2024-09-19T11:20:56.803 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T11:20:56.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T11:20:56.929 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912444 branch: wip-yuval-test description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7912444' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuval-test ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 rgw: compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuval-test sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 owner: scheduled_yuvalif@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 4251 sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 sleep_before_teardown: 0 subset: 1/3 suite: rgw suite_branch: wip-yuval-test suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 targets: smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB9Bn4+gcDJ8JTFkrYDWodL/rr3hTgZsnPffn+95U5x3Zs0ILtvVb16iZVsjUoAK9/KZ35etjm2W+inbk+KP7HY= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMnyycvKo4Vf9qg1VrhXk80tYnMMk5ZZYOEoMVLvJbH5XX3E+CWaxpkvM2du0kCF55CsJ5HqEtXIsuNnj1/U7No= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-19_08:49:34 tube: smithi user: yuvalif verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T11:20:56.929 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa; will attempt to use it 2024-09-19T11:20:56.930 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa/tasks 2024-09-19T11:20:56.930 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T11:20:56.932 INFO:teuthology.task.internal:Checking packages... 2024-09-19T11:20:56.952 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '08af21e0d16078b88ddf808fe9ba2ab84dbe6754' 2024-09-19T11:20:56.953 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T11:20:56.953 INFO:teuthology.packaging:ref: None 2024-09-19T11:20:56.953 INFO:teuthology.packaging:tag: None 2024-09-19T11:20:56.953 INFO:teuthology.packaging:branch: wip-yuval-test 2024-09-19T11:20:56.953 INFO:teuthology.packaging:sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:20:56.953 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuval-test 2024-09-19T11:20:57.099 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5012-g08af21e0-1jammy 2024-09-19T11:20:57.100 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T11:20:57.118 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T11:20:57.118 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T11:20:57.134 INFO:teuthology.task.internal:Saving configuration 2024-09-19T11:20:57.152 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T11:20:57.163 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T11:20:57.196 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 11:15:12.708199', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOdIgzTerQvDtF8zxQKSE1HR0KXxiwh+9BecIEejbdn5'} 2024-09-19T11:20:57.222 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 11:15:12.709934', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIACd6b2EzimQOAl68KYxr6B6e21K82Ng6O97UEaxkGuB'} 2024-09-19T11:20:57.222 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T11:20:57.233 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-19T11:20:57.233 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-19T11:20:57.234 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T11:20:57.316 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f27d90cfac0>, signals=[15]) 2024-09-19T11:20:57.316 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T11:20:57.325 INFO:teuthology.task.internal:Opening connections... 2024-09-19T11:20:57.325 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T11:20:57.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:20:57.413 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2024-09-19T11:20:57.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:20:57.505 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T11:20:57.514 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-09-19T11:20:57.518 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-09-19T11:20:57.519 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-09-19T11:20:57.569 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-19T11:20:57.569 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Ubuntu" 2024-09-19T11:20:57.569 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="22.04" 2024-09-19T11:20:57.570 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-19T11:20:57.570 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_CODENAME=jammy 2024-09-19T11:20:57.570 INFO:teuthology.orchestra.run.smithi120.stdout:ID=ubuntu 2024-09-19T11:20:57.570 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE=debian 2024-09-19T11:20:57.570 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-19T11:20:57.570 INFO:teuthology.orchestra.run.smithi120.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-19T11:20:57.570 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-19T11:20:57.570 INFO:teuthology.orchestra.run.smithi120.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-19T11:20:57.570 INFO:teuthology.orchestra.run.smithi120.stdout:UBUNTU_CODENAME=jammy 2024-09-19T11:20:57.571 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-09-19T11:20:57.605 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-09-19T11:20:57.610 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-09-19T11:20:57.610 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-09-19T11:20:57.663 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-19T11:20:57.663 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2024-09-19T11:20:57.663 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="22.04" 2024-09-19T11:20:57.663 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-19T11:20:57.663 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=jammy 2024-09-19T11:20:57.663 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2024-09-19T11:20:57.663 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2024-09-19T11:20:57.663 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-19T11:20:57.664 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-19T11:20:57.664 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-19T11:20:57.664 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-19T11:20:57.664 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=jammy 2024-09-19T11:20:57.664 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-09-19T11:20:57.689 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T11:20:57.700 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T11:20:57.710 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T11:20:57.711 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-09-19T11:20:57.713 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2024-09-19T11:20:57.717 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T11:20:57.729 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T11:20:57.729 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-09-19T11:20:57.763 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2024-09-19T11:20:57.785 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T11:20:57.861 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T11:20:57.877 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T11:20:57.877 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T11:20:57.878 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T11:20:57.878 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T11:20:57.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:20:57.883 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-19T11:20:57.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:20:57.884 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-09-19T11:20:57.931 INFO:teuthology.orchestra.run.smithi120.stdout:5.15.0-56-generic 2024-09-19T11:20:57.931 INFO:teuthology.task.kernel:Running kernel on smithi120: 5.15.0-56-generic 2024-09-19T11:20:57.931 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get clean 2024-09-19T11:20:57.932 INFO:teuthology.orchestra.run.smithi151.stdout:5.15.0-56-generic 2024-09-19T11:20:57.933 INFO:teuthology.task.kernel:Running kernel on smithi151: 5.15.0-56-generic 2024-09-19T11:20:57.933 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-09-19T11:20:58.055 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-09-19T11:20:58.070 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-09-19T11:20:58.183 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T11:20:58.203 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-19T11:20:58.204 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T11:20:58.228 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-19T11:20:58.266 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-19T11:20:58.297 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-19T11:20:58.299 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-19T11:20:58.322 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-19T11:20:58.405 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-19T11:20:58.451 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-19T11:20:58.508 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-19T11:20:58.513 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-19T11:20:58.516 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-19T11:20:58.516 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-19T11:20:58.535 INFO:teuthology.orchestra.run.smithi120.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-19T11:20:58.536 INFO:teuthology.orchestra.run.smithi120.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-19T11:20:58.539 INFO:teuthology.orchestra.run.smithi120.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-19T11:20:58.539 INFO:teuthology.orchestra.run.smithi120.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-19T11:20:58.543 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-19T11:20:58.545 INFO:teuthology.orchestra.run.smithi120.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-19T11:20:58.549 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-19T11:20:58.552 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-19T11:20:58.553 INFO:teuthology.orchestra.run.smithi120.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-19T11:20:58.553 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-19T11:20:58.554 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-19T11:20:58.555 INFO:teuthology.orchestra.run.smithi120.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-19T11:20:58.555 INFO:teuthology.orchestra.run.smithi120.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-19T11:20:58.555 INFO:teuthology.orchestra.run.smithi120.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-19T11:20:58.576 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-19T11:20:58.579 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-19T11:20:58.580 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-19T11:20:58.588 INFO:teuthology.orchestra.run.smithi120.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-19T11:20:58.589 INFO:teuthology.orchestra.run.smithi120.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-19T11:20:58.589 INFO:teuthology.orchestra.run.smithi120.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-19T11:20:58.589 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-19T11:20:58.591 INFO:teuthology.orchestra.run.smithi120.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-19T11:20:58.591 INFO:teuthology.orchestra.run.smithi120.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-19T11:20:58.591 INFO:teuthology.orchestra.run.smithi120.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-19T11:20:58.591 INFO:teuthology.orchestra.run.smithi120.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-19T11:20:58.591 INFO:teuthology.orchestra.run.smithi120.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-19T11:20:58.592 INFO:teuthology.orchestra.run.smithi120.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-19T11:20:58.592 INFO:teuthology.orchestra.run.smithi120.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-19T11:20:58.595 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-19T11:20:58.597 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-19T11:20:58.598 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-19T11:20:58.598 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-19T11:20:58.637 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-19T11:20:58.638 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-19T11:20:58.638 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-19T11:20:58.638 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-19T11:20:58.639 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-19T11:20:58.639 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-19T11:20:58.640 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-19T11:20:58.640 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-19T11:20:58.655 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-19T11:20:58.672 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-19T11:20:58.742 INFO:teuthology.orchestra.run.smithi120.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-19T11:20:58.791 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-19T11:20:59.026 INFO:teuthology.orchestra.run.smithi120.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-19T11:20:59.199 INFO:teuthology.orchestra.run.smithi120.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-19T11:20:59.211 INFO:teuthology.orchestra.run.smithi120.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-19T11:20:59.212 INFO:teuthology.orchestra.run.smithi120.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-19T11:20:59.214 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-19T11:20:59.230 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-19T11:20:59.239 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-19T11:20:59.239 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-19T11:20:59.298 INFO:teuthology.orchestra.run.smithi120.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-19T11:20:59.299 INFO:teuthology.orchestra.run.smithi120.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-19T11:20:59.307 INFO:teuthology.orchestra.run.smithi120.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-19T11:20:59.308 INFO:teuthology.orchestra.run.smithi120.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [903 kB] 2024-09-19T11:20:59.336 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-19T11:20:59.337 INFO:teuthology.orchestra.run.smithi120.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [628 kB] 2024-09-19T11:20:59.337 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-19T11:20:59.348 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-19T11:20:59.349 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [903 kB] 2024-09-19T11:20:59.360 INFO:teuthology.orchestra.run.smithi120.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-19T11:20:59.363 INFO:teuthology.orchestra.run.smithi120.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-19T11:20:59.366 INFO:teuthology.orchestra.run.smithi120.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-19T11:20:59.366 INFO:teuthology.orchestra.run.smithi120.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-19T11:20:59.377 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [628 kB] 2024-09-19T11:20:59.393 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-19T11:20:59.399 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-19T11:20:59.400 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-19T11:20:59.400 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-19T11:20:59.447 INFO:teuthology.orchestra.run.smithi120.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-19T11:20:59.447 INFO:teuthology.orchestra.run.smithi120.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-19T11:20:59.475 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-19T11:20:59.476 INFO:teuthology.orchestra.run.smithi151.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-19T11:21:04.857 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 16.2 MB in 2s (7,501 kB/s) 2024-09-19T11:21:04.875 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 16.2 MB in 2s (7,469 kB/s) 2024-09-19T11:21:06.220 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-19T11:21:06.239 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-19T11:21:06.301 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-19T11:21:06.420 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-19T11:21:06.437 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-19T11:21:06.490 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-19T11:21:06.513 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-09-19T11:21:06.514 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-09-19T11:21:06.676 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-19T11:21:06.677 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-19T11:21:06.701 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T11:21:06.701 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T11:21:06.702 INFO:teuthology.orchestra.run.smithi120.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T11:21:06.702 INFO:teuthology.orchestra.run.smithi120.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T11:21:06.702 INFO:teuthology.orchestra.run.smithi120.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-19T11:21:06.703 INFO:teuthology.orchestra.run.smithi120.stdout: python2.7-minimal 2024-09-19T11:21:06.703 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T11:21:06.704 INFO:teuthology.orchestra.run.smithi120.stdout:The following additional packages will be installed: 2024-09-19T11:21:06.704 INFO:teuthology.orchestra.run.smithi120.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-19T11:21:06.704 INFO:teuthology.orchestra.run.smithi120.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-19T11:21:06.704 INFO:teuthology.orchestra.run.smithi120.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-19T11:21:06.705 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2024-09-19T11:21:06.705 INFO:teuthology.orchestra.run.smithi120.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-19T11:21:06.706 INFO:teuthology.orchestra.run.smithi120.stdout:Recommended packages: 2024-09-19T11:21:06.706 INFO:teuthology.orchestra.run.smithi120.stdout: thermald 2024-09-19T11:21:06.747 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2024-09-19T11:21:06.747 INFO:teuthology.orchestra.run.smithi120.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-19T11:21:06.747 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-19T11:21:06.747 INFO:teuthology.orchestra.run.smithi120.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-19T11:21:06.749 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages will be upgraded: 2024-09-19T11:21:06.749 INFO:teuthology.orchestra.run.smithi120.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-19T11:21:06.844 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T11:21:06.844 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T11:21:06.844 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T11:21:06.845 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T11:21:06.845 INFO:teuthology.orchestra.run.smithi151.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-19T11:21:06.845 INFO:teuthology.orchestra.run.smithi151.stdout: python2.7-minimal 2024-09-19T11:21:06.845 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T11:21:06.846 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-09-19T11:21:06.846 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-19T11:21:06.846 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-19T11:21:06.847 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-19T11:21:06.848 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-09-19T11:21:06.848 INFO:teuthology.orchestra.run.smithi151.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-19T11:21:06.848 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-09-19T11:21:06.848 INFO:teuthology.orchestra.run.smithi151.stdout: thermald 2024-09-19T11:21:06.900 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-09-19T11:21:06.900 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-19T11:21:06.900 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-19T11:21:06.900 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-19T11:21:06.902 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages will be upgraded: 2024-09-19T11:21:06.902 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-19T11:21:06.929 INFO:teuthology.orchestra.run.smithi120.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-19T11:21:06.929 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 113 MB of archives. 2024-09-19T11:21:06.929 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-19T11:21:06.929 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-19T11:21:07.082 INFO:teuthology.orchestra.run.smithi151.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-19T11:21:07.082 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 113 MB of archives. 2024-09-19T11:21:07.082 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-19T11:21:07.082 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-19T11:21:08.348 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-19T11:21:08.465 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-19T11:21:08.696 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-19T11:21:08.816 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-19T11:21:10.955 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-19T11:21:10.955 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-19T11:21:10.955 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-19T11:21:11.030 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-19T11:21:11.030 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-19T11:21:11.030 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-19T11:21:11.300 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-19T11:21:11.378 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-19T11:21:11.412 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-19T11:21:11.498 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-19T11:21:11.778 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 113 MB in 5s (24.5 MB/s) 2024-09-19T11:21:11.888 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 113 MB in 5s (24.7 MB/s) 2024-09-19T11:21:11.959 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-19T11:21:12.067 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-19T11:21:13.987 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-19T11:21:13.992 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T11:21:14.047 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:14.156 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-19T11:21:14.161 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T11:21:14.239 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:16.318 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-19T11:21:16.339 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T11:21:16.365 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-19T11:21:16.386 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T11:21:16.478 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:16.690 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:16.948 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-19T11:21:16.969 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T11:21:17.001 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:17.176 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-19T11:21:17.197 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T11:21:17.234 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:23.852 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T11:21:23.884 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T11:21:23.963 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T11:21:24.011 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T11:21:24.303 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T11:21:24.361 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T11:21:24.425 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T11:21:24.482 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T11:21:24.736 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-19T11:21:24.759 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-19T11:21:24.785 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-19T11:21:24.803 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-19T11:21:24.807 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-19T11:21:24.851 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-19T11:21:30.355 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-19T11:21:30.393 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T11:21:30.421 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:30.736 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-19T11:21:30.773 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T11:21:30.802 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:33.380 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T11:21:33.488 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T11:21:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T11:21:33.671 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T11:21:34.789 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-19T11:21:34.910 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:34.914 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-19T11:21:35.037 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-19T11:21:35.044 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:35.165 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:35.170 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-19T11:21:35.324 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:36.481 INFO:teuthology.orchestra.run.smithi151.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-19T11:21:36.481 INFO:teuthology.orchestra.run.smithi151.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-19T11:21:36.481 INFO:teuthology.orchestra.run.smithi151.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-19T11:21:36.482 INFO:teuthology.orchestra.run.smithi151.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-19T11:21:36.642 INFO:teuthology.orchestra.run.smithi120.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-19T11:21:36.642 INFO:teuthology.orchestra.run.smithi120.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-19T11:21:36.642 INFO:teuthology.orchestra.run.smithi120.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-19T11:21:36.642 INFO:teuthology.orchestra.run.smithi120.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-19T11:21:36.642 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:36.802 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:38.027 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-19T11:21:38.152 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-19T11:21:38.195 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-19T11:21:38.278 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:38.296 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-19T11:21:38.397 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:39.697 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:39.791 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T11:21:39.847 INFO:teuthology.orchestra.run.smithi120.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-19T11:21:39.847 INFO:teuthology.orchestra.run.smithi120.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-19T11:21:40.540 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-19T11:21:40.540 INFO:teuthology.orchestra.run.smithi151.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-19T11:21:54.422 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-19T11:21:54.422 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub' 2024-09-19T11:21:54.431 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-19T11:21:54.443 INFO:teuthology.orchestra.run.smithi120.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-19T11:21:54.443 INFO:teuthology.orchestra.run.smithi120.stdout:Sourcing file `/etc/default/grub' 2024-09-19T11:21:54.456 INFO:teuthology.orchestra.run.smithi151.stdout:Generating grub configuration file ... 2024-09-19T11:21:54.458 INFO:teuthology.orchestra.run.smithi120.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-19T11:21:54.480 INFO:teuthology.orchestra.run.smithi120.stdout:Generating grub configuration file ... 2024-09-19T11:21:54.724 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-19T11:21:54.747 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-19T11:21:54.797 INFO:teuthology.orchestra.run.smithi120.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-19T11:21:54.816 INFO:teuthology.orchestra.run.smithi120.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-19T11:21:55.013 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-19T11:21:55.019 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-19T11:21:55.089 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-19T11:21:55.095 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-19T11:21:55.123 INFO:teuthology.orchestra.run.smithi120.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-19T11:21:55.128 INFO:teuthology.orchestra.run.smithi120.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-19T11:21:55.193 INFO:teuthology.orchestra.run.smithi120.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-19T11:21:55.198 INFO:teuthology.orchestra.run.smithi120.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-19T11:21:55.256 INFO:teuthology.orchestra.run.smithi151.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-19T11:21:55.256 INFO:teuthology.orchestra.run.smithi151.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-19T11:21:55.256 INFO:teuthology.orchestra.run.smithi151.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-19T11:21:55.304 INFO:teuthology.orchestra.run.smithi151.stdout:done 2024-09-19T11:21:55.366 INFO:teuthology.orchestra.run.smithi120.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-19T11:21:55.366 INFO:teuthology.orchestra.run.smithi120.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-19T11:21:55.366 INFO:teuthology.orchestra.run.smithi120.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-19T11:21:55.408 INFO:teuthology.orchestra.run.smithi120.stdout:done 2024-09-19T11:21:55.804 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-09-19T11:21:55.830 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-09-19T11:21:55.831 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-09-19T11:21:55.831 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-09-19T11:21:55.831 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-09-19T11:21:55.831 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 21 2024-09-19T11:21:55.831 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-09-19T11:21:55.831 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-09-19T11:21:55.831 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-09-19T11:21:55.831 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.15.0.122.122 2024-09-19T11:21:55.831 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-19T11:21:55.831 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-19T11:21:55.831 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-09-19T11:21:55.831 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-09-19T11:21:55.831 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-09-19T11:21:55.832 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-09-19T11:21:55.832 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-19T11:21:55.833 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T11:21:55.833 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T11:21:55.833 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-19T11:21:55.833 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T11:21:55.833 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-09-19T11:21:55.882 DEBUG:teuthology.orchestra.run.smithi120:> dpkg -s linux-image-generic 2024-09-19T11:21:55.909 INFO:teuthology.orchestra.run.smithi120.stdout:Package: linux-image-generic 2024-09-19T11:21:55.909 INFO:teuthology.orchestra.run.smithi120.stdout:Status: install ok installed 2024-09-19T11:21:55.909 INFO:teuthology.orchestra.run.smithi120.stdout:Priority: optional 2024-09-19T11:21:55.909 INFO:teuthology.orchestra.run.smithi120.stdout:Section: kernel 2024-09-19T11:21:55.909 INFO:teuthology.orchestra.run.smithi120.stdout:Installed-Size: 21 2024-09-19T11:21:55.909 INFO:teuthology.orchestra.run.smithi120.stdout:Maintainer: Ubuntu Kernel Team 2024-09-19T11:21:55.909 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: amd64 2024-09-19T11:21:55.909 INFO:teuthology.orchestra.run.smithi120.stdout:Source: linux-meta 2024-09-19T11:21:55.910 INFO:teuthology.orchestra.run.smithi120.stdout:Version: 5.15.0.122.122 2024-09-19T11:21:55.910 INFO:teuthology.orchestra.run.smithi120.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-19T11:21:55.910 INFO:teuthology.orchestra.run.smithi120.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-19T11:21:55.910 INFO:teuthology.orchestra.run.smithi120.stdout:Recommends: thermald 2024-09-19T11:21:55.910 INFO:teuthology.orchestra.run.smithi120.stdout:Description: Generic Linux kernel image 2024-09-19T11:21:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: This package will always depend on the latest generic kernel image 2024-09-19T11:21:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: available. 2024-09-19T11:21:55.910 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-19T11:21:55.910 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T11:21:55.910 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T11:21:55.910 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-19T11:21:55.910 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi120.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T11:21:55.911 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get clean 2024-09-19T11:21:55.969 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-09-19T11:21:56.067 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-09-19T11:21:56.074 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-19T11:21:56.206 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T11:21:56.277 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-19T11:21:56.317 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T11:21:56.317 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-19T11:21:56.359 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-19T11:21:56.387 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-19T11:21:56.468 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-19T11:21:57.464 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-19T11:21:57.482 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-19T11:21:57.535 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-19T11:21:57.719 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-19T11:21:57.723 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-19T11:21:57.723 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-19T11:21:57.736 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-19T11:21:57.788 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-19T11:21:57.891 INFO:teuthology.orchestra.run.smithi151.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-19T11:21:57.891 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T11:21:57.891 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T11:21:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T11:21:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T11:21:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T11:21:57.892 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T11:21:57.892 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T11:21:57.933 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-19T11:21:57.934 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-09-19T11:21:57.974 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-09-19T11:21:57.975 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-09-19T11:21:57.994 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-09-19T11:21:57.994 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-09-19T11:21:57.995 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-09-19T11:21:57.995 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-09-19T11:21:57.995 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 21 2024-09-19T11:21:57.995 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-09-19T11:21:57.995 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-09-19T11:21:57.995 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-09-19T11:21:57.995 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.15.0.122.122 2024-09-19T11:21:57.996 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-19T11:21:57.996 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-19T11:21:57.996 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-09-19T11:21:57.996 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-09-19T11:21:57.996 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-09-19T11:21:57.996 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-09-19T11:21:57.997 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-09-19T11:21:58.046 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.aaOPQaffcs 2024-09-19T11:21:58.047 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub/grub.cfg /tmp/tmp.aaOPQaffcs 2024-09-19T11:21:58.103 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.aaOPQaffcs 2024-09-19T11:21:58.139 INFO:teuthology.orchestra.run.smithi120.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-19T11:21:58.139 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T11:21:58.139 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T11:21:58.139 INFO:teuthology.orchestra.run.smithi120.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T11:21:58.140 INFO:teuthology.orchestra.run.smithi120.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T11:21:58.140 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T11:21:58.140 INFO:teuthology.orchestra.run.smithi120.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T11:21:58.140 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T11:21:58.179 INFO:teuthology.orchestra.run.smithi120.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-19T11:21:58.181 DEBUG:teuthology.orchestra.run.smithi120:> dpkg -s linux-image-generic 2024-09-19T11:21:58.235 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.aaOPQaffcs is 10KB 2024-09-19T11:21:58.237 INFO:teuthology.orchestra.run.smithi120.stdout:Package: linux-image-generic 2024-09-19T11:21:58.237 INFO:teuthology.orchestra.run.smithi120.stdout:Status: install ok installed 2024-09-19T11:21:58.238 INFO:teuthology.orchestra.run.smithi120.stdout:Priority: optional 2024-09-19T11:21:58.238 INFO:teuthology.orchestra.run.smithi120.stdout:Section: kernel 2024-09-19T11:21:58.238 INFO:teuthology.orchestra.run.smithi120.stdout:Installed-Size: 21 2024-09-19T11:21:58.238 INFO:teuthology.orchestra.run.smithi120.stdout:Maintainer: Ubuntu Kernel Team 2024-09-19T11:21:58.238 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: amd64 2024-09-19T11:21:58.239 INFO:teuthology.orchestra.run.smithi120.stdout:Source: linux-meta 2024-09-19T11:21:58.239 INFO:teuthology.orchestra.run.smithi120.stdout:Version: 5.15.0.122.122 2024-09-19T11:21:58.239 INFO:teuthology.orchestra.run.smithi120.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-19T11:21:58.239 INFO:teuthology.orchestra.run.smithi120.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-19T11:21:58.239 INFO:teuthology.orchestra.run.smithi120.stdout:Recommends: thermald 2024-09-19T11:21:58.240 INFO:teuthology.orchestra.run.smithi120.stdout:Description: Generic Linux kernel image 2024-09-19T11:21:58.240 INFO:teuthology.orchestra.run.smithi120.stdout: This package will always depend on the latest generic kernel image 2024-09-19T11:21:58.240 INFO:teuthology.orchestra.run.smithi120.stdout: available. 2024-09-19T11:21:58.240 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-19T11:21:58.254 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.aaOPQaffcs 2024-09-19T11:21:58.260 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-19T11:21:58.285 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.xVvZIq4n7w 2024-09-19T11:21:58.285 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /boot/grub/grub.cfg /tmp/tmp.xVvZIq4n7w 2024-09-19T11:21:58.315 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:21:58.315 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-19T11:21:58.315 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-19T11:21:58.340 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.xVvZIq4n7w 2024-09-19T11:21:58.382 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-19T11:21:58.382 DEBUG:teuthology.orchestra.run.smithi151:> sudo update-grub 2024-09-19T11:21:58.465 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.xVvZIq4n7w is 10KB 2024-09-19T11:21:58.478 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.xVvZIq4n7w 2024-09-19T11:21:58.483 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-19T11:21:58.537 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:21:58.537 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-19T11:21:58.537 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-19T11:21:58.611 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-19T11:21:58.611 DEBUG:teuthology.orchestra.run.smithi120:> sudo update-grub 2024-09-19T11:21:59.779 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub' 2024-09-19T11:21:59.780 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-19T11:21:59.782 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2024-09-19T11:21:59.862 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub' 2024-09-19T11:21:59.863 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-19T11:21:59.865 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-09-19T11:21:59.959 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-19T11:21:59.965 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-19T11:22:00.051 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-19T11:22:00.057 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-19T11:22:00.185 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-19T11:22:00.190 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-19T11:22:00.229 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-19T11:22:00.233 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-19T11:22:00.291 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-19T11:22:00.296 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-19T11:22:00.335 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-19T11:22:00.340 INFO:teuthology.orchestra.run.smithi151.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-19T11:22:00.341 INFO:teuthology.orchestra.run.smithi151.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-19T11:22:00.341 INFO:teuthology.orchestra.run.smithi151.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-19T11:22:00.341 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-19T11:22:00.350 INFO:teuthology.orchestra.run.smithi151.stderr:done 2024-09-19T11:22:00.362 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2024-09-19T11:22:00.479 INFO:teuthology.orchestra.run.smithi120.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-19T11:22:00.479 INFO:teuthology.orchestra.run.smithi120.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-19T11:22:00.479 INFO:teuthology.orchestra.run.smithi120.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-19T11:22:00.490 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-09-19T11:22:00.500 DEBUG:teuthology.orchestra.run.smithi120:> sudo shutdown -r now 2024-09-19T11:22:30.393 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-19T11:22:30.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-19T11:22:30.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:22:30.504 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-19T11:22:30.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-19T11:22:30.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:22:48.769 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-19T11:22:49.021 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-19T11:22:57.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-19T11:22:57.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:22:58.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-19T11:22:58.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:23:00.865 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-19T11:23:01.089 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-19T11:23:12.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-19T11:23:12.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:23:13.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-19T11:23:13.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:23:31.517 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-19T11:23:46.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-19T11:23:46.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:23:47.145 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-19T11:23:48.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-19T11:23:48.198 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-19T11:23:48.198 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-19T11:23:48.245 INFO:teuthology.orchestra.run.smithi120.stdout:5.15.0-122-generic 2024-09-19T11:23:48.245 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-19T11:23:48.246 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T11:23:48.246 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-19T11:23:49.246 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-19T11:23:49.247 DEBUG:teuthology.orchestra.run.smithi120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T11:23:49.337 INFO:teuthology.orchestra.run.smithi120.stdout:ttyS1 2024-09-19T11:23:49.367 DEBUG:teuthology.parallel:result is None 2024-09-19T11:24:12.886 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T11:24:27.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-19T11:24:27.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:24:28.191 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-09-19T11:24:28.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-19T11:24:28.766 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-122-generic"... 2024-09-19T11:24:28.766 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-09-19T11:24:28.812 INFO:teuthology.orchestra.run.smithi151.stdout:5.15.0-122-generic 2024-09-19T11:24:28.812 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-19T11:24:28.812 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T11:24:28.812 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-19T11:24:29.813 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-19T11:24:29.813 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T11:24:30.140 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2024-09-19T11:24:30.170 DEBUG:teuthology.parallel:result is None 2024-09-19T11:24:30.170 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T11:24:30.177 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T11:24:30.177 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T11:24:30.180 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T11:24:30.186 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T11:24:30.249 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T11:24:30.259 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T11:24:30.259 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T11:24:30.262 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T11:24:30.430 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T11:24:30.437 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T11:24:30.438 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T11:24:30.440 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T11:24:30.458 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T11:24:30.466 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T11:24:30.475 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T11:24:30.484 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T11:24:30.485 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T11:24:30.492 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T11:24:30.492 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T11:24:30.513 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T11:24:30.540 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T11:24:30.548 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T11:24:30.548 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T11:24:30.569 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T11:24:30.588 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T11:24:30.620 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T11:24:30.668 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:24:30.669 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T11:24:30.736 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T11:24:30.742 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T11:24:30.789 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:24:30.789 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T11:24:30.855 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-09-19T11:24:30.858 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2024-09-19T11:24:30.935 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T11:24:30.942 INFO:teuthology.task.internal:Starting timer... 2024-09-19T11:24:30.943 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T11:24:30.954 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T11:24:30.963 DEBUG:teuthology.task.selinux:Excluding smithi120: OS 'ubuntu' does not support SELinux 2024-09-19T11:24:30.963 DEBUG:teuthology.task.selinux:Excluding smithi151: OS 'ubuntu' does not support SELinux 2024-09-19T11:24:30.963 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T11:24:30.963 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-19T11:24:30.963 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T11:24:30.963 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T11:24:30.972 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T11:24:30.975 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T11:24:31.091 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T11:24:31.102 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T11:24:31.103 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi120.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T11:32:00.254 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi120.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2024-09-19T11:32:00.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-19T11:32:00.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:32:00.346 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-19T11:32:00.425 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-19T11:32:00.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-19T11:32:00.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:32:00.529 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-09-19T11:32:00.609 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-19T11:32:00.609 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T11:32:00.622 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T11:32:00.622 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T11:32:00.622 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T11:32:00.625 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T11:32:00.625 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T11:32:00.652 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-19T11:32:00.653 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: Command line: ntpd -gq 2024-09-19T11:32:00.653 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: ---------------------------------------------------- 2024-09-19T11:32:00.653 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: ntp-4 is maintained by Network Time Foundation, 2024-09-19T11:32:00.653 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-19T11:32:00.653 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: corporation. Support and training for ntp-4 are 2024-09-19T11:32:00.653 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: available at https://www.nwtime.org/support 2024-09-19T11:32:00.653 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: ---------------------------------------------------- 2024-09-19T11:32:00.655 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: proto: precision = 0.059 usec (-24) 2024-09-19T11:32:00.655 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: basedate set to 2022-02-04 2024-09-19T11:32:00.655 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: gps base set to 2022-02-06 (week 2196) 2024-09-19T11:32:00.655 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-19T11:32:00.655 INFO:teuthology.orchestra.run.smithi120.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-19T11:32:00.655 INFO:teuthology.orchestra.run.smithi120.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-19T11:32:00.656 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: restrict ::: KOD does nothing without LIMITED. 2024-09-19T11:32:00.656 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: Listen and drop on 0 v6wildcard [::]:123 2024-09-19T11:32:00.656 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-19T11:32:00.656 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: Listen normally on 2 lo 127.0.0.1:123 2024-09-19T11:32:00.657 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: Listen normally on 3 enp3s0f1 172.21.15.120:123 2024-09-19T11:32:00.657 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: Listen normally on 4 lo [::1]:123 2024-09-19T11:32:00.657 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:478f%5]:123 2024-09-19T11:32:00.657 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:00 ntpd[18457]: Listening on routing socket on fd #22 for interface updates 2024-09-19T11:32:00.679 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-19T11:32:00.679 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: Command line: ntpd -gq 2024-09-19T11:32:00.679 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: ---------------------------------------------------- 2024-09-19T11:32:00.680 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: ntp-4 is maintained by Network Time Foundation, 2024-09-19T11:32:00.680 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-19T11:32:00.680 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: corporation. Support and training for ntp-4 are 2024-09-19T11:32:00.680 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: available at https://www.nwtime.org/support 2024-09-19T11:32:00.680 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: ---------------------------------------------------- 2024-09-19T11:32:00.680 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: proto: precision = 0.045 usec (-24) 2024-09-19T11:32:00.681 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: basedate set to 2022-02-04 2024-09-19T11:32:00.681 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: gps base set to 2022-02-06 (week 2196) 2024-09-19T11:32:00.681 INFO:teuthology.orchestra.run.smithi151.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-19T11:32:00.681 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-19T11:32:00.681 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: restrict ::: KOD does nothing without LIMITED. 2024-09-19T11:32:00.682 INFO:teuthology.orchestra.run.smithi151.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-19T11:32:00.683 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: Listen and drop on 0 v6wildcard [::]:123 2024-09-19T11:32:00.683 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-19T11:32:00.683 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: Listen normally on 2 lo 127.0.0.1:123 2024-09-19T11:32:00.683 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: Listen normally on 3 enp3s0f1 172.21.15.151:123 2024-09-19T11:32:00.683 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: Listen normally on 4 lo [::1]:123 2024-09-19T11:32:00.683 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f63%5]:123 2024-09-19T11:32:00.683 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:00 ntpd[18468]: Listening on routing socket on fd #22 for interface updates 2024-09-19T11:32:01.680 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:01 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:01.680 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:01 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:01.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:01 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:01.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:01 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:01.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:01 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:01.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:01 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:01.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:01 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:01.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:01 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:01.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:01 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:01.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:01 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:01.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:01 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:01.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:01 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:02.653 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:02 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:02.653 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:02 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:02.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:02 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:02.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:02 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:02.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:02 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:02.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:02 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:02.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:02 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:02.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:02 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:03.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:03.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:03.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:03.683 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:03.683 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:03.683 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:03 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:04.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:04 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:04.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:04 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:04.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:04 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:04.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:04 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:04.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:04 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:04.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:04 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:04.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:04 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:04.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:04 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:04.655 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:04 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:04.655 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:04 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:04.655 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:04 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:04.655 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:04 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:05.653 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:05 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:05.653 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:05 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:05.653 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:05 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:05.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:05 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:05.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:05 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:05.655 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:05 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:05.683 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:05.683 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:05.683 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:05.684 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:05.684 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:05.684 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:05.684 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:05.684 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:05.685 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:05.685 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:05.685 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:05.685 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:05.685 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:05.685 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:05.685 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:05.685 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:05.686 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:05.686 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:05 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:06.653 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:06 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:06.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:06 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:06.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:06 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:06.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:06 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:06.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:06 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:06.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:06 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:06.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:06 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:06.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:06 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:06.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:06 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:06.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:06 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:06.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:06 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:06.655 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:06 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:07.653 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:07 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:07.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:07 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:07.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:07 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:07.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:07 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:07.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:07 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:07.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:07 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:07.680 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:07.680 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:07.681 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:07.682 INFO:teuthology.orchestra.run.smithi151.stdout:19 Sep 11:32:07 ntpd[18468]: ntpd: time slew -0.000528 s 2024-09-19T11:32:07.682 INFO:teuthology.orchestra.run.smithi151.stdout:ntpd: time slew -0.000528s 2024-09-19T11:32:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-19T11:32:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:19 Sep 11:32:07 ntpd[18468]: can't open /var/log/ntpstats/loopstats.20240919: Permission denied 2024-09-19T11:32:07.726 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-09-19T11:32:07.726 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-09-19T11:32:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T11:32:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T11:32:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T11:32:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T11:32:08.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:08 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:08.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:08 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:08.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:08 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:08.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:08 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:08.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:08 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:08.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:08 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:08.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:08 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:08.654 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:08 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:08.655 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:08 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T11:32:08.655 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:08 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T11:32:08.655 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:08 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T11:32:08.655 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:08 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T11:32:08.655 INFO:teuthology.orchestra.run.smithi120.stdout:19 Sep 11:32:08 ntpd[18457]: ntpd: time slew -0.000706 s 2024-09-19T11:32:08.655 INFO:teuthology.orchestra.run.smithi120.stdout:ntpd: time slew -0.000706s 2024-09-19T11:32:08.655 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:08 ntpd[18457]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-19T11:32:08.656 INFO:teuthology.orchestra.run.smithi120.stderr:19 Sep 11:32:08 ntpd[18457]: can't open /var/log/ntpstats/loopstats.20240919: Permission denied 2024-09-19T11:32:08.706 INFO:teuthology.orchestra.run.smithi120.stdout: remote refid st t when poll reach delay offset jitter 2024-09-19T11:32:08.706 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================== 2024-09-19T11:32:08.706 INFO:teuthology.orchestra.run.smithi120.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T11:32:08.706 INFO:teuthology.orchestra.run.smithi120.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T11:32:08.707 INFO:teuthology.orchestra.run.smithi120.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T11:32:08.707 INFO:teuthology.orchestra.run.smithi120.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T11:32:08.707 INFO:teuthology.run_tasks:Running task install... 2024-09-19T11:32:08.718 DEBUG:teuthology.task.install:project ceph 2024-09-19T11:32:08.719 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}} 2024-09-19T11:32:08.719 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'} 2024-09-19T11:32:08.719 INFO:teuthology.task.install:Using flavor: default 2024-09-19T11:32:08.724 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T11:32:08.724 INFO:teuthology.task.install:extra packages: [] 2024-09-19T11:32:08.725 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-key list | grep Ceph 2024-09-19T11:32:08.725 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-key list | grep Ceph 2024-09-19T11:32:08.789 INFO:teuthology.orchestra.run.smithi151.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-19T11:32:08.808 INFO:teuthology.orchestra.run.smithi120.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-19T11:32:08.819 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-19T11:32:08.819 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph.com (release key) 2024-09-19T11:32:08.820 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-19T11:32:08.820 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-19T11:32:08.821 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:32:08.836 INFO:teuthology.orchestra.run.smithi120.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-19T11:32:08.836 INFO:teuthology.orchestra.run.smithi120.stdout:uid [ unknown] Ceph.com (release key) 2024-09-19T11:32:08.836 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-19T11:32:08.836 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-19T11:32:08.836 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:32:08.979 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default/ 2024-09-19T11:32:08.979 INFO:teuthology.task.install.deb:Package version is 19.3.0-5012-g08af21e0-1jammy 2024-09-19T11:32:08.990 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default/ 2024-09-19T11:32:08.990 INFO:teuthology.task.install.deb:Package version is 19.3.0-5012-g08af21e0-1jammy 2024-09-19T11:32:09.100 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:32:09.100 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-19T11:32:09.107 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:32:09.107 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-19T11:32:09.114 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-09-19T11:32:09.121 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-09-19T11:32:09.281 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T11:32:09.281 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-19T11:32:09.290 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-19T11:32:09.291 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-19T11:32:09.310 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-19T11:32:09.337 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy InRelease 2024-09-19T11:32:09.343 INFO:teuthology.orchestra.run.smithi120.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy InRelease 2024-09-19T11:32:09.359 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-19T11:32:09.365 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-19T11:32:09.381 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-19T11:32:09.389 INFO:teuthology.orchestra.run.smithi120.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-19T11:32:09.402 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,432 B] 2024-09-19T11:32:09.410 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-19T11:32:09.416 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T11:32:09.428 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-19T11:32:09.437 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,432 B] 2024-09-19T11:32:09.492 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-19T11:32:09.574 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-19T11:32:09.633 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 29.3 kB in 0s (86.0 kB/s) 2024-09-19T11:32:09.723 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 29.3 kB in 0s (69.8 kB/s) 2024-09-19T11:32:10.665 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-19T11:32:10.682 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-5012-g08af21e0-1jammy cephadm=19.3.0-5012-g08af21e0-1jammy ceph-mds=19.3.0-5012-g08af21e0-1jammy ceph-mgr=19.3.0-5012-g08af21e0-1jammy ceph-common=19.3.0-5012-g08af21e0-1jammy ceph-fuse=19.3.0-5012-g08af21e0-1jammy ceph-test=19.3.0-5012-g08af21e0-1jammy ceph-volume=19.3.0-5012-g08af21e0-1jammy radosgw=19.3.0-5012-g08af21e0-1jammy python3-rados=19.3.0-5012-g08af21e0-1jammy python3-rgw=19.3.0-5012-g08af21e0-1jammy python3-cephfs=19.3.0-5012-g08af21e0-1jammy python3-rbd=19.3.0-5012-g08af21e0-1jammy libcephfs2=19.3.0-5012-g08af21e0-1jammy libcephfs-dev=19.3.0-5012-g08af21e0-1jammy librados2=19.3.0-5012-g08af21e0-1jammy librbd1=19.3.0-5012-g08af21e0-1jammy rbd-fuse=19.3.0-5012-g08af21e0-1jammy 2024-09-19T11:32:10.738 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-19T11:32:10.778 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-19T11:32:10.795 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-5012-g08af21e0-1jammy cephadm=19.3.0-5012-g08af21e0-1jammy ceph-mds=19.3.0-5012-g08af21e0-1jammy ceph-mgr=19.3.0-5012-g08af21e0-1jammy ceph-common=19.3.0-5012-g08af21e0-1jammy ceph-fuse=19.3.0-5012-g08af21e0-1jammy ceph-test=19.3.0-5012-g08af21e0-1jammy ceph-volume=19.3.0-5012-g08af21e0-1jammy radosgw=19.3.0-5012-g08af21e0-1jammy python3-rados=19.3.0-5012-g08af21e0-1jammy python3-rgw=19.3.0-5012-g08af21e0-1jammy python3-cephfs=19.3.0-5012-g08af21e0-1jammy python3-rbd=19.3.0-5012-g08af21e0-1jammy libcephfs2=19.3.0-5012-g08af21e0-1jammy libcephfs-dev=19.3.0-5012-g08af21e0-1jammy librados2=19.3.0-5012-g08af21e0-1jammy librbd1=19.3.0-5012-g08af21e0-1jammy rbd-fuse=19.3.0-5012-g08af21e0-1jammy 2024-09-19T11:32:10.856 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-19T11:32:10.925 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-19T11:32:10.926 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-19T11:32:11.069 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-09-19T11:32:11.070 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-09-19T11:32:11.111 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T11:32:11.111 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T11:32:11.111 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T11:32:11.111 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T11:32:11.112 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T11:32:11.112 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T11:32:11.112 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T11:32:11.113 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-09-19T11:32:11.117 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-19T11:32:11.117 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-19T11:32:11.117 INFO:teuthology.orchestra.run.smithi151.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-19T11:32:11.117 INFO:teuthology.orchestra.run.smithi151.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-19T11:32:11.117 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-19T11:32:11.118 INFO:teuthology.orchestra.run.smithi151.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-19T11:32:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-19T11:32:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-19T11:32:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-19T11:32:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-19T11:32:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-19T11:32:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-19T11:32:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-19T11:32:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-19T11:32:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-19T11:32:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-19T11:32:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-19T11:32:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-19T11:32:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-19T11:32:11.120 INFO:teuthology.orchestra.run.smithi151.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-19T11:32:11.120 INFO:teuthology.orchestra.run.smithi151.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-19T11:32:11.120 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-19T11:32:11.120 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-19T11:32:11.120 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet zip 2024-09-19T11:32:11.120 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-09-19T11:32:11.120 INFO:teuthology.orchestra.run.smithi151.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-19T11:32:11.120 INFO:teuthology.orchestra.run.smithi151.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-19T11:32:11.120 INFO:teuthology.orchestra.run.smithi151.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-19T11:32:11.120 INFO:teuthology.orchestra.run.smithi151.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-19T11:32:11.120 INFO:teuthology.orchestra.run.smithi151.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-19T11:32:11.120 INFO:teuthology.orchestra.run.smithi151.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-19T11:32:11.120 INFO:teuthology.orchestra.run.smithi151.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-19T11:32:11.121 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-09-19T11:32:11.121 INFO:teuthology.orchestra.run.smithi151.stdout: btrfs-tools 2024-09-19T11:32:11.219 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-09-19T11:32:11.220 INFO:teuthology.orchestra.run.smithi151.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-19T11:32:11.220 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-19T11:32:11.220 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-19T11:32:11.220 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-19T11:32:11.220 INFO:teuthology.orchestra.run.smithi151.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-19T11:32:11.220 INFO:teuthology.orchestra.run.smithi151.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-19T11:32:11.221 INFO:teuthology.orchestra.run.smithi151.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-19T11:32:11.221 INFO:teuthology.orchestra.run.smithi151.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-19T11:32:11.221 INFO:teuthology.orchestra.run.smithi151.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-19T11:32:11.221 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-19T11:32:11.221 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-19T11:32:11.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-19T11:32:11.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-19T11:32:11.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-19T11:32:11.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-19T11:32:11.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-19T11:32:11.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-19T11:32:11.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-19T11:32:11.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-19T11:32:11.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-19T11:32:11.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-19T11:32:11.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-19T11:32:11.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-19T11:32:11.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-19T11:32:11.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-19T11:32:11.223 INFO:teuthology.orchestra.run.smithi151.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-19T11:32:11.266 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T11:32:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T11:32:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T11:32:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T11:32:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T11:32:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T11:32:11.267 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T11:32:11.268 INFO:teuthology.orchestra.run.smithi120.stdout:The following additional packages will be installed: 2024-09-19T11:32:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-19T11:32:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-19T11:32:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-19T11:32:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-19T11:32:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-19T11:32:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-19T11:32:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-19T11:32:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-19T11:32:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-19T11:32:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-19T11:32:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-19T11:32:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-19T11:32:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-19T11:32:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-19T11:32:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-19T11:32:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-19T11:32:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-19T11:32:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-19T11:32:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-19T11:32:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-19T11:32:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-19T11:32:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-19T11:32:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-19T11:32:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet zip 2024-09-19T11:32:11.271 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2024-09-19T11:32:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-19T11:32:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-19T11:32:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-19T11:32:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-19T11:32:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-19T11:32:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-19T11:32:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-19T11:32:11.272 INFO:teuthology.orchestra.run.smithi120.stdout:Recommended packages: 2024-09-19T11:32:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: btrfs-tools 2024-09-19T11:32:11.283 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-19T11:32:11.283 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 244 MB of archives. 2024-09-19T11:32:11.283 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 909 MB of additional disk space will be used. 2024-09-19T11:32:11.283 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-19T11:32:11.369 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-5012-g08af21e0-1jammy [3,634 kB] 2024-09-19T11:32:11.372 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2024-09-19T11:32:11.372 INFO:teuthology.orchestra.run.smithi120.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-19T11:32:11.373 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-19T11:32:11.373 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-19T11:32:11.374 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-19T11:32:11.374 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-19T11:32:11.374 INFO:teuthology.orchestra.run.smithi120.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-19T11:32:11.375 INFO:teuthology.orchestra.run.smithi120.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-19T11:32:11.375 INFO:teuthology.orchestra.run.smithi120.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-19T11:32:11.375 INFO:teuthology.orchestra.run.smithi120.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-19T11:32:11.375 INFO:teuthology.orchestra.run.smithi120.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-19T11:32:11.375 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-19T11:32:11.375 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-19T11:32:11.375 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-19T11:32:11.375 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-19T11:32:11.375 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-19T11:32:11.375 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-19T11:32:11.375 INFO:teuthology.orchestra.run.smithi120.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-19T11:32:11.375 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-19T11:32:11.375 INFO:teuthology.orchestra.run.smithi120.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-19T11:32:11.376 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-19T11:32:11.376 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-19T11:32:11.376 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-19T11:32:11.376 INFO:teuthology.orchestra.run.smithi120.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-19T11:32:11.376 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-19T11:32:11.376 INFO:teuthology.orchestra.run.smithi120.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-19T11:32:11.376 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-19T11:32:11.376 INFO:teuthology.orchestra.run.smithi120.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-19T11:32:11.376 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-19T11:32:11.393 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-19T11:32:11.434 INFO:teuthology.orchestra.run.smithi120.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-19T11:32:11.434 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 244 MB of archives. 2024-09-19T11:32:11.435 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 909 MB of additional disk space will be used. 2024-09-19T11:32:11.435 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-19T11:32:11.454 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-19T11:32:11.459 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-19T11:32:11.472 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-19T11:32:11.476 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-19T11:32:11.477 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-19T11:32:11.478 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-19T11:32:11.479 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-19T11:32:11.487 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-19T11:32:11.489 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-19T11:32:11.491 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-19T11:32:11.493 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-19T11:32:11.494 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-19T11:32:11.511 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-19T11:32:11.513 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-19T11:32:11.515 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-19T11:32:11.515 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-19T11:32:11.516 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-19T11:32:11.517 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-19T11:32:11.517 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-19T11:32:11.518 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-19T11:32:11.520 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-5012-g08af21e0-1jammy [3,634 kB] 2024-09-19T11:32:11.521 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-19T11:32:11.524 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-19T11:32:11.529 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-19T11:32:11.529 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-19T11:32:11.541 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-19T11:32:11.545 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-19T11:32:11.545 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-19T11:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-19T11:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-19T11:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-19T11:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-19T11:32:11.550 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-19T11:32:11.551 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-19T11:32:11.560 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-5012-g08af21e0-1jammy [3,336 kB] 2024-09-19T11:32:11.562 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-19T11:32:11.563 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-19T11:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-19T11:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-19T11:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-19T11:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-19T11:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-19T11:32:11.586 INFO:teuthology.orchestra.run.smithi151.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-19T11:32:11.587 INFO:teuthology.orchestra.run.smithi151.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-19T11:32:11.589 INFO:teuthology.orchestra.run.smithi151.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-19T11:32:11.596 INFO:teuthology.orchestra.run.smithi151.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-19T11:32:11.597 INFO:teuthology.orchestra.run.smithi151.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-19T11:32:11.608 INFO:teuthology.orchestra.run.smithi151.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-19T11:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-19T11:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-5012-g08af21e0-1jammy [722 kB] 2024-09-19T11:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-19T11:32:11.612 INFO:teuthology.orchestra.run.smithi151.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-19T11:32:11.613 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-19T11:32:11.614 INFO:teuthology.orchestra.run.smithi151.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-19T11:32:11.617 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-19T11:32:11.625 INFO:teuthology.orchestra.run.smithi151.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-5012-g08af21e0-1jammy [356 kB] 2024-09-19T11:32:11.630 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-19T11:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-5012-g08af21e0-1jammy [32.8 kB] 2024-09-19T11:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-5012-g08af21e0-1jammy [180 kB] 2024-09-19T11:32:11.635 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-19T11:32:11.635 INFO:teuthology.orchestra.run.smithi120.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-19T11:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-5012-g08af21e0-1jammy [72.8 kB] 2024-09-19T11:32:11.636 INFO:teuthology.orchestra.run.smithi120.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-19T11:32:11.637 INFO:teuthology.orchestra.run.smithi120.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-19T11:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-5012-g08af21e0-1jammy [338 kB] 2024-09-19T11:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-5012-g08af21e0-1jammy [7,969 kB] 2024-09-19T11:32:11.645 INFO:teuthology.orchestra.run.smithi120.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-19T11:32:11.648 INFO:teuthology.orchestra.run.smithi120.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-19T11:32:11.650 INFO:teuthology.orchestra.run.smithi120.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-19T11:32:11.652 INFO:teuthology.orchestra.run.smithi120.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-19T11:32:11.652 INFO:teuthology.orchestra.run.smithi120.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-19T11:32:11.667 INFO:teuthology.orchestra.run.smithi151.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-19T11:32:11.668 INFO:teuthology.orchestra.run.smithi151.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-19T11:32:11.669 INFO:teuthology.orchestra.run.smithi120.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-19T11:32:11.670 INFO:teuthology.orchestra.run.smithi151.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-19T11:32:11.670 INFO:teuthology.orchestra.run.smithi151.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-19T11:32:11.671 INFO:teuthology.orchestra.run.smithi151.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-19T11:32:11.671 INFO:teuthology.orchestra.run.smithi120.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-19T11:32:11.672 INFO:teuthology.orchestra.run.smithi120.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-19T11:32:11.673 INFO:teuthology.orchestra.run.smithi120.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-19T11:32:11.673 INFO:teuthology.orchestra.run.smithi120.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-19T11:32:11.674 INFO:teuthology.orchestra.run.smithi120.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-19T11:32:11.675 INFO:teuthology.orchestra.run.smithi120.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-19T11:32:11.685 INFO:teuthology.orchestra.run.smithi120.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-19T11:32:11.686 INFO:teuthology.orchestra.run.smithi120.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-19T11:32:11.686 INFO:teuthology.orchestra.run.smithi120.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-19T11:32:11.688 INFO:teuthology.orchestra.run.smithi151.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-19T11:32:11.690 INFO:teuthology.orchestra.run.smithi151.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-19T11:32:11.690 INFO:teuthology.orchestra.run.smithi151.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-19T11:32:11.702 INFO:teuthology.orchestra.run.smithi120.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-19T11:32:11.703 INFO:teuthology.orchestra.run.smithi120.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-19T11:32:11.705 INFO:teuthology.orchestra.run.smithi151.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-19T11:32:11.705 INFO:teuthology.orchestra.run.smithi151.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-19T11:32:11.705 INFO:teuthology.orchestra.run.smithi151.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-19T11:32:11.707 INFO:teuthology.orchestra.run.smithi151.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-19T11:32:11.707 INFO:teuthology.orchestra.run.smithi151.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-19T11:32:11.708 INFO:teuthology.orchestra.run.smithi151.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-19T11:32:11.708 INFO:teuthology.orchestra.run.smithi120.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-19T11:32:11.708 INFO:teuthology.orchestra.run.smithi120.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-19T11:32:11.708 INFO:teuthology.orchestra.run.smithi120.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-19T11:32:11.708 INFO:teuthology.orchestra.run.smithi120.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-19T11:32:11.709 INFO:teuthology.orchestra.run.smithi120.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-19T11:32:11.720 INFO:teuthology.orchestra.run.smithi120.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-19T11:32:11.720 INFO:teuthology.orchestra.run.smithi120.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-19T11:32:11.721 INFO:teuthology.orchestra.run.smithi120.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-19T11:32:11.722 INFO:teuthology.orchestra.run.smithi151.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-19T11:32:11.722 INFO:teuthology.orchestra.run.smithi151.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-19T11:32:11.725 INFO:teuthology.orchestra.run.smithi151.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-19T11:32:11.736 INFO:teuthology.orchestra.run.smithi120.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-19T11:32:11.737 INFO:teuthology.orchestra.run.smithi120.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-19T11:32:11.739 INFO:teuthology.orchestra.run.smithi151.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-19T11:32:11.740 INFO:teuthology.orchestra.run.smithi151.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-19T11:32:11.740 INFO:teuthology.orchestra.run.smithi151.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-19T11:32:11.742 INFO:teuthology.orchestra.run.smithi120.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-19T11:32:11.742 INFO:teuthology.orchestra.run.smithi120.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-19T11:32:11.742 INFO:teuthology.orchestra.run.smithi120.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-19T11:32:11.743 INFO:teuthology.orchestra.run.smithi120.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-19T11:32:11.743 INFO:teuthology.orchestra.run.smithi151.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-19T11:32:11.744 INFO:teuthology.orchestra.run.smithi120.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-19T11:32:11.746 INFO:teuthology.orchestra.run.smithi151.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-19T11:32:11.747 INFO:teuthology.orchestra.run.smithi151.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-19T11:32:11.747 INFO:teuthology.orchestra.run.smithi151.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-19T11:32:11.753 INFO:teuthology.orchestra.run.smithi120.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-19T11:32:11.754 INFO:teuthology.orchestra.run.smithi120.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-19T11:32:11.755 INFO:teuthology.orchestra.run.smithi120.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-19T11:32:11.757 INFO:teuthology.orchestra.run.smithi151.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-19T11:32:11.757 INFO:teuthology.orchestra.run.smithi151.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-19T11:32:11.760 INFO:teuthology.orchestra.run.smithi151.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-19T11:32:11.770 INFO:teuthology.orchestra.run.smithi120.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-19T11:32:11.773 INFO:teuthology.orchestra.run.smithi120.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-19T11:32:11.773 INFO:teuthology.orchestra.run.smithi120.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-19T11:32:11.774 INFO:teuthology.orchestra.run.smithi151.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-19T11:32:11.774 INFO:teuthology.orchestra.run.smithi120.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-19T11:32:11.775 INFO:teuthology.orchestra.run.smithi151.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-19T11:32:11.775 INFO:teuthology.orchestra.run.smithi151.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-19T11:32:11.776 INFO:teuthology.orchestra.run.smithi120.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-19T11:32:11.777 INFO:teuthology.orchestra.run.smithi151.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-19T11:32:11.777 INFO:teuthology.orchestra.run.smithi151.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-19T11:32:11.783 INFO:teuthology.orchestra.run.smithi151.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-19T11:32:11.784 INFO:teuthology.orchestra.run.smithi151.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-19T11:32:11.794 INFO:teuthology.orchestra.run.smithi151.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-19T11:32:11.796 INFO:teuthology.orchestra.run.smithi151.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-19T11:32:11.796 INFO:teuthology.orchestra.run.smithi151.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-19T11:32:11.813 INFO:teuthology.orchestra.run.smithi151.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-5012-g08af21e0-1jammy [112 kB] 2024-09-19T11:32:11.815 INFO:teuthology.orchestra.run.smithi151.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-5012-g08af21e0-1jammy [473 kB] 2024-09-19T11:32:11.821 INFO:teuthology.orchestra.run.smithi151.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-5012-g08af21e0-1jammy [28.3 MB] 2024-09-19T11:32:11.829 INFO:teuthology.orchestra.run.smithi120.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-19T11:32:11.829 INFO:teuthology.orchestra.run.smithi120.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-19T11:32:11.830 INFO:teuthology.orchestra.run.smithi120.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-19T11:32:11.831 INFO:teuthology.orchestra.run.smithi120.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-19T11:32:11.832 INFO:teuthology.orchestra.run.smithi120.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-19T11:32:11.849 INFO:teuthology.orchestra.run.smithi120.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-19T11:32:11.850 INFO:teuthology.orchestra.run.smithi120.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-19T11:32:11.851 INFO:teuthology.orchestra.run.smithi120.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-19T11:32:11.865 INFO:teuthology.orchestra.run.smithi120.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-19T11:32:11.866 INFO:teuthology.orchestra.run.smithi120.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-19T11:32:11.866 INFO:teuthology.orchestra.run.smithi120.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-19T11:32:11.866 INFO:teuthology.orchestra.run.smithi120.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-19T11:32:11.867 INFO:teuthology.orchestra.run.smithi120.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-19T11:32:11.867 INFO:teuthology.orchestra.run.smithi120.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-19T11:32:11.883 INFO:teuthology.orchestra.run.smithi120.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-19T11:32:11.884 INFO:teuthology.orchestra.run.smithi120.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-19T11:32:11.886 INFO:teuthology.orchestra.run.smithi120.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-19T11:32:11.900 INFO:teuthology.orchestra.run.smithi120.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-19T11:32:11.901 INFO:teuthology.orchestra.run.smithi120.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-19T11:32:11.902 INFO:teuthology.orchestra.run.smithi120.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-19T11:32:11.905 INFO:teuthology.orchestra.run.smithi120.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-19T11:32:11.907 INFO:teuthology.orchestra.run.smithi120.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-19T11:32:11.908 INFO:teuthology.orchestra.run.smithi120.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-19T11:32:11.908 INFO:teuthology.orchestra.run.smithi120.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-19T11:32:11.917 INFO:teuthology.orchestra.run.smithi120.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-19T11:32:11.917 INFO:teuthology.orchestra.run.smithi120.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-19T11:32:11.920 INFO:teuthology.orchestra.run.smithi120.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-19T11:32:11.921 INFO:teuthology.orchestra.run.smithi120.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-5012-g08af21e0-1jammy [3,336 kB] 2024-09-19T11:32:11.937 INFO:teuthology.orchestra.run.smithi120.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-19T11:32:11.937 INFO:teuthology.orchestra.run.smithi120.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-19T11:32:11.937 INFO:teuthology.orchestra.run.smithi120.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-19T11:32:11.938 INFO:teuthology.orchestra.run.smithi120.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-19T11:32:11.938 INFO:teuthology.orchestra.run.smithi120.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-19T11:32:11.943 INFO:teuthology.orchestra.run.smithi120.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-19T11:32:11.943 INFO:teuthology.orchestra.run.smithi120.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-19T11:32:11.951 INFO:teuthology.orchestra.run.smithi120.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-19T11:32:11.953 INFO:teuthology.orchestra.run.smithi120.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-19T11:32:11.953 INFO:teuthology.orchestra.run.smithi120.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-19T11:32:12.197 INFO:teuthology.orchestra.run.smithi120.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-5012-g08af21e0-1jammy [722 kB] 2024-09-19T11:32:12.258 INFO:teuthology.orchestra.run.smithi120.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-5012-g08af21e0-1jammy [356 kB] 2024-09-19T11:32:12.265 INFO:teuthology.orchestra.run.smithi120.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-5012-g08af21e0-1jammy [32.8 kB] 2024-09-19T11:32:12.266 INFO:teuthology.orchestra.run.smithi120.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-5012-g08af21e0-1jammy [180 kB] 2024-09-19T11:32:12.310 INFO:teuthology.orchestra.run.smithi120.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-5012-g08af21e0-1jammy [72.8 kB] 2024-09-19T11:32:12.312 INFO:teuthology.orchestra.run.smithi120.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-5012-g08af21e0-1jammy [338 kB] 2024-09-19T11:32:12.325 INFO:teuthology.orchestra.run.smithi120.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-5012-g08af21e0-1jammy [7,969 kB] 2024-09-19T11:32:12.544 INFO:teuthology.orchestra.run.smithi151.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-5012-g08af21e0-1jammy [5,208 kB] 2024-09-19T11:32:12.596 INFO:teuthology.orchestra.run.smithi120.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-5012-g08af21e0-1jammy [112 kB] 2024-09-19T11:32:12.599 INFO:teuthology.orchestra.run.smithi120.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-5012-g08af21e0-1jammy [473 kB] 2024-09-19T11:32:12.613 INFO:teuthology.orchestra.run.smithi120.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-5012-g08af21e0-1jammy [28.3 MB] 2024-09-19T11:32:12.621 INFO:teuthology.orchestra.run.smithi151.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-5012-g08af21e0-1jammy [252 kB] 2024-09-19T11:32:12.623 INFO:teuthology.orchestra.run.smithi151.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-5012-g08af21e0-1jammy [124 kB] 2024-09-19T11:32:12.625 INFO:teuthology.orchestra.run.smithi151.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-5012-g08af21e0-1jammy [1,561 kB] 2024-09-19T11:32:12.653 INFO:teuthology.orchestra.run.smithi151.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-5012-g08af21e0-1jammy [6,312 kB] 2024-09-19T11:32:12.801 INFO:teuthology.orchestra.run.smithi151.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-5012-g08af21e0-1jammy [23.1 MB] 2024-09-19T11:32:13.477 INFO:teuthology.orchestra.run.smithi151.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-5012-g08af21e0-1jammy [14.1 kB] 2024-09-19T11:32:13.478 INFO:teuthology.orchestra.run.smithi151.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-5012-g08af21e0-1jammy [880 kB] 2024-09-19T11:32:13.495 INFO:teuthology.orchestra.run.smithi151.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-5012-g08af21e0-1jammy [2,453 kB] 2024-09-19T11:32:13.536 INFO:teuthology.orchestra.run.smithi151.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-5012-g08af21e0-1jammy [814 kB] 2024-09-19T11:32:13.546 INFO:teuthology.orchestra.run.smithi151.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-5012-g08af21e0-1jammy [160 kB] 2024-09-19T11:32:13.548 INFO:teuthology.orchestra.run.smithi151.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-5012-g08af21e0-1jammy [61.5 MB] 2024-09-19T11:32:14.088 INFO:teuthology.orchestra.run.smithi120.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-5012-g08af21e0-1jammy [5,208 kB] 2024-09-19T11:32:14.229 INFO:teuthology.orchestra.run.smithi120.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-5012-g08af21e0-1jammy [252 kB] 2024-09-19T11:32:14.251 INFO:teuthology.orchestra.run.smithi120.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-5012-g08af21e0-1jammy [124 kB] 2024-09-19T11:32:14.254 INFO:teuthology.orchestra.run.smithi120.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-5012-g08af21e0-1jammy [1,561 kB] 2024-09-19T11:32:14.331 INFO:teuthology.orchestra.run.smithi120.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-5012-g08af21e0-1jammy [6,312 kB] 2024-09-19T11:32:14.666 INFO:teuthology.orchestra.run.smithi120.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-5012-g08af21e0-1jammy [23.1 MB] 2024-09-19T11:32:15.435 INFO:teuthology.orchestra.run.smithi120.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-5012-g08af21e0-1jammy [14.1 kB] 2024-09-19T11:32:15.436 INFO:teuthology.orchestra.run.smithi120.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-5012-g08af21e0-1jammy [880 kB] 2024-09-19T11:32:15.448 INFO:teuthology.orchestra.run.smithi120.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-5012-g08af21e0-1jammy [2,453 kB] 2024-09-19T11:32:15.458 INFO:teuthology.orchestra.run.smithi151.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-5012-g08af21e0-1jammy [8,625 kB] 2024-09-19T11:32:15.481 INFO:teuthology.orchestra.run.smithi120.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-5012-g08af21e0-1jammy [814 kB] 2024-09-19T11:32:15.490 INFO:teuthology.orchestra.run.smithi120.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-5012-g08af21e0-1jammy [160 kB] 2024-09-19T11:32:15.492 INFO:teuthology.orchestra.run.smithi120.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-5012-g08af21e0-1jammy [61.5 MB] 2024-09-19T11:32:15.629 INFO:teuthology.orchestra.run.smithi151.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-5012-g08af21e0-1jammy [14.2 kB] 2024-09-19T11:32:15.629 INFO:teuthology.orchestra.run.smithi151.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-5012-g08af21e0-1jammy [48.5 MB] 2024-09-19T11:32:17.325 INFO:teuthology.orchestra.run.smithi151.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-5012-g08af21e0-1jammy [130 kB] 2024-09-19T11:32:17.328 INFO:teuthology.orchestra.run.smithi151.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-5012-g08af21e0-1jammy [39.0 kB] 2024-09-19T11:32:17.329 INFO:teuthology.orchestra.run.smithi151.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-5012-g08af21e0-1jammy [15.8 MB] 2024-09-19T11:32:17.738 INFO:teuthology.orchestra.run.smithi120.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-5012-g08af21e0-1jammy [8,625 kB] 2024-09-19T11:32:17.749 INFO:teuthology.orchestra.run.smithi151.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-5012-g08af21e0-1jammy [91.2 kB] 2024-09-19T11:32:17.845 INFO:teuthology.orchestra.run.smithi120.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-5012-g08af21e0-1jammy [14.2 kB] 2024-09-19T11:32:17.845 INFO:teuthology.orchestra.run.smithi120.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-5012-g08af21e0-1jammy [48.5 MB] 2024-09-19T11:32:18.324 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 244 MB in 7s (37.4 MB/s) 2024-09-19T11:32:18.477 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-19T11:32:18.572 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-19T11:32:18.577 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-19T11:32:18.651 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-19T11:32:18.918 INFO:teuthology.orchestra.run.smithi120.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-5012-g08af21e0-1jammy [130 kB] 2024-09-19T11:32:18.921 INFO:teuthology.orchestra.run.smithi120.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-5012-g08af21e0-1jammy [39.0 kB] 2024-09-19T11:32:18.922 INFO:teuthology.orchestra.run.smithi120.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-5012-g08af21e0-1jammy [15.8 MB] 2024-09-19T11:32:18.922 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-19T11:32:18.949 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-19T11:32:18.988 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-19T11:32:19.233 INFO:teuthology.orchestra.run.smithi120.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-5012-g08af21e0-1jammy [91.2 kB] 2024-09-19T11:32:19.342 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-19T11:32:19.369 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-19T11:32:19.409 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-19T11:32:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-19T11:32:19.784 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 244 MB in 8s (31.1 MB/s) 2024-09-19T11:32:19.790 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T11:32:19.830 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T11:32:19.961 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-19T11:32:20.061 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-19T11:32:20.067 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-19T11:32:20.143 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-19T11:32:20.209 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-19T11:32:20.235 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T11:32:20.275 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T11:32:20.422 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-19T11:32:20.448 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-19T11:32:20.480 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-19T11:32:20.604 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-19T11:32:20.630 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T11:32:20.671 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T11:32:20.817 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-19T11:32:20.842 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-19T11:32:20.883 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-19T11:32:20.949 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-19T11:32:20.975 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-19T11:32:21.008 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-19T11:32:21.320 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-19T11:32:21.328 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librados2. 2024-09-19T11:32:21.347 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T11:32:21.354 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../007-librados2_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:21.395 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librados2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:21.395 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T11:32:21.774 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-19T11:32:21.800 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T11:32:21.840 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T11:32:21.907 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libnbd0. 2024-09-19T11:32:21.933 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-19T11:32:21.973 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-19T11:32:22.144 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-19T11:32:22.159 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T11:32:22.201 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librbd1. 2024-09-19T11:32:22.202 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T11:32:22.217 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../009-librbd1_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:22.268 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librbd1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:22.730 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs2. 2024-09-19T11:32:22.756 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:22.797 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:23.056 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-19T11:32:23.082 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-19T11:32:23.091 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rados. 2024-09-19T11:32:23.107 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../011-python3-rados_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:23.122 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-19T11:32:23.141 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rados (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:23.437 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-19T11:32:23.450 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librados2. 2024-09-19T11:32:23.462 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:32:23.476 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../007-librados2_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:23.503 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-argparse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:23.517 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librados2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:23.756 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cephfs. 2024-09-19T11:32:23.782 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:23.939 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cephfs (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:23.945 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libnbd0. 2024-09-19T11:32:23.971 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-19T11:32:24.012 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-19T11:32:24.309 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-19T11:32:24.315 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librbd1. 2024-09-19T11:32:24.335 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:32:24.341 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../009-librbd1_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:24.376 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:24.381 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librbd1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-19T11:32:24.681 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-19T11:32:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-19T11:32:24.826 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcephfs2. 2024-09-19T11:32:24.852 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:24.892 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcephfs2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:25.017 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-prettytable. 2024-09-19T11:32:25.043 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-19T11:32:25.083 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-19T11:32:25.162 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rados. 2024-09-19T11:32:25.177 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../011-python3-rados_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:25.220 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rados (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:25.345 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rbd. 2024-09-19T11:32:25.360 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:25.403 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rbd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:25.548 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-19T11:32:25.574 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:32:25.615 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-ceph-argparse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:25.707 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-19T11:32:25.733 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-19T11:32:25.765 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-19T11:32:25.868 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cephfs. 2024-09-19T11:32:25.894 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:25.934 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cephfs (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:26.035 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-19T11:32:26.050 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-19T11:32:26.093 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-19T11:32:26.246 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-19T11:32:26.272 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:32:26.304 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:26.380 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-19T11:32:26.395 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-19T11:32:26.438 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-19T11:32:26.616 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-19T11:32:26.642 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-19T11:32:26.682 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-19T11:32:26.734 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua5.1. 2024-09-19T11:32:26.760 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-19T11:32:26.800 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-19T11:32:26.944 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-prettytable. 2024-09-19T11:32:26.970 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-19T11:32:27.010 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-19T11:32:27.146 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-any. 2024-09-19T11:32:27.161 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-19T11:32:27.204 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-19T11:32:27.288 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rbd. 2024-09-19T11:32:27.304 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:27.347 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rbd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:27.441 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package zip. 2024-09-19T11:32:27.456 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-19T11:32:27.499 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking zip (3.0-12build2) ... 2024-09-19T11:32:27.734 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-19T11:32:27.760 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-19T11:32:27.795 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package unzip. 2024-09-19T11:32:27.800 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-19T11:32:27.821 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-19T11:32:27.853 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-19T11:32:28.089 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-19T11:32:28.116 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-19T11:32:28.203 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-19T11:32:28.241 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package luarocks. 2024-09-19T11:32:28.267 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-19T11:32:28.307 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-19T11:32:28.515 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-19T11:32:28.541 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-19T11:32:28.582 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-19T11:32:28.684 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librgw2. 2024-09-19T11:32:28.710 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../026-librgw2_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:28.751 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librgw2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:28.927 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package lua5.1. 2024-09-19T11:32:28.953 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-19T11:32:28.993 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-19T11:32:29.313 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package lua-any. 2024-09-19T11:32:29.329 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-19T11:32:29.371 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-19T11:32:29.624 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package zip. 2024-09-19T11:32:29.640 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-19T11:32:29.682 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking zip (3.0-12build2) ... 2024-09-19T11:32:29.846 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rgw. 2024-09-19T11:32:29.861 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:29.895 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:30.003 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package unzip. 2024-09-19T11:32:30.031 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-19T11:32:30.069 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-19T11:32:30.249 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-19T11:32:30.275 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-19T11:32:30.315 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-19T11:32:30.424 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package luarocks. 2024-09-19T11:32:30.450 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-19T11:32:30.482 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-19T11:32:30.611 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libradosstriper1. 2024-09-19T11:32:30.637 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:30.677 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libradosstriper1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:30.849 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librgw2. 2024-09-19T11:32:30.875 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../026-librgw2_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:30.915 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librgw2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:31.107 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-common. 2024-09-19T11:32:31.132 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../030-ceph-common_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:31.173 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:31.576 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rgw. 2024-09-19T11:32:31.592 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:31.634 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:31.938 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-19T11:32:31.964 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-19T11:32:31.996 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-19T11:32:32.341 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libradosstriper1. 2024-09-19T11:32:32.367 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:32.407 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libradosstriper1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:32.646 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-base. 2024-09-19T11:32:32.673 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../031-ceph-base_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:32.722 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-base (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:32.836 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-common. 2024-09-19T11:32:32.863 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../030-ceph-common_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:32.902 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:33.260 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-19T11:32:33.286 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-19T11:32:33.318 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-19T11:32:33.605 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cheroot. 2024-09-19T11:32:33.631 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-19T11:32:33.672 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-19T11:32:33.984 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-19T11:32:34.010 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-19T11:32:34.050 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-19T11:32:34.329 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-19T11:32:34.355 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-19T11:32:34.395 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-19T11:32:34.417 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-base. 2024-09-19T11:32:34.443 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../031-ceph-base_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:34.492 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-base (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:34.707 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-19T11:32:34.734 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-19T11:32:34.774 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-19T11:32:35.077 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-tempora. 2024-09-19T11:32:35.080 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-19T11:32:35.103 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-19T11:32:35.107 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-19T11:32:35.144 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-19T11:32:35.146 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-19T11:32:35.423 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-portend. 2024-09-19T11:32:35.449 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-19T11:32:35.449 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cheroot. 2024-09-19T11:32:35.476 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-19T11:32:35.481 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-19T11:32:35.516 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-19T11:32:35.751 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-19T11:32:35.777 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-19T11:32:35.794 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-19T11:32:35.817 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-19T11:32:35.821 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-19T11:32:35.852 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-19T11:32:36.130 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-19T11:32:36.147 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-19T11:32:36.156 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-19T11:32:36.174 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-19T11:32:36.196 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-19T11:32:36.214 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-19T11:32:36.517 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-19T11:32:36.525 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-natsort. 2024-09-19T11:32:36.543 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-19T11:32:36.552 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-19T11:32:36.583 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-19T11:32:36.592 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-19T11:32:36.861 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-tempora. 2024-09-19T11:32:36.888 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-19T11:32:36.906 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-logutils. 2024-09-19T11:32:36.919 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-19T11:32:36.932 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-19T11:32:36.973 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-19T11:32:37.207 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-portend. 2024-09-19T11:32:37.233 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-19T11:32:37.251 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-19T11:32:37.273 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-19T11:32:37.278 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-19T11:32:37.309 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-19T11:32:37.576 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-19T11:32:37.596 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-mako. 2024-09-19T11:32:37.603 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-19T11:32:37.622 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-19T11:32:37.642 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-19T11:32:37.663 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-19T11:32:37.921 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-19T11:32:37.948 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-19T11:32:37.979 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-19T11:32:38.000 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-19T11:32:38.027 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-19T11:32:38.067 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-19T11:32:38.341 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-natsort. 2024-09-19T11:32:38.354 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-19T11:32:38.368 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-19T11:32:38.380 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-19T11:32:38.408 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-19T11:32:38.445 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-19T11:32:38.694 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-logutils. 2024-09-19T11:32:38.710 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-19T11:32:38.744 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-19T11:32:38.749 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webob. 2024-09-19T11:32:38.775 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-19T11:32:38.815 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-19T11:32:39.023 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-19T11:32:39.050 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-19T11:32:39.152 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-waitress. 2024-09-19T11:32:39.179 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-19T11:32:39.220 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-19T11:32:39.221 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-19T11:32:39.540 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-tempita. 2024-09-19T11:32:39.566 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-19T11:32:39.584 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-mako. 2024-09-19T11:32:39.606 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-19T11:32:39.611 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-19T11:32:39.651 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-19T11:32:39.885 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-paste. 2024-09-19T11:32:39.911 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-19T11:32:39.988 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-19T11:32:40.004 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-19T11:32:40.033 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-19T11:32:40.070 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-19T11:32:40.416 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-19T11:32:40.422 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-19T11:32:40.437 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-19T11:32:40.442 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-19T11:32:40.480 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-19T11:32:40.490 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-19T11:32:40.759 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-19T11:32:40.785 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-19T11:32:40.817 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-19T11:32:40.860 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webob. 2024-09-19T11:32:40.887 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-19T11:32:40.935 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-19T11:32:41.079 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webtest. 2024-09-19T11:32:41.105 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-19T11:32:41.145 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-19T11:32:41.322 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-waitress. 2024-09-19T11:32:41.348 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-19T11:32:41.417 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-19T11:32:41.441 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pecan. 2024-09-19T11:32:41.467 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-19T11:32:41.507 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-19T11:32:41.733 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-tempita. 2024-09-19T11:32:41.760 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-19T11:32:41.800 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-19T11:32:41.863 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-certifi. 2024-09-19T11:32:41.890 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-19T11:32:41.929 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-19T11:32:42.111 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-paste. 2024-09-19T11:32:42.138 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-19T11:32:42.186 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-19T11:32:42.242 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-idna. 2024-09-19T11:32:42.268 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-19T11:32:42.308 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-19T11:32:42.490 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-19T11:32:42.517 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-19T11:32:42.557 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-19T11:32:42.604 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-urllib3. 2024-09-19T11:32:42.630 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-19T11:32:42.670 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-19T11:32:42.859 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-19T11:32:42.886 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-19T11:32:42.926 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-19T11:32:42.983 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-requests. 2024-09-19T11:32:43.009 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-19T11:32:43.049 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-19T11:32:43.229 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webtest. 2024-09-19T11:32:43.256 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-19T11:32:43.296 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-19T11:32:43.361 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-19T11:32:43.387 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-19T11:32:43.427 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-19T11:32:43.558 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pecan. 2024-09-19T11:32:43.584 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-19T11:32:43.615 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-19T11:32:43.937 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-certifi. 2024-09-19T11:32:43.953 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-19T11:32:43.987 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-19T11:32:44.316 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-idna. 2024-09-19T11:32:44.342 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-19T11:32:44.382 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-19T11:32:44.632 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-19T11:32:44.647 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:32:44.690 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-modules-core (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:45.071 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-19T11:32:45.098 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:45.138 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:45.408 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-19T11:32:45.434 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-19T11:32:45.474 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-19T11:32:45.761 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-openssl. 2024-09-19T11:32:45.788 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-19T11:32:45.795 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-urllib3. 2024-09-19T11:32:45.821 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-19T11:32:45.828 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-19T11:32:45.853 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-19T11:32:46.123 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-requests. 2024-09-19T11:32:46.150 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-19T11:32:46.181 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-19T11:32:46.181 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr. 2024-09-19T11:32:46.208 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:46.248 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:46.493 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-19T11:32:46.519 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-19T11:32:46.559 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-19T11:32:46.602 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mon. 2024-09-19T11:32:46.617 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:46.652 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mon (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:46.837 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-19T11:32:46.853 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:32:46.896 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-modules-core (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:47.243 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-19T11:32:47.265 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-osd. 2024-09-19T11:32:47.270 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:47.291 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:47.301 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:47.331 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-osd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:47.621 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-19T11:32:47.648 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-19T11:32:47.687 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-19T11:32:47.991 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-openssl. 2024-09-19T11:32:48.018 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-19T11:32:48.057 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-19T11:32:48.385 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr. 2024-09-19T11:32:48.393 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph. 2024-09-19T11:32:48.401 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:48.417 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../067-ceph_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:48.435 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:48.452 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:48.746 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-fuse. 2024-09-19T11:32:48.773 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:48.813 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:48.814 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mon. 2024-09-19T11:32:48.841 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:48.880 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mon (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:49.192 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mds. 2024-09-19T11:32:49.219 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:49.258 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mds (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:49.501 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-osd. 2024-09-19T11:32:49.527 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:49.567 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-osd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:49.612 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package cephadm. 2024-09-19T11:32:49.639 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../070-cephadm_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:49.682 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:50.016 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-19T11:32:50.043 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-19T11:32:50.082 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-19T11:32:50.610 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-19T11:32:50.626 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-19T11:32:50.654 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph. 2024-09-19T11:32:50.668 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-19T11:32:50.681 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../067-ceph_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:50.712 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:51.032 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-fuse. 2024-09-19T11:32:51.059 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:51.098 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:51.469 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mds. 2024-09-19T11:32:51.495 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:51.535 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mds (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:51.633 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-babel. 2024-09-19T11:32:51.660 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-19T11:32:51.699 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-19T11:32:51.896 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package cephadm. 2024-09-19T11:32:51.912 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../070-cephadm_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:32:51.946 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:52.028 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jinja2. 2024-09-19T11:32:52.055 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-19T11:32:52.095 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-19T11:32:52.274 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-19T11:32:52.298 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-19T11:32:52.341 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-19T11:32:52.440 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-19T11:32:52.467 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:32:52.515 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:52.635 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-19T11:32:52.660 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-19T11:32:52.702 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-19T11:32:52.853 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-19T11:32:52.879 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-19T11:32:52.919 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-19T11:32:53.206 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-routes. 2024-09-19T11:32:53.233 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-19T11:32:53.272 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-19T11:32:53.618 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-19T11:32:53.645 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:32:53.685 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-dashboard (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:53.733 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-babel. 2024-09-19T11:32:53.760 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-19T11:32:53.799 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-19T11:32:54.102 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jinja2. 2024-09-19T11:32:54.118 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-19T11:32:54.152 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-19T11:32:54.473 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-19T11:32:54.500 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:32:54.531 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:54.851 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-19T11:32:54.875 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-19T11:32:54.909 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-19T11:32:55.179 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-routes. 2024-09-19T11:32:55.206 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-19T11:32:55.262 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-19T11:32:55.608 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-19T11:32:55.635 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:32:55.674 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-dashboard (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:56.568 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-19T11:32:56.585 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-19T11:32:56.626 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-19T11:32:57.131 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-joblib. 2024-09-19T11:32:57.158 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-19T11:32:57.197 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-19T11:32:57.535 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-19T11:32:57.551 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-19T11:32:57.584 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-19T11:32:57.921 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn. 2024-09-19T11:32:57.949 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-19T11:32:58.066 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-19T11:32:58.513 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-19T11:32:58.530 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-19T11:32:58.571 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-19T11:32:58.794 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-19T11:32:58.822 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:32:58.860 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:32:59.044 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-joblib. 2024-09-19T11:32:59.060 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-19T11:32:59.094 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-19T11:32:59.456 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-19T11:32:59.483 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-19T11:32:59.522 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-19T11:32:59.756 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cachetools. 2024-09-19T11:32:59.783 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-19T11:32:59.822 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-19T11:32:59.868 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-sklearn. 2024-09-19T11:32:59.895 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-19T11:33:00.028 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-19T11:33:00.118 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-19T11:33:00.146 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-19T11:33:00.184 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-19T11:33:00.522 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-19T11:33:00.549 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-19T11:33:00.588 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-19T11:33:00.913 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-19T11:33:00.941 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:33:00.980 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:01.076 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rsa. 2024-09-19T11:33:01.103 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-19T11:33:01.142 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-19T11:33:01.488 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-google-auth. 2024-09-19T11:33:01.516 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-19T11:33:01.555 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-19T11:33:01.884 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-19T11:33:01.911 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-19T11:33:01.950 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-19T11:33:02.008 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cachetools. 2024-09-19T11:33:02.036 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-19T11:33:02.075 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-19T11:33:02.229 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-websocket. 2024-09-19T11:33:02.256 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-19T11:33:02.296 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-19T11:33:02.336 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-19T11:33:02.352 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-19T11:33:02.386 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-19T11:33:02.625 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-19T11:33:02.653 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-19T11:33:02.691 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-19T11:33:02.698 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-19T11:33:02.726 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-19T11:33:02.765 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-19T11:33:03.101 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rsa. 2024-09-19T11:33:03.129 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-19T11:33:03.168 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-19T11:33:03.290 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-19T11:33:03.306 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:33:03.340 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:03.480 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-google-auth. 2024-09-19T11:33:03.508 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-19T11:33:03.547 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-19T11:33:03.652 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-19T11:33:03.679 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-19T11:33:03.718 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-19T11:33:03.867 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-19T11:33:03.895 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-19T11:33:03.934 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-19T11:33:04.055 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-19T11:33:04.083 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-19T11:33:04.122 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-19T11:33:04.237 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-websocket. 2024-09-19T11:33:04.264 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-19T11:33:04.303 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-19T11:33:04.384 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package jq. 2024-09-19T11:33:04.411 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-19T11:33:04.450 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-19T11:33:04.590 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-19T11:33:04.606 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-19T11:33:04.640 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-19T11:33:04.670 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package socat. 2024-09-19T11:33:04.698 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-19T11:33:04.737 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-19T11:33:05.057 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package xmlstarlet. 2024-09-19T11:33:05.086 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-19T11:33:05.124 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-19T11:33:05.429 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-19T11:33:05.446 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:33:05.488 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:05.496 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-test. 2024-09-19T11:33:05.512 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../098-ceph-test_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:33:05.554 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-test (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:05.807 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-19T11:33:05.836 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-19T11:33:05.874 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-19T11:33:06.253 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-19T11:33:06.281 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-19T11:33:06.319 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-19T11:33:06.547 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package jq. 2024-09-19T11:33:06.563 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-19T11:33:06.597 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-19T11:33:06.858 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package socat. 2024-09-19T11:33:06.875 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-19T11:33:06.917 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-19T11:33:07.229 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package xmlstarlet. 2024-09-19T11:33:07.257 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-19T11:33:07.295 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-19T11:33:07.650 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-test. 2024-09-19T11:33:07.666 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../098-ceph-test_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:33:07.716 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-test (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:07.860 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-volume. 2024-09-19T11:33:07.888 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:33:07.926 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-volume (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:08.231 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-19T11:33:08.247 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:33:08.289 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs-dev (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:08.568 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-19T11:33:08.596 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-19T11:33:08.626 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-19T11:33:08.940 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-19T11:33:08.968 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-19T11:33:09.006 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-19T11:33:09.420 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package nvme-cli. 2024-09-19T11:33:09.447 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-19T11:33:09.486 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-19T11:33:09.868 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package pkg-config. 2024-09-19T11:33:09.896 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-19T11:33:09.904 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-volume. 2024-09-19T11:33:09.932 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T11:33:09.934 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-19T11:33:09.970 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-volume (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:10.196 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-19T11:33:10.224 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-19T11:33:10.233 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-19T11:33:10.250 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:33:10.262 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-19T11:33:10.283 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcephfs-dev (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:10.636 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-19T11:33:10.664 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-19T11:33:10.700 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-19T11:33:10.702 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-19T11:33:10.728 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-19T11:33:10.766 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-19T11:33:11.024 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-19T11:33:11.052 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-19T11:33:11.070 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastescript. 2024-09-19T11:33:11.098 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-19T11:33:11.136 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-19T11:33:11.211 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-19T11:33:11.424 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pluggy. 2024-09-19T11:33:11.452 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-19T11:33:11.491 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-19T11:33:11.645 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package nvme-cli. 2024-09-19T11:33:11.673 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-19T11:33:11.712 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-19T11:33:11.803 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-psutil. 2024-09-19T11:33:11.832 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-19T11:33:11.869 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-19T11:33:12.151 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package pkg-config. 2024-09-19T11:33:12.179 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-19T11:33:12.190 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-py. 2024-09-19T11:33:12.217 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-19T11:33:12.218 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-19T11:33:12.256 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-19T11:33:12.437 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-19T11:33:12.453 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-19T11:33:12.487 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-19T11:33:12.586 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pygments. 2024-09-19T11:33:12.614 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-19T11:33:12.652 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-19T11:33:12.915 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-19T11:33:12.943 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-19T11:33:12.982 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-19T11:33:13.149 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-19T11:33:13.165 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-19T11:33:13.207 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-19T11:33:13.277 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pastescript. 2024-09-19T11:33:13.305 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-19T11:33:13.343 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-19T11:33:13.512 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-toml. 2024-09-19T11:33:13.540 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-19T11:33:13.570 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-19T11:33:13.630 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pluggy. 2024-09-19T11:33:13.658 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-19T11:33:13.688 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-19T11:33:13.848 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pytest. 2024-09-19T11:33:13.876 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-19T11:33:13.914 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-19T11:33:13.967 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-psutil. 2024-09-19T11:33:13.995 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-19T11:33:14.033 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-19T11:33:14.210 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplejson. 2024-09-19T11:33:14.237 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-19T11:33:14.276 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-19T11:33:14.378 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-py. 2024-09-19T11:33:14.406 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-19T11:33:14.444 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-19T11:33:14.554 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-19T11:33:14.570 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-19T11:33:14.612 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-19T11:33:14.773 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pygments. 2024-09-19T11:33:14.801 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-19T11:33:14.839 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-19T11:33:15.282 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package radosgw. 2024-09-19T11:33:15.286 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-19T11:33:15.311 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../117-radosgw_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:33:15.314 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-19T11:33:15.344 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-19T11:33:15.348 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking radosgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:15.672 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-toml. 2024-09-19T11:33:15.700 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-19T11:33:15.738 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-19T11:33:16.042 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pytest. 2024-09-19T11:33:16.070 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-19T11:33:16.108 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-19T11:33:16.226 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package rbd-fuse. 2024-09-19T11:33:16.243 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:33:16.285 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking rbd-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:16.471 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-simplejson. 2024-09-19T11:33:16.499 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-19T11:33:16.537 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-19T11:33:16.789 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-19T11:33:16.806 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-19T11:33:16.831 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-19T11:33:16.848 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-19T11:33:17.081 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-19T11:33:17.209 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-19T11:33:17.467 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-19T11:33:17.628 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package radosgw. 2024-09-19T11:33:17.656 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../117-radosgw_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:33:17.694 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking radosgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:17.796 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-19T11:33:18.226 INFO:teuthology.orchestra.run.smithi151.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-19T11:33:18.300 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:18.639 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package rbd-fuse. 2024-09-19T11:33:18.655 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T11:33:18.697 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking rbd-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:18.767 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user cephadm....done 2024-09-19T11:33:18.923 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-19T11:33:19.002 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-19T11:33:19.215 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-19T11:33:19.253 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-19T11:33:19.378 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-19T11:33:19.467 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-19T11:33:19.584 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-19T11:33:19.640 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-19T11:33:19.843 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-19T11:33:19.958 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-19T11:33:20.103 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-19T11:33:20.221 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-19T11:33:20.364 INFO:teuthology.orchestra.run.smithi120.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-19T11:33:20.439 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:20.497 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-19T11:33:20.840 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-19T11:33:21.023 INFO:teuthology.orchestra.run.smithi120.stdout:Adding system user cephadm....done 2024-09-19T11:33:21.100 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-19T11:33:21.179 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-19T11:33:21.376 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-19T11:33:21.456 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-19T11:33:21.636 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-19T11:33:21.824 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-19T11:33:21.904 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-19T11:33:21.924 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-19T11:33:22.154 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-19T11:33:22.159 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-19T11:33:22.397 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-argparse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:22.419 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-19T11:33:22.520 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-19T11:33:22.648 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-19T11:33:22.774 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-19T11:33:22.805 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-19T11:33:22.900 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-19T11:33:23.026 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-19T11:33:23.152 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-19T11:33:23.157 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-19T11:33:23.409 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-19T11:33:23.420 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-19T11:33:23.677 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-19T11:33:23.809 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-19T11:33:23.842 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-19T11:33:23.890 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-19T11:33:23.920 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-19T11:33:24.016 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-19T11:33:24.188 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-19T11:33:24.392 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-19T11:33:24.448 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-19T11:33:24.543 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-19T11:33:24.707 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-ceph-argparse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:24.810 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-19T11:33:25.034 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-19T11:33:25.087 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-19T11:33:25.143 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-19T11:33:25.269 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-19T11:33:25.395 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-19T11:33:25.396 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up zip (3.0-12build2) ... 2024-09-19T11:33:25.514 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-19T11:33:25.521 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-19T11:33:25.780 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-19T11:33:26.180 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-19T11:33:26.191 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-19T11:33:26.211 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-19T11:33:26.276 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-19T11:33:26.402 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-19T11:33:26.450 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-19T11:33:26.576 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-19T11:33:26.702 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-19T11:33:26.754 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-19T11:33:26.855 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-19T11:33:27.011 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-19T11:33:27.097 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-19T11:33:27.349 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-19T11:33:27.404 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-19T11:33:27.630 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-19T11:33:27.658 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up zip (3.0-12build2) ... 2024-09-19T11:33:27.793 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-19T11:33:27.998 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-19T11:33:28.324 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-19T11:33:28.428 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-19T11:33:28.663 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-19T11:33:28.692 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-19T11:33:28.789 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-19T11:33:28.915 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-19T11:33:28.943 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-19T11:33:29.078 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:29.208 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-19T11:33:29.387 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-19T11:33:29.593 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-19T11:33:29.697 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-19T11:33:29.852 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-19T11:33:30.220 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-19T11:33:30.497 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-19T11:33:30.857 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-19T11:33:30.903 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-19T11:33:31.108 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-19T11:33:31.154 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T11:33:31.217 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:31.272 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-19T11:33:31.519 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-19T11:33:31.523 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-19T11:33:31.652 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-19T11:33:31.837 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-19T11:33:32.058 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-19T11:33:32.351 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-19T11:33:32.619 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-19T11:33:32.870 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T11:33:32.996 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-19T11:33:33.043 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-19T11:33:33.280 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-19T11:33:33.287 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T11:33:33.421 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-19T11:33:33.523 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-19T11:33:33.681 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-19T11:33:33.783 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-19T11:33:33.806 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-19T11:33:33.941 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-19T11:33:34.034 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-19T11:33:34.218 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-19T11:33:34.293 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-19T11:33:34.469 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-19T11:33:34.552 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-19T11:33:34.678 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-19T11:33:34.712 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T11:33:34.813 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-19T11:33:34.955 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-19T11:33:35.056 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-19T11:33:35.114 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-19T11:33:35.332 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-19T11:33:35.365 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-19T11:33:35.617 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-19T11:33:35.641 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-19T11:33:35.851 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-19T11:33:35.900 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-19T11:33:36.044 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-19T11:33:36.111 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-19T11:33:36.177 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-19T11:33:36.266 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-19T11:33:36.370 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-19T11:33:36.471 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-19T11:33:36.529 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-19T11:33:36.647 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-19T11:33:36.764 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-19T11:33:36.868 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-19T11:33:37.023 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-19T11:33:37.175 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-19T11:33:37.291 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-19T11:33:37.417 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-19T11:33:37.485 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-19T11:33:37.676 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T11:33:37.736 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-19T11:33:37.802 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-19T11:33:37.862 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-19T11:33:37.988 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-19T11:33:38.078 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-19T11:33:38.128 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-19T11:33:38.323 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-19T11:33:38.421 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-19T11:33:38.424 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-19T11:33:38.672 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-19T11:33:38.773 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-19T11:33:38.793 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-19T11:33:39.040 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-19T11:33:39.044 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-19T11:33:39.170 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-19T11:33:39.402 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-19T11:33:39.430 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T11:33:39.556 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-19T11:33:39.678 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-19T11:33:39.848 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-19T11:33:40.038 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-19T11:33:40.125 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-19T11:33:40.314 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-19T11:33:40.393 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-19T11:33:40.519 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-19T11:33:40.641 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-19T11:33:40.768 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librados2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:40.786 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-19T11:33:40.893 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libsqlite3-mod-ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:41.020 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-19T11:33:41.140 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-19T11:33:41.297 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:41.391 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-19T11:33:41.432 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libradosstriper1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:41.558 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-19T11:33:41.769 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-19T11:33:41.834 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librbd1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:41.960 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-modules-core (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:42.053 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-19T11:33:42.086 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:42.295 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-19T11:33:42.295 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-19T11:33:42.389 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-19T11:33:42.499 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librados2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:42.609 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libsqlite3-mod-ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:42.743 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-19T11:33:42.762 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs-dev (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:42.880 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rados (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:42.989 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librgw2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:43.098 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-19T11:33:43.105 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcephfs2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:43.222 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libradosstriper1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:43.349 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-19T11:33:43.625 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librbd1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:43.754 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-modules-core (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:43.879 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:44.089 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-19T11:33:44.090 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-19T11:33:44.252 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rbd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:44.387 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up rbd-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:44.513 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:44.564 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcephfs-dev (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:44.630 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cephfs (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:44.715 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rados (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:44.739 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:44.833 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librgw2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:44.959 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-19T11:33:45.283 INFO:teuthology.orchestra.run.smithi151.stdout:Adding group ceph....done 2024-09-19T11:33:45.667 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user ceph....done 2024-09-19T11:33:45.844 INFO:teuthology.orchestra.run.smithi151.stdout:Setting system user ceph properties....done 2024-09-19T11:33:45.861 INFO:teuthology.orchestra.run.smithi151.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-19T11:33:45.999 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-19T11:33:46.172 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rbd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:46.289 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up rbd-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:46.335 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-19T11:33:46.407 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:46.508 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cephfs (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:46.634 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:46.799 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-test (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:46.924 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up radosgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:47.185 INFO:teuthology.orchestra.run.smithi120.stdout:Adding group ceph....done 2024-09-19T11:33:47.382 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-19T11:33:47.382 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-19T11:33:47.578 INFO:teuthology.orchestra.run.smithi120.stdout:Adding system user ceph....done 2024-09-19T11:33:47.729 INFO:teuthology.orchestra.run.smithi120.stdout:Setting system user ceph properties....done 2024-09-19T11:33:47.742 INFO:teuthology.orchestra.run.smithi120.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-19T11:33:47.843 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-base (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:47.877 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-19T11:33:48.175 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-19T11:33:48.219 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-19T11:33:48.652 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mds (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:48.685 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-test (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:48.786 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up radosgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:48.972 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-19T11:33:48.972 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-19T11:33:49.279 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-19T11:33:49.279 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-19T11:33:49.430 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:49.637 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-19T11:33:49.637 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-19T11:33:49.758 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-base (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:50.065 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-osd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:50.227 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-19T11:33:50.334 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-19T11:33:50.334 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-19T11:33:50.648 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mds (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:50.767 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-k8sevents (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:50.871 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-19T11:33:50.872 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-19T11:33:50.892 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:51.043 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mon (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:51.254 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-19T11:33:51.254 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-19T11:33:51.358 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:51.564 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-19T11:33:51.565 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-19T11:33:51.728 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:51.846 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:51.947 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-dashboard (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:52.034 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-osd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:52.081 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-volume (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:52.311 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-19T11:33:52.312 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-19T11:33:52.552 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-19T11:33:52.645 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-19T11:33:52.814 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-19T11:33:52.874 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-k8sevents (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:53.004 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:53.155 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mon (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:53.364 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-19T11:33:53.364 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-19T11:33:53.446 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-19T11:33:53.814 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:53.957 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:54.083 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-dashboard (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:54.099 INFO:teuthology.orchestra.run.smithi151.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-19T11:33:54.102 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-19T11:33:54.205 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-19T11:33:54.233 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-volume (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T11:33:54.417 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-19T11:33:54.418 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-19T11:33:54.595 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-19T11:33:54.616 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T11:33:54.616 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T11:33:54.616 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T11:33:54.616 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T11:33:54.617 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T11:33:54.617 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T11:33:54.617 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T11:33:54.618 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-09-19T11:33:54.618 INFO:teuthology.orchestra.run.smithi151.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-19T11:33:54.619 INFO:teuthology.orchestra.run.smithi151.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-19T11:33:54.619 INFO:teuthology.orchestra.run.smithi151.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-19T11:33:54.619 INFO:teuthology.orchestra.run.smithi151.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-19T11:33:54.619 INFO:teuthology.orchestra.run.smithi151.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-19T11:33:54.619 INFO:teuthology.orchestra.run.smithi151.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-19T11:33:54.619 INFO:teuthology.orchestra.run.smithi151.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-19T11:33:54.619 INFO:teuthology.orchestra.run.smithi151.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-19T11:33:54.619 INFO:teuthology.orchestra.run.smithi151.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-19T11:33:54.619 INFO:teuthology.orchestra.run.smithi151.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-19T11:33:54.619 INFO:teuthology.orchestra.run.smithi151.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-19T11:33:54.620 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-09-19T11:33:54.620 INFO:teuthology.orchestra.run.smithi151.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-19T11:33:54.620 INFO:teuthology.orchestra.run.smithi151.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-19T11:33:54.620 INFO:teuthology.orchestra.run.smithi151.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-19T11:33:54.620 INFO:teuthology.orchestra.run.smithi151.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-19T11:33:54.621 INFO:teuthology.orchestra.run.smithi151.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-19T11:33:54.658 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-09-19T11:33:54.659 INFO:teuthology.orchestra.run.smithi151.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-19T11:33:54.659 INFO:teuthology.orchestra.run.smithi151.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-19T11:33:54.659 INFO:teuthology.orchestra.run.smithi151.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-19T11:33:54.659 INFO:teuthology.orchestra.run.smithi151.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-19T11:33:54.659 INFO:teuthology.orchestra.run.smithi151.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-19T11:33:54.659 INFO:teuthology.orchestra.run.smithi151.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-19T11:33:54.659 INFO:teuthology.orchestra.run.smithi151.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-19T11:33:54.659 INFO:teuthology.orchestra.run.smithi151.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-19T11:33:54.659 INFO:teuthology.orchestra.run.smithi151.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-19T11:33:54.659 INFO:teuthology.orchestra.run.smithi151.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-19T11:33:54.659 INFO:teuthology.orchestra.run.smithi151.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-19T11:33:54.659 INFO:teuthology.orchestra.run.smithi151.stdout: s3cmd 2024-09-19T11:33:54.696 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-19T11:33:54.842 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-19T11:33:54.842 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 10.4 MB of archives. 2024-09-19T11:33:54.842 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-19T11:33:54.843 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-19T11:33:54.864 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-19T11:33:54.924 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-19T11:33:54.925 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-19T11:33:54.942 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-19T11:33:55.104 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-19T11:33:55.175 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-19T11:33:55.183 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-19T11:33:55.317 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-19T11:33:55.410 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-19T11:33:55.412 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-19T11:33:55.415 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-19T11:33:55.560 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-19T11:33:55.560 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-19T11:33:55.600 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-19T11:33:55.601 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-19T11:33:55.602 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-19T11:33:55.603 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-19T11:33:55.604 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-19T11:33:55.610 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-19T11:33:55.611 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-19T11:33:55.631 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-19T11:33:55.657 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-19T11:33:55.659 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-19T11:33:55.708 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-19T11:33:55.710 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-19T11:33:55.710 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-19T11:33:55.713 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-19T11:33:55.714 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-19T11:33:55.717 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-19T11:33:55.746 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-19T11:33:55.750 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-19T11:33:55.819 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-19T11:33:55.820 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-19T11:33:55.853 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-19T11:33:55.853 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-19T11:33:55.854 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-19T11:33:56.259 INFO:teuthology.orchestra.run.smithi120.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-19T11:33:56.262 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-19T11:33:56.285 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 10.4 MB in 1s (8,726 kB/s) 2024-09-19T11:33:56.316 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-19T11:33:56.375 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-19T11:33:56.435 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176264 files and directories currently installed.) 2024-09-19T11:33:56.439 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-19T11:33:56.483 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-19T11:33:56.515 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-09-19T11:33:56.515 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-09-19T11:33:56.692 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T11:33:56.692 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T11:33:56.693 INFO:teuthology.orchestra.run.smithi120.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T11:33:56.693 INFO:teuthology.orchestra.run.smithi120.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T11:33:56.693 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T11:33:56.693 INFO:teuthology.orchestra.run.smithi120.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T11:33:56.693 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T11:33:56.694 INFO:teuthology.orchestra.run.smithi120.stdout:The following additional packages will be installed: 2024-09-19T11:33:56.694 INFO:teuthology.orchestra.run.smithi120.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-19T11:33:56.694 INFO:teuthology.orchestra.run.smithi120.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-19T11:33:56.695 INFO:teuthology.orchestra.run.smithi120.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-19T11:33:56.695 INFO:teuthology.orchestra.run.smithi120.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-19T11:33:56.695 INFO:teuthology.orchestra.run.smithi120.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-19T11:33:56.695 INFO:teuthology.orchestra.run.smithi120.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-19T11:33:56.695 INFO:teuthology.orchestra.run.smithi120.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-19T11:33:56.695 INFO:teuthology.orchestra.run.smithi120.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-19T11:33:56.695 INFO:teuthology.orchestra.run.smithi120.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-19T11:33:56.695 INFO:teuthology.orchestra.run.smithi120.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-19T11:33:56.695 INFO:teuthology.orchestra.run.smithi120.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-19T11:33:56.696 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2024-09-19T11:33:56.696 INFO:teuthology.orchestra.run.smithi120.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-19T11:33:56.696 INFO:teuthology.orchestra.run.smithi120.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-19T11:33:56.696 INFO:teuthology.orchestra.run.smithi120.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-19T11:33:56.696 INFO:teuthology.orchestra.run.smithi120.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-19T11:33:56.696 INFO:teuthology.orchestra.run.smithi120.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-19T11:33:56.735 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2024-09-19T11:33:56.735 INFO:teuthology.orchestra.run.smithi120.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-19T11:33:56.736 INFO:teuthology.orchestra.run.smithi120.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-19T11:33:56.736 INFO:teuthology.orchestra.run.smithi120.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-19T11:33:56.736 INFO:teuthology.orchestra.run.smithi120.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-19T11:33:56.736 INFO:teuthology.orchestra.run.smithi120.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-19T11:33:56.736 INFO:teuthology.orchestra.run.smithi120.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-19T11:33:56.736 INFO:teuthology.orchestra.run.smithi120.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-19T11:33:56.736 INFO:teuthology.orchestra.run.smithi120.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-19T11:33:56.736 INFO:teuthology.orchestra.run.smithi120.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-19T11:33:56.736 INFO:teuthology.orchestra.run.smithi120.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-19T11:33:56.737 INFO:teuthology.orchestra.run.smithi120.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-19T11:33:56.737 INFO:teuthology.orchestra.run.smithi120.stdout: s3cmd 2024-09-19T11:33:56.778 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-19T11:33:56.793 INFO:teuthology.orchestra.run.smithi120.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-19T11:33:56.793 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 10.4 MB of archives. 2024-09-19T11:33:56.793 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-19T11:33:56.793 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-19T11:33:56.806 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-19T11:33:56.811 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-19T11:33:56.811 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-19T11:33:56.815 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-19T11:33:56.844 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-19T11:33:56.850 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-19T11:33:56.866 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-19T11:33:56.867 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-19T11:33:56.898 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-19T11:33:56.918 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-19T11:33:56.919 INFO:teuthology.orchestra.run.smithi120.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-19T11:33:56.920 INFO:teuthology.orchestra.run.smithi120.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-19T11:33:56.966 INFO:teuthology.orchestra.run.smithi120.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-19T11:33:56.967 INFO:teuthology.orchestra.run.smithi120.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-19T11:33:56.984 INFO:teuthology.orchestra.run.smithi120.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-19T11:33:56.985 INFO:teuthology.orchestra.run.smithi120.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-19T11:33:56.985 INFO:teuthology.orchestra.run.smithi120.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-19T11:33:56.986 INFO:teuthology.orchestra.run.smithi120.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-19T11:33:56.986 INFO:teuthology.orchestra.run.smithi120.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-19T11:33:56.989 INFO:teuthology.orchestra.run.smithi120.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-19T11:33:56.990 INFO:teuthology.orchestra.run.smithi120.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-19T11:33:56.996 INFO:teuthology.orchestra.run.smithi120.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-19T11:33:57.002 INFO:teuthology.orchestra.run.smithi120.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-19T11:33:57.003 INFO:teuthology.orchestra.run.smithi120.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-19T11:33:57.015 INFO:teuthology.orchestra.run.smithi120.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-19T11:33:57.015 INFO:teuthology.orchestra.run.smithi120.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-19T11:33:57.016 INFO:teuthology.orchestra.run.smithi120.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-19T11:33:57.016 INFO:teuthology.orchestra.run.smithi120.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-19T11:33:57.018 INFO:teuthology.orchestra.run.smithi120.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-19T11:33:57.021 INFO:teuthology.orchestra.run.smithi120.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-19T11:33:57.023 INFO:teuthology.orchestra.run.smithi120.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-19T11:33:57.037 INFO:teuthology.orchestra.run.smithi120.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-19T11:33:57.037 INFO:teuthology.orchestra.run.smithi120.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-19T11:33:57.047 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-19T11:33:57.054 INFO:teuthology.orchestra.run.smithi120.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-19T11:33:57.054 INFO:teuthology.orchestra.run.smithi120.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-19T11:33:57.054 INFO:teuthology.orchestra.run.smithi120.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-19T11:33:57.075 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-19T11:33:57.105 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-19T11:33:57.358 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-19T11:33:57.386 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-19T11:33:57.424 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-19T11:33:57.492 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 10.4 MB in 0s (33.4 MB/s) 2024-09-19T11:33:57.577 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-19T11:33:57.637 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176264 files and directories currently installed.) 2024-09-19T11:33:57.642 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-19T11:33:57.693 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-19T11:33:57.988 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-19T11:33:58.017 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-19T11:33:58.063 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-19T11:33:58.281 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-19T11:33:58.309 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-19T11:33:58.339 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-19T11:33:58.366 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-19T11:33:58.394 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-19T11:33:58.457 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-19T11:33:58.591 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-19T11:33:58.619 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-19T11:33:58.658 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-19T11:33:58.735 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-19T11:33:58.763 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-19T11:33:58.801 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-19T11:33:58.910 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-19T11:33:58.938 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-19T11:33:58.976 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-19T11:33:59.087 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-19T11:33:59.116 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-19T11:33:59.154 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-19T11:33:59.262 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-19T11:33:59.291 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-19T11:33:59.329 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-19T11:33:59.423 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-19T11:33:59.451 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-19T11:33:59.498 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-19T11:33:59.615 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-19T11:33:59.631 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-19T11:33:59.665 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-19T11:33:59.800 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-19T11:33:59.829 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-19T11:33:59.875 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-19T11:33:59.908 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libjsr305-java. 2024-09-19T11:33:59.925 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-19T11:33:59.967 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-19T11:34:00.178 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-19T11:34:00.194 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-19T11:34:00.220 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libguava-java. 2024-09-19T11:34:00.236 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-19T11:34:00.244 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-19T11:34:00.278 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-19T11:34:00.538 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-19T11:34:00.555 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-19T11:34:00.597 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-19T11:34:00.722 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-19T11:34:00.751 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-19T11:34:00.789 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-19T11:34:00.874 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjsr305-java. 2024-09-19T11:34:00.900 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-19T11:34:00.941 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-19T11:34:01.041 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libguice-java. 2024-09-19T11:34:01.065 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-19T11:34:01.108 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-19T11:34:01.193 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libguava-java. 2024-09-19T11:34:01.210 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-19T11:34:01.252 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-19T11:34:01.495 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-19T11:34:01.511 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-19T11:34:01.553 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-19T11:34:01.704 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-19T11:34:01.720 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-19T11:34:01.763 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-19T11:34:01.797 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-19T11:34:01.813 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-19T11:34:01.847 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-19T11:34:02.006 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libguice-java. 2024-09-19T11:34:02.023 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-19T11:34:02.057 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-19T11:34:02.057 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libjansi-java. 2024-09-19T11:34:02.074 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-19T11:34:02.107 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-19T11:34:02.360 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-19T11:34:02.388 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-19T11:34:02.427 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-19T11:34:02.443 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-19T11:34:02.460 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-19T11:34:02.502 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-19T11:34:02.681 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-19T11:34:02.697 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-19T11:34:02.738 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-19T11:34:02.739 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-19T11:34:02.754 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-19T11:34:02.788 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-19T11:34:02.973 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjansi-java. 2024-09-19T11:34:02.990 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-19T11:34:03.000 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-19T11:34:03.017 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-19T11:34:03.023 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-19T11:34:03.058 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-19T11:34:03.311 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-19T11:34:03.339 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-19T11:34:03.378 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-19T11:34:03.420 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-19T11:34:03.448 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-19T11:34:03.486 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-19T11:34:03.699 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-19T11:34:03.715 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-19T11:34:03.739 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-19T11:34:03.757 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-19T11:34:03.767 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-19T11:34:03.805 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-19T11:34:04.009 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-19T11:34:04.037 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-19T11:34:04.067 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-19T11:34:04.076 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-19T11:34:04.090 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-19T11:34:04.133 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-19T11:34:04.303 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-19T11:34:04.320 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-19T11:34:04.362 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-19T11:34:04.368 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-19T11:34:04.385 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-19T11:34:04.419 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-19T11:34:04.622 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-19T11:34:04.639 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-19T11:34:04.706 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-19T11:34:04.764 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-19T11:34:04.792 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-19T11:34:04.831 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-19T11:34:04.958 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-19T11:34:04.987 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-19T11:34:05.025 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-19T11:34:05.100 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-19T11:34:05.128 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-19T11:34:05.166 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-19T11:34:05.277 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-19T11:34:05.294 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-19T11:34:05.327 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-19T11:34:05.419 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-19T11:34:05.435 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-19T11:34:05.477 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-19T11:34:05.572 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libslf4j-java. 2024-09-19T11:34:05.600 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-19T11:34:05.638 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-19T11:34:05.704 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-19T11:34:05.720 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-19T11:34:05.762 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-19T11:34:05.909 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-19T11:34:05.925 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-19T11:34:05.967 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-19T11:34:06.015 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-19T11:34:06.043 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-19T11:34:06.082 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-19T11:34:06.253 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-19T11:34:06.269 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-19T11:34:06.311 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-19T11:34:06.334 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-19T11:34:06.350 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-19T11:34:06.384 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-19T11:34:06.572 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-19T11:34:06.588 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-19T11:34:06.603 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libslf4j-java. 2024-09-19T11:34:06.630 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-19T11:34:06.631 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-19T11:34:06.669 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-19T11:34:06.931 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-19T11:34:06.947 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-19T11:34:06.990 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-19T11:34:07.027 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-19T11:34:07.055 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-19T11:34:07.093 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-19T11:34:07.275 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-19T11:34:07.292 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-19T11:34:07.334 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-19T11:34:07.345 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-19T11:34:07.362 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-19T11:34:07.403 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-19T11:34:07.865 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package maven. 2024-09-19T11:34:07.893 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-19T11:34:07.895 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-19T11:34:07.911 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-19T11:34:07.923 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking maven (3.6.3-5) ... 2024-09-19T11:34:07.945 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-19T11:34:08.210 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-magic. 2024-09-19T11:34:08.238 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-19T11:34:08.276 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-19T11:34:08.366 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-19T11:34:08.383 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-19T11:34:08.424 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-19T11:34:08.581 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package s3cmd. 2024-09-19T11:34:08.607 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-19T11:34:08.645 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-19T11:34:08.677 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-19T11:34:08.705 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-19T11:34:08.743 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-19T11:34:09.017 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-19T11:34:09.144 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-19T11:34:09.146 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package maven. 2024-09-19T11:34:09.175 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-19T11:34:09.204 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking maven (3.6.3-5) ... 2024-09-19T11:34:09.269 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-19T11:34:09.395 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-19T11:34:09.521 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-19T11:34:09.524 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-magic. 2024-09-19T11:34:09.552 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-19T11:34:09.591 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-19T11:34:09.647 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-19T11:34:09.773 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-19T11:34:09.890 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-19T11:34:09.893 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package s3cmd. 2024-09-19T11:34:09.921 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-19T11:34:09.960 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-19T11:34:09.991 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-19T11:34:10.117 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-19T11:34:10.243 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-19T11:34:10.338 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-19T11:34:10.369 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-19T11:34:10.465 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-19T11:34:10.495 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-19T11:34:10.591 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-19T11:34:10.647 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-19T11:34:10.739 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-19T11:34:10.781 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-19T11:34:10.859 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-19T11:34:10.899 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-19T11:34:10.960 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-19T11:34:11.061 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-19T11:34:11.150 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-19T11:34:11.187 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-19T11:34:11.276 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-19T11:34:11.313 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-19T11:34:11.439 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-19T11:34:11.565 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-19T11:34:11.691 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-19T11:34:11.702 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-19T11:34:11.817 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-19T11:34:11.820 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-19T11:34:11.935 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-19T11:34:11.937 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-19T11:34:12.044 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-19T11:34:12.063 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-19T11:34:12.154 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-19T11:34:12.190 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-19T11:34:12.422 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-19T11:34:12.483 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-19T11:34:12.548 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-19T11:34:12.609 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-19T11:34:12.673 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-19T11:34:12.726 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libguava-java (29.0-6) ... 2024-09-19T11:34:12.816 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-19T11:34:12.827 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-19T11:34:12.942 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-19T11:34:12.945 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-19T11:34:13.054 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-19T11:34:13.068 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-19T11:34:13.177 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-19T11:34:13.180 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-19T11:34:13.315 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-19T11:34:13.440 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-19T11:34:13.488 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-19T11:34:13.566 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-19T11:34:13.606 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-19T11:34:13.692 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-19T11:34:13.706 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libguava-java (29.0-6) ... 2024-09-19T11:34:13.810 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up maven (3.6.3-5) ... 2024-09-19T11:34:13.832 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-19T11:34:13.942 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-19T11:34:14.034 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-19T11:34:14.068 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-19T11:34:14.106 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-19T11:34:14.193 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-19T11:34:14.319 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-19T11:34:14.446 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-19T11:34:14.571 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-19T11:34:14.697 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-19T11:34:14.798 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up maven (3.6.3-5) ... 2024-09-19T11:34:15.055 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-19T11:34:15.119 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-19T11:34:15.457 INFO:teuthology.orchestra.run.smithi151.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-19T11:34:15.463 DEBUG:teuthology.parallel:result is None 2024-09-19T11:34:16.509 INFO:teuthology.orchestra.run.smithi120.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-19T11:34:16.514 DEBUG:teuthology.parallel:result is None 2024-09-19T11:34:16.514 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:34:16.678 DEBUG:teuthology.orchestra.run.smithi120:> dpkg-query -W -f '${Version}' ceph 2024-09-19T11:34:16.697 INFO:teuthology.orchestra.run.smithi120.stdout:19.3.0-5012-g08af21e0-1jammy 2024-09-19T11:34:16.698 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5012-g08af21e0-1jammy 2024-09-19T11:34:16.698 INFO:teuthology.task.install:The correct ceph version 19.3.0-5012-g08af21e0-1jammy is installed. 2024-09-19T11:34:16.700 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:34:16.855 DEBUG:teuthology.orchestra.run.smithi151:> dpkg-query -W -f '${Version}' ceph 2024-09-19T11:34:16.874 INFO:teuthology.orchestra.run.smithi151.stdout:19.3.0-5012-g08af21e0-1jammy 2024-09-19T11:34:16.874 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5012-g08af21e0-1jammy 2024-09-19T11:34:16.875 INFO:teuthology.task.install:The correct ceph version 19.3.0-5012-g08af21e0-1jammy is installed. 2024-09-19T11:34:16.876 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T11:34:16.877 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:16.877 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T11:34:16.891 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:16.891 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T11:34:16.929 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T11:34:16.929 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:16.929 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T11:34:16.945 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T11:34:17.001 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:17.001 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T11:34:17.015 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T11:34:17.068 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T11:34:17.068 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:17.068 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T11:34:17.081 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T11:34:17.136 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:17.136 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T11:34:17.150 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T11:34:17.207 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T11:34:17.208 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:17.208 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T11:34:17.221 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T11:34:17.277 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:17.277 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T11:34:17.290 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T11:34:17.344 INFO:teuthology.run_tasks:Running task ceph... 2024-09-19T11:34:17.428 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-19T11:34:17.428 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /var/log/ceph 2024-09-19T11:34:17.431 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2024-09-19T11:34:17.444 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-19T11:34:17.444 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T11:34:17.487 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T11:34:17.499 INFO:tasks.ceph:Creating extra log directories... 2024-09-19T11:34:17.500 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T11:34:17.539 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T11:34:17.571 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-19T11:34:17.571 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-19T11:34:17.571 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912444', 'branch': 'wip-yuval-test', 'description': 'rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7912444', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuval-test'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}}, 'rgw': {'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuval-test', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}}, 'owner': 'scheduled_yuvalif@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 4251, 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754', 'sleep_before_teardown': 0, 'subset': '1/3', 'suite': 'rgw', 'suite_branch': 'wip-yuval-test', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754', 'targets': {'smithi120.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB9Bn4+gcDJ8JTFkrYDWodL/rr3hTgZsnPffn+95U5x3Zs0ILtvVb16iZVsjUoAK9/KZ35etjm2W+inbk+KP7HY=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMnyycvKo4Vf9qg1VrhXk80tYnMMk5ZZYOEoMVLvJbH5XX3E+CWaxpkvM2du0kCF55CsJ5HqEtXIsuNnj1/U7No='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-19_08:49:34', 'tube': 'smithi', 'user': 'yuvalif', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-19T11:34:17.572 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T11:34:17.598 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T11:34:17.609 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T11:34:17.646 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T11:34:17.665 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:17.665 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T11:34:17.705 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T11:34:17.705 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-09-19T11:34:17.754 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T11:34:17.754 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:34:17.754 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-09-19T11:34:17.754 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:34:17.754 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-19 11:28:27.070327817 +0000 2024-09-19T11:34:17.754 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-19 11:28:26.802330210 +0000 2024-09-19T11:34:17.754 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-19 11:28:26.802330210 +0000 2024-09-19T11:34:17.755 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-19T11:34:17.755 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T11:34:17.808 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-19T11:34:17.808 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-19T11:34:17.808 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000376313 s, 1.4 MB/s 2024-09-19T11:34:17.810 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T11:34:17.859 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-09-19T11:34:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T11:34:17.906 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:34:17.906 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-09-19T11:34:17.906 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:34:17.906 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-19 11:28:27.550323529 +0000 2024-09-19T11:34:17.906 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-19 11:28:27.294325815 +0000 2024-09-19T11:34:17.906 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-19 11:28:27.294325815 +0000 2024-09-19T11:34:17.906 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-19T11:34:17.906 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T11:34:17.960 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-19T11:34:17.960 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-19T11:34:17.960 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000446753 s, 1.1 MB/s 2024-09-19T11:34:17.962 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T11:34:18.011 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-09-19T11:34:18.057 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T11:34:18.057 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:34:18.057 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-09-19T11:34:18.058 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:34:18.058 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-19 11:28:28.058318991 +0000 2024-09-19T11:34:18.058 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-19 11:28:27.794321349 +0000 2024-09-19T11:34:18.058 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-19 11:28:27.794321349 +0000 2024-09-19T11:34:18.058 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-19T11:34:18.058 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T11:34:18.112 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-19T11:34:18.112 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-19T11:34:18.112 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000430033 s, 1.2 MB/s 2024-09-19T11:34:18.113 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T11:34:18.163 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-09-19T11:34:18.209 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T11:34:18.209 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:34:18.210 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-09-19T11:34:18.210 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:34:18.210 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-19 11:28:28.558314526 +0000 2024-09-19T11:34:18.210 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-19 11:28:28.294316884 +0000 2024-09-19T11:34:18.210 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-19 11:28:28.294316884 +0000 2024-09-19T11:34:18.210 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-19T11:34:18.210 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T11:34:18.263 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-19T11:34:18.264 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-19T11:34:18.264 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000385408 s, 1.3 MB/s 2024-09-19T11:34:18.265 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T11:34:18.315 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T11:34:18.315 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:18.315 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T11:34:18.321 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T11:34:18.321 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2024-09-19T11:34:18.369 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T11:34:18.369 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:34:18.369 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 880 Links: 1 2024-09-19T11:34:18.369 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:34:18.369 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-19 11:28:30.603727569 +0000 2024-09-19T11:34:18.369 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-19 11:28:30.351729820 +0000 2024-09-19T11:34:18.369 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-19 11:28:30.351729820 +0000 2024-09-19T11:34:18.369 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-19T11:34:18.370 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T11:34:18.425 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-19T11:34:18.425 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-19T11:34:18.425 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000361455 s, 1.4 MB/s 2024-09-19T11:34:18.426 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T11:34:18.474 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2024-09-19T11:34:18.520 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T11:34:18.521 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:34:18.521 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-09-19T11:34:18.521 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:34:18.521 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-19 11:28:31.071723389 +0000 2024-09-19T11:34:18.521 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-19 11:28:30.823725604 +0000 2024-09-19T11:34:18.521 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-19 11:28:30.823725604 +0000 2024-09-19T11:34:18.521 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-19T11:34:18.521 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T11:34:18.575 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-19T11:34:18.575 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-19T11:34:18.575 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000418984 s, 1.2 MB/s 2024-09-19T11:34:18.576 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T11:34:18.626 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2024-09-19T11:34:18.673 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T11:34:18.673 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:34:18.673 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-19T11:34:18.673 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:34:18.673 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-19 11:28:31.319721174 +0000 2024-09-19T11:34:18.673 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-19 11:28:31.315721210 +0000 2024-09-19T11:34:18.674 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-19 11:28:31.315721210 +0000 2024-09-19T11:34:18.674 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-19T11:34:18.674 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T11:34:18.727 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-19T11:34:18.727 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-19T11:34:18.727 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.00044292 s, 1.2 MB/s 2024-09-19T11:34:18.728 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T11:34:18.778 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2024-09-19T11:34:18.825 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T11:34:18.825 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:34:18.825 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-09-19T11:34:18.825 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:34:18.825 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-19 11:28:32.071714457 +0000 2024-09-19T11:34:18.825 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-19 11:28:31.835716565 +0000 2024-09-19T11:34:18.825 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-19 11:28:31.835716565 +0000 2024-09-19T11:34:18.825 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-19T11:34:18.825 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T11:34:18.879 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-19T11:34:18.879 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-19T11:34:18.879 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000328463 s, 1.6 MB/s 2024-09-19T11:34:18.880 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T11:34:18.930 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T11:34:18.930 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T11:34:18.930 INFO:tasks.ceph:Generating config... 2024-09-19T11:34:18.931 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-19T11:34:18.931 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-19T11:34:18.932 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-19T11:34:18.932 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-19T11:34:18.932 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-19T11:34:18.932 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-19T11:34:18.932 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-19T11:34:18.932 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-19T11:34:18.932 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-19T11:34:18.932 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-19T11:34:18.932 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-19T11:34:18.932 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-19T11:34:18.932 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-19T11:34:18.932 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-19T11:34:18.932 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-19T11:34:18.933 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-19T11:34:18.933 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-19T11:34:18.933 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-19T11:34:18.933 INFO:tasks.ceph:[client] setuser = ceph 2024-09-19T11:34:18.933 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-19T11:34:18.933 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-19T11:34:18.933 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-19T11:34:18.933 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-19T11:34:18.933 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-09-19T11:34:18.933 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-19T11:34:18.933 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-19T11:34:18.933 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-19T11:34:18.933 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-19T11:34:18.933 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-19T11:34:18.933 INFO:tasks.ceph:[mon] lockdep = True 2024-09-19T11:34:18.934 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-19T11:34:18.934 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-19T11:34:18.934 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-19T11:34:18.934 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-19T11:34:18.934 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-19T11:34:18.934 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-19T11:34:18.934 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-19T11:34:18.934 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-19T11:34:18.934 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-19T11:34:18.934 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-19T11:34:18.934 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-19T11:34:18.935 INFO:tasks.ceph:[osd] lockdep = True 2024-09-19T11:34:18.935 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-19T11:34:18.935 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-19T11:34:18.935 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-19T11:34:18.935 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-19T11:34:18.935 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-19T11:34:18.935 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-19T11:34:18.935 INFO:tasks.ceph:Setting up mon.a... 2024-09-19T11:34:18.937 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-19T11:34:18.972 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.keyring 2024-09-19T11:34:18.997 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-19T11:34:19.076 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T11:34:19.129 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.120'), ('mon.c', '[v2:172.21.15.120:3301,v1:172.21.15.120:6790]'), ('mon.b', '172.21.15.151')] 2024-09-19T11:34:19.130 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.120,[v2:172.21.15.120:3301,v1:172.21.15.120:6790],172.21.15.151', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-19T11:34:19.132 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:19.132 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T11:34:19.178 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.120 --addv c '[v2:172.21.15.120:3301,v1:172.21.15.120:6790]' --add b 172.21.15.151 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:34:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:34:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:34:19.264 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:34:19.264 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: generated fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:34:19.264 INFO:teuthology.orchestra.run.smithi120.stdout:setting min_mon_release = quincy 2024-09-19T11:34:19.264 INFO:teuthology.orchestra.run.smithi120.stdout:epoch 0 2024-09-19T11:34:19.264 INFO:teuthology.orchestra.run.smithi120.stdout:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:34:19.264 INFO:teuthology.orchestra.run.smithi120.stdout:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:34:19.264 INFO:teuthology.orchestra.run.smithi120.stdout:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:34:19.264 INFO:teuthology.orchestra.run.smithi120.stdout:min_mon_release 17 (quincy) 2024-09-19T11:34:19.264 INFO:teuthology.orchestra.run.smithi120.stdout:election_strategy: 1 2024-09-19T11:34:19.264 INFO:teuthology.orchestra.run.smithi120.stdout:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:34:19.264 INFO:teuthology.orchestra.run.smithi120.stdout:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:34:19.264 INFO:teuthology.orchestra.run.smithi120.stdout:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:34:19.265 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-19T11:34:19.266 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T11:34:19.314 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e4647c72-93bd-41bc-8102-6ca42f6edad4... 2024-09-19T11:34:19.315 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T11:34:19.358 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T11:34:19.384 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2024-09-19T11:34:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: chdir = "" 2024-09-19T11:34:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T11:34:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: auth supported = cephx 2024-09-19T11:34:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: filestore xattr use omap = true 2024-09-19T11:34:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: mon clock drift allowed = 1.000 2024-09-19T11:34:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: osd crush chooseleaf type = 0 2024-09-19T11:34:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: auth debug = true 2024-09-19T11:34:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on old message = true 2024-09-19T11:34:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on bug = true 2024-09-19T11:34:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T11:34:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn max object skew = 0 2024-09-19T11:34:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T11:34:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T11:34:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default size = 2 2024-09-19T11:34:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow primary affinity = true 2024-09-19T11:34:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow pg remap = true 2024-09-19T11:34:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on legacy crush tunables = false 2024-09-19T11:34:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on crush straw calc version zero = false 2024-09-19T11:34:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on no sortbitwise = false 2024-09-19T11:34:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on osd down out interval zero = false 2024-09-19T11:34:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on too few osds = false 2024-09-19T11:34:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T11:34:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T11:34:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: mon_allow_pool_size_one = true 2024-09-19T11:34:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T11:34:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: osd default data pool replay window = 5 2024-09-19T11:34:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: mon allow pool delete = true 2024-09-19T11:34:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: mon cluster log file level = debug 2024-09-19T11:34:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: debug asserts on shutdown = true 2024-09-19T11:34:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: mon health detail to clog = false 2024-09-19T11:34:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: mon host = "172.21.15.120,[v2:172.21.15.120:3301,v1:172.21.15.120:6790],172.21.15.151" 2024-09-19T11:34:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: mon client directed command retry = 5 2024-09-19T11:34:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: ms inject socket failures = 5000 2024-09-19T11:34:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: osd_max_pg_log_entries = 10 2024-09-19T11:34:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: osd_min_pg_log_entries = 10 2024-09-19T11:34:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: rgw override bucket index max shards = 1 2024-09-19T11:34:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:34:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.387 INFO:teuthology.orchestra.run.smithi120.stdout:[osd] 2024-09-19T11:34:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: osd journal size = 100 2024-09-19T11:34:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub load threshold = 5.0 2024-09-19T11:34:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub max interval = 600 2024-09-19T11:34:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: osd mclock profile = high_recovery_ops 2024-09-19T11:34:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: osd recover clone overlap = true 2024-09-19T11:34:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: osd recovery max chunk = 1048576 2024-09-19T11:34:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug shutdown = true 2024-09-19T11:34:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug op order = true 2024-09-19T11:34:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug verify stray on activate = true 2024-09-19T11:34:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug trim objects = true 2024-09-19T11:34:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: osd open classes on start = true 2024-09-19T11:34:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug pg log writeout = true 2024-09-19T11:34:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: osd deep scrub update digest min age = 30 2024-09-19T11:34:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: osd map max advance = 10 2024-09-19T11:34:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: journal zero on create = true 2024-09-19T11:34:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: filestore ondisk finisher threads = 3 2024-09-19T11:34:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: filestore apply finisher threads = 3 2024-09-19T11:34:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: bdev debug aio = true 2024-09-19T11:34:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug misdirected ops = true 2024-09-19T11:34:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: bdev async discard = True 2024-09-19T11:34:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: bdev enable discard = True 2024-09-19T11:34:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore allocator = bitmap 2024-09-19T11:34:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore block size = 96636764160 2024-09-19T11:34:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore fsck on mount = True 2024-09-19T11:34:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluefs = 1/20 2024-09-19T11:34:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluestore = 1/20 2024-09-19T11:34:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-19T11:34:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: debug objclass = 20 2024-09-19T11:34:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: debug osd = 20 2024-09-19T11:34:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: debug rocksdb = 4/10 2024-09-19T11:34:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: lockdep = True 2024-09-19T11:34:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T11:34:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd full ratio = 0.9 2024-09-19T11:34:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd nearfull ratio = 0.8 2024-09-19T11:34:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: osd failsafe full ratio = 0.95 2024-09-19T11:34:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: osd objectstore = bluestore 2024-09-19T11:34:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: osd shutdown pgref assert = True 2024-09-19T11:34:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.391 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr] 2024-09-19T11:34:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-19T11:34:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: debug mgr = 20 2024-09-19T11:34:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-19T11:34:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-19T11:34:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-19T11:34:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-19T11:34:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: mgr/telemetry/nag = false 2024-09-19T11:34:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.392 INFO:teuthology.orchestra.run.smithi120.stdout:[mon] 2024-09-19T11:34:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-19T11:34:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-19T11:34:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: debug paxos = 20 2024-09-19T11:34:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-19T11:34:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: mon data avail warn = 5 2024-09-19T11:34:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: mon mgr mkfs grace = 240 2024-09-19T11:34:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-19T11:34:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd reporter subtree level = osd 2024-09-19T11:34:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd prime pg temp = true 2024-09-19T11:34:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-19T11:34:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T11:34:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T11:34:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T11:34:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T11:34:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T11:34:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T11:34:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: # 1m isn't quite enough 2024-09-19T11:34:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: mon_down_mkfs_grace = 2m 2024-09-19T11:34:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_filestore_osds = false 2024-09-19T11:34:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: lockdep = True 2024-09-19T11:34:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:34:19.394 INFO:teuthology.orchestra.run.smithi120.stdout:[client] 2024-09-19T11:34:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: rgw cache enabled = true 2024-09-19T11:34:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable ops log = True 2024-09-19T11:34:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable usage log = true 2024-09-19T11:34:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T11:34:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T11:34:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: debug rgw = 20 2024-09-19T11:34:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: debug rgw notification = 20 2024-09-19T11:34:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: rgw bucket counters cache = True 2024-09-19T11:34:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: rgw crypt require ssl = False 2024-09-19T11:34:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: rgw crypt s3 kms backend = testing 2024-09-19T11:34:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-19T11:34:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-19T11:34:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-19T11:34:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: rgw d3n l1 local datacache enabled = True 2024-09-19T11:34:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: rgw max chunk size = 4194304 2024-09-19T11:34:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: rgw obj stripe size = 6291456 2024-09-19T11:34:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: rgw reshard progress judge interval = 10 2024-09-19T11:34:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: rgw s3 auth use sts = True 2024-09-19T11:34:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: rgw sts key = abcdefghijklmnop 2024-09-19T11:34:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: rgw torrent flag = True 2024-09-19T11:34:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: rgw user counters cache = True 2024-09-19T11:34:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: setgroup = ceph 2024-09-19T11:34:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: setuser = ceph 2024-09-19T11:34:19.396 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.a] 2024-09-19T11:34:19.396 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.c] 2024-09-19T11:34:19.396 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.b] 2024-09-19T11:34:19.396 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2024-09-19T11:34:19.396 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2024-09-19T11:34:19.396 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T11:34:19.397 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2024-09-19T11:34:19.397 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.397 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2024-09-19T11:34:19.397 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.397 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2024-09-19T11:34:19.397 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.397 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2024-09-19T11:34:19.397 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2024-09-19T11:34:19.397 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.397 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2024-09-19T11:34:19.397 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2024-09-19T11:34:19.397 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.397 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T11:34:19.398 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2024-09-19T11:34:19.398 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.398 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T11:34:19.398 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T11:34:19.398 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.398 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2024-09-19T11:34:19.398 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.398 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2024-09-19T11:34:19.398 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2024-09-19T11:34:19.398 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2024-09-19T11:34:19.398 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2024-09-19T11:34:19.398 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2024-09-19T11:34:19.398 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2024-09-19T11:34:19.399 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2024-09-19T11:34:19.399 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T11:34:19.399 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T11:34:19.399 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2024-09-19T11:34:19.399 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.399 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T11:34:19.399 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.399 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2024-09-19T11:34:19.399 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.399 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2024-09-19T11:34:19.399 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.399 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2024-09-19T11:34:19.399 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2024-09-19T11:34:19.399 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2024-09-19T11:34:19.400 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.120,[v2:172.21.15.120:3301,v1:172.21.15.120:6790],172.21.15.151" 2024-09-19T11:34:19.400 INFO:teuthology.orchestra.run.smithi151.stdout: mon client directed command retry = 5 2024-09-19T11:34:19.400 INFO:teuthology.orchestra.run.smithi151.stdout: ms inject socket failures = 5000 2024-09-19T11:34:19.400 INFO:teuthology.orchestra.run.smithi151.stdout: osd_max_pg_log_entries = 10 2024-09-19T11:34:19.400 INFO:teuthology.orchestra.run.smithi151.stdout: osd_min_pg_log_entries = 10 2024-09-19T11:34:19.400 INFO:teuthology.orchestra.run.smithi151.stdout: rgw override bucket index max shards = 1 2024-09-19T11:34:19.400 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:34:19.400 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.400 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2024-09-19T11:34:19.400 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2024-09-19T11:34:19.400 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.400 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2024-09-19T11:34:19.400 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2024-09-19T11:34:19.400 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2024-09-19T11:34:19.401 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.401 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2024-09-19T11:34:19.401 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2024-09-19T11:34:19.401 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.401 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2024-09-19T11:34:19.401 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2024-09-19T11:34:19.401 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2024-09-19T11:34:19.401 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug trim objects = true 2024-09-19T11:34:19.401 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.401 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2024-09-19T11:34:19.401 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2024-09-19T11:34:19.401 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.401 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2024-09-19T11:34:19.401 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.402 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2024-09-19T11:34:19.402 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.402 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2024-09-19T11:34:19.402 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.402 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2024-09-19T11:34:19.402 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2024-09-19T11:34:19.402 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.402 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2024-09-19T11:34:19.402 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2024-09-19T11:34:19.402 INFO:teuthology.orchestra.run.smithi151.stdout: bdev async discard = True 2024-09-19T11:34:19.402 INFO:teuthology.orchestra.run.smithi151.stdout: bdev enable discard = True 2024-09-19T11:34:19.402 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore allocator = bitmap 2024-09-19T11:34:19.402 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2024-09-19T11:34:19.402 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2024-09-19T11:34:19.403 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2024-09-19T11:34:19.403 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2024-09-19T11:34:19.403 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-19T11:34:19.403 INFO:teuthology.orchestra.run.smithi151.stdout: debug objclass = 20 2024-09-19T11:34:19.403 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2024-09-19T11:34:19.403 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2024-09-19T11:34:19.403 INFO:teuthology.orchestra.run.smithi151.stdout: lockdep = True 2024-09-19T11:34:19.403 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T11:34:19.403 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2024-09-19T11:34:19.403 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2024-09-19T11:34:19.403 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2024-09-19T11:34:19.403 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2024-09-19T11:34:19.404 INFO:teuthology.orchestra.run.smithi151.stdout: osd shutdown pgref assert = True 2024-09-19T11:34:19.404 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.404 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2024-09-19T11:34:19.404 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-19T11:34:19.404 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2024-09-19T11:34:19.404 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-09-19T11:34:19.404 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-09-19T11:34:19.404 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-09-19T11:34:19.404 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-09-19T11:34:19.404 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2024-09-19T11:34:19.404 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.404 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2024-09-19T11:34:19.404 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-19T11:34:19.405 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-09-19T11:34:19.405 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2024-09-19T11:34:19.405 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-09-19T11:34:19.405 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2024-09-19T11:34:19.405 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2024-09-19T11:34:19.405 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-09-19T11:34:19.405 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2024-09-19T11:34:19.405 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2024-09-19T11:34:19.405 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-09-19T11:34:19.405 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.405 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T11:34:19.405 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T11:34:19.405 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T11:34:19.405 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.405 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T11:34:19.406 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T11:34:19.406 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T11:34:19.406 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.406 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2024-09-19T11:34:19.406 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2024-09-19T11:34:19.406 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.406 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2024-09-19T11:34:19.406 INFO:teuthology.orchestra.run.smithi151.stdout: lockdep = True 2024-09-19T11:34:19.406 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-19T11:34:19.406 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2024-09-19T11:34:19.406 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2024-09-19T11:34:19.406 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = True 2024-09-19T11:34:19.406 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2024-09-19T11:34:19.407 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T11:34:19.407 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T11:34:19.407 INFO:teuthology.orchestra.run.smithi151.stdout: debug rgw = 20 2024-09-19T11:34:19.407 INFO:teuthology.orchestra.run.smithi151.stdout: debug rgw notification = 20 2024-09-19T11:34:19.407 INFO:teuthology.orchestra.run.smithi151.stdout: rgw bucket counters cache = True 2024-09-19T11:34:19.407 INFO:teuthology.orchestra.run.smithi151.stdout: rgw crypt require ssl = False 2024-09-19T11:34:19.407 INFO:teuthology.orchestra.run.smithi151.stdout: rgw crypt s3 kms backend = testing 2024-09-19T11:34:19.407 INFO:teuthology.orchestra.run.smithi151.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-19T11:34:19.407 INFO:teuthology.orchestra.run.smithi151.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-19T11:34:19.407 INFO:teuthology.orchestra.run.smithi151.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-19T11:34:19.407 INFO:teuthology.orchestra.run.smithi151.stdout: rgw d3n l1 local datacache enabled = True 2024-09-19T11:34:19.407 INFO:teuthology.orchestra.run.smithi151.stdout: rgw max chunk size = 4194304 2024-09-19T11:34:19.407 INFO:teuthology.orchestra.run.smithi151.stdout: rgw obj stripe size = 6291456 2024-09-19T11:34:19.408 INFO:teuthology.orchestra.run.smithi151.stdout: rgw reshard progress judge interval = 10 2024-09-19T11:34:19.408 INFO:teuthology.orchestra.run.smithi151.stdout: rgw s3 auth use sts = True 2024-09-19T11:34:19.408 INFO:teuthology.orchestra.run.smithi151.stdout: rgw sts key = abcdefghijklmnop 2024-09-19T11:34:19.408 INFO:teuthology.orchestra.run.smithi151.stdout: rgw torrent flag = True 2024-09-19T11:34:19.408 INFO:teuthology.orchestra.run.smithi151.stdout: rgw user counters cache = True 2024-09-19T11:34:19.408 INFO:teuthology.orchestra.run.smithi151.stdout: setgroup = ceph 2024-09-19T11:34:19.408 INFO:teuthology.orchestra.run.smithi151.stdout: setuser = ceph 2024-09-19T11:34:19.408 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2024-09-19T11:34:19.408 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2024-09-19T11:34:19.408 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2024-09-19T11:34:19.409 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-19T11:34:19.410 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-19T11:34:19.501 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-19T11:34:19.502 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:19.502 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-19T11:34:19.507 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:19.507 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-19T11:34:19.553 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T11:34:19.553 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:19.553 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T11:34:19.554 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T11:34:19.618 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:19.618 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:34:19.665 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2024-09-19T11:34:19.666 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:19.666 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T11:34:19.666 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T11:34:19.689 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:19.689 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:34:19.736 INFO:tasks.ceph:Setting up mon nodes... 2024-09-19T11:34:19.737 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-19T11:34:19.737 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T11:34:19.783 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T11:34:19.786 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T11:34:19.830 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T11:34:19.839 INFO:tasks.ceph:Setting up mds nodes... 2024-09-19T11:34:19.839 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-19T11:34:19.839 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T11:34:19.873 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-19T11:34:19.884 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-19T11:34:19.920 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-19T11:34:19.931 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-19T11:34:19.931 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T11:34:19.931 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-19T11:34:19.943 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T11:34:19.943 INFO:tasks.ceph:role: osd.0 2024-09-19T11:34:19.943 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T11:34:19.943 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T11:34:20.008 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T11:34:20.008 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T11:34:20.008 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T11:34:20.008 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T11:34:20.008 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T11:34:20.008 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-19T11:34:20.008 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T11:34:20.009 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T11:34:20.009 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T11:34:20.009 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T11:34:20.493 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-19T11:34:20.495 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-19T11:34:20.495 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-19T11:34:20.660 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-19T11:34:20.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:34:20.672 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T11:34:20.673 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-19T11:34:20.729 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T11:34:20.729 INFO:tasks.ceph:role: osd.1 2024-09-19T11:34:20.729 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T11:34:20.729 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T11:34:20.794 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T11:34:20.794 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T11:34:20.794 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T11:34:20.794 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T11:34:20.794 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T11:34:20.794 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-19T11:34:20.794 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T11:34:20.794 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T11:34:20.794 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T11:34:20.795 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T11:34:21.250 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-19T11:34:21.252 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-19T11:34:21.252 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-19T11:34:21.346 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-19T11:34:21.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:34:21.355 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T11:34:21.356 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-19T11:34:21.409 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T11:34:21.409 INFO:tasks.ceph:role: osd.2 2024-09-19T11:34:21.409 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T11:34:21.409 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T11:34:21.472 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T11:34:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T11:34:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T11:34:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T11:34:21.473 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T11:34:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-19T11:34:21.473 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T11:34:21.473 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T11:34:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T11:34:21.473 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T11:34:21.932 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-19T11:34:21.935 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-19T11:34:21.935 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-19T11:34:22.049 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-19T11:34:22.059 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T11:34:22.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:34:22.061 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-19T11:34:22.117 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T11:34:22.117 INFO:tasks.ceph:role: osd.3 2024-09-19T11:34:22.117 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T11:34:22.117 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T11:34:22.182 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T11:34:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T11:34:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T11:34:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T11:34:22.182 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T11:34:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-19T11:34:22.182 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T11:34:22.182 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T11:34:22.182 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T11:34:22.182 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T11:34:22.674 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-19T11:34:22.677 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-19T11:34:22.677 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-19T11:34:22.819 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-19T11:34:22.830 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T11:34:22.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:34:22.831 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:34:22.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:22.950+0000 7f03bcbe57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-19T11:34:22.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:22.954+0000 7f03bcbe57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-19T11:34:22.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:22.954+0000 7f03bcbe57c0 -1 bdev(0x556d68cb7800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-19T11:34:22.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:22.954+0000 7f03bcbe57c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-19T11:34:26.117 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T11:34:26.131 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:34:26.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:26.210+0000 7f858309d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-19T11:34:26.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:26.210+0000 7f858309d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-19T11:34:26.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:26.210+0000 7f858309d7c0 -1 bdev(0x558010fef800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-19T11:34:26.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:26.214+0000 7f858309d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-19T11:34:29.375 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T11:34:29.430 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:34:29.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:29.510+0000 7fdbf2db07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-19T11:34:29.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:29.510+0000 7fdbf2db07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-19T11:34:29.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:29.510+0000 7fdbf2db07c0 -1 bdev(0x55d26ee0d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-19T11:34:29.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:29.514+0000 7fdbf2db07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-19T11:34:32.690 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T11:34:32.746 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:34:32.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:32.825+0000 7f8c30e5f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-19T11:34:32.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:32.829+0000 7f8c30e5f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-19T11:34:32.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:32.829+0000 7f8c30e5f7c0 -1 bdev(0x55dc3e02b800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-19T11:34:32.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:34:32.829+0000 7f8c30e5f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-19T11:34:35.960 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T11:34:36.021 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-19T11:34:36.036 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T11:34:36.036 INFO:tasks.ceph:role: osd.4 2024-09-19T11:34:36.036 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-19T11:34:36.036 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T11:34:36.100 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T11:34:36.100 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T11:34:36.100 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T11:34:36.100 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T11:34:36.100 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T11:34:36.100 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-19T11:34:36.100 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T11:34:36.100 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T11:34:36.100 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T11:34:36.100 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T11:34:36.578 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-19T11:34:36.580 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-19T11:34:36.580 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-19T11:34:36.727 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-19T11:34:36.738 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T11:34:36.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:34:36.739 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-19T11:34:36.795 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T11:34:36.795 INFO:tasks.ceph:role: osd.5 2024-09-19T11:34:36.795 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-19T11:34:36.795 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T11:34:36.863 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T11:34:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T11:34:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T11:34:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T11:34:36.863 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T11:34:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-19T11:34:36.864 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T11:34:36.864 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T11:34:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T11:34:36.864 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T11:34:37.293 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-19T11:34:37.295 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-19T11:34:37.295 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-19T11:34:37.356 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-19T11:34:37.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:34:37.409 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T11:34:37.410 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-19T11:34:37.463 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T11:34:37.463 INFO:tasks.ceph:role: osd.6 2024-09-19T11:34:37.463 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-19T11:34:37.463 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T11:34:37.524 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T11:34:37.524 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T11:34:37.524 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T11:34:37.524 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T11:34:37.524 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T11:34:37.524 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-19T11:34:37.524 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T11:34:37.525 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T11:34:37.525 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T11:34:37.525 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T11:34:37.982 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-19T11:34:37.984 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-19T11:34:37.984 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-19T11:34:38.086 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-19T11:34:38.097 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T11:34:38.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:34:38.098 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-19T11:34:38.152 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T11:34:38.152 INFO:tasks.ceph:role: osd.7 2024-09-19T11:34:38.152 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-19T11:34:38.152 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T11:34:38.220 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T11:34:38.220 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T11:34:38.220 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T11:34:38.220 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T11:34:38.220 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T11:34:38.221 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-19T11:34:38.221 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T11:34:38.221 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T11:34:38.221 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T11:34:38.221 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T11:34:38.687 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-19T11:34:38.688 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-19T11:34:38.689 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-19T11:34:38.854 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-19T11:34:38.865 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T11:34:38.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:34:38.866 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:34:38.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:38.982+0000 7f76d493c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-19T11:34:38.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:38.986+0000 7f76d493c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-19T11:34:38.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:38.986+0000 7f76d493c7c0 -1 bdev(0x5636f2927800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-19T11:34:38.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:38.986+0000 7f76d493c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-19T11:34:42.129 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T11:34:42.142 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:34:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:42.218+0000 7f18f93c37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-19T11:34:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:42.222+0000 7f18f93c37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-19T11:34:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:42.222+0000 7f18f93c37c0 -1 bdev(0x55d324c1f800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-19T11:34:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:42.222+0000 7f18f93c37c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-19T11:34:45.362 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T11:34:45.417 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:34:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:45.494+0000 7fb56df697c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-19T11:34:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:45.494+0000 7fb56df697c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-19T11:34:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:45.494+0000 7fb56df697c0 -1 bdev(0x5585424b9800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-19T11:34:45.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:45.494+0000 7fb56df697c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-19T11:34:48.632 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-19T11:34:48.693 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:34:48.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:48.774+0000 7f847b60e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-19T11:34:48.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:48.778+0000 7f847b60e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-19T11:34:48.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:48.778+0000 7f847b60e7c0 -1 bdev(0x55d8ff513800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-19T11:34:48.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-19T11:34:48.778+0000 7f847b60e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-19T11:34:51.916 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-19T11:34:51.973 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-19T11:34:51.974 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:51.974 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-19T11:34:51.988 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:51.988 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-19T11:34:52.045 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:52.045 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-19T11:34:52.100 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:52.100 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-19T11:34:52.156 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:52.156 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-19T11:34:52.212 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:52.212 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-19T11:34:52.226 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:52.226 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-19T11:34:52.280 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:52.280 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-19T11:34:52.339 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:52.339 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-19T11:34:52.391 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:52.391 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-19T11:34:52.444 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:52.444 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-19T11:34:52.450 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:52.450 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-19T11:34:52.492 INFO:tasks.ceph:Adding keys to all mons... 2024-09-19T11:34:52.492 DEBUG:teuthology.orchestra.run.smithi120:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T11:34:52.495 DEBUG:teuthology.orchestra.run.smithi151:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T11:34:52.538 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.y] 2024-09-19T11:34:52.538 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA7DOxmhau8LhAAp7kJVZDSnbeEqQn01PckPQ== 2024-09-19T11:34:52.538 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.0] 2024-09-19T11:34:52.538 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA+DOxmL0W6OBAAkvWnUfwECQ1x0wAaSPKcAg== 2024-09-19T11:34:52.538 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.1] 2024-09-19T11:34:52.539 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBCDOxm9p+3DBAA7zqqUbxgJlfMC5zX6FtjWw== 2024-09-19T11:34:52.539 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.2] 2024-09-19T11:34:52.539 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBFDOxmB1GXHhAABRp1cvWbLvNARapeyY3g/w== 2024-09-19T11:34:52.539 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.3] 2024-09-19T11:34:52.539 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBIDOxmr414MRAAjUutOwB0tJWgDfKpGw5EOA== 2024-09-19T11:34:52.539 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.x] 2024-09-19T11:34:52.539 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA7DOxmr2xvMRAAkd0zT5fV9M4UUtsAgq8/iw== 2024-09-19T11:34:52.539 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.4] 2024-09-19T11:34:52.539 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBODOxmMk3GOhAAH+oLrgJUBWKp4VRAhbvzHA== 2024-09-19T11:34:52.539 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.5] 2024-09-19T11:34:52.539 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBSDOxmdoJTDRAA7IeM3sW7DrsW40m8zLtZXQ== 2024-09-19T11:34:52.539 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.6] 2024-09-19T11:34:52.540 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBVDOxmaw+8HRAAUeCNit+9cQTi73RG168meg== 2024-09-19T11:34:52.540 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.7] 2024-09-19T11:34:52.540 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBYDOxmsqZ7LhAAntK2D7p6iUF6RCihY9iNAw== 2024-09-19T11:34:52.540 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-09-19T11:34:52.540 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA7DOxmfd4kNBAAtbC0xIYEpfzxPRYfqxsrVA== 2024-09-19T11:34:52.540 INFO:teuthology.orchestra.run.smithi120.stdout:[client.1] 2024-09-19T11:34:52.540 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA7DOxmgFHZNhAATo+5582nO+HqnLWt7kV8zA== 2024-09-19T11:34:52.546 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.y] 2024-09-19T11:34:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQA7DOxmhau8LhAAp7kJVZDSnbeEqQn01PckPQ== 2024-09-19T11:34:52.546 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.0] 2024-09-19T11:34:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQA+DOxmL0W6OBAAkvWnUfwECQ1x0wAaSPKcAg== 2024-09-19T11:34:52.546 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.1] 2024-09-19T11:34:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBCDOxm9p+3DBAA7zqqUbxgJlfMC5zX6FtjWw== 2024-09-19T11:34:52.546 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.2] 2024-09-19T11:34:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBFDOxmB1GXHhAABRp1cvWbLvNARapeyY3g/w== 2024-09-19T11:34:52.547 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.3] 2024-09-19T11:34:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBIDOxmr414MRAAjUutOwB0tJWgDfKpGw5EOA== 2024-09-19T11:34:52.547 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.x] 2024-09-19T11:34:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQA7DOxmr2xvMRAAkd0zT5fV9M4UUtsAgq8/iw== 2024-09-19T11:34:52.547 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.4] 2024-09-19T11:34:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBODOxmMk3GOhAAH+oLrgJUBWKp4VRAhbvzHA== 2024-09-19T11:34:52.547 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.5] 2024-09-19T11:34:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBSDOxmdoJTDRAA7IeM3sW7DrsW40m8zLtZXQ== 2024-09-19T11:34:52.547 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.6] 2024-09-19T11:34:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBVDOxmaw+8HRAAUeCNit+9cQTi73RG168meg== 2024-09-19T11:34:52.547 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.7] 2024-09-19T11:34:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBYDOxmsqZ7LhAAntK2D7p6iUF6RCihY9iNAw== 2024-09-19T11:34:52.548 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2024-09-19T11:34:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQA7DOxmfd4kNBAAtbC0xIYEpfzxPRYfqxsrVA== 2024-09-19T11:34:52.548 INFO:teuthology.orchestra.run.smithi151.stdout:[client.1] 2024-09-19T11:34:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQA7DOxmgFHZNhAATo+5582nO+HqnLWt7kV8zA== 2024-09-19T11:34:52.549 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T11:34:52.586 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T11:34:52.637 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:52.679 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:52.721 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:52.762 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:52.804 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:52.846 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:52.888 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:52.934 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:52.980 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T11:34:53.014 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T11:34:53.055 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:53.098 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:53.144 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:53.182 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:53.231 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:53.266 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:53.320 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:53.350 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:34:53.393 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T11:34:53.395 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T11:34:53.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T11:34:53.477 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T11:34:53.563 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-19T11:34:53.563 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-19T11:34:53.576 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T11:34:53.672 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-19T11:34:53.682 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-19T11:34:53.736 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T11:34:53.831 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-19T11:34:53.842 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-19T11:34:53.857 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T11:34:53.955 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-19T11:34:53.968 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:34:53.970 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:34:54.016 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-19T11:34:54.016 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-19T11:34:54.016 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-19T11:34:54.019 INFO:tasks.ceph.mon.a:Started 2024-09-19T11:34:54.019 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-19T11:34:54.019 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-19T11:34:54.021 INFO:tasks.ceph.mon.c:Started 2024-09-19T11:34:54.021 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-19T11:34:54.021 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-19T11:34:54.062 INFO:tasks.ceph.mon.b:Started 2024-09-19T11:34:54.062 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-19T11:34:54.062 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-19T11:34:54.062 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-19T11:34:54.065 INFO:tasks.ceph.mgr.y:Started 2024-09-19T11:34:54.066 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-19T11:34:54.066 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-19T11:34:54.069 INFO:tasks.ceph.mgr.x:Started 2024-09-19T11:34:54.069 DEBUG:tasks.ceph:set 0 configs 2024-09-19T11:34:54.069 INFO:tasks.ceph:Setting crush tunables to default 2024-09-19T11:34:54.069 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd crush tunables default 2024-09-19T11:34:59.501 INFO:teuthology.orchestra.run.smithi120.stderr:adjusted tunables profile to default 2024-09-19T11:34:59.519 INFO:tasks.ceph:check_enable_crimson: False 2024-09-19T11:34:59.519 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-19T11:34:59.520 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:59.520 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-19T11:34:59.531 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:59.531 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-19T11:34:59.583 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:59.583 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-19T11:34:59.635 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:34:59.636 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-19T11:34:59.688 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:59.689 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-19T11:34:59.703 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:59.703 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-19T11:34:59.755 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:59.755 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-19T11:34:59.807 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-19T11:34:59.807 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-19T11:34:59.860 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new c6f4cff4-42cd-4606-9588-4dc40244f947 0 2024-09-19T11:35:00.121 INFO:teuthology.orchestra.run.smithi151.stdout:0 2024-09-19T11:35:00.140 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new fa6ebdc7-7db1-4740-91c9-918a4d82b59e 1 2024-09-19T11:35:00.354 INFO:teuthology.orchestra.run.smithi151.stdout:1 2024-09-19T11:35:00.371 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 54736b9e-f941-4aa7-aeb8-3a39902d254d 2 2024-09-19T11:35:00.587 INFO:teuthology.orchestra.run.smithi151.stdout:2 2024-09-19T11:35:00.603 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new ace2198d-da3d-4555-a0d3-86f83a9a565c 3 2024-09-19T11:35:00.802 INFO:teuthology.orchestra.run.smithi151.stdout:3 2024-09-19T11:35:00.819 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 021ef3d1-e1a9-4d4f-9cfb-b6599dfa15d8 4 2024-09-19T11:35:01.027 INFO:teuthology.orchestra.run.smithi151.stdout:4 2024-09-19T11:35:01.045 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 23b747d9-39bd-48ff-a044-12b6263e9398 5 2024-09-19T11:35:01.245 INFO:teuthology.orchestra.run.smithi151.stdout:5 2024-09-19T11:35:01.262 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 0fd18d41-a379-44f9-8d57-d23c38e1bdd5 6 2024-09-19T11:35:01.465 INFO:teuthology.orchestra.run.smithi151.stdout:6 2024-09-19T11:35:01.482 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 1a511214-3f37-4d07-9d3f-d1b3c207451f 7 2024-09-19T11:35:01.686 INFO:teuthology.orchestra.run.smithi151.stdout:7 2024-09-19T11:35:01.703 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-19T11:35:01.703 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-19T11:35:01.706 INFO:tasks.ceph.osd.0:Started 2024-09-19T11:35:01.706 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-19T11:35:01.706 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-19T11:35:01.708 INFO:tasks.ceph.osd.1:Started 2024-09-19T11:35:01.709 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-19T11:35:01.709 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-19T11:35:01.711 INFO:tasks.ceph.osd.2:Started 2024-09-19T11:35:01.711 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-19T11:35:01.712 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-19T11:35:01.713 INFO:tasks.ceph.osd.3:Started 2024-09-19T11:35:01.714 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-19T11:35:01.714 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-19T11:35:01.716 INFO:tasks.ceph.osd.4:Started 2024-09-19T11:35:01.716 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-19T11:35:01.716 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-19T11:35:01.718 INFO:tasks.ceph.osd.5:Started 2024-09-19T11:35:01.718 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-19T11:35:01.718 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-19T11:35:01.720 INFO:tasks.ceph.osd.6:Started 2024-09-19T11:35:01.720 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-19T11:35:01.720 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-19T11:35:01.722 INFO:tasks.ceph.osd.7:Started 2024-09-19T11:35:01.723 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T11:35:01.928 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:35:01.929 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":10,"fsid":"e4647c72-93bd-41bc-8102-6ca42f6edad4","created":"2024-09-19T11:34:59.387938+0000","modified":"2024-09-19T11:35:01.684559+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T11:35:01.684559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c6f4cff4-42cd-4606-9588-4dc40244f947","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fa6ebdc7-7db1-4740-91c9-918a4d82b59e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"54736b9e-f941-4aa7-aeb8-3a39902d254d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ace2198d-da3d-4555-a0d3-86f83a9a565c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"021ef3d1-e1a9-4d4f-9cfb-b6599dfa15d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"23b747d9-39bd-48ff-a044-12b6263e9398","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0fd18d41-a379-44f9-8d57-d23c38e1bdd5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1a511214-3f37-4d07-9d3f-d1b3c207451f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T11:35:01.946 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-19T11:35:01.946 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-19T11:35:02.485 INFO:tasks.ceph.mgr.x.smithi151.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-19T11:35:02.486 INFO:tasks.ceph.mgr.x.smithi151.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-19T11:35:02.486 INFO:tasks.ceph.mgr.x.smithi151.stderr: from numpy import show_config as show_numpy_config 2024-09-19T11:35:02.753 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T11:35:02.922 INFO:teuthology.misc.health.smithi120.stdout: 2024-09-19T11:35:02.922 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":10,"fsid":"e4647c72-93bd-41bc-8102-6ca42f6edad4","created":"2024-09-19T11:34:59.387938+0000","modified":"2024-09-19T11:35:01.684559+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T11:35:01.684559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c6f4cff4-42cd-4606-9588-4dc40244f947","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fa6ebdc7-7db1-4740-91c9-918a4d82b59e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"54736b9e-f941-4aa7-aeb8-3a39902d254d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ace2198d-da3d-4555-a0d3-86f83a9a565c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"021ef3d1-e1a9-4d4f-9cfb-b6599dfa15d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"23b747d9-39bd-48ff-a044-12b6263e9398","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0fd18d41-a379-44f9-8d57-d23c38e1bdd5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1a511214-3f37-4d07-9d3f-d1b3c207451f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T11:35:02.937 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-19T11:35:02.960 INFO:tasks.ceph.mgr.y.smithi120.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-19T11:35:02.960 INFO:tasks.ceph.mgr.y.smithi120.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-19T11:35:02.960 INFO:tasks.ceph.mgr.y.smithi120.stderr: from numpy import show_config as show_numpy_config 2024-09-19T11:35:03.094 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-19T11:35:03.093+0000 7f14e86fc7c0 -1 Falling back to public interface 2024-09-19T11:35:03.117 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-19T11:35:03.117+0000 7f74602037c0 -1 Falling back to public interface 2024-09-19T11:35:03.166 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-09-19T11:35:03.162+0000 7f730197f7c0 -1 Falling back to public interface 2024-09-19T11:35:03.353 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-09-19T11:35:03.350+0000 7f111cd8a7c0 -1 Falling back to public interface 2024-09-19T11:35:03.393 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-09-19T11:35:03.390+0000 7fb30df597c0 -1 Falling back to public interface 2024-09-19T11:35:03.409 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-09-19T11:35:03.406+0000 7fe8a04fa7c0 -1 Falling back to public interface 2024-09-19T11:35:03.433 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-19T11:35:03.433+0000 7f6d027f57c0 -1 Falling back to public interface 2024-09-19T11:35:03.638 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-19T11:35:03.637+0000 7f78a12157c0 -1 Falling back to public interface 2024-09-19T11:35:05.446 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-19T11:35:05.442+0000 7fb791780640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-19T11:35:05.452 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-19T11:35:05.450+0000 7fb791780640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T11:35:07.108 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-19T11:35:07.105+0000 7f74602037c0 -1 osd.0 0 log_to_monitors true 2024-09-19T11:35:07.201 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-09-19T11:35:07.198+0000 7f730197f7c0 -1 osd.4 0 log_to_monitors true 2024-09-19T11:35:07.225 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-19T11:35:07.225+0000 7f14e86fc7c0 -1 osd.2 0 log_to_monitors true 2024-09-19T11:35:07.353 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-09-19T11:35:07.350+0000 7f111cd8a7c0 -1 osd.6 0 log_to_monitors true 2024-09-19T11:35:07.487 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-09-19T11:35:07.482+0000 7fb30df597c0 -1 osd.7 0 log_to_monitors true 2024-09-19T11:35:07.616 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-09-19T11:35:07.614+0000 7fe8a04fa7c0 -1 osd.5 0 log_to_monitors true 2024-09-19T11:35:07.800 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-19T11:35:07.797+0000 7f6d027f57c0 -1 osd.1 0 log_to_monitors true 2024-09-19T11:35:07.949 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-19T11:35:07.949+0000 7f78a12157c0 -1 osd.3 0 log_to_monitors true 2024-09-19T11:35:09.744 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T11:35:09.993 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-09-19T11:35:09.990+0000 7f72fd928640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T11:35:10.001 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-09-19T11:35:09.998+0000 7f1119545640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T11:35:10.024 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-19T11:35:10.025+0000 7f14e46a5640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T11:35:10.038 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-19T11:35:10.037+0000 7f745c1ac640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T11:35:10.047 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-09-19T11:35:10.042+0000 7f1110b65640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T11:35:10.053 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-09-19T11:35:10.050+0000 7f72f575a640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T11:35:10.073 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-09-19T11:35:10.073+0000 7f14dc4d7640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T11:35:10.138 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-09-19T11:35:10.137+0000 7f7453fde640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T11:35:10.163 INFO:teuthology.misc.health.smithi120.stdout: 2024-09-19T11:35:10.163 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":13,"fsid":"e4647c72-93bd-41bc-8102-6ca42f6edad4","created":"2024-09-19T11:34:59.387938+0000","modified":"2024-09-19T11:35:09.461644+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T11:35:01.684559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c6f4cff4-42cd-4606-9588-4dc40244f947","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fa6ebdc7-7db1-4740-91c9-918a4d82b59e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"54736b9e-f941-4aa7-aeb8-3a39902d254d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ace2198d-da3d-4555-a0d3-86f83a9a565c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"021ef3d1-e1a9-4d4f-9cfb-b6599dfa15d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"23b747d9-39bd-48ff-a044-12b6263e9398","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0fd18d41-a379-44f9-8d57-d23c38e1bdd5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1a511214-3f37-4d07-9d3f-d1b3c207451f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T11:35:10.185 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-19T11:35:10.833 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-09-19T11:35:10.830+0000 7fb30a714640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T11:35:10.852 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-09-19T11:35:10.850+0000 7fb301d34640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T11:35:10.901 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-19T11:35:10.901+0000 7f6cfefb0640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T11:35:10.905 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-19T11:35:10.905+0000 7f789d9d0640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T11:35:10.928 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-09-19T11:35:10.926+0000 7fe89ccb5640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T11:35:10.937 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-09-19T11:35:10.937+0000 7f7894ff0640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T11:35:10.937 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-09-19T11:35:10.937+0000 7f6cf65d0640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T11:35:10.965 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-09-19T11:35:10.962+0000 7fe8942d5640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T11:35:16.993 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T11:35:17.308 INFO:teuthology.misc.health.smithi120.stdout: 2024-09-19T11:35:17.308 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":18,"fsid":"e4647c72-93bd-41bc-8102-6ca42f6edad4","created":"2024-09-19T11:34:59.387938+0000","modified":"2024-09-19T11:35:15.101662+0000","last_up_change":"2024-09-19T11:35:11.074438+0000","last_in_change":"2024-09-19T11:35:01.684559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T11:35:12.462300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f4cff4-42cd-4606-9588-4dc40244f947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6809","nonce":1940228464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6811","nonce":1940228464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6815","nonce":1940228464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6813","nonce":1940228464}]},"public_addr":"172.21.15.120:6809/1940228464","cluster_addr":"172.21.15.120:6811/1940228464","heartbeat_back_addr":"172.21.15.120:6815/1940228464","heartbeat_front_addr":"172.21.15.120:6813/1940228464","state":["exists","up"]},{"osd":1,"uuid":"fa6ebdc7-7db1-4740-91c9-918a4d82b59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6817","nonce":2362810278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6819","nonce":2362810278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6823","nonce":2362810278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6821","nonce":2362810278}]},"public_addr":"172.21.15.120:6817/2362810278","cluster_addr":"172.21.15.120:6819/2362810278","heartbeat_back_addr":"172.21.15.120:6823/2362810278","heartbeat_front_addr":"172.21.15.120:6821/2362810278","state":["exists","up"]},{"osd":2,"uuid":"54736b9e-f941-4aa7-aeb8-3a39902d254d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6801","nonce":1864022726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6803","nonce":1864022726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6807","nonce":1864022726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6805","nonce":1864022726}]},"public_addr":"172.21.15.120:6801/1864022726","cluster_addr":"172.21.15.120:6803/1864022726","heartbeat_back_addr":"172.21.15.120:6807/1864022726","heartbeat_front_addr":"172.21.15.120:6805/1864022726","state":["exists","up"]},{"osd":3,"uuid":"ace2198d-da3d-4555-a0d3-86f83a9a565c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6825","nonce":1565558845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6827","nonce":1565558845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6831","nonce":1565558845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6829","nonce":1565558845}]},"public_addr":"172.21.15.120:6825/1565558845","cluster_addr":"172.21.15.120:6827/1565558845","heartbeat_back_addr":"172.21.15.120:6831/1565558845","heartbeat_front_addr":"172.21.15.120:6829/1565558845","state":["exists","up"]},{"osd":4,"uuid":"021ef3d1-e1a9-4d4f-9cfb-b6599dfa15d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6801","nonce":4207680840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6803","nonce":4207680840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6807","nonce":4207680840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6805","nonce":4207680840}]},"public_addr":"172.21.15.151:6801/4207680840","cluster_addr":"172.21.15.151:6803/4207680840","heartbeat_back_addr":"172.21.15.151:6807/4207680840","heartbeat_front_addr":"172.21.15.151:6805/4207680840","state":["exists","up"]},{"osd":5,"uuid":"23b747d9-39bd-48ff-a044-12b6263e9398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6825","nonce":1967784835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6827","nonce":1967784835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6831","nonce":1967784835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6829","nonce":1967784835}]},"public_addr":"172.21.15.151:6825/1967784835","cluster_addr":"172.21.15.151:6827/1967784835","heartbeat_back_addr":"172.21.15.151:6831/1967784835","heartbeat_front_addr":"172.21.15.151:6829/1967784835","state":["exists","up"]},{"osd":6,"uuid":"0fd18d41-a379-44f9-8d57-d23c38e1bdd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6809","nonce":4185618971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6811","nonce":4185618971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6815","nonce":4185618971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6813","nonce":4185618971}]},"public_addr":"172.21.15.151:6809/4185618971","cluster_addr":"172.21.15.151:6811/4185618971","heartbeat_back_addr":"172.21.15.151:6815/4185618971","heartbeat_front_addr":"172.21.15.151:6813/4185618971","state":["exists","up"]},{"osd":7,"uuid":"1a511214-3f37-4d07-9d3f-d1b3c207451f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6817","nonce":2331670939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6819","nonce":2331670939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6823","nonce":2331670939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6821","nonce":2331670939}]},"public_addr":"172.21.15.151:6817/2331670939","cluster_addr":"172.21.15.151:6819/2331670939","heartbeat_back_addr":"172.21.15.151:6823/2331670939","heartbeat_front_addr":"172.21.15.151:6821/2331670939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.111242+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.777828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.207060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.974538+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.234741+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.592114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.348056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.522745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T11:35:17.326 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-19T11:35:17.326 INFO:tasks.ceph:Creating RBD pool 2024-09-19T11:35:17.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-19T11:35:18.134 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'rbd' created 2024-09-19T11:35:18.157 DEBUG:teuthology.orchestra.run.smithi120:> rbd --cluster ceph pool init rbd 2024-09-19T11:35:18.294 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:35:18.294 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:35:21.196 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-19T11:35:21.197 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-19T11:35:21.198 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-19T11:35:21.513 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:35:21.533 INFO:teuthology.orchestra.run.smithi120.stdout:[{"version":9,"timestamp":"2024-09-19T11:35:10.931164+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"5800.423641"}]}] 2024-09-19T11:35:21.533 INFO:tasks.ceph_manager:config epoch is 9 2024-09-19T11:35:21.533 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T11:35:21.533 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-19T11:35:21.534 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-19T11:35:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:35:21.906 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1252307159},{"type":"v1","addr":"172.21.15.151:6833","nonce":1252307159}]},"active_addr":"172.21.15.151:6833/1252307159","active_change":"2024-09-19T11:35:04.407487+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":4220631011}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":544875333}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":270602060}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":1411639573}]}]} 2024-09-19T11:35:21.910 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-19T11:35:21.910 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-19T11:35:21.911 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T11:35:22.217 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:35:22.218 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"e4647c72-93bd-41bc-8102-6ca42f6edad4","created":"2024-09-19T11:34:59.387938+0000","modified":"2024-09-19T11:35:21.157650+0000","last_up_change":"2024-09-19T11:35:11.074438+0000","last_in_change":"2024-09-19T11:35:01.684559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T11:35:12.462300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-19T11:35:17.641758+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f4cff4-42cd-4606-9588-4dc40244f947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6809","nonce":1940228464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6811","nonce":1940228464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6815","nonce":1940228464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6813","nonce":1940228464}]},"public_addr":"172.21.15.120:6809/1940228464","cluster_addr":"172.21.15.120:6811/1940228464","heartbeat_back_addr":"172.21.15.120:6815/1940228464","heartbeat_front_addr":"172.21.15.120:6813/1940228464","state":["exists","up"]},{"osd":1,"uuid":"fa6ebdc7-7db1-4740-91c9-918a4d82b59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6817","nonce":2362810278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6819","nonce":2362810278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6823","nonce":2362810278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6821","nonce":2362810278}]},"public_addr":"172.21.15.120:6817/2362810278","cluster_addr":"172.21.15.120:6819/2362810278","heartbeat_back_addr":"172.21.15.120:6823/2362810278","heartbeat_front_addr":"172.21.15.120:6821/2362810278","state":["exists","up"]},{"osd":2,"uuid":"54736b9e-f941-4aa7-aeb8-3a39902d254d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6801","nonce":1864022726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6803","nonce":1864022726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6807","nonce":1864022726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6805","nonce":1864022726}]},"public_addr":"172.21.15.120:6801/1864022726","cluster_addr":"172.21.15.120:6803/1864022726","heartbeat_back_addr":"172.21.15.120:6807/1864022726","heartbeat_front_addr":"172.21.15.120:6805/1864022726","state":["exists","up"]},{"osd":3,"uuid":"ace2198d-da3d-4555-a0d3-86f83a9a565c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6825","nonce":1565558845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6827","nonce":1565558845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6831","nonce":1565558845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6829","nonce":1565558845}]},"public_addr":"172.21.15.120:6825/1565558845","cluster_addr":"172.21.15.120:6827/1565558845","heartbeat_back_addr":"172.21.15.120:6831/1565558845","heartbeat_front_addr":"172.21.15.120:6829/1565558845","state":["exists","up"]},{"osd":4,"uuid":"021ef3d1-e1a9-4d4f-9cfb-b6599dfa15d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6801","nonce":4207680840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6803","nonce":4207680840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6807","nonce":4207680840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6805","nonce":4207680840}]},"public_addr":"172.21.15.151:6801/4207680840","cluster_addr":"172.21.15.151:6803/4207680840","heartbeat_back_addr":"172.21.15.151:6807/4207680840","heartbeat_front_addr":"172.21.15.151:6805/4207680840","state":["exists","up"]},{"osd":5,"uuid":"23b747d9-39bd-48ff-a044-12b6263e9398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6825","nonce":1967784835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6827","nonce":1967784835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6831","nonce":1967784835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6829","nonce":1967784835}]},"public_addr":"172.21.15.151:6825/1967784835","cluster_addr":"172.21.15.151:6827/1967784835","heartbeat_back_addr":"172.21.15.151:6831/1967784835","heartbeat_front_addr":"172.21.15.151:6829/1967784835","state":["exists","up"]},{"osd":6,"uuid":"0fd18d41-a379-44f9-8d57-d23c38e1bdd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6809","nonce":4185618971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6811","nonce":4185618971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6815","nonce":4185618971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6813","nonce":4185618971}]},"public_addr":"172.21.15.151:6809/4185618971","cluster_addr":"172.21.15.151:6811/4185618971","heartbeat_back_addr":"172.21.15.151:6815/4185618971","heartbeat_front_addr":"172.21.15.151:6813/4185618971","state":["exists","up"]},{"osd":7,"uuid":"1a511214-3f37-4d07-9d3f-d1b3c207451f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6817","nonce":2331670939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6819","nonce":2331670939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6823","nonce":2331670939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6821","nonce":2331670939}]},"public_addr":"172.21.15.151:6817/2331670939","cluster_addr":"172.21.15.151:6819/2331670939","heartbeat_back_addr":"172.21.15.151:6823/2331670939","heartbeat_front_addr":"172.21.15.151:6821/2331670939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.111242+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.777828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.207060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.974538+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.234741+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.592114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.348056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.522745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T11:35:22.236 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-19T11:35:22.236 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T11:35:22.544 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:35:22.544 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":22,"fsid":"e4647c72-93bd-41bc-8102-6ca42f6edad4","created":"2024-09-19T11:34:59.387938+0000","modified":"2024-09-19T11:35:21.157650+0000","last_up_change":"2024-09-19T11:35:11.074438+0000","last_in_change":"2024-09-19T11:35:01.684559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T11:35:12.462300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-19T11:35:17.641758+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f4cff4-42cd-4606-9588-4dc40244f947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6809","nonce":1940228464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6811","nonce":1940228464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6815","nonce":1940228464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6813","nonce":1940228464}]},"public_addr":"172.21.15.120:6809/1940228464","cluster_addr":"172.21.15.120:6811/1940228464","heartbeat_back_addr":"172.21.15.120:6815/1940228464","heartbeat_front_addr":"172.21.15.120:6813/1940228464","state":["exists","up"]},{"osd":1,"uuid":"fa6ebdc7-7db1-4740-91c9-918a4d82b59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6817","nonce":2362810278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6819","nonce":2362810278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6823","nonce":2362810278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6821","nonce":2362810278}]},"public_addr":"172.21.15.120:6817/2362810278","cluster_addr":"172.21.15.120:6819/2362810278","heartbeat_back_addr":"172.21.15.120:6823/2362810278","heartbeat_front_addr":"172.21.15.120:6821/2362810278","state":["exists","up"]},{"osd":2,"uuid":"54736b9e-f941-4aa7-aeb8-3a39902d254d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6801","nonce":1864022726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6803","nonce":1864022726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6807","nonce":1864022726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6805","nonce":1864022726}]},"public_addr":"172.21.15.120:6801/1864022726","cluster_addr":"172.21.15.120:6803/1864022726","heartbeat_back_addr":"172.21.15.120:6807/1864022726","heartbeat_front_addr":"172.21.15.120:6805/1864022726","state":["exists","up"]},{"osd":3,"uuid":"ace2198d-da3d-4555-a0d3-86f83a9a565c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6825","nonce":1565558845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6827","nonce":1565558845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6831","nonce":1565558845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6829","nonce":1565558845}]},"public_addr":"172.21.15.120:6825/1565558845","cluster_addr":"172.21.15.120:6827/1565558845","heartbeat_back_addr":"172.21.15.120:6831/1565558845","heartbeat_front_addr":"172.21.15.120:6829/1565558845","state":["exists","up"]},{"osd":4,"uuid":"021ef3d1-e1a9-4d4f-9cfb-b6599dfa15d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6801","nonce":4207680840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6803","nonce":4207680840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6807","nonce":4207680840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6805","nonce":4207680840}]},"public_addr":"172.21.15.151:6801/4207680840","cluster_addr":"172.21.15.151:6803/4207680840","heartbeat_back_addr":"172.21.15.151:6807/4207680840","heartbeat_front_addr":"172.21.15.151:6805/4207680840","state":["exists","up"]},{"osd":5,"uuid":"23b747d9-39bd-48ff-a044-12b6263e9398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6825","nonce":1967784835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6827","nonce":1967784835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6831","nonce":1967784835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6829","nonce":1967784835}]},"public_addr":"172.21.15.151:6825/1967784835","cluster_addr":"172.21.15.151:6827/1967784835","heartbeat_back_addr":"172.21.15.151:6831/1967784835","heartbeat_front_addr":"172.21.15.151:6829/1967784835","state":["exists","up"]},{"osd":6,"uuid":"0fd18d41-a379-44f9-8d57-d23c38e1bdd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6809","nonce":4185618971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6811","nonce":4185618971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6815","nonce":4185618971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6813","nonce":4185618971}]},"public_addr":"172.21.15.151:6809/4185618971","cluster_addr":"172.21.15.151:6811/4185618971","heartbeat_back_addr":"172.21.15.151:6815/4185618971","heartbeat_front_addr":"172.21.15.151:6813/4185618971","state":["exists","up"]},{"osd":7,"uuid":"1a511214-3f37-4d07-9d3f-d1b3c207451f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6817","nonce":2331670939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6819","nonce":2331670939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6823","nonce":2331670939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6821","nonce":2331670939}]},"public_addr":"172.21.15.151:6817/2331670939","cluster_addr":"172.21.15.151:6819/2331670939","heartbeat_back_addr":"172.21.15.151:6823/2331670939","heartbeat_front_addr":"172.21.15.151:6821/2331670939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.111242+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.777828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.207060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.974538+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.234741+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.592114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.348056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.522745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T11:35:22.562 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-19T11:35:22.563 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-19T11:35:22.563 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-19T11:35:22.564 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-19T11:35:22.564 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-19T11:35:22.564 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-19T11:35:22.565 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-19T11:35:22.565 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-19T11:35:22.819 INFO:teuthology.orchestra.run.smithi120.stdout:60129542149 2024-09-19T11:35:22.820 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T11:35:22.826 INFO:teuthology.orchestra.run.smithi120.stdout:60129542151 2024-09-19T11:35:22.826 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T11:35:22.830 INFO:teuthology.orchestra.run.smithi120.stdout:60129542150 2024-09-19T11:35:22.831 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T11:35:22.832 INFO:teuthology.orchestra.run.smithi120.stdout:60129542150 2024-09-19T11:35:22.832 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T11:35:22.833 INFO:teuthology.orchestra.run.smithi120.stdout:60129542149 2024-09-19T11:35:22.833 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T11:35:22.836 INFO:teuthology.orchestra.run.smithi120.stdout:60129542151 2024-09-19T11:35:22.836 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T11:35:22.838 INFO:teuthology.orchestra.run.smithi120.stdout:60129542148 2024-09-19T11:35:22.838 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T11:35:22.844 INFO:teuthology.orchestra.run.smithi120.stdout:60129542150 2024-09-19T11:35:22.844 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T11:35:23.365 INFO:teuthology.orchestra.run.smithi120.stdout:60129542148 2024-09-19T11:35:23.374 INFO:teuthology.orchestra.run.smithi120.stdout:60129542149 2024-09-19T11:35:23.376 INFO:teuthology.orchestra.run.smithi120.stdout:60129542150 2024-09-19T11:35:23.380 INFO:teuthology.orchestra.run.smithi120.stdout:60129542147 2024-09-19T11:35:23.392 INFO:teuthology.orchestra.run.smithi120.stdout:60129542149 2024-09-19T11:35:23.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-09-19T11:35:23.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.3 2024-09-19T11:35:23.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.0 2024-09-19T11:35:23.406 INFO:teuthology.orchestra.run.smithi120.stdout:60129542150 2024-09-19T11:35:23.412 INFO:teuthology.orchestra.run.smithi120.stdout:60129542148 2024-09-19T11:35:23.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.1 2024-09-19T11:35:23.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-19T11:35:23.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.4 2024-09-19T11:35:23.436 INFO:teuthology.orchestra.run.smithi120.stdout:60129542149 2024-09-19T11:35:23.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.6 2024-09-19T11:35:23.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.2 2024-09-19T11:35:24.396 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T11:35:24.404 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T11:35:24.406 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T11:35:24.420 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T11:35:24.420 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T11:35:24.431 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T11:35:24.440 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T11:35:24.454 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T11:35:24.936 INFO:teuthology.orchestra.run.smithi120.stdout:60129542148 2024-09-19T11:35:24.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-09-19T11:35:24.992 INFO:teuthology.orchestra.run.smithi120.stdout:60129542150 2024-09-19T11:35:24.992 INFO:teuthology.orchestra.run.smithi120.stdout:60129542147 2024-09-19T11:35:25.005 INFO:teuthology.orchestra.run.smithi120.stdout:60129542149 2024-09-19T11:35:25.006 INFO:teuthology.orchestra.run.smithi120.stdout:60129542148 2024-09-19T11:35:25.009 INFO:teuthology.orchestra.run.smithi120.stdout:60129542149 2024-09-19T11:35:25.012 INFO:teuthology.orchestra.run.smithi120.stdout:60129542149 2024-09-19T11:35:25.012 INFO:teuthology.orchestra.run.smithi120.stdout:60129542150 2024-09-19T11:35:25.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.0 2024-09-19T11:35:25.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.1 2024-09-19T11:35:25.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-19T11:35:25.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.3 2024-09-19T11:35:25.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.2 2024-09-19T11:35:25.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.6 2024-09-19T11:35:25.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.4 2024-09-19T11:35:25.959 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T11:35:26.023 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T11:35:26.025 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T11:35:26.040 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T11:35:26.041 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T11:35:26.043 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T11:35:26.045 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T11:35:26.046 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T11:35:26.453 INFO:teuthology.orchestra.run.smithi120.stdout:60129542149 2024-09-19T11:35:26.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-19T11:35:26.479 DEBUG:teuthology.parallel:result is None 2024-09-19T11:35:26.504 INFO:teuthology.orchestra.run.smithi120.stdout:60129542151 2024-09-19T11:35:26.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.0 2024-09-19T11:35:26.529 DEBUG:teuthology.parallel:result is None 2024-09-19T11:35:26.554 INFO:teuthology.orchestra.run.smithi120.stdout:60129542148 2024-09-19T11:35:26.569 INFO:teuthology.orchestra.run.smithi120.stdout:60129542151 2024-09-19T11:35:26.574 INFO:teuthology.orchestra.run.smithi120.stdout:60129542150 2024-09-19T11:35:26.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2024-09-19T11:35:26.581 DEBUG:teuthology.parallel:result is None 2024-09-19T11:35:26.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.4 2024-09-19T11:35:26.596 DEBUG:teuthology.parallel:result is None 2024-09-19T11:35:26.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-19T11:35:26.599 DEBUG:teuthology.parallel:result is None 2024-09-19T11:35:26.613 INFO:teuthology.orchestra.run.smithi120.stdout:60129542150 2024-09-19T11:35:26.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-09-19T11:35:26.630 DEBUG:teuthology.parallel:result is None 2024-09-19T11:35:26.635 INFO:teuthology.orchestra.run.smithi120.stdout:60129542149 2024-09-19T11:35:26.642 INFO:teuthology.orchestra.run.smithi120.stdout:60129542150 2024-09-19T11:35:26.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2024-09-19T11:35:26.654 DEBUG:teuthology.parallel:result is None 2024-09-19T11:35:26.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-09-19T11:35:26.661 DEBUG:teuthology.parallel:result is None 2024-09-19T11:35:26.661 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T11:35:26.661 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T11:35:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:35:26.980 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T11:35:26.996 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-19T11:35:26.419499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219196,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755524,"statfs":{"total":773094113280,"available":772869656576,"internally_reserved":0,"allocated":2998272,"data_stored":1793958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.270177"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.168189+0000","last_change":"2024-09-19T11:35:21.168189+0000","last_active":"2024-09-19T11:35:21.168189+0000","last_peered":"2024-09-19T11:35:21.168189+0000","last_clean":"2024-09-19T11:35:21.168189+0000","last_became_active":"2024-09-19T11:35:19.152446+0000","last_became_peered":"2024-09-19T11:35:19.152446+0000","last_unstale":"2024-09-19T11:35:21.168189+0000","last_undegraded":"2024-09-19T11:35:21.168189+0000","last_fullsized":"2024-09-19T11:35:21.168189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:09.874667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.182872+0000","last_change":"2024-09-19T11:35:21.182872+0000","last_active":"2024-09-19T11:35:21.182872+0000","last_peered":"2024-09-19T11:35:21.182872+0000","last_clean":"2024-09-19T11:35:21.182872+0000","last_became_active":"2024-09-19T11:35:19.152195+0000","last_became_peered":"2024-09-19T11:35:19.152195+0000","last_unstale":"2024-09-19T11:35:21.182872+0000","last_undegraded":"2024-09-19T11:35:21.182872+0000","last_fullsized":"2024-09-19T11:35:21.182872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:33.512818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094930600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.463119+0000","last_change":"2024-09-19T11:35:21.463119+0000","last_active":"2024-09-19T11:35:21.463119+0000","last_peered":"2024-09-19T11:35:21.463119+0000","last_clean":"2024-09-19T11:35:21.463119+0000","last_became_active":"2024-09-19T11:35:20.094400+0000","last_became_peered":"2024-09-19T11:35:20.094400+0000","last_unstale":"2024-09-19T11:35:21.463119+0000","last_undegraded":"2024-09-19T11:35:21.463119+0000","last_fullsized":"2024-09-19T11:35:21.463119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:19.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088955000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.183056+0000","last_change":"2024-09-19T11:35:21.183056+0000","last_active":"2024-09-19T11:35:21.183056+0000","last_peered":"2024-09-19T11:35:21.183056+0000","last_clean":"2024-09-19T11:35:21.183056+0000","last_became_active":"2024-09-19T11:35:20.096557+0000","last_became_peered":"2024-09-19T11:35:20.096557+0000","last_unstale":"2024-09-19T11:35:21.183056+0000","last_undegraded":"2024-09-19T11:35:21.183056+0000","last_fullsized":"2024-09-19T11:35:21.183056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:29.688644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010463289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.179045+0000","last_change":"2024-09-19T11:35:21.176258+0000","last_active":"2024-09-19T11:35:21.179045+0000","last_peered":"2024-09-19T11:35:21.179045+0000","last_clean":"2024-09-19T11:35:21.179045+0000","last_became_active":"2024-09-19T11:35:19.151363+0000","last_became_peered":"2024-09-19T11:35:19.151363+0000","last_unstale":"2024-09-19T11:35:21.179045+0000","last_undegraded":"2024-09-19T11:35:21.179045+0000","last_fullsized":"2024-09-19T11:35:21.179045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:58.212055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028321980000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.169499+0000","last_change":"2024-09-19T11:35:21.169499+0000","last_active":"2024-09-19T11:35:21.169499+0000","last_peered":"2024-09-19T11:35:21.169499+0000","last_clean":"2024-09-19T11:35:21.169499+0000","last_became_active":"2024-09-19T11:35:19.969368+0000","last_became_peered":"2024-09-19T11:35:19.969368+0000","last_unstale":"2024-09-19T11:35:21.169499+0000","last_undegraded":"2024-09-19T11:35:21.169499+0000","last_fullsized":"2024-09-19T11:35:21.169499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:54.928769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001160424,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.463140+0000","last_change":"2024-09-19T11:35:21.463140+0000","last_active":"2024-09-19T11:35:21.463140+0000","last_peered":"2024-09-19T11:35:21.463140+0000","last_clean":"2024-09-19T11:35:21.463140+0000","last_became_active":"2024-09-19T11:35:19.154360+0000","last_became_peered":"2024-09-19T11:35:19.154360+0000","last_unstale":"2024-09-19T11:35:21.463140+0000","last_undegraded":"2024-09-19T11:35:21.463140+0000","last_fullsized":"2024-09-19T11:35:21.463140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:59.779314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086516000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.174817+0000","last_change":"2024-09-19T11:35:21.174817+0000","last_active":"2024-09-19T11:35:21.174817+0000","last_peered":"2024-09-19T11:35:21.174817+0000","last_clean":"2024-09-19T11:35:21.174817+0000","last_became_active":"2024-09-19T11:35:19.150393+0000","last_became_peered":"2024-09-19T11:35:19.150393+0000","last_unstale":"2024-09-19T11:35:21.174817+0000","last_undegraded":"2024-09-19T11:35:21.174817+0000","last_fullsized":"2024-09-19T11:35:21.174817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:35.259610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001387466,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.462073+0000","last_change":"2024-09-19T11:35:14.134637+0000","last_active":"2024-09-19T11:35:21.462073+0000","last_peered":"2024-09-19T11:35:21.462073+0000","last_clean":"2024-09-19T11:35:21.462073+0000","last_became_active":"2024-09-19T11:35:14.133710+0000","last_became_peered":"2024-09-19T11:35:14.133710+0000","last_unstale":"2024-09-19T11:35:21.462073+0000","last_undegraded":"2024-09-19T11:35:21.462073+0000","last_fullsized":"2024-09-19T11:35:21.462073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:13.080179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:13.080179+0000","last_clean_scrub_stamp":"2024-09-19T11:35:13.080179+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:26.810969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":667016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T11:35:26.997 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T11:35:27.279 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:35:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T11:35:27.296 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-19T11:35:26.419499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219196,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755524,"statfs":{"total":773094113280,"available":772869656576,"internally_reserved":0,"allocated":2998272,"data_stored":1793958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.270177"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.168189+0000","last_change":"2024-09-19T11:35:21.168189+0000","last_active":"2024-09-19T11:35:21.168189+0000","last_peered":"2024-09-19T11:35:21.168189+0000","last_clean":"2024-09-19T11:35:21.168189+0000","last_became_active":"2024-09-19T11:35:19.152446+0000","last_became_peered":"2024-09-19T11:35:19.152446+0000","last_unstale":"2024-09-19T11:35:21.168189+0000","last_undegraded":"2024-09-19T11:35:21.168189+0000","last_fullsized":"2024-09-19T11:35:21.168189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:09.874667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.182872+0000","last_change":"2024-09-19T11:35:21.182872+0000","last_active":"2024-09-19T11:35:21.182872+0000","last_peered":"2024-09-19T11:35:21.182872+0000","last_clean":"2024-09-19T11:35:21.182872+0000","last_became_active":"2024-09-19T11:35:19.152195+0000","last_became_peered":"2024-09-19T11:35:19.152195+0000","last_unstale":"2024-09-19T11:35:21.182872+0000","last_undegraded":"2024-09-19T11:35:21.182872+0000","last_fullsized":"2024-09-19T11:35:21.182872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:33.512818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094930600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.463119+0000","last_change":"2024-09-19T11:35:21.463119+0000","last_active":"2024-09-19T11:35:21.463119+0000","last_peered":"2024-09-19T11:35:21.463119+0000","last_clean":"2024-09-19T11:35:21.463119+0000","last_became_active":"2024-09-19T11:35:20.094400+0000","last_became_peered":"2024-09-19T11:35:20.094400+0000","last_unstale":"2024-09-19T11:35:21.463119+0000","last_undegraded":"2024-09-19T11:35:21.463119+0000","last_fullsized":"2024-09-19T11:35:21.463119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:19.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088955000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.183056+0000","last_change":"2024-09-19T11:35:21.183056+0000","last_active":"2024-09-19T11:35:21.183056+0000","last_peered":"2024-09-19T11:35:21.183056+0000","last_clean":"2024-09-19T11:35:21.183056+0000","last_became_active":"2024-09-19T11:35:20.096557+0000","last_became_peered":"2024-09-19T11:35:20.096557+0000","last_unstale":"2024-09-19T11:35:21.183056+0000","last_undegraded":"2024-09-19T11:35:21.183056+0000","last_fullsized":"2024-09-19T11:35:21.183056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:29.688644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010463289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.179045+0000","last_change":"2024-09-19T11:35:21.176258+0000","last_active":"2024-09-19T11:35:21.179045+0000","last_peered":"2024-09-19T11:35:21.179045+0000","last_clean":"2024-09-19T11:35:21.179045+0000","last_became_active":"2024-09-19T11:35:19.151363+0000","last_became_peered":"2024-09-19T11:35:19.151363+0000","last_unstale":"2024-09-19T11:35:21.179045+0000","last_undegraded":"2024-09-19T11:35:21.179045+0000","last_fullsized":"2024-09-19T11:35:21.179045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:58.212055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028321980000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.169499+0000","last_change":"2024-09-19T11:35:21.169499+0000","last_active":"2024-09-19T11:35:21.169499+0000","last_peered":"2024-09-19T11:35:21.169499+0000","last_clean":"2024-09-19T11:35:21.169499+0000","last_became_active":"2024-09-19T11:35:19.969368+0000","last_became_peered":"2024-09-19T11:35:19.969368+0000","last_unstale":"2024-09-19T11:35:21.169499+0000","last_undegraded":"2024-09-19T11:35:21.169499+0000","last_fullsized":"2024-09-19T11:35:21.169499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:54.928769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001160424,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.463140+0000","last_change":"2024-09-19T11:35:21.463140+0000","last_active":"2024-09-19T11:35:21.463140+0000","last_peered":"2024-09-19T11:35:21.463140+0000","last_clean":"2024-09-19T11:35:21.463140+0000","last_became_active":"2024-09-19T11:35:19.154360+0000","last_became_peered":"2024-09-19T11:35:19.154360+0000","last_unstale":"2024-09-19T11:35:21.463140+0000","last_undegraded":"2024-09-19T11:35:21.463140+0000","last_fullsized":"2024-09-19T11:35:21.463140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:59.779314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086516000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.174817+0000","last_change":"2024-09-19T11:35:21.174817+0000","last_active":"2024-09-19T11:35:21.174817+0000","last_peered":"2024-09-19T11:35:21.174817+0000","last_clean":"2024-09-19T11:35:21.174817+0000","last_became_active":"2024-09-19T11:35:19.150393+0000","last_became_peered":"2024-09-19T11:35:19.150393+0000","last_unstale":"2024-09-19T11:35:21.174817+0000","last_undegraded":"2024-09-19T11:35:21.174817+0000","last_fullsized":"2024-09-19T11:35:21.174817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:35.259610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001387466,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-19T11:35:21.462073+0000","last_change":"2024-09-19T11:35:14.134637+0000","last_active":"2024-09-19T11:35:21.462073+0000","last_peered":"2024-09-19T11:35:21.462073+0000","last_clean":"2024-09-19T11:35:21.462073+0000","last_became_active":"2024-09-19T11:35:14.133710+0000","last_became_peered":"2024-09-19T11:35:14.133710+0000","last_unstale":"2024-09-19T11:35:21.462073+0000","last_undegraded":"2024-09-19T11:35:21.462073+0000","last_fullsized":"2024-09-19T11:35:21.462073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:13.080179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:13.080179+0000","last_clean_scrub_stamp":"2024-09-19T11:35:13.080179+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:26.810969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":667016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T11:35:27.296 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T11:35:27.297 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T11:35:27.297 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-19T11:35:27.297 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-19T11:35:27.611 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:35:27.611 INFO:teuthology.orchestra.run.smithi120.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T11:35:27.629 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-19T11:35:27.629 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-19T11:35:27.642 INFO:teuthology.run_tasks:Running task rgw... 2024-09-19T11:35:27.660 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-19T11:35:27.660 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-19T11:35:27.660 INFO:tasks.rgw:Creating data pools 2024-09-19T11:35:27.660 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-19T11:35:27.661 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-19T11:35:28.544 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-19T11:35:30.533 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'default.rgw.buckets.data' created 2024-09-19T11:35:30.566 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-19T11:35:31.523 INFO:teuthology.orchestra.run.smithi120.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-19T11:35:31.567 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-19T11:35:32.585 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'default.rgw.buckets.index' created 2024-09-19T11:35:32.617 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-19T11:35:33.600 INFO:teuthology.orchestra.run.smithi120.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-19T11:35:33.643 DEBUG:tasks.rgw:Pools created 2024-09-19T11:35:33.643 INFO:tasks.rgw:Configuring compression type = random 2024-09-19T11:35:33.643 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-19T11:35:33.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-19T11:35:33.643 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-19T11:35:33.692 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:35:33.692 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:35:35.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.689+0000 7f22ae1b2640 0 -- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561fbf3fd9c0 msgr2=0x561fbf3fde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2024-09-19T11:35:35.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.693+0000 7f22b06ac9c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:35.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.693+0000 7f22ae9b3640 0 -- 172.21.15.120:0/1570474821 >> [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] conn(0x7f2174071be0 msgr2=0x7f21740740a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:35:35.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.697+0000 7f22b06ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:35.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.697+0000 7f22b06ac9c0 20 realm 2024-09-19T11:35:35.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.697+0000 7f22b06ac9c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.697+0000 7f22b06ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.697+0000 7f22b06ac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:35:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.697+0000 7f22b06ac9c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.697+0000 7f22b06ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:35.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.697+0000 7f22b06ac9c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:35.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.697+0000 7f22b06ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:35:35.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.697+0000 7f22b06ac9c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.701+0000 7f22b06ac9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:35:35.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.701+0000 7f22b06ac9c0 20 searching for the correct realm 2024-09-19T11:35:35.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:35:35.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:35:35.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:35:35.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:35:35.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:35:35.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:35:35.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:35.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:35.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:35.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:35:35.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:35.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:35:35.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 zone default found 2024-09-19T11:35:35.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 4 Realm: () 2024-09-19T11:35:35.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:35:35.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:35:35.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:35:35.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 zonegroup default 2024-09-19T11:35:35.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:35.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:35.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:35.721+0000 7f22b06ac9c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:37.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:37.645+0000 7f22b06ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:37.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:37.645+0000 7f22b06ac9c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:37.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:37.645+0000 7f22b06ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:37.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:37.645+0000 7f22b06ac9c0 20 started sync module instance, tier type = 2024-09-19T11:35:37.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:37.645+0000 7f22b06ac9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:35:39.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.700+0000 7f22b06ac9c0 20 add_watcher() i=0 2024-09-19T11:35:39.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.700+0000 7f22b06ac9c0 20 add_watcher() i=1 2024-09-19T11:35:39.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.700+0000 7f22b06ac9c0 20 add_watcher() i=2 2024-09-19T11:35:39.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.700+0000 7f22b06ac9c0 20 add_watcher() i=3 2024-09-19T11:35:39.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.700+0000 7f22b06ac9c0 20 add_watcher() i=4 2024-09-19T11:35:39.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.700+0000 7f22b06ac9c0 20 add_watcher() i=5 2024-09-19T11:35:39.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.700+0000 7f22b06ac9c0 20 add_watcher() i=6 2024-09-19T11:35:39.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.704+0000 7f22b06ac9c0 20 add_watcher() i=7 2024-09-19T11:35:39.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.704+0000 7f22b06ac9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:35:39.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.704+0000 7f22b06ac9c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-19T11:35:39.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.704+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-19T11:35:39.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.704+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.704+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-19T11:35:39.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.704+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-19T11:35:39.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.704+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.704+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-19T11:35:39.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.704+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-19T11:35:39.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.704+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-19T11:35:39.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-19T11:35:39.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-19T11:35:39.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-19T11:35:39.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-19T11:35:39.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-19T11:35:39.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-19T11:35:39.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-19T11:35:39.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-19T11:35:39.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-19T11:35:39.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-19T11:35:39.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-19T11:35:39.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-19T11:35:39.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-19T11:35:39.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-19T11:35:39.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-19T11:35:39.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.708+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-19T11:35:39.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-19T11:35:39.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-19T11:35:39.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-19T11:35:39.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-19T11:35:39.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-19T11:35:39.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-19T11:35:39.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-19T11:35:39.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-19T11:35:39.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-19T11:35:39.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-19T11:35:39.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-19T11:35:39.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-19T11:35:39.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-19T11:35:39.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.712+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-19T11:35:39.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-19T11:35:39.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-19T11:35:39.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-19T11:35:39.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-19T11:35:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-19T11:35:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-19T11:35:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-19T11:35:39.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-19T11:35:39.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-19T11:35:39.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-19T11:35:39.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-19T11:35:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.716+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-19T11:35:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-19T11:35:39.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-19T11:35:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-19T11:35:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-19T11:35:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-19T11:35:39.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-19T11:35:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-19T11:35:39.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-19T11:35:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-19T11:35:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-19T11:35:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-19T11:35:39.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-19T11:35:39.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-19T11:35:39.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-19T11:35:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-19T11:35:39.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.720+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-19T11:35:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-19T11:35:39.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-19T11:35:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-19T11:35:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-19T11:35:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-19T11:35:39.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-19T11:35:39.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-19T11:35:39.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-19T11:35:39.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-19T11:35:39.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-19T11:35:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-19T11:35:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-19T11:35:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-19T11:35:39.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-19T11:35:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-19T11:35:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.724+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-19T11:35:39.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-19T11:35:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-19T11:35:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-19T11:35:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-19T11:35:39.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-19T11:35:39.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-19T11:35:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-19T11:35:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-19T11:35:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-19T11:35:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-19T11:35:39.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-19T11:35:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.728+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-19T11:35:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-19T11:35:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-19T11:35:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-19T11:35:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-19T11:35:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-19T11:35:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-19T11:35:39.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-19T11:35:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-19T11:35:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-19T11:35:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-19T11:35:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-19T11:35:39.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-19T11:35:39.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-19T11:35:39.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-19T11:35:39.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-19T11:35:39.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.732+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-19T11:35:39.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-19T11:35:39.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-19T11:35:39.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-19T11:35:39.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-19T11:35:39.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-19T11:35:39.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-19T11:35:39.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-19T11:35:39.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-19T11:35:39.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-19T11:35:39.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-19T11:35:39.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-19T11:35:39.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-19T11:35:39.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-19T11:35:39.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.736+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-19T11:35:39.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-19T11:35:39.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-19T11:35:39.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-19T11:35:39.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-19T11:35:39.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-19T11:35:39.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-19T11:35:39.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-19T11:35:39.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-19T11:35:39.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-19T11:35:39.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-19T11:35:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-19T11:35:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-19T11:35:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-19T11:35:39.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-19T11:35:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-19T11:35:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.740+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-19T11:35:39.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-19T11:35:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-19T11:35:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-19T11:35:39.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-19T11:35:39.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-19T11:35:39.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-19T11:35:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-19T11:35:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-19T11:35:39.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-19T11:35:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-19T11:35:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-19T11:35:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-19T11:35:39.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-19T11:35:39.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-19T11:35:39.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-19T11:35:39.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.744+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-19T11:35:39.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-19T11:35:39.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-19T11:35:39.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-19T11:35:39.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-19T11:35:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-19T11:35:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-19T11:35:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-19T11:35:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-19T11:35:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-19T11:35:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-19T11:35:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-19T11:35:39.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.748+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-19T11:35:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-19T11:35:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-19T11:35:39.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-19T11:35:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-19T11:35:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-19T11:35:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-19T11:35:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-19T11:35:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-19T11:35:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-19T11:35:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-19T11:35:39.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-19T11:35:39.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.752+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-19T11:35:39.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-19T11:35:39.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-19T11:35:39.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-19T11:35:39.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-19T11:35:39.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-19T11:35:39.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-19T11:35:39.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-19T11:35:39.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-19T11:35:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-19T11:35:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-19T11:35:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-19T11:35:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-19T11:35:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-19T11:35:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.756+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-19T11:35:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-19T11:35:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-19T11:35:39.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-19T11:35:39.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-19T11:35:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-19T11:35:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-19T11:35:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-19T11:35:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-19T11:35:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-19T11:35:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-19T11:35:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-19T11:35:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.760+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-19T11:35:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-19T11:35:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-19T11:35:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-19T11:35:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-19T11:35:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-19T11:35:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-19T11:35:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-19T11:35:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-19T11:35:39.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-19T11:35:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-19T11:35:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-19T11:35:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-19T11:35:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-19T11:35:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.764+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-19T11:35:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-19T11:35:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-19T11:35:39.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-19T11:35:39.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-19T11:35:39.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-19T11:35:39.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-19T11:35:39.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-19T11:35:39.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-19T11:35:39.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-19T11:35:39.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-19T11:35:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-19T11:35:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-19T11:35:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-19T11:35:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.768+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-19T11:35:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-19T11:35:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-19T11:35:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-19T11:35:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-19T11:35:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-19T11:35:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-19T11:35:39.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-19T11:35:39.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-19T11:35:39.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-19T11:35:39.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-19T11:35:39.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-19T11:35:39.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-19T11:35:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-19T11:35:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.772+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-19T11:35:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-19T11:35:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-19T11:35:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-19T11:35:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-19T11:35:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-19T11:35:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-19T11:35:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-19T11:35:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-19T11:35:39.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-19T11:35:39.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-19T11:35:39.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.776+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-19T11:35:39.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.780+0000 7f22b06ac9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T11:35:39.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.788+0000 7f2160fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:35:39.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.788+0000 7f22b06ac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:35:39.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:39.788+0000 7f22b06ac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:35:42.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.656+0000 7f22b06ac9c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-19T11:35:42.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.656+0000 7f22b06ac9c0 5 note: GC not initialized 2024-09-19T11:35:42.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.728+0000 7f20cb7fe640 20 reqs_thread_entry: start 2024-09-19T11:35:42.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.728+0000 7f22b06ac9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:35:42.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.728+0000 7f22b06ac9c0 20 Filter name: none 2024-09-19T11:35:42.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.728+0000 7f20c97fa640 20 reqs_thread_entry: start 2024-09-19T11:35:42.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.784+0000 7f2160fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:35:42.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.792+0000 7f22b06ac9c0 20 remove_watcher() i=0 2024-09-19T11:35:42.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.792+0000 7f22b06ac9c0 2 removed watcher, disabling cache 2024-09-19T11:35:42.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.792+0000 7f22b06ac9c0 20 remove_watcher() i=1 2024-09-19T11:35:42.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.796+0000 7f22b06ac9c0 20 remove_watcher() i=2 2024-09-19T11:35:42.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.800+0000 7f22b06ac9c0 20 remove_watcher() i=3 2024-09-19T11:35:42.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.800+0000 7f22b06ac9c0 20 remove_watcher() i=4 2024-09-19T11:35:42.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.804+0000 7f22b06ac9c0 20 remove_watcher() i=5 2024-09-19T11:35:42.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.804+0000 7f22b06ac9c0 20 remove_watcher() i=6 2024-09-19T11:35:42.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.808+0000 7f22b06ac9c0 20 remove_watcher() i=7 2024-09-19T11:35:42.829 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-19T11:35:42.829 DEBUG:tasks.util.rgw: json result: [] 2024-09-19T11:35:42.830 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-19T11:35:42.830 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-19T11:35:42.830 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-19T11:35:42.872 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:35:42.872 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:35:42.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.900+0000 7f2a114969c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:35:42.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.900+0000 7f2a114969c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:35:42.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:42.904+0000 7f28ccff9640 20 reqs_thread_entry: start 2024-09-19T11:35:42.930 INFO:teuthology.orchestra.run.smithi120.stdout:{"id":"cd83c2b8-48ff-443f-8733-529022aeb2cf","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-19T11:35:42.930 DEBUG:tasks.util.rgw: json result: {'id': 'cd83c2b8-48ff-443f-8733-529022aeb2cf', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-19T11:35:42.931 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-19T11:35:42.931 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-19T11:35:42.931 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-19T11:35:43.000 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:35:43.000 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:35:43.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.036+0000 7fb2346939c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.040+0000 7fb2346939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:43.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.040+0000 7fb2346939c0 20 realm 2024-09-19T11:35:43.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.040+0000 7fb2346939c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.040+0000 7fb2346939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:43.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.040+0000 7fb2346939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:35:43.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.040+0000 7fb2346939c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.040+0000 7fb2346939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:43.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.040+0000 7fb2346939c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.040+0000 7fb2346939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:35:43.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.040+0000 7fb2346939c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.044+0000 7fb2346939c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-19T11:35:43.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.044+0000 7fb2346939c0 20 searching for the correct realm 2024-09-19T11:35:43.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.048+0000 7fb23299a640 0 -- 172.21.15.120:0/4107434510 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x563bc0bfcc00 msgr2=0x7fb21c1003d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:35:43.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.052+0000 7fb231998640 0 -- 172.21.15.120:0/4107434510 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fb22c044440 msgr2=0x7fb22c0448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:35:43.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.268+0000 7fb2346939c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:35:43.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.268+0000 7fb2346939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:35:43.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.268+0000 7fb2346939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:35:43.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.268+0000 7fb2346939c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:35:43.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.268+0000 7fb2346939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:35:43.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.268+0000 7fb2346939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:35:43.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.268+0000 7fb2346939c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.268+0000 7fb2346939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:43.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.268+0000 7fb2346939c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.272+0000 7fb2346939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:35:43.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.272+0000 7fb2346939c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.272+0000 7fb2346939c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:35:43.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.272+0000 7fb2346939c0 20 zone default found 2024-09-19T11:35:43.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.272+0000 7fb2346939c0 4 Realm: () 2024-09-19T11:35:43.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.272+0000 7fb2346939c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:35:43.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.272+0000 7fb2346939c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:35:43.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.272+0000 7fb2346939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:35:43.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.272+0000 7fb2346939c0 20 zonegroup default 2024-09-19T11:35:43.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.272+0000 7fb2346939c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.272+0000 7fb2346939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:43.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.272+0000 7fb2346939c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.272+0000 7fb2346939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:43.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.272+0000 7fb2346939c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.276+0000 7fb2346939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:43.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.276+0000 7fb2346939c0 20 started sync module instance, tier type = 2024-09-19T11:35:43.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.276+0000 7fb2346939c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:35:43.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.296+0000 7fb2346939c0 20 add_watcher() i=0 2024-09-19T11:35:43.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.296+0000 7fb2346939c0 20 add_watcher() i=1 2024-09-19T11:35:43.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.296+0000 7fb2346939c0 20 add_watcher() i=2 2024-09-19T11:35:43.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.296+0000 7fb2346939c0 20 add_watcher() i=3 2024-09-19T11:35:43.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.296+0000 7fb2346939c0 20 add_watcher() i=4 2024-09-19T11:35:43.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.296+0000 7fb2346939c0 20 add_watcher() i=5 2024-09-19T11:35:43.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.296+0000 7fb2346939c0 20 add_watcher() i=6 2024-09-19T11:35:43.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.300+0000 7fb2346939c0 20 add_watcher() i=7 2024-09-19T11:35:43.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.300+0000 7fb2346939c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:35:43.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.304+0000 7fb0e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:35:43.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.304+0000 7fb2346939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:35:43.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.304+0000 7fb2346939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:35:43.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.304+0000 7fb2346939c0 5 note: GC not initialized 2024-09-19T11:35:43.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.304+0000 7fb0637fe640 20 reqs_thread_entry: start 2024-09-19T11:35:43.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.304+0000 7fb2346939c0 20 init_complete bucket index max shards: 1 2024-09-19T11:35:43.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.304+0000 7fb2346939c0 20 Filter name: none 2024-09-19T11:35:43.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.304+0000 7fb0617fa640 20 reqs_thread_entry: start 2024-09-19T11:35:43.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.324+0000 7fb0e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:35:43.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.332+0000 7fb2346939c0 20 remove_watcher() i=0 2024-09-19T11:35:43.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.332+0000 7fb2346939c0 2 removed watcher, disabling cache 2024-09-19T11:35:43.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.332+0000 7fb2346939c0 20 remove_watcher() i=1 2024-09-19T11:35:43.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.336+0000 7fb2346939c0 20 remove_watcher() i=2 2024-09-19T11:35:43.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.340+0000 7fb2346939c0 20 remove_watcher() i=3 2024-09-19T11:35:43.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.340+0000 7fb2346939c0 20 remove_watcher() i=4 2024-09-19T11:35:43.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.340+0000 7fb2346939c0 20 remove_watcher() i=5 2024-09-19T11:35:43.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.344+0000 7fb2346939c0 20 remove_watcher() i=6 2024-09-19T11:35:43.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.344+0000 7fb2346939c0 20 remove_watcher() i=7 2024-09-19T11:35:43.364 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-19T11:35:43.364 DEBUG:tasks.util.rgw: json result: [] 2024-09-19T11:35:43.364 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-19T11:35:43.365 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-19T11:35:43.365 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-19T11:35:43.450 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:35:43.450 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:35:43.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.476+0000 7fac055989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:35:43.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.476+0000 7fac055989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:35:43.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.480+0000 7faac1ffb640 20 reqs_thread_entry: start 2024-09-19T11:35:43.506 INFO:teuthology.orchestra.run.smithi120.stdout:{"id":"cd83c2b8-48ff-443f-8733-529022aeb2cf","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-19T11:35:43.506 DEBUG:tasks.util.rgw: json result: {'id': 'cd83c2b8-48ff-443f-8733-529022aeb2cf', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-19T11:35:43.507 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-19T11:35:43.507 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p /tmp/rgw_datacache 2024-09-19T11:35:43.553 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-19T11:35:43.607 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-19T11:35:43.607 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-19T11:35:43.608 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-19T11:35:43.683 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:35:43.683 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:35:43.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.724+0000 7f4ab1de09c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.724+0000 7f4ab1de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:43.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.724+0000 7f4ab1de09c0 20 realm 2024-09-19T11:35:43.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.724+0000 7f4ab1de09c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.724+0000 7f4ab1de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:43.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.724+0000 7f4ab1de09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:35:43.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.724+0000 7f4ab1de09c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.724+0000 7f4ab1de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:43.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.724+0000 7f4ab1de09c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.728+0000 7f4ab1de09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:35:43.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.728+0000 7f4ab1de09c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.728+0000 7f4ab1de09c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-19T11:35:43.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.728+0000 7f4ab1de09c0 20 searching for the correct realm 2024-09-19T11:35:43.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.732+0000 7f4aaf8e6640 0 -- 172.21.15.120:0/3015467155 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f4aa0008040 msgr2=0x7f4aa003c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:35:43.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.948+0000 7f4aaf8e6640 0 -- 172.21.15.120:0/3015467155 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f4aa0008040 msgr2=0x7f4aa003c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.960+0000 7f4ab1de09c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.960+0000 7f4ab1de09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.960+0000 7f4ab1de09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.960+0000 7f4ab1de09c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.960+0000 7f4ab1de09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.960+0000 7f4ab1de09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.960+0000 7f4ab1de09c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.960+0000 7f4ab1de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.960+0000 7f4ab1de09c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.960+0000 7f4ab1de09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:35:43.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 20 zone default found 2024-09-19T11:35:43.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 4 Realm: () 2024-09-19T11:35:43.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:35:43.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:35:43.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:35:43.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 20 zonegroup default 2024-09-19T11:35:43.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:43.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:43.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 20 rados->read ofs=0 len=0 2024-09-19T11:35:43.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:35:43.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 20 started sync module instance, tier type = 2024-09-19T11:35:43.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.964+0000 7f4ab1de09c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:35:43.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.992+0000 7f4ab1de09c0 20 add_watcher() i=0 2024-09-19T11:35:43.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.992+0000 7f4ab1de09c0 20 add_watcher() i=1 2024-09-19T11:35:43.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.992+0000 7f4ab1de09c0 20 add_watcher() i=2 2024-09-19T11:35:43.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.992+0000 7f4ab1de09c0 20 add_watcher() i=3 2024-09-19T11:35:43.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.992+0000 7f4ab1de09c0 20 add_watcher() i=4 2024-09-19T11:35:43.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.992+0000 7f4ab1de09c0 20 add_watcher() i=5 2024-09-19T11:35:43.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.992+0000 7f4ab1de09c0 20 add_watcher() i=6 2024-09-19T11:35:43.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.992+0000 7f4ab1de09c0 20 add_watcher() i=7 2024-09-19T11:35:43.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.992+0000 7f4ab1de09c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:35:43.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.996+0000 7f4965fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:35:43.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.996+0000 7f4ab1de09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:35:43.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.996+0000 7f4ab1de09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:35:43.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.996+0000 7f4ab1de09c0 5 note: GC not initialized 2024-09-19T11:35:44.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.996+0000 7f4964fe1640 20 reqs_thread_entry: start 2024-09-19T11:35:44.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.996+0000 7f4ab1de09c0 20 init_complete bucket index max shards: 1 2024-09-19T11:35:44.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.996+0000 7f4ab1de09c0 20 Filter name: none 2024-09-19T11:35:44.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:43.996+0000 7f48de7fc640 20 reqs_thread_entry: start 2024-09-19T11:35:44.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.020+0000 7f4965fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:35:44.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.024+0000 7f4ab1de09c0 20 remove_watcher() i=0 2024-09-19T11:35:44.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.024+0000 7f4ab1de09c0 2 removed watcher, disabling cache 2024-09-19T11:35:44.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.024+0000 7f4ab1de09c0 20 remove_watcher() i=1 2024-09-19T11:35:44.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.028+0000 7f4ab1de09c0 20 remove_watcher() i=2 2024-09-19T11:35:44.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.032+0000 7f4ab1de09c0 20 remove_watcher() i=3 2024-09-19T11:35:44.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.036+0000 7f4ab1de09c0 20 remove_watcher() i=4 2024-09-19T11:35:44.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.040+0000 7f4ab1de09c0 20 remove_watcher() i=5 2024-09-19T11:35:44.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.040+0000 7f4ab1de09c0 20 remove_watcher() i=6 2024-09-19T11:35:44.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.040+0000 7f4ab1de09c0 20 remove_watcher() i=7 2024-09-19T11:35:44.065 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-19T11:35:44.065 DEBUG:tasks.util.rgw: json result: [] 2024-09-19T11:35:44.066 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-19T11:35:44.066 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-19T11:35:44.066 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-19T11:35:44.066 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-19T11:35:44.152 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:35:44.152 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:35:44.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.180+0000 7f48d75b89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:35:44.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.180+0000 7f48d75b89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:35:44.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.184+0000 7f47937fe640 20 reqs_thread_entry: start 2024-09-19T11:35:44.204 INFO:teuthology.orchestra.run.smithi120.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-19T11:35:44.204 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-19T11:35:44.204 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-19T11:35:44.204 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-19T11:35:44.205 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-19T11:35:44.288 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:35:44.288 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:35:44.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.316+0000 7f307a9bc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:35:44.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.316+0000 7f307a9bc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:35:44.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.320+0000 7f2f367fc640 20 reqs_thread_entry: start 2024-09-19T11:35:44.343 INFO:teuthology.orchestra.run.smithi120.stdout:{"id":"cd83c2b8-48ff-443f-8733-529022aeb2cf","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-19T11:35:44.343 DEBUG:tasks.util.rgw: json result: {'id': 'cd83c2b8-48ff-443f-8733-529022aeb2cf', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-19T11:35:44.343 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-19T11:35:44.343 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-19T11:35:44.343 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-19T11:35:44.344 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-19T11:35:44.425 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:35:44.425 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:35:44.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.452+0000 7f5e70eaa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:35:44.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.452+0000 7f5e70eaa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:35:44.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.456+0000 7f5d2cff9640 20 reqs_thread_entry: start 2024-09-19T11:35:44.474 INFO:teuthology.orchestra.run.smithi120.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-19T11:35:44.475 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-19T11:35:44.475 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-19T11:35:44.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-19T11:35:44.475 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-19T11:35:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:35:44.555 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:35:44.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.580+0000 7f3babd3b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:35:44.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.580+0000 7f3babd3b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:35:44.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:35:44.584+0000 7f39eeffd640 20 reqs_thread_entry: start 2024-09-19T11:35:44.608 INFO:teuthology.orchestra.run.smithi120.stdout:{"id":"cd83c2b8-48ff-443f-8733-529022aeb2cf","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-19T11:35:44.608 DEBUG:tasks.util.rgw: json result: {'id': 'cd83c2b8-48ff-443f-8733-529022aeb2cf', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-19T11:35:44.608 INFO:tasks.rgw:Starting rgw... 2024-09-19T11:35:44.609 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-19T11:35:44.609 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-19T11:35:44.609 DEBUG:teuthology.orchestra.run.smithi120:> sudo echo -n http://smithi120.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-19T11:35:44.671 INFO:teuthology.orchestra.run.smithi120.stdout:http://smithi120.front.sepia.ceph.com:80 2024-09-19T11:35:44.671 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-19T11:35:44.723 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-19T11:35:44.723 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-19T11:35:44.766 INFO:tasks.rgw.client.0:Started 2024-09-19T11:35:44.766 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi120.front.sepia.ceph.com:80/ 2024-09-19T11:35:44.766 DEBUG:teuthology.orchestra.run.smithi120:> curl http://smithi120.front.sepia.ceph.com:80/ 2024-09-19T11:35:44.784 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-19T11:35:44.785 INFO:teuthology.orchestra.run.smithi120.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-19T11:35:44.785 INFO:teuthology.orchestra.run.smithi120.stderr: Dload Upload Total Spent Left Speed 2024-09-19T11:35:44.785 INFO:teuthology.orchestra.run.smithi120.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-19T11:35:44.785 INFO:teuthology.orchestra.run.smithi120.stderr:curl: (7) Failed to connect to smithi120.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-19T11:35:45.786 DEBUG:teuthology.orchestra.run.smithi120:> curl http://smithi120.front.sepia.ceph.com:80/ 2024-09-19T11:35:45.797 INFO:teuthology.orchestra.run.smithi120.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-19T11:35:45.797 INFO:teuthology.orchestra.run.smithi120.stderr: Dload Upload Total Spent Left Speed 2024-09-19T11:35:45.800 INFO:teuthology.orchestra.run.smithi120.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 64460 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-19T11:35:45.800 INFO:teuthology.orchestra.run.smithi120.stdout:anonymous 2024-09-19T11:35:45.801 INFO:teuthology.run_tasks:Running task tox... 2024-09-19T11:35:45.811 INFO:tasks.tox:Deploying tox from pip... 2024-09-19T11:35:45.812 DEBUG:teuthology.orchestra.run.smithi120:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-19T11:35:49.252 DEBUG:teuthology.orchestra.run.smithi120:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-19T11:35:49.942 INFO:teuthology.orchestra.run.smithi120.stdout:Collecting tox==3.15.0 2024-09-19T11:35:50.041 INFO:teuthology.orchestra.run.smithi120.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-19T11:35:50.113 INFO:teuthology.orchestra.run.smithi120.stdout: ---------------------------------------- 82.1/82.1 KB 1.1 MB/s eta 0:00:00 2024-09-19T11:35:50.280 INFO:teuthology.orchestra.run.smithi120.stdout:Collecting filelock<4,>=3.0.0 2024-09-19T11:35:50.294 INFO:teuthology.orchestra.run.smithi120.stdout: Downloading filelock-3.16.1-py3-none-any.whl (16 kB) 2024-09-19T11:35:50.608 INFO:teuthology.orchestra.run.smithi120.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-19T11:35:50.622 INFO:teuthology.orchestra.run.smithi120.stdout: Downloading virtualenv-20.26.5-py3-none-any.whl (6.0 MB) 2024-09-19T11:35:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: ---------------------------------------- 6.0/6.0 MB 11.9 MB/s eta 0:00:00 2024-09-19T11:35:51.259 INFO:teuthology.orchestra.run.smithi120.stdout:Collecting six<2,>=1.14.0 2024-09-19T11:35:51.275 INFO:teuthology.orchestra.run.smithi120.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T11:35:51.398 INFO:teuthology.orchestra.run.smithi120.stdout:Collecting py<2,>=1.4.17 2024-09-19T11:35:51.414 INFO:teuthology.orchestra.run.smithi120.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-19T11:35:51.447 INFO:teuthology.orchestra.run.smithi120.stdout: ---------------------------------------- 98.7/98.7 KB 3.1 MB/s eta 0:00:00 2024-09-19T11:35:51.559 INFO:teuthology.orchestra.run.smithi120.stdout:Collecting packaging>=14 2024-09-19T11:35:51.573 INFO:teuthology.orchestra.run.smithi120.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-19T11:35:51.605 INFO:teuthology.orchestra.run.smithi120.stdout: ---------------------------------------- 54.0/54.0 KB 1.5 MB/s eta 0:00:00 2024-09-19T11:35:51.686 INFO:teuthology.orchestra.run.smithi120.stdout:Collecting pluggy<1,>=0.12.0 2024-09-19T11:35:51.701 INFO:teuthology.orchestra.run.smithi120.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-19T11:35:51.774 INFO:teuthology.orchestra.run.smithi120.stdout:Collecting toml>=0.9.4 2024-09-19T11:35:51.789 INFO:teuthology.orchestra.run.smithi120.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-19T11:35:51.990 INFO:teuthology.orchestra.run.smithi120.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-19T11:35:52.004 INFO:teuthology.orchestra.run.smithi120.stdout: Downloading platformdirs-4.3.6-py3-none-any.whl (18 kB) 2024-09-19T11:35:52.127 INFO:teuthology.orchestra.run.smithi120.stdout:Collecting distlib<1,>=0.3.7 2024-09-19T11:35:52.142 INFO:teuthology.orchestra.run.smithi120.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-19T11:35:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: --------------------------------------- 468.9/468.9 KB 5.8 MB/s eta 0:00:00 2024-09-19T11:35:52.396 INFO:teuthology.orchestra.run.smithi120.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-19T11:35:53.435 INFO:teuthology.orchestra.run.smithi120.stdout:Successfully installed distlib-0.3.8 filelock-3.16.1 packaging-24.1 platformdirs-4.3.6 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.5 2024-09-19T11:35:53.529 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T11:35:53.542 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:35:53.543 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T11:35:53.543 DEBUG:teuthology.orchestra.run.smithi120:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T11:35:53.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:35:53.549 INFO:teuthology.orchestra.run.smithi120.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T11:35:53.549 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T11:35:53.598 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T11:35:53.598 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T11:35:53.646 INFO:tasks.workunit:timeout=3h 2024-09-19T11:35:53.646 INFO:tasks.workunit:cleanup=True 2024-09-19T11:35:53.646 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:35:53.695 INFO:tasks.workunit.client.0.smithi120.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T11:36:51.528 INFO:tasks.workunit.client.0.smithi120.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T11:36:51.529 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:36:51.529 INFO:tasks.workunit.client.0.smithi120.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T11:36:51.529 INFO:tasks.workunit.client.0.smithi120.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T11:36:51.529 INFO:tasks.workunit.client.0.smithi120.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T11:36:51.529 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:36:51.529 INFO:tasks.workunit.client.0.smithi120.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T11:36:51.529 INFO:tasks.workunit.client.0.smithi120.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T11:36:51.529 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:36:51.529 INFO:tasks.workunit.client.0.smithi120.stderr: git switch -c 2024-09-19T11:36:51.530 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:36:51.530 INFO:tasks.workunit.client.0.smithi120.stderr:Or undo this operation with: 2024-09-19T11:36:51.530 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:36:51.530 INFO:tasks.workunit.client.0.smithi120.stderr: git switch - 2024-09-19T11:36:51.530 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:36:51.530 INFO:tasks.workunit.client.0.smithi120.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T11:36:51.530 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:36:51.530 INFO:tasks.workunit.client.0.smithi120.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T11:36:51.535 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T11:36:51.584 INFO:tasks.workunit.client.0.smithi120.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T11:36:51.586 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T11:36:51.586 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T11:36:52.409 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T11:36:52.480 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T11:36:52.527 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T11:36:52.528 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T11:36:52.528 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T11:36:52.570 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T11:36:52.574 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:36:52.574 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T11:36:52.627 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-19T11:36:52.628 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-19T11:36:52.628 DEBUG:teuthology.orchestra.run.smithi120:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-19T11:36:52.679 INFO:tasks.workunit.client.0.smithi120.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-19T11:36:52.679 INFO:tasks.workunit.client.0.smithi120.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T11:36:52.680 INFO:tasks.workunit.client.0.smithi120.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T11:36:55.555 INFO:tasks.workunit.client.0.smithi120.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-19T11:36:55.555 INFO:tasks.workunit.client.0.smithi120.stderr:++ deactivate nondestructive 2024-09-19T11:36:55.555 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n '' ']' 2024-09-19T11:36:55.555 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n '' ']' 2024-09-19T11:36:55.555 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T11:36:55.555 INFO:tasks.workunit.client.0.smithi120.stderr:++ hash -r 2024-09-19T11:36:55.556 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n '' ']' 2024-09-19T11:36:55.556 INFO:tasks.workunit.client.0.smithi120.stderr:++ unset VIRTUAL_ENV 2024-09-19T11:36:55.556 INFO:tasks.workunit.client.0.smithi120.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-19T11:36:55.556 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-19T11:36:55.556 INFO:tasks.workunit.client.0.smithi120.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T11:36:55.556 INFO:tasks.workunit.client.0.smithi120.stderr:++ export VIRTUAL_ENV 2024-09-19T11:36:55.556 INFO:tasks.workunit.client.0.smithi120.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T11:36:55.557 INFO:tasks.workunit.client.0.smithi120.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T11:36:55.557 INFO:tasks.workunit.client.0.smithi120.stderr:++ export PATH 2024-09-19T11:36:55.557 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n '' ']' 2024-09-19T11:36:55.557 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -z '' ']' 2024-09-19T11:36:55.558 INFO:tasks.workunit.client.0.smithi120.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-19T11:36:55.558 INFO:tasks.workunit.client.0.smithi120.stderr:++ PS1='(rgw) ' 2024-09-19T11:36:55.558 INFO:tasks.workunit.client.0.smithi120.stderr:++ export PS1 2024-09-19T11:36:55.558 INFO:tasks.workunit.client.0.smithi120.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-19T11:36:55.558 INFO:tasks.workunit.client.0.smithi120.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-19T11:36:55.558 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T11:36:55.558 INFO:tasks.workunit.client.0.smithi120.stderr:++ hash -r 2024-09-19T11:36:55.558 INFO:tasks.workunit.client.0.smithi120.stderr:+ pip install pip --upgrade 2024-09-19T11:36:55.918 INFO:tasks.workunit.client.0.smithi120.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-19T11:36:56.137 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting pip 2024-09-19T11:36:56.248 INFO:tasks.workunit.client.0.smithi120.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-19T11:36:56.539 INFO:tasks.workunit.client.0.smithi120.stdout: ---------------------------------------- 1.8/1.8 MB 6.3 MB/s eta 0:00:00 2024-09-19T11:36:56.612 INFO:tasks.workunit.client.0.smithi120.stdout:Installing collected packages: pip 2024-09-19T11:36:56.612 INFO:tasks.workunit.client.0.smithi120.stdout: Attempting uninstall: pip 2024-09-19T11:36:56.613 INFO:tasks.workunit.client.0.smithi120.stdout: Found existing installation: pip 22.0.2 2024-09-19T11:36:56.886 INFO:tasks.workunit.client.0.smithi120.stdout: Uninstalling pip-22.0.2: 2024-09-19T11:36:56.892 INFO:tasks.workunit.client.0.smithi120.stdout: Successfully uninstalled pip-22.0.2 2024-09-19T11:36:57.641 INFO:tasks.workunit.client.0.smithi120.stdout:Successfully installed pip-24.2 2024-09-19T11:36:57.703 INFO:tasks.workunit.client.0.smithi120.stderr:+ pip install configobj 2024-09-19T11:36:58.268 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting configobj 2024-09-19T11:36:58.318 INFO:tasks.workunit.client.0.smithi120.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-19T11:36:58.455 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting six (from configobj) 2024-09-19T11:36:58.472 INFO:tasks.workunit.client.0.smithi120.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-19T11:36:58.545 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-19T11:36:58.613 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T11:36:58.695 INFO:tasks.workunit.client.0.smithi120.stdout:Installing collected packages: six, configobj 2024-09-19T11:36:58.851 INFO:tasks.workunit.client.0.smithi120.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-19T11:36:59.237 INFO:tasks.workunit.client.0.smithi120.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-19T11:36:59.273 INFO:tasks.workunit.client.0.smithi120.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-19T11:36:59.274 INFO:tasks.workunit.client.0.smithi120.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-19T11:36:59.275 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:command succeeded 2024-09-19T11:36:59.275 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-19T11:36:59.275 INFO:tasks.workunit.client.0.smithi120.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:36:59.275 INFO:tasks.workunit.client.0.smithi120.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-19T11:36:59.332 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:command succeeded 2024-09-19T11:36:59.332 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:b'tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 38394/radosgw \ntcp6 0 0 :::80 :::* LISTEN 38394/radosgw \n' 2024-09-19T11:36:59.332 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:radosgw port: 80 2024-09-19T11:36:59.332 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-19T11:36:59.332 INFO:tasks.workunit.client.0.smithi120.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-19T11:36:59.357 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:command succeeded 2024-09-19T11:36:59.357 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:b'' 2024-09-19T11:36:59.357 INFO:tasks.workunit.client.0.smithi120.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-19T11:36:59.766 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:command succeeded 2024-09-19T11:36:59.766 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-19T11:36:59.720197Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-19T11:36:59.720163Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-19T11:36:59.766 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:Creating s3cmd config... 2024-09-19T11:36:59.766 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:proto for s3cmd config is http 2024-09-19T11:36:59.767 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:s3cmd config written 2024-09-19T11:36:59.767 INFO:tasks.workunit.client.0.smithi120.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-19T11:36:59.947 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:command succeeded 2024-09-19T11:36:59.947 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-19T11:36:59.947 INFO:tasks.workunit.client.0.smithi120.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-19T11:37:00.206 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:command succeeded 2024-09-19T11:37:00.206 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 0.1 seconds, 64.69 MB/s) [1 of 1]\n" 2024-09-19T11:37:00.206 INFO:tasks.workunit.client.0.smithi120.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-19T11:37:00.386 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:command succeeded 2024-09-19T11:37:00.387 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.0 seconds, 168.11 MB/s)\n" 2024-09-19T11:37:00.387 INFO:tasks.workunit.client.0.smithi120.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-19T11:37:00.774 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:command succeeded 2024-09-19T11:37:00.774 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340032,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "etag": "ad25de3dc0c12b66a1c532dca8b70b33",\n "tag": "cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3096188937798750836",\n "manifest": {\n "objs": [],\n "obj_size": 7340032,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".FUeC1wuHx9AHNQ-KxikA9tLcw3PI9Wk_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 6291456,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1",\n "bucket_id": "cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 6291456,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1",\n "bucket_id": "cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".FUeC1wuHx9AHNQ-KxikA9tLcw3PI9Wk_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 6291456,\n "ofs": 7340032,\n "stripe_size": 1048576,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1",\n "bucket_id": "cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".FUeC1wuHx9AHNQ-KxikA9tLcw3PI9Wk_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-19T11:37:00.182307Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3096188937798750836",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726745819/ctime:1726745819/gid:1271/gname:ubuntu/md5:ad25de3dc0c12b66a1c532dca8b70b33/mode:33204/mtime:1726745819/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-19T11:37:00.774 INFO:tasks.workunit.client.0.smithi120.stderr:DEBUG:root:Cached object name is: .FUeC1wuHx9AHNQ-KxikA9tLcw3PI9Wk_ 2024-09-19T11:37:00.774 INFO:tasks.workunit.client.0.smithi120.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-19T11:37:00.777 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:command succeeded 2024-09-19T11:37:00.777 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:b'0\n' 2024-09-19T11:37:00.777 INFO:tasks.workunit.client.0.smithi120.stderr:DEBUG:root:Check cache dir content: 0 2024-09-19T11:37:00.777 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-19T11:37:00.777 INFO:tasks.workunit.client.0.smithi120.stderr:INFO:root:Completed Datacache tests 2024-09-19T11:37:00.784 INFO:tasks.workunit.client.0.smithi120.stderr:+ deactivate 2024-09-19T11:37:00.784 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-19T11:37:00.784 INFO:tasks.workunit.client.0.smithi120.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T11:37:00.784 INFO:tasks.workunit.client.0.smithi120.stderr:+ export PATH 2024-09-19T11:37:00.784 INFO:tasks.workunit.client.0.smithi120.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-19T11:37:00.784 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' -n '' ']' 2024-09-19T11:37:00.784 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T11:37:00.784 INFO:tasks.workunit.client.0.smithi120.stderr:+ hash -r 2024-09-19T11:37:00.785 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' -n '' ']' 2024-09-19T11:37:00.785 INFO:tasks.workunit.client.0.smithi120.stderr:+ unset VIRTUAL_ENV 2024-09-19T11:37:00.785 INFO:tasks.workunit.client.0.smithi120.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-19T11:37:00.785 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-19T11:37:00.785 INFO:tasks.workunit.client.0.smithi120.stderr:+ unset -f deactivate 2024-09-19T11:37:00.785 INFO:tasks.workunit.client.0.smithi120.stderr:+ echo OK. 2024-09-19T11:37:00.786 INFO:tasks.workunit.client.0.smithi120.stdout:OK. 2024-09-19T11:37:00.786 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:37:00.787 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:37:00.850 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-19T11:37:00.851 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T11:37:01.180 DEBUG:teuthology.parallel:result is None 2024-09-19T11:37:01.181 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T11:37:01.194 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T11:37:01.194 DEBUG:teuthology.orchestra.run.smithi120:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T11:37:01.549 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T11:37:01.549 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T11:37:01.561 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:37:01.561 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T11:37:01.561 DEBUG:teuthology.orchestra.run.smithi120:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T11:37:01.567 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:37:01.568 INFO:teuthology.orchestra.run.smithi120.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T11:37:01.568 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T11:37:01.619 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T11:37:01.620 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T11:37:01.666 INFO:tasks.workunit:timeout=3h 2024-09-19T11:37:01.667 INFO:tasks.workunit:cleanup=True 2024-09-19T11:37:01.667 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:37:01.715 INFO:tasks.workunit.client.0.smithi120.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T11:38:00.442 INFO:tasks.workunit.client.0.smithi120.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T11:38:00.443 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:00.443 INFO:tasks.workunit.client.0.smithi120.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T11:38:00.443 INFO:tasks.workunit.client.0.smithi120.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T11:38:00.443 INFO:tasks.workunit.client.0.smithi120.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T11:38:00.443 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:00.443 INFO:tasks.workunit.client.0.smithi120.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T11:38:00.443 INFO:tasks.workunit.client.0.smithi120.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T11:38:00.443 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:00.443 INFO:tasks.workunit.client.0.smithi120.stderr: git switch -c 2024-09-19T11:38:00.443 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:00.443 INFO:tasks.workunit.client.0.smithi120.stderr:Or undo this operation with: 2024-09-19T11:38:00.444 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:00.444 INFO:tasks.workunit.client.0.smithi120.stderr: git switch - 2024-09-19T11:38:00.444 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:00.444 INFO:tasks.workunit.client.0.smithi120.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T11:38:00.444 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:00.444 INFO:tasks.workunit.client.0.smithi120.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T11:38:00.449 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T11:38:00.495 INFO:tasks.workunit.client.0.smithi120.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T11:38:00.498 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T11:38:00.498 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T11:38:00.559 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T11:38:00.620 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T11:38:00.661 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T11:38:00.662 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T11:38:00.662 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T11:38:00.706 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T11:38:00.710 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:38:00.710 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T11:38:00.758 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-19T11:38:00.759 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-19T11:38:00.759 DEBUG:teuthology.orchestra.run.smithi120:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-19T11:38:00.810 INFO:tasks.workunit.client.0.smithi120.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-19T11:38:00.811 INFO:tasks.workunit.client.0.smithi120.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T11:38:00.811 INFO:tasks.workunit.client.0.smithi120.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T11:38:03.667 INFO:tasks.workunit.client.0.smithi120.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-19T11:38:03.667 INFO:tasks.workunit.client.0.smithi120.stderr:++ deactivate nondestructive 2024-09-19T11:38:03.667 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n '' ']' 2024-09-19T11:38:03.667 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n '' ']' 2024-09-19T11:38:03.667 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T11:38:03.667 INFO:tasks.workunit.client.0.smithi120.stderr:++ hash -r 2024-09-19T11:38:03.667 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n '' ']' 2024-09-19T11:38:03.668 INFO:tasks.workunit.client.0.smithi120.stderr:++ unset VIRTUAL_ENV 2024-09-19T11:38:03.668 INFO:tasks.workunit.client.0.smithi120.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-19T11:38:03.668 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-19T11:38:03.668 INFO:tasks.workunit.client.0.smithi120.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T11:38:03.668 INFO:tasks.workunit.client.0.smithi120.stderr:++ export VIRTUAL_ENV 2024-09-19T11:38:03.668 INFO:tasks.workunit.client.0.smithi120.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T11:38:03.668 INFO:tasks.workunit.client.0.smithi120.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T11:38:03.668 INFO:tasks.workunit.client.0.smithi120.stderr:++ export PATH 2024-09-19T11:38:03.668 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n '' ']' 2024-09-19T11:38:03.668 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -z '' ']' 2024-09-19T11:38:03.668 INFO:tasks.workunit.client.0.smithi120.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-19T11:38:03.668 INFO:tasks.workunit.client.0.smithi120.stderr:++ PS1='(rgw) ' 2024-09-19T11:38:03.668 INFO:tasks.workunit.client.0.smithi120.stderr:++ export PS1 2024-09-19T11:38:03.669 INFO:tasks.workunit.client.0.smithi120.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-19T11:38:03.669 INFO:tasks.workunit.client.0.smithi120.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-19T11:38:03.669 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T11:38:03.669 INFO:tasks.workunit.client.0.smithi120.stderr:++ hash -r 2024-09-19T11:38:03.669 INFO:tasks.workunit.client.0.smithi120.stderr:+ pip install pip --upgrade 2024-09-19T11:38:04.060 INFO:tasks.workunit.client.0.smithi120.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-19T11:38:04.263 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting pip 2024-09-19T11:38:04.269 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-19T11:38:04.303 INFO:tasks.workunit.client.0.smithi120.stdout:Installing collected packages: pip 2024-09-19T11:38:04.303 INFO:tasks.workunit.client.0.smithi120.stdout: Attempting uninstall: pip 2024-09-19T11:38:04.303 INFO:tasks.workunit.client.0.smithi120.stdout: Found existing installation: pip 22.0.2 2024-09-19T11:38:04.557 INFO:tasks.workunit.client.0.smithi120.stdout: Uninstalling pip-22.0.2: 2024-09-19T11:38:04.563 INFO:tasks.workunit.client.0.smithi120.stdout: Successfully uninstalled pip-22.0.2 2024-09-19T11:38:05.294 INFO:tasks.workunit.client.0.smithi120.stdout:Successfully installed pip-24.2 2024-09-19T11:38:05.354 INFO:tasks.workunit.client.0.smithi120.stderr:+ pip install boto3 2024-09-19T11:38:06.372 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting boto3 2024-09-19T11:38:06.415 INFO:tasks.workunit.client.0.smithi120.stdout: Downloading boto3-1.35.22-py3-none-any.whl.metadata (6.6 kB) 2024-09-19T11:38:07.019 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting botocore<1.36.0,>=1.35.22 (from boto3) 2024-09-19T11:38:07.033 INFO:tasks.workunit.client.0.smithi120.stdout: Downloading botocore-1.35.22-py3-none-any.whl.metadata (5.7 kB) 2024-09-19T11:38:07.172 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-19T11:38:07.187 INFO:tasks.workunit.client.0.smithi120.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-19T11:38:07.323 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-19T11:38:07.339 INFO:tasks.workunit.client.0.smithi120.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-19T11:38:07.467 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T11:38:07.483 INFO:tasks.workunit.client.0.smithi120.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-19T11:38:07.679 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T11:38:07.694 INFO:tasks.workunit.client.0.smithi120.stdout: Downloading urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-19T11:38:07.972 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T11:38:07.973 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-19T11:38:07.990 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading boto3-1.35.22-py3-none-any.whl (139 kB) 2024-09-19T11:38:08.122 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading botocore-1.35.22-py3-none-any.whl (12.6 MB) 2024-09-19T11:38:08.384 INFO:tasks.workunit.client.0.smithi120.stdout: ---------------------------------------- 12.6/12.6 MB 50.3 MB/s eta 0:00:00 2024-09-19T11:38:08.400 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-19T11:38:08.466 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-19T11:38:08.533 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-19T11:38:08.609 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-19T11:38:08.672 INFO:tasks.workunit.client.0.smithi120.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T11:38:08.796 INFO:tasks.workunit.client.0.smithi120.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-19T11:38:09.808 INFO:tasks.workunit.client.0.smithi120.stdout:Successfully installed boto3-1.35.22 botocore-1.35.22 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-19T11:38:10.021 INFO:tasks.workunit.client.0.smithi120.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-19T11:38:10.172 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-19T11:38:10.210 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:10.210 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:10.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.247+0000 7f6196d069c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:10.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.251+0000 7f6196d069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:10.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.251+0000 7f6196d069c0 20 realm 2024-09-19T11:38:10.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.251+0000 7f6196d069c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:10.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.251+0000 7f6196d069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:10.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.251+0000 7f6196d069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:10.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.251+0000 7f6196d069c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:10.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.251+0000 7f6196d069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:10.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.251+0000 7f6196d069c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:10.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.251+0000 7f6196d069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:10.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.251+0000 7f6196d069c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:10.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.255+0000 7f6196d069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:10.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.255+0000 7f6196d069c0 20 searching for the correct realm 2024-09-19T11:38:10.262 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.259+0000 7f619480c640 0 -- 172.21.15.120:0/157154079 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f618c0e5020 msgr2=0x7f618c0e6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:10.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.475+0000 7f619480c640 0 -- 172.21.15.120:0/157154079 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f618c0e5020 msgr2=0x7f618c0e6040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:10.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:10.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:10.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:10.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:10.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:10.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:10.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:10.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:10.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:10.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:10.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:10.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:10.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 20 zone default found 2024-09-19T11:38:10.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 4 Realm: () 2024-09-19T11:38:10.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:10.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:10.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:10.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 20 zonegroup default 2024-09-19T11:38:10.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.487+0000 7f6196d069c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:10.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.491+0000 7f6196d069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:10.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.491+0000 7f6196d069c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:10.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.491+0000 7f6196d069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:10.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.491+0000 7f6196d069c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:10.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.491+0000 7f6196d069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:10.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.491+0000 7f6196d069c0 20 started sync module instance, tier type = 2024-09-19T11:38:10.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.491+0000 7f6196d069c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:10.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.519+0000 7f6196d069c0 20 add_watcher() i=0 2024-09-19T11:38:10.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.519+0000 7f6196d069c0 20 add_watcher() i=1 2024-09-19T11:38:10.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.519+0000 7f6196d069c0 20 add_watcher() i=2 2024-09-19T11:38:10.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.519+0000 7f6196d069c0 20 add_watcher() i=3 2024-09-19T11:38:10.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.519+0000 7f6196d069c0 20 add_watcher() i=4 2024-09-19T11:38:10.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.519+0000 7f6196d069c0 20 add_watcher() i=5 2024-09-19T11:38:10.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.519+0000 7f6196d069c0 20 add_watcher() i=6 2024-09-19T11:38:10.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.519+0000 7f6196d069c0 20 add_watcher() i=7 2024-09-19T11:38:10.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.519+0000 7f6196d069c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:10.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.527+0000 7f604b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:10.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.527+0000 7f6196d069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:10.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.527+0000 7f6196d069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:10.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.527+0000 7f6196d069c0 5 note: GC not initialized 2024-09-19T11:38:10.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.527+0000 7f604a7e4640 20 reqs_thread_entry: start 2024-09-19T11:38:10.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.527+0000 7f6196d069c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:10.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.527+0000 7f6196d069c0 20 Filter name: none 2024-09-19T11:38:10.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.527+0000 7f60437fe640 20 reqs_thread_entry: start 2024-09-19T11:38:10.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.527+0000 7f6196d069c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-19T11:38:10.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.527+0000 7f6196d069c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:10.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.527+0000 7f6196d069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:10.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.527+0000 7f6196d069c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-19T11:38:10.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.527+0000 7f6196d069c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-19T11:38:10.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.527+0000 7f6196d069c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-19T11:38:10.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.527+0000 7f6196d069c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:10.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.531+0000 7f6196d069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:10.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.531+0000 7f6196d069c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-19T11:38:10.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.531+0000 7f6196d069c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-19T11:38:10.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.531+0000 7f6196d069c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-19T11:38:10.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.531+0000 7f6196d069c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-19T11:38:10.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.531+0000 7f6196d069c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-19T11:38:10.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.531+0000 7f6196d069c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-19T11:38:10.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.531+0000 7f6196d069c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-19T11:38:10.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.535+0000 7f606bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691841 cookie 94421464806784 notifier 4755 bl.length()=593 2024-09-19T11:38:10.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.535+0000 7f606bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-19T11:38:10.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.535+0000 7f606bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-19T11:38:10.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.539+0000 7f6196d069c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-19T11:38:10.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.539+0000 7f6196d069c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-19T11:38:10.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.539+0000 7f6196d069c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-19T11:38:10.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.539+0000 7f606bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94421464799408 notifier 4755 bl.length()=186 2024-09-19T11:38:10.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.539+0000 7f606bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-19T11:38:10.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.539+0000 7f606bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-19T11:38:10.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.543+0000 7f604b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:10.551 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.547+0000 7f6196d069c0 20 remove_watcher() i=0 2024-09-19T11:38:10.551 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.547+0000 7f6196d069c0 2 removed watcher, disabling cache 2024-09-19T11:38:10.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.547+0000 7f6196d069c0 20 remove_watcher() i=1 2024-09-19T11:38:10.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.551+0000 7f6196d069c0 20 remove_watcher() i=2 2024-09-19T11:38:10.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.551+0000 7f6196d069c0 20 remove_watcher() i=3 2024-09-19T11:38:10.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.555+0000 7f6196d069c0 20 remove_watcher() i=4 2024-09-19T11:38:10.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.555+0000 7f6196d069c0 20 remove_watcher() i=5 2024-09-19T11:38:10.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.559+0000 7f6196d069c0 20 remove_watcher() i=6 2024-09-19T11:38:10.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:10.559+0000 7f6196d069c0 20 remove_watcher() i=7 2024-09-19T11:38:11.048 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: recalculated bucket check stats are correct 2024-09-19T11:38:11.048 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:11.048 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-19T11:38:11.080 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:11.080 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:11.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.123+0000 7f99a3a609c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.123+0000 7f99a3a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.123+0000 7f99a3a609c0 20 realm 2024-09-19T11:38:11.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.123+0000 7f99a3a609c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.123+0000 7f99a3a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.123+0000 7f99a3a609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:11.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.123+0000 7f99a3a609c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.123+0000 7f99a3a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.123+0000 7f99a3a609c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.123+0000 7f99a3a609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:11.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.127+0000 7f99a3a609c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.127+0000 7f99a3a609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:11.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.127+0000 7f99a3a609c0 20 searching for the correct realm 2024-09-19T11:38:11.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.131+0000 7f99a1566640 0 -- 172.21.15.120:0/4254413852 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f999c0ab070 msgr2=0x7f999c0dd920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:11.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.347+0000 7f99a1566640 0 -- 172.21.15.120:0/4254413852 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f999c0ab070 msgr2=0x7f999c0dd920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:11.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:11.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:11.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:11.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:11.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:11.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:11.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:11.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:11.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 20 zone default found 2024-09-19T11:38:11.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 4 Realm: () 2024-09-19T11:38:11.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:11.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:11.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:11.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 20 zonegroup default 2024-09-19T11:38:11.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.359+0000 7f99a3a609c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.363+0000 7f99a3a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.363+0000 7f99a3a609c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.363+0000 7f99a3a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.363+0000 7f99a3a609c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.363+0000 7f99a3a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.363+0000 7f99a3a609c0 20 started sync module instance, tier type = 2024-09-19T11:38:11.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.363+0000 7f99a3a609c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:11.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.391+0000 7f99a3a609c0 20 add_watcher() i=0 2024-09-19T11:38:11.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.391+0000 7f99a3a609c0 20 add_watcher() i=1 2024-09-19T11:38:11.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.391+0000 7f99a3a609c0 20 add_watcher() i=2 2024-09-19T11:38:11.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.391+0000 7f99a3a609c0 20 add_watcher() i=3 2024-09-19T11:38:11.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.391+0000 7f99a3a609c0 20 add_watcher() i=4 2024-09-19T11:38:11.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.391+0000 7f99a3a609c0 20 add_watcher() i=5 2024-09-19T11:38:11.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.391+0000 7f99a3a609c0 20 add_watcher() i=6 2024-09-19T11:38:11.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.395+0000 7f99a3a609c0 20 add_watcher() i=7 2024-09-19T11:38:11.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.395+0000 7f99a3a609c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:11.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.399+0000 7f9857fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:11.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.399+0000 7f99a3a609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:11.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.399+0000 7f99a3a609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:11.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.399+0000 7f99a3a609c0 5 note: GC not initialized 2024-09-19T11:38:11.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.399+0000 7f9856fe5640 20 reqs_thread_entry: start 2024-09-19T11:38:11.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.399+0000 7f99a3a609c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:11.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.399+0000 7f99a3a609c0 20 Filter name: none 2024-09-19T11:38:11.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.399+0000 7f9854fe1640 20 reqs_thread_entry: start 2024-09-19T11:38:11.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.399+0000 7f99a3a609c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T11:38:11.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.399+0000 7f99a3a609c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.403+0000 7f99a3a609c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:11.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.403+0000 7f99a3a609c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T11:38:11.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.403+0000 7f99a3a609c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T11:38:11.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.403+0000 7f99a3a609c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 : miss 2024-09-19T11:38:11.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.403+0000 7f99a3a609c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.403+0000 7f99a3a609c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:11.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.403+0000 7f99a3a609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 info.flags=0x17 2024-09-19T11:38:11.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.403+0000 7f99a3a609c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 to cache LRU end 2024-09-19T11:38:11.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.403+0000 7f99a3a609c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:38:11.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.403+0000 7f99a3a609c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T11:38:11.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.403+0000 7f99a3a609c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 2024-09-19T11:38:11.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.403+0000 7f99a3a609c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:11.413 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.407+0000 7f9857fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:11.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.415+0000 7f99a3a609c0 20 remove_watcher() i=0 2024-09-19T11:38:11.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.415+0000 7f99a3a609c0 2 removed watcher, disabling cache 2024-09-19T11:38:11.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.415+0000 7f99a3a609c0 20 remove_watcher() i=1 2024-09-19T11:38:11.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.419+0000 7f99a3a609c0 20 remove_watcher() i=2 2024-09-19T11:38:11.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.419+0000 7f99a3a609c0 20 remove_watcher() i=3 2024-09-19T11:38:11.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.423+0000 7f99a3a609c0 20 remove_watcher() i=4 2024-09-19T11:38:11.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.427+0000 7f99a3a609c0 20 remove_watcher() i=5 2024-09-19T11:38:11.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.427+0000 7f99a3a609c0 20 remove_watcher() i=6 2024-09-19T11:38:11.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.427+0000 7f99a3a609c0 20 remove_watcher() i=7 2024-09-19T11:38:11.449 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-19T11:38:11.479 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:11.480 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:11.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.519+0000 7f69be0529c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.519+0000 7f69be0529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.519+0000 7f69be0529c0 20 realm 2024-09-19T11:38:11.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.519+0000 7f69be0529c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.519+0000 7f69be0529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.519+0000 7f69be0529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:11.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.519+0000 7f69be0529c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.519+0000 7f69be0529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.519+0000 7f69be0529c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.523+0000 7f69be0529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:11.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.523+0000 7f69be0529c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.523+0000 7f69be0529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:11.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.523+0000 7f69be0529c0 20 searching for the correct realm 2024-09-19T11:38:11.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.527+0000 7f69bbb58640 0 -- 172.21.15.120:0/783590428 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f69b400e3c0 msgr2=0x7f69b400e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:38:11.748 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.743+0000 7f69bbb58640 0 -- 172.21.15.120:0/783590428 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f69b400e3c0 msgr2=0x7f69b400e7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:11.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.755+0000 7f69be0529c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:11.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.755+0000 7f69be0529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:11.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.755+0000 7f69be0529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:11.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.755+0000 7f69be0529c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:11.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.755+0000 7f69be0529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:11.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.755+0000 7f69be0529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:11.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.755+0000 7f69be0529c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.755+0000 7f69be0529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.755+0000 7f69be0529c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.755+0000 7f69be0529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:11.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.755+0000 7f69be0529c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.759+0000 7f69be0529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:11.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.759+0000 7f69be0529c0 20 zone default found 2024-09-19T11:38:11.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.759+0000 7f69be0529c0 4 Realm: () 2024-09-19T11:38:11.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.759+0000 7f69be0529c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:11.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.759+0000 7f69be0529c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:11.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.759+0000 7f69be0529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:11.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.759+0000 7f69be0529c0 20 zonegroup default 2024-09-19T11:38:11.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.759+0000 7f69be0529c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.759+0000 7f69be0529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.759+0000 7f69be0529c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.759+0000 7f69be0529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.759+0000 7f69be0529c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.759+0000 7f69be0529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.759+0000 7f69be0529c0 20 started sync module instance, tier type = 2024-09-19T11:38:11.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.759+0000 7f69be0529c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:11.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.787+0000 7f69be0529c0 20 add_watcher() i=0 2024-09-19T11:38:11.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.787+0000 7f69be0529c0 20 add_watcher() i=1 2024-09-19T11:38:11.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.787+0000 7f69be0529c0 20 add_watcher() i=2 2024-09-19T11:38:11.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.787+0000 7f69be0529c0 20 add_watcher() i=3 2024-09-19T11:38:11.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.787+0000 7f69be0529c0 20 add_watcher() i=4 2024-09-19T11:38:11.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.787+0000 7f69be0529c0 20 add_watcher() i=5 2024-09-19T11:38:11.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.787+0000 7f69be0529c0 20 add_watcher() i=6 2024-09-19T11:38:11.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.791+0000 7f69be0529c0 20 add_watcher() i=7 2024-09-19T11:38:11.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.791+0000 7f69be0529c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:11.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.795+0000 7f6871fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:11.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.795+0000 7f69be0529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:11.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.795+0000 7f69be0529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:11.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.795+0000 7f69be0529c0 5 note: GC not initialized 2024-09-19T11:38:11.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.795+0000 7f6870fe1640 20 reqs_thread_entry: start 2024-09-19T11:38:11.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.795+0000 7f69be0529c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:11.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.795+0000 7f69be0529c0 20 Filter name: none 2024-09-19T11:38:11.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.795+0000 7f67ea7fc640 20 reqs_thread_entry: start 2024-09-19T11:38:11.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.795+0000 7f69be0529c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.795+0000 7f69be0529c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:11.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.799+0000 7f69be0529c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.799+0000 7f69be0529c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:11.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.799+0000 7f69be0529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:11.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.799+0000 7f69be0529c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.799+0000 7f69be0529c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:11.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.799+0000 7f69be0529c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.799+0000 7f69be0529c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:11.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.799+0000 7f69be0529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:11.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.799+0000 7f6871fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:11.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.807+0000 7f69be0529c0 20 remove_watcher() i=0 2024-09-19T11:38:11.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.807+0000 7f69be0529c0 2 removed watcher, disabling cache 2024-09-19T11:38:11.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.807+0000 7f69be0529c0 20 remove_watcher() i=1 2024-09-19T11:38:11.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.811+0000 7f69be0529c0 20 remove_watcher() i=2 2024-09-19T11:38:11.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.815+0000 7f69be0529c0 20 remove_watcher() i=3 2024-09-19T11:38:11.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.815+0000 7f69be0529c0 20 remove_watcher() i=4 2024-09-19T11:38:11.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.819+0000 7f69be0529c0 20 remove_watcher() i=5 2024-09-19T11:38:11.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.819+0000 7f69be0529c0 20 remove_watcher() i=6 2024-09-19T11:38:11.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.823+0000 7f69be0529c0 20 remove_watcher() i=7 2024-09-19T11:38:11.844 INFO:tasks.workunit.client.0.smithi120.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 88, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-19T11:38:11.844 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-19T11:38:11.844 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:11.844 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-19T11:38:11.875 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:11.876 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:11.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.919+0000 7f57eb7829c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.919+0000 7f57eb7829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.919+0000 7f57eb7829c0 20 realm 2024-09-19T11:38:11.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.919+0000 7f57eb7829c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.919+0000 7f57eb7829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.919+0000 7f57eb7829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:11.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.919+0000 7f57eb7829c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.919+0000 7f57eb7829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:11.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.919+0000 7f57eb7829c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.923+0000 7f57eb7829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:11.927 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.923+0000 7f57eb7829c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:11.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.923+0000 7f57eb7829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:11.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.923+0000 7f57eb7829c0 20 searching for the correct realm 2024-09-19T11:38:11.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:11.923+0000 7f57e8a87640 0 -- 172.21.15.120:0/2576351253 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7f57dc046c20 msgr2=0x7f57dc05bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:12.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.135+0000 7f57e9a89640 0 -- 172.21.15.120:0/2576351253 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f57e001c040 msgr2=0x7f57e0038930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:12.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.155+0000 7f57eb7829c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:12.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.155+0000 7f57eb7829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:12.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.155+0000 7f57eb7829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:12.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.155+0000 7f57eb7829c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:12.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.155+0000 7f57eb7829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:12.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.155+0000 7f57eb7829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:12.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.155+0000 7f57eb7829c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:12.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.155+0000 7f57eb7829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:12.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.155+0000 7f57eb7829c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:12.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.155+0000 7f57eb7829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:12.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.155+0000 7f57eb7829c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:12.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.159+0000 7f57eb7829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:12.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.159+0000 7f57eb7829c0 20 zone default found 2024-09-19T11:38:12.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.159+0000 7f57eb7829c0 4 Realm: () 2024-09-19T11:38:12.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.159+0000 7f57eb7829c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:12.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.159+0000 7f57eb7829c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:12.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.159+0000 7f57eb7829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:12.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.159+0000 7f57eb7829c0 20 zonegroup default 2024-09-19T11:38:12.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.159+0000 7f57eb7829c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:12.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.159+0000 7f57eb7829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:12.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.159+0000 7f57eb7829c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:12.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.159+0000 7f57eb7829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:12.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.159+0000 7f57eb7829c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:12.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.159+0000 7f57eb7829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:12.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.159+0000 7f57eb7829c0 20 started sync module instance, tier type = 2024-09-19T11:38:12.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.159+0000 7f57eb7829c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:12.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.187+0000 7f57eb7829c0 20 add_watcher() i=0 2024-09-19T11:38:12.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.187+0000 7f57eb7829c0 20 add_watcher() i=1 2024-09-19T11:38:12.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.187+0000 7f57eb7829c0 20 add_watcher() i=2 2024-09-19T11:38:12.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.187+0000 7f57eb7829c0 20 add_watcher() i=3 2024-09-19T11:38:12.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.187+0000 7f57eb7829c0 20 add_watcher() i=4 2024-09-19T11:38:12.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.187+0000 7f57eb7829c0 20 add_watcher() i=5 2024-09-19T11:38:12.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.187+0000 7f57eb7829c0 20 add_watcher() i=6 2024-09-19T11:38:12.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.191+0000 7f57eb7829c0 20 add_watcher() i=7 2024-09-19T11:38:12.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.191+0000 7f57eb7829c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:12.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f569ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:12.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:12.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:12.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 5 note: GC not initialized 2024-09-19T11:38:12.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f569efe5640 20 reqs_thread_entry: start 2024-09-19T11:38:12.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:12.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 20 Filter name: none 2024-09-19T11:38:12.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f569cfe1640 20 reqs_thread_entry: start 2024-09-19T11:38:12.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T11:38:12.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:12.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:12.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T11:38:12.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T11:38:12.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 : miss 2024-09-19T11:38:12.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:12.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:12.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 info.flags=0x17 2024-09-19T11:38:12.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 to cache LRU end 2024-09-19T11:38:12.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:38:12.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T11:38:12.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.195+0000 7f57eb7829c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 2024-09-19T11:38:12.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.199+0000 7f57eb7829c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:12.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.199+0000 7f57eb7829c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-19T11:38:12.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.199+0000 7f57eb7829c0 1 NOTICE: finished all shards (0 entries found) 2024-09-19T11:38:12.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.199+0000 7f569ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:12.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.207+0000 7f57eb7829c0 20 remove_watcher() i=0 2024-09-19T11:38:12.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.207+0000 7f57eb7829c0 2 removed watcher, disabling cache 2024-09-19T11:38:12.212 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.207+0000 7f57eb7829c0 20 remove_watcher() i=1 2024-09-19T11:38:12.215 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.211+0000 7f57eb7829c0 20 remove_watcher() i=2 2024-09-19T11:38:12.217 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.211+0000 7f57eb7829c0 20 remove_watcher() i=3 2024-09-19T11:38:12.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.215+0000 7f57eb7829c0 20 remove_watcher() i=4 2024-09-19T11:38:12.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.215+0000 7f57eb7829c0 20 remove_watcher() i=5 2024-09-19T11:38:12.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.219+0000 7f57eb7829c0 20 remove_watcher() i=6 2024-09-19T11:38:12.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:12.219+0000 7f57eb7829c0 20 remove_watcher() i=7 2024-09-19T11:38:12.246 INFO:tasks.workunit.client.0.smithi120.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-19T11:38:12.693 INFO:tasks.workunit.client.0.smithi120.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-19T11:38:13.022 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:13.019+0000 7f5d56ffd640 0 --2- 172.21.15.120:0/179881789 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x7f5d40003a60 0x7f5d40003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-19T11:38:14.431 INFO:tasks.workunit.client.0.smithi120.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T11:38:14.431 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-19T11:38:14.467 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:14.467 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:14.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.691+0000 7f1764317640 0 --2- 172.21.15.120:0/2075542498 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x562a7a484750 0x562a7a5f12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-19T11:38:14.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.719+0000 7f17670129c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:14.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.719+0000 7f17670129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:14.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.719+0000 7f17670129c0 20 realm 2024-09-19T11:38:14.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.719+0000 7f17670129c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:14.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.719+0000 7f17670129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:14.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.719+0000 7f17670129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:14.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.719+0000 7f17670129c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:14.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.719+0000 7f17670129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:14.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.719+0000 7f17670129c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:14.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.723+0000 7f17670129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:14.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.723+0000 7f17670129c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:14.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.723+0000 7f17670129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:14.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.723+0000 7f17670129c0 20 searching for the correct realm 2024-09-19T11:38:14.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.723+0000 7f1764317640 0 -- 172.21.15.120:0/1612730689 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x562a7a6904f0 msgr2=0x7f1754077050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:38:14.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.935+0000 7f1765319640 0 -- 172.21.15.120:0/1612730689 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f174c0c2070 msgr2=0x7f174c0fa410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:14.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.955+0000 7f17670129c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:14.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.955+0000 7f17670129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:14.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.955+0000 7f17670129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:14.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.955+0000 7f17670129c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:14.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.955+0000 7f17670129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:14.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.955+0000 7f17670129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:14.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.955+0000 7f17670129c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:14.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.955+0000 7f17670129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:14.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.955+0000 7f17670129c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:14.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.955+0000 7f17670129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:14.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.955+0000 7f17670129c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:14.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.959+0000 7f17670129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:14.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.959+0000 7f17670129c0 20 zone default found 2024-09-19T11:38:14.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.959+0000 7f17670129c0 4 Realm: () 2024-09-19T11:38:14.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.959+0000 7f17670129c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:14.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.959+0000 7f17670129c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:14.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.959+0000 7f17670129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:14.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.959+0000 7f17670129c0 20 zonegroup default 2024-09-19T11:38:14.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.959+0000 7f17670129c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:14.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.959+0000 7f17670129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:14.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.959+0000 7f17670129c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:14.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.959+0000 7f17670129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:14.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.959+0000 7f17670129c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:14.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.959+0000 7f17670129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:14.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.959+0000 7f17670129c0 20 started sync module instance, tier type = 2024-09-19T11:38:14.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.959+0000 7f17670129c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:14.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.983+0000 7f17670129c0 20 add_watcher() i=0 2024-09-19T11:38:14.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.983+0000 7f17670129c0 20 add_watcher() i=1 2024-09-19T11:38:14.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.983+0000 7f17670129c0 20 add_watcher() i=2 2024-09-19T11:38:14.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.983+0000 7f17670129c0 20 add_watcher() i=3 2024-09-19T11:38:14.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.983+0000 7f17670129c0 20 add_watcher() i=4 2024-09-19T11:38:14.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.983+0000 7f17670129c0 20 add_watcher() i=5 2024-09-19T11:38:14.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.987+0000 7f17670129c0 20 add_watcher() i=6 2024-09-19T11:38:14.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.987+0000 7f17670129c0 20 add_watcher() i=7 2024-09-19T11:38:14.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.987+0000 7f17670129c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:14.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.991+0000 7f161b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:14.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.991+0000 7f17670129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:14.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.991+0000 7f17670129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:14.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.995+0000 7f17670129c0 5 note: GC not initialized 2024-09-19T11:38:14.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.995+0000 7f161a7e4640 20 reqs_thread_entry: start 2024-09-19T11:38:14.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.995+0000 7f17670129c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:14.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.995+0000 7f17670129c0 20 Filter name: none 2024-09-19T11:38:14.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.995+0000 7f16137fe640 20 reqs_thread_entry: start 2024-09-19T11:38:14.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.995+0000 7f17670129c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:14.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.995+0000 7f17670129c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:14.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.995+0000 7f17670129c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.995+0000 7f17670129c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:15.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.995+0000 7f17670129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:15.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.995+0000 7f17670129c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-19T11:38:15.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.995+0000 7f17670129c0 20 INFO: main: starting shard=0 2024-09-19T11:38:15.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.995+0000 7f17670129c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:15.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.995+0000 7f17670129c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-19T11:38:15.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.995+0000 7f17670129c0 20 INFO: main: done 2024-09-19T11:38:15.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:14.999+0000 7f161b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:15.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.003+0000 7f17670129c0 20 remove_watcher() i=0 2024-09-19T11:38:15.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.003+0000 7f17670129c0 2 removed watcher, disabling cache 2024-09-19T11:38:15.010 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.007+0000 7f17670129c0 20 remove_watcher() i=1 2024-09-19T11:38:15.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.007+0000 7f17670129c0 20 remove_watcher() i=2 2024-09-19T11:38:15.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.011+0000 7f17670129c0 20 remove_watcher() i=3 2024-09-19T11:38:15.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.011+0000 7f17670129c0 20 remove_watcher() i=4 2024-09-19T11:38:15.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.015+0000 7f17670129c0 20 remove_watcher() i=5 2024-09-19T11:38:15.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.015+0000 7f17670129c0 20 remove_watcher() i=6 2024-09-19T11:38:15.022 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.019+0000 7f17670129c0 20 remove_watcher() i=7 2024-09-19T11:38:15.111 INFO:tasks.workunit.client.0.smithi120.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T11:38:15.111 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-19T11:38:15.146 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:15.146 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:15.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.187+0000 7f04141299c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.191+0000 7f04141299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:15.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.191+0000 7f04141299c0 20 realm 2024-09-19T11:38:15.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.191+0000 7f04141299c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.191+0000 7f04141299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:15.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.191+0000 7f04141299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:15.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.191+0000 7f04141299c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.191+0000 7f04141299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:15.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.191+0000 7f04141299c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.196 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.191+0000 7f04141299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:15.196 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.191+0000 7f04141299c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.195+0000 7f04141299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:15.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.195+0000 7f04141299c0 20 searching for the correct realm 2024-09-19T11:38:15.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.195+0000 7f0412430640 0 -- 172.21.15.120:0/358604617 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f0408008040 msgr2=0x7f040804e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:15.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.411+0000 7f041142e640 0 -- 172.21.15.120:0/358604617 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f04040387b0 msgr2=0x7f0404071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:15.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:15.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:15.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:15.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:15.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:15.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:15.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:15.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:15.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:15.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 20 zone default found 2024-09-19T11:38:15.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 4 Realm: () 2024-09-19T11:38:15.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:15.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:15.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:15.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 20 zonegroup default 2024-09-19T11:38:15.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.631+0000 7f04141299c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.635+0000 7f04141299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:15.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.635+0000 7f04141299c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.635+0000 7f04141299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:15.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.635+0000 7f04141299c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.635+0000 7f04141299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:15.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.635+0000 7f04141299c0 20 started sync module instance, tier type = 2024-09-19T11:38:15.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.635+0000 7f04141299c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:15.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.663+0000 7f04141299c0 20 add_watcher() i=0 2024-09-19T11:38:15.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.663+0000 7f04141299c0 20 add_watcher() i=1 2024-09-19T11:38:15.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.663+0000 7f04141299c0 20 add_watcher() i=2 2024-09-19T11:38:15.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.663+0000 7f04141299c0 20 add_watcher() i=3 2024-09-19T11:38:15.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.663+0000 7f04141299c0 20 add_watcher() i=4 2024-09-19T11:38:15.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.663+0000 7f04141299c0 20 add_watcher() i=5 2024-09-19T11:38:15.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.663+0000 7f04141299c0 20 add_watcher() i=6 2024-09-19T11:38:15.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.663+0000 7f04141299c0 20 add_watcher() i=7 2024-09-19T11:38:15.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.663+0000 7f04141299c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:15.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.671+0000 7f02c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:15.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.671+0000 7f04141299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:15.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.671+0000 7f04141299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:15.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.671+0000 7f04141299c0 5 note: GC not initialized 2024-09-19T11:38:15.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.671+0000 7f02c27fc640 20 reqs_thread_entry: start 2024-09-19T11:38:15.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.671+0000 7f04141299c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:15.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.671+0000 7f04141299c0 20 Filter name: none 2024-09-19T11:38:15.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.671+0000 7f0233fff640 20 reqs_thread_entry: start 2024-09-19T11:38:15.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.671+0000 7f04141299c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.675+0000 7f04141299c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:15.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.675+0000 7f04141299c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.675+0000 7f04141299c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:15.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.675+0000 7f04141299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:15.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.675+0000 7f04141299c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-19T11:38:15.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.675+0000 7f04141299c0 20 INFO: main: starting shard=0 2024-09-19T11:38:15.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.675+0000 7f04141299c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:15.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.675+0000 7f04141299c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-19T11:38:15.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.675+0000 7f04141299c0 20 INFO: main: done 2024-09-19T11:38:15.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.675+0000 7f02c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:15.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.683+0000 7f04141299c0 20 remove_watcher() i=0 2024-09-19T11:38:15.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.683+0000 7f04141299c0 2 removed watcher, disabling cache 2024-09-19T11:38:15.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.683+0000 7f04141299c0 20 remove_watcher() i=1 2024-09-19T11:38:15.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.687+0000 7f04141299c0 20 remove_watcher() i=2 2024-09-19T11:38:15.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.691+0000 7f04141299c0 20 remove_watcher() i=3 2024-09-19T11:38:15.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.691+0000 7f04141299c0 20 remove_watcher() i=4 2024-09-19T11:38:15.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.695+0000 7f04141299c0 20 remove_watcher() i=5 2024-09-19T11:38:15.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.695+0000 7f04141299c0 20 remove_watcher() i=6 2024-09-19T11:38:15.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.695+0000 7f04141299c0 20 remove_watcher() i=7 2024-09-19T11:38:15.787 INFO:tasks.workunit.client.0.smithi120.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T11:38:15.787 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-19T11:38:15.822 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:15.822 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:15.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.863+0000 7f45a929e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.867+0000 7f45a929e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:15.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.867+0000 7f45a929e9c0 20 realm 2024-09-19T11:38:15.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.867+0000 7f45a929e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.867+0000 7f45a929e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:15.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.867+0000 7f45a929e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:15.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.867+0000 7f45a929e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.867+0000 7f45a929e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:15.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.867+0000 7f45a929e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.867+0000 7f45a929e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:15.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.867+0000 7f45a929e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:15.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.871+0000 7f45a929e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:15.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.871+0000 7f45a929e9c0 20 searching for the correct realm 2024-09-19T11:38:15.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.875+0000 7f45a75a5640 0 -- 172.21.15.120:0/780735033 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f459002d060 msgr2=0x7f4590003c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:15.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:15.879+0000 7f45a65a3640 0 -- 172.21.15.120:0/780735033 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f4598065cc0 msgr2=0x7f459806e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:16.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.095+0000 7f45a929e9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:16.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.095+0000 7f45a929e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:16.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.095+0000 7f45a929e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:16.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.095+0000 7f45a929e9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:16.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.095+0000 7f45a929e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:16.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.095+0000 7f45a929e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:16.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.095+0000 7f45a929e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.099+0000 7f45a929e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:16.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.099+0000 7f45a929e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.099+0000 7f45a929e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:16.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.099+0000 7f45a929e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.099+0000 7f45a929e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:16.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.099+0000 7f45a929e9c0 20 zone default found 2024-09-19T11:38:16.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.099+0000 7f45a929e9c0 4 Realm: () 2024-09-19T11:38:16.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.099+0000 7f45a929e9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:16.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.099+0000 7f45a929e9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:16.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.099+0000 7f45a929e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:16.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.099+0000 7f45a929e9c0 20 zonegroup default 2024-09-19T11:38:16.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.099+0000 7f45a929e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.099+0000 7f45a929e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:16.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.099+0000 7f45a929e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.103+0000 7f45a929e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:16.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.103+0000 7f45a929e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.103+0000 7f45a929e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:16.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.103+0000 7f45a929e9c0 20 started sync module instance, tier type = 2024-09-19T11:38:16.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.103+0000 7f45a929e9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:16.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.127+0000 7f45a929e9c0 20 add_watcher() i=0 2024-09-19T11:38:16.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.127+0000 7f45a929e9c0 20 add_watcher() i=1 2024-09-19T11:38:16.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.127+0000 7f45a929e9c0 20 add_watcher() i=2 2024-09-19T11:38:16.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.127+0000 7f45a929e9c0 20 add_watcher() i=3 2024-09-19T11:38:16.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.127+0000 7f45a929e9c0 20 add_watcher() i=4 2024-09-19T11:38:16.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.127+0000 7f45a929e9c0 20 add_watcher() i=5 2024-09-19T11:38:16.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.127+0000 7f45a929e9c0 20 add_watcher() i=6 2024-09-19T11:38:16.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.127+0000 7f45a929e9c0 20 add_watcher() i=7 2024-09-19T11:38:16.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.127+0000 7f45a929e9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:16.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.131+0000 7f445d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:16.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.135+0000 7f45a929e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:16.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.135+0000 7f45a929e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:16.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.135+0000 7f45a929e9c0 5 note: GC not initialized 2024-09-19T11:38:16.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.135+0000 7f43d7fff640 20 reqs_thread_entry: start 2024-09-19T11:38:16.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.135+0000 7f45a929e9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:16.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.135+0000 7f45a929e9c0 20 Filter name: none 2024-09-19T11:38:16.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.135+0000 7f43d5ffb640 20 reqs_thread_entry: start 2024-09-19T11:38:16.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.135+0000 7f45a929e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.135+0000 7f45a929e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:16.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.135+0000 7f45a929e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.135+0000 7f45a929e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:16.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.135+0000 7f45a929e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:16.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.135+0000 7f45a929e9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-19T11:38:16.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.135+0000 7f45a929e9c0 20 INFO: main: starting shard=0 2024-09-19T11:38:16.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.135+0000 7f45a929e9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:16.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.139+0000 7f45a929e9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T11:38:16.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.139+0000 7f45a929e9c0 20 INFO: main: done 2024-09-19T11:38:16.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.139+0000 7f445d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:16.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.143+0000 7f45a929e9c0 20 remove_watcher() i=0 2024-09-19T11:38:16.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.143+0000 7f45a929e9c0 2 removed watcher, disabling cache 2024-09-19T11:38:16.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.147+0000 7f45a929e9c0 20 remove_watcher() i=1 2024-09-19T11:38:16.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.147+0000 7f45a929e9c0 20 remove_watcher() i=2 2024-09-19T11:38:16.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.151+0000 7f45a929e9c0 20 remove_watcher() i=3 2024-09-19T11:38:16.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.155+0000 7f45a929e9c0 20 remove_watcher() i=4 2024-09-19T11:38:16.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.155+0000 7f45a929e9c0 20 remove_watcher() i=5 2024-09-19T11:38:16.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.155+0000 7f45a929e9c0 20 remove_watcher() i=6 2024-09-19T11:38:16.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.159+0000 7f45a929e9c0 20 remove_watcher() i=7 2024-09-19T11:38:16.243 INFO:tasks.workunit.client.0.smithi120.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T11:38:16.243 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-19T11:38:16.278 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:16.278 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:16.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.319+0000 7f3a6039b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.323+0000 7f3a6039b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:16.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.323+0000 7f3a6039b9c0 20 realm 2024-09-19T11:38:16.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.323+0000 7f3a6039b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.323+0000 7f3a6039b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:16.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.323+0000 7f3a6039b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:16.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.323+0000 7f3a6039b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.323+0000 7f3a6039b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:16.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.323+0000 7f3a6039b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.323+0000 7f3a6039b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:16.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.323+0000 7f3a6039b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.327+0000 7f3a6039b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:16.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.327+0000 7f3a6039b9c0 20 searching for the correct realm 2024-09-19T11:38:16.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.327+0000 7f3a5e6a2640 0 -- 172.21.15.120:0/774168099 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f3a4805cdb0 msgr2=0x7f3a480157c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:16.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.335+0000 7f3a5d6a0640 0 -- 172.21.15.120:0/774168099 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f3a5006fc20 msgr2=0x7f3a50097fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:16.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.551+0000 7f3a6039b9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:16.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.551+0000 7f3a6039b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:16.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.551+0000 7f3a6039b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:16.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.551+0000 7f3a6039b9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:16.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.551+0000 7f3a6039b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:16.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.551+0000 7f3a6039b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:16.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.551+0000 7f3a6039b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.555+0000 7f3a6039b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:16.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.555+0000 7f3a6039b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.555+0000 7f3a6039b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:16.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.555+0000 7f3a6039b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.555+0000 7f3a6039b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:16.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.555+0000 7f3a6039b9c0 20 zone default found 2024-09-19T11:38:16.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.555+0000 7f3a6039b9c0 4 Realm: () 2024-09-19T11:38:16.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.555+0000 7f3a6039b9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:16.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.555+0000 7f3a6039b9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:16.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.555+0000 7f3a6039b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:16.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.555+0000 7f3a6039b9c0 20 zonegroup default 2024-09-19T11:38:16.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.555+0000 7f3a6039b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.555+0000 7f3a6039b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:16.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.555+0000 7f3a6039b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.559+0000 7f3a6039b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:16.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.559+0000 7f3a6039b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.559+0000 7f3a6039b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:16.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.559+0000 7f3a6039b9c0 20 started sync module instance, tier type = 2024-09-19T11:38:16.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.559+0000 7f3a6039b9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:16.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.583+0000 7f3a6039b9c0 20 add_watcher() i=0 2024-09-19T11:38:16.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.583+0000 7f3a6039b9c0 20 add_watcher() i=1 2024-09-19T11:38:16.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.583+0000 7f3a6039b9c0 20 add_watcher() i=2 2024-09-19T11:38:16.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.583+0000 7f3a6039b9c0 20 add_watcher() i=3 2024-09-19T11:38:16.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.583+0000 7f3a6039b9c0 20 add_watcher() i=4 2024-09-19T11:38:16.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.583+0000 7f3a6039b9c0 20 add_watcher() i=5 2024-09-19T11:38:16.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.583+0000 7f3a6039b9c0 20 add_watcher() i=6 2024-09-19T11:38:16.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.587+0000 7f3a6039b9c0 20 add_watcher() i=7 2024-09-19T11:38:16.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.587+0000 7f3a6039b9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:16.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.591+0000 7f390f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:16.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.591+0000 7f3a6039b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:16.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.591+0000 7f3a6039b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:16.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.591+0000 7f3a6039b9c0 5 note: GC not initialized 2024-09-19T11:38:16.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.591+0000 7f390e7fc640 20 reqs_thread_entry: start 2024-09-19T11:38:16.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.591+0000 7f3a6039b9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:16.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.591+0000 7f3a6039b9c0 20 Filter name: none 2024-09-19T11:38:16.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.591+0000 7f387ffff640 20 reqs_thread_entry: start 2024-09-19T11:38:16.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.591+0000 7f3a6039b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.591+0000 7f3a6039b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:16.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.591+0000 7f3a6039b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:16.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.591+0000 7f3a6039b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:16.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.595+0000 7f3a6039b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:16.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.595+0000 7f3a6039b9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-19T11:38:16.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.595+0000 7f3a6039b9c0 20 INFO: main: starting shard=0 2024-09-19T11:38:16.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.595+0000 7f3a6039b9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:16.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.595+0000 7f3a6039b9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T11:38:16.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.595+0000 7f3a6039b9c0 20 INFO: main: done 2024-09-19T11:38:16.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.595+0000 7f390f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:16.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.599+0000 7f3a6039b9c0 20 remove_watcher() i=0 2024-09-19T11:38:16.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.599+0000 7f3a6039b9c0 2 removed watcher, disabling cache 2024-09-19T11:38:16.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.603+0000 7f3a6039b9c0 20 remove_watcher() i=1 2024-09-19T11:38:16.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.607+0000 7f3a6039b9c0 20 remove_watcher() i=2 2024-09-19T11:38:16.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.607+0000 7f3a6039b9c0 20 remove_watcher() i=3 2024-09-19T11:38:16.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.611+0000 7f3a6039b9c0 20 remove_watcher() i=4 2024-09-19T11:38:16.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.611+0000 7f3a6039b9c0 20 remove_watcher() i=5 2024-09-19T11:38:16.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.611+0000 7f3a6039b9c0 20 remove_watcher() i=6 2024-09-19T11:38:16.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:16.615+0000 7f3a6039b9c0 20 remove_watcher() i=7 2024-09-19T11:38:16.640 INFO:tasks.workunit.client.0.smithi120.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-19T11:38:17.076 INFO:tasks.workunit.client.0.smithi120.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-19T11:38:17.508 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-19T11:38:17.508 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:17.509 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-19T11:38:17.543 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:17.543 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:17.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.583+0000 7fbde54ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:17.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.583+0000 7fbde54ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:17.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.583+0000 7fbde54ae9c0 20 realm 2024-09-19T11:38:17.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.583+0000 7fbde54ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:17.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.583+0000 7fbde54ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:17.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.583+0000 7fbde54ae9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:17.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.583+0000 7fbde54ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:17.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.587+0000 7fbde54ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:17.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.587+0000 7fbde54ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:17.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.587+0000 7fbde54ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:17.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.587+0000 7fbde54ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:17.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.587+0000 7fbde54ae9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:17.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.587+0000 7fbde54ae9c0 20 searching for the correct realm 2024-09-19T11:38:17.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.591+0000 7fbde37b5640 0 -- 172.21.15.120:0/150856886 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fbdd80c8070 msgr2=0x7fbdd810b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:17.603 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.599+0000 7fbde27b3640 0 -- 172.21.15.120:0/150856886 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fbdd4008070 msgr2=0x7fbdd40646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:17.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.815+0000 7fbde54ae9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:17.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.815+0000 7fbde54ae9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:17.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.815+0000 7fbde54ae9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:17.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.815+0000 7fbde54ae9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:17.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.815+0000 7fbde54ae9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:17.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.815+0000 7fbde54ae9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:17.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.815+0000 7fbde54ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:17.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.815+0000 7fbde54ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:17.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.815+0000 7fbde54ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:17.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:17.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:17.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:17.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 20 zone default found 2024-09-19T11:38:17.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 4 Realm: () 2024-09-19T11:38:17.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:17.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:17.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:17.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 20 zonegroup default 2024-09-19T11:38:17.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:17.824 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:17.824 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:17.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:17.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:17.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:17.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 20 started sync module instance, tier type = 2024-09-19T11:38:17.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.819+0000 7fbde54ae9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:17.849 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.843+0000 7fbde54ae9c0 20 add_watcher() i=0 2024-09-19T11:38:17.849 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.843+0000 7fbde54ae9c0 20 add_watcher() i=1 2024-09-19T11:38:17.849 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.843+0000 7fbde54ae9c0 20 add_watcher() i=2 2024-09-19T11:38:17.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.843+0000 7fbde54ae9c0 20 add_watcher() i=3 2024-09-19T11:38:17.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.843+0000 7fbde54ae9c0 20 add_watcher() i=4 2024-09-19T11:38:17.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.843+0000 7fbde54ae9c0 20 add_watcher() i=5 2024-09-19T11:38:17.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.843+0000 7fbde54ae9c0 20 add_watcher() i=6 2024-09-19T11:38:17.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.847+0000 7fbde54ae9c0 20 add_watcher() i=7 2024-09-19T11:38:17.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.847+0000 7fbde54ae9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:17.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.851+0000 7fbc997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:17.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.851+0000 7fbde54ae9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:17.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.851+0000 7fbde54ae9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:17.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.851+0000 7fbde54ae9c0 5 note: GC not initialized 2024-09-19T11:38:17.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.851+0000 7fbc13fff640 20 reqs_thread_entry: start 2024-09-19T11:38:17.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.851+0000 7fbde54ae9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:17.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbde54ae9c0 20 Filter name: none 2024-09-19T11:38:17.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbc11ffb640 20 reqs_thread_entry: start 2024-09-19T11:38:17.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbde54ae9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T11:38:17.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbde54ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:17.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbde54ae9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:17.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbde54ae9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T11:38:17.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbde54ae9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T11:38:17.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbde54ae9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 : miss 2024-09-19T11:38:17.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbde54ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:17.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbde54ae9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:17.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbde54ae9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 info.flags=0x17 2024-09-19T11:38:17.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbde54ae9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 to cache LRU end 2024-09-19T11:38:17.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbde54ae9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:38:17.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbde54ae9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T11:38:17.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbde54ae9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 2024-09-19T11:38:17.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.855+0000 7fbde54ae9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:17.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.859+0000 7fbde54ae9c0 1 NOTICE: finished shard 0 (4 entries found) 2024-09-19T11:38:17.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.859+0000 7fbde54ae9c0 1 NOTICE: finished all shards (4 entries found) 2024-09-19T11:38:17.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.859+0000 7fbc997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:17.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.867+0000 7fbde54ae9c0 20 remove_watcher() i=0 2024-09-19T11:38:17.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.867+0000 7fbde54ae9c0 2 removed watcher, disabling cache 2024-09-19T11:38:17.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.871+0000 7fbde54ae9c0 20 remove_watcher() i=1 2024-09-19T11:38:17.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.871+0000 7fbde54ae9c0 20 remove_watcher() i=2 2024-09-19T11:38:17.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.875+0000 7fbde54ae9c0 20 remove_watcher() i=3 2024-09-19T11:38:17.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.875+0000 7fbde54ae9c0 20 remove_watcher() i=4 2024-09-19T11:38:17.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.879+0000 7fbde54ae9c0 20 remove_watcher() i=5 2024-09-19T11:38:17.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.879+0000 7fbde54ae9c0 20 remove_watcher() i=6 2024-09-19T11:38:17.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:17.879+0000 7fbde54ae9c0 20 remove_watcher() i=7 2024-09-19T11:38:17.901 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: unlinked entries are not listable 2024-09-19T11:38:17.902 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:17.909 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-19T11:38:17.909 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:18.007 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-19T11:38:18.007 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:18.007 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-19T11:38:18.047 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:18.047 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:18.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.087+0000 7f4a192639c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.091+0000 7f4a192639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:18.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.091+0000 7f4a192639c0 20 realm 2024-09-19T11:38:18.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.091+0000 7f4a192639c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.091+0000 7f4a192639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:18.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.091+0000 7f4a192639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:18.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.091+0000 7f4a192639c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.091+0000 7f4a192639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:18.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.091+0000 7f4a192639c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.091+0000 7f4a192639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:18.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.091+0000 7f4a192639c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.095+0000 7f4a192639c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:18.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.095+0000 7f4a192639c0 20 searching for the correct realm 2024-09-19T11:38:18.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.095+0000 7f4a1756a640 0 -- 172.21.15.120:0/394788159 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f4a0c073040 msgr2=0x7f4a0c067800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:18.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.103+0000 7f4a16568640 0 -- 172.21.15.120:0/394788159 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f4a0807fd10 msgr2=0x7f4a08071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:18.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.319+0000 7f4a192639c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:18.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.319+0000 7f4a192639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:18.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.319+0000 7f4a192639c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:18.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.319+0000 7f4a192639c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:18.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.319+0000 7f4a192639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:18.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.319+0000 7f4a192639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:18.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.319+0000 7f4a192639c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.319+0000 7f4a192639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:18.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.319+0000 7f4a192639c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.319+0000 7f4a192639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:18.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.319+0000 7f4a192639c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.323+0000 7f4a192639c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:18.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.323+0000 7f4a192639c0 20 zone default found 2024-09-19T11:38:18.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.323+0000 7f4a192639c0 4 Realm: () 2024-09-19T11:38:18.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.323+0000 7f4a192639c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:18.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.323+0000 7f4a192639c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:18.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.323+0000 7f4a192639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:18.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.323+0000 7f4a192639c0 20 zonegroup default 2024-09-19T11:38:18.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.323+0000 7f4a192639c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.323+0000 7f4a192639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:18.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.323+0000 7f4a192639c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.323+0000 7f4a192639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:18.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.323+0000 7f4a192639c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.323+0000 7f4a192639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:18.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.323+0000 7f4a192639c0 20 started sync module instance, tier type = 2024-09-19T11:38:18.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.323+0000 7f4a192639c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:18.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.351+0000 7f4a192639c0 20 add_watcher() i=0 2024-09-19T11:38:18.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.351+0000 7f4a192639c0 20 add_watcher() i=1 2024-09-19T11:38:18.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.351+0000 7f4a192639c0 20 add_watcher() i=2 2024-09-19T11:38:18.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.351+0000 7f4a192639c0 20 add_watcher() i=3 2024-09-19T11:38:18.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.351+0000 7f4a192639c0 20 add_watcher() i=4 2024-09-19T11:38:18.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.351+0000 7f4a192639c0 20 add_watcher() i=5 2024-09-19T11:38:18.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.351+0000 7f4a192639c0 20 add_watcher() i=6 2024-09-19T11:38:18.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.351+0000 7f4a192639c0 20 add_watcher() i=7 2024-09-19T11:38:18.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.351+0000 7f4a192639c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:18.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.355+0000 7f48cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:18.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:18.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:18.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 5 note: GC not initialized 2024-09-19T11:38:18.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4847fff640 20 reqs_thread_entry: start 2024-09-19T11:38:18.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:18.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 20 Filter name: none 2024-09-19T11:38:18.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4845ffb640 20 reqs_thread_entry: start 2024-09-19T11:38:18.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T11:38:18.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:18.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T11:38:18.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T11:38:18.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 : miss 2024-09-19T11:38:18.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:18.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 info.flags=0x17 2024-09-19T11:38:18.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 to cache LRU end 2024-09-19T11:38:18.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:38:18.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T11:38:18.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 2024-09-19T11:38:18.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.359+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.363+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.363+0000 7f4a192639c0 20 get_obj_state: octx=0x5590bdfcdea0 obj=check-bucket:c state=0x5590be2833d8 s->prefetch_data=0 2024-09-19T11:38:18.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.363+0000 7f4a192639c0 20 get_obj_state: setting s->obj_tag to i9798pyu5ely2ej4f511v95lv2lz1yxt 2024-09-19T11:38:18.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.363+0000 7f4a192639c0 20 get_obj_state_impl: setting s->olh_tag to 2qibrqbl62k4mupex6yxy8qe90obfwus 2024-09-19T11:38:18.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.363+0000 7f4a192639c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2qibrqbl62k4mupex6yxy8qe90obfwus 2024-09-19T11:38:18.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.363+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.367+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.367+0000 7f4a192639c0 20 olh_log_entry: epoch=3 op=3 key=c[VVPMelvXyaL-eIwplflLn-j8POsGefP] 2024-09-19T11:38:18.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.367+0000 7f4a192639c0 20 get_obj_state: octx=0x5590bdfcdea0 obj=check-bucket:_:VVPMelvXyaL-eIwplflLn-j8POsGefP_c state=0x5590be27d968 s->prefetch_data=0 2024-09-19T11:38:18.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.367+0000 7f4a192639c0 10 manifest: total_size = 11 2024-09-19T11:38:18.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.367+0000 7f4a192639c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11195961537334502824 2024-09-19T11:38:18.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.367+0000 7f4a192639c0 20 get_obj_state: octx=0x5590bdfcdea0 obj=check-bucket:_:VVPMelvXyaL-eIwplflLn-j8POsGefP_c state=0x5590be27d968 s->prefetch_data=0 2024-09-19T11:38:18.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.367+0000 7f4a192639c0 20 prepare_atomic_modification: state is not atomic. state=0x5590be27d968 2024-09-19T11:38:18.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.367+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.375+0000 7f4a192639c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:38:18.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.375+0000 7f4a192639c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-19T11:38:18.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.375+0000 7f4a192639c0 0 deleting objects inline since gc isn't initialized 2024-09-19T11:38:18.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.375+0000 7f4a192639c0 5 delete_objs_inline: removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2__shadow:VVPMelvXyaL-eIwplflLn-j8POsGefP_.9VuSYb4GDpv94_PKsTPzbYNwbR18sfs_0 2024-09-19T11:38:18.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.375+0000 7f48fa7fc640 20 handle_completion(): completion ok for obj=c[VVPMelvXyaL-eIwplflLn-j8POsGefP] 2024-09-19T11:38:18.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.375+0000 7f4a192639c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T11:38:18.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.379+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.379+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.383+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.383+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.383+0000 7f4a192639c0 20 get_obj_state: octx=0x5590bdfcdea0 obj=check-bucket:d state=0x5590be2833d8 s->prefetch_data=0 2024-09-19T11:38:18.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.383+0000 7f4a192639c0 20 get_obj_state: setting s->obj_tag to 4zcea058pg8d7rjxwjruj30lvmm981m0 2024-09-19T11:38:18.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.383+0000 7f4a192639c0 20 get_obj_state_impl: setting s->olh_tag to ewt5mwn4czgtvrqmsqd6alitbt5zzb4k 2024-09-19T11:38:18.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.383+0000 7f4a192639c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ewt5mwn4czgtvrqmsqd6alitbt5zzb4k 2024-09-19T11:38:18.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.387+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.387+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.387+0000 7f4a192639c0 20 olh_log_entry: epoch=3 op=3 key=d[TzVL98lz4nZdbQvDdHl06ucIlZNF3wE] 2024-09-19T11:38:18.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.387+0000 7f4a192639c0 20 get_obj_state: octx=0x5590bdfcdea0 obj=check-bucket:_:TzVL98lz4nZdbQvDdHl06ucIlZNF3wE_d state=0x5590be2802e8 s->prefetch_data=0 2024-09-19T11:38:18.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.387+0000 7f4a192639c0 10 manifest: total_size = 12 2024-09-19T11:38:18.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.387+0000 7f4a192639c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12974474987953246362 2024-09-19T11:38:18.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.387+0000 7f4a192639c0 20 get_obj_state: octx=0x5590bdfcdea0 obj=check-bucket:_:TzVL98lz4nZdbQvDdHl06ucIlZNF3wE_d state=0x5590be2802e8 s->prefetch_data=0 2024-09-19T11:38:18.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.387+0000 7f4a192639c0 20 prepare_atomic_modification: state is not atomic. state=0x5590be2802e8 2024-09-19T11:38:18.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.387+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.391+0000 7f4a192639c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:38:18.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.391+0000 7f4a192639c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-19T11:38:18.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.391+0000 7f4a192639c0 0 deleting objects inline since gc isn't initialized 2024-09-19T11:38:18.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.391+0000 7f4a192639c0 5 delete_objs_inline: removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2__shadow:TzVL98lz4nZdbQvDdHl06ucIlZNF3wE_.kYnLbpE3O4YZ34_pyG4qzKwXDKP4jA0_0 2024-09-19T11:38:18.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.395+0000 7f4a192639c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T11:38:18.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.395+0000 7f48f9ffb640 20 handle_completion(): completion ok for obj=d[TzVL98lz4nZdbQvDdHl06ucIlZNF3wE] 2024-09-19T11:38:18.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.399+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.399+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.399+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.399+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.403+0000 7f4a192639c0 20 get_obj_state: octx=0x5590bdfcdea0 obj=check-bucket:e state=0x5590be282ec8 s->prefetch_data=0 2024-09-19T11:38:18.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.403+0000 7f4a192639c0 20 get_obj_state: setting s->obj_tag to hhfr69u1pechf2zx7f833jbrwamuvo3p 2024-09-19T11:38:18.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.403+0000 7f4a192639c0 20 get_obj_state_impl: setting s->olh_tag to 72qnq9rwbak07prh7tmp7ntrf9xvtzcq 2024-09-19T11:38:18.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.403+0000 7f4a192639c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=72qnq9rwbak07prh7tmp7ntrf9xvtzcq 2024-09-19T11:38:18.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.407+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.411+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.411+0000 7f4a192639c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-19T11:38:18.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.411+0000 7f4a192639c0 20 olh_log_entry: epoch=2 op=3 key=e[-eKB.KqiaLzfOWD7KeRsME6VDfD2Gvg] 2024-09-19T11:38:18.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.411+0000 7f4a192639c0 20 get_obj_state: octx=0x5590bdfcdea0 obj=check-bucket:_:-eKB.KqiaLzfOWD7KeRsME6VDfD2Gvg_e state=0x5590be2812f8 s->prefetch_data=0 2024-09-19T11:38:18.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.411+0000 7f4a192639c0 10 manifest: total_size = 22 2024-09-19T11:38:18.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.411+0000 7f4a192639c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17973850360557269851 2024-09-19T11:38:18.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.411+0000 7f4a192639c0 20 get_obj_state: octx=0x5590bdfcdea0 obj=check-bucket:_:-eKB.KqiaLzfOWD7KeRsME6VDfD2Gvg_e state=0x5590be2812f8 s->prefetch_data=0 2024-09-19T11:38:18.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.411+0000 7f4a192639c0 20 prepare_atomic_modification: state is not atomic. state=0x5590be2812f8 2024-09-19T11:38:18.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.411+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.419+0000 7f4a192639c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:38:18.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.419+0000 7f4a192639c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-19T11:38:18.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.419+0000 7f4a192639c0 0 deleting objects inline since gc isn't initialized 2024-09-19T11:38:18.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.419+0000 7f4a192639c0 5 delete_objs_inline: removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2__shadow:-eKB.KqiaLzfOWD7KeRsME6VDfD2Gvg_.rp8tM7bN-_R-5kpYj7CVc6V2qilwqOK_0 2024-09-19T11:38:18.428 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.423+0000 7f4a192639c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T11:38:18.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.427+0000 7f48f9ffb640 20 handle_completion(): completion ok for obj=e[-eKB.KqiaLzfOWD7KeRsME6VDfD2Gvg] 2024-09-19T11:38:18.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.427+0000 7f4a192639c0 20 get_obj_state: octx=0x5590bdfcdea0 obj=check-bucket:e state=0x5590be282ec8 s->prefetch_data=0 2024-09-19T11:38:18.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.427+0000 7f4a192639c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=72qnq9rwbak07prh7tmp7ntrf9xvtzcq 2024-09-19T11:38:18.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.439+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.443+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.443+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.443+0000 7f4a192639c0 20 get_obj_state: octx=0x5590bdfcdea0 obj=check-bucket:f state=0x5590be282ec8 s->prefetch_data=0 2024-09-19T11:38:18.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.443+0000 7f4a192639c0 20 get_obj_state: setting s->obj_tag to uhgf3z52sv9uoqf81g8qywydc0qi1u5k 2024-09-19T11:38:18.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.443+0000 7f4a192639c0 20 get_obj_state_impl: setting s->olh_tag to lom4l3300l73ywl7y74dzfu19jngu0v9 2024-09-19T11:38:18.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.443+0000 7f4a192639c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lom4l3300l73ywl7y74dzfu19jngu0v9 2024-09-19T11:38:18.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.447+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.451+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.451+0000 7f4a192639c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-19T11:38:18.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.451+0000 7f4a192639c0 20 olh_log_entry: epoch=2 op=3 key=f[d7FM5D22Yv.WWD5cL-9m2FBJaS2Hq2o] 2024-09-19T11:38:18.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.451+0000 7f4a192639c0 20 get_obj_state: octx=0x5590bdfcdea0 obj=check-bucket:_:d7FM5D22Yv.WWD5cL-9m2FBJaS2Hq2o_f state=0x5590be2ae428 s->prefetch_data=0 2024-09-19T11:38:18.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.451+0000 7f4a192639c0 10 manifest: total_size = 22 2024-09-19T11:38:18.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.451+0000 7f4a192639c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8906485834895600979 2024-09-19T11:38:18.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.451+0000 7f4a192639c0 20 get_obj_state: octx=0x5590bdfcdea0 obj=check-bucket:_:d7FM5D22Yv.WWD5cL-9m2FBJaS2Hq2o_f state=0x5590be2ae428 s->prefetch_data=0 2024-09-19T11:38:18.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.451+0000 7f4a192639c0 20 prepare_atomic_modification: state is not atomic. state=0x5590be2ae428 2024-09-19T11:38:18.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.451+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.455+0000 7f4a192639c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:38:18.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.455+0000 7f4a192639c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-19T11:38:18.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.455+0000 7f4a192639c0 0 deleting objects inline since gc isn't initialized 2024-09-19T11:38:18.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.455+0000 7f4a192639c0 5 delete_objs_inline: removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2__shadow:d7FM5D22Yv.WWD5cL-9m2FBJaS2Hq2o_.VEPdq9tTKoW0Iu9d0x9XO-cBS7dZ7Xj_0 2024-09-19T11:38:18.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.459+0000 7f48fa7fc640 20 handle_completion(): completion ok for obj=f[d7FM5D22Yv.WWD5cL-9m2FBJaS2Hq2o] 2024-09-19T11:38:18.467 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.463+0000 7f4a192639c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T11:38:18.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.463+0000 7f4a192639c0 20 get_obj_state: octx=0x5590bdfcdea0 obj=check-bucket:f state=0x5590be282ec8 s->prefetch_data=0 2024-09-19T11:38:18.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.463+0000 7f4a192639c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lom4l3300l73ywl7y74dzfu19jngu0v9 2024-09-19T11:38:18.479 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.475+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.479+0000 7f4a192639c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.479+0000 7f4a192639c0 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-19T11:38:18.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.479+0000 7f4a192639c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-19T11:38:18.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.479+0000 7f48cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:18.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.483+0000 7f4a192639c0 20 remove_watcher() i=0 2024-09-19T11:38:18.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.483+0000 7f4a192639c0 2 removed watcher, disabling cache 2024-09-19T11:38:18.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.487+0000 7f4a192639c0 20 remove_watcher() i=1 2024-09-19T11:38:18.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.487+0000 7f4a192639c0 20 remove_watcher() i=2 2024-09-19T11:38:18.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.491+0000 7f4a192639c0 20 remove_watcher() i=3 2024-09-19T11:38:18.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.495+0000 7f4a192639c0 20 remove_watcher() i=4 2024-09-19T11:38:18.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.495+0000 7f4a192639c0 20 remove_watcher() i=5 2024-09-19T11:38:18.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.499+0000 7f4a192639c0 20 remove_watcher() i=6 2024-09-19T11:38:18.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.499+0000 7f4a192639c0 20 remove_watcher() i=7 2024-09-19T11:38:18.541 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-19T11:38:18.541 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:18.617 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-19T11:38:18.617 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:18.618 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-19T11:38:18.656 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:18.656 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:18.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.699+0000 7fdacecca9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.699+0000 7fdacecca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:18.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.699+0000 7fdacecca9c0 20 realm 2024-09-19T11:38:18.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.699+0000 7fdacecca9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.699+0000 7fdacecca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:18.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.699+0000 7fdacecca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:18.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.699+0000 7fdacecca9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.699+0000 7fdacecca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:18.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.699+0000 7fdacecca9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.703+0000 7fdacecca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:18.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.703+0000 7fdacecca9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.703+0000 7fdacecca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:18.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.703+0000 7fdacecca9c0 20 searching for the correct realm 2024-09-19T11:38:18.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.703+0000 7fdacbfcf640 0 -- 172.21.15.120:0/1034961922 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7fdabc037060 msgr2=0x7fdabc06d4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:38:18.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.915+0000 7fdacbfcf640 0 -- 172.21.15.120:0/1034961922 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7fdabc037060 msgr2=0x7fdabc06d4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:38:18.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.935+0000 7fdacecca9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:18.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.935+0000 7fdacecca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:18.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.935+0000 7fdacecca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:18.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.935+0000 7fdacecca9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:18.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.935+0000 7fdacecca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:18.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.935+0000 7fdacecca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:18.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.935+0000 7fdacecca9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.935+0000 7fdacecca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:18.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.935+0000 7fdacecca9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.935+0000 7fdacecca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:18.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.935+0000 7fdacecca9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.939+0000 7fdacecca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:18.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.939+0000 7fdacecca9c0 20 zone default found 2024-09-19T11:38:18.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.939+0000 7fdacecca9c0 4 Realm: () 2024-09-19T11:38:18.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.939+0000 7fdacecca9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:18.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.939+0000 7fdacecca9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:18.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.939+0000 7fdacecca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:18.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.939+0000 7fdacecca9c0 20 zonegroup default 2024-09-19T11:38:18.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.939+0000 7fdacecca9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.939+0000 7fdacecca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:18.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.939+0000 7fdacecca9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.939+0000 7fdacecca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:18.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.939+0000 7fdacecca9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.939+0000 7fdacecca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:18.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.939+0000 7fdacecca9c0 20 started sync module instance, tier type = 2024-09-19T11:38:18.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.939+0000 7fdacecca9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:18.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.967+0000 7fdacecca9c0 20 add_watcher() i=0 2024-09-19T11:38:18.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.967+0000 7fdacecca9c0 20 add_watcher() i=1 2024-09-19T11:38:18.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.967+0000 7fdacecca9c0 20 add_watcher() i=2 2024-09-19T11:38:18.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.967+0000 7fdacecca9c0 20 add_watcher() i=3 2024-09-19T11:38:18.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.967+0000 7fdacecca9c0 20 add_watcher() i=4 2024-09-19T11:38:18.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.967+0000 7fdacecca9c0 20 add_watcher() i=5 2024-09-19T11:38:18.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.967+0000 7fdacecca9c0 20 add_watcher() i=6 2024-09-19T11:38:18.976 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.971+0000 7fdacecca9c0 20 add_watcher() i=7 2024-09-19T11:38:18.976 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.971+0000 7fdacecca9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:18.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.975+0000 7fd982fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:18.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.975+0000 7fdacecca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:18.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.975+0000 7fdacecca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:18.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.975+0000 7fdacecca9c0 5 note: GC not initialized 2024-09-19T11:38:18.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.975+0000 7fd981fdb640 20 reqs_thread_entry: start 2024-09-19T11:38:18.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.975+0000 7fdacecca9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:18.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.975+0000 7fdacecca9c0 20 Filter name: none 2024-09-19T11:38:18.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.975+0000 7fd8f37fe640 20 reqs_thread_entry: start 2024-09-19T11:38:18.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.975+0000 7fdacecca9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T11:38:18.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.975+0000 7fdacecca9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.975+0000 7fdacecca9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:18.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.975+0000 7fdacecca9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T11:38:18.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.975+0000 7fdacecca9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T11:38:18.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.975+0000 7fdacecca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 : miss 2024-09-19T11:38:18.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.975+0000 7fdacecca9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:18.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.979+0000 7fdacecca9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:18.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.979+0000 7fdacecca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 info.flags=0x17 2024-09-19T11:38:18.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.979+0000 7fdacecca9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 to cache LRU end 2024-09-19T11:38:18.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.979+0000 7fdacecca9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:38:18.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.979+0000 7fdacecca9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T11:38:18.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.979+0000 7fdacecca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 2024-09-19T11:38:18.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.979+0000 7fdacecca9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:18.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.979+0000 7fdacecca9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-19T11:38:18.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.979+0000 7fdacecca9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-19T11:38:18.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.979+0000 7fd982fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:18.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.987+0000 7fdacecca9c0 20 remove_watcher() i=0 2024-09-19T11:38:18.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.987+0000 7fdacecca9c0 2 removed watcher, disabling cache 2024-09-19T11:38:18.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.987+0000 7fdacecca9c0 20 remove_watcher() i=1 2024-09-19T11:38:18.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.991+0000 7fdacecca9c0 20 remove_watcher() i=2 2024-09-19T11:38:18.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.991+0000 7fdacecca9c0 20 remove_watcher() i=3 2024-09-19T11:38:19.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.995+0000 7fdacecca9c0 20 remove_watcher() i=4 2024-09-19T11:38:19.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:18.999+0000 7fdacecca9c0 20 remove_watcher() i=5 2024-09-19T11:38:19.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.003+0000 7fdacecca9c0 20 remove_watcher() i=6 2024-09-19T11:38:19.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.003+0000 7fdacecca9c0 20 remove_watcher() i=7 2024-09-19T11:38:19.084 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-19T11:38:19.117 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:19.117 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:19.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.159+0000 7fb29ffa19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.159+0000 7fb29ffa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.159+0000 7fb29ffa19c0 20 realm 2024-09-19T11:38:19.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.159+0000 7fb29ffa19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.159+0000 7fb29ffa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.159+0000 7fb29ffa19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:19.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.159+0000 7fb29ffa19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.159+0000 7fb29ffa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.159+0000 7fb29ffa19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.163+0000 7fb29ffa19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:19.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.163+0000 7fb29ffa19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.169 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.163+0000 7fb29ffa19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:19.169 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.163+0000 7fb29ffa19c0 20 searching for the correct realm 2024-09-19T11:38:19.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.167+0000 7fb29e2a8640 0 -- 172.21.15.120:0/2409921640 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fb28800e070 msgr2=0x7fb288041950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:19.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.379+0000 7fb29d2a6640 0 -- 172.21.15.120:0/2409921640 >> [v2:172.21.15.151:6824/1967784835,v1:172.21.15.151:6825/1967784835] conn(0x564dda585520 msgr2=0x564dda5879b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:38:19.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.395+0000 7fb29ffa19c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:19.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.395+0000 7fb29ffa19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:19.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.395+0000 7fb29ffa19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:19.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.395+0000 7fb29ffa19c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:19.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.395+0000 7fb29ffa19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:19.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.395+0000 7fb29ffa19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:19.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.395+0000 7fb29ffa19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.395+0000 7fb29ffa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.395+0000 7fb29ffa19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.395+0000 7fb29ffa19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:19.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.395+0000 7fb29ffa19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.399+0000 7fb29ffa19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:19.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.399+0000 7fb29ffa19c0 20 zone default found 2024-09-19T11:38:19.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.399+0000 7fb29ffa19c0 4 Realm: () 2024-09-19T11:38:19.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.399+0000 7fb29ffa19c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:19.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.399+0000 7fb29ffa19c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:19.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.399+0000 7fb29ffa19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:19.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.399+0000 7fb29ffa19c0 20 zonegroup default 2024-09-19T11:38:19.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.399+0000 7fb29ffa19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.399+0000 7fb29ffa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.399+0000 7fb29ffa19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.399+0000 7fb29ffa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.399+0000 7fb29ffa19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.399+0000 7fb29ffa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.399+0000 7fb29ffa19c0 20 started sync module instance, tier type = 2024-09-19T11:38:19.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.399+0000 7fb29ffa19c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:19.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.423+0000 7fb29ffa19c0 20 add_watcher() i=0 2024-09-19T11:38:19.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.423+0000 7fb29ffa19c0 20 add_watcher() i=1 2024-09-19T11:38:19.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.423+0000 7fb29ffa19c0 20 add_watcher() i=2 2024-09-19T11:38:19.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.423+0000 7fb29ffa19c0 20 add_watcher() i=3 2024-09-19T11:38:19.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.423+0000 7fb29ffa19c0 20 add_watcher() i=4 2024-09-19T11:38:19.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.423+0000 7fb29ffa19c0 20 add_watcher() i=5 2024-09-19T11:38:19.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.423+0000 7fb29ffa19c0 20 add_watcher() i=6 2024-09-19T11:38:19.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.427+0000 7fb29ffa19c0 20 add_watcher() i=7 2024-09-19T11:38:19.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.427+0000 7fb29ffa19c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:19.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.431+0000 7fb152fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:19.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.431+0000 7fb29ffa19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:19.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.431+0000 7fb29ffa19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:19.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.431+0000 7fb29ffa19c0 5 note: GC not initialized 2024-09-19T11:38:19.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.431+0000 7fb29ffa19c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:19.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.431+0000 7fb29ffa19c0 20 Filter name: none 2024-09-19T11:38:19.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.431+0000 7fb151fe3640 20 reqs_thread_entry: start 2024-09-19T11:38:19.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.431+0000 7fb0cb7fe640 20 reqs_thread_entry: start 2024-09-19T11:38:19.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.431+0000 7fb29ffa19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.435+0000 7fb29ffa19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:19.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.435+0000 7fb29ffa19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.435+0000 7fb29ffa19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:19.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.435+0000 7fb29ffa19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:19.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.435+0000 7fb29ffa19c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-19T11:38:19.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.435+0000 7fb29ffa19c0 20 INFO: main: starting shard=0 2024-09-19T11:38:19.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.435+0000 7fb29ffa19c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:19.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.435+0000 7fb29ffa19c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-19T11:38:19.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.435+0000 7fb29ffa19c0 20 INFO: main: done 2024-09-19T11:38:19.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.435+0000 7fb152fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:19.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.443+0000 7fb29ffa19c0 20 remove_watcher() i=0 2024-09-19T11:38:19.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.443+0000 7fb29ffa19c0 2 removed watcher, disabling cache 2024-09-19T11:38:19.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.443+0000 7fb29ffa19c0 20 remove_watcher() i=1 2024-09-19T11:38:19.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.447+0000 7fb29ffa19c0 20 remove_watcher() i=2 2024-09-19T11:38:19.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.447+0000 7fb29ffa19c0 20 remove_watcher() i=3 2024-09-19T11:38:19.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.451+0000 7fb29ffa19c0 20 remove_watcher() i=4 2024-09-19T11:38:19.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.451+0000 7fb29ffa19c0 20 remove_watcher() i=5 2024-09-19T11:38:19.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.455+0000 7fb29ffa19c0 20 remove_watcher() i=6 2024-09-19T11:38:19.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.455+0000 7fb29ffa19c0 20 remove_watcher() i=7 2024-09-19T11:38:19.476 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-19T11:38:19.506 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:19.506 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:19.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.547+0000 7f090657d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.547+0000 7f090657d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.547+0000 7f090657d9c0 20 realm 2024-09-19T11:38:19.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.547+0000 7f090657d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.547+0000 7f090657d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.547+0000 7f090657d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:19.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.547+0000 7f090657d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.547+0000 7f090657d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.547+0000 7f090657d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.551+0000 7f090657d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:19.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.551+0000 7f090657d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.551+0000 7f090657d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:19.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.551+0000 7f090657d9c0 20 searching for the correct realm 2024-09-19T11:38:19.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.555+0000 7f0904083640 0 -- 172.21.15.120:0/3223532165 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f08fc047020 msgr2=0x7f08fc032910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:38:19.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.771+0000 7f0904083640 0 -- 172.21.15.120:0/3223532165 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f08fc047020 msgr2=0x7f08fc032910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:19.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.783+0000 7f090657d9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:19.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.783+0000 7f090657d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:19.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.783+0000 7f090657d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:19.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.783+0000 7f090657d9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:19.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.783+0000 7f090657d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:19.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.783+0000 7f090657d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:19.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.783+0000 7f090657d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.783+0000 7f090657d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.783+0000 7f090657d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.783+0000 7f090657d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:19.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.783+0000 7f090657d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.787+0000 7f090657d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:19.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.787+0000 7f090657d9c0 20 zone default found 2024-09-19T11:38:19.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.787+0000 7f090657d9c0 4 Realm: () 2024-09-19T11:38:19.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.787+0000 7f090657d9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:19.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.787+0000 7f090657d9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:19.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.787+0000 7f090657d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:19.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.787+0000 7f090657d9c0 20 zonegroup default 2024-09-19T11:38:19.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.787+0000 7f090657d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.787+0000 7f090657d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.787+0000 7f090657d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.787+0000 7f090657d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.787+0000 7f090657d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.787+0000 7f090657d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.787+0000 7f090657d9c0 20 started sync module instance, tier type = 2024-09-19T11:38:19.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.787+0000 7f090657d9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:19.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.811+0000 7f090657d9c0 20 add_watcher() i=0 2024-09-19T11:38:19.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.811+0000 7f090657d9c0 20 add_watcher() i=1 2024-09-19T11:38:19.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.811+0000 7f090657d9c0 20 add_watcher() i=2 2024-09-19T11:38:19.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.811+0000 7f090657d9c0 20 add_watcher() i=3 2024-09-19T11:38:19.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.811+0000 7f090657d9c0 20 add_watcher() i=4 2024-09-19T11:38:19.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.811+0000 7f090657d9c0 20 add_watcher() i=5 2024-09-19T11:38:19.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.811+0000 7f090657d9c0 20 add_watcher() i=6 2024-09-19T11:38:19.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.815+0000 7f090657d9c0 20 add_watcher() i=7 2024-09-19T11:38:19.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.815+0000 7f090657d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:19.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.819+0000 7f07bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:19.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.823+0000 7f090657d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:19.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.823+0000 7f090657d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:19.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.823+0000 7f090657d9c0 5 note: GC not initialized 2024-09-19T11:38:19.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.823+0000 7f07b9fdb640 20 reqs_thread_entry: start 2024-09-19T11:38:19.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.823+0000 7f090657d9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:19.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.823+0000 7f090657d9c0 20 Filter name: none 2024-09-19T11:38:19.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.823+0000 7f072b7fe640 20 reqs_thread_entry: start 2024-09-19T11:38:19.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.823+0000 7f090657d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.823+0000 7f090657d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:19.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.823+0000 7f090657d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.823+0000 7f090657d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:19.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.823+0000 7f090657d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:19.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.823+0000 7f090657d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-19T11:38:19.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.823+0000 7f090657d9c0 20 INFO: main: starting shard=0 2024-09-19T11:38:19.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.823+0000 7f090657d9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:19.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.827+0000 7f090657d9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-19T11:38:19.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.827+0000 7f090657d9c0 20 INFO: main: done 2024-09-19T11:38:19.832 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.827+0000 7f07bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:19.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.831+0000 7f090657d9c0 20 remove_watcher() i=0 2024-09-19T11:38:19.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.831+0000 7f090657d9c0 2 removed watcher, disabling cache 2024-09-19T11:38:19.840 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.835+0000 7f090657d9c0 20 remove_watcher() i=1 2024-09-19T11:38:19.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.839+0000 7f090657d9c0 20 remove_watcher() i=2 2024-09-19T11:38:19.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.839+0000 7f090657d9c0 20 remove_watcher() i=3 2024-09-19T11:38:19.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.843+0000 7f090657d9c0 20 remove_watcher() i=4 2024-09-19T11:38:19.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.843+0000 7f090657d9c0 20 remove_watcher() i=5 2024-09-19T11:38:19.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.847+0000 7f090657d9c0 20 remove_watcher() i=6 2024-09-19T11:38:19.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.847+0000 7f090657d9c0 20 remove_watcher() i=7 2024-09-19T11:38:19.870 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-19T11:38:19.870 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:19.870 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-19T11:38:19.905 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:19.905 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:19.951 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.947+0000 7f26952cd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.947+0000 7f26952cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.947+0000 7f26952cd9c0 20 realm 2024-09-19T11:38:19.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.947+0000 7f26952cd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.947+0000 7f26952cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.947+0000 7f26952cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:19.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.947+0000 7f26952cd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.947+0000 7f26952cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:19.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.947+0000 7f26952cd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.951+0000 7f26952cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:19.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.951+0000 7f26952cd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:19.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.951+0000 7f26952cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:19.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.951+0000 7f26952cd9c0 20 searching for the correct realm 2024-09-19T11:38:19.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.955+0000 7f26935d4640 0 -- 172.21.15.120:0/2005561472 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f268802d070 msgr2=0x7f268802d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:19.966 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:19.963+0000 7f26925d2640 0 -- 172.21.15.120:0/2005561472 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f2684114070 msgr2=0x7f26841059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:20.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.179+0000 7f26952cd9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:20.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.179+0000 7f26952cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:20.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.179+0000 7f26952cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:20.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.179+0000 7f26952cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:20.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.179+0000 7f26952cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:20.186 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.179+0000 7f26952cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:20.186 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.179+0000 7f26952cd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.186 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.179+0000 7f26952cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.186 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.179+0000 7f26952cd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.186 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:20.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:20.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 20 zone default found 2024-09-19T11:38:20.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 4 Realm: () 2024-09-19T11:38:20.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:20.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:20.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:20.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 20 zonegroup default 2024-09-19T11:38:20.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 20 started sync module instance, tier type = 2024-09-19T11:38:20.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.183+0000 7f26952cd9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:20.214 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.211+0000 7f26952cd9c0 20 add_watcher() i=0 2024-09-19T11:38:20.214 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.211+0000 7f26952cd9c0 20 add_watcher() i=1 2024-09-19T11:38:20.214 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.211+0000 7f26952cd9c0 20 add_watcher() i=2 2024-09-19T11:38:20.214 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.211+0000 7f26952cd9c0 20 add_watcher() i=3 2024-09-19T11:38:20.214 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.211+0000 7f26952cd9c0 20 add_watcher() i=4 2024-09-19T11:38:20.215 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.211+0000 7f26952cd9c0 20 add_watcher() i=5 2024-09-19T11:38:20.215 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.211+0000 7f26952cd9c0 20 add_watcher() i=6 2024-09-19T11:38:20.216 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.211+0000 7f26952cd9c0 20 add_watcher() i=7 2024-09-19T11:38:20.216 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.211+0000 7f26952cd9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:20.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.215+0000 7f25497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:20.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:20.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:20.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 5 note: GC not initialized 2024-09-19T11:38:20.223 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f24c3fff640 20 reqs_thread_entry: start 2024-09-19T11:38:20.223 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:20.223 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 20 Filter name: none 2024-09-19T11:38:20.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f24c1ffb640 20 reqs_thread_entry: start 2024-09-19T11:38:20.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T11:38:20.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.225 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:20.225 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T11:38:20.225 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T11:38:20.225 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 : miss 2024-09-19T11:38:20.225 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:20.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 info.flags=0x17 2024-09-19T11:38:20.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 to cache LRU end 2024-09-19T11:38:20.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:38:20.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T11:38:20.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 2024-09-19T11:38:20.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.219+0000 7f26952cd9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:20.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.223+0000 7f26952cd9c0 1 NOTICE: finished shard 0 (2 entries found) 2024-09-19T11:38:20.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.223+0000 7f26952cd9c0 1 NOTICE: finished all shards (2 entries found) 2024-09-19T11:38:20.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.223+0000 7f25497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:20.233 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.227+0000 7f26952cd9c0 20 remove_watcher() i=0 2024-09-19T11:38:20.233 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.227+0000 7f26952cd9c0 2 removed watcher, disabling cache 2024-09-19T11:38:20.235 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.231+0000 7f26952cd9c0 20 remove_watcher() i=1 2024-09-19T11:38:20.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.231+0000 7f26952cd9c0 20 remove_watcher() i=2 2024-09-19T11:38:20.239 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.235+0000 7f26952cd9c0 20 remove_watcher() i=3 2024-09-19T11:38:20.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.239+0000 7f26952cd9c0 20 remove_watcher() i=4 2024-09-19T11:38:20.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.239+0000 7f26952cd9c0 20 remove_watcher() i=5 2024-09-19T11:38:20.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.239+0000 7f26952cd9c0 20 remove_watcher() i=6 2024-09-19T11:38:20.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.243+0000 7f26952cd9c0 20 remove_watcher() i=7 2024-09-19T11:38:20.264 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-19T11:38:20.264 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:20.264 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-19T11:38:20.300 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:20.300 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:20.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.339+0000 7fa5089fe9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.343+0000 7fa5089fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.343+0000 7fa5089fe9c0 20 realm 2024-09-19T11:38:20.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.343+0000 7fa5089fe9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.343+0000 7fa5089fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.343+0000 7fa5089fe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:20.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.343+0000 7fa5089fe9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.343+0000 7fa5089fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.343+0000 7fa5089fe9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.343+0000 7fa5089fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:20.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.343+0000 7fa5089fe9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.347+0000 7fa5089fe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:20.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.347+0000 7fa5089fe9c0 20 searching for the correct realm 2024-09-19T11:38:20.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.351+0000 7fa506504640 0 -- 172.21.15.120:0/2644219762 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fa500071020 msgr2=0x7fa50002d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:20.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.567+0000 7fa506504640 0 -- 172.21.15.120:0/2644219762 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fa500071020 msgr2=0x7fa50002d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:20.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:20.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:20.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:20.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:20.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:20.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:20.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:20.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:20.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 zone default found 2024-09-19T11:38:20.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 4 Realm: () 2024-09-19T11:38:20.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:20.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:20.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:20.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 zonegroup default 2024-09-19T11:38:20.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.579+0000 7fa5089fe9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.583+0000 7fa5089fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.583+0000 7fa5089fe9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.583+0000 7fa5089fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.583+0000 7fa5089fe9c0 20 started sync module instance, tier type = 2024-09-19T11:38:20.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.583+0000 7fa5089fe9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:20.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.603+0000 7fa5089fe9c0 20 add_watcher() i=0 2024-09-19T11:38:20.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.603+0000 7fa5089fe9c0 20 add_watcher() i=1 2024-09-19T11:38:20.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.603+0000 7fa5089fe9c0 20 add_watcher() i=2 2024-09-19T11:38:20.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.603+0000 7fa5089fe9c0 20 add_watcher() i=3 2024-09-19T11:38:20.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.603+0000 7fa5089fe9c0 20 add_watcher() i=4 2024-09-19T11:38:20.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.603+0000 7fa5089fe9c0 20 add_watcher() i=5 2024-09-19T11:38:20.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.603+0000 7fa5089fe9c0 20 add_watcher() i=6 2024-09-19T11:38:20.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.607+0000 7fa5089fe9c0 20 add_watcher() i=7 2024-09-19T11:38:20.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.607+0000 7fa5089fe9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:20.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.607+0000 7fa3bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:20.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:20.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:20.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 5 note: GC not initialized 2024-09-19T11:38:20.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa3377fe640 20 reqs_thread_entry: start 2024-09-19T11:38:20.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:20.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 20 Filter name: none 2024-09-19T11:38:20.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa3357fa640 20 reqs_thread_entry: start 2024-09-19T11:38:20.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T11:38:20.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:20.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T11:38:20.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T11:38:20.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 : miss 2024-09-19T11:38:20.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:20.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 info.flags=0x17 2024-09-19T11:38:20.618 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 to cache LRU end 2024-09-19T11:38:20.618 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:38:20.618 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T11:38:20.618 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 2024-09-19T11:38:20.618 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.611+0000 7fa5089fe9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:20.618 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.615+0000 7fa5089fe9c0 20 get_obj_state: octx=0x55e8b4e42e90 obj=check-bucket:c state=0x55e8b50fa268 s->prefetch_data=0 2024-09-19T11:38:20.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.615+0000 7fa5089fe9c0 20 get_obj_state: setting s->obj_tag to i9798pyu5ely2ej4f511v95lv2lz1yxt 2024-09-19T11:38:20.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.615+0000 7fa5089fe9c0 20 get_obj_state_impl: setting s->olh_tag to 2qibrqbl62k4mupex6yxy8qe90obfwus 2024-09-19T11:38:20.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.615+0000 7fa5089fe9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:20.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.615+0000 7fa5089fe9c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-19T11:38:20.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.615+0000 7fa5089fe9c0 20 olh_log_entry: epoch=4 op=3 key=c[vSwhb8F--bBXyTpGy.wJXAJsh9WnVgw] 2024-09-19T11:38:20.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.615+0000 7fa5089fe9c0 20 get_obj_state: octx=0x55e8b5122fa0 obj=check-bucket:_:vSwhb8F--bBXyTpGy.wJXAJsh9WnVgw_c state=0x55e8b50f8ae8 s->prefetch_data=0 2024-09-19T11:38:20.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.619+0000 7fa5089fe9c0 20 get_obj_state: octx=0x55e8b5122fa0 obj=check-bucket:c state=0x55e8b50fadc8 s->prefetch_data=0 2024-09-19T11:38:20.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.619+0000 7fa5089fe9c0 20 get_obj_state: setting s->obj_tag to i9798pyu5ely2ej4f511v95lv2lz1yxt 2024-09-19T11:38:20.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.619+0000 7fa5089fe9c0 20 get_obj_state_impl: setting s->olh_tag to 2qibrqbl62k4mupex6yxy8qe90obfwus 2024-09-19T11:38:20.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.619+0000 7fa5089fe9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2qibrqbl62k4mupex6yxy8qe90obfwus 2024-09-19T11:38:20.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.623+0000 7fa5089fe9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:20.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.627+0000 7fa5089fe9c0 20 get_obj_state: octx=0x55e8b4e42e90 obj=check-bucket:d state=0x55e8b50f66e8 s->prefetch_data=0 2024-09-19T11:38:20.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.627+0000 7fa5089fe9c0 20 get_obj_state: setting s->obj_tag to 4zcea058pg8d7rjxwjruj30lvmm981m0 2024-09-19T11:38:20.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.627+0000 7fa5089fe9c0 20 get_obj_state_impl: setting s->olh_tag to ewt5mwn4czgtvrqmsqd6alitbt5zzb4k 2024-09-19T11:38:20.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.627+0000 7fa5089fe9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:20.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.627+0000 7fa5089fe9c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-19T11:38:20.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.627+0000 7fa5089fe9c0 20 olh_log_entry: epoch=4 op=3 key=d[aWBxAN1rBrwedm66p44M0S3yIdkE7Tv] 2024-09-19T11:38:20.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.627+0000 7fa5089fe9c0 20 get_obj_state: octx=0x55e8b5122fa0 obj=check-bucket:_:aWBxAN1rBrwedm66p44M0S3yIdkE7Tv_d state=0x55e8b5124be8 s->prefetch_data=0 2024-09-19T11:38:20.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.631+0000 7fa5089fe9c0 20 get_obj_state: octx=0x55e8b5122fa0 obj=check-bucket:d state=0x55e8b50f0288 s->prefetch_data=0 2024-09-19T11:38:20.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.631+0000 7fa5089fe9c0 20 get_obj_state: setting s->obj_tag to 4zcea058pg8d7rjxwjruj30lvmm981m0 2024-09-19T11:38:20.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.631+0000 7fa5089fe9c0 20 get_obj_state_impl: setting s->olh_tag to ewt5mwn4czgtvrqmsqd6alitbt5zzb4k 2024-09-19T11:38:20.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.631+0000 7fa5089fe9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ewt5mwn4czgtvrqmsqd6alitbt5zzb4k 2024-09-19T11:38:20.641 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.635+0000 7fa5089fe9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:20.643 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.639+0000 7fa5089fe9c0 1 NOTICE: finished shard 0 (2 entries removed) 2024-09-19T11:38:20.643 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.639+0000 7fa5089fe9c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-19T11:38:20.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.639+0000 7fa3bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:20.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.643+0000 7fa5089fe9c0 20 remove_watcher() i=0 2024-09-19T11:38:20.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.643+0000 7fa5089fe9c0 2 removed watcher, disabling cache 2024-09-19T11:38:20.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.647+0000 7fa5089fe9c0 20 remove_watcher() i=1 2024-09-19T11:38:20.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.651+0000 7fa5089fe9c0 20 remove_watcher() i=2 2024-09-19T11:38:20.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.651+0000 7fa5089fe9c0 20 remove_watcher() i=3 2024-09-19T11:38:20.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.655+0000 7fa5089fe9c0 20 remove_watcher() i=4 2024-09-19T11:38:20.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.655+0000 7fa5089fe9c0 20 remove_watcher() i=5 2024-09-19T11:38:20.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.655+0000 7fa5089fe9c0 20 remove_watcher() i=6 2024-09-19T11:38:20.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.659+0000 7fa5089fe9c0 20 remove_watcher() i=7 2024-09-19T11:38:20.678 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-19T11:38:20.708 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:20.708 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:20.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.747+0000 7f323642e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.751+0000 7f323642e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.751+0000 7f323642e9c0 20 realm 2024-09-19T11:38:20.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.751+0000 7f323642e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.751+0000 7f323642e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.751+0000 7f323642e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:20.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.751+0000 7f323642e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.751+0000 7f323642e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.751+0000 7f323642e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.751+0000 7f323642e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:20.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.751+0000 7f323642e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.755+0000 7f323642e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:20.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.755+0000 7f323642e9c0 20 searching for the correct realm 2024-09-19T11:38:20.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.759+0000 7f3234735640 0 -- 172.21.15.120:0/1671344953 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f3228039940 msgr2=0x7f3228049400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:20.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.767+0000 7f3233733640 0 -- 172.21.15.120:0/1671344953 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f32240024f0 msgr2=0x7f3224015950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:38:20.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.983+0000 7f323642e9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:20.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.983+0000 7f323642e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:20.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.983+0000 7f323642e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:20.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.983+0000 7f323642e9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:20.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.983+0000 7f323642e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:20.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.983+0000 7f323642e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:20.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.983+0000 7f323642e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:20.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:20.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 20 zone default found 2024-09-19T11:38:20.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 4 Realm: () 2024-09-19T11:38:20.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:20.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:20.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:20.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 20 zonegroup default 2024-09-19T11:38:20.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.987+0000 7f323642e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:20.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.991+0000 7f323642e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:20.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.991+0000 7f323642e9c0 20 started sync module instance, tier type = 2024-09-19T11:38:20.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:20.991+0000 7f323642e9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:21.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.015+0000 7f323642e9c0 20 add_watcher() i=0 2024-09-19T11:38:21.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.015+0000 7f323642e9c0 20 add_watcher() i=1 2024-09-19T11:38:21.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.015+0000 7f323642e9c0 20 add_watcher() i=2 2024-09-19T11:38:21.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.015+0000 7f323642e9c0 20 add_watcher() i=3 2024-09-19T11:38:21.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.015+0000 7f323642e9c0 20 add_watcher() i=4 2024-09-19T11:38:21.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.015+0000 7f323642e9c0 20 add_watcher() i=5 2024-09-19T11:38:21.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.015+0000 7f323642e9c0 20 add_watcher() i=6 2024-09-19T11:38:21.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.015+0000 7f323642e9c0 20 add_watcher() i=7 2024-09-19T11:38:21.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.015+0000 7f323642e9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:21.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.019+0000 7f30e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:21.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.023+0000 7f323642e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:21.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.023+0000 7f323642e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:21.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.023+0000 7f323642e9c0 5 note: GC not initialized 2024-09-19T11:38:21.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.023+0000 7f30e8fe1640 20 reqs_thread_entry: start 2024-09-19T11:38:21.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.023+0000 7f323642e9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:21.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.023+0000 7f323642e9c0 20 Filter name: none 2024-09-19T11:38:21.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.023+0000 7f30627fc640 20 reqs_thread_entry: start 2024-09-19T11:38:21.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.023+0000 7f323642e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.023+0000 7f323642e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:21.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.023+0000 7f323642e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.023+0000 7f323642e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:21.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.023+0000 7f323642e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:21.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.023+0000 7f323642e9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-19T11:38:21.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.023+0000 7f323642e9c0 20 INFO: main: starting shard=0 2024-09-19T11:38:21.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.023+0000 7f323642e9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:21.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.027+0000 7f323642e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T11:38:21.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.027+0000 7f323642e9c0 20 INFO: main: done 2024-09-19T11:38:21.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.027+0000 7f30e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:21.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.031+0000 7f323642e9c0 20 remove_watcher() i=0 2024-09-19T11:38:21.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.031+0000 7f323642e9c0 2 removed watcher, disabling cache 2024-09-19T11:38:21.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.035+0000 7f323642e9c0 20 remove_watcher() i=1 2024-09-19T11:38:21.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.035+0000 7f323642e9c0 20 remove_watcher() i=2 2024-09-19T11:38:21.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.039+0000 7f323642e9c0 20 remove_watcher() i=3 2024-09-19T11:38:21.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.039+0000 7f323642e9c0 20 remove_watcher() i=4 2024-09-19T11:38:21.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.043+0000 7f323642e9c0 20 remove_watcher() i=5 2024-09-19T11:38:21.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.043+0000 7f323642e9c0 20 remove_watcher() i=6 2024-09-19T11:38:21.050 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.047+0000 7f323642e9c0 20 remove_watcher() i=7 2024-09-19T11:38:21.068 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-19T11:38:21.097 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:21.097 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:21.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.139+0000 7ffa795ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.139+0000 7ffa795ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:21.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.139+0000 7ffa795ad9c0 20 realm 2024-09-19T11:38:21.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.139+0000 7ffa795ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.139+0000 7ffa795ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:21.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.139+0000 7ffa795ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:21.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.139+0000 7ffa795ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.139+0000 7ffa795ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:21.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.139+0000 7ffa795ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.143+0000 7ffa795ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:21.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.143+0000 7ffa795ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.143+0000 7ffa795ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:21.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.143+0000 7ffa795ad9c0 20 searching for the correct realm 2024-09-19T11:38:21.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.147+0000 7ffa778b4640 0 -- 172.21.15.120:0/3795236956 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7ffa6c0bab30 msgr2=0x7ffa6c106aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:21.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.363+0000 7ffa768b2640 0 -- 172.21.15.120:0/3795236956 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7ffa68079150 msgr2=0x7ffa68060770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:21.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.579+0000 7ffa795ad9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:21.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.579+0000 7ffa795ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:21.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.579+0000 7ffa795ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:21.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.579+0000 7ffa795ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:21.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.579+0000 7ffa795ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:21.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.579+0000 7ffa795ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:21.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.579+0000 7ffa795ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.579+0000 7ffa795ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:21.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.579+0000 7ffa795ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:21.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:21.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 20 zone default found 2024-09-19T11:38:21.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 4 Realm: () 2024-09-19T11:38:21.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:21.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:21.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:21.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 20 zonegroup default 2024-09-19T11:38:21.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:21.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:21.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:21.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.583+0000 7ffa795ad9c0 20 started sync module instance, tier type = 2024-09-19T11:38:21.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.587+0000 7ffa795ad9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:21.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.607+0000 7ffa795ad9c0 20 add_watcher() i=0 2024-09-19T11:38:21.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.607+0000 7ffa795ad9c0 20 add_watcher() i=1 2024-09-19T11:38:21.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.607+0000 7ffa795ad9c0 20 add_watcher() i=2 2024-09-19T11:38:21.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.607+0000 7ffa795ad9c0 20 add_watcher() i=3 2024-09-19T11:38:21.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.607+0000 7ffa795ad9c0 20 add_watcher() i=4 2024-09-19T11:38:21.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.607+0000 7ffa795ad9c0 20 add_watcher() i=5 2024-09-19T11:38:21.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.611+0000 7ffa795ad9c0 20 add_watcher() i=6 2024-09-19T11:38:21.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.611+0000 7ffa795ad9c0 20 add_watcher() i=7 2024-09-19T11:38:21.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.611+0000 7ffa795ad9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:21.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.615+0000 7ff92dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:21.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ffa795ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:21.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ffa795ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:21.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ffa795ad9c0 5 note: GC not initialized 2024-09-19T11:38:21.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ff92cfe1640 20 reqs_thread_entry: start 2024-09-19T11:38:21.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ffa795ad9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:21.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ffa795ad9c0 20 Filter name: none 2024-09-19T11:38:21.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ff8a67fc640 20 reqs_thread_entry: start 2024-09-19T11:38:21.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ffa795ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ffa795ad9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:21.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ffa795ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ffa795ad9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:21.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ffa795ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:21.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ffa795ad9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-19T11:38:21.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ffa795ad9c0 20 INFO: main: starting shard=0 2024-09-19T11:38:21.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ffa795ad9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:21.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ffa795ad9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T11:38:21.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.619+0000 7ffa795ad9c0 20 INFO: main: done 2024-09-19T11:38:21.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.623+0000 7ff92dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:21.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.627+0000 7ffa795ad9c0 20 remove_watcher() i=0 2024-09-19T11:38:21.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.627+0000 7ffa795ad9c0 2 removed watcher, disabling cache 2024-09-19T11:38:21.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.631+0000 7ffa795ad9c0 20 remove_watcher() i=1 2024-09-19T11:38:21.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.631+0000 7ffa795ad9c0 20 remove_watcher() i=2 2024-09-19T11:38:21.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.635+0000 7ffa795ad9c0 20 remove_watcher() i=3 2024-09-19T11:38:21.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.635+0000 7ffa795ad9c0 20 remove_watcher() i=4 2024-09-19T11:38:21.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.639+0000 7ffa795ad9c0 20 remove_watcher() i=5 2024-09-19T11:38:21.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.639+0000 7ffa795ad9c0 20 remove_watcher() i=6 2024-09-19T11:38:21.646 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.643+0000 7ffa795ad9c0 20 remove_watcher() i=7 2024-09-19T11:38:21.660 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-19T11:38:21.661 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:21.661 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-19T11:38:21.691 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:21.691 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:21.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.731+0000 7f35292959c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.731+0000 7f35292959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:21.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.731+0000 7f35292959c0 20 realm 2024-09-19T11:38:21.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.731+0000 7f35292959c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.731+0000 7f35292959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:21.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.731+0000 7f35292959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:21.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.731+0000 7f35292959c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.735+0000 7f35292959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:21.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.735+0000 7f35292959c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.735+0000 7f35292959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:21.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.735+0000 7f35292959c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.735+0000 7f35292959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:21.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.735+0000 7f35292959c0 20 searching for the correct realm 2024-09-19T11:38:21.744 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.739+0000 7f352759c640 0 -- 172.21.15.120:0/367770899 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f351c008040 msgr2=0x7f351c045400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:21.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.747+0000 7f352659a640 0 -- 172.21.15.120:0/367770899 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f3518089be0 msgr2=0x7f3518064ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:21.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.963+0000 7f35292959c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:21.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.963+0000 7f35292959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:21.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.963+0000 7f35292959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:21.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.963+0000 7f35292959c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:21.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.963+0000 7f35292959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:21.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.963+0000 7f35292959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:21.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.963+0000 7f35292959c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:21.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:21.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:21.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 20 zone default found 2024-09-19T11:38:21.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 4 Realm: () 2024-09-19T11:38:21.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:21.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:21.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:21.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 20 zonegroup default 2024-09-19T11:38:21.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:21.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:21.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.967+0000 7f35292959c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:21.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.971+0000 7f35292959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:21.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.971+0000 7f35292959c0 20 started sync module instance, tier type = 2024-09-19T11:38:21.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.971+0000 7f35292959c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:21.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.991+0000 7f35292959c0 20 add_watcher() i=0 2024-09-19T11:38:21.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.991+0000 7f35292959c0 20 add_watcher() i=1 2024-09-19T11:38:21.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.991+0000 7f35292959c0 20 add_watcher() i=2 2024-09-19T11:38:21.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.991+0000 7f35292959c0 20 add_watcher() i=3 2024-09-19T11:38:21.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.991+0000 7f35292959c0 20 add_watcher() i=4 2024-09-19T11:38:21.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.991+0000 7f35292959c0 20 add_watcher() i=5 2024-09-19T11:38:21.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.995+0000 7f35292959c0 20 add_watcher() i=6 2024-09-19T11:38:22.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.995+0000 7f35292959c0 20 add_watcher() i=7 2024-09-19T11:38:22.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.995+0000 7f35292959c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:22.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.999+0000 7f33dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:22.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.999+0000 7f35292959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:22.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.999+0000 7f35292959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:22.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:21.999+0000 7f35292959c0 5 note: GC not initialized 2024-09-19T11:38:22.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f3357fff640 20 reqs_thread_entry: start 2024-09-19T11:38:22.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:22.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 20 Filter name: none 2024-09-19T11:38:22.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f3355ffb640 20 reqs_thread_entry: start 2024-09-19T11:38:22.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T11:38:22.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:22.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:22.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T11:38:22.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T11:38:22.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 : miss 2024-09-19T11:38:22.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:22.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:22.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 info.flags=0x17 2024-09-19T11:38:22.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 to cache LRU end 2024-09-19T11:38:22.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:38:22.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T11:38:22.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 2024-09-19T11:38:22.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.003+0000 7f35292959c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:22.010 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.007+0000 7f35292959c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-19T11:38:22.010 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.007+0000 7f35292959c0 1 NOTICE: finished all shards (0 entries found) 2024-09-19T11:38:22.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.007+0000 7f33dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:22.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.011+0000 7f35292959c0 20 remove_watcher() i=0 2024-09-19T11:38:22.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.011+0000 7f35292959c0 2 removed watcher, disabling cache 2024-09-19T11:38:22.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.015+0000 7f35292959c0 20 remove_watcher() i=1 2024-09-19T11:38:22.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.015+0000 7f35292959c0 20 remove_watcher() i=2 2024-09-19T11:38:22.023 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.019+0000 7f35292959c0 20 remove_watcher() i=3 2024-09-19T11:38:22.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.019+0000 7f35292959c0 20 remove_watcher() i=4 2024-09-19T11:38:22.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.023+0000 7f35292959c0 20 remove_watcher() i=5 2024-09-19T11:38:22.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.023+0000 7f35292959c0 20 remove_watcher() i=6 2024-09-19T11:38:22.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:22.027+0000 7f35292959c0 20 remove_watcher() i=7 2024-09-19T11:38:22.047 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-19T11:38:22.047 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:22.104 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-19T11:38:22.104 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:38:22.510 INFO:tasks.workunit.client.0.smithi120.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-19T11:38:22.963 INFO:tasks.workunit.client.0.smithi120.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-19T11:38:24.471 INFO:tasks.workunit.client.0.smithi120.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T11:38:24.471 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-19T11:38:24.508 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:24.508 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:24.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:24.755+0000 7f3c58b039c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:24.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:24.759+0000 7f3c58b039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:24.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:24.759+0000 7f3c58b039c0 20 realm 2024-09-19T11:38:24.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:24.759+0000 7f3c58b039c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:24.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:24.759+0000 7f3c58b039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:24.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:24.759+0000 7f3c58b039c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:24.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:24.759+0000 7f3c58b039c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:24.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:24.759+0000 7f3c58b039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:24.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:24.759+0000 7f3c58b039c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:24.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:24.763+0000 7f3c58b039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:24.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:24.763+0000 7f3c58b039c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:24.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:24.763+0000 7f3c58b039c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:24.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:24.763+0000 7f3c58b039c0 20 searching for the correct realm 2024-09-19T11:38:24.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:24.767+0000 7f3c56e0a640 0 -- 172.21.15.120:0/2875348263 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f3c4c008050 msgr2=0x7f3c4c040400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:24.988 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:24.983+0000 7f3c55e08640 0 -- 172.21.15.120:0/2875348263 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f3c48024070 msgr2=0x7f3c480682c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:25.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.199+0000 7f3c58b039c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:25.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.199+0000 7f3c58b039c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:25.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.199+0000 7f3c58b039c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:25.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.199+0000 7f3c58b039c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:25.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.199+0000 7f3c58b039c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:25.206 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.199+0000 7f3c58b039c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:25.206 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.199+0000 7f3c58b039c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.206 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.199+0000 7f3c58b039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:25.206 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.199+0000 7f3c58b039c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.207 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.203+0000 7f3c58b039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:25.207 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.203+0000 7f3c58b039c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.203+0000 7f3c58b039c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:25.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.203+0000 7f3c58b039c0 20 zone default found 2024-09-19T11:38:25.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.203+0000 7f3c58b039c0 4 Realm: () 2024-09-19T11:38:25.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.203+0000 7f3c58b039c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:25.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.203+0000 7f3c58b039c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:25.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.203+0000 7f3c58b039c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:25.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.203+0000 7f3c58b039c0 20 zonegroup default 2024-09-19T11:38:25.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.203+0000 7f3c58b039c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.203+0000 7f3c58b039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:25.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.203+0000 7f3c58b039c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.203+0000 7f3c58b039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:25.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.203+0000 7f3c58b039c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.207+0000 7f3c58b039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:25.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.207+0000 7f3c58b039c0 20 started sync module instance, tier type = 2024-09-19T11:38:25.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.207+0000 7f3c58b039c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:25.236 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.231+0000 7f3c58b039c0 20 add_watcher() i=0 2024-09-19T11:38:25.236 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.231+0000 7f3c58b039c0 20 add_watcher() i=1 2024-09-19T11:38:25.236 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.231+0000 7f3c58b039c0 20 add_watcher() i=2 2024-09-19T11:38:25.236 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.231+0000 7f3c58b039c0 20 add_watcher() i=3 2024-09-19T11:38:25.236 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.231+0000 7f3c58b039c0 20 add_watcher() i=4 2024-09-19T11:38:25.236 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.231+0000 7f3c58b039c0 20 add_watcher() i=5 2024-09-19T11:38:25.236 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.231+0000 7f3c58b039c0 20 add_watcher() i=6 2024-09-19T11:38:25.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.231+0000 7f3c58b039c0 20 add_watcher() i=7 2024-09-19T11:38:25.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.231+0000 7f3c58b039c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:25.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.235+0000 7f3b0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:25.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.239+0000 7f3c58b039c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:25.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.239+0000 7f3c58b039c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:25.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.239+0000 7f3c58b039c0 5 note: GC not initialized 2024-09-19T11:38:25.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.239+0000 7f3a877fe640 20 reqs_thread_entry: start 2024-09-19T11:38:25.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.239+0000 7f3c58b039c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:25.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.239+0000 7f3c58b039c0 20 Filter name: none 2024-09-19T11:38:25.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.239+0000 7f3a857fa640 20 reqs_thread_entry: start 2024-09-19T11:38:25.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.239+0000 7f3c58b039c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.239+0000 7f3c58b039c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:25.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.239+0000 7f3c58b039c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.239+0000 7f3c58b039c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:25.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.239+0000 7f3c58b039c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:25.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.239+0000 7f3c58b039c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-19T11:38:25.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.239+0000 7f3c58b039c0 20 INFO: main: starting shard=0 2024-09-19T11:38:25.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.239+0000 7f3c58b039c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:25.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.243+0000 7f3c58b039c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-19T11:38:25.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.243+0000 7f3c58b039c0 20 INFO: main: done 2024-09-19T11:38:25.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.243+0000 7f3b0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:25.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.247+0000 7f3c58b039c0 20 remove_watcher() i=0 2024-09-19T11:38:25.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.247+0000 7f3c58b039c0 2 removed watcher, disabling cache 2024-09-19T11:38:25.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.251+0000 7f3c58b039c0 20 remove_watcher() i=1 2024-09-19T11:38:25.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.251+0000 7f3c58b039c0 20 remove_watcher() i=2 2024-09-19T11:38:25.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.255+0000 7f3c58b039c0 20 remove_watcher() i=3 2024-09-19T11:38:25.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.255+0000 7f3c58b039c0 20 remove_watcher() i=4 2024-09-19T11:38:25.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.259+0000 7f3c58b039c0 20 remove_watcher() i=5 2024-09-19T11:38:25.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.259+0000 7f3c58b039c0 20 remove_watcher() i=6 2024-09-19T11:38:25.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.259+0000 7f3c58b039c0 20 remove_watcher() i=7 2024-09-19T11:38:25.359 INFO:tasks.workunit.client.0.smithi120.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T11:38:25.359 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-19T11:38:25.396 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:25.396 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:25.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.435+0000 7fe2aa76f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.439+0000 7fe2aa76f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:25.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.439+0000 7fe2aa76f9c0 20 realm 2024-09-19T11:38:25.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.439+0000 7fe2aa76f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.439+0000 7fe2aa76f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:25.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.439+0000 7fe2aa76f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:25.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.439+0000 7fe2aa76f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.439+0000 7fe2aa76f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:25.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.439+0000 7fe2aa76f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.439+0000 7fe2aa76f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:25.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.439+0000 7fe2aa76f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.443+0000 7fe2aa76f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:25.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.443+0000 7fe2aa76f9c0 20 searching for the correct realm 2024-09-19T11:38:25.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.447+0000 7fe2a8a76640 0 -- 172.21.15.120:0/2431549730 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fe29c085c20 msgr2=0x7fe29c062eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:25.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.663+0000 7fe2a7a74640 0 -- 172.21.15.120:0/2431549730 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fe298008040 msgr2=0x7fe29806f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:25.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.879+0000 7fe2aa76f9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:25.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.879+0000 7fe2aa76f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:25.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.879+0000 7fe2aa76f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:25.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.879+0000 7fe2aa76f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:25.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.879+0000 7fe2aa76f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:25.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.879+0000 7fe2aa76f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:25.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.879+0000 7fe2aa76f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.879+0000 7fe2aa76f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:25.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.879+0000 7fe2aa76f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:25.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:25.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 20 zone default found 2024-09-19T11:38:25.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 4 Realm: () 2024-09-19T11:38:25.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:25.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:25.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:25.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 20 zonegroup default 2024-09-19T11:38:25.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:25.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:25.889 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.889 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:25.889 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 20 started sync module instance, tier type = 2024-09-19T11:38:25.889 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.883+0000 7fe2aa76f9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:25.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.911+0000 7fe2aa76f9c0 20 add_watcher() i=0 2024-09-19T11:38:25.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.911+0000 7fe2aa76f9c0 20 add_watcher() i=1 2024-09-19T11:38:25.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.911+0000 7fe2aa76f9c0 20 add_watcher() i=2 2024-09-19T11:38:25.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.911+0000 7fe2aa76f9c0 20 add_watcher() i=3 2024-09-19T11:38:25.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.911+0000 7fe2aa76f9c0 20 add_watcher() i=4 2024-09-19T11:38:25.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.911+0000 7fe2aa76f9c0 20 add_watcher() i=5 2024-09-19T11:38:25.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.911+0000 7fe2aa76f9c0 20 add_watcher() i=6 2024-09-19T11:38:25.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.911+0000 7fe2aa76f9c0 20 add_watcher() i=7 2024-09-19T11:38:25.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.911+0000 7fe2aa76f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:25.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.915+0000 7fe15efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:25.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe2aa76f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:25.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe2aa76f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:25.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe2aa76f9c0 5 note: GC not initialized 2024-09-19T11:38:25.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe15dfdb640 20 reqs_thread_entry: start 2024-09-19T11:38:25.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe2aa76f9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:25.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe2aa76f9c0 20 Filter name: none 2024-09-19T11:38:25.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe0cf7fe640 20 reqs_thread_entry: start 2024-09-19T11:38:25.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe2aa76f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe2aa76f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:25.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe2aa76f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:25.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe2aa76f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:25.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe2aa76f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:25.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe2aa76f9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-19T11:38:25.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe2aa76f9c0 20 INFO: main: starting shard=0 2024-09-19T11:38:25.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe2aa76f9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:25.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe2aa76f9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-19T11:38:25.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.919+0000 7fe2aa76f9c0 20 INFO: main: done 2024-09-19T11:38:25.927 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.923+0000 7fe15efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:25.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.927+0000 7fe2aa76f9c0 20 remove_watcher() i=0 2024-09-19T11:38:25.933 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.927+0000 7fe2aa76f9c0 2 removed watcher, disabling cache 2024-09-19T11:38:25.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.931+0000 7fe2aa76f9c0 20 remove_watcher() i=1 2024-09-19T11:38:25.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.931+0000 7fe2aa76f9c0 20 remove_watcher() i=2 2024-09-19T11:38:25.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.935+0000 7fe2aa76f9c0 20 remove_watcher() i=3 2024-09-19T11:38:25.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.935+0000 7fe2aa76f9c0 20 remove_watcher() i=4 2024-09-19T11:38:25.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.939+0000 7fe2aa76f9c0 20 remove_watcher() i=5 2024-09-19T11:38:25.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.943+0000 7fe2aa76f9c0 20 remove_watcher() i=6 2024-09-19T11:38:25.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:25.943+0000 7fe2aa76f9c0 20 remove_watcher() i=7 2024-09-19T11:38:26.034 INFO:tasks.workunit.client.0.smithi120.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T11:38:26.036 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-19T11:38:26.069 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:26.070 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:26.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.107+0000 7f8b402ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.111+0000 7f8b402ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:26.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.111+0000 7f8b402ad9c0 20 realm 2024-09-19T11:38:26.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.111+0000 7f8b402ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.111+0000 7f8b402ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:26.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.111+0000 7f8b402ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:26.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.111+0000 7f8b402ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.111+0000 7f8b402ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:26.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.111+0000 7f8b402ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.111+0000 7f8b402ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:26.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.111+0000 7f8b402ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.115+0000 7f8b402ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:26.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.115+0000 7f8b402ad9c0 20 searching for the correct realm 2024-09-19T11:38:26.123 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.119+0000 7f8b3ddb3640 0 -- 172.21.15.120:0/14723618 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f8b300e4040 msgr2=0x7f8b300d7930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:38:26.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.335+0000 7f8b3ddb3640 0 -- 172.21.15.120:0/14723618 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f8b300e4040 msgr2=0x7f8b300d7930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:26.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.347+0000 7f8b402ad9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:26.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.347+0000 7f8b402ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:26.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.347+0000 7f8b402ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:26.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.347+0000 7f8b402ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:26.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.347+0000 7f8b402ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:26.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.347+0000 7f8b402ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:26.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.347+0000 7f8b402ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.347+0000 7f8b402ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:26.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.347+0000 7f8b402ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:26.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:26.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 20 zone default found 2024-09-19T11:38:26.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 4 Realm: () 2024-09-19T11:38:26.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:26.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:26.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:26.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 20 zonegroup default 2024-09-19T11:38:26.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:26.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:26.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:26.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 20 started sync module instance, tier type = 2024-09-19T11:38:26.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.351+0000 7f8b402ad9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:26.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.375+0000 7f8b402ad9c0 20 add_watcher() i=0 2024-09-19T11:38:26.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.375+0000 7f8b402ad9c0 20 add_watcher() i=1 2024-09-19T11:38:26.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.375+0000 7f8b402ad9c0 20 add_watcher() i=2 2024-09-19T11:38:26.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.375+0000 7f8b402ad9c0 20 add_watcher() i=3 2024-09-19T11:38:26.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.375+0000 7f8b402ad9c0 20 add_watcher() i=4 2024-09-19T11:38:26.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.375+0000 7f8b402ad9c0 20 add_watcher() i=5 2024-09-19T11:38:26.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.375+0000 7f8b402ad9c0 20 add_watcher() i=6 2024-09-19T11:38:26.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.379+0000 7f8b402ad9c0 20 add_watcher() i=7 2024-09-19T11:38:26.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.379+0000 7f8b402ad9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:26.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.383+0000 7f89ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:26.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.383+0000 7f8b402ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:26.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.383+0000 7f8b402ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:26.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.383+0000 7f8b402ad9c0 5 note: GC not initialized 2024-09-19T11:38:26.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.383+0000 7f89ee7fc640 20 reqs_thread_entry: start 2024-09-19T11:38:26.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.383+0000 7f8b402ad9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:26.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.383+0000 7f8b402ad9c0 20 Filter name: none 2024-09-19T11:38:26.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.383+0000 7f895ffff640 20 reqs_thread_entry: start 2024-09-19T11:38:26.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.383+0000 7f8b402ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.383+0000 7f8b402ad9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:26.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.383+0000 7f8b402ad9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.387+0000 7f8b402ad9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:26.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.387+0000 7f8b402ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:26.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.387+0000 7f8b402ad9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-19T11:38:26.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.387+0000 7f8b402ad9c0 20 INFO: main: starting shard=0 2024-09-19T11:38:26.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.387+0000 7f8b402ad9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:26.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.387+0000 7f8b402ad9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T11:38:26.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.387+0000 7f8b402ad9c0 20 INFO: main: done 2024-09-19T11:38:26.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.387+0000 7f89ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:26.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.395+0000 7f8b402ad9c0 20 remove_watcher() i=0 2024-09-19T11:38:26.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.395+0000 7f8b402ad9c0 2 removed watcher, disabling cache 2024-09-19T11:38:26.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.395+0000 7f8b402ad9c0 20 remove_watcher() i=1 2024-09-19T11:38:26.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.399+0000 7f8b402ad9c0 20 remove_watcher() i=2 2024-09-19T11:38:26.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.403+0000 7f8b402ad9c0 20 remove_watcher() i=3 2024-09-19T11:38:26.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.403+0000 7f8b402ad9c0 20 remove_watcher() i=4 2024-09-19T11:38:26.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.407+0000 7f8b402ad9c0 20 remove_watcher() i=5 2024-09-19T11:38:26.413 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.407+0000 7f8b402ad9c0 20 remove_watcher() i=6 2024-09-19T11:38:26.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.411+0000 7f8b402ad9c0 20 remove_watcher() i=7 2024-09-19T11:38:26.495 INFO:tasks.workunit.client.0.smithi120.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T11:38:26.495 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-19T11:38:26.530 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:26.531 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:26.576 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.571+0000 7f24e69d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.578 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.575+0000 7f24e69d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:26.578 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.575+0000 7f24e69d19c0 20 realm 2024-09-19T11:38:26.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.575+0000 7f24e69d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.575+0000 7f24e69d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:26.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.575+0000 7f24e69d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:26.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.575+0000 7f24e69d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.575+0000 7f24e69d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:26.580 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.575+0000 7f24e69d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.575+0000 7f24e69d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:26.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.575+0000 7f24e69d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.579+0000 7f24e69d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:26.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.579+0000 7f24e69d19c0 20 searching for the correct realm 2024-09-19T11:38:26.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.583+0000 7f24e44d7640 0 -- 172.21.15.120:0/4100219657 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f24dc04bc10 msgr2=0x7f24dc022960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:26.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.799+0000 7f24e44d7640 0 -- 172.21.15.120:0/4100219657 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f24dc04bc10 msgr2=0x7f24dc022960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:26.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.811+0000 7f24e69d19c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:26.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.811+0000 7f24e69d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:26.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.811+0000 7f24e69d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:26.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.811+0000 7f24e69d19c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:26.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.811+0000 7f24e69d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:26.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.811+0000 7f24e69d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:26.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.811+0000 7f24e69d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.811+0000 7f24e69d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:26.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.811+0000 7f24e69d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.811+0000 7f24e69d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:26.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.811+0000 7f24e69d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.815+0000 7f24e69d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:26.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.815+0000 7f24e69d19c0 20 zone default found 2024-09-19T11:38:26.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.815+0000 7f24e69d19c0 4 Realm: () 2024-09-19T11:38:26.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.815+0000 7f24e69d19c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:26.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.815+0000 7f24e69d19c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:26.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.815+0000 7f24e69d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:26.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.815+0000 7f24e69d19c0 20 zonegroup default 2024-09-19T11:38:26.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.815+0000 7f24e69d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.815+0000 7f24e69d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:26.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.815+0000 7f24e69d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.820 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.815+0000 7f24e69d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:26.820 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.815+0000 7f24e69d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.815+0000 7f24e69d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:26.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.815+0000 7f24e69d19c0 20 started sync module instance, tier type = 2024-09-19T11:38:26.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.815+0000 7f24e69d19c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:26.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.843+0000 7f24e69d19c0 20 add_watcher() i=0 2024-09-19T11:38:26.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.843+0000 7f24e69d19c0 20 add_watcher() i=1 2024-09-19T11:38:26.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.843+0000 7f24e69d19c0 20 add_watcher() i=2 2024-09-19T11:38:26.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.843+0000 7f24e69d19c0 20 add_watcher() i=3 2024-09-19T11:38:26.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.843+0000 7f24e69d19c0 20 add_watcher() i=4 2024-09-19T11:38:26.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.843+0000 7f24e69d19c0 20 add_watcher() i=5 2024-09-19T11:38:26.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.843+0000 7f24e69d19c0 20 add_watcher() i=6 2024-09-19T11:38:26.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.847+0000 7f24e69d19c0 20 add_watcher() i=7 2024-09-19T11:38:26.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.847+0000 7f24e69d19c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:26.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.851+0000 7f239a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:26.855 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.851+0000 7f24e69d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:26.855 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.851+0000 7f24e69d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:26.855 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.851+0000 7f24e69d19c0 5 note: GC not initialized 2024-09-19T11:38:26.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.851+0000 7f23997e2640 20 reqs_thread_entry: start 2024-09-19T11:38:26.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.851+0000 7f24e69d19c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:26.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.851+0000 7f24e69d19c0 20 Filter name: none 2024-09-19T11:38:26.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.851+0000 7f230affd640 20 reqs_thread_entry: start 2024-09-19T11:38:26.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.851+0000 7f24e69d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.851+0000 7f24e69d19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:26.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.851+0000 7f24e69d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:26.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.855+0000 7f24e69d19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:26.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.855+0000 7f24e69d19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:26.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.855+0000 7f24e69d19c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-19T11:38:26.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.855+0000 7f24e69d19c0 20 INFO: main: starting shard=0 2024-09-19T11:38:26.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.855+0000 7f24e69d19c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:26.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.855+0000 7f24e69d19c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T11:38:26.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.855+0000 7f24e69d19c0 20 INFO: main: done 2024-09-19T11:38:26.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.855+0000 7f239a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:26.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.863+0000 7f24e69d19c0 20 remove_watcher() i=0 2024-09-19T11:38:26.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.863+0000 7f24e69d19c0 2 removed watcher, disabling cache 2024-09-19T11:38:26.868 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.863+0000 7f24e69d19c0 20 remove_watcher() i=1 2024-09-19T11:38:26.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.867+0000 7f24e69d19c0 20 remove_watcher() i=2 2024-09-19T11:38:26.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.867+0000 7f24e69d19c0 20 remove_watcher() i=3 2024-09-19T11:38:26.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.871+0000 7f24e69d19c0 20 remove_watcher() i=4 2024-09-19T11:38:26.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.871+0000 7f24e69d19c0 20 remove_watcher() i=5 2024-09-19T11:38:26.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.875+0000 7f24e69d19c0 20 remove_watcher() i=6 2024-09-19T11:38:26.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:26.875+0000 7f24e69d19c0 20 remove_watcher() i=7 2024-09-19T11:38:26.901 INFO:tasks.workunit.client.0.smithi120.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-19T11:38:27.330 INFO:tasks.workunit.client.0.smithi120.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-19T11:38:27.765 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-19T11:38:27.795 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:27.795 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:27.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:27.831+0000 7f5210e1f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:27.836 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:27.831+0000 7f5210e1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:27.836 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:27.831+0000 7f5210e1f9c0 20 realm 2024-09-19T11:38:27.836 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:27.831+0000 7f5210e1f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:27.836 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:27.831+0000 7f5210e1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:27.836 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:27.831+0000 7f5210e1f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:27.836 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:27.831+0000 7f5210e1f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:27.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:27.831+0000 7f5210e1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:27.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:27.831+0000 7f5210e1f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:27.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:27.831+0000 7f5210e1f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:27.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:27.831+0000 7f5210e1f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:27.839 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:27.835+0000 7f5210e1f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:27.839 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:27.835+0000 7f5210e1f9c0 20 searching for the correct realm 2024-09-19T11:38:27.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:27.839+0000 7f520e925640 0 -- 172.21.15.120:0/3749374588 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f52080c7040 msgr2=0x7f52080fe3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:28.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.055+0000 7f520e925640 0 -- 172.21.15.120:0/3749374588 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f52080c7040 msgr2=0x7f52080fe3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:28.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.063+0000 7f5210e1f9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:28.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.063+0000 7f5210e1f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:28.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.063+0000 7f5210e1f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:28.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.063+0000 7f5210e1f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:28.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.063+0000 7f5210e1f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:28.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.063+0000 7f5210e1f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:28.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.063+0000 7f5210e1f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.071 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:28.071 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.071 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:28.071 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.071 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:28.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 20 zone default found 2024-09-19T11:38:28.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 4 Realm: () 2024-09-19T11:38:28.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:28.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:28.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:28.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 20 zonegroup default 2024-09-19T11:38:28.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:28.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:28.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:28.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 20 started sync module instance, tier type = 2024-09-19T11:38:28.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.067+0000 7f5210e1f9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:28.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.091+0000 7f5210e1f9c0 20 add_watcher() i=0 2024-09-19T11:38:28.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.091+0000 7f5210e1f9c0 20 add_watcher() i=1 2024-09-19T11:38:28.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.091+0000 7f5210e1f9c0 20 add_watcher() i=2 2024-09-19T11:38:28.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.091+0000 7f5210e1f9c0 20 add_watcher() i=3 2024-09-19T11:38:28.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.091+0000 7f5210e1f9c0 20 add_watcher() i=4 2024-09-19T11:38:28.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.091+0000 7f5210e1f9c0 20 add_watcher() i=5 2024-09-19T11:38:28.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.091+0000 7f5210e1f9c0 20 add_watcher() i=6 2024-09-19T11:38:28.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.095+0000 7f5210e1f9c0 20 add_watcher() i=7 2024-09-19T11:38:28.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.095+0000 7f5210e1f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:28.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.099+0000 7f50c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:28.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.099+0000 7f5210e1f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:28.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.099+0000 7f5210e1f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:28.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.099+0000 7f5210e1f9c0 5 note: GC not initialized 2024-09-19T11:38:28.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.099+0000 7f503ffff640 20 reqs_thread_entry: start 2024-09-19T11:38:28.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.099+0000 7f5210e1f9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:28.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f5210e1f9c0 20 Filter name: none 2024-09-19T11:38:28.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f503dffb640 20 reqs_thread_entry: start 2024-09-19T11:38:28.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f5210e1f9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T11:38:28.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f5210e1f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f5210e1f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:28.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f5210e1f9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T11:38:28.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f5210e1f9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T11:38:28.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f5210e1f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 : miss 2024-09-19T11:38:28.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f5210e1f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f5210e1f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:28.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f5210e1f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 info.flags=0x17 2024-09-19T11:38:28.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f5210e1f9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 to cache LRU end 2024-09-19T11:38:28.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f5210e1f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:38:28.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f5210e1f9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T11:38:28.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f5210e1f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 2024-09-19T11:38:28.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.103+0000 7f5210e1f9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.111+0000 7f50c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:28.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.115+0000 7f5210e1f9c0 20 remove_watcher() i=0 2024-09-19T11:38:28.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.115+0000 7f5210e1f9c0 2 removed watcher, disabling cache 2024-09-19T11:38:28.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.119+0000 7f5210e1f9c0 20 remove_watcher() i=1 2024-09-19T11:38:28.124 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.119+0000 7f5210e1f9c0 20 remove_watcher() i=2 2024-09-19T11:38:28.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.123+0000 7f5210e1f9c0 20 remove_watcher() i=3 2024-09-19T11:38:28.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.123+0000 7f5210e1f9c0 20 remove_watcher() i=4 2024-09-19T11:38:28.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.127+0000 7f5210e1f9c0 20 remove_watcher() i=5 2024-09-19T11:38:28.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.127+0000 7f5210e1f9c0 20 remove_watcher() i=6 2024-09-19T11:38:28.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.127+0000 7f5210e1f9c0 20 remove_watcher() i=7 2024-09-19T11:38:28.148 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-19T11:38:28.179 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:28.179 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:28.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.215+0000 7fbc6a1589c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.223 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.219+0000 7fbc6a1589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:28.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.219+0000 7fbc6a1589c0 20 realm 2024-09-19T11:38:28.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.219+0000 7fbc6a1589c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.219+0000 7fbc6a1589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:28.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.219+0000 7fbc6a1589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:28.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.219+0000 7fbc6a1589c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.219+0000 7fbc6a1589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:28.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.219+0000 7fbc6a1589c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.225 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.219+0000 7fbc6a1589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:28.225 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.219+0000 7fbc6a1589c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.223+0000 7fbc6a1589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:28.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.223+0000 7fbc6a1589c0 20 searching for the correct realm 2024-09-19T11:38:28.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.227+0000 7fbc67c5e640 0 -- 172.21.15.120:0/1220050369 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fbc600cd070 msgr2=0x7fbc600dc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:28.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.443+0000 7fbc67c5e640 0 -- 172.21.15.120:0/1220050369 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fbc600cd070 msgr2=0x7fbc600dc920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:28.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.451+0000 7fbc6a1589c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:28.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.451+0000 7fbc6a1589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:28.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.451+0000 7fbc6a1589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:28.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.451+0000 7fbc6a1589c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:28.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.451+0000 7fbc6a1589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:28.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.451+0000 7fbc6a1589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:28.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.451+0000 7fbc6a1589c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:28.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:28.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:28.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 20 zone default found 2024-09-19T11:38:28.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 4 Realm: () 2024-09-19T11:38:28.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:28.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:28.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:28.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 20 zonegroup default 2024-09-19T11:38:28.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:28.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:28.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:28.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 20 started sync module instance, tier type = 2024-09-19T11:38:28.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.455+0000 7fbc6a1589c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:28.485 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.479+0000 7fbc6a1589c0 20 add_watcher() i=0 2024-09-19T11:38:28.485 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.479+0000 7fbc6a1589c0 20 add_watcher() i=1 2024-09-19T11:38:28.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.479+0000 7fbc6a1589c0 20 add_watcher() i=2 2024-09-19T11:38:28.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.479+0000 7fbc6a1589c0 20 add_watcher() i=3 2024-09-19T11:38:28.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.479+0000 7fbc6a1589c0 20 add_watcher() i=4 2024-09-19T11:38:28.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.479+0000 7fbc6a1589c0 20 add_watcher() i=5 2024-09-19T11:38:28.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.479+0000 7fbc6a1589c0 20 add_watcher() i=6 2024-09-19T11:38:28.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.483+0000 7fbc6a1589c0 20 add_watcher() i=7 2024-09-19T11:38:28.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.483+0000 7fbc6a1589c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:28.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.487+0000 7fbb1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:28.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.487+0000 7fbc6a1589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:28.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.487+0000 7fbc6a1589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:28.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.487+0000 7fbc6a1589c0 5 note: GC not initialized 2024-09-19T11:38:28.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbb1cfe1640 20 reqs_thread_entry: start 2024-09-19T11:38:28.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:28.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 20 Filter name: none 2024-09-19T11:38:28.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fba967fc640 20 reqs_thread_entry: start 2024-09-19T11:38:28.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T11:38:28.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:28.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T11:38:28.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T11:38:28.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 : miss 2024-09-19T11:38:28.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:28.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 info.flags=0x17 2024-09-19T11:38:28.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 to cache LRU end 2024-09-19T11:38:28.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:38:28.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T11:38:28.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2 2024-09-19T11:38:28.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.491+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.495+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.495+0000 7fbc6a1589c0 20 get_obj_state: octx=0x55de630dfea0 obj=check-bucket:c state=0x55de633952e8 s->prefetch_data=0 2024-09-19T11:38:28.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.495+0000 7fbc6a1589c0 20 get_obj_state: setting s->obj_tag to awbkmu8jxiv1f0y0j0lqt77k7p5vbmr0 2024-09-19T11:38:28.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.495+0000 7fbc6a1589c0 20 get_obj_state_impl: setting s->olh_tag to 6p0gtwu5jdyarr2g5pcvtxd7rnheho7g 2024-09-19T11:38:28.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.495+0000 7fbc6a1589c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6p0gtwu5jdyarr2g5pcvtxd7rnheho7g 2024-09-19T11:38:28.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.499+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.499+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.499+0000 7fbc6a1589c0 20 olh_log_entry: epoch=3 op=3 key=c[zQxTLJpM0pMB3pfEf5T7cab5iDmeeyW] 2024-09-19T11:38:28.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.499+0000 7fbc6a1589c0 20 get_obj_state: octx=0x55de630dfea0 obj=check-bucket:_:zQxTLJpM0pMB3pfEf5T7cab5iDmeeyW_c state=0x55de6338fc68 s->prefetch_data=0 2024-09-19T11:38:28.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.503+0000 7fbc6a1589c0 10 manifest: total_size = 22 2024-09-19T11:38:28.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.503+0000 7fbc6a1589c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2299989490992366456 2024-09-19T11:38:28.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.503+0000 7fbc6a1589c0 20 get_obj_state: octx=0x55de630dfea0 obj=check-bucket:_:zQxTLJpM0pMB3pfEf5T7cab5iDmeeyW_c state=0x55de6338fc68 s->prefetch_data=0 2024-09-19T11:38:28.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.503+0000 7fbc6a1589c0 20 prepare_atomic_modification: state is not atomic. state=0x55de6338fc68 2024-09-19T11:38:28.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.503+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.507+0000 7fbc6a1589c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:38:28.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.507+0000 7fbc6a1589c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-19T11:38:28.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.507+0000 7fbc6a1589c0 0 deleting objects inline since gc isn't initialized 2024-09-19T11:38:28.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.507+0000 7fbc6a1589c0 5 delete_objs_inline: removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2__shadow:zQxTLJpM0pMB3pfEf5T7cab5iDmeeyW_.OPv42zGa8SMXWEm7GIVl_8Kh6EwEU7w_0 2024-09-19T11:38:28.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.507+0000 7fbb46ffd640 20 handle_completion(): completion ok for obj=c[zQxTLJpM0pMB3pfEf5T7cab5iDmeeyW] 2024-09-19T11:38:28.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.511+0000 7fbc6a1589c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T11:38:28.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.515+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.515+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.519+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.519+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.519+0000 7fbc6a1589c0 20 get_obj_state: octx=0x55de630dfea0 obj=check-bucket:d state=0x55de63394dd8 s->prefetch_data=0 2024-09-19T11:38:28.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.519+0000 7fbc6a1589c0 20 get_obj_state: setting s->obj_tag to 3nem29zv6e2wbjrzm5iu95kr5e827le6 2024-09-19T11:38:28.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.519+0000 7fbc6a1589c0 20 get_obj_state_impl: setting s->olh_tag to n2by23ycuhf0ywn1qs3p3bw74tp3za6o 2024-09-19T11:38:28.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.519+0000 7fbc6a1589c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=n2by23ycuhf0ywn1qs3p3bw74tp3za6o 2024-09-19T11:38:28.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.523+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.527+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.527+0000 7fbc6a1589c0 20 olh_log_entry: epoch=3 op=3 key=d[2PUScxqxK6WlAsv9ER7oBfX1pEu3Sxq] 2024-09-19T11:38:28.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.527+0000 7fbc6a1589c0 20 get_obj_state: octx=0x55de630dfea0 obj=check-bucket:_:2PUScxqxK6WlAsv9ER7oBfX1pEu3Sxq_d state=0x55de6338fc68 s->prefetch_data=0 2024-09-19T11:38:28.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.527+0000 7fbc6a1589c0 10 manifest: total_size = 11 2024-09-19T11:38:28.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.527+0000 7fbc6a1589c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14919297036988811253 2024-09-19T11:38:28.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.527+0000 7fbc6a1589c0 20 get_obj_state: octx=0x55de630dfea0 obj=check-bucket:_:2PUScxqxK6WlAsv9ER7oBfX1pEu3Sxq_d state=0x55de6338fc68 s->prefetch_data=0 2024-09-19T11:38:28.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.527+0000 7fbc6a1589c0 20 prepare_atomic_modification: state is not atomic. state=0x55de6338fc68 2024-09-19T11:38:28.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.527+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.531+0000 7fbc6a1589c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:38:28.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.531+0000 7fbc6a1589c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-19T11:38:28.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.531+0000 7fbc6a1589c0 0 deleting objects inline since gc isn't initialized 2024-09-19T11:38:28.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.531+0000 7fbc6a1589c0 5 delete_objs_inline: removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2__shadow:2PUScxqxK6WlAsv9ER7oBfX1pEu3Sxq_.yhZO39U-tdJM5AkALS2GzJlAKIuikP0_0 2024-09-19T11:38:28.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.535+0000 7fbb46ffd640 20 handle_completion(): completion ok for obj=d[2PUScxqxK6WlAsv9ER7oBfX1pEu3Sxq] 2024-09-19T11:38:28.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.535+0000 7fbc6a1589c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T11:38:28.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.539+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.539+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.539+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.545 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.539+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.545 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.539+0000 7fbc6a1589c0 20 get_obj_state: octx=0x55de630dfea0 obj=check-bucket:e state=0x55de63394dd8 s->prefetch_data=0 2024-09-19T11:38:28.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.543+0000 7fbc6a1589c0 20 get_obj_state: setting s->obj_tag to za2fc7nfepolxrwgxpyznawus17iqvid 2024-09-19T11:38:28.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.543+0000 7fbc6a1589c0 20 get_obj_state_impl: setting s->olh_tag to 39eu5b3dsg796xrou9hacxrns0gj4vap 2024-09-19T11:38:28.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.543+0000 7fbc6a1589c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=39eu5b3dsg796xrou9hacxrns0gj4vap 2024-09-19T11:38:28.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.543+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.551 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.547+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.547+0000 7fbc6a1589c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-19T11:38:28.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.547+0000 7fbc6a1589c0 20 olh_log_entry: epoch=2 op=3 key=e[yaGBzMdFuV4SvNxHUznDa8yawS0BV3j] 2024-09-19T11:38:28.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.547+0000 7fbc6a1589c0 20 get_obj_state: octx=0x55de630dfea0 obj=check-bucket:_:yaGBzMdFuV4SvNxHUznDa8yawS0BV3j_e state=0x55de6338fc68 s->prefetch_data=0 2024-09-19T11:38:28.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.547+0000 7fbc6a1589c0 10 manifest: total_size = 11 2024-09-19T11:38:28.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.547+0000 7fbc6a1589c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.428148571953640881 2024-09-19T11:38:28.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.547+0000 7fbc6a1589c0 20 get_obj_state: octx=0x55de630dfea0 obj=check-bucket:_:yaGBzMdFuV4SvNxHUznDa8yawS0BV3j_e state=0x55de6338fc68 s->prefetch_data=0 2024-09-19T11:38:28.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.547+0000 7fbc6a1589c0 20 prepare_atomic_modification: state is not atomic. state=0x55de6338fc68 2024-09-19T11:38:28.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.547+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.551+0000 7fbc6a1589c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:38:28.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.551+0000 7fbc6a1589c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-19T11:38:28.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.551+0000 7fbc6a1589c0 0 deleting objects inline since gc isn't initialized 2024-09-19T11:38:28.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.551+0000 7fbc6a1589c0 5 delete_objs_inline: removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2__shadow:yaGBzMdFuV4SvNxHUznDa8yawS0BV3j_.Fy2WU9ATNsOhpsgS9vPDPCy_41pJLvG_0 2024-09-19T11:38:28.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.555+0000 7fbb46ffd640 20 handle_completion(): completion ok for obj=e[yaGBzMdFuV4SvNxHUznDa8yawS0BV3j] 2024-09-19T11:38:28.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.555+0000 7fbc6a1589c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T11:38:28.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.559+0000 7fbc6a1589c0 20 get_obj_state: octx=0x55de630dfea0 obj=check-bucket:e state=0x55de63394dd8 s->prefetch_data=0 2024-09-19T11:38:28.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.559+0000 7fbc6a1589c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=39eu5b3dsg796xrou9hacxrns0gj4vap 2024-09-19T11:38:28.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.567+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.573 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.567+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.573 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.567+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.571+0000 7fbc6a1589c0 20 get_obj_state: octx=0x55de630dfea0 obj=check-bucket:f state=0x55de63394dd8 s->prefetch_data=0 2024-09-19T11:38:28.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.571+0000 7fbc6a1589c0 20 get_obj_state: setting s->obj_tag to wstxau7wl4l9fihw4c4cingy7ctwkucs 2024-09-19T11:38:28.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.571+0000 7fbc6a1589c0 20 get_obj_state_impl: setting s->olh_tag to 8vivawso3gxrs2qk27lk31yx9pcv22u2 2024-09-19T11:38:28.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.571+0000 7fbc6a1589c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8vivawso3gxrs2qk27lk31yx9pcv22u2 2024-09-19T11:38:28.577 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.571+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.580 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.575+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.575+0000 7fbc6a1589c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-19T11:38:28.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.575+0000 7fbc6a1589c0 20 olh_log_entry: epoch=2 op=3 key=f[GPBmY2mouoDv7bM3LZ51scc33AIflUU] 2024-09-19T11:38:28.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.575+0000 7fbc6a1589c0 20 get_obj_state: octx=0x55de630dfea0 obj=check-bucket:_:GPBmY2mouoDv7bM3LZ51scc33AIflUU_f state=0x55de6338fc68 s->prefetch_data=0 2024-09-19T11:38:28.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.579+0000 7fbc6a1589c0 10 manifest: total_size = 12 2024-09-19T11:38:28.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.579+0000 7fbc6a1589c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6551376847060306128 2024-09-19T11:38:28.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.579+0000 7fbc6a1589c0 20 get_obj_state: octx=0x55de630dfea0 obj=check-bucket:_:GPBmY2mouoDv7bM3LZ51scc33AIflUU_f state=0x55de6338fc68 s->prefetch_data=0 2024-09-19T11:38:28.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.579+0000 7fbc6a1589c0 20 prepare_atomic_modification: state is not atomic. state=0x55de6338fc68 2024-09-19T11:38:28.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.579+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.583+0000 7fbc6a1589c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:38:28.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.583+0000 7fbc6a1589c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-19T11:38:28.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.583+0000 7fbc6a1589c0 0 deleting objects inline since gc isn't initialized 2024-09-19T11:38:28.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.583+0000 7fbc6a1589c0 5 delete_objs_inline: removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2__shadow:GPBmY2mouoDv7bM3LZ51scc33AIflUU_.GN0hqlZK6cvSaNdVrnbZ_HgYodQI4kx_0 2024-09-19T11:38:28.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.587+0000 7fbb46ffd640 20 handle_completion(): completion ok for obj=f[GPBmY2mouoDv7bM3LZ51scc33AIflUU] 2024-09-19T11:38:28.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.587+0000 7fbc6a1589c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T11:38:28.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.591+0000 7fbc6a1589c0 20 get_obj_state: octx=0x55de630dfea0 obj=check-bucket:f state=0x55de63394dd8 s->prefetch_data=0 2024-09-19T11:38:28.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.591+0000 7fbc6a1589c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8vivawso3gxrs2qk27lk31yx9pcv22u2 2024-09-19T11:38:28.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.603+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.607+0000 7fbc6a1589c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2.0 2024-09-19T11:38:28.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.607+0000 7fbc6a1589c0 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-19T11:38:28.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.607+0000 7fbc6a1589c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-19T11:38:28.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.607+0000 7fbb1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:28.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.611+0000 7fbc6a1589c0 20 remove_watcher() i=0 2024-09-19T11:38:28.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.611+0000 7fbc6a1589c0 2 removed watcher, disabling cache 2024-09-19T11:38:28.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.615+0000 7fbc6a1589c0 20 remove_watcher() i=1 2024-09-19T11:38:28.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.619+0000 7fbc6a1589c0 20 remove_watcher() i=2 2024-09-19T11:38:28.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.619+0000 7fbc6a1589c0 20 remove_watcher() i=3 2024-09-19T11:38:28.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.623+0000 7fbc6a1589c0 20 remove_watcher() i=4 2024-09-19T11:38:28.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.623+0000 7fbc6a1589c0 20 remove_watcher() i=5 2024-09-19T11:38:28.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.627+0000 7fbc6a1589c0 20 remove_watcher() i=6 2024-09-19T11:38:28.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.627+0000 7fbc6a1589c0 20 remove_watcher() i=7 2024-09-19T11:38:28.739 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-19T11:38:28.767 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:38:28.767 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:38:28.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.807+0000 7fb4453699c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.807+0000 7fb4453699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:28.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.807+0000 7fb4453699c0 20 realm 2024-09-19T11:38:28.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.807+0000 7fb4453699c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.807+0000 7fb4453699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:28.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.807+0000 7fb4453699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:38:28.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.807+0000 7fb4453699c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.811+0000 7fb4453699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:28.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.811+0000 7fb4453699c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.811+0000 7fb4453699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:28.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.811+0000 7fb4453699c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:28.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.811+0000 7fb4453699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:38:28.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.811+0000 7fb4453699c0 20 searching for the correct realm 2024-09-19T11:38:28.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:28.815+0000 7fb442e6f640 0 -- 172.21.15.120:0/200721591 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fb43c0e3410 msgr2=0x7fb43c0e3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:38:29.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.031+0000 7fb442e6f640 0 -- 172.21.15.120:0/200721591 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fb43c0e3410 msgr2=0x7fb43c0e3830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:38:29.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.043+0000 7fb4453699c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:38:29.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.043+0000 7fb4453699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:38:29.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.043+0000 7fb4453699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:38:29.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.043+0000 7fb4453699c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:38:29.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.043+0000 7fb4453699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:38:29.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.043+0000 7fb4453699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:38:29.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.043+0000 7fb4453699c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:29.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.043+0000 7fb4453699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:29.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.043+0000 7fb4453699c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:29.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.043+0000 7fb4453699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:38:29.050 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.043+0000 7fb4453699c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:29.050 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.047+0000 7fb4453699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:38:29.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.047+0000 7fb4453699c0 20 zone default found 2024-09-19T11:38:29.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.047+0000 7fb4453699c0 4 Realm: () 2024-09-19T11:38:29.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.047+0000 7fb4453699c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:38:29.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.047+0000 7fb4453699c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:38:29.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.047+0000 7fb4453699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:38:29.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.047+0000 7fb4453699c0 20 zonegroup default 2024-09-19T11:38:29.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.047+0000 7fb4453699c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:29.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.047+0000 7fb4453699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:29.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.047+0000 7fb4453699c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:29.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.047+0000 7fb4453699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:29.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.047+0000 7fb4453699c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:29.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.047+0000 7fb4453699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:38:29.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.047+0000 7fb4453699c0 20 started sync module instance, tier type = 2024-09-19T11:38:29.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.047+0000 7fb4453699c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:38:29.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.071+0000 7fb4453699c0 20 add_watcher() i=0 2024-09-19T11:38:29.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.071+0000 7fb4453699c0 20 add_watcher() i=1 2024-09-19T11:38:29.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.071+0000 7fb4453699c0 20 add_watcher() i=2 2024-09-19T11:38:29.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.071+0000 7fb4453699c0 20 add_watcher() i=3 2024-09-19T11:38:29.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.071+0000 7fb4453699c0 20 add_watcher() i=4 2024-09-19T11:38:29.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.071+0000 7fb4453699c0 20 add_watcher() i=5 2024-09-19T11:38:29.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.071+0000 7fb4453699c0 20 add_watcher() i=6 2024-09-19T11:38:29.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.075+0000 7fb4453699c0 20 add_watcher() i=7 2024-09-19T11:38:29.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.075+0000 7fb4453699c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:38:29.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.079+0000 7fb2f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:29.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.079+0000 7fb4453699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:38:29.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.079+0000 7fb4453699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:38:29.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.079+0000 7fb4453699c0 5 note: GC not initialized 2024-09-19T11:38:29.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.079+0000 7fb273fff640 20 reqs_thread_entry: start 2024-09-19T11:38:29.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.079+0000 7fb4453699c0 20 init_complete bucket index max shards: 1 2024-09-19T11:38:29.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.079+0000 7fb4453699c0 20 Filter name: none 2024-09-19T11:38:29.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.079+0000 7fb271ffb640 20 reqs_thread_entry: start 2024-09-19T11:38:29.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.079+0000 7fb4453699c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:29.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.083+0000 7fb4453699c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:29.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.083+0000 7fb4453699c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:29.087 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.083+0000 7fb4453699c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:29.087 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.083+0000 7fb4453699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:29.087 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.083+0000 7fb4453699c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:29.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.083+0000 7fb4453699c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T11:38:29.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.083+0000 7fb4453699c0 20 rados->read ofs=0 len=0 2024-09-19T11:38:29.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.083+0000 7fb4453699c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T11:38:29.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.083+0000 7fb4453699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:38:29.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.087+0000 7fb2f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:38:29.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.091+0000 7fb4453699c0 20 remove_watcher() i=0 2024-09-19T11:38:29.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.091+0000 7fb4453699c0 2 removed watcher, disabling cache 2024-09-19T11:38:29.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.095+0000 7fb4453699c0 20 remove_watcher() i=1 2024-09-19T11:38:29.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.095+0000 7fb4453699c0 20 remove_watcher() i=2 2024-09-19T11:38:29.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.099+0000 7fb4453699c0 20 remove_watcher() i=3 2024-09-19T11:38:29.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.099+0000 7fb4453699c0 20 remove_watcher() i=4 2024-09-19T11:38:29.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.103+0000 7fb4453699c0 20 remove_watcher() i=5 2024-09-19T11:38:29.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.103+0000 7fb4453699c0 20 remove_watcher() i=6 2024-09-19T11:38:29.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:38:29.103+0000 7fb4453699c0 20 remove_watcher() i=7 2024-09-19T11:38:29.124 INFO:tasks.workunit.client.0.smithi120.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-19T11:38:29.124 INFO:tasks.workunit.client.0.smithi120.stderr:Deleting bucket check-bucket 2024-09-19T11:38:29.156 INFO:tasks.workunit.client.0.smithi120.stderr:Completed bucket check tests 2024-09-19T11:38:29.156 INFO:tasks.workunit.client.0.smithi120.stdout:connected to http://localhost:80 2024-09-19T11:38:29.245 INFO:tasks.workunit.client.0.smithi120.stderr:+ deactivate 2024-09-19T11:38:29.245 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-19T11:38:29.245 INFO:tasks.workunit.client.0.smithi120.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T11:38:29.245 INFO:tasks.workunit.client.0.smithi120.stderr:+ export PATH 2024-09-19T11:38:29.245 INFO:tasks.workunit.client.0.smithi120.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-19T11:38:29.245 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' -n '' ']' 2024-09-19T11:38:29.245 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T11:38:29.245 INFO:tasks.workunit.client.0.smithi120.stderr:+ hash -r 2024-09-19T11:38:29.246 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' -n '' ']' 2024-09-19T11:38:29.246 INFO:tasks.workunit.client.0.smithi120.stderr:+ unset VIRTUAL_ENV 2024-09-19T11:38:29.246 INFO:tasks.workunit.client.0.smithi120.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-19T11:38:29.246 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-19T11:38:29.246 INFO:tasks.workunit.client.0.smithi120.stderr:+ unset -f deactivate 2024-09-19T11:38:29.246 INFO:tasks.workunit.client.0.smithi120.stderr:+ echo OK. 2024-09-19T11:38:29.247 INFO:tasks.workunit.client.0.smithi120.stdout:OK. 2024-09-19T11:38:29.247 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:38:29.247 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:38:29.303 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-19T11:38:29.303 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T11:38:29.686 DEBUG:teuthology.parallel:result is None 2024-09-19T11:38:29.687 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T11:38:29.698 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T11:38:29.698 DEBUG:teuthology.orchestra.run.smithi120:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T11:38:29.746 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T11:38:29.746 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T11:38:29.757 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:38:29.757 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T11:38:29.757 DEBUG:teuthology.orchestra.run.smithi120:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T11:38:29.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:38:29.794 INFO:teuthology.orchestra.run.smithi120.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T11:38:29.794 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T11:38:29.842 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T11:38:29.842 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T11:38:29.891 INFO:tasks.workunit:timeout=3h 2024-09-19T11:38:29.891 INFO:tasks.workunit:cleanup=True 2024-09-19T11:38:29.892 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:38:29.940 INFO:tasks.workunit.client.0.smithi120.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T11:39:28.289 INFO:tasks.workunit.client.0.smithi120.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T11:39:28.289 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:39:28.289 INFO:tasks.workunit.client.0.smithi120.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T11:39:28.289 INFO:tasks.workunit.client.0.smithi120.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T11:39:28.289 INFO:tasks.workunit.client.0.smithi120.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T11:39:28.290 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:39:28.290 INFO:tasks.workunit.client.0.smithi120.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T11:39:28.290 INFO:tasks.workunit.client.0.smithi120.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T11:39:28.290 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:39:28.290 INFO:tasks.workunit.client.0.smithi120.stderr: git switch -c 2024-09-19T11:39:28.290 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:39:28.290 INFO:tasks.workunit.client.0.smithi120.stderr:Or undo this operation with: 2024-09-19T11:39:28.290 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:39:28.290 INFO:tasks.workunit.client.0.smithi120.stderr: git switch - 2024-09-19T11:39:28.290 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:39:28.290 INFO:tasks.workunit.client.0.smithi120.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T11:39:28.290 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:39:28.290 INFO:tasks.workunit.client.0.smithi120.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T11:39:28.297 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T11:39:28.344 INFO:tasks.workunit.client.0.smithi120.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T11:39:28.347 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T11:39:28.347 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T11:39:28.401 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T11:39:28.456 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T11:39:28.499 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T11:39:28.501 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T11:39:28.501 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T11:39:28.546 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T11:39:28.549 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:39:28.550 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T11:39:28.598 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-19T11:39:28.599 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-19T11:39:28.599 DEBUG:teuthology.orchestra.run.smithi120:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-19T11:39:28.658 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-19T11:39:28.659 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-19T11:39:28.659 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:39:28.659 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 11 tests from ClsLock 2024-09-19T11:39:28.659 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-19T11:39:30.049 INFO:tasks.workunit.client.0.smithi120.stdout:lock: mylock 2024-09-19T11:39:30.049 INFO:tasks.workunit.client.0.smithi120.stdout: lock_type: exclusive 2024-09-19T11:39:30.049 INFO:tasks.workunit.client.0.smithi120.stdout: tag: 2024-09-19T11:39:30.049 INFO:tasks.workunit.client.0.smithi120.stdout: lockers: 2024-09-19T11:39:30.050 INFO:tasks.workunit.client.0.smithi120.stdout: client.5042 expiration=2024-09-19T11:41:30.043550+0000 addr=v1:172.21.15.120:0/1521271296 cookie= 2024-09-19T11:39:30.057 INFO:tasks.workunit.client.0.smithi120.stdout:lock: mylock 2024-09-19T11:39:30.057 INFO:tasks.workunit.client.0.smithi120.stdout: lock_type: shared 2024-09-19T11:39:30.057 INFO:tasks.workunit.client.0.smithi120.stdout: tag: 2024-09-19T11:39:30.057 INFO:tasks.workunit.client.0.smithi120.stdout: lockers: 2024-09-19T11:39:30.057 INFO:tasks.workunit.client.0.smithi120.stdout: client.5042 expiration=2024-09-19T11:41:30.054933+0000 addr=v1:172.21.15.120:0/1521271296 cookie= 2024-09-19T11:39:30.057 INFO:tasks.workunit.client.0.smithi120.stdout: client.5048 expiration=0.000000 addr=v1:172.21.15.120:0/1072801077 cookie= 2024-09-19T11:39:30.059 INFO:tasks.workunit.client.0.smithi120.stdout:lock: mylock 2024-09-19T11:39:30.059 INFO:tasks.workunit.client.0.smithi120.stdout: lock_type: shared 2024-09-19T11:39:30.059 INFO:tasks.workunit.client.0.smithi120.stdout: tag: 2024-09-19T11:39:30.059 INFO:tasks.workunit.client.0.smithi120.stdout: lockers: 2024-09-19T11:39:30.059 INFO:tasks.workunit.client.0.smithi120.stdout: client.5048 expiration=0.000000 addr=v1:172.21.15.120:0/1072801077 cookie= 2024-09-19T11:39:31.021 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] ClsLock.TestMultiLocking (2362 ms) 2024-09-19T11:39:31.021 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] ClsLock.TestMeta 2024-09-19T11:39:33.310 INFO:tasks.workunit.client.0.smithi120.stdout:lock: mylock 2024-09-19T11:39:33.310 INFO:tasks.workunit.client.0.smithi120.stdout: lock_type: shared 2024-09-19T11:39:33.310 INFO:tasks.workunit.client.0.smithi120.stdout: tag: 2024-09-19T11:39:33.310 INFO:tasks.workunit.client.0.smithi120.stdout: lockers: 2024-09-19T11:39:33.310 INFO:tasks.workunit.client.0.smithi120.stdout: client.5057 expiration=0.000000 addr=v1:172.21.15.120:0/3631796489 cookie= 2024-09-19T11:39:33.319 INFO:tasks.workunit.client.0.smithi120.stdout:lock: mylock 2024-09-19T11:39:33.320 INFO:tasks.workunit.client.0.smithi120.stdout: lock_type: exclusive 2024-09-19T11:39:33.320 INFO:tasks.workunit.client.0.smithi120.stdout: tag: new_tag 2024-09-19T11:39:33.320 INFO:tasks.workunit.client.0.smithi120.stdout: lockers: 2024-09-19T11:39:33.320 INFO:tasks.workunit.client.0.smithi120.stdout: client.5054 expiration=0.000000 addr=v1:172.21.15.120:0/2021182243 cookie= 2024-09-19T11:39:34.044 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] ClsLock.TestMeta (3023 ms) 2024-09-19T11:39:34.044 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] ClsLock.TestCookie 2024-09-19T11:39:36.098 INFO:tasks.workunit.client.0.smithi120.stdout:lock: mylock 2024-09-19T11:39:36.098 INFO:tasks.workunit.client.0.smithi120.stdout: lock_type: exclusive 2024-09-19T11:39:36.098 INFO:tasks.workunit.client.0.smithi120.stdout: tag: 2024-09-19T11:39:36.098 INFO:tasks.workunit.client.0.smithi120.stdout: lockers: 2024-09-19T11:39:36.103 INFO:tasks.workunit.client.0.smithi120.stdout:lock: mylock 2024-09-19T11:39:36.104 INFO:tasks.workunit.client.0.smithi120.stdout: lock_type: shared 2024-09-19T11:39:36.104 INFO:tasks.workunit.client.0.smithi120.stdout: tag: 2024-09-19T11:39:36.104 INFO:tasks.workunit.client.0.smithi120.stdout: lockers: 2024-09-19T11:39:36.104 INFO:tasks.workunit.client.0.smithi120.stdout: client.5063 expiration=0.000000 addr=v1:172.21.15.120:0/835332144 cookie= 2024-09-19T11:39:36.104 INFO:tasks.workunit.client.0.smithi120.stdout: client.5063 expiration=0.000000 addr=v1:172.21.15.120:0/835332144 cookie=new cookie 2024-09-19T11:39:37.075 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] ClsLock.TestCookie (3032 ms) 2024-09-19T11:39:37.076 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-19T11:39:40.136 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] ClsLock.TestMultipleLocks (3060 ms) 2024-09-19T11:39:40.136 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-19T11:39:48.204 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] ClsLock.TestLockDuration (8068 ms) 2024-09-19T11:39:48.205 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-19T11:39:51.243 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] ClsLock.TestAssertLocked (3039 ms) 2024-09-19T11:39:51.243 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-19T11:39:54.275 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] ClsLock.TestSetCookie (3032 ms) 2024-09-19T11:39:54.275 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] ClsLock.TestRenew 2024-09-19T11:40:15.374 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] ClsLock.TestRenew (21096 ms) 2024-09-19T11:40:15.374 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-19T11:40:22.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7071 ms) 2024-09-19T11:40:22.443 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-19T11:40:30.495 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8053 ms) 2024-09-19T11:40:30.495 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-19T11:40:38.537 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8042 ms) 2024-09-19T11:40:38.537 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 11 tests from ClsLock (69878 ms total) 2024-09-19T11:40:38.537 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:40:38.537 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:40:38.538 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 11 tests from 1 test suite ran. (69878 ms total) 2024-09-19T11:40:38.538 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 11 tests. 2024-09-19T11:40:38.543 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:40:38.543 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:40:38.603 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-19T11:40:38.605 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-19T11:40:38.605 DEBUG:teuthology.orchestra.run.smithi120:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-19T11:40:38.668 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-19T11:40:38.669 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-19T11:40:38.669 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:40:38.669 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from cls_log 2024-09-19T11:40:38.669 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-19T11:40:41.581 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_log.test_log_add_same_time (2912 ms) 2024-09-19T11:40:41.581 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-19T11:40:44.594 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_log.test_log_add_different_time (3013 ms) 2024-09-19T11:40:44.594 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_log.trim_by_time 2024-09-19T11:40:47.620 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_log.trim_by_time (3026 ms) 2024-09-19T11:40:47.620 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-19T11:40:50.656 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_log.trim_by_marker (3036 ms) 2024-09-19T11:40:50.656 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from cls_log (11987 ms total) 2024-09-19T11:40:50.656 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:40:50.656 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:40:50.656 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 4 tests from 1 test suite ran. (11987 ms total) 2024-09-19T11:40:50.656 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 4 tests. 2024-09-19T11:40:50.663 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:40:50.663 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:40:50.719 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-19T11:40:50.720 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-19T11:40:50.720 DEBUG:teuthology.orchestra.run.smithi120:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-19T11:40:50.783 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-19T11:40:50.784 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-19T11:40:50.784 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:40:50.784 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 10 tests from cls_refcount 2024-09-19T11:40:50.784 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-19T11:40:53.696 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_refcount.test_implicit (2913 ms) 2024-09-19T11:40:53.696 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-19T11:40:56.750 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3053 ms) 2024-09-19T11:40:56.750 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-19T11:41:04.912 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_refcount.test_put_snap (8160 ms) 2024-09-19T11:41:04.912 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-19T11:41:07.947 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_refcount.test_explicit (3037 ms) 2024-09-19T11:41:07.947 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_refcount.set 2024-09-19T11:41:10.955 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_refcount.set (3008 ms) 2024-09-19T11:41:10.955 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-19T11:41:18.079 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_refcount.test_implicit_ec (7124 ms) 2024-09-19T11:41:18.079 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-19T11:41:25.122 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7044 ms) 2024-09-19T11:41:25.123 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-19T11:41:38.230 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_refcount.test_put_snap_ec (13107 ms) 2024-09-19T11:41:38.230 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-19T11:41:45.265 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_refcount.test_explicit_ec (7036 ms) 2024-09-19T11:41:45.265 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_refcount.set_ec 2024-09-19T11:41:52.356 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_refcount.set_ec (7091 ms) 2024-09-19T11:41:52.357 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 10 tests from cls_refcount (61573 ms total) 2024-09-19T11:41:52.357 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:41:52.357 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:41:52.357 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 10 tests from 1 test suite ran. (61573 ms total) 2024-09-19T11:41:52.357 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 10 tests. 2024-09-19T11:41:52.361 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:41:52.361 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:41:52.418 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-19T11:41:52.419 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-19T11:41:52.420 DEBUG:teuthology.orchestra.run.smithi120:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-19T11:41:52.484 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-19T11:41:52.484 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-19T11:41:52.484 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:41:52.484 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 18 tests from cls_rgw 2024-09-19T11:41:54.398 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.index_basic 2024-09-19T11:41:54.440 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.index_basic (42 ms) 2024-09-19T11:41:54.441 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-19T11:41:54.527 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (86 ms) 2024-09-19T11:41:54.527 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-19T11:41:54.638 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.index_remove_object (111 ms) 2024-09-19T11:41:54.638 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-19T11:41:57.101 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.index_suggest (2463 ms) 2024-09-19T11:41:57.101 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-19T11:41:57.117 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.index_suggest_complete (16 ms) 2024-09-19T11:41:57.117 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.index_list 2024-09-19T11:41:57.191 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.index_list (74 ms) 2024-09-19T11:41:57.191 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-19T11:42:42.486 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.index_list_delimited (45294 ms) 2024-09-19T11:42:42.486 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.bi_list 2024-09-19T11:42:42.636 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.bi_list (151 ms) 2024-09-19T11:42:42.637 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.gc_set 2024-09-19T11:42:42.656 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.gc_set (19 ms) 2024-09-19T11:42:42.656 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.gc_list 2024-09-19T11:42:42.674 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.gc_list (19 ms) 2024-09-19T11:42:42.674 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-19T11:42:50.570 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.gc_defer (7896 ms) 2024-09-19T11:42:50.571 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-19T11:42:50.773 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.usage_basic (203 ms) 2024-09-19T11:42:50.773 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-19T11:42:50.776 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.usage_clear_no_obj (3 ms) 2024-09-19T11:42:50.776 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-19T11:42:50.987 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.usage_clear (211 ms) 2024-09-19T11:42:50.988 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-19T11:42:51.317 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.bi_log_trim (329 ms) 2024-09-19T11:42:51.318 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-19T11:42:51.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.index_racing_removes (34 ms) 2024-09-19T11:42:51.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-19T11:42:51.384 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.reshardlog_list (34 ms) 2024-09-19T11:42:51.384 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-19T11:42:51.414 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw.reshardlog_num (29 ms) 2024-09-19T11:42:51.584 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 18 tests from cls_rgw (57016 ms total) 2024-09-19T11:42:51.584 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:42:51.584 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:42:51.584 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 18 tests from 1 test suite ran. (59100 ms total) 2024-09-19T11:42:51.584 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 18 tests. 2024-09-19T11:42:51.593 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:42:51.593 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:42:51.649 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-19T11:42:51.651 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-19T11:42:51.651 DEBUG:teuthology.orchestra.run.smithi120:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-19T11:42:51.718 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-19T11:42:51.718 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-19T11:42:51.719 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:42:51.719 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-19T11:42:51.719 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw_gc.init 2024-09-19T11:42:53.586 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw_gc.init (1867 ms) 2024-09-19T11:42:53.586 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-19T11:42:53.622 INFO:tasks.workunit.client.0.smithi120.stderr:[ ] list info tag = chain-0 2024-09-19T11:42:53.622 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (36 ms) 2024-09-19T11:42:53.622 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-19T11:42:53.634 INFO:tasks.workunit.client.0.smithi120.stderr:[ ] next_marker is: = 0/4263 2024-09-19T11:42:53.635 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (14 ms) 2024-09-19T11:42:53.635 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-19T11:42:53.650 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (15 ms) 2024-09-19T11:42:53.650 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-19T11:42:53.917 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (267 ms) 2024-09-19T11:42:53.918 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-19T11:42:53.937 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (20 ms) 2024-09-19T11:42:53.937 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-19T11:42:53.956 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (18 ms) 2024-09-19T11:42:53.956 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-19T11:42:53.975 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (19 ms) 2024-09-19T11:42:53.975 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-19T11:42:54.591 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw_gc.finalize (611 ms) 2024-09-19T11:42:54.592 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 9 tests from cls_rgw_gc (2868 ms total) 2024-09-19T11:42:54.592 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:42:54.592 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:42:54.592 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 9 tests from 1 test suite ran. (2868 ms total) 2024-09-19T11:42:54.592 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 9 tests. 2024-09-19T11:42:54.593 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:42:54.593 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:42:54.650 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-19T11:42:54.651 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-19T11:42:54.651 DEBUG:teuthology.orchestra.run.smithi120:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-19T11:42:54.724 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:42:54.724 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:42:54.724 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 1 test from 1 test suite. 2024-09-19T11:42:54.724 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:42:56.606 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from cls_rgw_stats 2024-09-19T11:42:56.606 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-19T11:42:56.643 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.638+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~ZF7W6DKCET0P.0 size=11066 2024-09-19T11:42:56.643 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.638+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=ZF7W6DKCET0P tag=RUFHEEAF9NVK type=write size=1059642 2024-09-19T11:42:56.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.642+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=VY4ZA0TCKH2U type=write size=203679 2024-09-19T11:42:56.647 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.642+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=HQXLNPZF4614 type=del size=2238854 2024-09-19T11:42:56.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.646+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~WMLLWQRKJ75D.0 size=1048576 2024-09-19T11:42:56.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.650+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~WMLLWQRKJ75D.1 size=194615 2024-09-19T11:42:56.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.650+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=WMLLWQRKJ75D tag=7213OSXT6NDS type=write size=2291767 2024-09-19T11:42:56.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.650+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=VABP2KTZLV1R type=del size=2573092 2024-09-19T11:42:56.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.654+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=PNF2I1T3RU7B type=del size=1348539 2024-09-19T11:42:56.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.654+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=JH4AN57OKSX1 type=del size=2891668 2024-09-19T11:42:56.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.658+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~ZA4B91A8UZED.0 size=1048576 2024-09-19T11:42:56.665 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.662+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~ZA4B91A8UZED.1 size=338684 2024-09-19T11:42:56.665 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.662+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=ZA4B91A8UZED tag=50ENW4E5B6WP type=write size=2435836 2024-09-19T11:42:56.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.666+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~F0Y8Y7LHKNV1.0 size=1048576 2024-09-19T11:42:56.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.666+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~F0Y8Y7LHKNV1.1 size=1048576 2024-09-19T11:42:56.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.666+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~F0Y8Y7LHKNV1.2 size=9109 2024-09-19T11:42:56.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.666+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=F0Y8Y7LHKNV1 tag=I6H5Y7XK1WG5 type=write size=3154837 2024-09-19T11:42:56.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.670+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~AQG51N3YUPQE.0 size=106316 2024-09-19T11:42:56.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.670+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=AQG51N3YUPQE tag=PVIHGR5QQR5J type=write size=1154892 2024-09-19T11:42:56.678 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.674+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=1M11VVANTR63 type=del size=1389576 2024-09-19T11:42:56.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.678+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~IUY68U3I4W69.0 size=660348 2024-09-19T11:42:56.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.678+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=IUY68U3I4W69 tag=STCYO37ZKFR4 type=write size=1708924 2024-09-19T11:42:56.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.682+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~EV2PWMRA5Y27.0 size=801794 2024-09-19T11:42:56.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.682+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=EV2PWMRA5Y27 tag=T1L8MPFEWGHC type=write size=1850370 2024-09-19T11:42:56.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.686+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=C36TYQEXPVLT type=write size=3478 2024-09-19T11:42:56.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.686+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=RZP1269H9CD2 type=del size=1368760 2024-09-19T11:42:56.696 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.690+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=A5JKX8RIK8Y2 type=write size=180207 2024-09-19T11:42:56.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.694+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~ZF7W6DKCET0P.0 size=11066 2024-09-19T11:42:56.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.698+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=ZF7W6DKCET0P tag=RUFHEEAF9NVK type=write size=1059642 2024-09-19T11:42:56.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.702+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~CMTBGVHDKJ35.0 size=283090 2024-09-19T11:42:56.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.702+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=CMTBGVHDKJ35 tag=518663DGU4JF type=write size=1331666 2024-09-19T11:42:56.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.702+0000 7f3d831968c0 1 < completed write operation key=8FGIZJIY58C7 tag=VY4ZA0TCKH2U type=write size=203679 2024-09-19T11:42:56.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.710+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~2718YOYSLMZB.0 size=1048576 2024-09-19T11:42:56.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.710+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~2718YOYSLMZB.1 size=750347 2024-09-19T11:42:56.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.710+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=2718YOYSLMZB tag=HI16UMKCN6C5 type=write size=2847499 2024-09-19T11:42:56.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.714+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=HQXLNPZF4614 type=del 2024-09-19T11:42:56.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.718+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=12ZCF6P41JQG type=del size=3815221 2024-09-19T11:42:56.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.718+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~WMLLWQRKJ75D.0 size=1048576 2024-09-19T11:42:56.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.722+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~WMLLWQRKJ75D.1 size=194615 2024-09-19T11:42:56.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.726+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=WMLLWQRKJ75D tag=7213OSXT6NDS type=write size=2291767 2024-09-19T11:42:56.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.730+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=8HPZZKT8H1O2 type=del size=687766 2024-09-19T11:42:56.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.730+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=VABP2KTZLV1R type=del 2024-09-19T11:42:56.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.734+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~6PPC651LM3N1.0 size=505610 2024-09-19T11:42:56.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.734+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=6PPC651LM3N1 tag=ZXJ5YLOFN9AW type=write size=1554186 2024-09-19T11:42:56.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.738+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=PNF2I1T3RU7B type=del 2024-09-19T11:42:56.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.742+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=KMJM3PPG8YYT type=del size=1787770 2024-09-19T11:42:56.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.742+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=JH4AN57OKSX1 type=del 2024-09-19T11:42:56.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.746+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=YRJEWII6JB5M type=del size=2485218 2024-09-19T11:42:56.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.746+0000 7f3d831968c0 1 < canceled part key=_multipart_4I8BY4YYTRT0.2~ZA4B91A8UZED.0 size=1048576 2024-09-19T11:42:56.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.750+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~ZA4B91A8UZED.1 size=338684 2024-09-19T11:42:56.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.754+0000 7f3d831968c0 1 < canceled multipart upload key=4I8BY4YYTRT0 upload=ZA4B91A8UZED tag=50ENW4E5B6WP type=write size=2435836 2024-09-19T11:42:56.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.758+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~K9IWOQXHELVQ.0 size=1048576 2024-09-19T11:42:56.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.758+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~K9IWOQXHELVQ.1 size=1048576 2024-09-19T11:42:56.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.762+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~K9IWOQXHELVQ.2 size=123993 2024-09-19T11:42:56.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.762+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=K9IWOQXHELVQ tag=AKB39H21WZF2 type=write size=3269721 2024-09-19T11:42:56.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.766+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~F0Y8Y7LHKNV1.0 size=1048576 2024-09-19T11:42:56.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.766+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~F0Y8Y7LHKNV1.1 size=1048576 2024-09-19T11:42:56.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.770+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~F0Y8Y7LHKNV1.2 size=9109 2024-09-19T11:42:56.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.774+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=F0Y8Y7LHKNV1 tag=I6H5Y7XK1WG5 type=write size=3154837 2024-09-19T11:42:56.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.782+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~885GY42X39U6.0 size=1048576 2024-09-19T11:42:56.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.782+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~885GY42X39U6.1 size=1048576 2024-09-19T11:42:56.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.786+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~885GY42X39U6.2 size=1033991 2024-09-19T11:42:56.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.786+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=885GY42X39U6 tag=JRNFQJVIWLS0 type=write size=4179719 2024-09-19T11:42:56.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.790+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~AQG51N3YUPQE.0 size=106316 2024-09-19T11:42:56.798 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.794+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=AQG51N3YUPQE tag=PVIHGR5QQR5J type=write size=1154892 2024-09-19T11:42:56.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.798+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=JFNIRQYRIS87 type=del size=673176 2024-09-19T11:42:56.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.802+0000 7f3d831968c0 1 < suggested remove operation key=3GD7UZCI3WX4 tag=1M11VVANTR63 type=del 2024-09-19T11:42:56.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.806+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~97MFPAFQ2XJZ.0 size=1048576 2024-09-19T11:42:56.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.810+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~97MFPAFQ2XJZ.1 size=854795 2024-09-19T11:42:56.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.810+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=97MFPAFQ2XJZ tag=AYIAX2PHXL1C type=write size=2951947 2024-09-19T11:42:56.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.814+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~IUY68U3I4W69.0 size=660348 2024-09-19T11:42:56.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.818+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=IUY68U3I4W69 tag=STCYO37ZKFR4 type=write size=1708924 2024-09-19T11:42:56.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.822+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=JI3FQE3OCOZM type=del size=634134 2024-09-19T11:42:56.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.822+0000 7f3d831968c0 1 < canceled part key=_multipart_EVFF0F0760OS.2~EV2PWMRA5Y27.0 size=801794 2024-09-19T11:42:56.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.826+0000 7f3d831968c0 1 < canceled multipart upload key=EVFF0F0760OS upload=EV2PWMRA5Y27 tag=T1L8MPFEWGHC type=write size=1850370 2024-09-19T11:42:56.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.830+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=QR6U81LDCDOS type=del size=1343321 2024-09-19T11:42:56.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.834+0000 7f3d831968c0 1 < completed write operation key=224HPC2Y95N6 tag=C36TYQEXPVLT type=write size=3478 2024-09-19T11:42:56.839 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.834+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=U683X4C1UQ1L type=del size=1632740 2024-09-19T11:42:56.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.838+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=RZP1269H9CD2 type=del 2024-09-19T11:42:56.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.842+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=LPZOKZKCI1MU type=del size=1341126 2024-09-19T11:42:56.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.842+0000 7f3d831968c0 1 < completed write operation key=G4P6HIOM1G2E tag=A5JKX8RIK8Y2 type=write size=180207 2024-09-19T11:42:56.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.846+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=WOOEH8LOPOJF type=del size=37510 2024-09-19T11:42:56.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.846+0000 7f3d831968c0 1 < canceled part key=_multipart_5RTONAWGYJNE.2~CMTBGVHDKJ35.0 size=283090 2024-09-19T11:42:56.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.854+0000 7f3d831968c0 1 < canceled multipart upload key=5RTONAWGYJNE upload=CMTBGVHDKJ35 tag=518663DGU4JF type=write size=1331666 2024-09-19T11:42:56.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.854+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=SJMJJO0YXFYJ type=del size=3116488 2024-09-19T11:42:56.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.858+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~2718YOYSLMZB.0 size=1048576 2024-09-19T11:42:56.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.862+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~2718YOYSLMZB.1 size=750347 2024-09-19T11:42:56.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.866+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=2718YOYSLMZB tag=HI16UMKCN6C5 type=write size=2847499 2024-09-19T11:42:56.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.870+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~3J816H84OQAP.0 size=553396 2024-09-19T11:42:56.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.870+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=3J816H84OQAP tag=DMX5GCIBIH53 type=write size=1601972 2024-09-19T11:42:56.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.874+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=12ZCF6P41JQG type=del 2024-09-19T11:42:56.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.878+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=5JL9HVJO2UQ1 type=del size=204508 2024-09-19T11:42:56.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.882+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=8HPZZKT8H1O2 type=del 2024-09-19T11:42:56.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.886+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~UH46F9K35ERH.0 size=190420 2024-09-19T11:42:56.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.886+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=UH46F9K35ERH tag=5Q6LLU54GBW5 type=write size=1238996 2024-09-19T11:42:56.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.886+0000 7f3d831968c0 1 < canceled part key=_multipart_5RTONAWGYJNE.2~6PPC651LM3N1.0 size=505610 2024-09-19T11:42:56.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.894+0000 7f3d831968c0 1 < canceled multipart upload key=5RTONAWGYJNE upload=6PPC651LM3N1 tag=ZXJ5YLOFN9AW type=write size=1554186 2024-09-19T11:42:56.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.898+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=6MZN6KIWNBD1 type=del size=2393587 2024-09-19T11:42:56.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.898+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=KMJM3PPG8YYT type=del 2024-09-19T11:42:56.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.902+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=XZP8UKBZL2LJ type=del size=3665839 2024-09-19T11:42:56.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.906+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=YRJEWII6JB5M type=del 2024-09-19T11:42:56.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.910+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=GXND9EZHL2O3 type=write size=2171 2024-09-19T11:42:56.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.914+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~K9IWOQXHELVQ.0 size=1048576 2024-09-19T11:42:56.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.914+0000 7f3d831968c0 1 < canceled part key=_multipart_224HPC2Y95N6.2~K9IWOQXHELVQ.1 size=1048576 2024-09-19T11:42:56.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.918+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~K9IWOQXHELVQ.2 size=123993 2024-09-19T11:42:56.927 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.922+0000 7f3d831968c0 1 < canceled multipart upload key=224HPC2Y95N6 upload=K9IWOQXHELVQ tag=AKB39H21WZF2 type=write size=3269721 2024-09-19T11:42:56.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.926+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=1SYY2KBXOCZH type=del size=1686088 2024-09-19T11:42:56.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.930+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~885GY42X39U6.0 size=1048576 2024-09-19T11:42:56.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.934+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~885GY42X39U6.1 size=1048576 2024-09-19T11:42:56.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.934+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~885GY42X39U6.2 size=1033991 2024-09-19T11:42:56.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.942+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=885GY42X39U6 tag=JRNFQJVIWLS0 type=write size=4179719 2024-09-19T11:42:56.951 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.946+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~7AMBY97EHPGZ.0 size=1048576 2024-09-19T11:42:56.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.950+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~7AMBY97EHPGZ.1 size=1048576 2024-09-19T11:42:56.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.954+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~7AMBY97EHPGZ.2 size=788649 2024-09-19T11:42:56.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.954+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=7AMBY97EHPGZ tag=F8SXTV8HAT6S type=write size=3934377 2024-09-19T11:42:56.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.954+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=JFNIRQYRIS87 type=del 2024-09-19T11:42:56.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.958+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=V2099S5UQZIV type=del size=226581 2024-09-19T11:42:56.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.962+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~97MFPAFQ2XJZ.0 size=1048576 2024-09-19T11:42:56.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.966+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~97MFPAFQ2XJZ.1 size=854795 2024-09-19T11:42:56.976 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.970+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=97MFPAFQ2XJZ tag=AYIAX2PHXL1C type=write size=2951947 2024-09-19T11:42:56.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.978+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~F1PU5QFSZA4J.0 size=1048576 2024-09-19T11:42:56.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.978+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~F1PU5QFSZA4J.1 size=246517 2024-09-19T11:42:56.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.978+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=F1PU5QFSZA4J tag=8LXQNR9VEY5C type=write size=2343669 2024-09-19T11:42:56.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.982+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=JI3FQE3OCOZM type=del 2024-09-19T11:42:56.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.986+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=7LTJZC3RRN44 type=del size=2930896 2024-09-19T11:42:56.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.990+0000 7f3d831968c0 1 < completed delete operation key=PB62JE7I55GG tag=QR6U81LDCDOS type=del 2024-09-19T11:42:56.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.994+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~IPHXZSFZK0D1.0 size=1048576 2024-09-19T11:42:57.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.998+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~IPHXZSFZK0D1.1 size=1048576 2024-09-19T11:42:57.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.998+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~IPHXZSFZK0D1.2 size=412645 2024-09-19T11:42:57.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:56.998+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=IPHXZSFZK0D1 tag=4XTYLG3Y4C6V type=write size=3558373 2024-09-19T11:42:57.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.002+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=U683X4C1UQ1L type=del 2024-09-19T11:42:57.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.006+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~63DDQCDOPKPR.0 size=1048576 2024-09-19T11:42:57.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.010+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~63DDQCDOPKPR.1 size=238724 2024-09-19T11:42:57.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.010+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=63DDQCDOPKPR tag=5L04YL76ZLUS type=write size=2335876 2024-09-19T11:42:57.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.014+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=LPZOKZKCI1MU type=del 2024-09-19T11:42:57.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.022+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~910Y1EBHXJAP.0 size=271590 2024-09-19T11:42:57.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.022+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=910Y1EBHXJAP tag=6EQBKDQR00NE type=write size=1320166 2024-09-19T11:42:57.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.026+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=WOOEH8LOPOJF type=del 2024-09-19T11:42:57.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.030+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~SMSOGDTFE2SS.0 size=1048576 2024-09-19T11:42:57.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.034+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~SMSOGDTFE2SS.1 size=1048576 2024-09-19T11:42:57.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.038+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~SMSOGDTFE2SS.2 size=92274 2024-09-19T11:42:57.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.038+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=SMSOGDTFE2SS tag=HS5HBGIU7MPX type=write size=3238002 2024-09-19T11:42:57.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.038+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=SJMJJO0YXFYJ type=del 2024-09-19T11:42:57.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.042+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=EYOWMWQ5DDSV type=del size=3792985 2024-09-19T11:42:57.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.046+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~3J816H84OQAP.0 size=553396 2024-09-19T11:42:57.057 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.054+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=3J816H84OQAP tag=DMX5GCIBIH53 type=write size=1601972 2024-09-19T11:42:57.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.058+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~51L5234D5LES.0 size=1048576 2024-09-19T11:42:57.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.062+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~51L5234D5LES.1 size=1048576 2024-09-19T11:42:57.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.066+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~51L5234D5LES.2 size=628088 2024-09-19T11:42:57.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.066+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=51L5234D5LES tag=8AHJ2NA39EM8 type=write size=3773816 2024-09-19T11:42:57.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.070+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=5JL9HVJO2UQ1 type=del 2024-09-19T11:42:57.076 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.074+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=LYRO6ZG318V2 type=write size=710456 2024-09-19T11:42:57.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.078+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~UH46F9K35ERH.0 size=190420 2024-09-19T11:42:57.087 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.082+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=UH46F9K35ERH tag=5Q6LLU54GBW5 type=write size=1238996 2024-09-19T11:42:57.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.090+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~2B4V1V9FM44D.0 size=1048576 2024-09-19T11:42:57.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.094+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~2B4V1V9FM44D.1 size=1048576 2024-09-19T11:42:57.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.098+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~2B4V1V9FM44D.2 size=240947 2024-09-19T11:42:57.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.098+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=2B4V1V9FM44D tag=C0KMY30RA1Z0 type=write size=3386675 2024-09-19T11:42:57.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.106+0000 7f3d831968c0 1 < suggested remove operation key=PB62JE7I55GG tag=6MZN6KIWNBD1 type=del 2024-09-19T11:42:57.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.110+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=Y1UOES2X60X7 type=del size=3959856 2024-09-19T11:42:57.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.114+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=XZP8UKBZL2LJ type=del 2024-09-19T11:42:57.120 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.114+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=AWBSLZBMVDP5 type=del size=2667342 2024-09-19T11:42:57.123 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.118+0000 7f3d831968c0 1 < completed write operation key=2VJRZVU7S8LB tag=GXND9EZHL2O3 type=write size=2171 2024-09-19T11:42:57.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.122+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=LHVI0JE13XYG type=del size=3046629 2024-09-19T11:42:57.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.126+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=1SYY2KBXOCZH type=del 2024-09-19T11:42:57.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.130+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~4HJPVOLA20VX.0 size=692872 2024-09-19T11:42:57.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.130+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=4HJPVOLA20VX tag=JA28CJEEA2TL type=write size=1741448 2024-09-19T11:42:57.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.134+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~7AMBY97EHPGZ.0 size=1048576 2024-09-19T11:42:57.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.138+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~7AMBY97EHPGZ.1 size=1048576 2024-09-19T11:42:57.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.142+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~7AMBY97EHPGZ.2 size=788649 2024-09-19T11:42:57.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.146+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=7AMBY97EHPGZ tag=F8SXTV8HAT6S type=write size=3934377 2024-09-19T11:42:57.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.150+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=V15BHSM7KGYX type=del size=4075439 2024-09-19T11:42:57.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.154+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=V2099S5UQZIV type=del 2024-09-19T11:42:57.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.154+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=JJNXODKP0ZJZ type=del size=3513644 2024-09-19T11:42:57.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.158+0000 7f3d831968c0 1 < canceled part key=_multipart_UI7EVZ1SGD8R.2~F1PU5QFSZA4J.0 size=1048576 2024-09-19T11:42:57.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.158+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~F1PU5QFSZA4J.1 size=246517 2024-09-19T11:42:57.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.166+0000 7f3d831968c0 1 < canceled multipart upload key=UI7EVZ1SGD8R upload=F1PU5QFSZA4J tag=8LXQNR9VEY5C type=write size=2343669 2024-09-19T11:42:57.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.166+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=SQ17EC4W5M4U type=del size=1242668 2024-09-19T11:42:57.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.170+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=7LTJZC3RRN44 type=del 2024-09-19T11:42:57.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.178+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~K3LR85KLCE3J.0 size=1048576 2024-09-19T11:42:57.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.178+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~K3LR85KLCE3J.1 size=558629 2024-09-19T11:42:57.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.178+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=K3LR85KLCE3J tag=XS1MIDMX99VO type=write size=2655781 2024-09-19T11:42:57.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.182+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~IPHXZSFZK0D1.0 size=1048576 2024-09-19T11:42:57.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.186+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~IPHXZSFZK0D1.1 size=1048576 2024-09-19T11:42:57.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.190+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~IPHXZSFZK0D1.2 size=412645 2024-09-19T11:42:57.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.194+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=IPHXZSFZK0D1 tag=4XTYLG3Y4C6V type=write size=3558373 2024-09-19T11:42:57.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.198+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=X5XA4XT9KOQ3 type=del size=3160394 2024-09-19T11:42:57.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.202+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~63DDQCDOPKPR.0 size=1048576 2024-09-19T11:42:57.207 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.202+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~63DDQCDOPKPR.1 size=238724 2024-09-19T11:42:57.213 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.210+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=63DDQCDOPKPR tag=5L04YL76ZLUS type=write size=2335876 2024-09-19T11:42:57.216 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.210+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=005O5I3TU79X type=del size=2405603 2024-09-19T11:42:57.220 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.214+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~910Y1EBHXJAP.0 size=271590 2024-09-19T11:42:57.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.222+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=910Y1EBHXJAP tag=6EQBKDQR00NE type=write size=1320166 2024-09-19T11:42:57.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.226+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=4BIYVRH3K1RL type=write size=148970 2024-09-19T11:42:57.233 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.230+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~SMSOGDTFE2SS.0 size=1048576 2024-09-19T11:42:57.235 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.230+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~SMSOGDTFE2SS.1 size=1048576 2024-09-19T11:42:57.238 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.234+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~SMSOGDTFE2SS.2 size=92274 2024-09-19T11:42:57.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.238+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=SMSOGDTFE2SS tag=HS5HBGIU7MPX type=write size=3238002 2024-09-19T11:42:57.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.242+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=HYSJQL3RYWLG type=del size=3774446 2024-09-19T11:42:57.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.246+0000 7f3d831968c0 1 < canceled operation key=Y3LO4H9RI4X0 tag=EYOWMWQ5DDSV type=del size=3792985 2024-09-19T11:42:57.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.250+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~GNHBYZ80I8CB.0 size=1048576 2024-09-19T11:42:57.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.250+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~GNHBYZ80I8CB.1 size=1048576 2024-09-19T11:42:57.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.254+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~GNHBYZ80I8CB.2 size=108582 2024-09-19T11:42:57.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.254+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=GNHBYZ80I8CB tag=6M98E5SN2H4F type=write size=3254310 2024-09-19T11:42:57.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.258+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~51L5234D5LES.0 size=1048576 2024-09-19T11:42:57.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.258+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~51L5234D5LES.1 size=1048576 2024-09-19T11:42:57.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.262+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~51L5234D5LES.2 size=628088 2024-09-19T11:42:57.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.266+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=51L5234D5LES tag=8AHJ2NA39EM8 type=write size=3773816 2024-09-19T11:42:57.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.270+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=6LLJ96ZBTG7E type=del size=2783938 2024-09-19T11:42:57.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.274+0000 7f3d831968c0 1 < completed write operation key=FZGRZ06MOHBI tag=LYRO6ZG318V2 type=write size=710456 2024-09-19T11:42:57.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.274+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=OGFEFTKF5J0A type=del size=3914330 2024-09-19T11:42:57.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.278+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~2B4V1V9FM44D.0 size=1048576 2024-09-19T11:42:57.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.282+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~2B4V1V9FM44D.1 size=1048576 2024-09-19T11:42:57.288 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.282+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~2B4V1V9FM44D.2 size=240947 2024-09-19T11:42:57.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.290+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=2B4V1V9FM44D tag=C0KMY30RA1Z0 type=write size=3386675 2024-09-19T11:42:57.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.290+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=XHM17PVSSQKD type=del size=3541842 2024-09-19T11:42:57.299 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.294+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=Y1UOES2X60X7 type=del 2024-09-19T11:42:57.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.298+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=ALNQP14MIECJ type=del size=1243792 2024-09-19T11:42:57.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.302+0000 7f3d831968c0 1 < suggested remove operation key=76JFMPOUJZXW tag=AWBSLZBMVDP5 type=del 2024-09-19T11:42:57.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.306+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=LNBTAFF5AUIX type=write size=430035 2024-09-19T11:42:57.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.310+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=LHVI0JE13XYG type=del 2024-09-19T11:42:57.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.314+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~ALTFWT1PWJ7K.0 size=1048576 2024-09-19T11:42:57.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.318+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~ALTFWT1PWJ7K.1 size=1048576 2024-09-19T11:42:57.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.318+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~ALTFWT1PWJ7K.2 size=83251 2024-09-19T11:42:57.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.318+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=ALTFWT1PWJ7K tag=WR8YBM5F38WH type=write size=3228979 2024-09-19T11:42:57.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.322+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~4HJPVOLA20VX.0 size=692872 2024-09-19T11:42:57.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.326+0000 7f3d831968c0 1 < completed multipart upload key=LINLTWYV88VU upload=4HJPVOLA20VX tag=JA28CJEEA2TL type=write size=1741448 2024-09-19T11:42:57.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.330+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=T2TK8YLKFO8K type=write size=38941 2024-09-19T11:42:57.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.334+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=V15BHSM7KGYX type=del 2024-09-19T11:42:57.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.338+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~VZDZ1GJCPPBN.0 size=1048576 2024-09-19T11:42:57.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.342+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~VZDZ1GJCPPBN.1 size=319218 2024-09-19T11:42:57.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.342+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=VZDZ1GJCPPBN tag=EELCKWLTD00A type=write size=2416370 2024-09-19T11:42:57.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.346+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=JJNXODKP0ZJZ type=del 2024-09-19T11:42:57.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.350+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=VSAIMGMGAWNC type=del size=920716 2024-09-19T11:42:57.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.358+0000 7f3d831968c0 1 < suggested update operation key=Y3LO4H9RI4X0 tag=SQ17EC4W5M4U type=del size=1242668 2024-09-19T11:42:57.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.358+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=HBX54H1A3X9F type=write size=775027 2024-09-19T11:42:57.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.362+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~K3LR85KLCE3J.0 size=1048576 2024-09-19T11:42:57.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.362+0000 7f3d831968c0 1 < canceled part key=_multipart_Y3LO4H9RI4X0.2~K3LR85KLCE3J.1 size=558629 2024-09-19T11:42:57.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.370+0000 7f3d831968c0 1 < canceled multipart upload key=Y3LO4H9RI4X0 upload=K3LR85KLCE3J tag=XS1MIDMX99VO type=write size=2655781 2024-09-19T11:42:57.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.374+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~Q6WVROFIU51B.0 size=922171 2024-09-19T11:42:57.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.374+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=Q6WVROFIU51B tag=QLMZ33BMGUEW type=write size=1970747 2024-09-19T11:42:57.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.378+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=X5XA4XT9KOQ3 type=del 2024-09-19T11:42:57.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.386+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~5JFM3TA6I9RB.0 size=1048576 2024-09-19T11:42:57.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.386+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~5JFM3TA6I9RB.1 size=77161 2024-09-19T11:42:57.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.386+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=5JFM3TA6I9RB tag=Q2BZ0PMWYLKM type=write size=2174313 2024-09-19T11:42:57.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.390+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=005O5I3TU79X type=del 2024-09-19T11:42:57.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.394+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=7J47L2Q9XE99 type=del size=3660910 2024-09-19T11:42:57.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.398+0000 7f3d831968c0 1 < completed write operation key=JV7EGEI6062Y tag=4BIYVRH3K1RL type=write size=148970 2024-09-19T11:42:57.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.402+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=TBGQ688CD4OK type=write size=76833 2024-09-19T11:42:57.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.410+0000 7f3d831968c0 1 < suggested remove operation key=6NLQ0BK8AJUO tag=HYSJQL3RYWLG type=del 2024-09-19T11:42:57.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.410+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=JZH1EB1KJNTT type=del size=3018263 2024-09-19T11:42:57.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.418+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~GNHBYZ80I8CB.0 size=1048576 2024-09-19T11:42:57.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.418+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~GNHBYZ80I8CB.1 size=1048576 2024-09-19T11:42:57.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.422+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~GNHBYZ80I8CB.2 size=108582 2024-09-19T11:42:57.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.430+0000 7f3d831968c0 1 < completed multipart upload key=3GD7UZCI3WX4 upload=GNHBYZ80I8CB tag=6M98E5SN2H4F type=write size=3254310 2024-09-19T11:42:57.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.434+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=PBNLMHMLEK82 type=del size=769150 2024-09-19T11:42:57.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.438+0000 7f3d831968c0 1 < canceled operation key=EVFF0F0760OS tag=6LLJ96ZBTG7E type=del size=2783938 2024-09-19T11:42:57.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.442+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~EJ8KXIM00PBZ.0 size=1048576 2024-09-19T11:42:57.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.446+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~EJ8KXIM00PBZ.1 size=1048576 2024-09-19T11:42:57.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.446+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~EJ8KXIM00PBZ.2 size=107030 2024-09-19T11:42:57.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.446+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=EJ8KXIM00PBZ tag=U2PD6Q8T01I4 type=write size=3252758 2024-09-19T11:42:57.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.450+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=OGFEFTKF5J0A type=del 2024-09-19T11:42:57.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.454+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=9DANYESG3C2N type=del size=3616856 2024-09-19T11:42:57.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.458+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=XHM17PVSSQKD type=del 2024-09-19T11:42:57.467 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.462+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=9A08WP8486TI type=del size=1119690 2024-09-19T11:42:57.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.466+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=ALNQP14MIECJ type=del 2024-09-19T11:42:57.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.470+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=N8B1WW29IP06 type=del size=2234120 2024-09-19T11:42:57.478 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.474+0000 7f3d831968c0 -1 < failed to complete operation key=6NLQ0BK8AJUO tag=LNBTAFF5AUIX type=write size=430035: (22) Invalid argument 2024-09-19T11:42:57.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.478+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=PQDXFS10S0H8 type=del size=210000 2024-09-19T11:42:57.485 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.482+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~ALTFWT1PWJ7K.0 size=1048576 2024-09-19T11:42:57.485 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.482+0000 7f3d831968c0 1 < canceled part key=_multipart_FZGRZ06MOHBI.2~ALTFWT1PWJ7K.1 size=1048576 2024-09-19T11:42:57.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.482+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~ALTFWT1PWJ7K.2 size=83251 2024-09-19T11:42:57.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.490+0000 7f3d831968c0 1 < canceled multipart upload key=FZGRZ06MOHBI upload=ALTFWT1PWJ7K tag=WR8YBM5F38WH type=write size=3228979 2024-09-19T11:42:57.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.498+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~JUOJ5Z4Y9HAL.0 size=1048576 2024-09-19T11:42:57.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.498+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~JUOJ5Z4Y9HAL.1 size=923124 2024-09-19T11:42:57.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.498+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=JUOJ5Z4Y9HAL tag=WH27S3D0IZ2M type=write size=3020276 2024-09-19T11:42:57.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.502+0000 7f3d831968c0 1 < completed write operation key=66N4QS1R70Z7 tag=T2TK8YLKFO8K type=write size=38941 2024-09-19T11:42:57.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.506+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=JMEEP6WZ21GY type=del size=2394157 2024-09-19T11:42:57.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.510+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~VZDZ1GJCPPBN.0 size=1048576 2024-09-19T11:42:57.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.514+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~VZDZ1GJCPPBN.1 size=319218 2024-09-19T11:42:57.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.518+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=VZDZ1GJCPPBN tag=EELCKWLTD00A type=write size=2416370 2024-09-19T11:42:57.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.522+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=7PH4PYO43Z6P type=write size=540170 2024-09-19T11:42:57.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.530+0000 7f3d831968c0 1 < suggested remove operation key=G4P6HIOM1G2E tag=VSAIMGMGAWNC type=del 2024-09-19T11:42:57.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.538+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~AJ2EXWHU5IP9.0 size=851355 2024-09-19T11:42:57.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.538+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=AJ2EXWHU5IP9 tag=03IJBJVAVOUZ type=write size=1899931 2024-09-19T11:42:57.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.542+0000 7f3d831968c0 1 < completed write operation key=KAPKNZJ2DE6A tag=HBX54H1A3X9F type=write size=775027 2024-09-19T11:42:57.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.546+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=TNZQ2AY7SLAA type=write size=781109 2024-09-19T11:42:57.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.550+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~Q6WVROFIU51B.0 size=922171 2024-09-19T11:42:57.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.554+0000 7f3d831968c0 1 < completed multipart upload key=3GD7UZCI3WX4 upload=Q6WVROFIU51B tag=QLMZ33BMGUEW type=write size=1970747 2024-09-19T11:42:57.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.558+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=UDN1HDIRZOEG type=write size=290213 2024-09-19T11:42:57.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.562+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~5JFM3TA6I9RB.0 size=1048576 2024-09-19T11:42:57.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.566+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~5JFM3TA6I9RB.1 size=77161 2024-09-19T11:42:57.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.570+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=5JFM3TA6I9RB tag=Q2BZ0PMWYLKM type=write size=2174313 2024-09-19T11:42:57.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.578+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~J9GXSBQ54AYY.0 size=428923 2024-09-19T11:42:57.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.578+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=J9GXSBQ54AYY tag=NZZPS7GPP8A1 type=write size=1477499 2024-09-19T11:42:57.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.582+0000 7f3d831968c0 -1 < failed to complete operation key=G4P6HIOM1G2E tag=7J47L2Q9XE99 type=del size=3660910: (22) Invalid argument 2024-09-19T11:42:57.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.586+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~4HUXHW06GE27.0 size=1048576 2024-09-19T11:42:57.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.590+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~4HUXHW06GE27.1 size=1048576 2024-09-19T11:42:57.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.598+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~4HUXHW06GE27.2 size=1018545 2024-09-19T11:42:57.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.598+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=4HUXHW06GE27 tag=3546OF2LF03W type=write size=4164273 2024-09-19T11:42:57.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.602+0000 7f3d831968c0 1 < canceled operation key=900RV3451AON tag=TBGQ688CD4OK type=write size=76833 2024-09-19T11:42:57.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.622+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~PF0YS8RIQT0Q.0 size=1048576 2024-09-19T11:42:57.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.626+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~PF0YS8RIQT0Q.1 size=1029555 2024-09-19T11:42:57.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.626+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=PF0YS8RIQT0Q tag=1DWHTSKJLETB type=write size=3126707 2024-09-19T11:42:57.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.630+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=JZH1EB1KJNTT type=del 2024-09-19T11:42:57.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.630+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=7IY9UWO11VB9 type=del size=3537255 2024-09-19T11:42:57.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.634+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=PBNLMHMLEK82 type=del 2024-09-19T11:42:57.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.638+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=VY4Z0LBCYSEM type=write size=930167 2024-09-19T11:42:57.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.642+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~EJ8KXIM00PBZ.0 size=1048576 2024-09-19T11:42:57.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.642+0000 7f3d831968c0 1 < canceled part key=_multipart_LINLTWYV88VU.2~EJ8KXIM00PBZ.1 size=1048576 2024-09-19T11:42:57.647 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.642+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~EJ8KXIM00PBZ.2 size=107030 2024-09-19T11:42:57.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.646+0000 7f3d831968c0 1 < canceled multipart upload key=LINLTWYV88VU upload=EJ8KXIM00PBZ tag=U2PD6Q8T01I4 type=write size=3252758 2024-09-19T11:42:57.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.650+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=DE7CXETEF2BE type=del size=519078 2024-09-19T11:42:57.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.654+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=9DANYESG3C2N type=del 2024-09-19T11:42:57.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.658+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=V79V84N8BSOG type=write size=846541 2024-09-19T11:42:57.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.658+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=9A08WP8486TI type=del 2024-09-19T11:42:57.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.662+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~6SB2ICK9ZUP8.0 size=1048576 2024-09-19T11:42:57.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.666+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~6SB2ICK9ZUP8.1 size=338890 2024-09-19T11:42:57.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.666+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=6SB2ICK9ZUP8 tag=Z9K44YN4VWN0 type=write size=2436042 2024-09-19T11:42:57.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.666+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=N8B1WW29IP06 type=del 2024-09-19T11:42:57.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.670+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~2YXK8UI8OFV1.0 size=1048576 2024-09-19T11:42:57.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.674+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~2YXK8UI8OFV1.1 size=304190 2024-09-19T11:42:57.678 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.674+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=2YXK8UI8OFV1 tag=SDUONON5QM11 type=write size=2401342 2024-09-19T11:42:57.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.674+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=PQDXFS10S0H8 type=del 2024-09-19T11:42:57.684 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.682+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~CMA833FXBF5U.0 size=1048576 2024-09-19T11:42:57.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.682+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~CMA833FXBF5U.1 size=1048576 2024-09-19T11:42:57.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.686+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~CMA833FXBF5U.2 size=825424 2024-09-19T11:42:57.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.686+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=CMA833FXBF5U tag=UM31M3NCLCKC type=write size=3971152 2024-09-19T11:42:57.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.686+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~JUOJ5Z4Y9HAL.0 size=1048576 2024-09-19T11:42:57.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.690+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~JUOJ5Z4Y9HAL.1 size=923124 2024-09-19T11:42:57.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.694+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=JUOJ5Z4Y9HAL tag=WH27S3D0IZ2M type=write size=3020276 2024-09-19T11:42:57.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.698+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~RCQ1KPJWH2VC.0 size=420419 2024-09-19T11:42:57.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.698+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=RCQ1KPJWH2VC tag=G1P9GBJH0Z6X type=write size=1468995 2024-09-19T11:42:57.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.698+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=JMEEP6WZ21GY type=del 2024-09-19T11:42:57.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.702+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=VWHQ3MB6VQOO type=del size=1270053 2024-09-19T11:42:57.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.706+0000 7f3d831968c0 1 < suggested remove operation key=6NLQ0BK8AJUO tag=7PH4PYO43Z6P type=write 2024-09-19T11:42:57.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.710+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=2IUKTC2QD0H8 type=del size=1570635 2024-09-19T11:42:57.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.714+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~AJ2EXWHU5IP9.0 size=851355 2024-09-19T11:42:57.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.718+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=AJ2EXWHU5IP9 tag=03IJBJVAVOUZ type=write size=1899931 2024-09-19T11:42:57.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.722+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~TV0LESF9YFJ8.0 size=1048576 2024-09-19T11:42:57.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.722+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~TV0LESF9YFJ8.1 size=764970 2024-09-19T11:42:57.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.722+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=TV0LESF9YFJ8 tag=GQDSX8AT5X9D type=write size=2862122 2024-09-19T11:42:57.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.726+0000 7f3d831968c0 1 < completed write operation key=JTPBGWC4T3Y5 tag=TNZQ2AY7SLAA type=write size=781109 2024-09-19T11:42:57.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.726+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=XQTHMC144DOZ type=del size=1937987 2024-09-19T11:42:57.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.730+0000 7f3d831968c0 1 < completed write operation key=LINLTWYV88VU tag=UDN1HDIRZOEG type=write size=290213 2024-09-19T11:42:57.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.734+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~NGTZC63H0W12.0 size=1048576 2024-09-19T11:42:57.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.738+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~NGTZC63H0W12.1 size=1048576 2024-09-19T11:42:57.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.738+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~NGTZC63H0W12.2 size=322135 2024-09-19T11:42:57.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.738+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=NGTZC63H0W12 tag=1KP6VN6G05KA type=write size=3467863 2024-09-19T11:42:57.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.742+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~J9GXSBQ54AYY.0 size=428923 2024-09-19T11:42:57.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.746+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=J9GXSBQ54AYY tag=NZZPS7GPP8A1 type=write size=1477499 2024-09-19T11:42:57.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.750+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~7SR46XBH7VUQ.0 size=1048576 2024-09-19T11:42:57.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.754+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~7SR46XBH7VUQ.1 size=40193 2024-09-19T11:42:57.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.754+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=7SR46XBH7VUQ tag=1Z65KNZDNFHK type=write size=2137345 2024-09-19T11:42:57.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.758+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~4HUXHW06GE27.0 size=1048576 2024-09-19T11:42:57.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.758+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~4HUXHW06GE27.1 size=1048576 2024-09-19T11:42:57.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.762+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~4HUXHW06GE27.2 size=1018545 2024-09-19T11:42:57.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.766+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=4HUXHW06GE27 tag=3546OF2LF03W type=write size=4164273 2024-09-19T11:42:57.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.766+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=XSSDGLEIQYVN type=write size=291625 2024-09-19T11:42:57.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.770+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~PF0YS8RIQT0Q.0 size=1048576 2024-09-19T11:42:57.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.770+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~PF0YS8RIQT0Q.1 size=1029555 2024-09-19T11:42:57.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.774+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=PF0YS8RIQT0Q tag=1DWHTSKJLETB type=write size=3126707 2024-09-19T11:42:57.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.782+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~634AQJ9UT6AN.0 size=331326 2024-09-19T11:42:57.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.782+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=634AQJ9UT6AN tag=PLOFV5T0ANX0 type=write size=1379902 2024-09-19T11:42:57.787 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.782+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=7IY9UWO11VB9 type=del 2024-09-19T11:42:57.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.786+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~MJRLZ5RS3V3I.0 size=514984 2024-09-19T11:42:57.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.786+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=MJRLZ5RS3V3I tag=K9Z4IBLGQQK0 type=write size=1563560 2024-09-19T11:42:57.796 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.790+0000 7f3d831968c0 1 < suggested update operation key=5RTONAWGYJNE tag=VY4Z0LBCYSEM type=write size=930167 2024-09-19T11:42:57.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.798+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~765AD2M4Q2DE.0 size=1048576 2024-09-19T11:42:57.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.798+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~765AD2M4Q2DE.1 size=123071 2024-09-19T11:42:57.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.798+0000 7f3d831968c0 1 > prepared multipart upload key=JTPBGWC4T3Y5 upload=765AD2M4Q2DE tag=9VPURVLVFN3Z type=write size=2220223 2024-09-19T11:42:57.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.802+0000 7f3d831968c0 1 < suggested remove operation key=FKLL38ZNCJ21 tag=DE7CXETEF2BE type=del 2024-09-19T11:42:57.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.806+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=CQIZFFGM5DYY type=del size=1181634 2024-09-19T11:42:57.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.810+0000 7f3d831968c0 1 < completed write operation key=76JFMPOUJZXW tag=V79V84N8BSOG type=write size=846541 2024-09-19T11:42:57.820 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.814+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~KQ250YHVERTT.0 size=1048576 2024-09-19T11:42:57.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.818+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~KQ250YHVERTT.1 size=1048576 2024-09-19T11:42:57.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.818+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~KQ250YHVERTT.2 size=933154 2024-09-19T11:42:57.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.818+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=KQ250YHVERTT tag=JVD1NMORL92I type=write size=4078882 2024-09-19T11:42:57.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.822+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~6SB2ICK9ZUP8.0 size=1048576 2024-09-19T11:42:57.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.822+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~6SB2ICK9ZUP8.1 size=338890 2024-09-19T11:42:57.832 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.830+0000 7f3d831968c0 1 < completed multipart upload key=76JFMPOUJZXW upload=6SB2ICK9ZUP8 tag=Z9K44YN4VWN0 type=write size=2436042 2024-09-19T11:42:57.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.830+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=XDU89EY9OQ11 type=del size=3477305 2024-09-19T11:42:57.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.834+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~2YXK8UI8OFV1.0 size=1048576 2024-09-19T11:42:57.840 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.834+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~2YXK8UI8OFV1.1 size=304190 2024-09-19T11:42:57.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.838+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=2YXK8UI8OFV1 tag=SDUONON5QM11 type=write size=2401342 2024-09-19T11:42:57.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.842+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=O00S027X5Y4W type=write size=742070 2024-09-19T11:42:57.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.846+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~CMA833FXBF5U.0 size=1048576 2024-09-19T11:42:57.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.846+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~CMA833FXBF5U.1 size=1048576 2024-09-19T11:42:57.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.850+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~CMA833FXBF5U.2 size=825424 2024-09-19T11:42:57.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.854+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=CMA833FXBF5U tag=UM31M3NCLCKC type=write size=3971152 2024-09-19T11:42:57.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.858+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~0R2AHRDZU87D.0 size=1048576 2024-09-19T11:42:57.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.858+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~0R2AHRDZU87D.1 size=479130 2024-09-19T11:42:57.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.858+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=0R2AHRDZU87D tag=R8XCZHF4CDDD type=write size=2576282 2024-09-19T11:42:57.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.862+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~RCQ1KPJWH2VC.0 size=420419 2024-09-19T11:42:57.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.866+0000 7f3d831968c0 1 < completed multipart upload key=LINLTWYV88VU upload=RCQ1KPJWH2VC tag=G1P9GBJH0Z6X type=write size=1468995 2024-09-19T11:42:57.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.866+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=ZTMHQOONBM4J type=del size=2643227 2024-09-19T11:42:57.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.870+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=VWHQ3MB6VQOO type=del 2024-09-19T11:42:57.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.874+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=VZ9YUBU3J1GO type=del size=2968173 2024-09-19T11:42:57.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.874+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=2IUKTC2QD0H8 type=del 2024-09-19T11:42:57.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.878+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=75RHWYQSZYDJ type=del size=2958835 2024-09-19T11:42:57.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.882+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~TV0LESF9YFJ8.0 size=1048576 2024-09-19T11:42:57.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.882+0000 7f3d831968c0 1 < canceled part key=_multipart_LINLTWYV88VU.2~TV0LESF9YFJ8.1 size=764970 2024-09-19T11:42:57.889 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.886+0000 7f3d831968c0 1 < canceled multipart upload key=LINLTWYV88VU upload=TV0LESF9YFJ8 tag=GQDSX8AT5X9D type=write size=2862122 2024-09-19T11:42:57.893 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.890+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~VWIDAXML3011.0 size=1048576 2024-09-19T11:42:57.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.890+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~VWIDAXML3011.1 size=23002 2024-09-19T11:42:57.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.890+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=VWIDAXML3011 tag=0CL6JSAXTG1F type=write size=2120154 2024-09-19T11:42:57.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.894+0000 7f3d831968c0 1 < canceled operation key=66N4QS1R70Z7 tag=XQTHMC144DOZ type=del size=1937987 2024-09-19T11:42:57.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.898+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~ILA8WL7QGP15.0 size=1048576 2024-09-19T11:42:57.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.898+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~ILA8WL7QGP15.1 size=156375 2024-09-19T11:42:57.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.898+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=ILA8WL7QGP15 tag=0AG1813ZW1ZR type=write size=2253527 2024-09-19T11:42:57.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.902+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~NGTZC63H0W12.0 size=1048576 2024-09-19T11:42:57.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.906+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~NGTZC63H0W12.1 size=1048576 2024-09-19T11:42:57.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.906+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~NGTZC63H0W12.2 size=322135 2024-09-19T11:42:57.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.910+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=NGTZC63H0W12 tag=1KP6VN6G05KA type=write size=3467863 2024-09-19T11:42:57.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.914+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=MS3DGBNGPG7D type=write size=594939 2024-09-19T11:42:57.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.918+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~7SR46XBH7VUQ.0 size=1048576 2024-09-19T11:42:57.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.922+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~7SR46XBH7VUQ.1 size=40193 2024-09-19T11:42:57.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.926+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=7SR46XBH7VUQ tag=1Z65KNZDNFHK type=write size=2137345 2024-09-19T11:42:57.933 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.930+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=9F9PCGDW6MD2 type=del size=2221480 2024-09-19T11:42:57.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.930+0000 7f3d831968c0 1 < completed write operation key=4V17CRW6EB65 tag=XSSDGLEIQYVN type=write size=291625 2024-09-19T11:42:57.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.938+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~X4NSGV949AKZ.0 size=1048576 2024-09-19T11:42:57.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.938+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~X4NSGV949AKZ.1 size=1048576 2024-09-19T11:42:57.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.942+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~X4NSGV949AKZ.2 size=6032 2024-09-19T11:42:57.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.942+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=X4NSGV949AKZ tag=6V516KFAVKWL type=write size=3151760 2024-09-19T11:42:57.949 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.946+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~634AQJ9UT6AN.0 size=331326 2024-09-19T11:42:57.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.950+0000 7f3d831968c0 1 < completed multipart upload key=76JFMPOUJZXW upload=634AQJ9UT6AN tag=PLOFV5T0ANX0 type=write size=1379902 2024-09-19T11:42:57.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.954+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=OSUG89315HC0 type=del size=2639615 2024-09-19T11:42:57.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.958+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~MJRLZ5RS3V3I.0 size=514984 2024-09-19T11:42:57.966 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.962+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=MJRLZ5RS3V3I tag=K9Z4IBLGQQK0 type=write size=1563560 2024-09-19T11:42:57.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.966+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=0QYQG53JMZUF type=write size=657238 2024-09-19T11:42:57.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.966+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~765AD2M4Q2DE.0 size=1048576 2024-09-19T11:42:57.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.970+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~765AD2M4Q2DE.1 size=123071 2024-09-19T11:42:57.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.974+0000 7f3d831968c0 1 < completed multipart upload key=JTPBGWC4T3Y5 upload=765AD2M4Q2DE tag=9VPURVLVFN3Z type=write size=2220223 2024-09-19T11:42:57.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.982+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~T9H3ECNEYPXN.0 size=1048576 2024-09-19T11:42:57.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.982+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~T9H3ECNEYPXN.1 size=1048576 2024-09-19T11:42:57.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.986+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~T9H3ECNEYPXN.2 size=113231 2024-09-19T11:42:57.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.986+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=T9H3ECNEYPXN tag=S7FX01F622Z5 type=write size=3258959 2024-09-19T11:42:57.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.990+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=CQIZFFGM5DYY type=del 2024-09-19T11:42:57.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.994+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=2WG8N55L3ZKU type=write size=882545 2024-09-19T11:42:58.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.994+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~KQ250YHVERTT.0 size=1048576 2024-09-19T11:42:58.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:57.998+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~KQ250YHVERTT.1 size=1048576 2024-09-19T11:42:58.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.002+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~KQ250YHVERTT.2 size=933154 2024-09-19T11:42:58.010 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.006+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=KQ250YHVERTT tag=JVD1NMORL92I type=write size=4078882 2024-09-19T11:42:58.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.010+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=CZ1315PY1I2M type=del size=3051356 2024-09-19T11:42:58.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.014+0000 7f3d831968c0 1 < suggested remove operation key=900RV3451AON tag=XDU89EY9OQ11 type=del 2024-09-19T11:42:58.023 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.018+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=CZM5THK34E9M type=del size=3993085 2024-09-19T11:42:58.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.022+0000 7f3d831968c0 1 < completed write operation key=3QWBQYLI0SJR tag=O00S027X5Y4W type=write size=742070 2024-09-19T11:42:58.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.026+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~BWGNDHF28S5R.0 size=1048576 2024-09-19T11:42:58.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.030+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~BWGNDHF28S5R.1 size=188860 2024-09-19T11:42:58.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.030+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=BWGNDHF28S5R tag=E2NDHVQVCOBU type=write size=2286012 2024-09-19T11:42:58.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.034+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~0R2AHRDZU87D.0 size=1048576 2024-09-19T11:42:58.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.038+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~0R2AHRDZU87D.1 size=479130 2024-09-19T11:42:58.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.042+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=0R2AHRDZU87D tag=R8XCZHF4CDDD type=write size=2576282 2024-09-19T11:42:58.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.050+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~O8KJX6CQYN52.0 size=1048576 2024-09-19T11:42:58.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.050+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~O8KJX6CQYN52.1 size=891276 2024-09-19T11:42:58.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.050+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=O8KJX6CQYN52 tag=W74ACVFBGHV1 type=write size=2988428 2024-09-19T11:42:58.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.054+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=ZTMHQOONBM4J type=del 2024-09-19T11:42:58.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.058+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=H36YKV3SCC6K type=del size=3158102 2024-09-19T11:42:58.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.070+0000 7f3d831968c0 1 < suggested update operation key=66N4QS1R70Z7 tag=VZ9YUBU3J1GO type=del size=2968173 2024-09-19T11:42:58.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.078+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~OYLUCPTQ930P.0 size=1048576 2024-09-19T11:42:58.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.082+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~OYLUCPTQ930P.1 size=1048576 2024-09-19T11:42:58.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.086+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~OYLUCPTQ930P.2 size=223442 2024-09-19T11:42:58.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.086+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=OYLUCPTQ930P tag=UW4ZVCU8X5YO type=write size=3369170 2024-09-19T11:42:58.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.094+0000 7f3d831968c0 1 < suggested remove operation key=G4P6HIOM1G2E tag=75RHWYQSZYDJ type=del 2024-09-19T11:42:58.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.098+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~NJMTQNXJ1MPK.0 size=1048576 2024-09-19T11:42:58.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.102+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~NJMTQNXJ1MPK.1 size=1048576 2024-09-19T11:42:58.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.102+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~NJMTQNXJ1MPK.2 size=113360 2024-09-19T11:42:58.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.102+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=NJMTQNXJ1MPK tag=3TMB09CGWGO0 type=write size=3259088 2024-09-19T11:42:58.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.106+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~VWIDAXML3011.0 size=1048576 2024-09-19T11:42:58.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.110+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~VWIDAXML3011.1 size=23002 2024-09-19T11:42:58.120 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.114+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=VWIDAXML3011 tag=0CL6JSAXTG1F type=write size=2120154 2024-09-19T11:42:58.125 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.122+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~RTU6ZJ29B16P.0 size=1048576 2024-09-19T11:42:58.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.122+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~RTU6ZJ29B16P.1 size=479285 2024-09-19T11:42:58.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.122+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=RTU6ZJ29B16P tag=FC1O3RRE8SGN type=write size=2576437 2024-09-19T11:42:58.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.126+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~ILA8WL7QGP15.0 size=1048576 2024-09-19T11:42:58.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.126+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~ILA8WL7QGP15.1 size=156375 2024-09-19T11:42:58.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.134+0000 7f3d831968c0 1 < completed multipart upload key=LINLTWYV88VU upload=ILA8WL7QGP15 tag=0AG1813ZW1ZR type=write size=2253527 2024-09-19T11:42:58.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.138+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~P5WJ8YK4AV6X.0 size=1048576 2024-09-19T11:42:58.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.138+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~P5WJ8YK4AV6X.1 size=492570 2024-09-19T11:42:58.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.138+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=P5WJ8YK4AV6X tag=J93DFAJ3P9JE type=write size=2589722 2024-09-19T11:42:58.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.142+0000 7f3d831968c0 1 < canceled operation key=0OOB2SNLVK8E tag=MS3DGBNGPG7D type=write size=594939 2024-09-19T11:42:58.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.146+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~J0R625N6XBTQ.0 size=835962 2024-09-19T11:42:58.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.146+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=J0R625N6XBTQ tag=2FD44QZMKIL1 type=write size=1884538 2024-09-19T11:42:58.153 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.150+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=9F9PCGDW6MD2 type=del 2024-09-19T11:42:58.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.154+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~L1G6Y1RYYN58.0 size=1048576 2024-09-19T11:42:58.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.158+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~L1G6Y1RYYN58.1 size=1048576 2024-09-19T11:42:58.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.158+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~L1G6Y1RYYN58.2 size=645577 2024-09-19T11:42:58.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.158+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=L1G6Y1RYYN58 tag=P58TVF5OBSB6 type=write size=3791305 2024-09-19T11:42:58.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.162+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~X4NSGV949AKZ.0 size=1048576 2024-09-19T11:42:58.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.166+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~X4NSGV949AKZ.1 size=1048576 2024-09-19T11:42:58.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.170+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~X4NSGV949AKZ.2 size=6032 2024-09-19T11:42:58.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.174+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=X4NSGV949AKZ tag=6V516KFAVKWL type=write size=3151760 2024-09-19T11:42:58.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.178+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=CRSER21AKBDH type=del size=3381341 2024-09-19T11:42:58.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.182+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=OSUG89315HC0 type=del 2024-09-19T11:42:58.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.182+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=PTCORDNCWT1X type=del size=1328661 2024-09-19T11:42:58.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.186+0000 7f3d831968c0 1 < completed write operation key=2VJRZVU7S8LB tag=0QYQG53JMZUF type=write size=657238 2024-09-19T11:42:58.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.194+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~YSFAYJHDTWBG.0 size=1048576 2024-09-19T11:42:58.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.198+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~YSFAYJHDTWBG.1 size=1048576 2024-09-19T11:42:58.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.198+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~YSFAYJHDTWBG.2 size=336924 2024-09-19T11:42:58.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.198+0000 7f3d831968c0 1 > prepared multipart upload key=JTPBGWC4T3Y5 upload=YSFAYJHDTWBG tag=C596F8FPZED2 type=write size=3482652 2024-09-19T11:42:58.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.198+0000 7f3d831968c0 1 < canceled part key=_multipart_3GD7UZCI3WX4.2~T9H3ECNEYPXN.0 size=1048576 2024-09-19T11:42:58.206 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.202+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~T9H3ECNEYPXN.1 size=1048576 2024-09-19T11:42:58.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.206+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~T9H3ECNEYPXN.2 size=113231 2024-09-19T11:42:58.215 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.210+0000 7f3d831968c0 1 < canceled multipart upload key=3GD7UZCI3WX4 upload=T9H3ECNEYPXN tag=S7FX01F622Z5 type=write size=3258959 2024-09-19T11:42:58.220 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.214+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=7JOPN015CYZ5 type=write size=999990 2024-09-19T11:42:58.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.222+0000 7f3d831968c0 1 < suggested remove operation key=8FGIZJIY58C7 tag=2WG8N55L3ZKU type=write 2024-09-19T11:42:58.233 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.230+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~P1FJTCA4M0KL.0 size=641891 2024-09-19T11:42:58.234 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.230+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=P1FJTCA4M0KL tag=FEVQF8RFQI4W type=write size=1690467 2024-09-19T11:42:58.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.234+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=CZ1315PY1I2M type=del 2024-09-19T11:42:58.240 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.238+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=MWWBN7DVYYTI type=del size=1433804 2024-09-19T11:42:58.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.242+0000 7f3d831968c0 1 < suggested update operation key=3GD7UZCI3WX4 tag=CZM5THK34E9M type=del size=3993085 2024-09-19T11:42:58.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.246+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=YZ15R41T4UBJ type=del size=1596937 2024-09-19T11:42:58.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.250+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~BWGNDHF28S5R.0 size=1048576 2024-09-19T11:42:58.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.254+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~BWGNDHF28S5R.1 size=188860 2024-09-19T11:42:58.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.262+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=BWGNDHF28S5R tag=E2NDHVQVCOBU type=write size=2286012 2024-09-19T11:42:58.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.262+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=JI1XSGG9LG3B type=del size=500943 2024-09-19T11:42:58.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.266+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~O8KJX6CQYN52.0 size=1048576 2024-09-19T11:42:58.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.270+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~O8KJX6CQYN52.1 size=891276 2024-09-19T11:42:58.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.274+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=O8KJX6CQYN52 tag=W74ACVFBGHV1 type=write size=2988428 2024-09-19T11:42:58.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.278+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=UAECBAS4SNLN type=write size=877063 2024-09-19T11:42:58.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.282+0000 7f3d831968c0 1 < completed delete operation key=3QWBQYLI0SJR tag=H36YKV3SCC6K type=del 2024-09-19T11:42:58.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.286+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~B0X9V7S1SBY8.0 size=1048576 2024-09-19T11:42:58.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.290+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~B0X9V7S1SBY8.1 size=1048576 2024-09-19T11:42:58.297 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.294+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~B0X9V7S1SBY8.2 size=271983 2024-09-19T11:42:58.297 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.294+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=B0X9V7S1SBY8 tag=DD9GHVZ0UASX type=write size=3417711 2024-09-19T11:42:58.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.298+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~OYLUCPTQ930P.0 size=1048576 2024-09-19T11:42:58.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.298+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~OYLUCPTQ930P.1 size=1048576 2024-09-19T11:42:58.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.302+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~OYLUCPTQ930P.2 size=223442 2024-09-19T11:42:58.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.306+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=OYLUCPTQ930P tag=UW4ZVCU8X5YO type=write size=3369170 2024-09-19T11:42:58.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.310+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=1E8FGI0WM3TP type=write size=213469 2024-09-19T11:42:58.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.314+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~NJMTQNXJ1MPK.0 size=1048576 2024-09-19T11:42:58.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.318+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~NJMTQNXJ1MPK.1 size=1048576 2024-09-19T11:42:58.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.318+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~NJMTQNXJ1MPK.2 size=113360 2024-09-19T11:42:58.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.326+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=NJMTQNXJ1MPK tag=3TMB09CGWGO0 type=write size=3259088 2024-09-19T11:42:58.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.330+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=W018B24WGDE4 type=del size=4092563 2024-09-19T11:42:58.336 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.330+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~RTU6ZJ29B16P.0 size=1048576 2024-09-19T11:42:58.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.334+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~RTU6ZJ29B16P.1 size=479285 2024-09-19T11:42:58.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.338+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=RTU6ZJ29B16P tag=FC1O3RRE8SGN type=write size=2576437 2024-09-19T11:42:58.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.346+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~H47F77EY7QR4.0 size=1048576 2024-09-19T11:42:58.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.350+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~H47F77EY7QR4.1 size=847408 2024-09-19T11:42:58.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.350+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=H47F77EY7QR4 tag=PMQYS1I4TWKB type=write size=2944560 2024-09-19T11:42:58.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.350+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~P5WJ8YK4AV6X.0 size=1048576 2024-09-19T11:42:58.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.354+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~P5WJ8YK4AV6X.1 size=492570 2024-09-19T11:42:58.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.358+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=P5WJ8YK4AV6X tag=J93DFAJ3P9JE type=write size=2589722 2024-09-19T11:42:58.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.362+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=K1DI0JUZJT5Y type=del size=4030735 2024-09-19T11:42:58.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.362+0000 7f3d831968c0 1 < canceled part key=_multipart_3QWBQYLI0SJR.2~J0R625N6XBTQ.0 size=835962 2024-09-19T11:42:58.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.370+0000 7f3d831968c0 1 < canceled multipart upload key=3QWBQYLI0SJR upload=J0R625N6XBTQ tag=2FD44QZMKIL1 type=write size=1884538 2024-09-19T11:42:58.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.378+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~LFJ0OWAKXJLR.0 size=583216 2024-09-19T11:42:58.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.378+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=LFJ0OWAKXJLR tag=CNLGE1ZT3GPT type=write size=1631792 2024-09-19T11:42:58.385 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.382+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~L1G6Y1RYYN58.0 size=1048576 2024-09-19T11:42:58.385 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.382+0000 7f3d831968c0 1 < canceled part key=_multipart_LINLTWYV88VU.2~L1G6Y1RYYN58.1 size=1048576 2024-09-19T11:42:58.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.382+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~L1G6Y1RYYN58.2 size=645577 2024-09-19T11:42:58.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.390+0000 7f3d831968c0 1 < canceled multipart upload key=LINLTWYV88VU upload=L1G6Y1RYYN58 tag=P58TVF5OBSB6 type=write size=3791305 2024-09-19T11:42:58.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.390+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=UWNBMYRUTILD type=del size=3485307 2024-09-19T11:42:58.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.394+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=CRSER21AKBDH type=del 2024-09-19T11:42:58.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.402+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~07KW68YY07CU.0 size=474902 2024-09-19T11:42:58.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.402+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=07KW68YY07CU tag=IE8ZSVSN3I0C type=write size=1523478 2024-09-19T11:42:58.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.406+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=PTCORDNCWT1X type=del 2024-09-19T11:42:58.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.410+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~JYYJ2FKPVK5I.0 size=1048576 2024-09-19T11:42:58.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.414+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~JYYJ2FKPVK5I.1 size=527846 2024-09-19T11:42:58.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.414+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=JYYJ2FKPVK5I tag=P47TM1K5S4JC type=write size=2624998 2024-09-19T11:42:58.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.414+0000 7f3d831968c0 1 < canceled part key=_multipart_JTPBGWC4T3Y5.2~YSFAYJHDTWBG.0 size=1048576 2024-09-19T11:42:58.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.418+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~YSFAYJHDTWBG.1 size=1048576 2024-09-19T11:42:58.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.418+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~YSFAYJHDTWBG.2 size=336924 2024-09-19T11:42:58.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.426+0000 7f3d831968c0 1 < canceled multipart upload key=JTPBGWC4T3Y5 upload=YSFAYJHDTWBG tag=C596F8FPZED2 type=write size=3482652 2024-09-19T11:42:58.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.430+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~FCR2VTM53M9O.0 size=267507 2024-09-19T11:42:58.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.430+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=FCR2VTM53M9O tag=Z4ZXWUPBSX7B type=write size=1316083 2024-09-19T11:42:58.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.434+0000 7f3d831968c0 1 < completed write operation key=FKLL38ZNCJ21 tag=7JOPN015CYZ5 type=write size=999990 2024-09-19T11:42:58.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.442+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~CPIFPSXN9B38.0 size=1048576 2024-09-19T11:42:58.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.442+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~CPIFPSXN9B38.1 size=492600 2024-09-19T11:42:58.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.442+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=CPIFPSXN9B38 tag=25VV4TQU1ONN type=write size=2589752 2024-09-19T11:42:58.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.446+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~P1FJTCA4M0KL.0 size=641891 2024-09-19T11:42:58.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.450+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=P1FJTCA4M0KL tag=FEVQF8RFQI4W type=write size=1690467 2024-09-19T11:42:58.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.458+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~900CSXFU7Z4T.0 size=1048576 2024-09-19T11:42:58.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.458+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~900CSXFU7Z4T.1 size=1048576 2024-09-19T11:42:58.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.462+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~900CSXFU7Z4T.2 size=323004 2024-09-19T11:42:58.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.462+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=900CSXFU7Z4T tag=PMDG7LGV45XB type=write size=3468732 2024-09-19T11:42:58.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.466+0000 7f3d831968c0 -1 < failed to complete operation key=3GD7UZCI3WX4 tag=MWWBN7DVYYTI type=del size=1433804: (22) Invalid argument 2024-09-19T11:42:58.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.470+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~VYPNOZE9WNZ8.0 size=692632 2024-09-19T11:42:58.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.470+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=VYPNOZE9WNZ8 tag=9BD7WXHKB5V1 type=write size=1741208 2024-09-19T11:42:58.478 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.474+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=YZ15R41T4UBJ type=del 2024-09-19T11:42:58.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.478+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=8RGPK1CP6UI4 type=del size=3797680 2024-09-19T11:42:58.485 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.482+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=JI1XSGG9LG3B type=del 2024-09-19T11:42:58.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.482+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=ELW7WF9QXWEA type=del size=634479 2024-09-19T11:42:58.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.486+0000 7f3d831968c0 1 < completed write operation key=E8OFSMUZHR02 tag=UAECBAS4SNLN type=write size=877063 2024-09-19T11:42:58.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.490+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=2OIIFQ4ZVN8Z type=del size=1737610 2024-09-19T11:42:58.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.494+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~B0X9V7S1SBY8.0 size=1048576 2024-09-19T11:42:58.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.494+0000 7f3d831968c0 1 < canceled part key=_multipart_5RTONAWGYJNE.2~B0X9V7S1SBY8.1 size=1048576 2024-09-19T11:42:58.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.498+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~B0X9V7S1SBY8.2 size=271983 2024-09-19T11:42:58.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.502+0000 7f3d831968c0 1 < canceled multipart upload key=5RTONAWGYJNE upload=B0X9V7S1SBY8 tag=DD9GHVZ0UASX type=write size=3417711 2024-09-19T11:42:58.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.510+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~DW8YXKNTDQYF.0 size=825253 2024-09-19T11:42:58.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.510+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=DW8YXKNTDQYF tag=PNTSNM6FLJC1 type=write size=1873829 2024-09-19T11:42:58.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.510+0000 7f3d831968c0 1 < completed write operation key=6NLQ0BK8AJUO tag=1E8FGI0WM3TP type=write size=213469 2024-09-19T11:42:58.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.514+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=FM0S43I87A5H type=del size=3713343 2024-09-19T11:42:58.522 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.518+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=W018B24WGDE4 type=del 2024-09-19T11:42:58.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.522+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=3JQ3FMKXNVY6 type=write size=749089 2024-09-19T11:42:58.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.522+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~H47F77EY7QR4.0 size=1048576 2024-09-19T11:42:58.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.526+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~H47F77EY7QR4.1 size=847408 2024-09-19T11:42:58.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.530+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=H47F77EY7QR4 tag=PMQYS1I4TWKB type=write size=2944560 2024-09-19T11:42:58.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.534+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~5JBSFBMO50HU.0 size=1048576 2024-09-19T11:42:58.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.538+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~5JBSFBMO50HU.1 size=1048576 2024-09-19T11:42:58.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.538+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~5JBSFBMO50HU.2 size=131003 2024-09-19T11:42:58.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.538+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=5JBSFBMO50HU tag=YCDGHTJD7R2A type=write size=3276731 2024-09-19T11:42:58.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.542+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=K1DI0JUZJT5Y type=del 2024-09-19T11:42:58.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.546+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=8036GXY9WHKA type=del size=1895450 2024-09-19T11:42:58.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.550+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~LFJ0OWAKXJLR.0 size=583216 2024-09-19T11:42:58.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.554+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=LFJ0OWAKXJLR tag=CNLGE1ZT3GPT type=write size=1631792 2024-09-19T11:42:58.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.558+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=P12LDDS716KZ type=del size=2527596 2024-09-19T11:42:58.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.558+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=UWNBMYRUTILD type=del 2024-09-19T11:42:58.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.566+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~VNCPPP369357.0 size=1048576 2024-09-19T11:42:58.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.566+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~VNCPPP369357.1 size=521969 2024-09-19T11:42:58.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.566+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=VNCPPP369357 tag=BCYAEJGTJO05 type=write size=2619121 2024-09-19T11:42:58.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.570+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~07KW68YY07CU.0 size=474902 2024-09-19T11:42:58.580 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.574+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=07KW68YY07CU tag=IE8ZSVSN3I0C type=write size=1523478 2024-09-19T11:42:58.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.578+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=06B6FX468KZV type=del size=3461866 2024-09-19T11:42:58.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.582+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~JYYJ2FKPVK5I.0 size=1048576 2024-09-19T11:42:58.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.586+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~JYYJ2FKPVK5I.1 size=527846 2024-09-19T11:42:58.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.590+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=JYYJ2FKPVK5I tag=P47TM1K5S4JC type=write size=2624998 2024-09-19T11:42:58.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.594+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=88FPDD6NCDP5 type=del size=1866448 2024-09-19T11:42:58.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.598+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~FCR2VTM53M9O.0 size=267507 2024-09-19T11:42:58.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.602+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=FCR2VTM53M9O tag=Z4ZXWUPBSX7B type=write size=1316083 2024-09-19T11:42:58.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.606+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=JKGZYIO6C3DJ type=del size=1172212 2024-09-19T11:42:58.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.610+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~CPIFPSXN9B38.0 size=1048576 2024-09-19T11:42:58.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.614+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~CPIFPSXN9B38.1 size=492600 2024-09-19T11:42:58.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.618+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=CPIFPSXN9B38 tag=25VV4TQU1ONN type=write size=2589752 2024-09-19T11:42:58.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.622+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~J7JQRVHGBFUC.0 size=1048576 2024-09-19T11:42:58.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.626+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~J7JQRVHGBFUC.1 size=1048576 2024-09-19T11:42:58.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.626+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~J7JQRVHGBFUC.2 size=240632 2024-09-19T11:42:58.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.626+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=J7JQRVHGBFUC tag=70ABKLV4N63T type=write size=3386360 2024-09-19T11:42:58.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.630+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~900CSXFU7Z4T.0 size=1048576 2024-09-19T11:42:58.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.634+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~900CSXFU7Z4T.1 size=1048576 2024-09-19T11:42:58.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.634+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~900CSXFU7Z4T.2 size=323004 2024-09-19T11:42:58.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.642+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=900CSXFU7Z4T tag=PMDG7LGV45XB type=write size=3468732 2024-09-19T11:42:58.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.646+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=HTDTGZ3LR59L type=del size=1488469 2024-09-19T11:42:58.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.646+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~VYPNOZE9WNZ8.0 size=692632 2024-09-19T11:42:58.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.654+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=VYPNOZE9WNZ8 tag=9BD7WXHKB5V1 type=write size=1741208 2024-09-19T11:42:58.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.654+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=IHZY2TCAP0PW type=del size=312562 2024-09-19T11:42:58.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.658+0000 7f3d831968c0 1 < canceled operation key=JTPBGWC4T3Y5 tag=8RGPK1CP6UI4 type=del size=3797680 2024-09-19T11:42:58.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.662+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=L4WFEAZPSEJ7 type=del size=3064213 2024-09-19T11:42:58.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.666+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=ELW7WF9QXWEA type=del 2024-09-19T11:42:58.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.670+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=SUD2X323XZCC type=del size=2913690 2024-09-19T11:42:58.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.674+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=2OIIFQ4ZVN8Z type=del 2024-09-19T11:42:58.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.678+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=NJLTJFZHVKB6 type=del size=249585 2024-09-19T11:42:58.684 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.678+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~DW8YXKNTDQYF.0 size=825253 2024-09-19T11:42:58.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.686+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=DW8YXKNTDQYF tag=PNTSNM6FLJC1 type=write size=1873829 2024-09-19T11:42:58.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.686+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=RDBCSI4Y5JJ0 type=del size=1064955 2024-09-19T11:42:58.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.690+0000 7f3d831968c0 1 < canceled operation key=T9KJH2ZYCLVA tag=FM0S43I87A5H type=del size=3713343 2024-09-19T11:42:58.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.694+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=9Q1P6LRLFFWJ type=del size=3685039 2024-09-19T11:42:58.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.698+0000 7f3d831968c0 1 < completed write operation key=JV7EGEI6062Y tag=3JQ3FMKXNVY6 type=write size=749089 2024-09-19T11:42:58.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.702+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=55WRYH91ZABK type=del size=3423229 2024-09-19T11:42:58.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.702+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~5JBSFBMO50HU.0 size=1048576 2024-09-19T11:42:58.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.706+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~5JBSFBMO50HU.1 size=1048576 2024-09-19T11:42:58.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.710+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~5JBSFBMO50HU.2 size=131003 2024-09-19T11:42:58.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.714+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=5JBSFBMO50HU tag=YCDGHTJD7R2A type=write size=3276731 2024-09-19T11:42:58.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.718+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~9GIOG5SPHDCU.0 size=1048576 2024-09-19T11:42:58.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.722+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~9GIOG5SPHDCU.1 size=916888 2024-09-19T11:42:58.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.722+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=9GIOG5SPHDCU tag=017GMM4D9BJ4 type=write size=3014040 2024-09-19T11:42:58.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.726+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=8036GXY9WHKA type=del 2024-09-19T11:42:58.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.726+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=4YLUWYSHXZDS type=del size=758522 2024-09-19T11:42:58.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.730+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=P12LDDS716KZ type=del 2024-09-19T11:42:58.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.734+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=YGQCAN45JPZ7 type=del size=2082054 2024-09-19T11:42:58.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.738+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~VNCPPP369357.0 size=1048576 2024-09-19T11:42:58.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.738+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~VNCPPP369357.1 size=521969 2024-09-19T11:42:58.748 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.746+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=VNCPPP369357 tag=BCYAEJGTJO05 type=write size=2619121 2024-09-19T11:42:58.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.750+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~JP97JNA51W4M.0 size=1048576 2024-09-19T11:42:58.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.754+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~JP97JNA51W4M.1 size=1048576 2024-09-19T11:42:58.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.754+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~JP97JNA51W4M.2 size=436806 2024-09-19T11:42:58.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.754+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=JP97JNA51W4M tag=TBSD6HF57NTS type=write size=3582534 2024-09-19T11:42:58.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.758+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=06B6FX468KZV type=del 2024-09-19T11:42:58.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.762+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=PTVTVH8FSCC0 type=write size=71703 2024-09-19T11:42:58.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.762+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=88FPDD6NCDP5 type=del 2024-09-19T11:42:58.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.766+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=B8FYTFMRFPZX type=write size=217814 2024-09-19T11:42:58.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.770+0000 7f3d831968c0 1 < canceled operation key=8104Z4OQ7UWQ tag=JKGZYIO6C3DJ type=del size=1172212 2024-09-19T11:42:58.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.774+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~GWUTARWW86Q3.0 size=89723 2024-09-19T11:42:58.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.774+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=GWUTARWW86Q3 tag=65RRIJDBQPKZ type=write size=1138299 2024-09-19T11:42:58.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.778+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~J7JQRVHGBFUC.0 size=1048576 2024-09-19T11:42:58.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.782+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~J7JQRVHGBFUC.1 size=1048576 2024-09-19T11:42:58.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.782+0000 7f3d831968c0 1 < canceled part key=_multipart_EVFF0F0760OS.2~J7JQRVHGBFUC.2 size=240632 2024-09-19T11:42:58.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.786+0000 7f3d831968c0 1 < canceled multipart upload key=EVFF0F0760OS upload=J7JQRVHGBFUC tag=70ABKLV4N63T type=write size=3386360 2024-09-19T11:42:58.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.790+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=ZMQ6NBEXFG82 type=write size=846645 2024-09-19T11:42:58.796 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.794+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=HTDTGZ3LR59L type=del 2024-09-19T11:42:58.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.798+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~C7MWSQQ9W52D.0 size=1048576 2024-09-19T11:42:58.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.802+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~C7MWSQQ9W52D.1 size=1048576 2024-09-19T11:42:58.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.802+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~C7MWSQQ9W52D.2 size=138200 2024-09-19T11:42:58.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.802+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=C7MWSQQ9W52D tag=2O095QVTPEPZ type=write size=3283928 2024-09-19T11:42:58.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.806+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=IHZY2TCAP0PW type=del 2024-09-19T11:42:58.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.810+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~5A5GDFVJGGES.0 size=930146 2024-09-19T11:42:58.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.810+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=5A5GDFVJGGES tag=QKGPIJNU15FI type=write size=1978722 2024-09-19T11:42:58.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.814+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=L4WFEAZPSEJ7 type=del 2024-09-19T11:42:58.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.822+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~Z3WYBQYP3F3J.0 size=1048576 2024-09-19T11:42:58.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.822+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~Z3WYBQYP3F3J.1 size=1036029 2024-09-19T11:42:58.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.822+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=Z3WYBQYP3F3J tag=BVJV1YYSY74F type=write size=3133181 2024-09-19T11:42:58.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.826+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=SUD2X323XZCC type=del 2024-09-19T11:42:58.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.830+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=FXZG5B5D7334 type=write size=493202 2024-09-19T11:42:58.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.834+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=NJLTJFZHVKB6 type=del 2024-09-19T11:42:58.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.838+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=1SS0YBX586T7 type=del size=1065961 2024-09-19T11:42:58.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.838+0000 7f3d831968c0 1 < canceled operation key=900RV3451AON tag=RDBCSI4Y5JJ0 type=del size=1064955 2024-09-19T11:42:58.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.842+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=BF3HCFF99ATW type=del size=2748381 2024-09-19T11:42:58.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.846+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=9Q1P6LRLFFWJ type=del 2024-09-19T11:42:58.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.854+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~TFGDXEZBBCB4.0 size=1048576 2024-09-19T11:42:58.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.854+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~TFGDXEZBBCB4.1 size=1048576 2024-09-19T11:42:58.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.858+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~TFGDXEZBBCB4.2 size=829615 2024-09-19T11:42:58.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.858+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=TFGDXEZBBCB4 tag=93J0788I40I9 type=write size=3975343 2024-09-19T11:42:58.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.862+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=55WRYH91ZABK type=del 2024-09-19T11:42:58.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.866+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=G6MCDP4LNNDQ type=del size=18917 2024-09-19T11:42:58.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.866+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~9GIOG5SPHDCU.0 size=1048576 2024-09-19T11:42:58.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.870+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~9GIOG5SPHDCU.1 size=916888 2024-09-19T11:42:58.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.874+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=9GIOG5SPHDCU tag=017GMM4D9BJ4 type=write size=3014040 2024-09-19T11:42:58.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.882+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~T528HHOPSSN8.0 size=727916 2024-09-19T11:42:58.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.882+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=T528HHOPSSN8 tag=P078E6HZEHVN type=write size=1776492 2024-09-19T11:42:58.889 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.886+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=4YLUWYSHXZDS type=del 2024-09-19T11:42:58.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.890+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~XMQ623Y42ZGK.0 size=1048576 2024-09-19T11:42:58.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.894+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~XMQ623Y42ZGK.1 size=1048576 2024-09-19T11:42:58.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.898+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~XMQ623Y42ZGK.2 size=968515 2024-09-19T11:42:58.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.898+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=XMQ623Y42ZGK tag=ZJL5OHUMSEE9 type=write size=4114243 2024-09-19T11:42:58.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.902+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=YGQCAN45JPZ7 type=del 2024-09-19T11:42:58.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.902+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=OHE0TEZW75NF type=write size=124733 2024-09-19T11:42:58.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.906+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~JP97JNA51W4M.0 size=1048576 2024-09-19T11:42:58.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.910+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~JP97JNA51W4M.1 size=1048576 2024-09-19T11:42:58.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.914+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~JP97JNA51W4M.2 size=436806 2024-09-19T11:42:58.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.918+0000 7f3d831968c0 1 < completed multipart upload key=76JFMPOUJZXW upload=JP97JNA51W4M tag=TBSD6HF57NTS type=write size=3582534 2024-09-19T11:42:58.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.922+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=6HVHES5CUEPV type=del size=2396448 2024-09-19T11:42:58.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.922+0000 7f3d831968c0 1 < canceled operation key=900RV3451AON tag=PTVTVH8FSCC0 type=write size=71703 2024-09-19T11:42:58.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.930+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~RA32299XYOSP.0 size=1048576 2024-09-19T11:42:58.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.930+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~RA32299XYOSP.1 size=829 2024-09-19T11:42:58.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.930+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=RA32299XYOSP tag=YDBTQK7S9GN8 type=write size=2097981 2024-09-19T11:42:58.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.934+0000 7f3d831968c0 1 < completed write operation key=PB62JE7I55GG tag=B8FYTFMRFPZX type=write size=217814 2024-09-19T11:42:58.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.942+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~N6WVSH5RCIQZ.0 size=1048576 2024-09-19T11:42:58.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.942+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~N6WVSH5RCIQZ.1 size=1048576 2024-09-19T11:42:58.950 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.946+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~N6WVSH5RCIQZ.2 size=14946 2024-09-19T11:42:58.950 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.946+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=N6WVSH5RCIQZ tag=NLOY0YYESN4B type=write size=3160674 2024-09-19T11:42:58.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.950+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~GWUTARWW86Q3.0 size=89723 2024-09-19T11:42:58.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.954+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=GWUTARWW86Q3 tag=65RRIJDBQPKZ type=write size=1138299 2024-09-19T11:42:58.966 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.962+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~SET0CK7TEZNE.0 size=1048576 2024-09-19T11:42:58.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.966+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~SET0CK7TEZNE.1 size=754795 2024-09-19T11:42:58.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.966+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=SET0CK7TEZNE tag=LSWN0LJ4URAN type=write size=2851947 2024-09-19T11:42:58.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.966+0000 7f3d831968c0 1 < completed write operation key=8104Z4OQ7UWQ tag=ZMQ6NBEXFG82 type=write size=846645 2024-09-19T11:42:58.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.974+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~99OBANXL6CR0.0 size=1048576 2024-09-19T11:42:58.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.974+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~99OBANXL6CR0.1 size=187575 2024-09-19T11:42:58.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.974+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=99OBANXL6CR0 tag=3P8U2FWTOMDX type=write size=2284727 2024-09-19T11:42:58.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.978+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~C7MWSQQ9W52D.0 size=1048576 2024-09-19T11:42:58.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.978+0000 7f3d831968c0 1 < canceled part key=_multipart_6NLQ0BK8AJUO.2~C7MWSQQ9W52D.1 size=1048576 2024-09-19T11:42:58.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.982+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~C7MWSQQ9W52D.2 size=138200 2024-09-19T11:42:58.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.986+0000 7f3d831968c0 1 < canceled multipart upload key=6NLQ0BK8AJUO upload=C7MWSQQ9W52D tag=2O095QVTPEPZ type=write size=3283928 2024-09-19T11:42:58.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.990+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=G5GBO22EDU7A type=write size=114549 2024-09-19T11:42:58.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.994+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~5A5GDFVJGGES.0 size=930146 2024-09-19T11:42:59.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:58.998+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=5A5GDFVJGGES tag=QKGPIJNU15FI type=write size=1978722 2024-09-19T11:42:59.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.006+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~DC5ERDFHLO4T.0 size=1048576 2024-09-19T11:42:59.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.006+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~DC5ERDFHLO4T.1 size=318633 2024-09-19T11:42:59.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.006+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=DC5ERDFHLO4T tag=88Y5ZPJZ4I2L type=write size=2415785 2024-09-19T11:42:59.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.010+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~Z3WYBQYP3F3J.0 size=1048576 2024-09-19T11:42:59.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.014+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~Z3WYBQYP3F3J.1 size=1036029 2024-09-19T11:42:59.022 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.018+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=Z3WYBQYP3F3J tag=BVJV1YYSY74F type=write size=3133181 2024-09-19T11:42:59.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.022+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=0SDWBZ8JIBSJ type=del size=2470500 2024-09-19T11:42:59.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.026+0000 7f3d831968c0 1 < suggested remove operation key=G4P6HIOM1G2E tag=FXZG5B5D7334 type=write 2024-09-19T11:42:59.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.034+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~63UKN9I4OYF8.0 size=1048576 2024-09-19T11:42:59.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.038+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~63UKN9I4OYF8.1 size=390380 2024-09-19T11:42:59.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.038+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=63UKN9I4OYF8 tag=EY1NGE02AP68 type=write size=2487532 2024-09-19T11:42:59.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.038+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=1SS0YBX586T7 type=del 2024-09-19T11:42:59.050 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.046+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~3RO0F20BNXPS.0 size=1048576 2024-09-19T11:42:59.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.050+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~3RO0F20BNXPS.1 size=425237 2024-09-19T11:42:59.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.050+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=3RO0F20BNXPS tag=W2ZG7LOKO75X type=write size=2522389 2024-09-19T11:42:59.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.050+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=BF3HCFF99ATW type=del 2024-09-19T11:42:59.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.054+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=JQA81IQ3F1X8 type=del size=2458883 2024-09-19T11:42:59.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.058+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~TFGDXEZBBCB4.0 size=1048576 2024-09-19T11:42:59.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.058+0000 7f3d831968c0 1 < canceled part key=_multipart_CULXGFLZ0HI6.2~TFGDXEZBBCB4.1 size=1048576 2024-09-19T11:42:59.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.062+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~TFGDXEZBBCB4.2 size=829615 2024-09-19T11:42:59.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.066+0000 7f3d831968c0 1 < canceled multipart upload key=CULXGFLZ0HI6 upload=TFGDXEZBBCB4 tag=93J0788I40I9 type=write size=3975343 2024-09-19T11:42:59.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.074+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~P05DYOCEVQCP.0 size=1048576 2024-09-19T11:42:59.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.074+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~P05DYOCEVQCP.1 size=1048576 2024-09-19T11:42:59.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.078+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~P05DYOCEVQCP.2 size=762833 2024-09-19T11:42:59.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.078+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=P05DYOCEVQCP tag=RKE7TRVUB033 type=write size=3908561 2024-09-19T11:42:59.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.082+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=G6MCDP4LNNDQ type=del 2024-09-19T11:42:59.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.082+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=OXZ2AQY77B5N type=del size=416669 2024-09-19T11:42:59.091 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.086+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~T528HHOPSSN8.0 size=727916 2024-09-19T11:42:59.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.094+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=T528HHOPSSN8 tag=P078E6HZEHVN type=write size=1776492 2024-09-19T11:42:59.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.094+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=4AB7C5N6T3IL type=del size=1036306 2024-09-19T11:42:59.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.098+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~XMQ623Y42ZGK.0 size=1048576 2024-09-19T11:42:59.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.098+0000 7f3d831968c0 1 < canceled part key=_multipart_4V17CRW6EB65.2~XMQ623Y42ZGK.1 size=1048576 2024-09-19T11:42:59.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.102+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~XMQ623Y42ZGK.2 size=968515 2024-09-19T11:42:59.112 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.106+0000 7f3d831968c0 1 < canceled multipart upload key=4V17CRW6EB65 upload=XMQ623Y42ZGK tag=ZJL5OHUMSEE9 type=write size=4114243 2024-09-19T11:42:59.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.114+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~5E5JV1V1406X.0 size=314348 2024-09-19T11:42:59.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.114+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=5E5JV1V1406X tag=RRXMQZ725HLA type=write size=1362924 2024-09-19T11:42:59.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.118+0000 7f3d831968c0 1 < completed write operation key=8104Z4OQ7UWQ tag=OHE0TEZW75NF type=write size=124733 2024-09-19T11:42:59.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.126+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~BGHAXM16MW7S.0 size=916842 2024-09-19T11:42:59.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.126+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=BGHAXM16MW7S tag=FDBRGMWU0MX1 type=write size=1965418 2024-09-19T11:42:59.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.130+0000 7f3d831968c0 1 < suggested remove operation key=FZGRZ06MOHBI tag=6HVHES5CUEPV type=del 2024-09-19T11:42:59.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.134+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=MCCQG6C2T9TZ type=del size=1562014 2024-09-19T11:42:59.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.138+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~RA32299XYOSP.0 size=1048576 2024-09-19T11:42:59.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.142+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~RA32299XYOSP.1 size=829 2024-09-19T11:42:59.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.146+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=RA32299XYOSP tag=YDBTQK7S9GN8 type=write size=2097981 2024-09-19T11:42:59.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.154+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~EYFR60BI7N20.0 size=1048576 2024-09-19T11:42:59.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.158+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~EYFR60BI7N20.1 size=1048576 2024-09-19T11:42:59.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.162+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~EYFR60BI7N20.2 size=69110 2024-09-19T11:42:59.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.162+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=EYFR60BI7N20 tag=4J1CM2FOHP4W type=write size=3214838 2024-09-19T11:42:59.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.162+0000 7f3d831968c0 1 < canceled part key=_multipart_QPG75T46BH38.2~N6WVSH5RCIQZ.0 size=1048576 2024-09-19T11:42:59.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.166+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~N6WVSH5RCIQZ.1 size=1048576 2024-09-19T11:42:59.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.170+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~N6WVSH5RCIQZ.2 size=14946 2024-09-19T11:42:59.178 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.174+0000 7f3d831968c0 1 < canceled multipart upload key=QPG75T46BH38 upload=N6WVSH5RCIQZ tag=NLOY0YYESN4B type=write size=3160674 2024-09-19T11:42:59.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.182+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~1WRO5Q9GWYQQ.0 size=1048576 2024-09-19T11:42:59.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.182+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~1WRO5Q9GWYQQ.1 size=1048576 2024-09-19T11:42:59.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.186+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~1WRO5Q9GWYQQ.2 size=309442 2024-09-19T11:42:59.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.186+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=1WRO5Q9GWYQQ tag=DLQT565TXYEV type=write size=3455170 2024-09-19T11:42:59.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.190+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~SET0CK7TEZNE.0 size=1048576 2024-09-19T11:42:59.196 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.190+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~SET0CK7TEZNE.1 size=754795 2024-09-19T11:42:59.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.198+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=SET0CK7TEZNE tag=LSWN0LJ4URAN type=write size=2851947 2024-09-19T11:42:59.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.202+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=IW7Z7LRZ15FN type=del size=3158233 2024-09-19T11:42:59.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.206+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~99OBANXL6CR0.0 size=1048576 2024-09-19T11:42:59.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.206+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~99OBANXL6CR0.1 size=187575 2024-09-19T11:42:59.217 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.214+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=99OBANXL6CR0 tag=3P8U2FWTOMDX type=write size=2284727 2024-09-19T11:42:59.223 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.218+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~LNT5O2FUMZKZ.0 size=751071 2024-09-19T11:42:59.223 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.218+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=LNT5O2FUMZKZ tag=KPMB8HW4OAMD type=write size=1799647 2024-09-19T11:42:59.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.226+0000 7f3d831968c0 1 < suggested remove operation key=JV7EGEI6062Y tag=G5GBO22EDU7A type=write 2024-09-19T11:42:59.236 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.234+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~1AHZGDVSXQ3J.0 size=1048576 2024-09-19T11:42:59.239 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.234+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~1AHZGDVSXQ3J.1 size=875396 2024-09-19T11:42:59.239 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.234+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=1AHZGDVSXQ3J tag=HIS2A9D1AIIF type=write size=2972548 2024-09-19T11:42:59.240 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.234+0000 7f3d831968c0 1 < canceled part key=_multipart_Y3LO4H9RI4X0.2~DC5ERDFHLO4T.0 size=1048576 2024-09-19T11:42:59.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.238+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~DC5ERDFHLO4T.1 size=318633 2024-09-19T11:42:59.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.246+0000 7f3d831968c0 1 < canceled multipart upload key=Y3LO4H9RI4X0 upload=DC5ERDFHLO4T tag=88Y5ZPJZ4I2L type=write size=2415785 2024-09-19T11:42:59.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.246+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=U2B5PWBSE7XG type=del size=4011837 2024-09-19T11:42:59.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.250+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=0SDWBZ8JIBSJ type=del 2024-09-19T11:42:59.260 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.254+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=56ZOHJ6UHVT9 type=del size=1438726 2024-09-19T11:42:59.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.258+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~63UKN9I4OYF8.0 size=1048576 2024-09-19T11:42:59.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.262+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~63UKN9I4OYF8.1 size=390380 2024-09-19T11:42:59.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.270+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=63UKN9I4OYF8 tag=EY1NGE02AP68 type=write size=2487532 2024-09-19T11:42:59.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.274+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=TAQQNO8866K1 type=del size=962760 2024-09-19T11:42:59.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.278+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~3RO0F20BNXPS.0 size=1048576 2024-09-19T11:42:59.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.282+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~3RO0F20BNXPS.1 size=425237 2024-09-19T11:42:59.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.286+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=3RO0F20BNXPS tag=W2ZG7LOKO75X type=write size=2522389 2024-09-19T11:42:59.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.290+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=AJ1E7CAAGXZ7 type=write size=19128 2024-09-19T11:42:59.297 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.294+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=JQA81IQ3F1X8 type=del 2024-09-19T11:42:59.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.298+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=K1X7LQZGH52F type=del size=3821609 2024-09-19T11:42:59.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.302+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~P05DYOCEVQCP.0 size=1048576 2024-09-19T11:42:59.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.302+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~P05DYOCEVQCP.1 size=1048576 2024-09-19T11:42:59.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.306+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~P05DYOCEVQCP.2 size=762833 2024-09-19T11:42:59.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.310+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=P05DYOCEVQCP tag=RKE7TRVUB033 type=write size=3908561 2024-09-19T11:42:59.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.314+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=RHXD7DJC1BQC type=del size=314389 2024-09-19T11:42:59.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.318+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=OXZ2AQY77B5N type=del 2024-09-19T11:42:59.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.322+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=1VTYI9QT6M8V type=write size=331173 2024-09-19T11:42:59.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.326+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=4AB7C5N6T3IL type=del 2024-09-19T11:42:59.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.330+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=W8LER9L8X11V type=del size=2444335 2024-09-19T11:42:59.336 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.334+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~5E5JV1V1406X.0 size=314348 2024-09-19T11:42:59.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.338+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=5E5JV1V1406X tag=RRXMQZ725HLA type=write size=1362924 2024-09-19T11:42:59.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.342+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~HJOWJ2T6V85N.0 size=542141 2024-09-19T11:42:59.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.342+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=HJOWJ2T6V85N tag=SMWSZW15ETHK type=write size=1590717 2024-09-19T11:42:59.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.346+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~BGHAXM16MW7S.0 size=916842 2024-09-19T11:42:59.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.354+0000 7f3d831968c0 1 < completed multipart upload key=EVFF0F0760OS upload=BGHAXM16MW7S tag=FDBRGMWU0MX1 type=write size=1965418 2024-09-19T11:42:59.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.358+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~4UT4XE6HDR60.0 size=1048576 2024-09-19T11:42:59.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.362+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~4UT4XE6HDR60.1 size=638300 2024-09-19T11:42:59.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.362+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=4UT4XE6HDR60 tag=3Q5AD34WY728 type=write size=2735452 2024-09-19T11:42:59.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.366+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=MCCQG6C2T9TZ type=del 2024-09-19T11:42:59.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.374+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~41BWRK58NAK7.0 size=877164 2024-09-19T11:42:59.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.374+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=41BWRK58NAK7 tag=RJ8CLBK95E1X type=write size=1925740 2024-09-19T11:42:59.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.374+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~EYFR60BI7N20.0 size=1048576 2024-09-19T11:42:59.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.378+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~EYFR60BI7N20.1 size=1048576 2024-09-19T11:42:59.385 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.382+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~EYFR60BI7N20.2 size=69110 2024-09-19T11:42:59.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.386+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=EYFR60BI7N20 tag=4J1CM2FOHP4W type=write size=3214838 2024-09-19T11:42:59.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.394+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~A44Q6VQXEQFA.0 size=340577 2024-09-19T11:42:59.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.394+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=A44Q6VQXEQFA tag=RT995UX0DHFM type=write size=1389153 2024-09-19T11:42:59.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.394+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~1WRO5Q9GWYQQ.0 size=1048576 2024-09-19T11:42:59.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.398+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~1WRO5Q9GWYQQ.1 size=1048576 2024-09-19T11:42:59.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.402+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~1WRO5Q9GWYQQ.2 size=309442 2024-09-19T11:42:59.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.406+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=1WRO5Q9GWYQQ tag=DLQT565TXYEV type=write size=3455170 2024-09-19T11:42:59.413 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.410+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=D56XZZG6YD4A type=del size=3399203 2024-09-19T11:42:59.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.410+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=IW7Z7LRZ15FN type=del 2024-09-19T11:42:59.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.414+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=TWTAED7F3XHE type=del size=2166555 2024-09-19T11:42:59.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.418+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~LNT5O2FUMZKZ.0 size=751071 2024-09-19T11:42:59.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.422+0000 7f3d831968c0 1 < completed multipart upload key=5RTONAWGYJNE upload=LNT5O2FUMZKZ tag=KPMB8HW4OAMD type=write size=1799647 2024-09-19T11:42:59.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.430+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~66Y5LTPOZ4H9.0 size=417899 2024-09-19T11:42:59.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.430+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=66Y5LTPOZ4H9 tag=3GIM3VUULM7W type=write size=1466475 2024-09-19T11:42:59.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.434+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~1AHZGDVSXQ3J.0 size=1048576 2024-09-19T11:42:59.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.434+0000 7f3d831968c0 1 < canceled part key=_multipart_8104Z4OQ7UWQ.2~1AHZGDVSXQ3J.1 size=875396 2024-09-19T11:42:59.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.438+0000 7f3d831968c0 1 < canceled multipart upload key=8104Z4OQ7UWQ upload=1AHZGDVSXQ3J tag=HIS2A9D1AIIF type=write size=2972548 2024-09-19T11:42:59.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.442+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=O5QWIAR31TW9 type=write size=118186 2024-09-19T11:42:59.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.446+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=U2B5PWBSE7XG type=del 2024-09-19T11:42:59.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.450+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~UEYIM3S7JAIP.0 size=579090 2024-09-19T11:42:59.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.450+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=UEYIM3S7JAIP tag=119WHQJTJYEB type=write size=1627666 2024-09-19T11:42:59.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.454+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=56ZOHJ6UHVT9 type=del 2024-09-19T11:42:59.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.458+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~JAV39ZQU659P.0 size=1048576 2024-09-19T11:42:59.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.462+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~JAV39ZQU659P.1 size=1048576 2024-09-19T11:42:59.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.466+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~JAV39ZQU659P.2 size=904750 2024-09-19T11:42:59.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.466+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=JAV39ZQU659P tag=BHF6P9F07KQD type=write size=4050478 2024-09-19T11:42:59.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.466+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=TAQQNO8866K1 type=del 2024-09-19T11:42:59.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.470+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=OYTJDHIYNGW4 type=write size=742609 2024-09-19T11:42:59.478 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.474+0000 7f3d831968c0 1 < completed write operation key=EVFF0F0760OS tag=AJ1E7CAAGXZ7 type=write size=19128 2024-09-19T11:42:59.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.478+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=2ZFUU7WH9ILR type=del size=1575933 2024-09-19T11:42:59.485 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.482+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=K1X7LQZGH52F type=del 2024-09-19T11:42:59.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.482+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=AEIEAAP7KZ5E type=del size=3041028 2024-09-19T11:42:59.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.486+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=RHXD7DJC1BQC type=del 2024-09-19T11:42:59.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.494+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~R9DHJRW32MBF.0 size=1048576 2024-09-19T11:42:59.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.494+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~R9DHJRW32MBF.1 size=643927 2024-09-19T11:42:59.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.494+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=R9DHJRW32MBF tag=XB4YA9GXWRA0 type=write size=2741079 2024-09-19T11:42:59.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.498+0000 7f3d831968c0 1 < completed write operation key=5RTONAWGYJNE tag=1VTYI9QT6M8V type=write size=331173 2024-09-19T11:42:59.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.502+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=LL7P1LXCPCUW type=write size=357703 2024-09-19T11:42:59.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.506+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=W8LER9L8X11V type=del 2024-09-19T11:42:59.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.510+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=BTQVS3GUWFJ7 type=del size=1731654 2024-09-19T11:42:59.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.514+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~HJOWJ2T6V85N.0 size=542141 2024-09-19T11:42:59.522 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.518+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=HJOWJ2T6V85N tag=SMWSZW15ETHK type=write size=1590717 2024-09-19T11:42:59.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.522+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~GH4H7WGS2B0J.0 size=1048576 2024-09-19T11:42:59.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.526+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~GH4H7WGS2B0J.1 size=1048576 2024-09-19T11:42:59.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.530+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~GH4H7WGS2B0J.2 size=62214 2024-09-19T11:42:59.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.530+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=GH4H7WGS2B0J tag=FUVSPEOTT9CC type=write size=3207942 2024-09-19T11:42:59.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.534+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~4UT4XE6HDR60.0 size=1048576 2024-09-19T11:42:59.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.534+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~4UT4XE6HDR60.1 size=638300 2024-09-19T11:42:59.545 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.542+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=4UT4XE6HDR60 tag=3Q5AD34WY728 type=write size=2735452 2024-09-19T11:42:59.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.542+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=S08UG99CQXIA type=del size=2347124 2024-09-19T11:42:59.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.546+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~41BWRK58NAK7.0 size=877164 2024-09-19T11:42:59.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.554+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=41BWRK58NAK7 tag=RJ8CLBK95E1X type=write size=1925740 2024-09-19T11:42:59.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.558+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=LY3JQPS5DOWQ type=del size=1644353 2024-09-19T11:42:59.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.562+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~A44Q6VQXEQFA.0 size=340577 2024-09-19T11:42:59.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.566+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=A44Q6VQXEQFA tag=RT995UX0DHFM type=write size=1389153 2024-09-19T11:42:59.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.570+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=4BD52BNTS8AF type=write size=475129 2024-09-19T11:42:59.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.578+0000 7f3d831968c0 1 < suggested update operation key=E8OFSMUZHR02 tag=D56XZZG6YD4A type=del size=3399203 2024-09-19T11:42:59.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.582+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=1VAU5GYM9Q4U type=write size=717875 2024-09-19T11:42:59.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.586+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=TWTAED7F3XHE type=del 2024-09-19T11:42:59.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.590+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=87HV8YJDRNBO type=del size=1317071 2024-09-19T11:42:59.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.594+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~66Y5LTPOZ4H9.0 size=417899 2024-09-19T11:42:59.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.598+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=66Y5LTPOZ4H9 tag=3GIM3VUULM7W type=write size=1466475 2024-09-19T11:42:59.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.602+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=05PZ3DMU62C6 type=del size=2847729 2024-09-19T11:42:59.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.606+0000 7f3d831968c0 1 < completed write operation key=JV7EGEI6062Y tag=O5QWIAR31TW9 type=write size=118186 2024-09-19T11:42:59.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.618+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~44XP5FIRRVZB.0 size=1048576 2024-09-19T11:42:59.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.622+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~44XP5FIRRVZB.1 size=327091 2024-09-19T11:42:59.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.622+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=44XP5FIRRVZB tag=ZI3ZTCGLAPHQ type=write size=2424243 2024-09-19T11:42:59.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.622+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~UEYIM3S7JAIP.0 size=579090 2024-09-19T11:42:59.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.630+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=UEYIM3S7JAIP tag=119WHQJTJYEB type=write size=1627666 2024-09-19T11:42:59.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.634+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~P3FCN95N9Q85.0 size=695898 2024-09-19T11:42:59.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.634+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=P3FCN95N9Q85 tag=86EUZXNIENS2 type=write size=1744474 2024-09-19T11:42:59.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.638+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~JAV39ZQU659P.0 size=1048576 2024-09-19T11:42:59.643 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.638+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~JAV39ZQU659P.1 size=1048576 2024-09-19T11:42:59.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.642+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~JAV39ZQU659P.2 size=904750 2024-09-19T11:42:59.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.646+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=JAV39ZQU659P tag=BHF6P9F07KQD type=write size=4050478 2024-09-19T11:42:59.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.646+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=OBE3BWWRXM3W type=del size=3984196 2024-09-19T11:42:59.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.650+0000 7f3d831968c0 1 < completed write operation key=PB62JE7I55GG tag=OYTJDHIYNGW4 type=write size=742609 2024-09-19T11:42:59.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.650+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=L0KIAN14VOXN type=del size=51182 2024-09-19T11:42:59.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.654+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=2ZFUU7WH9ILR type=del 2024-09-19T11:42:59.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.658+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=T2YDOTOVXE8P type=del size=2816131 2024-09-19T11:42:59.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.658+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=AEIEAAP7KZ5E type=del 2024-09-19T11:42:59.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.662+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=3Q22OZBQ6OPS type=del size=1399420 2024-09-19T11:42:59.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.666+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~R9DHJRW32MBF.0 size=1048576 2024-09-19T11:42:59.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.666+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~R9DHJRW32MBF.1 size=643927 2024-09-19T11:42:59.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.670+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=R9DHJRW32MBF tag=XB4YA9GXWRA0 type=write size=2741079 2024-09-19T11:42:59.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.674+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=MIT3S3W98L3D type=del size=2854984 2024-09-19T11:42:59.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.674+0000 7f3d831968c0 1 < completed write operation key=0OOB2SNLVK8E tag=LL7P1LXCPCUW type=write size=357703 2024-09-19T11:42:59.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.682+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~IC711RA30HNB.0 size=1048576 2024-09-19T11:42:59.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.682+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~IC711RA30HNB.1 size=680908 2024-09-19T11:42:59.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.682+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=IC711RA30HNB tag=9I7TPCOGQ34A type=write size=2778060 2024-09-19T11:42:59.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.686+0000 7f3d831968c0 1 < suggested remove operation key=6NLQ0BK8AJUO tag=BTQVS3GUWFJ7 type=del 2024-09-19T11:42:59.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.690+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=GQ99I05O9JFZ type=del size=1630765 2024-09-19T11:42:59.696 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.694+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~GH4H7WGS2B0J.0 size=1048576 2024-09-19T11:42:59.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.694+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~GH4H7WGS2B0J.1 size=1048576 2024-09-19T11:42:59.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.698+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~GH4H7WGS2B0J.2 size=62214 2024-09-19T11:42:59.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.702+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=GH4H7WGS2B0J tag=FUVSPEOTT9CC type=write size=3207942 2024-09-19T11:42:59.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.702+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=QWCXJU1EE9TN type=write size=597049 2024-09-19T11:42:59.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.706+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=S08UG99CQXIA type=del 2024-09-19T11:42:59.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.710+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~5PT85KD5830J.0 size=99314 2024-09-19T11:42:59.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.710+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=5PT85KD5830J tag=74WEHHHYPGEN type=write size=1147890 2024-09-19T11:42:59.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.710+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=LY3JQPS5DOWQ type=del 2024-09-19T11:42:59.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.714+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=9H1RKBMI4O1C type=del size=2812853 2024-09-19T11:42:59.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.718+0000 7f3d831968c0 1 < completed write operation key=KAPKNZJ2DE6A tag=4BD52BNTS8AF type=write size=475129 2024-09-19T11:42:59.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.718+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=M4EO0I9VTDQF type=del size=452714 2024-09-19T11:42:59.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.722+0000 7f3d831968c0 1 < completed write operation key=QPG75T46BH38 tag=1VAU5GYM9Q4U type=write size=717875 2024-09-19T11:42:59.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.722+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=UM0KKWB5BXD5 type=del size=706632 2024-09-19T11:42:59.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.726+0000 7f3d831968c0 1 < canceled operation key=JTPBGWC4T3Y5 tag=87HV8YJDRNBO type=del size=1317071 2024-09-19T11:42:59.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.730+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=J8JKL856RT31 type=del size=3930539 2024-09-19T11:42:59.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.730+0000 7f3d831968c0 -1 < failed to complete operation key=6NLQ0BK8AJUO tag=05PZ3DMU62C6 type=del size=2847729: (22) Invalid argument 2024-09-19T11:42:59.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.734+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~88VQN8WK77CX.0 size=1048576 2024-09-19T11:42:59.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.738+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~88VQN8WK77CX.1 size=1048576 2024-09-19T11:42:59.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.738+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~88VQN8WK77CX.2 size=969988 2024-09-19T11:42:59.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.738+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=88VQN8WK77CX tag=1NVI4FUIQV04 type=write size=4115716 2024-09-19T11:42:59.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.742+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~44XP5FIRRVZB.0 size=1048576 2024-09-19T11:42:59.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.742+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~44XP5FIRRVZB.1 size=327091 2024-09-19T11:42:59.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.746+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=44XP5FIRRVZB tag=ZI3ZTCGLAPHQ type=write size=2424243 2024-09-19T11:42:59.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.750+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~EMYT33NY6H9S.0 size=1048576 2024-09-19T11:42:59.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.754+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~EMYT33NY6H9S.1 size=746272 2024-09-19T11:42:59.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.754+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=EMYT33NY6H9S tag=BB6ILUE8MVEF type=write size=2843424 2024-09-19T11:42:59.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.754+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~P3FCN95N9Q85.0 size=695898 2024-09-19T11:42:59.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.758+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=P3FCN95N9Q85 tag=86EUZXNIENS2 type=write size=1744474 2024-09-19T11:42:59.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.762+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~LJGAVG1BLA88.0 size=881046 2024-09-19T11:42:59.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.762+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=LJGAVG1BLA88 tag=RGOCSS8DPTSX type=write size=1929622 2024-09-19T11:42:59.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.766+0000 7f3d831968c0 1 < canceled operation key=3QWBQYLI0SJR tag=OBE3BWWRXM3W type=del size=3984196 2024-09-19T11:42:59.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.770+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=2LBVJCLAX8C9 type=del size=1371193 2024-09-19T11:42:59.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.770+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=L0KIAN14VOXN type=del 2024-09-19T11:42:59.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.774+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~O29C7WSEM2PR.0 size=1048576 2024-09-19T11:42:59.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.778+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~O29C7WSEM2PR.1 size=862366 2024-09-19T11:42:59.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.778+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=O29C7WSEM2PR tag=I0HA3LZLE9QF type=write size=2959518 2024-09-19T11:42:59.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.778+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=T2YDOTOVXE8P type=del 2024-09-19T11:42:59.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.782+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~3J96AYALCCGW.0 size=1048576 2024-09-19T11:42:59.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.786+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~3J96AYALCCGW.1 size=1048576 2024-09-19T11:42:59.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.790+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~3J96AYALCCGW.2 size=579047 2024-09-19T11:42:59.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.790+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=3J96AYALCCGW tag=TA1UEXF9AOHJ type=write size=3724775 2024-09-19T11:42:59.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.790+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=3Q22OZBQ6OPS type=del 2024-09-19T11:42:59.798 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.794+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=UDIIBOYYXJZQ type=del size=1545643 2024-09-19T11:42:59.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.798+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=MIT3S3W98L3D type=del 2024-09-19T11:42:59.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.802+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~6KY8PROMDE8Z.0 size=1048576 2024-09-19T11:42:59.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.806+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~6KY8PROMDE8Z.1 size=951940 2024-09-19T11:42:59.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.806+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=6KY8PROMDE8Z tag=M6FFQF776NF3 type=write size=3049092 2024-09-19T11:42:59.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.810+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~IC711RA30HNB.0 size=1048576 2024-09-19T11:42:59.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.810+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~IC711RA30HNB.1 size=680908 2024-09-19T11:42:59.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.818+0000 7f3d831968c0 1 < completed multipart upload key=LINLTWYV88VU upload=IC711RA30HNB tag=9I7TPCOGQ34A type=write size=2778060 2024-09-19T11:42:59.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.822+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~PK1OZ13F1EIF.0 size=1048576 2024-09-19T11:42:59.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.826+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~PK1OZ13F1EIF.1 size=1048576 2024-09-19T11:42:59.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.830+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~PK1OZ13F1EIF.2 size=986867 2024-09-19T11:42:59.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.830+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=PK1OZ13F1EIF tag=TU6LZNUWA7A0 type=write size=4132595 2024-09-19T11:42:59.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.834+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=GQ99I05O9JFZ type=del 2024-09-19T11:42:59.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.838+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~SV7PNP3GQW4O.0 size=831557 2024-09-19T11:42:59.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.838+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=SV7PNP3GQW4O tag=C897GY2ZCU88 type=write size=1880133 2024-09-19T11:42:59.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.842+0000 7f3d831968c0 1 < suggested update operation key=4V17CRW6EB65 tag=QWCXJU1EE9TN type=write size=597049 2024-09-19T11:42:59.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.846+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=SVQ3FO0C6BYV type=del size=3558757 2024-09-19T11:42:59.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.850+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~5PT85KD5830J.0 size=99314 2024-09-19T11:42:59.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.854+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=5PT85KD5830J tag=74WEHHHYPGEN type=write size=1147890 2024-09-19T11:42:59.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.854+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=8SUF0TC6BU8P type=del size=2038300 2024-09-19T11:42:59.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.858+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=9H1RKBMI4O1C type=del 2024-09-19T11:42:59.867 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.862+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~XVUJQ632ZYTE.0 size=1048576 2024-09-19T11:42:59.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.866+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~XVUJQ632ZYTE.1 size=659749 2024-09-19T11:42:59.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.866+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=XVUJQ632ZYTE tag=CXTZ9XYVH6TQ type=write size=2756901 2024-09-19T11:42:59.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.866+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=M4EO0I9VTDQF type=del 2024-09-19T11:42:59.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.870+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~POCC0FRPNRCA.0 size=1048576 2024-09-19T11:42:59.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.874+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~POCC0FRPNRCA.1 size=130332 2024-09-19T11:42:59.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.874+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=POCC0FRPNRCA tag=34OAEP0K5N47 type=write size=2227484 2024-09-19T11:42:59.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.878+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=UM0KKWB5BXD5 type=del 2024-09-19T11:42:59.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.878+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=70C0NQTY4V3A type=write size=196351 2024-09-19T11:42:59.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.882+0000 7f3d831968c0 1 < suggested remove operation key=UI7EVZ1SGD8R tag=J8JKL856RT31 type=del 2024-09-19T11:42:59.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.886+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~4XYYYJONTAYN.0 size=1048576 2024-09-19T11:42:59.894 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.890+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~4XYYYJONTAYN.1 size=1048576 2024-09-19T11:42:59.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.890+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~4XYYYJONTAYN.2 size=588764 2024-09-19T11:42:59.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.890+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=4XYYYJONTAYN tag=R3R48HF3XJM2 type=write size=3734492 2024-09-19T11:42:59.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.894+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~88VQN8WK77CX.0 size=1048576 2024-09-19T11:42:59.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.894+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~88VQN8WK77CX.1 size=1048576 2024-09-19T11:42:59.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.898+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~88VQN8WK77CX.2 size=969988 2024-09-19T11:42:59.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.902+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=88VQN8WK77CX tag=1NVI4FUIQV04 type=write size=4115716 2024-09-19T11:42:59.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.906+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=1AU9SOHW9OEN type=del size=3018874 2024-09-19T11:42:59.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.906+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~EMYT33NY6H9S.0 size=1048576 2024-09-19T11:42:59.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.910+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~EMYT33NY6H9S.1 size=746272 2024-09-19T11:42:59.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.914+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=EMYT33NY6H9S tag=BB6ILUE8MVEF type=write size=2843424 2024-09-19T11:42:59.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.918+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~R3VMPMWSF1TP.0 size=1048576 2024-09-19T11:42:59.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.918+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~R3VMPMWSF1TP.1 size=815010 2024-09-19T11:42:59.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.918+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=R3VMPMWSF1TP tag=2L1VLGNGZHYV type=write size=2912162 2024-09-19T11:42:59.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.922+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~LJGAVG1BLA88.0 size=881046 2024-09-19T11:42:59.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.926+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=LJGAVG1BLA88 tag=RGOCSS8DPTSX type=write size=1929622 2024-09-19T11:42:59.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.930+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~D03EIJ07XETE.0 size=1048576 2024-09-19T11:42:59.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.934+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~D03EIJ07XETE.1 size=766324 2024-09-19T11:42:59.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.934+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=D03EIJ07XETE tag=0UYBVK6O3WWA type=write size=2863476 2024-09-19T11:42:59.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.934+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=2LBVJCLAX8C9 type=del 2024-09-19T11:42:59.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.938+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=1J8WJFLSNMGW type=del size=1547006 2024-09-19T11:42:59.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.942+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~O29C7WSEM2PR.0 size=1048576 2024-09-19T11:42:59.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.942+0000 7f3d831968c0 1 < canceled part key=_multipart_00DYD22W0ZNB.2~O29C7WSEM2PR.1 size=862366 2024-09-19T11:42:59.950 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.946+0000 7f3d831968c0 1 < canceled multipart upload key=00DYD22W0ZNB upload=O29C7WSEM2PR tag=I0HA3LZLE9QF type=write size=2959518 2024-09-19T11:42:59.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.950+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=OSSZDV2N37GG type=write size=8335 2024-09-19T11:42:59.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.950+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~3J96AYALCCGW.0 size=1048576 2024-09-19T11:42:59.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.950+0000 7f3d831968c0 1 < canceled part key=_multipart_UI7EVZ1SGD8R.2~3J96AYALCCGW.1 size=1048576 2024-09-19T11:42:59.958 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.954+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~3J96AYALCCGW.2 size=579047 2024-09-19T11:42:59.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.958+0000 7f3d831968c0 1 < canceled multipart upload key=UI7EVZ1SGD8R upload=3J96AYALCCGW tag=TA1UEXF9AOHJ type=write size=3724775 2024-09-19T11:42:59.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.966+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~LYF7O2FK33B2.0 size=1048576 2024-09-19T11:42:59.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.966+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~LYF7O2FK33B2.1 size=1048576 2024-09-19T11:42:59.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.970+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~LYF7O2FK33B2.2 size=214139 2024-09-19T11:42:59.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.970+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=LYF7O2FK33B2 tag=R39O39OFWJWX type=write size=3359867 2024-09-19T11:42:59.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.974+0000 7f3d831968c0 1 < canceled operation key=224HPC2Y95N6 tag=UDIIBOYYXJZQ type=del size=1545643 2024-09-19T11:42:59.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.974+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=G8ASH8H9ZKYD type=del size=1315612 2024-09-19T11:42:59.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.978+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~6KY8PROMDE8Z.0 size=1048576 2024-09-19T11:42:59.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.982+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~6KY8PROMDE8Z.1 size=951940 2024-09-19T11:42:59.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.986+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=6KY8PROMDE8Z tag=M6FFQF776NF3 type=write size=3049092 2024-09-19T11:42:59.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.990+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=2YTK0ZIY2K8X type=del size=291816 2024-09-19T11:42:59.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.994+0000 7f3d831968c0 1 < canceled part key=_multipart_6NLQ0BK8AJUO.2~PK1OZ13F1EIF.0 size=1048576 2024-09-19T11:42:59.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.994+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~PK1OZ13F1EIF.1 size=1048576 2024-09-19T11:43:00.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:42:59.998+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~PK1OZ13F1EIF.2 size=986867 2024-09-19T11:43:00.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.002+0000 7f3d831968c0 1 < canceled multipart upload key=6NLQ0BK8AJUO upload=PK1OZ13F1EIF tag=TU6LZNUWA7A0 type=write size=4132595 2024-09-19T11:43:00.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.010+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~NXYF6BZ0T3HQ.0 size=1048576 2024-09-19T11:43:00.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.010+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~NXYF6BZ0T3HQ.1 size=1048576 2024-09-19T11:43:00.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.014+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~NXYF6BZ0T3HQ.2 size=933340 2024-09-19T11:43:00.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.014+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=NXYF6BZ0T3HQ tag=AI24PCE03V28 type=write size=4079068 2024-09-19T11:43:00.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.018+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~SV7PNP3GQW4O.0 size=831557 2024-09-19T11:43:00.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.022+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=SV7PNP3GQW4O tag=C897GY2ZCU88 type=write size=1880133 2024-09-19T11:43:00.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.026+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=X3J3S8EPQ1YB type=del size=3637454 2024-09-19T11:43:00.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.030+0000 7f3d831968c0 1 < suggested update operation key=3K8P37C015G3 tag=SVQ3FO0C6BYV type=del size=3558757 2024-09-19T11:43:00.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.034+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=OJW8BQ5KQWUO type=write size=1028492 2024-09-19T11:43:00.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.038+0000 7f3d831968c0 1 < suggested remove operation key=224HPC2Y95N6 tag=8SUF0TC6BU8P type=del 2024-09-19T11:43:00.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.042+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~DV6I04XA1VGP.0 size=655593 2024-09-19T11:43:00.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.042+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=DV6I04XA1VGP tag=6LEP09QR0MG6 type=write size=1704169 2024-09-19T11:43:00.050 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.046+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~XVUJQ632ZYTE.0 size=1048576 2024-09-19T11:43:00.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.050+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~XVUJQ632ZYTE.1 size=659749 2024-09-19T11:43:00.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.054+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=XVUJQ632ZYTE tag=CXTZ9XYVH6TQ type=write size=2756901 2024-09-19T11:43:00.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.058+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=4ZELJXCKBZAW type=del size=4054708 2024-09-19T11:43:00.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.062+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~POCC0FRPNRCA.0 size=1048576 2024-09-19T11:43:00.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.062+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~POCC0FRPNRCA.1 size=130332 2024-09-19T11:43:00.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.066+0000 7f3d831968c0 1 < completed multipart upload key=76JFMPOUJZXW upload=POCC0FRPNRCA tag=34OAEP0K5N47 type=write size=2227484 2024-09-19T11:43:00.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.074+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~TK1MT3NY834F.0 size=310109 2024-09-19T11:43:00.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.074+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=TK1MT3NY834F tag=6O80HBQYBQ92 type=write size=1358685 2024-09-19T11:43:00.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.074+0000 7f3d831968c0 1 < completed write operation key=PB62JE7I55GG tag=70C0NQTY4V3A type=write size=196351 2024-09-19T11:43:00.084 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.078+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~1WU4QP305YT7.0 size=539833 2024-09-19T11:43:00.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.078+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=1WU4QP305YT7 tag=WPEHFYGKENOK type=write size=1588409 2024-09-19T11:43:00.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.086+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~4XYYYJONTAYN.0 size=1048576 2024-09-19T11:43:00.091 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.086+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~4XYYYJONTAYN.1 size=1048576 2024-09-19T11:43:00.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.090+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~4XYYYJONTAYN.2 size=588764 2024-09-19T11:43:00.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.094+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=4XYYYJONTAYN tag=R3R48HF3XJM2 type=write size=3734492 2024-09-19T11:43:00.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.094+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=JFGB4Y3VU6C4 type=del size=3115864 2024-09-19T11:43:00.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.094+0000 7f3d831968c0 -1 < no bi entry to suggest for operation key=224HPC2Y95N6 tag=1AU9SOHW9OEN type=del size=3018874: (2) No such file or directory 2024-09-19T11:43:00.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.098+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=ASI5EF0B4LPO type=del size=106489 2024-09-19T11:43:00.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.102+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~R3VMPMWSF1TP.0 size=1048576 2024-09-19T11:43:00.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.102+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~R3VMPMWSF1TP.1 size=815010 2024-09-19T11:43:00.110 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.106+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=R3VMPMWSF1TP tag=2L1VLGNGZHYV type=write size=2912162 2024-09-19T11:43:00.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.110+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=WXFNEQQPP2ZK type=write size=767490 2024-09-19T11:43:00.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.110+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~D03EIJ07XETE.0 size=1048576 2024-09-19T11:43:00.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.114+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~D03EIJ07XETE.1 size=766324 2024-09-19T11:43:00.120 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.114+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=D03EIJ07XETE tag=0UYBVK6O3WWA type=write size=2863476 2024-09-19T11:43:00.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.118+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=CBOEOHVCS0XX type=write size=469815 2024-09-19T11:43:00.124 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.118+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=1J8WJFLSNMGW type=del 2024-09-19T11:43:00.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.122+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=KSBH0LOOJXAL type=write size=513005 2024-09-19T11:43:00.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.122+0000 7f3d831968c0 1 < completed write operation key=Y3LO4H9RI4X0 tag=OSSZDV2N37GG type=write size=8335 2024-09-19T11:43:00.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.126+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=AYKHPDPXTIB7 type=del size=345056 2024-09-19T11:43:00.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.126+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~LYF7O2FK33B2.0 size=1048576 2024-09-19T11:43:00.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.130+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~LYF7O2FK33B2.1 size=1048576 2024-09-19T11:43:00.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.130+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~LYF7O2FK33B2.2 size=214139 2024-09-19T11:43:00.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.134+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=LYF7O2FK33B2 tag=R39O39OFWJWX type=write size=3359867 2024-09-19T11:43:00.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.138+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=7FVN20GLKCM5 type=del size=952127 2024-09-19T11:43:00.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.138+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=G8ASH8H9ZKYD type=del 2024-09-19T11:43:00.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.138+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=103GOA3AZJVJ type=del size=3794743 2024-09-19T11:43:00.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.142+0000 7f3d831968c0 1 < suggested remove operation key=CULXGFLZ0HI6 tag=2YTK0ZIY2K8X type=del 2024-09-19T11:43:00.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.146+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=RRB8TEKQW09S type=del size=108634 2024-09-19T11:43:00.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.146+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~NXYF6BZ0T3HQ.0 size=1048576 2024-09-19T11:43:00.153 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.150+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~NXYF6BZ0T3HQ.1 size=1048576 2024-09-19T11:43:00.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.150+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~NXYF6BZ0T3HQ.2 size=933340 2024-09-19T11:43:00.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.154+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=NXYF6BZ0T3HQ tag=AI24PCE03V28 type=write size=4079068 2024-09-19T11:43:00.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.158+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~3R4UK99CR9X2.0 size=1048576 2024-09-19T11:43:00.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.158+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~3R4UK99CR9X2.1 size=1048576 2024-09-19T11:43:00.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.158+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~3R4UK99CR9X2.2 size=316779 2024-09-19T11:43:00.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.158+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=3R4UK99CR9X2 tag=M9BAXXYTSF69 type=write size=3462507 2024-09-19T11:43:00.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.162+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=X3J3S8EPQ1YB type=del 2024-09-19T11:43:00.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.166+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~8U6L1Z16A46L.0 size=593613 2024-09-19T11:43:00.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.166+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=8U6L1Z16A46L tag=EV448BE8X09G type=write size=1642189 2024-09-19T11:43:00.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.170+0000 7f3d831968c0 1 < completed write operation key=0OOB2SNLVK8E tag=OJW8BQ5KQWUO type=write size=1028492 2024-09-19T11:43:00.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.170+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=4NS0S4YGPILD type=del size=1197033 2024-09-19T11:43:00.178 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.174+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~DV6I04XA1VGP.0 size=655593 2024-09-19T11:43:00.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.178+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=DV6I04XA1VGP tag=6LEP09QR0MG6 type=write size=1704169 2024-09-19T11:43:00.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.182+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~B9K2S9KZXB2Q.0 size=1048576 2024-09-19T11:43:00.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.186+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~B9K2S9KZXB2Q.1 size=213234 2024-09-19T11:43:00.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.186+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=B9K2S9KZXB2Q tag=EQP6K0WWHV9U type=write size=2310386 2024-09-19T11:43:00.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.186+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=4ZELJXCKBZAW type=del 2024-09-19T11:43:00.197 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.194+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~YY5V1FUZZFDT.0 size=1048576 2024-09-19T11:43:00.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.194+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~YY5V1FUZZFDT.1 size=1048576 2024-09-19T11:43:00.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.198+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~YY5V1FUZZFDT.2 size=323125 2024-09-19T11:43:00.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.198+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=YY5V1FUZZFDT tag=MW5GNI9S2TCV type=write size=3468853 2024-09-19T11:43:00.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.198+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~TK1MT3NY834F.0 size=310109 2024-09-19T11:43:00.207 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.202+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=TK1MT3NY834F tag=6O80HBQYBQ92 type=write size=1358685 2024-09-19T11:43:00.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.206+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=3ZRAMVN7QYOA type=del size=984973 2024-09-19T11:43:00.214 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.210+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~1WU4QP305YT7.0 size=539833 2024-09-19T11:43:00.218 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.214+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=1WU4QP305YT7 tag=WPEHFYGKENOK type=write size=1588409 2024-09-19T11:43:00.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.218+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=7L156T2DSH8X type=write size=1026472 2024-09-19T11:43:00.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.222+0000 7f3d831968c0 1 < suggested update operation key=EVFF0F0760OS tag=JFGB4Y3VU6C4 type=del size=3115864 2024-09-19T11:43:00.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.226+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=VHXYR5FUZYXF type=del size=3141005 2024-09-19T11:43:00.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.226+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=ASI5EF0B4LPO type=del 2024-09-19T11:43:00.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.234+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~ZCPFFEAHMHUS.0 size=400403 2024-09-19T11:43:00.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.234+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=ZCPFFEAHMHUS tag=JBASCLJRMLE6 type=write size=1448979 2024-09-19T11:43:00.240 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.234+0000 7f3d831968c0 1 < completed write operation key=QPG75T46BH38 tag=WXFNEQQPP2ZK type=write size=767490 2024-09-19T11:43:00.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.242+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~O73ZE5RWD3F4.0 size=597498 2024-09-19T11:43:00.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.242+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=O73ZE5RWD3F4 tag=128O3N5352NO type=write size=1646074 2024-09-19T11:43:00.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.246+0000 7f3d831968c0 1 < suggested update operation key=900RV3451AON tag=CBOEOHVCS0XX type=write size=469815 2024-09-19T11:43:00.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.250+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~6BA7V1HONZLZ.0 size=252156 2024-09-19T11:43:00.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.250+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=6BA7V1HONZLZ tag=5KJAA7AGTBKG type=write size=1300732 2024-09-19T11:43:00.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.254+0000 7f3d831968c0 1 < completed write operation key=0OOB2SNLVK8E tag=KSBH0LOOJXAL type=write size=513005 2024-09-19T11:43:00.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.258+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~UQYMFBB3ICFW.0 size=291599 2024-09-19T11:43:00.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.258+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=UQYMFBB3ICFW tag=1N40M94BZWFX type=write size=1340175 2024-09-19T11:43:00.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.262+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=AYKHPDPXTIB7 type=del 2024-09-19T11:43:00.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.266+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=L3EOQR89JAPS type=del size=1135101 2024-09-19T11:43:00.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.270+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=7FVN20GLKCM5 type=del 2024-09-19T11:43:00.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.274+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~MJPCT0FWYLZ1.0 size=1048576 2024-09-19T11:43:00.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.274+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~MJPCT0FWYLZ1.1 size=162671 2024-09-19T11:43:00.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.274+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=MJPCT0FWYLZ1 tag=YTID4PUKKC8J type=write size=2259823 2024-09-19T11:43:00.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.278+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=103GOA3AZJVJ type=del 2024-09-19T11:43:00.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.282+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=7WX6YBPTNCS4 type=write size=681226 2024-09-19T11:43:00.288 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.282+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=RRB8TEKQW09S type=del 2024-09-19T11:43:00.292 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.286+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=S4XSLOK071N4 type=del size=3905483 2024-09-19T11:43:00.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.286+0000 7f3d831968c0 1 < canceled part key=_multipart_CULXGFLZ0HI6.2~3R4UK99CR9X2.0 size=1048576 2024-09-19T11:43:00.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.290+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~3R4UK99CR9X2.1 size=1048576 2024-09-19T11:43:00.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.290+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~3R4UK99CR9X2.2 size=316779 2024-09-19T11:43:00.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.298+0000 7f3d831968c0 1 < canceled multipart upload key=CULXGFLZ0HI6 upload=3R4UK99CR9X2 tag=M9BAXXYTSF69 type=write size=3462507 2024-09-19T11:43:00.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.298+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=6A1WK8DXFG0H type=del size=4106004 2024-09-19T11:43:00.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.298+0000 7f3d831968c0 1 < canceled part key=_multipart_UI7EVZ1SGD8R.2~8U6L1Z16A46L.0 size=593613 2024-09-19T11:43:00.308 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.302+0000 7f3d831968c0 1 < canceled multipart upload key=UI7EVZ1SGD8R upload=8U6L1Z16A46L tag=EV448BE8X09G type=write size=1642189 2024-09-19T11:43:00.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.306+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=BOI2K5GB5Q3Z type=write size=527041 2024-09-19T11:43:00.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.310+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=4NS0S4YGPILD type=del 2024-09-19T11:43:00.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.314+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=I9PQ7TAX7F03 type=del size=1563123 2024-09-19T11:43:00.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.318+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~B9K2S9KZXB2Q.0 size=1048576 2024-09-19T11:43:00.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.318+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~B9K2S9KZXB2Q.1 size=213234 2024-09-19T11:43:00.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.322+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=B9K2S9KZXB2Q tag=EQP6K0WWHV9U type=write size=2310386 2024-09-19T11:43:00.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.330+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~HKJKK36QPFZV.0 size=1048576 2024-09-19T11:43:00.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.330+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~HKJKK36QPFZV.1 size=1048576 2024-09-19T11:43:00.337 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.334+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~HKJKK36QPFZV.2 size=218711 2024-09-19T11:43:00.337 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.334+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=HKJKK36QPFZV tag=72XN2K1B5LVM type=write size=3364439 2024-09-19T11:43:00.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.334+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~YY5V1FUZZFDT.0 size=1048576 2024-09-19T11:43:00.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.338+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~YY5V1FUZZFDT.1 size=1048576 2024-09-19T11:43:00.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.338+0000 7f3d831968c0 1 < canceled part key=_multipart_6NLQ0BK8AJUO.2~YY5V1FUZZFDT.2 size=323125 2024-09-19T11:43:00.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.342+0000 7f3d831968c0 1 < canceled multipart upload key=6NLQ0BK8AJUO upload=YY5V1FUZZFDT tag=MW5GNI9S2TCV type=write size=3468853 2024-09-19T11:43:00.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.346+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~IQN2FVCJJ03Z.0 size=1048576 2024-09-19T11:43:00.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.350+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~IQN2FVCJJ03Z.1 size=272381 2024-09-19T11:43:00.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.350+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=IQN2FVCJJ03Z tag=IIRKTK2KAR6D type=write size=2369533 2024-09-19T11:43:00.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.354+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=3ZRAMVN7QYOA type=del 2024-09-19T11:43:00.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.358+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=COB7NX3AOW2Y type=del size=379980 2024-09-19T11:43:00.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.358+0000 7f3d831968c0 1 < completed write operation key=Y3LO4H9RI4X0 tag=7L156T2DSH8X type=write size=1026472 2024-09-19T11:43:00.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.366+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~ECW04MBBDNQ9.0 size=1048576 2024-09-19T11:43:00.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.366+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~ECW04MBBDNQ9.1 size=1007205 2024-09-19T11:43:00.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.366+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=ECW04MBBDNQ9 tag=IIN4QLZ9NTG4 type=write size=3104357 2024-09-19T11:43:00.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.374+0000 7f3d831968c0 1 < suggested update operation key=UI7EVZ1SGD8R tag=VHXYR5FUZYXF type=del size=3141005 2024-09-19T11:43:00.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.378+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~VEM2DN2FZHQR.0 size=883372 2024-09-19T11:43:00.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.378+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=VEM2DN2FZHQR tag=4MJ2R3QHQM9N type=write size=1931948 2024-09-19T11:43:00.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.382+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~ZCPFFEAHMHUS.0 size=400403 2024-09-19T11:43:00.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.386+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=ZCPFFEAHMHUS tag=JBASCLJRMLE6 type=write size=1448979 2024-09-19T11:43:00.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.390+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=26DNW8UKBF00 type=write size=1014616 2024-09-19T11:43:00.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.394+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~O73ZE5RWD3F4.0 size=597498 2024-09-19T11:43:00.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.398+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=O73ZE5RWD3F4 tag=128O3N5352NO type=write size=1646074 2024-09-19T11:43:00.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.402+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=541ITCJE5UBU type=write size=212381 2024-09-19T11:43:00.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.406+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~6BA7V1HONZLZ.0 size=252156 2024-09-19T11:43:00.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.410+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=6BA7V1HONZLZ tag=5KJAA7AGTBKG type=write size=1300732 2024-09-19T11:43:00.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.414+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=389WB0RMZNY3 type=del size=1170052 2024-09-19T11:43:00.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.418+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~UQYMFBB3ICFW.0 size=291599 2024-09-19T11:43:00.428 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.422+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=UQYMFBB3ICFW tag=1N40M94BZWFX type=write size=1340175 2024-09-19T11:43:00.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.430+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~TR0CGOBTCSKC.0 size=1048576 2024-09-19T11:43:00.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.434+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~TR0CGOBTCSKC.1 size=1048576 2024-09-19T11:43:00.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.438+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~TR0CGOBTCSKC.2 size=610831 2024-09-19T11:43:00.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.438+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=TR0CGOBTCSKC tag=EZ3YF350V5GM type=write size=3756559 2024-09-19T11:43:00.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.438+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=L3EOQR89JAPS type=del 2024-09-19T11:43:00.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.442+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=4G066PUCFXB4 type=write size=22559 2024-09-19T11:43:00.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.446+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~MJPCT0FWYLZ1.0 size=1048576 2024-09-19T11:43:00.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.450+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~MJPCT0FWYLZ1.1 size=162671 2024-09-19T11:43:00.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.458+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=MJPCT0FWYLZ1 tag=YTID4PUKKC8J type=write size=2259823 2024-09-19T11:43:00.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.462+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=JMGK8HZIMHCV type=write size=756102 2024-09-19T11:43:00.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.462+0000 7f3d831968c0 1 < completed write operation key=FKLL38ZNCJ21 tag=7WX6YBPTNCS4 type=write size=681226 2024-09-19T11:43:00.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.470+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~VYT50XC937YO.0 size=1048576 2024-09-19T11:43:00.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.474+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~VYT50XC937YO.1 size=201411 2024-09-19T11:43:00.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.474+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=VYT50XC937YO tag=7YTE0L5J8MP8 type=write size=2298563 2024-09-19T11:43:00.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.474+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=S4XSLOK071N4 type=del 2024-09-19T11:43:00.487 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.482+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~D80Q8HNV455I.0 size=1048576 2024-09-19T11:43:00.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.486+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~D80Q8HNV455I.1 size=1048576 2024-09-19T11:43:00.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.486+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~D80Q8HNV455I.2 size=903699 2024-09-19T11:43:00.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.486+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=D80Q8HNV455I tag=05Z9L7P99MAA type=write size=4049427 2024-09-19T11:43:00.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.490+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=6A1WK8DXFG0H type=del 2024-09-19T11:43:00.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.494+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=B0HVR0IBBZWR type=del size=1686891 2024-09-19T11:43:00.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.498+0000 7f3d831968c0 1 < completed write operation key=G4P6HIOM1G2E tag=BOI2K5GB5Q3Z type=write size=527041 2024-09-19T11:43:00.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.502+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~VQAV774X132C.0 size=1048576 2024-09-19T11:43:00.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.506+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~VQAV774X132C.1 size=1048576 2024-09-19T11:43:00.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.510+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~VQAV774X132C.2 size=584509 2024-09-19T11:43:00.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.510+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=VQAV774X132C tag=XQ6NJLWQJTLZ type=write size=3730237 2024-09-19T11:43:00.520 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.514+0000 7f3d831968c0 1 < suggested remove operation key=T9KJH2ZYCLVA tag=I9PQ7TAX7F03 type=del 2024-09-19T11:43:00.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.522+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~F0IB4KY0XDYB.0 size=1048576 2024-09-19T11:43:00.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.526+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~F0IB4KY0XDYB.1 size=1048576 2024-09-19T11:43:00.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.526+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~F0IB4KY0XDYB.2 size=325960 2024-09-19T11:43:00.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.526+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=F0IB4KY0XDYB tag=Z1O86AEZ956R type=write size=3471688 2024-09-19T11:43:00.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.530+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~HKJKK36QPFZV.0 size=1048576 2024-09-19T11:43:00.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.534+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~HKJKK36QPFZV.1 size=1048576 2024-09-19T11:43:00.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.538+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~HKJKK36QPFZV.2 size=218711 2024-09-19T11:43:00.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.542+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=HKJKK36QPFZV tag=72XN2K1B5LVM type=write size=3364439 2024-09-19T11:43:00.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.546+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=FB1DQGHS9WCI type=del size=2181943 2024-09-19T11:43:00.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.550+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~IQN2FVCJJ03Z.0 size=1048576 2024-09-19T11:43:00.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.550+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~IQN2FVCJJ03Z.1 size=272381 2024-09-19T11:43:00.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.558+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=IQN2FVCJJ03Z tag=IIRKTK2KAR6D type=write size=2369533 2024-09-19T11:43:00.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.562+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=ZS7B389YPAY0 type=del size=1536400 2024-09-19T11:43:00.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.562+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=COB7NX3AOW2Y type=del 2024-09-19T11:43:00.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.570+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~8PN0BECY3SX7.0 size=1048576 2024-09-19T11:43:00.577 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.574+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~8PN0BECY3SX7.1 size=1048576 2024-09-19T11:43:00.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.574+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~8PN0BECY3SX7.2 size=181492 2024-09-19T11:43:00.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.574+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=8PN0BECY3SX7 tag=QZE9LD326ROB type=write size=3327220 2024-09-19T11:43:00.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.578+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~ECW04MBBDNQ9.0 size=1048576 2024-09-19T11:43:00.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.578+0000 7f3d831968c0 1 < canceled part key=_multipart_5RTONAWGYJNE.2~ECW04MBBDNQ9.1 size=1007205 2024-09-19T11:43:00.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.586+0000 7f3d831968c0 1 < canceled multipart upload key=5RTONAWGYJNE upload=ECW04MBBDNQ9 tag=IIN4QLZ9NTG4 type=write size=3104357 2024-09-19T11:43:00.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.590+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=Q30PONR0ETPD type=del size=2634701 2024-09-19T11:43:00.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.594+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~VEM2DN2FZHQR.0 size=883372 2024-09-19T11:43:00.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.598+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=VEM2DN2FZHQR tag=4MJ2R3QHQM9N type=write size=1931948 2024-09-19T11:43:00.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.602+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=I61A6WNOZOS1 type=del size=2148051 2024-09-19T11:43:00.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.606+0000 7f3d831968c0 1 < completed write operation key=0OOB2SNLVK8E tag=26DNW8UKBF00 type=write size=1014616 2024-09-19T11:43:00.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.610+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=U1SIELINTL23 type=del size=2132951 2024-09-19T11:43:00.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.622+0000 7f3d831968c0 1 < suggested remove operation key=UI7EVZ1SGD8R tag=541ITCJE5UBU type=write 2024-09-19T11:43:00.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.626+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=75N9ZJYLRLJS type=del size=61038 2024-09-19T11:43:00.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.634+0000 7f3d831968c0 1 < suggested update operation key=3GD7UZCI3WX4 tag=389WB0RMZNY3 type=del size=1170052 2024-09-19T11:43:00.641 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.638+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=YKTBCFPTGD7A type=del size=2141814 2024-09-19T11:43:00.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.642+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~TR0CGOBTCSKC.0 size=1048576 2024-09-19T11:43:00.647 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.642+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~TR0CGOBTCSKC.1 size=1048576 2024-09-19T11:43:00.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.646+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~TR0CGOBTCSKC.2 size=610831 2024-09-19T11:43:00.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.654+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=TR0CGOBTCSKC tag=EZ3YF350V5GM type=write size=3756559 2024-09-19T11:43:00.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.654+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=UD8K1Y1RRLLU type=del size=1302976 2024-09-19T11:43:00.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.658+0000 7f3d831968c0 -1 < failed to complete operation key=T9KJH2ZYCLVA tag=4G066PUCFXB4 type=write size=22559: (22) Invalid argument 2024-09-19T11:43:00.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.666+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~9YWFNECYM9J7.0 size=234848 2024-09-19T11:43:00.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.666+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=9YWFNECYM9J7 tag=JNQXQJSOQBCP type=write size=1283424 2024-09-19T11:43:00.673 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.670+0000 7f3d831968c0 1 < completed write operation key=900RV3451AON tag=JMGK8HZIMHCV type=write size=756102 2024-09-19T11:43:00.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.670+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=FES02FW2AY15 type=del size=3836522 2024-09-19T11:43:00.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.674+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~VYT50XC937YO.0 size=1048576 2024-09-19T11:43:00.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.678+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~VYT50XC937YO.1 size=201411 2024-09-19T11:43:00.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.682+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=VYT50XC937YO tag=7YTE0L5J8MP8 type=write size=2298563 2024-09-19T11:43:00.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.690+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~RT85GK56VVYH.0 size=1048576 2024-09-19T11:43:00.696 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.690+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~RT85GK56VVYH.1 size=408525 2024-09-19T11:43:00.696 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.690+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=RT85GK56VVYH tag=WTYMJRZ1CBXU type=write size=2505677 2024-09-19T11:43:00.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.694+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~D80Q8HNV455I.0 size=1048576 2024-09-19T11:43:00.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.698+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~D80Q8HNV455I.1 size=1048576 2024-09-19T11:43:00.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.702+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~D80Q8HNV455I.2 size=903699 2024-09-19T11:43:00.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.706+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=D80Q8HNV455I tag=05Z9L7P99MAA type=write size=4049427 2024-09-19T11:43:00.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.710+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=PWMFAH4S1WT6 type=del size=622567 2024-09-19T11:43:00.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.714+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=B0HVR0IBBZWR type=del 2024-09-19T11:43:00.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.718+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=3H1MESEN7BZH type=del size=1710104 2024-09-19T11:43:00.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.722+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~VQAV774X132C.0 size=1048576 2024-09-19T11:43:00.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.722+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~VQAV774X132C.1 size=1048576 2024-09-19T11:43:00.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.726+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~VQAV774X132C.2 size=584509 2024-09-19T11:43:00.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.730+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=VQAV774X132C tag=XQ6NJLWQJTLZ type=write size=3730237 2024-09-19T11:43:00.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.734+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=IG0WAL9SH93U type=del size=2059913 2024-09-19T11:43:00.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.738+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~F0IB4KY0XDYB.0 size=1048576 2024-09-19T11:43:00.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.742+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~F0IB4KY0XDYB.1 size=1048576 2024-09-19T11:43:00.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.742+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~F0IB4KY0XDYB.2 size=325960 2024-09-19T11:43:00.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.750+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=F0IB4KY0XDYB tag=Z1O86AEZ956R type=write size=3471688 2024-09-19T11:43:00.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.754+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=UU0N1UNCYBLZ type=del size=1648366 2024-09-19T11:43:00.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.758+0000 7f3d831968c0 1 < suggested remove operation key=UI7EVZ1SGD8R tag=FB1DQGHS9WCI type=del 2024-09-19T11:43:00.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.762+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=51ZMCJITB17I type=write size=185343 2024-09-19T11:43:00.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.770+0000 7f3d831968c0 1 < suggested remove operation key=900RV3451AON tag=ZS7B389YPAY0 type=del 2024-09-19T11:43:00.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.770+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=V1DTPLVCSYIX type=del size=2379599 2024-09-19T11:43:00.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.774+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~8PN0BECY3SX7.0 size=1048576 2024-09-19T11:43:00.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.778+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~8PN0BECY3SX7.1 size=1048576 2024-09-19T11:43:00.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.778+0000 7f3d831968c0 1 < canceled part key=_multipart_G4P6HIOM1G2E.2~8PN0BECY3SX7.2 size=181492 2024-09-19T11:43:00.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.782+0000 7f3d831968c0 1 < canceled multipart upload key=G4P6HIOM1G2E upload=8PN0BECY3SX7 tag=QZE9LD326ROB type=write size=3327220 2024-09-19T11:43:00.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.790+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~0YE3K956JGAE.0 size=1048576 2024-09-19T11:43:00.796 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.794+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~0YE3K956JGAE.1 size=1048576 2024-09-19T11:43:00.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.794+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~0YE3K956JGAE.2 size=932310 2024-09-19T11:43:00.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.794+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=0YE3K956JGAE tag=MLJLQRIION7V type=write size=4078038 2024-09-19T11:43:00.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.802+0000 7f3d831968c0 1 < suggested update operation key=KAPKNZJ2DE6A tag=Q30PONR0ETPD type=del size=2634701 2024-09-19T11:43:00.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.806+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=BT61U4JDF7N3 type=del size=3666299 2024-09-19T11:43:00.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.810+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=I61A6WNOZOS1 type=del 2024-09-19T11:43:00.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.814+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=MSSA5IC5PVXP type=del size=3981399 2024-09-19T11:43:00.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.818+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=U1SIELINTL23 type=del 2024-09-19T11:43:00.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.822+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~3CY3BUVSVJEI.0 size=1048576 2024-09-19T11:43:00.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.826+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~3CY3BUVSVJEI.1 size=1048576 2024-09-19T11:43:00.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.830+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~3CY3BUVSVJEI.2 size=346855 2024-09-19T11:43:00.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.830+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=3CY3BUVSVJEI tag=LKAVHI75IMZU type=write size=3492583 2024-09-19T11:43:00.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.834+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=75N9ZJYLRLJS type=del 2024-09-19T11:43:00.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.838+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=8MOZNKPE2OTJ type=del size=2451830 2024-09-19T11:43:00.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.842+0000 7f3d831968c0 -1 < failed to complete operation key=KAPKNZJ2DE6A tag=YKTBCFPTGD7A type=del size=2141814: (22) Invalid argument 2024-09-19T11:43:00.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.842+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=XAE18SNYBIFZ type=del size=3416454 2024-09-19T11:43:00.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.846+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=UD8K1Y1RRLLU type=del 2024-09-19T11:43:00.855 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.850+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=KUCSI93R9TBE type=del size=2531514 2024-09-19T11:43:00.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.854+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~9YWFNECYM9J7.0 size=234848 2024-09-19T11:43:00.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.858+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=9YWFNECYM9J7 tag=JNQXQJSOQBCP type=write size=1283424 2024-09-19T11:43:00.867 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.862+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=6L0924YN5G4F type=del size=4132983 2024-09-19T11:43:00.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.866+0000 7f3d831968c0 -1 < failed to complete operation key=UI7EVZ1SGD8R tag=FES02FW2AY15 type=del size=3836522: (22) Invalid argument 2024-09-19T11:43:00.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.874+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~0XB2ZCFJGW9E.0 size=1048576 2024-09-19T11:43:00.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.874+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~0XB2ZCFJGW9E.1 size=1048576 2024-09-19T11:43:00.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.878+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~0XB2ZCFJGW9E.2 size=845049 2024-09-19T11:43:00.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.878+0000 7f3d831968c0 1 > prepared multipart upload key=JTPBGWC4T3Y5 upload=0XB2ZCFJGW9E tag=PQOBNCSU657J type=write size=3990777 2024-09-19T11:43:00.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.882+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~RT85GK56VVYH.0 size=1048576 2024-09-19T11:43:00.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.882+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~RT85GK56VVYH.1 size=408525 2024-09-19T11:43:00.893 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.890+0000 7f3d831968c0 1 < completed multipart upload key=76JFMPOUJZXW upload=RT85GK56VVYH tag=WTYMJRZ1CBXU type=write size=2505677 2024-09-19T11:43:00.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.894+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=1WHUPI35KEJC type=del size=658419 2024-09-19T11:43:00.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.898+0000 7f3d831968c0 1 < suggested update operation key=3GD7UZCI3WX4 tag=PWMFAH4S1WT6 type=del size=622567 2024-09-19T11:43:00.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.902+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=5DXN1AB7DFBG type=del size=965138 2024-09-19T11:43:00.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.906+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=3H1MESEN7BZH type=del 2024-09-19T11:43:00.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.910+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=QYFDKPPEIALX type=del size=1345937 2024-09-19T11:43:00.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.914+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=IG0WAL9SH93U type=del 2024-09-19T11:43:00.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.918+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~I7V2L3W7B3EY.0 size=1048576 2024-09-19T11:43:00.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.922+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~I7V2L3W7B3EY.1 size=766672 2024-09-19T11:43:00.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.922+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=I7V2L3W7B3EY tag=3ATF54WKYH8C type=write size=2863824 2024-09-19T11:43:00.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.930+0000 7f3d831968c0 1 < suggested remove operation key=3QWBQYLI0SJR tag=UU0N1UNCYBLZ type=del 2024-09-19T11:43:00.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.934+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~E2ESFOEBE5IN.0 size=1048576 2024-09-19T11:43:00.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.938+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~E2ESFOEBE5IN.1 size=1048576 2024-09-19T11:43:00.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.942+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~E2ESFOEBE5IN.2 size=738768 2024-09-19T11:43:00.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.942+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=E2ESFOEBE5IN tag=PLOKFOTXF779 type=write size=3884496 2024-09-19T11:43:00.951 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.946+0000 7f3d831968c0 1 < suggested update operation key=PB62JE7I55GG tag=51ZMCJITB17I type=write size=185343 2024-09-19T11:43:00.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.950+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=GXCUIXQ5FX63 type=del size=2365203 2024-09-19T11:43:00.958 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.954+0000 7f3d831968c0 -1 < failed to complete operation key=3QWBQYLI0SJR tag=V1DTPLVCSYIX type=del size=2379599: (22) Invalid argument 2024-09-19T11:43:00.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.958+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=CNRBGZEVA053 type=del size=2163476 2024-09-19T11:43:00.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.962+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~0YE3K956JGAE.0 size=1048576 2024-09-19T11:43:00.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.962+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~0YE3K956JGAE.1 size=1048576 2024-09-19T11:43:00.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.966+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~0YE3K956JGAE.2 size=932310 2024-09-19T11:43:00.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.970+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=0YE3K956JGAE tag=MLJLQRIION7V type=write size=4078038 2024-09-19T11:43:00.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.974+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~EGC9RC4YOQDS.0 size=1048576 2024-09-19T11:43:00.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.978+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~EGC9RC4YOQDS.1 size=1048576 2024-09-19T11:43:00.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.982+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~EGC9RC4YOQDS.2 size=300861 2024-09-19T11:43:00.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.982+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=EGC9RC4YOQDS tag=DJLTWAQNDWLB type=write size=3446589 2024-09-19T11:43:00.988 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.982+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=BT61U4JDF7N3 type=del 2024-09-19T11:43:00.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.986+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=1XRSY862QDR1 type=del size=629273 2024-09-19T11:43:00.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.990+0000 7f3d831968c0 -1 < failed to complete operation key=PB62JE7I55GG tag=MSSA5IC5PVXP type=del size=3981399: (22) Invalid argument 2024-09-19T11:43:00.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.994+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=3K7VQJJYZPAV type=del size=1395482 2024-09-19T11:43:01.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.994+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~3CY3BUVSVJEI.0 size=1048576 2024-09-19T11:43:01.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:00.998+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~3CY3BUVSVJEI.1 size=1048576 2024-09-19T11:43:01.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.002+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~3CY3BUVSVJEI.2 size=346855 2024-09-19T11:43:01.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.006+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=3CY3BUVSVJEI tag=LKAVHI75IMZU type=write size=3492583 2024-09-19T11:43:01.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.010+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=L88DGB5G3H1P type=del size=378000 2024-09-19T11:43:01.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.014+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=8MOZNKPE2OTJ type=del 2024-09-19T11:43:01.023 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.018+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~X61FTTZ78WDU.0 size=1048576 2024-09-19T11:43:01.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.022+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~X61FTTZ78WDU.1 size=244005 2024-09-19T11:43:01.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.022+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=X61FTTZ78WDU tag=SBE4UUGL0V30 type=write size=2341157 2024-09-19T11:43:01.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.026+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=XAE18SNYBIFZ type=del 2024-09-19T11:43:01.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.026+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=3FLSZ1JUN1LQ type=del size=1846711 2024-09-19T11:43:01.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.030+0000 7f3d831968c0 -1 < failed to complete operation key=3GD7UZCI3WX4 tag=KUCSI93R9TBE type=del size=2531514: (22) Invalid argument 2024-09-19T11:43:01.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.038+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~4Q3T0Q1WUNUO.0 size=1048576 2024-09-19T11:43:01.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.042+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~4Q3T0Q1WUNUO.1 size=1048576 2024-09-19T11:43:01.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.042+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~4Q3T0Q1WUNUO.2 size=1012222 2024-09-19T11:43:01.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.042+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=4Q3T0Q1WUNUO tag=4GMSTFE0QVAX type=write size=4157950 2024-09-19T11:43:01.050 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.046+0000 7f3d831968c0 -1 < failed to complete operation key=3GD7UZCI3WX4 tag=6L0924YN5G4F type=del size=4132983: (22) Invalid argument 2024-09-19T11:43:01.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.050+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~EP7R743AM5GA.0 size=1048576 2024-09-19T11:43:01.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.054+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~EP7R743AM5GA.1 size=563385 2024-09-19T11:43:01.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.054+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=EP7R743AM5GA tag=FHMCHQAH356O type=write size=2660537 2024-09-19T11:43:01.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.058+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~0XB2ZCFJGW9E.0 size=1048576 2024-09-19T11:43:01.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.058+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~0XB2ZCFJGW9E.1 size=1048576 2024-09-19T11:43:01.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.062+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~0XB2ZCFJGW9E.2 size=845049 2024-09-19T11:43:01.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.066+0000 7f3d831968c0 1 < completed multipart upload key=JTPBGWC4T3Y5 upload=0XB2ZCFJGW9E tag=PQOBNCSU657J type=write size=3990777 2024-09-19T11:43:01.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.074+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~WQ9B0DLIHYEG.0 size=1048576 2024-09-19T11:43:01.080 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.078+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~WQ9B0DLIHYEG.1 size=1048576 2024-09-19T11:43:01.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.078+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~WQ9B0DLIHYEG.2 size=858869 2024-09-19T11:43:01.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.078+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=WQ9B0DLIHYEG tag=478ULGBYWU6O type=write size=4004597 2024-09-19T11:43:01.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.082+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=1WHUPI35KEJC type=del 2024-09-19T11:43:01.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.086+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=LEG584SJX72D type=del size=1003228 2024-09-19T11:43:01.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.090+0000 7f3d831968c0 1 < suggested update operation key=76JFMPOUJZXW tag=5DXN1AB7DFBG type=del size=965138 2024-09-19T11:43:01.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.098+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~1L9622RYASCM.0 size=752641 2024-09-19T11:43:01.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.098+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=1L9622RYASCM tag=JLW9D6JQAISU type=write size=1801217 2024-09-19T11:43:01.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.102+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=QYFDKPPEIALX type=del 2024-09-19T11:43:01.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.102+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=YMGVJV0MSWHN type=write size=233561 2024-09-19T11:43:01.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.106+0000 7f3d831968c0 1 < canceled part key=_multipart_4I8BY4YYTRT0.2~I7V2L3W7B3EY.0 size=1048576 2024-09-19T11:43:01.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.106+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~I7V2L3W7B3EY.1 size=766672 2024-09-19T11:43:01.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.110+0000 7f3d831968c0 1 < canceled multipart upload key=4I8BY4YYTRT0 upload=I7V2L3W7B3EY tag=3ATF54WKYH8C type=write size=2863824 2024-09-19T11:43:01.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.114+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=DB6MKV01UNJR type=del size=2824732 2024-09-19T11:43:01.121 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.118+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~E2ESFOEBE5IN.0 size=1048576 2024-09-19T11:43:01.121 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.118+0000 7f3d831968c0 1 < canceled part key=_multipart_3K8P37C015G3.2~E2ESFOEBE5IN.1 size=1048576 2024-09-19T11:43:01.123 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.118+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~E2ESFOEBE5IN.2 size=738768 2024-09-19T11:43:01.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.122+0000 7f3d831968c0 1 < canceled multipart upload key=3K8P37C015G3 upload=E2ESFOEBE5IN tag=PLOKFOTXF779 type=write size=3884496 2024-09-19T11:43:01.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.130+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~45B9OQZEQZ5T.0 size=1048576 2024-09-19T11:43:01.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.130+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~45B9OQZEQZ5T.1 size=58155 2024-09-19T11:43:01.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.130+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=45B9OQZEQZ5T tag=5FJ15K42QN9J type=write size=2155307 2024-09-19T11:43:01.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.134+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=GXCUIXQ5FX63 type=del 2024-09-19T11:43:01.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.138+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=2THQDUYFU5FK type=del size=157658 2024-09-19T11:43:01.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.138+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=CNRBGZEVA053 type=del 2024-09-19T11:43:01.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.142+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=512SJQH95HSF type=del size=2209941 2024-09-19T11:43:01.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.146+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~EGC9RC4YOQDS.0 size=1048576 2024-09-19T11:43:01.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.146+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~EGC9RC4YOQDS.1 size=1048576 2024-09-19T11:43:01.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.146+0000 7f3d831968c0 1 < canceled part key=_multipart_8104Z4OQ7UWQ.2~EGC9RC4YOQDS.2 size=300861 2024-09-19T11:43:01.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.154+0000 7f3d831968c0 1 < canceled multipart upload key=8104Z4OQ7UWQ upload=EGC9RC4YOQDS tag=DJLTWAQNDWLB type=write size=3446589 2024-09-19T11:43:01.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.158+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=K40TKA909LQ5 type=del size=1578400 2024-09-19T11:43:01.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.162+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=1XRSY862QDR1 type=del 2024-09-19T11:43:01.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.166+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=44UEHD0XUAMH type=del size=1380487 2024-09-19T11:43:01.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.170+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=3K7VQJJYZPAV type=del 2024-09-19T11:43:01.177 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.174+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=DNDEHTPDA2CG type=del size=3068469 2024-09-19T11:43:01.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.174+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=L88DGB5G3H1P type=del 2024-09-19T11:43:01.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.182+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~BAPH0V92NMS1.0 size=336675 2024-09-19T11:43:01.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.182+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=BAPH0V92NMS1 tag=A0HGOFNAETRC type=write size=1385251 2024-09-19T11:43:01.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.186+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~X61FTTZ78WDU.0 size=1048576 2024-09-19T11:43:01.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.190+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~X61FTTZ78WDU.1 size=244005 2024-09-19T11:43:01.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.194+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=X61FTTZ78WDU tag=SBE4UUGL0V30 type=write size=2341157 2024-09-19T11:43:01.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.198+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=L3UWYXP17JRT type=del size=2129248 2024-09-19T11:43:01.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.202+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=3FLSZ1JUN1LQ type=del 2024-09-19T11:43:01.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.202+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=PCN78GWCA5GQ type=del size=1169054 2024-09-19T11:43:01.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.206+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~4Q3T0Q1WUNUO.0 size=1048576 2024-09-19T11:43:01.217 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.210+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~4Q3T0Q1WUNUO.1 size=1048576 2024-09-19T11:43:01.217 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.210+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~4Q3T0Q1WUNUO.2 size=1012222 2024-09-19T11:43:01.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.218+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=4Q3T0Q1WUNUO tag=4GMSTFE0QVAX type=write size=4157950 2024-09-19T11:43:01.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.222+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~8SW12T0Z53VP.0 size=1048576 2024-09-19T11:43:01.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.226+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~8SW12T0Z53VP.1 size=1048576 2024-09-19T11:43:01.235 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.230+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~8SW12T0Z53VP.2 size=818518 2024-09-19T11:43:01.235 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.230+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=8SW12T0Z53VP tag=EGSFFXS9UDMG type=write size=3964246 2024-09-19T11:43:01.239 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.234+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~EP7R743AM5GA.0 size=1048576 2024-09-19T11:43:01.239 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.234+0000 7f3d831968c0 1 < canceled part key=_multipart_PB62JE7I55GG.2~EP7R743AM5GA.1 size=563385 2024-09-19T11:43:01.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.242+0000 7f3d831968c0 1 < canceled multipart upload key=PB62JE7I55GG upload=EP7R743AM5GA tag=FHMCHQAH356O type=write size=2660537 2024-09-19T11:43:01.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.242+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=KPQ72AOFIWEL type=del size=2893016 2024-09-19T11:43:01.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.246+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~WQ9B0DLIHYEG.0 size=1048576 2024-09-19T11:43:01.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.250+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~WQ9B0DLIHYEG.1 size=1048576 2024-09-19T11:43:01.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.250+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~WQ9B0DLIHYEG.2 size=858869 2024-09-19T11:43:01.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.258+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=WQ9B0DLIHYEG tag=478ULGBYWU6O type=write size=4004597 2024-09-19T11:43:01.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.262+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~489ZR3LAR2SS.0 size=1048576 2024-09-19T11:43:01.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.266+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~489ZR3LAR2SS.1 size=1048576 2024-09-19T11:43:01.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.266+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~489ZR3LAR2SS.2 size=123826 2024-09-19T11:43:01.272 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.266+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=489ZR3LAR2SS tag=U47TLZ4E07SE type=write size=3269554 2024-09-19T11:43:01.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.270+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=LEG584SJX72D type=del 2024-09-19T11:43:01.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.274+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=MS9TH77JX080 type=write size=9931 2024-09-19T11:43:01.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.278+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~1L9622RYASCM.0 size=752641 2024-09-19T11:43:01.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.282+0000 7f3d831968c0 1 < completed multipart upload key=5RTONAWGYJNE upload=1L9622RYASCM tag=JLW9D6JQAISU type=write size=1801217 2024-09-19T11:43:01.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.286+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=X12D4BZ7L290 type=del size=2548059 2024-09-19T11:43:01.292 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.286+0000 7f3d831968c0 1 < completed write operation key=QPG75T46BH38 tag=YMGVJV0MSWHN type=write size=233561 2024-09-19T11:43:01.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.290+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=6T928C43E2EM type=del size=3084163 2024-09-19T11:43:01.298 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.294+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=DB6MKV01UNJR type=del 2024-09-19T11:43:01.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.298+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=22KB6TLH892G type=write size=678394 2024-09-19T11:43:01.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.298+0000 7f3d831968c0 1 < canceled part key=_multipart_PB62JE7I55GG.2~45B9OQZEQZ5T.0 size=1048576 2024-09-19T11:43:01.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.298+0000 7f3d831968c0 1 < canceled part key=_multipart_PB62JE7I55GG.2~45B9OQZEQZ5T.1 size=58155 2024-09-19T11:43:01.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.302+0000 7f3d831968c0 1 < canceled multipart upload key=PB62JE7I55GG upload=45B9OQZEQZ5T tag=5FJ15K42QN9J type=write size=2155307 2024-09-19T11:43:01.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.310+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~XU6F19ME8BZT.0 size=1048576 2024-09-19T11:43:01.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.310+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~XU6F19ME8BZT.1 size=1048576 2024-09-19T11:43:01.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.314+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~XU6F19ME8BZT.2 size=946451 2024-09-19T11:43:01.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.314+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=XU6F19ME8BZT tag=IKYDSV741UMR type=write size=4092179 2024-09-19T11:43:01.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.318+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=2THQDUYFU5FK type=del 2024-09-19T11:43:01.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.322+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=ZVFA9GDE4YRE type=write size=556900 2024-09-19T11:43:01.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.326+0000 7f3d831968c0 1 < suggested update operation key=LINLTWYV88VU tag=512SJQH95HSF type=del size=2209941 2024-09-19T11:43:01.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.334+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~OD1LRTB9XUD6.0 size=1048576 2024-09-19T11:43:01.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.338+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~OD1LRTB9XUD6.1 size=1048576 2024-09-19T11:43:01.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.338+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~OD1LRTB9XUD6.2 size=586482 2024-09-19T11:43:01.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.338+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=OD1LRTB9XUD6 tag=DSRP7WM07F7W type=write size=3732210 2024-09-19T11:43:01.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.346+0000 7f3d831968c0 1 < suggested update operation key=LINLTWYV88VU tag=K40TKA909LQ5 type=del size=1578400 2024-09-19T11:43:01.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.350+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=L7HBMXIU66SA type=write size=169074 2024-09-19T11:43:01.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.358+0000 7f3d831968c0 1 < suggested update operation key=66N4QS1R70Z7 tag=44UEHD0XUAMH type=del size=1380487 2024-09-19T11:43:01.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.362+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=NHM2177VFPXQ type=del size=297979 2024-09-19T11:43:01.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.366+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=DNDEHTPDA2CG type=del 2024-09-19T11:43:01.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.374+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~3TTPOV3W5CTQ.0 size=332636 2024-09-19T11:43:01.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.374+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=3TTPOV3W5CTQ tag=O0UKIPMIUFI3 type=write size=1381212 2024-09-19T11:43:01.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.378+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~BAPH0V92NMS1.0 size=336675 2024-09-19T11:43:01.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.386+0000 7f3d831968c0 1 < completed multipart upload key=3GD7UZCI3WX4 upload=BAPH0V92NMS1 tag=A0HGOFNAETRC type=write size=1385251 2024-09-19T11:43:01.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.390+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=1H2SS6KYI5IM type=del size=2414558 2024-09-19T11:43:01.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.394+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=L3UWYXP17JRT type=del 2024-09-19T11:43:01.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.398+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=8JRVMSEKBQAQ type=del size=480037 2024-09-19T11:43:01.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.402+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=PCN78GWCA5GQ type=del 2024-09-19T11:43:01.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.406+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=8NGNSBYZ38X2 type=del size=3422229 2024-09-19T11:43:01.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.410+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~8SW12T0Z53VP.0 size=1048576 2024-09-19T11:43:01.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.410+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~8SW12T0Z53VP.1 size=1048576 2024-09-19T11:43:01.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.414+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~8SW12T0Z53VP.2 size=818518 2024-09-19T11:43:01.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.418+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=8SW12T0Z53VP tag=EGSFFXS9UDMG type=write size=3964246 2024-09-19T11:43:01.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.426+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~U5SCOEXC5VDI.0 size=1048576 2024-09-19T11:43:01.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.426+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~U5SCOEXC5VDI.1 size=1048576 2024-09-19T11:43:01.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.430+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~U5SCOEXC5VDI.2 size=440155 2024-09-19T11:43:01.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.430+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=U5SCOEXC5VDI tag=W1HWMCF0VX2F type=write size=3585883 2024-09-19T11:43:01.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.434+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=KPQ72AOFIWEL type=del 2024-09-19T11:43:01.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.438+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=HC8OGPN530I6 type=del size=705857 2024-09-19T11:43:01.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.438+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~489ZR3LAR2SS.0 size=1048576 2024-09-19T11:43:01.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.438+0000 7f3d831968c0 1 < canceled part key=_multipart_LINLTWYV88VU.2~489ZR3LAR2SS.1 size=1048576 2024-09-19T11:43:01.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.442+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~489ZR3LAR2SS.2 size=123826 2024-09-19T11:43:01.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.450+0000 7f3d831968c0 1 < canceled multipart upload key=LINLTWYV88VU upload=489ZR3LAR2SS tag=U47TLZ4E07SE type=write size=3269554 2024-09-19T11:43:01.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.450+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=ZSVKBVQ0NQ06 type=del size=588150 2024-09-19T11:43:01.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.458+0000 7f3d831968c0 1 < suggested update operation key=FKLL38ZNCJ21 tag=MS9TH77JX080 type=write size=9931 2024-09-19T11:43:01.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.462+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~T0Y7FL7CU1FB.0 size=1048576 2024-09-19T11:43:01.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.466+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~T0Y7FL7CU1FB.1 size=1048576 2024-09-19T11:43:01.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.470+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~T0Y7FL7CU1FB.2 size=462463 2024-09-19T11:43:01.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.470+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=T0Y7FL7CU1FB tag=DTBGYRV1HHV9 type=write size=3608191 2024-09-19T11:43:01.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.478+0000 7f3d831968c0 1 < suggested update operation key=3GD7UZCI3WX4 tag=X12D4BZ7L290 type=del size=2548059 2024-09-19T11:43:01.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.486+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~2UK17N9O7DZ5.0 size=726507 2024-09-19T11:43:01.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.486+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=2UK17N9O7DZ5 tag=VCAQII4DAKF6 type=write size=1775083 2024-09-19T11:43:01.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.486+0000 7f3d831968c0 1 < canceled operation key=UI7EVZ1SGD8R tag=6T928C43E2EM type=del size=3084163 2024-09-19T11:43:01.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.490+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=H34DUK1S0Q32 type=del size=3367521 2024-09-19T11:43:01.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.494+0000 7f3d831968c0 -1 < failed to complete operation key=66N4QS1R70Z7 tag=22KB6TLH892G type=write size=678394: (22) Invalid argument 2024-09-19T11:43:01.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.502+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~NX9FRMCBN12P.0 size=1048576 2024-09-19T11:43:01.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.506+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~NX9FRMCBN12P.1 size=1048576 2024-09-19T11:43:01.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.506+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~NX9FRMCBN12P.2 size=179572 2024-09-19T11:43:01.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.506+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=NX9FRMCBN12P tag=XW9MM1CLUWID type=write size=3325300 2024-09-19T11:43:01.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.510+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~XU6F19ME8BZT.0 size=1048576 2024-09-19T11:43:01.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.514+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~XU6F19ME8BZT.1 size=1048576 2024-09-19T11:43:01.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.514+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~XU6F19ME8BZT.2 size=946451 2024-09-19T11:43:01.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.522+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=XU6F19ME8BZT tag=IKYDSV741UMR type=write size=4092179 2024-09-19T11:43:01.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.526+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~VF19JQ59FPPI.0 size=1048576 2024-09-19T11:43:01.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.530+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~VF19JQ59FPPI.1 size=927842 2024-09-19T11:43:01.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.530+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=VF19JQ59FPPI tag=U8244Y6REVRY type=write size=3024994 2024-09-19T11:43:01.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.534+0000 7f3d831968c0 1 < completed write operation key=6NLQ0BK8AJUO tag=ZVFA9GDE4YRE type=write size=556900 2024-09-19T11:43:01.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.538+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=VR0UQ833FDQB type=del size=3448351 2024-09-19T11:43:01.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.538+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~OD1LRTB9XUD6.0 size=1048576 2024-09-19T11:43:01.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.546+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~OD1LRTB9XUD6.1 size=1048576 2024-09-19T11:43:01.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.546+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~OD1LRTB9XUD6.2 size=586482 2024-09-19T11:43:01.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.554+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=OD1LRTB9XUD6 tag=DSRP7WM07F7W type=write size=3732210 2024-09-19T11:43:01.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.558+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~7475QTGDX06A.0 size=1048576 2024-09-19T11:43:01.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.562+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~7475QTGDX06A.1 size=53727 2024-09-19T11:43:01.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.562+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=7475QTGDX06A tag=4T7WMMWMQB60 type=write size=2150879 2024-09-19T11:43:01.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.566+0000 7f3d831968c0 1 < completed write operation key=UI7EVZ1SGD8R tag=L7HBMXIU66SA type=write size=169074 2024-09-19T11:43:01.576 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.574+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~OTY64A1EZGV3.0 size=1048576 2024-09-19T11:43:01.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.574+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~OTY64A1EZGV3.1 size=1048576 2024-09-19T11:43:01.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.578+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~OTY64A1EZGV3.2 size=335595 2024-09-19T11:43:01.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.578+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=OTY64A1EZGV3 tag=8M03853S0TMI type=write size=3481323 2024-09-19T11:43:01.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.582+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=NHM2177VFPXQ type=del 2024-09-19T11:43:01.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.582+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=PRUVYSMJ8K0Y type=write size=9989 2024-09-19T11:43:01.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.586+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~3TTPOV3W5CTQ.0 size=332636 2024-09-19T11:43:01.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.590+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=3TTPOV3W5CTQ tag=O0UKIPMIUFI3 type=write size=1381212 2024-09-19T11:43:01.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.594+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=5EIRDMHRD119 type=del size=171933 2024-09-19T11:43:01.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.598+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=1H2SS6KYI5IM type=del 2024-09-19T11:43:01.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.598+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=5CGP7K1F0STY type=del size=1944074 2024-09-19T11:43:01.606 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.602+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=8JRVMSEKBQAQ type=del 2024-09-19T11:43:01.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.606+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~H4OV7X7WHP6E.0 size=186528 2024-09-19T11:43:01.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.606+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=H4OV7X7WHP6E tag=WKMNQBGDAT6Y type=write size=1235104 2024-09-19T11:43:01.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.610+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=8NGNSBYZ38X2 type=del 2024-09-19T11:43:01.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.614+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~Q29PFF16WX3V.0 size=1048576 2024-09-19T11:43:01.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.618+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~Q29PFF16WX3V.1 size=1048576 2024-09-19T11:43:01.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.622+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~Q29PFF16WX3V.2 size=387403 2024-09-19T11:43:01.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.622+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=Q29PFF16WX3V tag=RKE1VNI1SNOB type=write size=3533131 2024-09-19T11:43:01.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.622+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~U5SCOEXC5VDI.0 size=1048576 2024-09-19T11:43:01.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.626+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~U5SCOEXC5VDI.1 size=1048576 2024-09-19T11:43:01.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.630+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~U5SCOEXC5VDI.2 size=440155 2024-09-19T11:43:01.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.634+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=U5SCOEXC5VDI tag=W1HWMCF0VX2F type=write size=3585883 2024-09-19T11:43:01.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.638+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~Y4Y4EBCRTA87.0 size=423922 2024-09-19T11:43:01.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.638+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=Y4Y4EBCRTA87 tag=YS0825UZMPQE type=write size=1472498 2024-09-19T11:43:01.646 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.642+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=HC8OGPN530I6 type=del 2024-09-19T11:43:01.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.646+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=U54RQUKZ4G9Y type=write size=69263 2024-09-19T11:43:01.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.646+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=ZSVKBVQ0NQ06 type=del 2024-09-19T11:43:01.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.650+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=IMMJE2UFWYWI type=del size=3852386 2024-09-19T11:43:01.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.654+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~T0Y7FL7CU1FB.0 size=1048576 2024-09-19T11:43:01.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.654+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~T0Y7FL7CU1FB.1 size=1048576 2024-09-19T11:43:01.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.658+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~T0Y7FL7CU1FB.2 size=462463 2024-09-19T11:43:01.665 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.662+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=T0Y7FL7CU1FB tag=DTBGYRV1HHV9 type=write size=3608191 2024-09-19T11:43:01.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.662+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=S6YU1EXEXSV2 type=del size=3656052 2024-09-19T11:43:01.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.666+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~2UK17N9O7DZ5.0 size=726507 2024-09-19T11:43:01.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.670+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=2UK17N9O7DZ5 tag=VCAQII4DAKF6 type=write size=1775083 2024-09-19T11:43:01.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.674+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~EQYA0M96KA4K.0 size=1048576 2024-09-19T11:43:01.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.678+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~EQYA0M96KA4K.1 size=1048576 2024-09-19T11:43:01.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.678+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~EQYA0M96KA4K.2 size=610121 2024-09-19T11:43:01.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.678+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=EQYA0M96KA4K tag=IMT5EW8L7L0I type=write size=3755849 2024-09-19T11:43:01.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.682+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=H34DUK1S0Q32 type=del 2024-09-19T11:43:01.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.686+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=R7FVGMAIIXLM type=del size=249206 2024-09-19T11:43:01.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.686+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~NX9FRMCBN12P.0 size=1048576 2024-09-19T11:43:01.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.690+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~NX9FRMCBN12P.1 size=1048576 2024-09-19T11:43:01.696 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.694+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~NX9FRMCBN12P.2 size=179572 2024-09-19T11:43:01.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.698+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=NX9FRMCBN12P tag=XW9MM1CLUWID type=write size=3325300 2024-09-19T11:43:01.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.698+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=1IDUZM264KOM type=del size=1779243 2024-09-19T11:43:01.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.702+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~VF19JQ59FPPI.0 size=1048576 2024-09-19T11:43:01.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.706+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~VF19JQ59FPPI.1 size=927842 2024-09-19T11:43:01.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.710+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=VF19JQ59FPPI tag=U8244Y6REVRY type=write size=3024994 2024-09-19T11:43:01.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.710+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=2119084T012K type=del size=2676708 2024-09-19T11:43:01.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.714+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=VR0UQ833FDQB type=del 2024-09-19T11:43:01.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.718+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=42G9HHIG0U8Q type=del size=725795 2024-09-19T11:43:01.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.718+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~7475QTGDX06A.0 size=1048576 2024-09-19T11:43:01.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.722+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~7475QTGDX06A.1 size=53727 2024-09-19T11:43:01.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.726+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=7475QTGDX06A tag=4T7WMMWMQB60 type=write size=2150879 2024-09-19T11:43:01.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.726+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=ADDLQ0UP38BH type=del size=3323564 2024-09-19T11:43:01.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.730+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~OTY64A1EZGV3.0 size=1048576 2024-09-19T11:43:01.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.730+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~OTY64A1EZGV3.1 size=1048576 2024-09-19T11:43:01.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.734+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~OTY64A1EZGV3.2 size=335595 2024-09-19T11:43:01.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.738+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=OTY64A1EZGV3 tag=8M03853S0TMI type=write size=3481323 2024-09-19T11:43:01.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.738+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=BKRZNP55KWYG type=del size=298216 2024-09-19T11:43:01.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.742+0000 7f3d831968c0 1 < completed write operation key=LINLTWYV88VU tag=PRUVYSMJ8K0Y type=write size=9989 2024-09-19T11:43:01.748 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.742+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=DQJPSC0Q98Q0 type=write size=452773 2024-09-19T11:43:01.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.746+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=5EIRDMHRD119 type=del 2024-09-19T11:43:01.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.750+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=DMYZR58R0WEE type=del size=78064 2024-09-19T11:43:01.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.754+0000 7f3d831968c0 1 < suggested update operation key=PB62JE7I55GG tag=5CGP7K1F0STY type=del size=1944074 2024-09-19T11:43:01.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.758+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~GI1GGRXP5RFF.0 size=297847 2024-09-19T11:43:01.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.758+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=GI1GGRXP5RFF tag=YQEOW6LTOIHF type=write size=1346423 2024-09-19T11:43:01.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.762+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~H4OV7X7WHP6E.0 size=186528 2024-09-19T11:43:01.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.766+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=H4OV7X7WHP6E tag=WKMNQBGDAT6Y type=write size=1235104 2024-09-19T11:43:01.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.766+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=04QMK1C31K7A type=del size=1384900 2024-09-19T11:43:01.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.770+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~Q29PFF16WX3V.0 size=1048576 2024-09-19T11:43:01.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.770+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~Q29PFF16WX3V.1 size=1048576 2024-09-19T11:43:01.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.774+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~Q29PFF16WX3V.2 size=387403 2024-09-19T11:43:01.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.778+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=Q29PFF16WX3V tag=RKE1VNI1SNOB type=write size=3533131 2024-09-19T11:43:01.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.782+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~JAX5G1DJMTN9.0 size=1048576 2024-09-19T11:43:01.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.786+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~JAX5G1DJMTN9.1 size=1048576 2024-09-19T11:43:01.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.786+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~JAX5G1DJMTN9.2 size=670581 2024-09-19T11:43:01.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.786+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=JAX5G1DJMTN9 tag=3JK6PAR8KHI9 type=write size=3816309 2024-09-19T11:43:01.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.790+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~Y4Y4EBCRTA87.0 size=423922 2024-09-19T11:43:01.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.798+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=Y4Y4EBCRTA87 tag=YS0825UZMPQE type=write size=1472498 2024-09-19T11:43:01.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.798+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=V3A80Q6SMYER type=write size=341890 2024-09-19T11:43:01.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.802+0000 7f3d831968c0 1 < completed write operation key=76JFMPOUJZXW tag=U54RQUKZ4G9Y type=write size=69263 2024-09-19T11:43:01.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.806+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=6RZ74D9I0BFS type=del size=3348099 2024-09-19T11:43:01.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.806+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=IMMJE2UFWYWI type=del 2024-09-19T11:43:01.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.810+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=N695KA4KNV8F type=del size=3984600 2024-09-19T11:43:01.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.814+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=S6YU1EXEXSV2 type=del 2024-09-19T11:43:01.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.814+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=CS6NQEF3HMCQ type=del size=2283647 2024-09-19T11:43:01.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.818+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~EQYA0M96KA4K.0 size=1048576 2024-09-19T11:43:01.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.822+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~EQYA0M96KA4K.1 size=1048576 2024-09-19T11:43:01.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.822+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~EQYA0M96KA4K.2 size=610121 2024-09-19T11:43:01.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.826+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=EQYA0M96KA4K tag=IMT5EW8L7L0I type=write size=3755849 2024-09-19T11:43:01.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.830+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=RS1BMZ33K7S3 type=del size=2827421 2024-09-19T11:43:01.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.830+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=R7FVGMAIIXLM type=del 2024-09-19T11:43:01.840 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.834+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~6ASB5XHB84X6.0 size=1048576 2024-09-19T11:43:01.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.838+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~6ASB5XHB84X6.1 size=72573 2024-09-19T11:43:01.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.838+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=6ASB5XHB84X6 tag=2FFRIU8T2AAH type=write size=2169725 2024-09-19T11:43:01.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.838+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=1IDUZM264KOM type=del 2024-09-19T11:43:01.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.842+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=N0FNVCQCGXJT type=del size=1068325 2024-09-19T11:43:01.849 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.846+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=2119084T012K type=del 2024-09-19T11:43:01.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.846+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=2OS8DO65GTCU type=del size=3943016 2024-09-19T11:43:01.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.850+0000 7f3d831968c0 1 < suggested remove operation key=LINLTWYV88VU tag=42G9HHIG0U8Q type=del 2024-09-19T11:43:01.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.854+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=SRFLPUV71V98 type=del size=732935 2024-09-19T11:43:01.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.858+0000 7f3d831968c0 1 < suggested remove operation key=JTPBGWC4T3Y5 tag=ADDLQ0UP38BH type=del 2024-09-19T11:43:01.868 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.862+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~E2UG1P1OMMAR.0 size=997144 2024-09-19T11:43:01.868 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.862+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=E2UG1P1OMMAR tag=B0X1TL3IEL7B type=write size=2045720 2024-09-19T11:43:01.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.866+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=BKRZNP55KWYG type=del 2024-09-19T11:43:01.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.870+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=RMS06P4NFRWB type=del size=157861 2024-09-19T11:43:01.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.874+0000 7f3d831968c0 1 < completed write operation key=I5XUMA2HKIR5 tag=DQJPSC0Q98Q0 type=write size=452773 2024-09-19T11:43:01.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.874+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=BK13SESR4ZXJ type=del size=1309711 2024-09-19T11:43:01.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.878+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=DMYZR58R0WEE type=del 2024-09-19T11:43:01.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.882+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~MO5COI76O8F5.0 size=1048576 2024-09-19T11:43:01.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.886+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~MO5COI76O8F5.1 size=607747 2024-09-19T11:43:01.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.886+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=MO5COI76O8F5 tag=EJ6SOL4PLE9D type=write size=2704899 2024-09-19T11:43:01.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.890+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~GI1GGRXP5RFF.0 size=297847 2024-09-19T11:43:01.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.894+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=GI1GGRXP5RFF tag=YQEOW6LTOIHF type=write size=1346423 2024-09-19T11:43:01.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.898+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~38LGC42GLIPA.0 size=1048576 2024-09-19T11:43:01.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.902+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~38LGC42GLIPA.1 size=474713 2024-09-19T11:43:01.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.902+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=38LGC42GLIPA tag=885PTSVC8ZPW type=write size=2571865 2024-09-19T11:43:01.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.902+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=04QMK1C31K7A type=del 2024-09-19T11:43:01.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.906+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=GCXK1S1PW682 type=del size=420836 2024-09-19T11:43:01.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.906+0000 7f3d831968c0 1 < canceled part key=_multipart_3GD7UZCI3WX4.2~JAX5G1DJMTN9.0 size=1048576 2024-09-19T11:43:01.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.910+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~JAX5G1DJMTN9.1 size=1048576 2024-09-19T11:43:01.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.910+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~JAX5G1DJMTN9.2 size=670581 2024-09-19T11:43:01.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.918+0000 7f3d831968c0 1 < canceled multipart upload key=3GD7UZCI3WX4 upload=JAX5G1DJMTN9 tag=3JK6PAR8KHI9 type=write size=3816309 2024-09-19T11:43:01.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.922+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~7C3T4MCF6NKE.0 size=1048576 2024-09-19T11:43:01.927 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.922+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~7C3T4MCF6NKE.1 size=1036337 2024-09-19T11:43:01.927 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.922+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=7C3T4MCF6NKE tag=OF3SRMNYH97J type=write size=3133489 2024-09-19T11:43:01.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.926+0000 7f3d831968c0 1 < completed write operation key=5RTONAWGYJNE tag=V3A80Q6SMYER type=write size=341890 2024-09-19T11:43:01.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.930+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~56W63A40ELK9.0 size=1048576 2024-09-19T11:43:01.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.934+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~56W63A40ELK9.1 size=912202 2024-09-19T11:43:01.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.934+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=56W63A40ELK9 tag=DNYST8V99FWU type=write size=3009354 2024-09-19T11:43:01.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.938+0000 7f3d831968c0 1 < suggested remove operation key=Y3LO4H9RI4X0 tag=6RZ74D9I0BFS type=del 2024-09-19T11:43:01.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.938+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=OVSMSTFPI393 type=del size=3806867 2024-09-19T11:43:01.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.942+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=N695KA4KNV8F type=del 2024-09-19T11:43:01.949 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.946+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=8KXZ3XYILZI1 type=del size=3792799 2024-09-19T11:43:01.951 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.946+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=CS6NQEF3HMCQ type=del 2024-09-19T11:43:01.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.950+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=ZMMLVXMVY570 type=del size=3032077 2024-09-19T11:43:01.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.954+0000 7f3d831968c0 1 < suggested update operation key=4V17CRW6EB65 tag=RS1BMZ33K7S3 type=del size=2827421 2024-09-19T11:43:01.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.958+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~6E6R6UD2M3GT.0 size=1048576 2024-09-19T11:43:01.966 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.962+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~6E6R6UD2M3GT.1 size=90644 2024-09-19T11:43:01.966 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.962+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=6E6R6UD2M3GT tag=DN053B9S1PV5 type=write size=2187796 2024-09-19T11:43:01.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.966+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~6ASB5XHB84X6.0 size=1048576 2024-09-19T11:43:01.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.966+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~6ASB5XHB84X6.1 size=72573 2024-09-19T11:43:01.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.970+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=6ASB5XHB84X6 tag=2FFRIU8T2AAH type=write size=2169725 2024-09-19T11:43:01.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.974+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~VV693QWQKAQ0.0 size=309422 2024-09-19T11:43:01.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.974+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=VV693QWQKAQ0 tag=2ESLZRLZH07Y type=write size=1357998 2024-09-19T11:43:01.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.978+0000 7f3d831968c0 1 < canceled operation key=224HPC2Y95N6 tag=N0FNVCQCGXJT type=del size=1068325 2024-09-19T11:43:01.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.982+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~P34Y6L2TR99H.0 size=1048576 2024-09-19T11:43:01.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.986+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~P34Y6L2TR99H.1 size=1048576 2024-09-19T11:43:01.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.986+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~P34Y6L2TR99H.2 size=240282 2024-09-19T11:43:01.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.986+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=P34Y6L2TR99H tag=ZVMBRLC6WMOQ type=write size=3386010 2024-09-19T11:43:01.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.990+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=2OS8DO65GTCU type=del 2024-09-19T11:43:01.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.994+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~1IXOPJ1GZIRT.0 size=1048576 2024-09-19T11:43:02.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.998+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~1IXOPJ1GZIRT.1 size=1048576 2024-09-19T11:43:02.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.998+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~1IXOPJ1GZIRT.2 size=697393 2024-09-19T11:43:02.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:01.998+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=1IXOPJ1GZIRT tag=CDCB8UDF417Y type=write size=3843121 2024-09-19T11:43:02.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.002+0000 7f3d831968c0 -1 < failed to complete operation key=4V17CRW6EB65 tag=SRFLPUV71V98 type=del size=732935: (22) Invalid argument 2024-09-19T11:43:02.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.006+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=R5GWM5WD3CZE type=del size=1565446 2024-09-19T11:43:02.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.006+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~E2UG1P1OMMAR.0 size=997144 2024-09-19T11:43:02.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.014+0000 7f3d831968c0 1 < completed multipart upload key=EVFF0F0760OS upload=E2UG1P1OMMAR tag=B0X1TL3IEL7B type=write size=2045720 2024-09-19T11:43:02.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.014+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=90YHZ1YC1XBO type=del size=1764832 2024-09-19T11:43:02.022 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.018+0000 7f3d831968c0 1 < canceled operation key=PB62JE7I55GG tag=RMS06P4NFRWB type=del size=157861 2024-09-19T11:43:02.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.022+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~97YPRT5X20L4.0 size=1048576 2024-09-19T11:43:02.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.026+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~97YPRT5X20L4.1 size=318287 2024-09-19T11:43:02.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.026+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=97YPRT5X20L4 tag=YAFX4976614D type=write size=2415439 2024-09-19T11:43:02.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.030+0000 7f3d831968c0 1 < canceled operation key=2VJRZVU7S8LB tag=BK13SESR4ZXJ type=del size=1309711 2024-09-19T11:43:02.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.030+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=BQ9YXVHHXWNF type=del size=465785 2024-09-19T11:43:02.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.034+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~MO5COI76O8F5.0 size=1048576 2024-09-19T11:43:02.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.038+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~MO5COI76O8F5.1 size=607747 2024-09-19T11:43:02.050 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.046+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=MO5COI76O8F5 tag=EJ6SOL4PLE9D type=write size=2704899 2024-09-19T11:43:02.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.050+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=I39YVMZA9U30 type=del size=2619643 2024-09-19T11:43:02.057 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.054+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~38LGC42GLIPA.0 size=1048576 2024-09-19T11:43:02.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.054+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~38LGC42GLIPA.1 size=474713 2024-09-19T11:43:02.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.062+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=38LGC42GLIPA tag=885PTSVC8ZPW type=write size=2571865 2024-09-19T11:43:02.071 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.066+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~WW31UOZW056R.0 size=1048576 2024-09-19T11:43:02.074 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.070+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~WW31UOZW056R.1 size=603638 2024-09-19T11:43:02.075 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.070+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=WW31UOZW056R tag=Z2VYFS6PKL08 type=write size=2700790 2024-09-19T11:43:02.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.078+0000 7f3d831968c0 1 < suggested update operation key=3K8P37C015G3 tag=GCXK1S1PW682 type=del size=420836 2024-09-19T11:43:02.084 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.078+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=8C4D6CH98NMN type=del size=3684598 2024-09-19T11:43:02.087 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.082+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~7C3T4MCF6NKE.0 size=1048576 2024-09-19T11:43:02.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.086+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~7C3T4MCF6NKE.1 size=1036337 2024-09-19T11:43:02.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.090+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=7C3T4MCF6NKE tag=OF3SRMNYH97J type=write size=3133489 2024-09-19T11:43:02.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.094+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=F9F70QVF1ZMY type=del size=1051128 2024-09-19T11:43:02.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.098+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~56W63A40ELK9.0 size=1048576 2024-09-19T11:43:02.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.102+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~56W63A40ELK9.1 size=912202 2024-09-19T11:43:02.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.106+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=56W63A40ELK9 tag=DNYST8V99FWU type=write size=3009354 2024-09-19T11:43:02.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.110+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=Z4GL980RUFVH type=del size=3685745 2024-09-19T11:43:02.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.114+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=OVSMSTFPI393 type=del 2024-09-19T11:43:02.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.118+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~9WBL2KNSLZSV.0 size=1048576 2024-09-19T11:43:02.125 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.122+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~9WBL2KNSLZSV.1 size=177255 2024-09-19T11:43:02.125 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.122+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=9WBL2KNSLZSV tag=DRIVPPUWNEDS type=write size=2274407 2024-09-19T11:43:02.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.122+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=8KXZ3XYILZI1 type=del 2024-09-19T11:43:02.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.130+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~Y6GWIB640XOH.0 size=1048576 2024-09-19T11:43:02.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.134+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~Y6GWIB640XOH.1 size=1048576 2024-09-19T11:43:02.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.134+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~Y6GWIB640XOH.2 size=484806 2024-09-19T11:43:02.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.134+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=Y6GWIB640XOH tag=D01E2EXIOAW3 type=write size=3630534 2024-09-19T11:43:02.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.138+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=ZMMLVXMVY570 type=del 2024-09-19T11:43:02.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.142+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=8N6XUUU403T8 type=write size=101597 2024-09-19T11:43:02.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.146+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~6E6R6UD2M3GT.0 size=1048576 2024-09-19T11:43:02.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.146+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~6E6R6UD2M3GT.1 size=90644 2024-09-19T11:43:02.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.154+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=6E6R6UD2M3GT tag=DN053B9S1PV5 type=write size=2187796 2024-09-19T11:43:02.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.158+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~4MZPGKWR9GH7.0 size=1048576 2024-09-19T11:43:02.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.162+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~4MZPGKWR9GH7.1 size=103550 2024-09-19T11:43:02.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.162+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=4MZPGKWR9GH7 tag=97DC799XELCM type=write size=2200702 2024-09-19T11:43:02.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.166+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~VV693QWQKAQ0.0 size=309422 2024-09-19T11:43:02.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.170+0000 7f3d831968c0 1 < completed multipart upload key=EVFF0F0760OS upload=VV693QWQKAQ0 tag=2ESLZRLZH07Y type=write size=1357998 2024-09-19T11:43:02.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.174+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~USN6D020T5O1.0 size=1048576 2024-09-19T11:43:02.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.178+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~USN6D020T5O1.1 size=1048576 2024-09-19T11:43:02.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.182+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~USN6D020T5O1.2 size=219657 2024-09-19T11:43:02.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.182+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=USN6D020T5O1 tag=MUVBA37T6CAD type=write size=3365385 2024-09-19T11:43:02.186 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.182+0000 7f3d831968c0 1 < canceled part key=_multipart_6NLQ0BK8AJUO.2~P34Y6L2TR99H.0 size=1048576 2024-09-19T11:43:02.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.186+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~P34Y6L2TR99H.1 size=1048576 2024-09-19T11:43:02.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.186+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~P34Y6L2TR99H.2 size=240282 2024-09-19T11:43:02.196 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.194+0000 7f3d831968c0 1 < canceled multipart upload key=6NLQ0BK8AJUO upload=P34Y6L2TR99H tag=ZVMBRLC6WMOQ type=write size=3386010 2024-09-19T11:43:02.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.198+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~M8EF2STKU2W3.0 size=957130 2024-09-19T11:43:02.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.198+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=M8EF2STKU2W3 tag=2812TDPG6UI5 type=write size=2005706 2024-09-19T11:43:02.206 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.202+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~1IXOPJ1GZIRT.0 size=1048576 2024-09-19T11:43:02.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.206+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~1IXOPJ1GZIRT.1 size=1048576 2024-09-19T11:43:02.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.206+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~1IXOPJ1GZIRT.2 size=697393 2024-09-19T11:43:02.217 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.214+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=1IXOPJ1GZIRT tag=CDCB8UDF417Y type=write size=3843121 2024-09-19T11:43:02.220 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.214+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=88KTO791RBCB type=del size=1606418 2024-09-19T11:43:02.223 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.218+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=R5GWM5WD3CZE type=del 2024-09-19T11:43:02.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.226+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~2ZHLEJ9WDTJC.0 size=1048576 2024-09-19T11:43:02.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.226+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~2ZHLEJ9WDTJC.1 size=72492 2024-09-19T11:43:02.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.226+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=2ZHLEJ9WDTJC tag=D5S71RB2AZ34 type=write size=2169644 2024-09-19T11:43:02.235 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.230+0000 7f3d831968c0 1 < canceled operation key=00DYD22W0ZNB tag=90YHZ1YC1XBO type=del size=1764832 2024-09-19T11:43:02.238 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.234+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=PELNVM2VVMTN type=del size=1623771 2024-09-19T11:43:02.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.238+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~97YPRT5X20L4.0 size=1048576 2024-09-19T11:43:02.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.242+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~97YPRT5X20L4.1 size=318287 2024-09-19T11:43:02.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.246+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=97YPRT5X20L4 tag=YAFX4976614D type=write size=2415439 2024-09-19T11:43:02.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.250+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=F13NS9PRE7Z2 type=del size=3822044 2024-09-19T11:43:02.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.254+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=BQ9YXVHHXWNF type=del 2024-09-19T11:43:02.262 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.258+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~Y25RN1DQ7GZ8.0 size=1048576 2024-09-19T11:43:02.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.262+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~Y25RN1DQ7GZ8.1 size=1001505 2024-09-19T11:43:02.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.262+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=Y25RN1DQ7GZ8 tag=MKDU0GM0E74G type=write size=3098657 2024-09-19T11:43:02.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.266+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=I39YVMZA9U30 type=del 2024-09-19T11:43:02.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.270+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~M2MCIQ3K1GBF.0 size=1048576 2024-09-19T11:43:02.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.274+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~M2MCIQ3K1GBF.1 size=91708 2024-09-19T11:43:02.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.274+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=M2MCIQ3K1GBF tag=5Q8HHPL32M50 type=write size=2188860 2024-09-19T11:43:02.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.278+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~WW31UOZW056R.0 size=1048576 2024-09-19T11:43:02.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.278+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~WW31UOZW056R.1 size=603638 2024-09-19T11:43:02.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.286+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=WW31UOZW056R tag=Z2VYFS6PKL08 type=write size=2700790 2024-09-19T11:43:02.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.290+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~8VYYRIY8HT35.0 size=787306 2024-09-19T11:43:02.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.290+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=8VYYRIY8HT35 tag=VY38TXCZ35KV type=write size=1835882 2024-09-19T11:43:02.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.298+0000 7f3d831968c0 1 < suggested update operation key=6NLQ0BK8AJUO tag=8C4D6CH98NMN type=del size=3684598 2024-09-19T11:43:02.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.302+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=YFI76WB0WJP1 type=del size=769381 2024-09-19T11:43:02.308 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.302+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=F9F70QVF1ZMY type=del 2024-09-19T11:43:02.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.310+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~0QYB65GV1TA4.0 size=1048576 2024-09-19T11:43:02.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.314+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~0QYB65GV1TA4.1 size=1038795 2024-09-19T11:43:02.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.314+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=0QYB65GV1TA4 tag=UGOJO956EBZE type=write size=3135947 2024-09-19T11:43:02.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.314+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=Z4GL980RUFVH type=del 2024-09-19T11:43:02.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.318+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=5T45BQBPZC1U type=del size=2919954 2024-09-19T11:43:02.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.322+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~9WBL2KNSLZSV.0 size=1048576 2024-09-19T11:43:02.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.326+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~9WBL2KNSLZSV.1 size=177255 2024-09-19T11:43:02.334 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.330+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=9WBL2KNSLZSV tag=DRIVPPUWNEDS type=write size=2274407 2024-09-19T11:43:02.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.334+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=M0MFD159HF5K type=del size=3580419 2024-09-19T11:43:02.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.334+0000 7f3d831968c0 1 < canceled part key=_multipart_E8OFSMUZHR02.2~Y6GWIB640XOH.0 size=1048576 2024-09-19T11:43:02.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.338+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~Y6GWIB640XOH.1 size=1048576 2024-09-19T11:43:02.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.342+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~Y6GWIB640XOH.2 size=484806 2024-09-19T11:43:02.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.350+0000 7f3d831968c0 1 < canceled multipart upload key=E8OFSMUZHR02 upload=Y6GWIB640XOH tag=D01E2EXIOAW3 type=write size=3630534 2024-09-19T11:43:02.359 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.354+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~DJA2ZG0F00Z6.0 size=1048576 2024-09-19T11:43:02.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.358+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~DJA2ZG0F00Z6.1 size=1048576 2024-09-19T11:43:02.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.358+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~DJA2ZG0F00Z6.2 size=610808 2024-09-19T11:43:02.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.358+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=DJA2ZG0F00Z6 tag=INNPZFCWTVFH type=write size=3756536 2024-09-19T11:43:02.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.362+0000 7f3d831968c0 1 < completed write operation key=PB62JE7I55GG tag=8N6XUUU403T8 type=write size=101597 2024-09-19T11:43:02.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.370+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~PT6W3S33PLY8.0 size=850472 2024-09-19T11:43:02.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.370+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=PT6W3S33PLY8 tag=76PKK98EMWWS type=write size=1899048 2024-09-19T11:43:02.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.374+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~4MZPGKWR9GH7.0 size=1048576 2024-09-19T11:43:02.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.374+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~4MZPGKWR9GH7.1 size=103550 2024-09-19T11:43:02.385 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.382+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=4MZPGKWR9GH7 tag=97DC799XELCM type=write size=2200702 2024-09-19T11:43:02.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.386+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=MZJ2ISH7YOOX type=del size=2299901 2024-09-19T11:43:02.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.386+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~USN6D020T5O1.0 size=1048576 2024-09-19T11:43:02.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.390+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~USN6D020T5O1.1 size=1048576 2024-09-19T11:43:02.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.394+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~USN6D020T5O1.2 size=219657 2024-09-19T11:43:02.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.398+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=USN6D020T5O1 tag=MUVBA37T6CAD type=write size=3365385 2024-09-19T11:43:02.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.402+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=M5OIZG38W60Q type=del size=2940493 2024-09-19T11:43:02.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.406+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~M8EF2STKU2W3.0 size=957130 2024-09-19T11:43:02.413 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.410+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=M8EF2STKU2W3 tag=2812TDPG6UI5 type=write size=2005706 2024-09-19T11:43:02.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.414+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~RZBABOHWCGK6.0 size=357759 2024-09-19T11:43:02.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.414+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=RZBABOHWCGK6 tag=5R3MR03F7GSX type=write size=1406335 2024-09-19T11:43:02.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.418+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=88KTO791RBCB type=del 2024-09-19T11:43:02.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.422+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=D8NELG6GG6L3 type=del size=211876 2024-09-19T11:43:02.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.426+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~2ZHLEJ9WDTJC.0 size=1048576 2024-09-19T11:43:02.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.426+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~2ZHLEJ9WDTJC.1 size=72492 2024-09-19T11:43:02.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.430+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=2ZHLEJ9WDTJC tag=D5S71RB2AZ34 type=write size=2169644 2024-09-19T11:43:02.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.434+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=2LNHDYXKETHQ type=del size=1471102 2024-09-19T11:43:02.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.438+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=PELNVM2VVMTN type=del 2024-09-19T11:43:02.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.442+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~7WN6QOE9OR0V.0 size=483546 2024-09-19T11:43:02.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.442+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=7WN6QOE9OR0V tag=H1Z6LMXIY52Z type=write size=1532122 2024-09-19T11:43:02.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.446+0000 7f3d831968c0 1 < completed delete operation key=3QWBQYLI0SJR tag=F13NS9PRE7Z2 type=del 2024-09-19T11:43:02.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.450+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~LUM0UBKZ38QM.0 size=666018 2024-09-19T11:43:02.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.450+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=LUM0UBKZ38QM tag=WXZHD3KWG8QC type=write size=1714594 2024-09-19T11:43:02.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.454+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~Y25RN1DQ7GZ8.0 size=1048576 2024-09-19T11:43:02.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.458+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~Y25RN1DQ7GZ8.1 size=1001505 2024-09-19T11:43:02.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.462+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=Y25RN1DQ7GZ8 tag=MKDU0GM0E74G type=write size=3098657 2024-09-19T11:43:02.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.466+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~VP2WX87ORRHR.0 size=1048576 2024-09-19T11:43:02.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.470+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~VP2WX87ORRHR.1 size=150892 2024-09-19T11:43:02.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.470+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=VP2WX87ORRHR tag=VXBE73CS2XT1 type=write size=2248044 2024-09-19T11:43:02.478 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.474+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~M2MCIQ3K1GBF.0 size=1048576 2024-09-19T11:43:02.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.478+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~M2MCIQ3K1GBF.1 size=91708 2024-09-19T11:43:02.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.482+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=M2MCIQ3K1GBF tag=5Q8HHPL32M50 type=write size=2188860 2024-09-19T11:43:02.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.486+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~U9NLA0GU02IG.0 size=753376 2024-09-19T11:43:02.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.486+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=U9NLA0GU02IG tag=TY3U0M7OMRJA type=write size=1801952 2024-09-19T11:43:02.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.490+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~8VYYRIY8HT35.0 size=787306 2024-09-19T11:43:02.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.498+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=8VYYRIY8HT35 tag=VY38TXCZ35KV type=write size=1835882 2024-09-19T11:43:02.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.502+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~5XLB01GVXIV2.0 size=369530 2024-09-19T11:43:02.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.502+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=5XLB01GVXIV2 tag=R7505AGXOGKG type=write size=1418106 2024-09-19T11:43:02.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.506+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=YFI76WB0WJP1 type=del 2024-09-19T11:43:02.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.510+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=K3QMQ94BK30D type=del size=476613 2024-09-19T11:43:02.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.514+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~0QYB65GV1TA4.0 size=1048576 2024-09-19T11:43:02.521 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.518+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~0QYB65GV1TA4.1 size=1038795 2024-09-19T11:43:02.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.522+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=0QYB65GV1TA4 tag=UGOJO956EBZE type=write size=3135947 2024-09-19T11:43:02.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.526+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=F9T5MJFFK0RD type=del size=1409382 2024-09-19T11:43:02.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.526+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=5T45BQBPZC1U type=del 2024-09-19T11:43:02.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.530+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=5NCDIOOMLZDI type=del size=1251301 2024-09-19T11:43:02.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.538+0000 7f3d831968c0 1 < suggested remove operation key=76JFMPOUJZXW tag=M0MFD159HF5K type=del 2024-09-19T11:43:02.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.542+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~DIAKR9AQU7OK.0 size=989845 2024-09-19T11:43:02.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.542+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=DIAKR9AQU7OK tag=MR98QNH10D71 type=write size=2038421 2024-09-19T11:43:02.551 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.546+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~DJA2ZG0F00Z6.0 size=1048576 2024-09-19T11:43:02.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.550+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~DJA2ZG0F00Z6.1 size=1048576 2024-09-19T11:43:02.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.554+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~DJA2ZG0F00Z6.2 size=610808 2024-09-19T11:43:02.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.558+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=DJA2ZG0F00Z6 tag=INNPZFCWTVFH type=write size=3756536 2024-09-19T11:43:02.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.562+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=4IDIB9BRR616 type=del size=3042353 2024-09-19T11:43:02.570 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.566+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~PT6W3S33PLY8.0 size=850472 2024-09-19T11:43:02.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.570+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=PT6W3S33PLY8 tag=76PKK98EMWWS type=write size=1899048 2024-09-19T11:43:02.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.574+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=CLYERC4RXF7A type=del size=4185325 2024-09-19T11:43:02.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.582+0000 7f3d831968c0 1 < suggested remove operation key=5RTONAWGYJNE tag=MZJ2ISH7YOOX type=del 2024-09-19T11:43:02.592 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.590+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~HR10BPKZU9C3.0 size=1048576 2024-09-19T11:43:02.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.590+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~HR10BPKZU9C3.1 size=1048576 2024-09-19T11:43:02.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.594+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~HR10BPKZU9C3.2 size=320328 2024-09-19T11:43:02.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.594+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=HR10BPKZU9C3 tag=ZKZG2I4CTT1P type=write size=3466056 2024-09-19T11:43:02.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.598+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=M5OIZG38W60Q type=del 2024-09-19T11:43:02.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.602+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~GUPKAB9OHKQI.0 size=1048576 2024-09-19T11:43:02.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.606+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~GUPKAB9OHKQI.1 size=899223 2024-09-19T11:43:02.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.606+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=GUPKAB9OHKQI tag=GLW7LSYLHA5Y type=write size=2996375 2024-09-19T11:43:02.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.610+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~RZBABOHWCGK6.0 size=357759 2024-09-19T11:43:02.618 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.614+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=RZBABOHWCGK6 tag=5R3MR03F7GSX type=write size=1406335 2024-09-19T11:43:02.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.618+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=B20KHFQ4P0NM type=write size=587094 2024-09-19T11:43:02.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.622+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=D8NELG6GG6L3 type=del 2024-09-19T11:43:02.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.626+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~QUM9RMA5D6MM.0 size=1048576 2024-09-19T11:43:02.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.630+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~QUM9RMA5D6MM.1 size=370557 2024-09-19T11:43:02.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.630+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=QUM9RMA5D6MM tag=WEU7BBFTJKXX type=write size=2467709 2024-09-19T11:43:02.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.634+0000 7f3d831968c0 1 < canceled operation key=FKLL38ZNCJ21 tag=2LNHDYXKETHQ type=del size=1471102 2024-09-19T11:43:02.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.638+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~04YTB5N4GAZP.0 size=1048576 2024-09-19T11:43:02.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.642+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~04YTB5N4GAZP.1 size=1048576 2024-09-19T11:43:02.650 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.646+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~04YTB5N4GAZP.2 size=6247 2024-09-19T11:43:02.650 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.646+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=04YTB5N4GAZP tag=F99H597PGJPU type=write size=3151975 2024-09-19T11:43:02.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.650+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~7WN6QOE9OR0V.0 size=483546 2024-09-19T11:43:02.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.654+0000 7f3d831968c0 1 < completed multipart upload key=3GD7UZCI3WX4 upload=7WN6QOE9OR0V tag=H1Z6LMXIY52Z type=write size=1532122 2024-09-19T11:43:02.665 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.662+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~P0Z14FXEA4A3.0 size=148039 2024-09-19T11:43:02.665 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.662+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=P0Z14FXEA4A3 tag=OAJVX2KBR5WG type=write size=1196615 2024-09-19T11:43:02.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.666+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~LUM0UBKZ38QM.0 size=666018 2024-09-19T11:43:02.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.670+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=LUM0UBKZ38QM tag=WXZHD3KWG8QC type=write size=1714594 2024-09-19T11:43:02.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.678+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~UNC3JYZLC8BT.0 size=601000 2024-09-19T11:43:02.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.678+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=UNC3JYZLC8BT tag=GELWOOCI2455 type=write size=1649576 2024-09-19T11:43:02.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.678+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~VP2WX87ORRHR.0 size=1048576 2024-09-19T11:43:02.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.682+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~VP2WX87ORRHR.1 size=150892 2024-09-19T11:43:02.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.690+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=VP2WX87ORRHR tag=VXBE73CS2XT1 type=write size=2248044 2024-09-19T11:43:02.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.694+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~YP372GMKFH61.0 size=177691 2024-09-19T11:43:02.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.694+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=YP372GMKFH61 tag=IHXOTK0PC2JK type=write size=1226267 2024-09-19T11:43:02.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.698+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~U9NLA0GU02IG.0 size=753376 2024-09-19T11:43:02.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.702+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=U9NLA0GU02IG tag=TY3U0M7OMRJA type=write size=1801952 2024-09-19T11:43:02.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.702+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=AC0ALOYD1TVP type=del size=1563466 2024-09-19T11:43:02.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.706+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~5XLB01GVXIV2.0 size=369530 2024-09-19T11:43:02.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.710+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=5XLB01GVXIV2 tag=R7505AGXOGKG type=write size=1418106 2024-09-19T11:43:02.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.714+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=HQPMQZUMG9V7 type=del size=2235986 2024-09-19T11:43:02.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.718+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=K3QMQ94BK30D type=del 2024-09-19T11:43:02.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.722+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=75ALQ80KPHXV type=del size=999396 2024-09-19T11:43:02.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.726+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=F9T5MJFFK0RD type=del 2024-09-19T11:43:02.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.726+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=AEOLMXLES9QV type=del size=2262043 2024-09-19T11:43:02.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.730+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=5NCDIOOMLZDI type=del 2024-09-19T11:43:02.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.734+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=OD624K4VJ01Y type=del size=1200741 2024-09-19T11:43:02.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.734+0000 7f3d831968c0 1 < canceled part key=_multipart_KAPKNZJ2DE6A.2~DIAKR9AQU7OK.0 size=989845 2024-09-19T11:43:02.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.738+0000 7f3d831968c0 1 < canceled multipart upload key=KAPKNZJ2DE6A upload=DIAKR9AQU7OK tag=MR98QNH10D71 type=write size=2038421 2024-09-19T11:43:02.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.742+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=B4ALGLMAD9OE type=del size=2372304 2024-09-19T11:43:02.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.746+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=4IDIB9BRR616 type=del 2024-09-19T11:43:02.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.750+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=8IQEVSDJK9HD type=del size=3195541 2024-09-19T11:43:02.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.750+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=CLYERC4RXF7A type=del 2024-09-19T11:43:02.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.754+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=K1FHXGCTO84X type=write size=458302 2024-09-19T11:43:02.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.758+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~HR10BPKZU9C3.0 size=1048576 2024-09-19T11:43:02.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.762+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~HR10BPKZU9C3.1 size=1048576 2024-09-19T11:43:02.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.762+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~HR10BPKZU9C3.2 size=320328 2024-09-19T11:43:02.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.766+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=HR10BPKZU9C3 tag=ZKZG2I4CTT1P type=write size=3466056 2024-09-19T11:43:02.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.774+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~800YYFXMRESZ.0 size=1048576 2024-09-19T11:43:02.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.774+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~800YYFXMRESZ.1 size=1048576 2024-09-19T11:43:02.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.778+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~800YYFXMRESZ.2 size=257865 2024-09-19T11:43:02.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.778+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=800YYFXMRESZ tag=06U0HHNTR12V type=write size=3403593 2024-09-19T11:43:02.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.782+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~GUPKAB9OHKQI.0 size=1048576 2024-09-19T11:43:02.787 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.782+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~GUPKAB9OHKQI.1 size=899223 2024-09-19T11:43:02.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.786+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=GUPKAB9OHKQI tag=GLW7LSYLHA5Y type=write size=2996375 2024-09-19T11:43:02.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.790+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=TENFQVNBAE9Y type=write size=354419 2024-09-19T11:43:02.798 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.794+0000 7f3d831968c0 1 < completed write operation key=Y3LO4H9RI4X0 tag=B20KHFQ4P0NM type=write size=587094 2024-09-19T11:43:02.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.798+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=4KJY06Q7DII6 type=del size=3574209 2024-09-19T11:43:02.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.798+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~QUM9RMA5D6MM.0 size=1048576 2024-09-19T11:43:02.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.802+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~QUM9RMA5D6MM.1 size=370557 2024-09-19T11:43:02.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.806+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=QUM9RMA5D6MM tag=WEU7BBFTJKXX type=write size=2467709 2024-09-19T11:43:02.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.810+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=DEB6RND5EJO1 type=del size=3395140 2024-09-19T11:43:02.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.810+0000 7f3d831968c0 1 < canceled part key=_multipart_E8OFSMUZHR02.2~04YTB5N4GAZP.0 size=1048576 2024-09-19T11:43:02.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.814+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~04YTB5N4GAZP.1 size=1048576 2024-09-19T11:43:02.820 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.818+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~04YTB5N4GAZP.2 size=6247 2024-09-19T11:43:02.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.822+0000 7f3d831968c0 1 < canceled multipart upload key=E8OFSMUZHR02 upload=04YTB5N4GAZP tag=F99H597PGJPU type=write size=3151975 2024-09-19T11:43:02.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.826+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=113UR6PL9JKZ type=write size=303844 2024-09-19T11:43:02.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.830+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~P0Z14FXEA4A3.0 size=148039 2024-09-19T11:43:02.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.834+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=P0Z14FXEA4A3 tag=OAJVX2KBR5WG type=write size=1196615 2024-09-19T11:43:02.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.838+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=A3HX7TD5HTCQ type=write size=825972 2024-09-19T11:43:02.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.842+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~UNC3JYZLC8BT.0 size=601000 2024-09-19T11:43:02.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.846+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=UNC3JYZLC8BT tag=GELWOOCI2455 type=write size=1649576 2024-09-19T11:43:02.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.850+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=4126H0HFZG2S type=del size=2110222 2024-09-19T11:43:02.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.854+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~YP372GMKFH61.0 size=177691 2024-09-19T11:43:02.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.858+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=YP372GMKFH61 tag=IHXOTK0PC2JK type=write size=1226267 2024-09-19T11:43:02.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.862+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=0BPLAUUI8KXX type=del size=2102414 2024-09-19T11:43:02.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.866+0000 7f3d831968c0 1 < suggested update operation key=3QWBQYLI0SJR tag=AC0ALOYD1TVP type=del size=1563466 2024-09-19T11:43:02.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.870+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=UV1CWUYSXGZ1 type=write size=251876 2024-09-19T11:43:02.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.874+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=HQPMQZUMG9V7 type=del 2024-09-19T11:43:02.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.878+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=NM1RGR26EI89 type=del size=1425786 2024-09-19T11:43:02.889 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.886+0000 7f3d831968c0 1 < suggested update operation key=G4P6HIOM1G2E tag=75ALQ80KPHXV type=del size=999396 2024-09-19T11:43:02.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.886+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=T07MJ8S64TPK type=write size=531639 2024-09-19T11:43:02.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.894+0000 7f3d831968c0 1 < suggested update operation key=76JFMPOUJZXW tag=AEOLMXLES9QV type=del size=2262043 2024-09-19T11:43:02.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.898+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=AIGU1DNC6W6I type=del size=848798 2024-09-19T11:43:02.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.902+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=OD624K4VJ01Y type=del 2024-09-19T11:43:02.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.906+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~1GBRVMH5L15G.0 size=853816 2024-09-19T11:43:02.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.906+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=1GBRVMH5L15G tag=82GS4P3X9X6Q type=write size=1902392 2024-09-19T11:43:02.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.910+0000 7f3d831968c0 1 < suggested update operation key=JTPBGWC4T3Y5 tag=B4ALGLMAD9OE type=del size=2372304 2024-09-19T11:43:02.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.914+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=GO5D03GOXM4O type=del size=1660105 2024-09-19T11:43:02.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.918+0000 7f3d831968c0 1 < suggested remove operation key=FZGRZ06MOHBI tag=8IQEVSDJK9HD type=del 2024-09-19T11:43:02.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.922+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=JLE1MLIVJHI3 type=del size=1275135 2024-09-19T11:43:02.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.926+0000 7f3d831968c0 1 < completed write operation key=JV7EGEI6062Y tag=K1FHXGCTO84X type=write size=458302 2024-09-19T11:43:02.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.930+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=H3LFV7ZMRNAK type=del size=1574757 2024-09-19T11:43:02.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.930+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~800YYFXMRESZ.0 size=1048576 2024-09-19T11:43:02.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.934+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~800YYFXMRESZ.1 size=1048576 2024-09-19T11:43:02.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.938+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~800YYFXMRESZ.2 size=257865 2024-09-19T11:43:02.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.942+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=800YYFXMRESZ tag=06U0HHNTR12V type=write size=3403593 2024-09-19T11:43:02.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.950+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~EZLC8OEE63E1.0 size=1048576 2024-09-19T11:43:02.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.950+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~EZLC8OEE63E1.1 size=224316 2024-09-19T11:43:02.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.950+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=EZLC8OEE63E1 tag=A93RN8AHY9XH type=write size=2321468 2024-09-19T11:43:02.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.958+0000 7f3d831968c0 1 < suggested update operation key=0OOB2SNLVK8E tag=TENFQVNBAE9Y type=write size=354419 2024-09-19T11:43:02.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.962+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=R031EXVEGCT6 type=del size=238369 2024-09-19T11:43:02.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.966+0000 7f3d831968c0 -1 < failed to complete operation key=JTPBGWC4T3Y5 tag=4KJY06Q7DII6 type=del size=3574209: (22) Invalid argument 2024-09-19T11:43:02.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.970+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~K3EZJP2CBI9W.0 size=814783 2024-09-19T11:43:02.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.970+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=K3EZJP2CBI9W tag=QGRA4943KNAL type=write size=1863359 2024-09-19T11:43:02.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.974+0000 7f3d831968c0 1 < canceled operation key=8104Z4OQ7UWQ tag=DEB6RND5EJO1 type=del size=3395140 2024-09-19T11:43:02.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.978+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~NYW81GX12M14.0 size=28280 2024-09-19T11:43:02.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.978+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=NYW81GX12M14 tag=YC51LGC4M44A type=write size=1076856 2024-09-19T11:43:02.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.982+0000 7f3d831968c0 1 < completed write operation key=E8OFSMUZHR02 tag=113UR6PL9JKZ type=write size=303844 2024-09-19T11:43:02.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.986+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=8JBPF3DH3PJD type=del size=629911 2024-09-19T11:43:02.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.994+0000 7f3d831968c0 1 < suggested update operation key=8104Z4OQ7UWQ tag=A3HX7TD5HTCQ type=write size=825972 2024-09-19T11:43:03.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.994+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=T92W7S279TVE type=del size=650625 2024-09-19T11:43:03.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:02.998+0000 7f3d831968c0 1 < canceled operation key=8FGIZJIY58C7 tag=4126H0HFZG2S type=del size=2110222 2024-09-19T11:43:03.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.002+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=BWRA2JNC50AT type=del size=3145468 2024-09-19T11:43:03.010 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.006+0000 7f3d831968c0 -1 < failed to complete operation key=8104Z4OQ7UWQ tag=0BPLAUUI8KXX type=del size=2102414: (22) Invalid argument 2024-09-19T11:43:03.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.010+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=X9V71OZGJ19Q type=write size=68330 2024-09-19T11:43:03.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.014+0000 7f3d831968c0 1 < suggested remove operation key=T9KJH2ZYCLVA tag=UV1CWUYSXGZ1 type=write 2024-09-19T11:43:03.022 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.018+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=X5PIJCE8CAOT type=write size=567447 2024-09-19T11:43:03.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.022+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=NM1RGR26EI89 type=del 2024-09-19T11:43:03.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.026+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=71YS07G99VK5 type=del size=596637 2024-09-19T11:43:03.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.034+0000 7f3d831968c0 1 < suggested update operation key=2VJRZVU7S8LB tag=T07MJ8S64TPK type=write size=531639 2024-09-19T11:43:03.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.038+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~8YLM29KRMHAA.0 size=1048576 2024-09-19T11:43:03.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.042+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~8YLM29KRMHAA.1 size=1048576 2024-09-19T11:43:03.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.042+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~8YLM29KRMHAA.2 size=580333 2024-09-19T11:43:03.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.042+0000 7f3d831968c0 1 > prepared multipart upload key=JTPBGWC4T3Y5 upload=8YLM29KRMHAA tag=UUXTPITKFVLJ type=write size=3726061 2024-09-19T11:43:03.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.046+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=AIGU1DNC6W6I type=del 2024-09-19T11:43:03.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.054+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~5TEBUBAWM06R.0 size=1048576 2024-09-19T11:43:03.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.058+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~5TEBUBAWM06R.1 size=500185 2024-09-19T11:43:03.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.058+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=5TEBUBAWM06R tag=L9DCQFCU08D6 type=write size=2597337 2024-09-19T11:43:03.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.062+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~1GBRVMH5L15G.0 size=853816 2024-09-19T11:43:03.071 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.066+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=1GBRVMH5L15G tag=82GS4P3X9X6Q type=write size=1902392 2024-09-19T11:43:03.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.074+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~0Y32H4763SUW.0 size=1048576 2024-09-19T11:43:03.080 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.074+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~0Y32H4763SUW.1 size=1048576 2024-09-19T11:43:03.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.078+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~0Y32H4763SUW.2 size=833267 2024-09-19T11:43:03.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.078+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=0Y32H4763SUW tag=K5GJ3AXMC8KG type=write size=3978995 2024-09-19T11:43:03.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.082+0000 7f3d831968c0 -1 < failed to complete operation key=T9KJH2ZYCLVA tag=GO5D03GOXM4O type=del size=1660105: (22) Invalid argument 2024-09-19T11:43:03.092 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.090+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~CZ7Q4QH7KGVH.0 size=1048576 2024-09-19T11:43:03.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.090+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~CZ7Q4QH7KGVH.1 size=87956 2024-09-19T11:43:03.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.090+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=CZ7Q4QH7KGVH tag=H23C5HAPGCRL type=write size=2185108 2024-09-19T11:43:03.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.094+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=JLE1MLIVJHI3 type=del 2024-09-19T11:43:03.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.102+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~4HH33WCTQWAW.0 size=276651 2024-09-19T11:43:03.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.102+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=4HH33WCTQWAW tag=2YJ2XPHV3ZBA type=write size=1325227 2024-09-19T11:43:03.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.102+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=H3LFV7ZMRNAK type=del 2024-09-19T11:43:03.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.110+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~5846AUYZ2A2X.0 size=456423 2024-09-19T11:43:03.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.110+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=5846AUYZ2A2X tag=Y6U9155LQFSQ type=write size=1504999 2024-09-19T11:43:03.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.114+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~EZLC8OEE63E1.0 size=1048576 2024-09-19T11:43:03.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.114+0000 7f3d831968c0 1 < canceled part key=_multipart_EVFF0F0760OS.2~EZLC8OEE63E1.1 size=224316 2024-09-19T11:43:03.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.118+0000 7f3d831968c0 1 < canceled multipart upload key=EVFF0F0760OS upload=EZLC8OEE63E1 tag=A93RN8AHY9XH type=write size=2321468 2024-09-19T11:43:03.125 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.122+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=DZXJ5155J2S3 type=del size=890797 2024-09-19T11:43:03.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.126+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=R031EXVEGCT6 type=del 2024-09-19T11:43:03.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.130+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~PCHHMO2RLUQ9.0 size=1048576 2024-09-19T11:43:03.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.134+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~PCHHMO2RLUQ9.1 size=698854 2024-09-19T11:43:03.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.134+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=PCHHMO2RLUQ9 tag=V4FYTF4NT6YE type=write size=2796006 2024-09-19T11:43:03.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.138+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~K3EZJP2CBI9W.0 size=814783 2024-09-19T11:43:03.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.142+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=K3EZJP2CBI9W tag=QGRA4943KNAL type=write size=1863359 2024-09-19T11:43:03.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.146+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=WXDT7YDR9DNF type=del size=3041371 2024-09-19T11:43:03.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.150+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~NYW81GX12M14.0 size=28280 2024-09-19T11:43:03.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.154+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=NYW81GX12M14 tag=YC51LGC4M44A type=write size=1076856 2024-09-19T11:43:03.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.158+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=BM113MGR98K2 type=write size=818562 2024-09-19T11:43:03.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.158+0000 7f3d831968c0 -1 < failed to complete operation key=8104Z4OQ7UWQ tag=8JBPF3DH3PJD type=del size=629911: (22) Invalid argument 2024-09-19T11:43:03.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.162+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=N1Q6M3ALAXC7 type=del size=2161351 2024-09-19T11:43:03.169 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.166+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=T92W7S279TVE type=del 2024-09-19T11:43:03.177 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.174+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~EOTYQN71M1AP.0 size=1048576 2024-09-19T11:43:03.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.174+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~EOTYQN71M1AP.1 size=1002350 2024-09-19T11:43:03.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.174+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=EOTYQN71M1AP tag=MPR9SVT748JA type=write size=3099502 2024-09-19T11:43:03.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.178+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=BWRA2JNC50AT type=del 2024-09-19T11:43:03.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.182+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=3BS2BW1HGDRN type=del size=637150 2024-09-19T11:43:03.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.190+0000 7f3d831968c0 1 < suggested update operation key=8104Z4OQ7UWQ tag=X9V71OZGJ19Q type=write size=68330 2024-09-19T11:43:03.196 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.190+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=5DESU94050FR type=del size=1301931 2024-09-19T11:43:03.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.194+0000 7f3d831968c0 1 < completed write operation key=4I8BY4YYTRT0 tag=X5PIJCE8CAOT type=write size=567447 2024-09-19T11:43:03.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.198+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=ATER4NLF575O type=del size=784891 2024-09-19T11:43:03.206 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.202+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=71YS07G99VK5 type=del 2024-09-19T11:43:03.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.206+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=9E7SRZG20CW8 type=del size=1413533 2024-09-19T11:43:03.213 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.210+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~8YLM29KRMHAA.0 size=1048576 2024-09-19T11:43:03.215 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.210+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~8YLM29KRMHAA.1 size=1048576 2024-09-19T11:43:03.218 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.214+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~8YLM29KRMHAA.2 size=580333 2024-09-19T11:43:03.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.218+0000 7f3d831968c0 1 < completed multipart upload key=JTPBGWC4T3Y5 upload=8YLM29KRMHAA tag=UUXTPITKFVLJ type=write size=3726061 2024-09-19T11:43:03.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.226+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~PHV1WTCNLO5Y.0 size=610916 2024-09-19T11:43:03.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.226+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=PHV1WTCNLO5Y tag=9GBFUBPJ0RSK type=write size=1659492 2024-09-19T11:43:03.233 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.230+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~5TEBUBAWM06R.0 size=1048576 2024-09-19T11:43:03.236 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.230+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~5TEBUBAWM06R.1 size=500185 2024-09-19T11:43:03.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.238+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=5TEBUBAWM06R tag=L9DCQFCU08D6 type=write size=2597337 2024-09-19T11:43:03.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.246+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~OECB6F6WQE33.0 size=1048576 2024-09-19T11:43:03.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.250+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~OECB6F6WQE33.1 size=515227 2024-09-19T11:43:03.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.250+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=OECB6F6WQE33 tag=BQUTQLG6UVFC type=write size=2612379 2024-09-19T11:43:03.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.254+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~0Y32H4763SUW.0 size=1048576 2024-09-19T11:43:03.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.254+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~0Y32H4763SUW.1 size=1048576 2024-09-19T11:43:03.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.258+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~0Y32H4763SUW.2 size=833267 2024-09-19T11:43:03.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.262+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=0Y32H4763SUW tag=K5GJ3AXMC8KG type=write size=3978995 2024-09-19T11:43:03.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.270+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~FTOKP559FKGR.0 size=1048576 2024-09-19T11:43:03.276 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.270+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~FTOKP559FKGR.1 size=1048576 2024-09-19T11:43:03.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.274+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~FTOKP559FKGR.2 size=87235 2024-09-19T11:43:03.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.274+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=FTOKP559FKGR tag=1X4P5R0H1KKC type=write size=3232963 2024-09-19T11:43:03.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.278+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~CZ7Q4QH7KGVH.0 size=1048576 2024-09-19T11:43:03.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.282+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~CZ7Q4QH7KGVH.1 size=87956 2024-09-19T11:43:03.292 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.286+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=CZ7Q4QH7KGVH tag=H23C5HAPGCRL type=write size=2185108 2024-09-19T11:43:03.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.290+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=6FV0J4KBP8J6 type=del size=1697008 2024-09-19T11:43:03.299 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.294+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~4HH33WCTQWAW.0 size=276651 2024-09-19T11:43:03.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.302+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=4HH33WCTQWAW tag=2YJ2XPHV3ZBA type=write size=1325227 2024-09-19T11:43:03.308 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.306+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=MOBPY8ZEW371 type=del size=3950125 2024-09-19T11:43:03.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.310+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~5846AUYZ2A2X.0 size=456423 2024-09-19T11:43:03.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.314+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=5846AUYZ2A2X tag=Y6U9155LQFSQ type=write size=1504999 2024-09-19T11:43:03.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.318+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=L1IQSLS2A1YT type=del size=615650 2024-09-19T11:43:03.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.326+0000 7f3d831968c0 1 < suggested update operation key=6NLQ0BK8AJUO tag=DZXJ5155J2S3 type=del size=890797 2024-09-19T11:43:03.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.330+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=64XF6X3RN0PM type=del size=107764 2024-09-19T11:43:03.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.334+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~PCHHMO2RLUQ9.0 size=1048576 2024-09-19T11:43:03.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.338+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~PCHHMO2RLUQ9.1 size=698854 2024-09-19T11:43:03.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.342+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=PCHHMO2RLUQ9 tag=V4FYTF4NT6YE type=write size=2796006 2024-09-19T11:43:03.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.350+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~WIG2HDN7OVQE.0 size=1048576 2024-09-19T11:43:03.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.354+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~WIG2HDN7OVQE.1 size=1048576 2024-09-19T11:43:03.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.354+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~WIG2HDN7OVQE.2 size=971308 2024-09-19T11:43:03.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.354+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=WIG2HDN7OVQE tag=8RUDP79NPKWU type=write size=4117036 2024-09-19T11:43:03.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.362+0000 7f3d831968c0 1 < suggested update operation key=2VJRZVU7S8LB tag=WXDT7YDR9DNF type=del size=3041371 2024-09-19T11:43:03.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.366+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=FCBNBJP1PV7J type=del size=2821701 2024-09-19T11:43:03.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.370+0000 7f3d831968c0 -1 < failed to complete operation key=6NLQ0BK8AJUO tag=BM113MGR98K2 type=write size=818562: (22) Invalid argument 2024-09-19T11:43:03.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.374+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=3BDG3U4KXA5Y type=del size=601514 2024-09-19T11:43:03.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.374+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=N1Q6M3ALAXC7 type=del 2024-09-19T11:43:03.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.378+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=B15E8OB78XPT type=del size=2151881 2024-09-19T11:43:03.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.382+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~EOTYQN71M1AP.0 size=1048576 2024-09-19T11:43:03.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.386+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~EOTYQN71M1AP.1 size=1002350 2024-09-19T11:43:03.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.390+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=EOTYQN71M1AP tag=MPR9SVT748JA type=write size=3099502 2024-09-19T11:43:03.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.394+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=UCM5XX4GO0MI type=del size=1255423 2024-09-19T11:43:03.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.398+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=3BS2BW1HGDRN type=del 2024-09-19T11:43:03.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.402+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~0JAF6AN4GBVS.0 size=137082 2024-09-19T11:43:03.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.402+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=0JAF6AN4GBVS tag=5VKRDIC5GWPN type=write size=1185658 2024-09-19T11:43:03.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.406+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=5DESU94050FR type=del 2024-09-19T11:43:03.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.414+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~0MLQ609ISZDL.0 size=292396 2024-09-19T11:43:03.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.414+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=0MLQ609ISZDL tag=AOFHR05YUWPC type=write size=1340972 2024-09-19T11:43:03.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.418+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=ATER4NLF575O type=del 2024-09-19T11:43:03.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.422+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~CMXS3GVHIW99.0 size=1048576 2024-09-19T11:43:03.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.426+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~CMXS3GVHIW99.1 size=36816 2024-09-19T11:43:03.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.426+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=CMXS3GVHIW99 tag=XA5Z7QJCZFEP type=write size=2133968 2024-09-19T11:43:03.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.426+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=9E7SRZG20CW8 type=del 2024-09-19T11:43:03.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.430+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=0Z1KK710PZ9K type=del size=750958 2024-09-19T11:43:03.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.434+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~PHV1WTCNLO5Y.0 size=610916 2024-09-19T11:43:03.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.438+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=PHV1WTCNLO5Y tag=9GBFUBPJ0RSK type=write size=1659492 2024-09-19T11:43:03.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.442+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=AOIIYL67HVQL type=del size=3972057 2024-09-19T11:43:03.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.446+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~OECB6F6WQE33.0 size=1048576 2024-09-19T11:43:03.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.450+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~OECB6F6WQE33.1 size=515227 2024-09-19T11:43:03.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.454+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=OECB6F6WQE33 tag=BQUTQLG6UVFC type=write size=2612379 2024-09-19T11:43:03.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.462+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~MJIWNWG8V4M0.0 size=238010 2024-09-19T11:43:03.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.462+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=MJIWNWG8V4M0 tag=GCY9DYDQ2NTZ type=write size=1286586 2024-09-19T11:43:03.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.466+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~FTOKP559FKGR.0 size=1048576 2024-09-19T11:43:03.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.466+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~FTOKP559FKGR.1 size=1048576 2024-09-19T11:43:03.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.470+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~FTOKP559FKGR.2 size=87235 2024-09-19T11:43:03.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.474+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=FTOKP559FKGR tag=1X4P5R0H1KKC type=write size=3232963 2024-09-19T11:43:03.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.478+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=Q5QV0G9SV8NT type=del size=2392182 2024-09-19T11:43:03.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.482+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=6FV0J4KBP8J6 type=del 2024-09-19T11:43:03.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.486+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=1XVT34CJEG29 type=del size=2437352 2024-09-19T11:43:03.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.490+0000 7f3d831968c0 -1 < failed to complete operation key=6NLQ0BK8AJUO tag=MOBPY8ZEW371 type=del size=3950125: (22) Invalid argument 2024-09-19T11:43:03.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.490+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=CM17IZXOO1IB type=del size=1736308 2024-09-19T11:43:03.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.494+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=L1IQSLS2A1YT type=del 2024-09-19T11:43:03.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.498+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=KIG5IZPVFQKY type=del size=335264 2024-09-19T11:43:03.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.502+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=64XF6X3RN0PM type=del 2024-09-19T11:43:03.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.506+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=P1RK3PX1RNZX type=del size=2088094 2024-09-19T11:43:03.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.510+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~WIG2HDN7OVQE.0 size=1048576 2024-09-19T11:43:03.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.514+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~WIG2HDN7OVQE.1 size=1048576 2024-09-19T11:43:03.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.514+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~WIG2HDN7OVQE.2 size=971308 2024-09-19T11:43:03.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.522+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=WIG2HDN7OVQE tag=8RUDP79NPKWU type=write size=4117036 2024-09-19T11:43:03.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.526+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~WAXHH3JTQDS8.0 size=1048576 2024-09-19T11:43:03.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.530+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~WAXHH3JTQDS8.1 size=680245 2024-09-19T11:43:03.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.530+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=WAXHH3JTQDS8 tag=HOA8HBQIJVL9 type=write size=2777397 2024-09-19T11:43:03.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.534+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=FCBNBJP1PV7J type=del 2024-09-19T11:43:03.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.538+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=Z1LBYE9W30QL type=del size=4178383 2024-09-19T11:43:03.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.542+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=3BDG3U4KXA5Y type=del 2024-09-19T11:43:03.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.542+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=6V8OV2BTCT53 type=del size=254915 2024-09-19T11:43:03.551 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.546+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=B15E8OB78XPT type=del 2024-09-19T11:43:03.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.550+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=E8I5ANQU97A4 type=del size=2629931 2024-09-19T11:43:03.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.554+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=UCM5XX4GO0MI type=del 2024-09-19T11:43:03.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.558+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~MVLJKE98JE2K.0 size=161582 2024-09-19T11:43:03.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.558+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=MVLJKE98JE2K tag=CV40R5WYT0KV type=write size=1210158 2024-09-19T11:43:03.570 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.566+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~0JAF6AN4GBVS.0 size=137082 2024-09-19T11:43:03.576 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.570+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=0JAF6AN4GBVS tag=5VKRDIC5GWPN type=write size=1185658 2024-09-19T11:43:03.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.578+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~GO29LA3DDRNR.0 size=1048576 2024-09-19T11:43:03.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.582+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~GO29LA3DDRNR.1 size=993961 2024-09-19T11:43:03.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.582+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=GO29LA3DDRNR tag=W3NW94K4040V type=write size=3091113 2024-09-19T11:43:03.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.582+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~0MLQ609ISZDL.0 size=292396 2024-09-19T11:43:03.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.590+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=0MLQ609ISZDL tag=AOFHR05YUWPC type=write size=1340972 2024-09-19T11:43:03.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.594+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~1WU8K11605WG.0 size=1048576 2024-09-19T11:43:03.603 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.598+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~1WU8K11605WG.1 size=1048576 2024-09-19T11:43:03.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.602+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~1WU8K11605WG.2 size=958585 2024-09-19T11:43:03.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.602+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=1WU8K11605WG tag=WHD7KEXGL3I2 type=write size=4104313 2024-09-19T11:43:03.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.606+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~CMXS3GVHIW99.0 size=1048576 2024-09-19T11:43:03.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.606+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~CMXS3GVHIW99.1 size=36816 2024-09-19T11:43:03.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.614+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=CMXS3GVHIW99 tag=XA5Z7QJCZFEP type=write size=2133968 2024-09-19T11:43:03.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.618+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=DJOUDE75ZU95 type=del size=2937493 2024-09-19T11:43:03.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.618+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=0Z1KK710PZ9K type=del 2024-09-19T11:43:03.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.622+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=EGIXADX84NQQ type=del size=2362463 2024-09-19T11:43:03.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.630+0000 7f3d831968c0 1 < suggested update operation key=224HPC2Y95N6 tag=AOIIYL67HVQL type=del size=3972057 2024-09-19T11:43:03.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.634+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~6DGBG1CRVY0H.0 size=1048576 2024-09-19T11:43:03.641 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.638+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~6DGBG1CRVY0H.1 size=518610 2024-09-19T11:43:03.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.638+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=6DGBG1CRVY0H tag=0PDBSH0YXSWG type=write size=2615762 2024-09-19T11:43:03.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.642+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~MJIWNWG8V4M0.0 size=238010 2024-09-19T11:43:03.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.646+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=MJIWNWG8V4M0 tag=GCY9DYDQ2NTZ type=write size=1286586 2024-09-19T11:43:03.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.650+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=8N9K5MKM9N3A type=write size=821634 2024-09-19T11:43:03.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.650+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=Q5QV0G9SV8NT type=del 2024-09-19T11:43:03.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.654+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=SGX3O2G5BROY type=del size=2634335 2024-09-19T11:43:03.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.658+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=1XVT34CJEG29 type=del 2024-09-19T11:43:03.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.662+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~WR0ACRRJZS4E.0 size=1048576 2024-09-19T11:43:03.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.662+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~WR0ACRRJZS4E.1 size=1048576 2024-09-19T11:43:03.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.666+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~WR0ACRRJZS4E.2 size=941682 2024-09-19T11:43:03.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.666+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=WR0ACRRJZS4E tag=WWIEMV17Z64Q type=write size=4087410 2024-09-19T11:43:03.673 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.670+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=CM17IZXOO1IB type=del 2024-09-19T11:43:03.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.670+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=F4IBN7LUK0G5 type=del size=475826 2024-09-19T11:43:03.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.674+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=KIG5IZPVFQKY type=del 2024-09-19T11:43:03.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.678+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=YYIRG3SEP7BZ type=del size=644674 2024-09-19T11:43:03.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.682+0000 7f3d831968c0 1 < suggested remove operation key=CULXGFLZ0HI6 tag=P1RK3PX1RNZX type=del 2024-09-19T11:43:03.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.686+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~E4IFD5U6GRLK.0 size=367744 2024-09-19T11:43:03.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.686+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=E4IFD5U6GRLK tag=6OB03OZRPLLI type=write size=1416320 2024-09-19T11:43:03.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.690+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~WAXHH3JTQDS8.0 size=1048576 2024-09-19T11:43:03.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.690+0000 7f3d831968c0 1 < canceled part key=_multipart_224HPC2Y95N6.2~WAXHH3JTQDS8.1 size=680245 2024-09-19T11:43:03.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.694+0000 7f3d831968c0 1 < canceled multipart upload key=224HPC2Y95N6 upload=WAXHH3JTQDS8 tag=HOA8HBQIJVL9 type=write size=2777397 2024-09-19T11:43:03.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.698+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~U8I9AZV4X23S.0 size=1048576 2024-09-19T11:43:03.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.702+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~U8I9AZV4X23S.1 size=1048576 2024-09-19T11:43:03.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.706+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~U8I9AZV4X23S.2 size=267857 2024-09-19T11:43:03.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.706+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=U8I9AZV4X23S tag=AGI3KKPMW1KN type=write size=3413585 2024-09-19T11:43:03.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.706+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=Z1LBYE9W30QL type=del 2024-09-19T11:43:03.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.714+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~HPZT3WU1T02J.0 size=1048576 2024-09-19T11:43:03.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.714+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~HPZT3WU1T02J.1 size=704989 2024-09-19T11:43:03.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.714+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=HPZT3WU1T02J tag=H1S1D0O3PQRX type=write size=2802141 2024-09-19T11:43:03.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.718+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=6V8OV2BTCT53 type=del 2024-09-19T11:43:03.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.722+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~JS59F5M7N8WC.0 size=213499 2024-09-19T11:43:03.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.722+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=JS59F5M7N8WC tag=KD75M109ZBLH type=write size=1262075 2024-09-19T11:43:03.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.726+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=E8I5ANQU97A4 type=del 2024-09-19T11:43:03.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.730+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=Q2FNQOBTKTZS type=del size=18940 2024-09-19T11:43:03.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.730+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~MVLJKE98JE2K.0 size=161582 2024-09-19T11:43:03.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.734+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=MVLJKE98JE2K tag=CV40R5WYT0KV type=write size=1210158 2024-09-19T11:43:03.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.738+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=OAQGKSV51K0C type=del size=2371022 2024-09-19T11:43:03.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.742+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~GO29LA3DDRNR.0 size=1048576 2024-09-19T11:43:03.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.742+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~GO29LA3DDRNR.1 size=993961 2024-09-19T11:43:03.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.746+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=GO29LA3DDRNR tag=W3NW94K4040V type=write size=3091113 2024-09-19T11:43:03.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.750+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=RPK1WH2NHAGW type=write size=426533 2024-09-19T11:43:03.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.750+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~1WU8K11605WG.0 size=1048576 2024-09-19T11:43:03.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.754+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~1WU8K11605WG.1 size=1048576 2024-09-19T11:43:03.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.754+0000 7f3d831968c0 1 < canceled part key=_multipart_JV7EGEI6062Y.2~1WU8K11605WG.2 size=958585 2024-09-19T11:43:03.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.758+0000 7f3d831968c0 1 < canceled multipart upload key=JV7EGEI6062Y upload=1WU8K11605WG tag=WHD7KEXGL3I2 type=write size=4104313 2024-09-19T11:43:03.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.762+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~ZXKJ1WS5L8VP.0 size=881942 2024-09-19T11:43:03.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.762+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=ZXKJ1WS5L8VP tag=ZSA9R6G2LKRZ type=write size=1930518 2024-09-19T11:43:03.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.766+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=DJOUDE75ZU95 type=del 2024-09-19T11:43:03.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.770+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~2K6UXVV1PX2Z.0 size=1013704 2024-09-19T11:43:03.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.770+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=2K6UXVV1PX2Z tag=TK5RSAN4031D type=write size=2062280 2024-09-19T11:43:03.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.770+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=EGIXADX84NQQ type=del 2024-09-19T11:43:03.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.774+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=A4C6R02T28AZ type=del size=2131186 2024-09-19T11:43:03.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.778+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~6DGBG1CRVY0H.0 size=1048576 2024-09-19T11:43:03.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.778+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~6DGBG1CRVY0H.1 size=518610 2024-09-19T11:43:03.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.782+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=6DGBG1CRVY0H tag=0PDBSH0YXSWG type=write size=2615762 2024-09-19T11:43:03.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.786+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=1GUMJNQ4GQJQ type=del size=835300 2024-09-19T11:43:03.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.786+0000 7f3d831968c0 1 < completed write operation key=4V17CRW6EB65 tag=8N9K5MKM9N3A type=write size=821634 2024-09-19T11:43:03.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.790+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~5ICLTP2LMDEN.0 size=1048576 2024-09-19T11:43:03.797 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.794+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~5ICLTP2LMDEN.1 size=1048576 2024-09-19T11:43:03.798 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.794+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~5ICLTP2LMDEN.2 size=1034658 2024-09-19T11:43:03.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.794+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=5ICLTP2LMDEN tag=I7ZL746IK7F1 type=write size=4180386 2024-09-19T11:43:03.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.798+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=SGX3O2G5BROY type=del 2024-09-19T11:43:03.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.798+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=X4NN642QW5PJ type=del size=1820248 2024-09-19T11:43:03.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.802+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~WR0ACRRJZS4E.0 size=1048576 2024-09-19T11:43:03.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.802+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~WR0ACRRJZS4E.1 size=1048576 2024-09-19T11:43:03.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.806+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~WR0ACRRJZS4E.2 size=941682 2024-09-19T11:43:03.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.810+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=WR0ACRRJZS4E tag=WWIEMV17Z64Q type=write size=4087410 2024-09-19T11:43:03.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.810+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=2RKTN9S0FBX6 type=del size=3588354 2024-09-19T11:43:03.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.814+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=F4IBN7LUK0G5 type=del 2024-09-19T11:43:03.820 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.818+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=CVPKPHVKTML1 type=del size=153312 2024-09-19T11:43:03.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.822+0000 7f3d831968c0 1 < suggested update operation key=4V17CRW6EB65 tag=YYIRG3SEP7BZ type=del size=644674 2024-09-19T11:43:03.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.826+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=TZ11C2SWXG58 type=write size=140529 2024-09-19T11:43:03.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.826+0000 7f3d831968c0 1 < canceled part key=_multipart_Y3LO4H9RI4X0.2~E4IFD5U6GRLK.0 size=367744 2024-09-19T11:43:03.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.830+0000 7f3d831968c0 1 < canceled multipart upload key=Y3LO4H9RI4X0 upload=E4IFD5U6GRLK tag=6OB03OZRPLLI type=write size=1416320 2024-09-19T11:43:03.836 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.830+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=7VZ1FYPPYBVT type=del size=1154617 2024-09-19T11:43:03.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.834+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~U8I9AZV4X23S.0 size=1048576 2024-09-19T11:43:03.840 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.834+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~U8I9AZV4X23S.1 size=1048576 2024-09-19T11:43:03.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.838+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~U8I9AZV4X23S.2 size=267857 2024-09-19T11:43:03.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.842+0000 7f3d831968c0 1 < completed multipart upload key=76JFMPOUJZXW upload=U8I9AZV4X23S tag=AGI3KKPMW1KN type=write size=3413585 2024-09-19T11:43:03.849 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.846+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=1W8F49LHBU46 type=del size=1167290 2024-09-19T11:43:03.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.846+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~HPZT3WU1T02J.0 size=1048576 2024-09-19T11:43:03.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.850+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~HPZT3WU1T02J.1 size=704989 2024-09-19T11:43:03.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.854+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=HPZT3WU1T02J tag=H1S1D0O3PQRX type=write size=2802141 2024-09-19T11:43:03.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.854+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=JXXYHOHA9X03 type=del size=2829687 2024-09-19T11:43:03.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.858+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~JS59F5M7N8WC.0 size=213499 2024-09-19T11:43:03.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.862+0000 7f3d831968c0 1 < completed multipart upload key=EVFF0F0760OS upload=JS59F5M7N8WC tag=KD75M109ZBLH type=write size=1262075 2024-09-19T11:43:03.868 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.866+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=25447Q360E9H type=del size=4177484 2024-09-19T11:43:03.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.866+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=Q2FNQOBTKTZS type=del 2024-09-19T11:43:03.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.870+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=1FCC15F33HG6 type=del size=578960 2024-09-19T11:43:03.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.870+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=OAQGKSV51K0C type=del 2024-09-19T11:43:03.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.874+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=OEM1TYPPWIP7 type=del size=2956941 2024-09-19T11:43:03.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.878+0000 7f3d831968c0 1 < completed write operation key=900RV3451AON tag=RPK1WH2NHAGW type=write size=426533 2024-09-19T11:43:03.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.882+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~G5BLGIA3DNA4.0 size=251837 2024-09-19T11:43:03.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.882+0000 7f3d831968c0 1 > prepared multipart upload key=JTPBGWC4T3Y5 upload=G5BLGIA3DNA4 tag=AF60Q0JSRRQX type=write size=1300413 2024-09-19T11:43:03.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.882+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~ZXKJ1WS5L8VP.0 size=881942 2024-09-19T11:43:03.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.886+0000 7f3d831968c0 1 < completed multipart upload key=5RTONAWGYJNE upload=ZXKJ1WS5L8VP tag=ZSA9R6G2LKRZ type=write size=1930518 2024-09-19T11:43:03.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.890+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~ND74AQQK4659.0 size=537200 2024-09-19T11:43:03.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.890+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=ND74AQQK4659 tag=RD64FT49X13W type=write size=1585776 2024-09-19T11:43:03.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.894+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~2K6UXVV1PX2Z.0 size=1013704 2024-09-19T11:43:03.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.898+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=2K6UXVV1PX2Z tag=TK5RSAN4031D type=write size=2062280 2024-09-19T11:43:03.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.902+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=0N1UR7TCYP2P type=del size=854188 2024-09-19T11:43:03.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.906+0000 7f3d831968c0 1 < suggested update operation key=QPG75T46BH38 tag=A4C6R02T28AZ type=del size=2131186 2024-09-19T11:43:03.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.910+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~Y4HN89A0BEB2.0 size=845406 2024-09-19T11:43:03.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.910+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=Y4HN89A0BEB2 tag=MTMQ4ZVARDU8 type=write size=1893982 2024-09-19T11:43:03.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.914+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=1GUMJNQ4GQJQ type=del 2024-09-19T11:43:03.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.918+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~06TDSVBPH4KJ.0 size=765560 2024-09-19T11:43:03.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.918+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=06TDSVBPH4KJ tag=RNFERB7MUBG8 type=write size=1814136 2024-09-19T11:43:03.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.918+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~5ICLTP2LMDEN.0 size=1048576 2024-09-19T11:43:03.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.922+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~5ICLTP2LMDEN.1 size=1048576 2024-09-19T11:43:03.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.922+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~5ICLTP2LMDEN.2 size=1034658 2024-09-19T11:43:03.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.930+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=5ICLTP2LMDEN tag=I7ZL746IK7F1 type=write size=4180386 2024-09-19T11:43:03.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.934+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~PJNNPOQ0P7JJ.0 size=1048576 2024-09-19T11:43:03.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.934+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~PJNNPOQ0P7JJ.1 size=432491 2024-09-19T11:43:03.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.934+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=PJNNPOQ0P7JJ tag=BUYJ6J9I2PGS type=write size=2529643 2024-09-19T11:43:03.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.938+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=X4NN642QW5PJ type=del 2024-09-19T11:43:03.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.942+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=IF9D9GN1CRQ8 type=write size=377908 2024-09-19T11:43:03.949 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.946+0000 7f3d831968c0 -1 < failed to complete operation key=QPG75T46BH38 tag=2RKTN9S0FBX6 type=del size=3588354: (22) Invalid argument 2024-09-19T11:43:03.952 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.946+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=PPJ42MEPAFPX type=write size=481039 2024-09-19T11:43:03.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.950+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=CVPKPHVKTML1 type=del 2024-09-19T11:43:03.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.958+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~EIYFGMBTQ5S5.0 size=1048576 2024-09-19T11:43:03.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.958+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~EIYFGMBTQ5S5.1 size=1048576 2024-09-19T11:43:03.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.962+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~EIYFGMBTQ5S5.2 size=636652 2024-09-19T11:43:03.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.962+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=EIYFGMBTQ5S5 tag=9O4901BVPZHV type=write size=3782380 2024-09-19T11:43:03.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.966+0000 7f3d831968c0 1 < completed write operation key=900RV3451AON tag=TZ11C2SWXG58 type=write size=140529 2024-09-19T11:43:03.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.966+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=7L9FMFKJQIMH type=del size=1376010 2024-09-19T11:43:03.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.970+0000 7f3d831968c0 1 < canceled operation key=KAPKNZJ2DE6A tag=7VZ1FYPPYBVT type=del size=1154617 2024-09-19T11:43:03.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.974+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=6ZDZ42C3KX4C type=del size=4059373 2024-09-19T11:43:03.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.978+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=1W8F49LHBU46 type=del 2024-09-19T11:43:03.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.978+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=4DF01VJFTLY1 type=del size=3879450 2024-09-19T11:43:03.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.982+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=JXXYHOHA9X03 type=del 2024-09-19T11:43:03.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.990+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~433Y00M5DAJY.0 size=790741 2024-09-19T11:43:03.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.990+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=433Y00M5DAJY tag=XSYAST16ALZZ type=write size=1839317 2024-09-19T11:43:03.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.994+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=25447Q360E9H type=del 2024-09-19T11:43:04.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:03.998+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=OEW113C1QNX7 type=del size=787600 2024-09-19T11:43:04.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.002+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=1FCC15F33HG6 type=del 2024-09-19T11:43:04.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.002+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=0DBNLKQ7ZSIX type=write size=851308 2024-09-19T11:43:04.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.006+0000 7f3d831968c0 -1 < failed to complete operation key=QPG75T46BH38 tag=OEM1TYPPWIP7 type=del size=2956941: (22) Invalid argument 2024-09-19T11:43:04.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.014+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~XLOAV11D4S8B.0 size=1048576 2024-09-19T11:43:04.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.014+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~XLOAV11D4S8B.1 size=1048576 2024-09-19T11:43:04.022 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.018+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~XLOAV11D4S8B.2 size=324579 2024-09-19T11:43:04.022 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.018+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=XLOAV11D4S8B tag=JR1BT0M3DOI8 type=write size=3470307 2024-09-19T11:43:04.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.022+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~G5BLGIA3DNA4.0 size=251837 2024-09-19T11:43:04.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.026+0000 7f3d831968c0 1 < completed multipart upload key=JTPBGWC4T3Y5 upload=G5BLGIA3DNA4 tag=AF60Q0JSRRQX type=write size=1300413 2024-09-19T11:43:04.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.030+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=T11ND5YZTSOK type=del size=3741515 2024-09-19T11:43:04.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.034+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~ND74AQQK4659.0 size=537200 2024-09-19T11:43:04.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.038+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=ND74AQQK4659 tag=RD64FT49X13W type=write size=1585776 2024-09-19T11:43:04.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.042+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=D6HR6GG8ATJK type=del size=2222162 2024-09-19T11:43:04.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.042+0000 7f3d831968c0 1 < canceled operation key=G4P6HIOM1G2E tag=0N1UR7TCYP2P type=del size=854188 2024-09-19T11:43:04.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.050+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~KJZ73QD6TLPD.0 size=871416 2024-09-19T11:43:04.054 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.050+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=KJZ73QD6TLPD tag=TRC1Y8KDIP5A type=write size=1919992 2024-09-19T11:43:04.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.054+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~Y4HN89A0BEB2.0 size=845406 2024-09-19T11:43:04.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.058+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=Y4HN89A0BEB2 tag=MTMQ4ZVARDU8 type=write size=1893982 2024-09-19T11:43:04.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.062+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~G86TVC7IPX6H.0 size=1048576 2024-09-19T11:43:04.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.066+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~G86TVC7IPX6H.1 size=733137 2024-09-19T11:43:04.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.066+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=G86TVC7IPX6H tag=VN2KNACWLHEH type=write size=2830289 2024-09-19T11:43:04.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.070+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~06TDSVBPH4KJ.0 size=765560 2024-09-19T11:43:04.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.074+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=06TDSVBPH4KJ tag=RNFERB7MUBG8 type=write size=1814136 2024-09-19T11:43:04.087 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.082+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~NQX4U6JHAJQD.0 size=1048576 2024-09-19T11:43:04.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.086+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~NQX4U6JHAJQD.1 size=1048576 2024-09-19T11:43:04.092 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.086+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~NQX4U6JHAJQD.2 size=994482 2024-09-19T11:43:04.092 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.086+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=NQX4U6JHAJQD tag=2RLDA6QZAWPJ type=write size=4140210 2024-09-19T11:43:04.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.090+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~PJNNPOQ0P7JJ.0 size=1048576 2024-09-19T11:43:04.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.094+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~PJNNPOQ0P7JJ.1 size=432491 2024-09-19T11:43:04.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.098+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=PJNNPOQ0P7JJ tag=BUYJ6J9I2PGS type=write size=2529643 2024-09-19T11:43:04.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.102+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=1GSGOA88PFNY type=del size=3137710 2024-09-19T11:43:04.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.106+0000 7f3d831968c0 1 < completed write operation key=I5XUMA2HKIR5 tag=IF9D9GN1CRQ8 type=write size=377908 2024-09-19T11:43:04.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.110+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=DWYAWN0UOLM7 type=del size=1574994 2024-09-19T11:43:04.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.110+0000 7f3d831968c0 1 < completed write operation key=66N4QS1R70Z7 tag=PPJ42MEPAFPX type=write size=481039 2024-09-19T11:43:04.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.114+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=ZF42R75OEEO8 type=del size=4011230 2024-09-19T11:43:04.120 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.114+0000 7f3d831968c0 1 < canceled part key=_multipart_FZGRZ06MOHBI.2~EIYFGMBTQ5S5.0 size=1048576 2024-09-19T11:43:04.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.118+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~EIYFGMBTQ5S5.1 size=1048576 2024-09-19T11:43:04.125 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.122+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~EIYFGMBTQ5S5.2 size=636652 2024-09-19T11:43:04.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.126+0000 7f3d831968c0 1 < canceled multipart upload key=FZGRZ06MOHBI upload=EIYFGMBTQ5S5 tag=9O4901BVPZHV type=write size=3782380 2024-09-19T11:43:04.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.130+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~7XE1PXC741MO.0 size=1048576 2024-09-19T11:43:04.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.134+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~7XE1PXC741MO.1 size=1048576 2024-09-19T11:43:04.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.134+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~7XE1PXC741MO.2 size=522433 2024-09-19T11:43:04.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.134+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=7XE1PXC741MO tag=VPZN12UF2ZBL type=write size=3668161 2024-09-19T11:43:04.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.138+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=7L9FMFKJQIMH type=del 2024-09-19T11:43:04.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.142+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~8PVE9W5VJ03D.0 size=87506 2024-09-19T11:43:04.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.142+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=8PVE9W5VJ03D tag=V5JN7Q3GFQ07 type=write size=1136082 2024-09-19T11:43:04.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.146+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=6ZDZ42C3KX4C type=del 2024-09-19T11:43:04.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.150+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=Z73C6ME0FS5A type=del size=375540 2024-09-19T11:43:04.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.154+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=4DF01VJFTLY1 type=del 2024-09-19T11:43:04.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.158+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~YMN1S3GY9VGK.0 size=1048576 2024-09-19T11:43:04.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.162+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~YMN1S3GY9VGK.1 size=755195 2024-09-19T11:43:04.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.162+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=YMN1S3GY9VGK tag=EBSN85IFZU5U type=write size=2852347 2024-09-19T11:43:04.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.162+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~433Y00M5DAJY.0 size=790741 2024-09-19T11:43:04.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.170+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=433Y00M5DAJY tag=XSYAST16ALZZ type=write size=1839317 2024-09-19T11:43:04.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.170+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=056ZEW889EK0 type=del size=3253365 2024-09-19T11:43:04.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.174+0000 7f3d831968c0 1 < canceled operation key=JTPBGWC4T3Y5 tag=OEW113C1QNX7 type=del size=787600 2024-09-19T11:43:04.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.182+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~IXHFO6FZVCC5.0 size=1048576 2024-09-19T11:43:04.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.182+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~IXHFO6FZVCC5.1 size=1048576 2024-09-19T11:43:04.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.186+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~IXHFO6FZVCC5.2 size=29748 2024-09-19T11:43:04.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.186+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=IXHFO6FZVCC5 tag=0L3WH1IL9LA4 type=write size=3175476 2024-09-19T11:43:04.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.190+0000 7f3d831968c0 1 < completed write operation key=PB62JE7I55GG tag=0DBNLKQ7ZSIX type=write size=851308 2024-09-19T11:43:04.197 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.194+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=6OQHKQ5ZEQJ8 type=del size=273214 2024-09-19T11:43:04.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.198+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~XLOAV11D4S8B.0 size=1048576 2024-09-19T11:43:04.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.202+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~XLOAV11D4S8B.1 size=1048576 2024-09-19T11:43:04.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.202+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~XLOAV11D4S8B.2 size=324579 2024-09-19T11:43:04.214 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.210+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=XLOAV11D4S8B tag=JR1BT0M3DOI8 type=write size=3470307 2024-09-19T11:43:04.217 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.214+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=SIA4DBV1KN58 type=del size=4035631 2024-09-19T11:43:04.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.218+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=T11ND5YZTSOK type=del 2024-09-19T11:43:04.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.218+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=YJIA3MJ749JF type=write size=139107 2024-09-19T11:43:04.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.222+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=D6HR6GG8ATJK type=del 2024-09-19T11:43:04.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.226+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~VG9MHB78QHST.0 size=1048576 2024-09-19T11:43:04.234 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.230+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~VG9MHB78QHST.1 size=229945 2024-09-19T11:43:04.234 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.230+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=VG9MHB78QHST tag=DFEYFNBN5FA7 type=write size=2327097 2024-09-19T11:43:04.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.234+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~KJZ73QD6TLPD.0 size=871416 2024-09-19T11:43:04.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.238+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=KJZ73QD6TLPD tag=TRC1Y8KDIP5A type=write size=1919992 2024-09-19T11:43:04.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.242+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~X2S17K8CYZML.0 size=194181 2024-09-19T11:43:04.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.242+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=X2S17K8CYZML tag=Z2P2BZRGQ48Y type=write size=1242757 2024-09-19T11:43:04.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.246+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~G86TVC7IPX6H.0 size=1048576 2024-09-19T11:43:04.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.246+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~G86TVC7IPX6H.1 size=733137 2024-09-19T11:43:04.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.250+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=G86TVC7IPX6H tag=VN2KNACWLHEH type=write size=2830289 2024-09-19T11:43:04.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.254+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=CTOICOENC01C type=del size=3862909 2024-09-19T11:43:04.262 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.258+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~NQX4U6JHAJQD.0 size=1048576 2024-09-19T11:43:04.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.262+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~NQX4U6JHAJQD.1 size=1048576 2024-09-19T11:43:04.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.262+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~NQX4U6JHAJQD.2 size=994482 2024-09-19T11:43:04.272 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.266+0000 7f3d831968c0 1 < completed multipart upload key=5RTONAWGYJNE upload=NQX4U6JHAJQD tag=2RLDA6QZAWPJ type=write size=4140210 2024-09-19T11:43:04.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.270+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=ZFB6JHD8C51S type=del size=3297932 2024-09-19T11:43:04.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.274+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=1GSGOA88PFNY type=del 2024-09-19T11:43:04.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.278+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=1MD8HWGEQFGZ type=del size=1814649 2024-09-19T11:43:04.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.282+0000 7f3d831968c0 1 < suggested remove operation key=8FGIZJIY58C7 tag=DWYAWN0UOLM7 type=del 2024-09-19T11:43:04.292 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.286+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~4R3HZX4VUSXT.0 size=1048576 2024-09-19T11:43:04.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.290+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~4R3HZX4VUSXT.1 size=504704 2024-09-19T11:43:04.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.290+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=4R3HZX4VUSXT tag=UWARCLUVOVU8 type=write size=2601856 2024-09-19T11:43:04.298 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.294+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=ZF42R75OEEO8 type=del 2024-09-19T11:43:04.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.298+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=TKW2590U96ED type=del size=3084697 2024-09-19T11:43:04.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.298+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~7XE1PXC741MO.0 size=1048576 2024-09-19T11:43:04.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.302+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~7XE1PXC741MO.1 size=1048576 2024-09-19T11:43:04.309 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.306+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~7XE1PXC741MO.2 size=522433 2024-09-19T11:43:04.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.310+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=7XE1PXC741MO tag=VPZN12UF2ZBL type=write size=3668161 2024-09-19T11:43:04.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.314+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~HWZNZFLXACLP.0 size=32315 2024-09-19T11:43:04.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.314+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=HWZNZFLXACLP tag=1JO3OL7XW8NG type=write size=1080891 2024-09-19T11:43:04.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.318+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~8PVE9W5VJ03D.0 size=87506 2024-09-19T11:43:04.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.322+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=8PVE9W5VJ03D tag=V5JN7Q3GFQ07 type=write size=1136082 2024-09-19T11:43:04.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.326+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~5OSXTW21T7E0.0 size=1048576 2024-09-19T11:43:04.334 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.330+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~5OSXTW21T7E0.1 size=207695 2024-09-19T11:43:04.334 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.330+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=5OSXTW21T7E0 tag=Y24J9H3DZHA5 type=write size=2304847 2024-09-19T11:43:04.337 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.334+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=Z73C6ME0FS5A type=del 2024-09-19T11:43:04.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.338+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~6D9J1BGWW5V8.0 size=358000 2024-09-19T11:43:04.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.338+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=6D9J1BGWW5V8 tag=YJHSXUY5FHHU type=write size=1406576 2024-09-19T11:43:04.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.342+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~YMN1S3GY9VGK.0 size=1048576 2024-09-19T11:43:04.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.342+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~YMN1S3GY9VGK.1 size=755195 2024-09-19T11:43:04.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.346+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=YMN1S3GY9VGK tag=EBSN85IFZU5U type=write size=2852347 2024-09-19T11:43:04.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.350+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=ZBPBB1376F00 type=del size=4174107 2024-09-19T11:43:04.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.354+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=056ZEW889EK0 type=del 2024-09-19T11:43:04.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.354+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=1DN8BZTSWQ0Z type=del size=2570983 2024-09-19T11:43:04.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.358+0000 7f3d831968c0 1 < canceled part key=_multipart_FKLL38ZNCJ21.2~IXHFO6FZVCC5.0 size=1048576 2024-09-19T11:43:04.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.362+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~IXHFO6FZVCC5.1 size=1048576 2024-09-19T11:43:04.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.362+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~IXHFO6FZVCC5.2 size=29748 2024-09-19T11:43:04.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.366+0000 7f3d831968c0 1 < canceled multipart upload key=FKLL38ZNCJ21 upload=IXHFO6FZVCC5 tag=0L3WH1IL9LA4 type=write size=3175476 2024-09-19T11:43:04.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.374+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~1I3AFIJUAIUP.0 size=973500 2024-09-19T11:43:04.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.374+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=1I3AFIJUAIUP tag=KBWYJ978TH0O type=write size=2022076 2024-09-19T11:43:04.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.374+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=6OQHKQ5ZEQJ8 type=del 2024-09-19T11:43:04.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.378+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=1VEBVOIWVKF2 type=del size=2247592 2024-09-19T11:43:04.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.382+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=SIA4DBV1KN58 type=del 2024-09-19T11:43:04.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.386+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~C1U3RH37G6WL.0 size=735588 2024-09-19T11:43:04.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.386+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=C1U3RH37G6WL tag=MC9TOVQL67HU type=write size=1784164 2024-09-19T11:43:04.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.390+0000 7f3d831968c0 1 < completed write operation key=EVFF0F0760OS tag=YJIA3MJ749JF type=write size=139107 2024-09-19T11:43:04.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.394+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=380NT20H4TVT type=del size=2212827 2024-09-19T11:43:04.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.394+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~VG9MHB78QHST.0 size=1048576 2024-09-19T11:43:04.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.394+0000 7f3d831968c0 1 < canceled part key=_multipart_3K8P37C015G3.2~VG9MHB78QHST.1 size=229945 2024-09-19T11:43:04.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.402+0000 7f3d831968c0 1 < canceled multipart upload key=3K8P37C015G3 upload=VG9MHB78QHST tag=DFEYFNBN5FA7 type=write size=2327097 2024-09-19T11:43:04.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.402+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=BVVETIFZD1SH type=del size=4043541 2024-09-19T11:43:04.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.406+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~X2S17K8CYZML.0 size=194181 2024-09-19T11:43:04.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.410+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=X2S17K8CYZML tag=Z2P2BZRGQ48Y type=write size=1242757 2024-09-19T11:43:04.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.414+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=IB7AFONHXMCF type=del size=3293238 2024-09-19T11:43:04.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.418+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=CTOICOENC01C type=del 2024-09-19T11:43:04.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.418+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=1IP3T3C1LKKP type=del size=407857 2024-09-19T11:43:04.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.426+0000 7f3d831968c0 1 < suggested update operation key=76JFMPOUJZXW tag=ZFB6JHD8C51S type=del size=3297932 2024-09-19T11:43:04.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.430+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~1IY7W1JDIXX9.0 size=256090 2024-09-19T11:43:04.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.430+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=1IY7W1JDIXX9 tag=UUUY8YYGZQTP type=write size=1304666 2024-09-19T11:43:04.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.434+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=1MD8HWGEQFGZ type=del 2024-09-19T11:43:04.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.438+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~L2VFC2O75MKC.0 size=1048576 2024-09-19T11:43:04.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.442+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~L2VFC2O75MKC.1 size=1048576 2024-09-19T11:43:04.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.442+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~L2VFC2O75MKC.2 size=497201 2024-09-19T11:43:04.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.442+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=L2VFC2O75MKC tag=55TXSZOF0SWP type=write size=3642929 2024-09-19T11:43:04.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.442+0000 7f3d831968c0 1 < canceled part key=_multipart_0OOB2SNLVK8E.2~4R3HZX4VUSXT.0 size=1048576 2024-09-19T11:43:04.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.446+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~4R3HZX4VUSXT.1 size=504704 2024-09-19T11:43:04.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.450+0000 7f3d831968c0 1 < canceled multipart upload key=0OOB2SNLVK8E upload=4R3HZX4VUSXT tag=UWARCLUVOVU8 type=write size=2601856 2024-09-19T11:43:04.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.454+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=TT6JSP4X78MX type=del size=4152827 2024-09-19T11:43:04.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.462+0000 7f3d831968c0 1 < suggested remove operation key=QPG75T46BH38 tag=TKW2590U96ED type=del 2024-09-19T11:43:04.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.462+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=UHNVAKL8R28P type=del size=1149459 2024-09-19T11:43:04.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.466+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~HWZNZFLXACLP.0 size=32315 2024-09-19T11:43:04.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.470+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=HWZNZFLXACLP tag=1JO3OL7XW8NG type=write size=1080891 2024-09-19T11:43:04.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.478+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~EB2B2GO6MFYZ.0 size=589508 2024-09-19T11:43:04.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.478+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=EB2B2GO6MFYZ tag=HV7ID2NQ2X45 type=write size=1638084 2024-09-19T11:43:04.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.482+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~5OSXTW21T7E0.0 size=1048576 2024-09-19T11:43:04.487 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.482+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~5OSXTW21T7E0.1 size=207695 2024-09-19T11:43:04.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.486+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=5OSXTW21T7E0 tag=Y24J9H3DZHA5 type=write size=2304847 2024-09-19T11:43:04.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.494+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~5SQLIQ8O3LC2.0 size=1048576 2024-09-19T11:43:04.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.494+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~5SQLIQ8O3LC2.1 size=38032 2024-09-19T11:43:04.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.494+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=5SQLIQ8O3LC2 tag=XALCWC3TVU3R type=write size=2135184 2024-09-19T11:43:04.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.498+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~6D9J1BGWW5V8.0 size=358000 2024-09-19T11:43:04.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.506+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=6D9J1BGWW5V8 tag=YJHSXUY5FHHU type=write size=1406576 2024-09-19T11:43:04.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.510+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=Z26D7HK2EBFQ type=del size=2724264 2024-09-19T11:43:04.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.514+0000 7f3d831968c0 1 < canceled operation key=224HPC2Y95N6 tag=ZBPBB1376F00 type=del size=4174107 2024-09-19T11:43:04.520 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.514+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=CU6U8M9CCISP type=del size=145 2024-09-19T11:43:04.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.518+0000 7f3d831968c0 -1 < failed to complete operation key=76JFMPOUJZXW tag=1DN8BZTSWQ0Z type=del size=2570983: (22) Invalid argument 2024-09-19T11:43:04.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.522+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=O1KAP5J542RE type=del size=834882 2024-09-19T11:43:04.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.526+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~1I3AFIJUAIUP.0 size=973500 2024-09-19T11:43:04.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.530+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=1I3AFIJUAIUP tag=KBWYJ978TH0O type=write size=2022076 2024-09-19T11:43:04.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.534+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=MA4HH7WLVB23 type=del size=239754 2024-09-19T11:43:04.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.538+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=1VEBVOIWVKF2 type=del 2024-09-19T11:43:04.545 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.542+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=FP8OYHYR3RDF type=del size=4167047 2024-09-19T11:43:04.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.546+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~C1U3RH37G6WL.0 size=735588 2024-09-19T11:43:04.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.550+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=C1U3RH37G6WL tag=MC9TOVQL67HU type=write size=1784164 2024-09-19T11:43:04.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.554+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=RARF29A0MZOY type=write size=493098 2024-09-19T11:43:04.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.558+0000 7f3d831968c0 1 < canceled operation key=UI7EVZ1SGD8R tag=380NT20H4TVT type=del size=2212827 2024-09-19T11:43:04.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.562+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=ZRQ0KG4QAOF3 type=write size=529739 2024-09-19T11:43:04.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.566+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=BVVETIFZD1SH type=del 2024-09-19T11:43:04.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.570+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~LZ8ZABOV0K4N.0 size=1048576 2024-09-19T11:43:04.578 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.574+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~LZ8ZABOV0K4N.1 size=113586 2024-09-19T11:43:04.578 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.574+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=LZ8ZABOV0K4N tag=F934MCKY5I2B type=write size=2210738 2024-09-19T11:43:04.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.578+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=IB7AFONHXMCF type=del 2024-09-19T11:43:04.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.582+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=WZELT27X12HD type=del size=1999393 2024-09-19T11:43:04.592 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.590+0000 7f3d831968c0 1 < suggested update operation key=8FGIZJIY58C7 tag=1IP3T3C1LKKP type=del size=407857 2024-09-19T11:43:04.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.590+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=NEFLCJ71R68K type=del size=1287128 2024-09-19T11:43:04.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.594+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~1IY7W1JDIXX9.0 size=256090 2024-09-19T11:43:04.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.602+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=1IY7W1JDIXX9 tag=UUUY8YYGZQTP type=write size=1304666 2024-09-19T11:43:04.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.602+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=VGZBYR2DZEMZ type=del size=2472886 2024-09-19T11:43:04.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.606+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~L2VFC2O75MKC.0 size=1048576 2024-09-19T11:43:04.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.610+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~L2VFC2O75MKC.1 size=1048576 2024-09-19T11:43:04.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.614+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~L2VFC2O75MKC.2 size=497201 2024-09-19T11:43:04.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.618+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=L2VFC2O75MKC tag=55TXSZOF0SWP type=write size=3642929 2024-09-19T11:43:04.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.622+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=HMKJT86O6IL5 type=del size=1259586 2024-09-19T11:43:04.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.626+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=TT6JSP4X78MX type=del 2024-09-19T11:43:04.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.630+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=TCK0TX3CSLGR type=del size=1482480 2024-09-19T11:43:04.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.634+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=UHNVAKL8R28P type=del 2024-09-19T11:43:04.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.634+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=UZYIU0GLJ3J3 type=del size=3853360 2024-09-19T11:43:04.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.638+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~EB2B2GO6MFYZ.0 size=589508 2024-09-19T11:43:04.647 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.642+0000 7f3d831968c0 1 < completed multipart upload key=LINLTWYV88VU upload=EB2B2GO6MFYZ tag=HV7ID2NQ2X45 type=write size=1638084 2024-09-19T11:43:04.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.646+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=F11OREKNBEZ6 type=del size=1959647 2024-09-19T11:43:04.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.650+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~5SQLIQ8O3LC2.0 size=1048576 2024-09-19T11:43:04.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.650+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~5SQLIQ8O3LC2.1 size=38032 2024-09-19T11:43:04.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.658+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=5SQLIQ8O3LC2 tag=XALCWC3TVU3R type=write size=2135184 2024-09-19T11:43:04.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.662+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~J9DS18AH0V4N.0 size=1048576 2024-09-19T11:43:04.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.666+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~J9DS18AH0V4N.1 size=542309 2024-09-19T11:43:04.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.666+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=J9DS18AH0V4N tag=8PFDJONNLPLI type=write size=2639461 2024-09-19T11:43:04.673 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.670+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=Z26D7HK2EBFQ type=del 2024-09-19T11:43:04.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.674+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~CM4QS2V6T9BK.0 size=1048576 2024-09-19T11:43:04.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.678+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~CM4QS2V6T9BK.1 size=1048576 2024-09-19T11:43:04.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.678+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~CM4QS2V6T9BK.2 size=902297 2024-09-19T11:43:04.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.678+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=CM4QS2V6T9BK tag=KQTIPQO2QUN2 type=write size=4048025 2024-09-19T11:43:04.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.686+0000 7f3d831968c0 1 < suggested update operation key=JV7EGEI6062Y tag=CU6U8M9CCISP type=del size=145 2024-09-19T11:43:04.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.690+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~XCCD63DM1952.0 size=451954 2024-09-19T11:43:04.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.690+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=XCCD63DM1952 tag=LNFP7I5GYN9N type=write size=1500530 2024-09-19T11:43:04.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.694+0000 7f3d831968c0 1 < canceled operation key=JTPBGWC4T3Y5 tag=O1KAP5J542RE type=del size=834882 2024-09-19T11:43:04.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.698+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=X0UM6BMCB07Q type=del size=2346850 2024-09-19T11:43:04.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.698+0000 7f3d831968c0 1 < completed delete operation key=3QWBQYLI0SJR tag=MA4HH7WLVB23 type=del 2024-09-19T11:43:04.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.702+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=YB6DA28403A6 type=del size=2489426 2024-09-19T11:43:04.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.706+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=FP8OYHYR3RDF type=del 2024-09-19T11:43:04.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.714+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~TKW8XCQ4GFRO.0 size=1048576 2024-09-19T11:43:04.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.714+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~TKW8XCQ4GFRO.1 size=1048576 2024-09-19T11:43:04.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.718+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~TKW8XCQ4GFRO.2 size=907700 2024-09-19T11:43:04.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.718+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=TKW8XCQ4GFRO tag=WMNSV7TFV2ZK type=write size=4053428 2024-09-19T11:43:04.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.722+0000 7f3d831968c0 1 < completed write operation key=2VJRZVU7S8LB tag=RARF29A0MZOY type=write size=493098 2024-09-19T11:43:04.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.726+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=0GTGG9R84GME type=del size=957210 2024-09-19T11:43:04.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.730+0000 7f3d831968c0 1 < suggested update operation key=900RV3451AON tag=ZRQ0KG4QAOF3 type=write size=529739 2024-09-19T11:43:04.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.734+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=WPI3HOGGKFSC type=del size=241296 2024-09-19T11:43:04.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.734+0000 7f3d831968c0 1 < canceled part key=_multipart_E8OFSMUZHR02.2~LZ8ZABOV0K4N.0 size=1048576 2024-09-19T11:43:04.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.734+0000 7f3d831968c0 1 < canceled part key=_multipart_E8OFSMUZHR02.2~LZ8ZABOV0K4N.1 size=113586 2024-09-19T11:43:04.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.738+0000 7f3d831968c0 1 < canceled multipart upload key=E8OFSMUZHR02 upload=LZ8ZABOV0K4N tag=F934MCKY5I2B type=write size=2210738 2024-09-19T11:43:04.744 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.742+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=RNC2BMMDRQ6S type=del size=1395953 2024-09-19T11:43:04.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.742+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=WZELT27X12HD type=del 2024-09-19T11:43:04.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.746+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=M7I4U05CY6J3 type=del size=2943440 2024-09-19T11:43:04.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.750+0000 7f3d831968c0 -1 < failed to complete operation key=900RV3451AON tag=NEFLCJ71R68K type=del size=1287128: (22) Invalid argument 2024-09-19T11:43:04.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.750+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=MJZ6CKEZ2Q8L type=del size=2512189 2024-09-19T11:43:04.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.754+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=VGZBYR2DZEMZ type=del 2024-09-19T11:43:04.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.758+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=91QG9MU7POS4 type=write size=86348 2024-09-19T11:43:04.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.758+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=HMKJT86O6IL5 type=del 2024-09-19T11:43:04.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.762+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=JOZ8NXV6CV5V type=del size=2170844 2024-09-19T11:43:04.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.766+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=TCK0TX3CSLGR type=del 2024-09-19T11:43:04.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.766+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=R9TUX9WTL4W4 type=del size=2310701 2024-09-19T11:43:04.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.774+0000 7f3d831968c0 1 < suggested update operation key=8FGIZJIY58C7 tag=UZYIU0GLJ3J3 type=del size=3853360 2024-09-19T11:43:04.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.782+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~8QW1HK8VJPJ2.0 size=978683 2024-09-19T11:43:04.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.782+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=8QW1HK8VJPJ2 tag=17MWFR68O57S type=write size=2027259 2024-09-19T11:43:04.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.782+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=F11OREKNBEZ6 type=del 2024-09-19T11:43:04.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.790+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~6KDWTETE79PD.0 size=827010 2024-09-19T11:43:04.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.790+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=6KDWTETE79PD tag=BCHV73MK08I4 type=write size=1875586 2024-09-19T11:43:04.796 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.794+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~J9DS18AH0V4N.0 size=1048576 2024-09-19T11:43:04.796 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.794+0000 7f3d831968c0 1 < canceled part key=_multipart_76JFMPOUJZXW.2~J9DS18AH0V4N.1 size=542309 2024-09-19T11:43:04.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.798+0000 7f3d831968c0 1 < canceled multipart upload key=76JFMPOUJZXW upload=J9DS18AH0V4N tag=8PFDJONNLPLI type=write size=2639461 2024-09-19T11:43:04.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.802+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=RDNDZY92AGIG type=del size=2997056 2024-09-19T11:43:04.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.802+0000 7f3d831968c0 1 < canceled part key=_multipart_E8OFSMUZHR02.2~CM4QS2V6T9BK.0 size=1048576 2024-09-19T11:43:04.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.802+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~CM4QS2V6T9BK.1 size=1048576 2024-09-19T11:43:04.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.806+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~CM4QS2V6T9BK.2 size=902297 2024-09-19T11:43:04.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.810+0000 7f3d831968c0 1 < canceled multipart upload key=E8OFSMUZHR02 upload=CM4QS2V6T9BK tag=KQTIPQO2QUN2 type=write size=4048025 2024-09-19T11:43:04.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.818+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~K1FI08JCGONH.0 size=1048576 2024-09-19T11:43:04.824 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.818+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~K1FI08JCGONH.1 size=1048576 2024-09-19T11:43:04.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.822+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~K1FI08JCGONH.2 size=693348 2024-09-19T11:43:04.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.822+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=K1FI08JCGONH tag=I5NR16WBSD4R type=write size=3839076 2024-09-19T11:43:04.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.826+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~XCCD63DM1952.0 size=451954 2024-09-19T11:43:04.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.830+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=XCCD63DM1952 tag=LNFP7I5GYN9N type=write size=1500530 2024-09-19T11:43:04.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.834+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=LNYLLKTOXXNS type=del size=3513013 2024-09-19T11:43:04.840 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.834+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=X0UM6BMCB07Q type=del 2024-09-19T11:43:04.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.838+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=X2UM5NP3O1BW type=del size=1852291 2024-09-19T11:43:04.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.842+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=YB6DA28403A6 type=del 2024-09-19T11:43:04.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.842+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=O7ODMYENWJTQ type=write size=618453 2024-09-19T11:43:04.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.846+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~TKW8XCQ4GFRO.0 size=1048576 2024-09-19T11:43:04.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.850+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~TKW8XCQ4GFRO.1 size=1048576 2024-09-19T11:43:04.855 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.850+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~TKW8XCQ4GFRO.2 size=907700 2024-09-19T11:43:04.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.858+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=TKW8XCQ4GFRO tag=WMNSV7TFV2ZK type=write size=4053428 2024-09-19T11:43:04.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.858+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=C557UTKLURNS type=del size=1270958 2024-09-19T11:43:04.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.862+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=0GTGG9R84GME type=del 2024-09-19T11:43:04.868 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.866+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=UERIS2IZTPYH type=del size=3219265 2024-09-19T11:43:04.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.866+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=WPI3HOGGKFSC type=del 2024-09-19T11:43:04.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.870+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=WMX82SCQUPYK type=del size=3905272 2024-09-19T11:43:04.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.874+0000 7f3d831968c0 1 < suggested remove operation key=I5XUMA2HKIR5 tag=RNC2BMMDRQ6S type=del 2024-09-19T11:43:04.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.878+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=K01EADD6AD7R type=del size=3587986 2024-09-19T11:43:04.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.882+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=M7I4U05CY6J3 type=del 2024-09-19T11:43:04.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.882+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=FTWRGWBYS83Y type=del size=277278 2024-09-19T11:43:04.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.886+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=MJZ6CKEZ2Q8L type=del 2024-09-19T11:43:04.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.890+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~3F06NM0S7NPN.0 size=1048576 2024-09-19T11:43:04.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.894+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~3F06NM0S7NPN.1 size=1048576 2024-09-19T11:43:04.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.894+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~3F06NM0S7NPN.2 size=297016 2024-09-19T11:43:04.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.894+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=3F06NM0S7NPN tag=0M4YGG3VBDIJ type=write size=3442744 2024-09-19T11:43:04.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.898+0000 7f3d831968c0 1 < completed write operation key=QPG75T46BH38 tag=91QG9MU7POS4 type=write size=86348 2024-09-19T11:43:04.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.902+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=XNMBAZDG04XR type=write size=416712 2024-09-19T11:43:04.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.906+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=JOZ8NXV6CV5V type=del 2024-09-19T11:43:04.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.910+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~FATHZTJHWXOB.0 size=1048576 2024-09-19T11:43:04.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.914+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~FATHZTJHWXOB.1 size=1048576 2024-09-19T11:43:04.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.914+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~FATHZTJHWXOB.2 size=393954 2024-09-19T11:43:04.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.914+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=FATHZTJHWXOB tag=LOGHNKU64YK0 type=write size=3539682 2024-09-19T11:43:04.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.918+0000 7f3d831968c0 1 < suggested update operation key=4V17CRW6EB65 tag=R9TUX9WTL4W4 type=del size=2310701 2024-09-19T11:43:04.927 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.922+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=17A3NNS17L5J type=write size=67687 2024-09-19T11:43:04.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.926+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~8QW1HK8VJPJ2.0 size=978683 2024-09-19T11:43:04.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.934+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=8QW1HK8VJPJ2 tag=17MWFR68O57S type=write size=2027259 2024-09-19T11:43:04.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.934+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=XKOONXLLPIN5 type=del size=577913 2024-09-19T11:43:04.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.938+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~6KDWTETE79PD.0 size=827010 2024-09-19T11:43:04.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.942+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=6KDWTETE79PD tag=BCHV73MK08I4 type=write size=1875586 2024-09-19T11:43:04.949 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.946+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=Q97V70ZDIEM4 type=del size=4188281 2024-09-19T11:43:04.952 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.946+0000 7f3d831968c0 1 < canceled operation key=JV7EGEI6062Y tag=RDNDZY92AGIG type=del size=2997056 2024-09-19T11:43:04.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.950+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=R9VGSTWBXFRY type=del size=3312433 2024-09-19T11:43:04.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.954+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~K1FI08JCGONH.0 size=1048576 2024-09-19T11:43:04.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.954+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~K1FI08JCGONH.1 size=1048576 2024-09-19T11:43:04.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.958+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~K1FI08JCGONH.2 size=693348 2024-09-19T11:43:04.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.962+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=K1FI08JCGONH tag=I5NR16WBSD4R type=write size=3839076 2024-09-19T11:43:04.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.966+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~9A3PWW5O37ND.0 size=1048576 2024-09-19T11:43:04.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.966+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~9A3PWW5O37ND.1 size=1048576 2024-09-19T11:43:04.976 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.970+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~9A3PWW5O37ND.2 size=284318 2024-09-19T11:43:04.976 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.970+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=9A3PWW5O37ND tag=8CWSJJZKFFXN type=write size=3430046 2024-09-19T11:43:04.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.974+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=LNYLLKTOXXNS type=del 2024-09-19T11:43:04.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.978+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=2SQE97MZPTFE type=del size=2576690 2024-09-19T11:43:04.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.978+0000 7f3d831968c0 1 < completed delete operation key=3QWBQYLI0SJR tag=X2UM5NP3O1BW type=del 2024-09-19T11:43:04.988 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.986+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~M0NCJAS5V4AA.0 size=1048576 2024-09-19T11:43:04.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.986+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~M0NCJAS5V4AA.1 size=1048576 2024-09-19T11:43:04.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.990+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~M0NCJAS5V4AA.2 size=617011 2024-09-19T11:43:04.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.990+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=M0NCJAS5V4AA tag=7YXAXGIJDF5J type=write size=3762739 2024-09-19T11:43:04.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:04.994+0000 7f3d831968c0 1 < suggested remove operation key=4I8BY4YYTRT0 tag=O7ODMYENWJTQ type=write 2024-09-19T11:43:05.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.002+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~RYQA3C7NO60J.0 size=1048576 2024-09-19T11:43:05.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.002+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~RYQA3C7NO60J.1 size=462912 2024-09-19T11:43:05.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.002+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=RYQA3C7NO60J tag=C8Q437S7H0AN type=write size=2560064 2024-09-19T11:43:05.010 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.006+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=C557UTKLURNS type=del 2024-09-19T11:43:05.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.010+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~XIWU5ZI3WLOE.0 size=1048576 2024-09-19T11:43:05.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.014+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~XIWU5ZI3WLOE.1 size=1048576 2024-09-19T11:43:05.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.018+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~XIWU5ZI3WLOE.2 size=233819 2024-09-19T11:43:05.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.018+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=XIWU5ZI3WLOE tag=NYFGDKYEKDLV type=write size=3379547 2024-09-19T11:43:05.023 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.018+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=UERIS2IZTPYH type=del 2024-09-19T11:43:05.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.026+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~5VNIYVF5KY9I.0 size=420351 2024-09-19T11:43:05.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.026+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=5VNIYVF5KY9I tag=P5XD4NNGXVGF type=write size=1468927 2024-09-19T11:43:05.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.030+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=WMX82SCQUPYK type=del 2024-09-19T11:43:05.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.030+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=061CO1HUPUJZ type=write size=881102 2024-09-19T11:43:05.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.034+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=K01EADD6AD7R type=del 2024-09-19T11:43:05.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.042+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~FGIRUPJ75S2A.0 size=1048576 2024-09-19T11:43:05.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.042+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~FGIRUPJ75S2A.1 size=154632 2024-09-19T11:43:05.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.042+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=FGIRUPJ75S2A tag=D2JBW4P3MD61 type=write size=2251784 2024-09-19T11:43:05.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.046+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=FTWRGWBYS83Y type=del 2024-09-19T11:43:05.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.054+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~ZA119H27DX9R.0 size=1048576 2024-09-19T11:43:05.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.058+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~ZA119H27DX9R.1 size=1048576 2024-09-19T11:43:05.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.062+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~ZA119H27DX9R.2 size=551404 2024-09-19T11:43:05.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.062+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=ZA119H27DX9R tag=L5MF2UJ52R4Q type=write size=3697132 2024-09-19T11:43:05.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.062+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~3F06NM0S7NPN.0 size=1048576 2024-09-19T11:43:05.071 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.066+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~3F06NM0S7NPN.1 size=1048576 2024-09-19T11:43:05.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.070+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~3F06NM0S7NPN.2 size=297016 2024-09-19T11:43:05.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.074+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=3F06NM0S7NPN tag=0M4YGG3VBDIJ type=write size=3442744 2024-09-19T11:43:05.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.078+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=X1RKJZN01D0Q type=del size=466981 2024-09-19T11:43:05.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.082+0000 7f3d831968c0 1 < completed write operation key=QPG75T46BH38 tag=XNMBAZDG04XR type=write size=416712 2024-09-19T11:43:05.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.086+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=TT78IBPQRD7E type=del size=4108974 2024-09-19T11:43:05.092 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.090+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~FATHZTJHWXOB.0 size=1048576 2024-09-19T11:43:05.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.090+0000 7f3d831968c0 1 < canceled part key=_multipart_FKLL38ZNCJ21.2~FATHZTJHWXOB.1 size=1048576 2024-09-19T11:43:05.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.090+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~FATHZTJHWXOB.2 size=393954 2024-09-19T11:43:05.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.094+0000 7f3d831968c0 1 < canceled multipart upload key=FKLL38ZNCJ21 upload=FATHZTJHWXOB tag=LOGHNKU64YK0 type=write size=3539682 2024-09-19T11:43:05.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.098+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=D1UF8W3UB05P type=del size=4057192 2024-09-19T11:43:05.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.102+0000 7f3d831968c0 1 < completed write operation key=66N4QS1R70Z7 tag=17A3NNS17L5J type=write size=67687 2024-09-19T11:43:05.110 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.106+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=WLBZY0YWBEE1 type=del size=3399045 2024-09-19T11:43:05.112 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.110+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=XKOONXLLPIN5 type=del 2024-09-19T11:43:05.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.110+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=IRXDLYTVD03A type=del size=3410637 2024-09-19T11:43:05.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.114+0000 7f3d831968c0 1 < canceled operation key=PB62JE7I55GG tag=Q97V70ZDIEM4 type=del size=4188281 2024-09-19T11:43:05.123 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.118+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~WV01CCCYLDI9.0 size=1048576 2024-09-19T11:43:05.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.122+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~WV01CCCYLDI9.1 size=1048576 2024-09-19T11:43:05.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.122+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~WV01CCCYLDI9.2 size=1037466 2024-09-19T11:43:05.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.122+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=WV01CCCYLDI9 tag=3MW42JNT3OTN type=write size=4183194 2024-09-19T11:43:05.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.126+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=R9VGSTWBXFRY type=del 2024-09-19T11:43:05.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.130+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=BYJ9MGDV1QMA type=del size=4061929 2024-09-19T11:43:05.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.130+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~9A3PWW5O37ND.0 size=1048576 2024-09-19T11:43:05.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.134+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~9A3PWW5O37ND.1 size=1048576 2024-09-19T11:43:05.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.138+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~9A3PWW5O37ND.2 size=284318 2024-09-19T11:43:05.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.142+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=9A3PWW5O37ND tag=8CWSJJZKFFXN type=write size=3430046 2024-09-19T11:43:05.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.146+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=ZIWPT6IB7COQ type=del size=3946549 2024-09-19T11:43:05.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.146+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=2SQE97MZPTFE type=del 2024-09-19T11:43:05.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.150+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=OQ0M1LZNMJXB type=write size=800745 2024-09-19T11:43:05.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.154+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~M0NCJAS5V4AA.0 size=1048576 2024-09-19T11:43:05.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.154+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~M0NCJAS5V4AA.1 size=1048576 2024-09-19T11:43:05.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.158+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~M0NCJAS5V4AA.2 size=617011 2024-09-19T11:43:05.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.162+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=M0NCJAS5V4AA tag=7YXAXGIJDF5J type=write size=3762739 2024-09-19T11:43:05.169 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.166+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=B5A0YDBOBZC4 type=del size=3190370 2024-09-19T11:43:05.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.170+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~RYQA3C7NO60J.0 size=1048576 2024-09-19T11:43:05.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.170+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~RYQA3C7NO60J.1 size=462912 2024-09-19T11:43:05.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.178+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=RYQA3C7NO60J tag=C8Q437S7H0AN type=write size=2560064 2024-09-19T11:43:05.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.178+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=5JUP8HW765OH type=del size=3232338 2024-09-19T11:43:05.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.182+0000 7f3d831968c0 1 < canceled part key=_multipart_5RTONAWGYJNE.2~XIWU5ZI3WLOE.0 size=1048576 2024-09-19T11:43:05.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.182+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~XIWU5ZI3WLOE.1 size=1048576 2024-09-19T11:43:05.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.186+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~XIWU5ZI3WLOE.2 size=233819 2024-09-19T11:43:05.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.190+0000 7f3d831968c0 1 < canceled multipart upload key=5RTONAWGYJNE upload=XIWU5ZI3WLOE tag=NYFGDKYEKDLV type=write size=3379547 2024-09-19T11:43:05.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.194+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~BG6S2ZUNTD0N.0 size=898767 2024-09-19T11:43:05.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.194+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=BG6S2ZUNTD0N tag=F5518WS1K8I9 type=write size=1947343 2024-09-19T11:43:05.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.198+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~5VNIYVF5KY9I.0 size=420351 2024-09-19T11:43:05.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.202+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=5VNIYVF5KY9I tag=P5XD4NNGXVGF type=write size=1468927 2024-09-19T11:43:05.214 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.210+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=LVQZ3K186NOP type=del size=2218721 2024-09-19T11:43:05.223 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.218+0000 7f3d831968c0 1 < suggested remove operation key=E8OFSMUZHR02 tag=061CO1HUPUJZ type=write 2024-09-19T11:43:05.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.222+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=2L6O3LKODB5O type=del size=3370648 2024-09-19T11:43:05.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.226+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~FGIRUPJ75S2A.0 size=1048576 2024-09-19T11:43:05.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.226+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~FGIRUPJ75S2A.1 size=154632 2024-09-19T11:43:05.235 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.230+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=FGIRUPJ75S2A tag=D2JBW4P3MD61 type=write size=2251784 2024-09-19T11:43:05.238 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.234+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=M9HEJ3RUGL9Y type=del size=496843 2024-09-19T11:43:05.238 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.234+0000 7f3d831968c0 1 < canceled part key=_multipart_JV7EGEI6062Y.2~ZA119H27DX9R.0 size=1048576 2024-09-19T11:43:05.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.238+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~ZA119H27DX9R.1 size=1048576 2024-09-19T11:43:05.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.238+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~ZA119H27DX9R.2 size=551404 2024-09-19T11:43:05.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.246+0000 7f3d831968c0 1 < canceled multipart upload key=JV7EGEI6062Y upload=ZA119H27DX9R tag=L5MF2UJ52R4Q type=write size=3697132 2024-09-19T11:43:05.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.250+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~2Y5FDQ12R3TT.0 size=1048576 2024-09-19T11:43:05.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.250+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~2Y5FDQ12R3TT.1 size=1048576 2024-09-19T11:43:05.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.254+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~2Y5FDQ12R3TT.2 size=682732 2024-09-19T11:43:05.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.254+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=2Y5FDQ12R3TT tag=K0YHKSWEAW0X type=write size=3828460 2024-09-19T11:43:05.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.258+0000 7f3d831968c0 1 < canceled operation key=FKLL38ZNCJ21 tag=X1RKJZN01D0Q type=del size=466981 2024-09-19T11:43:05.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.258+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=HWJXKRH2RO2M type=del size=2584596 2024-09-19T11:43:05.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.262+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=TT78IBPQRD7E type=del 2024-09-19T11:43:05.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.270+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~U6HSP0F9P642.0 size=721479 2024-09-19T11:43:05.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.270+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=U6HSP0F9P642 tag=U4XF10RA97H4 type=write size=1770055 2024-09-19T11:43:05.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.274+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=D1UF8W3UB05P type=del 2024-09-19T11:43:05.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.278+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=56Y1W83CR9W5 type=write size=258778 2024-09-19T11:43:05.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.278+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=WLBZY0YWBEE1 type=del 2024-09-19T11:43:05.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.286+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~HX9HVLNN7GG8.0 size=1048576 2024-09-19T11:43:05.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.290+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~HX9HVLNN7GG8.1 size=271855 2024-09-19T11:43:05.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.290+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=HX9HVLNN7GG8 tag=92E507IDR278 type=write size=2369007 2024-09-19T11:43:05.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.294+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=IRXDLYTVD03A type=del 2024-09-19T11:43:05.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.298+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~YRFC24TOHTHW.0 size=1048576 2024-09-19T11:43:05.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.302+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~YRFC24TOHTHW.1 size=1048576 2024-09-19T11:43:05.308 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.306+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~YRFC24TOHTHW.2 size=501761 2024-09-19T11:43:05.308 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.306+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=YRFC24TOHTHW tag=GQ00KZXDBR3W type=write size=3647489 2024-09-19T11:43:05.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.306+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~WV01CCCYLDI9.0 size=1048576 2024-09-19T11:43:05.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.310+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~WV01CCCYLDI9.1 size=1048576 2024-09-19T11:43:05.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.314+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~WV01CCCYLDI9.2 size=1037466 2024-09-19T11:43:05.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.318+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=WV01CCCYLDI9 tag=3MW42JNT3OTN type=write size=4183194 2024-09-19T11:43:05.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.322+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=3JB31CE5FXM3 type=del size=3814517 2024-09-19T11:43:05.334 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.330+0000 7f3d831968c0 1 < suggested remove operation key=76JFMPOUJZXW tag=BYJ9MGDV1QMA type=del 2024-09-19T11:43:05.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.334+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=ZTY38YM68KIR type=del size=2167774 2024-09-19T11:43:05.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.338+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=ZIWPT6IB7COQ type=del 2024-09-19T11:43:05.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.342+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=E5216VYR8EFH type=del size=2258994 2024-09-19T11:43:05.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.346+0000 7f3d831968c0 -1 < failed to complete operation key=76JFMPOUJZXW tag=OQ0M1LZNMJXB type=write size=800745: (22) Invalid argument 2024-09-19T11:43:05.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.346+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=1DZ6A1T3GH2D type=del size=3866859 2024-09-19T11:43:05.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.350+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=B5A0YDBOBZC4 type=del 2024-09-19T11:43:05.359 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.354+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=2TERAD7BGSPE type=del size=3318846 2024-09-19T11:43:05.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.358+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=5JUP8HW765OH type=del 2024-09-19T11:43:05.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.366+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~1XDHM88ME9Z4.0 size=154005 2024-09-19T11:43:05.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.366+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=1XDHM88ME9Z4 tag=EEAE6OHF5W1N type=write size=1202581 2024-09-19T11:43:05.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.370+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~BG6S2ZUNTD0N.0 size=898767 2024-09-19T11:43:05.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.374+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=BG6S2ZUNTD0N tag=F5518WS1K8I9 type=write size=1947343 2024-09-19T11:43:05.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.378+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=XZ1COQBFE7HC type=del size=1377418 2024-09-19T11:43:05.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.382+0000 7f3d831968c0 1 < completed delete operation key=PB62JE7I55GG tag=LVQZ3K186NOP type=del 2024-09-19T11:43:05.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.386+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=SFAPQV996AOP type=del size=601618 2024-09-19T11:43:05.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.390+0000 7f3d831968c0 -1 < failed to complete operation key=76JFMPOUJZXW tag=2L6O3LKODB5O type=del size=3370648: (22) Invalid argument 2024-09-19T11:43:05.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.394+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=OGSMF750ZZS3 type=del size=3666838 2024-09-19T11:43:05.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.398+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=M9HEJ3RUGL9Y type=del 2024-09-19T11:43:05.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.402+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=I48JA01KVBKJ type=del size=438530 2024-09-19T11:43:05.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.406+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~2Y5FDQ12R3TT.0 size=1048576 2024-09-19T11:43:05.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.406+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~2Y5FDQ12R3TT.1 size=1048576 2024-09-19T11:43:05.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.410+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~2Y5FDQ12R3TT.2 size=682732 2024-09-19T11:43:05.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.418+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=2Y5FDQ12R3TT tag=K0YHKSWEAW0X type=write size=3828460 2024-09-19T11:43:05.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.418+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=0F0WH8136OBM type=del size=1242884 2024-09-19T11:43:05.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.422+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=HWJXKRH2RO2M type=del 2024-09-19T11:43:05.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.430+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~JWVAO8FX5PU8.0 size=1048576 2024-09-19T11:43:05.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.434+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~JWVAO8FX5PU8.1 size=577580 2024-09-19T11:43:05.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.434+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=JWVAO8FX5PU8 tag=UJEPQ6AAP3D8 type=write size=2674732 2024-09-19T11:43:05.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.438+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~U6HSP0F9P642.0 size=721479 2024-09-19T11:43:05.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.442+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=U6HSP0F9P642 tag=U4XF10RA97H4 type=write size=1770055 2024-09-19T11:43:05.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.446+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=TB02QTBZTRZF type=del size=2968085 2024-09-19T11:43:05.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.454+0000 7f3d831968c0 1 < suggested update operation key=00DYD22W0ZNB tag=56Y1W83CR9W5 type=write size=258778 2024-09-19T11:43:05.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.454+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=MFQPPJ1RYKWS type=del size=2170830 2024-09-19T11:43:05.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.458+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~HX9HVLNN7GG8.0 size=1048576 2024-09-19T11:43:05.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.462+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~HX9HVLNN7GG8.1 size=271855 2024-09-19T11:43:05.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.466+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=HX9HVLNN7GG8 tag=92E507IDR278 type=write size=2369007 2024-09-19T11:43:05.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.470+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=01RUEEH1Q49Q type=del size=3758129 2024-09-19T11:43:05.478 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.474+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~YRFC24TOHTHW.0 size=1048576 2024-09-19T11:43:05.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.478+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~YRFC24TOHTHW.1 size=1048576 2024-09-19T11:43:05.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.478+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~YRFC24TOHTHW.2 size=501761 2024-09-19T11:43:05.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.486+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=YRFC24TOHTHW tag=GQ00KZXDBR3W type=write size=3647489 2024-09-19T11:43:05.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.490+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~X6FR5DBUWAA8.0 size=1048576 2024-09-19T11:43:05.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.494+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~X6FR5DBUWAA8.1 size=1048576 2024-09-19T11:43:05.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.494+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~X6FR5DBUWAA8.2 size=4720 2024-09-19T11:43:05.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.494+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=X6FR5DBUWAA8 tag=XM9C1JBLEWPZ type=write size=3150448 2024-09-19T11:43:05.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.498+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=3JB31CE5FXM3 type=del 2024-09-19T11:43:05.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.506+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~RC4OG6GHGPMK.0 size=23334 2024-09-19T11:43:05.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.506+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=RC4OG6GHGPMK tag=EMT4YB0S0ER8 type=write size=1071910 2024-09-19T11:43:05.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.510+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=ZTY38YM68KIR type=del 2024-09-19T11:43:05.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.514+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=R78RO7Q6W77R type=write size=449047 2024-09-19T11:43:05.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.514+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=E5216VYR8EFH type=del 2024-09-19T11:43:05.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.522+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~0UWC79BEQE4G.0 size=1048576 2024-09-19T11:43:05.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.526+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~0UWC79BEQE4G.1 size=1048576 2024-09-19T11:43:05.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.530+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~0UWC79BEQE4G.2 size=499844 2024-09-19T11:43:05.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.530+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=0UWC79BEQE4G tag=IE5JZQG5IKVQ type=write size=3645572 2024-09-19T11:43:05.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.534+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=1DZ6A1T3GH2D type=del 2024-09-19T11:43:05.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.538+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=TVXGQ0NC48KN type=del size=3321691 2024-09-19T11:43:05.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.538+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=2TERAD7BGSPE type=del 2024-09-19T11:43:05.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.542+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=FOOQPUR1A0UJ type=del size=2768631 2024-09-19T11:43:05.551 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.546+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~1XDHM88ME9Z4.0 size=154005 2024-09-19T11:43:05.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.550+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=1XDHM88ME9Z4 tag=EEAE6OHF5W1N type=write size=1202581 2024-09-19T11:43:05.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.554+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=8O4D7H20VZHF type=del size=472062 2024-09-19T11:43:05.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.558+0000 7f3d831968c0 1 < completed delete operation key=PB62JE7I55GG tag=XZ1COQBFE7HC type=del 2024-09-19T11:43:05.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.562+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=CJ05KNOLZ7SI type=del size=755616 2024-09-19T11:43:05.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.566+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=SFAPQV996AOP type=del 2024-09-19T11:43:05.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.566+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=GV0B9QBRNJKT type=write size=393947 2024-09-19T11:43:05.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.570+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=OGSMF750ZZS3 type=del 2024-09-19T11:43:05.578 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.574+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=K9F3T96SNI10 type=del size=100636 2024-09-19T11:43:05.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.578+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=I48JA01KVBKJ type=del 2024-09-19T11:43:05.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.582+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~J87Z7SOQMEP7.0 size=1048576 2024-09-19T11:43:05.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.586+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~J87Z7SOQMEP7.1 size=539222 2024-09-19T11:43:05.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.586+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=J87Z7SOQMEP7 tag=CLYJDBUW3F4C type=write size=2636374 2024-09-19T11:43:05.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.590+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=0F0WH8136OBM type=del 2024-09-19T11:43:05.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.594+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~G6OOSPYQAXKZ.0 size=1048576 2024-09-19T11:43:05.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.598+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~G6OOSPYQAXKZ.1 size=291300 2024-09-19T11:43:05.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.598+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=G6OOSPYQAXKZ tag=2WNJ8U8E0TNK type=write size=2388452 2024-09-19T11:43:05.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.598+0000 7f3d831968c0 1 < canceled part key=_multipart_4I8BY4YYTRT0.2~JWVAO8FX5PU8.0 size=1048576 2024-09-19T11:43:05.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.602+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~JWVAO8FX5PU8.1 size=577580 2024-09-19T11:43:05.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.606+0000 7f3d831968c0 1 < canceled multipart upload key=4I8BY4YYTRT0 upload=JWVAO8FX5PU8 tag=UJEPQ6AAP3D8 type=write size=2674732 2024-09-19T11:43:05.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.610+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=UCN4V1PHYYYW type=write size=587798 2024-09-19T11:43:05.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.614+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=TB02QTBZTRZF type=del 2024-09-19T11:43:05.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.614+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=0Q66AAXP0QQD type=del size=1552892 2024-09-19T11:43:05.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.618+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=MFQPPJ1RYKWS type=del 2024-09-19T11:43:05.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.622+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=DNHX2BVIUTTT type=del size=1595890 2024-09-19T11:43:05.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.626+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=01RUEEH1Q49Q type=del 2024-09-19T11:43:05.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.630+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=DR0JPITPD478 type=del size=141561 2024-09-19T11:43:05.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.630+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~X6FR5DBUWAA8.0 size=1048576 2024-09-19T11:43:05.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.634+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~X6FR5DBUWAA8.1 size=1048576 2024-09-19T11:43:05.641 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.638+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~X6FR5DBUWAA8.2 size=4720 2024-09-19T11:43:05.646 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.642+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=X6FR5DBUWAA8 tag=XM9C1JBLEWPZ type=write size=3150448 2024-09-19T11:43:05.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.646+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=3X2VHW9Q6G21 type=del size=2157982 2024-09-19T11:43:05.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.646+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~RC4OG6GHGPMK.0 size=23334 2024-09-19T11:43:05.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.654+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=RC4OG6GHGPMK tag=EMT4YB0S0ER8 type=write size=1071910 2024-09-19T11:43:05.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.654+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=AXI33ZYHBI23 type=del size=604342 2024-09-19T11:43:05.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.658+0000 7f3d831968c0 1 < completed write operation key=LINLTWYV88VU tag=R78RO7Q6W77R type=write size=449047 2024-09-19T11:43:05.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.662+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=FHGUOFTVVAJZ type=del size=2649327 2024-09-19T11:43:05.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.666+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~0UWC79BEQE4G.0 size=1048576 2024-09-19T11:43:05.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.666+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~0UWC79BEQE4G.1 size=1048576 2024-09-19T11:43:05.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.670+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~0UWC79BEQE4G.2 size=499844 2024-09-19T11:43:05.678 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.674+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=0UWC79BEQE4G tag=IE5JZQG5IKVQ type=write size=3645572 2024-09-19T11:43:05.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.678+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~1XOHS2A35GO1.0 size=1048576 2024-09-19T11:43:05.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.682+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~1XOHS2A35GO1.1 size=232688 2024-09-19T11:43:05.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.682+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=1XOHS2A35GO1 tag=LADVJOV9DWKH type=write size=2329840 2024-09-19T11:43:05.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.686+0000 7f3d831968c0 1 < completed delete operation key=PB62JE7I55GG tag=TVXGQ0NC48KN type=del 2024-09-19T11:43:05.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.686+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=WAIIF0JN1I2N type=del size=3244911 2024-09-19T11:43:05.696 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.694+0000 7f3d831968c0 1 < suggested remove operation key=76JFMPOUJZXW tag=FOOQPUR1A0UJ type=del 2024-09-19T11:43:05.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.694+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=1T1SDNLXJKX5 type=write size=370939 2024-09-19T11:43:05.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.698+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=8O4D7H20VZHF type=del 2024-09-19T11:43:05.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.702+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~Z2WWN5RZQEYR.0 size=1048576 2024-09-19T11:43:05.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.706+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~Z2WWN5RZQEYR.1 size=211587 2024-09-19T11:43:05.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.706+0000 7f3d831968c0 1 > prepared multipart upload key=JTPBGWC4T3Y5 upload=Z2WWN5RZQEYR tag=UAFCCV09D0FK type=write size=2308739 2024-09-19T11:43:05.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.710+0000 7f3d831968c0 1 < suggested remove operation key=UI7EVZ1SGD8R tag=CJ05KNOLZ7SI type=del 2024-09-19T11:43:05.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.714+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~NOZC2DO2XEMV.0 size=606678 2024-09-19T11:43:05.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.714+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=NOZC2DO2XEMV tag=T4UB9QYFQW0I type=write size=1655254 2024-09-19T11:43:05.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.718+0000 7f3d831968c0 1 < completed write operation key=4V17CRW6EB65 tag=GV0B9QBRNJKT type=write size=393947 2024-09-19T11:43:05.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.718+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=L6DS1N41T9U2 type=del size=2981897 2024-09-19T11:43:05.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.722+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=K9F3T96SNI10 type=del 2024-09-19T11:43:05.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.730+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~WZ3PI36BNO4T.0 size=1048576 2024-09-19T11:43:05.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.730+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~WZ3PI36BNO4T.1 size=730632 2024-09-19T11:43:05.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.730+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=WZ3PI36BNO4T tag=8XQUU4P23JGV type=write size=2827784 2024-09-19T11:43:05.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.730+0000 7f3d831968c0 1 < canceled part key=_multipart_CULXGFLZ0HI6.2~J87Z7SOQMEP7.0 size=1048576 2024-09-19T11:43:05.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.734+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~J87Z7SOQMEP7.1 size=539222 2024-09-19T11:43:05.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.738+0000 7f3d831968c0 1 < canceled multipart upload key=CULXGFLZ0HI6 upload=J87Z7SOQMEP7 tag=CLYJDBUW3F4C type=write size=2636374 2024-09-19T11:43:05.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.742+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~RJHLO1BBLHCQ.0 size=1048576 2024-09-19T11:43:05.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.746+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~RJHLO1BBLHCQ.1 size=1048576 2024-09-19T11:43:05.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.746+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~RJHLO1BBLHCQ.2 size=839450 2024-09-19T11:43:05.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.746+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=RJHLO1BBLHCQ tag=YPJWOXNYGUDV type=write size=3985178 2024-09-19T11:43:05.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.750+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~G6OOSPYQAXKZ.0 size=1048576 2024-09-19T11:43:05.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.754+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~G6OOSPYQAXKZ.1 size=291300 2024-09-19T11:43:05.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.758+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=G6OOSPYQAXKZ tag=2WNJ8U8E0TNK type=write size=2388452 2024-09-19T11:43:05.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.762+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~GMK1DHQGUT48.0 size=50656 2024-09-19T11:43:05.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.762+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=GMK1DHQGUT48 tag=YS48E9XR1IXX type=write size=1099232 2024-09-19T11:43:05.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.766+0000 7f3d831968c0 1 < suggested update operation key=I5XUMA2HKIR5 tag=UCN4V1PHYYYW type=write size=587798 2024-09-19T11:43:05.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.774+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~M7XI6GE390D0.0 size=1048576 2024-09-19T11:43:05.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.774+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~M7XI6GE390D0.1 size=1048576 2024-09-19T11:43:05.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.778+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~M7XI6GE390D0.2 size=454461 2024-09-19T11:43:05.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.778+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=M7XI6GE390D0 tag=VLPYXEFBQPF3 type=write size=3600189 2024-09-19T11:43:05.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.782+0000 7f3d831968c0 1 < suggested update operation key=0OOB2SNLVK8E tag=0Q66AAXP0QQD type=del size=1552892 2024-09-19T11:43:05.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.786+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~NAIVT86LW2NA.0 size=1048576 2024-09-19T11:43:05.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.790+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~NAIVT86LW2NA.1 size=1048576 2024-09-19T11:43:05.796 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.794+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~NAIVT86LW2NA.2 size=402347 2024-09-19T11:43:05.796 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.794+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=NAIVT86LW2NA tag=YRLFKIAYUC1M type=write size=3548075 2024-09-19T11:43:05.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.794+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=DNHX2BVIUTTT type=del 2024-09-19T11:43:05.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.798+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=2A4BRPD8KOKX type=del size=2194673 2024-09-19T11:43:05.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.806+0000 7f3d831968c0 1 < canceled operation key=JTPBGWC4T3Y5 tag=DR0JPITPD478 type=del size=141561 2024-09-19T11:43:05.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.810+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~EN62YGHQNMQM.0 size=1048576 2024-09-19T11:43:05.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.814+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~EN62YGHQNMQM.1 size=1048576 2024-09-19T11:43:05.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.814+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~EN62YGHQNMQM.2 size=397780 2024-09-19T11:43:05.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.814+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=EN62YGHQNMQM tag=HXYV8T1AYBF1 type=write size=3543508 2024-09-19T11:43:05.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.818+0000 7f3d831968c0 1 < completed delete operation key=3QWBQYLI0SJR tag=3X2VHW9Q6G21 type=del 2024-09-19T11:43:05.824 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.818+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=6Y06I6WELIZQ type=write size=1023620 2024-09-19T11:43:05.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.822+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=AXI33ZYHBI23 type=del 2024-09-19T11:43:05.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.826+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~J2UKNIF88H04.0 size=1048576 2024-09-19T11:43:05.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.830+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~J2UKNIF88H04.1 size=301734 2024-09-19T11:43:05.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.830+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=J2UKNIF88H04 tag=RNI8JTOL8RWG type=write size=2398886 2024-09-19T11:43:05.836 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.830+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=FHGUOFTVVAJZ type=del 2024-09-19T11:43:05.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.838+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~2ER2VQN8TK7Q.0 size=435106 2024-09-19T11:43:05.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.838+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=2ER2VQN8TK7Q tag=H350NZRF8QMO type=write size=1483682 2024-09-19T11:43:05.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.838+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~1XOHS2A35GO1.0 size=1048576 2024-09-19T11:43:05.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.838+0000 7f3d831968c0 1 < canceled part key=_multipart_EVFF0F0760OS.2~1XOHS2A35GO1.1 size=232688 2024-09-19T11:43:05.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.842+0000 7f3d831968c0 1 < canceled multipart upload key=EVFF0F0760OS upload=1XOHS2A35GO1 tag=LADVJOV9DWKH type=write size=2329840 2024-09-19T11:43:05.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.850+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~7XSYPVS0QZEA.0 size=1048576 2024-09-19T11:43:05.855 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.850+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~7XSYPVS0QZEA.1 size=1048576 2024-09-19T11:43:05.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.854+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~7XSYPVS0QZEA.2 size=927194 2024-09-19T11:43:05.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.854+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=7XSYPVS0QZEA tag=2X2V27YOY2S6 type=write size=4072922 2024-09-19T11:43:05.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.854+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=WAIIF0JN1I2N type=del 2024-09-19T11:43:05.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.858+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=EFKYVIO4S5DM type=del size=3027245 2024-09-19T11:43:05.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.862+0000 7f3d831968c0 1 < completed write operation key=224HPC2Y95N6 tag=1T1SDNLXJKX5 type=write size=370939 2024-09-19T11:43:05.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.866+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~OKTDS3UG8W7N.0 size=1048576 2024-09-19T11:43:05.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.866+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~OKTDS3UG8W7N.1 size=772357 2024-09-19T11:43:05.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.866+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=OKTDS3UG8W7N tag=4T407TQEGDNH type=write size=2869509 2024-09-19T11:43:05.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.870+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~Z2WWN5RZQEYR.0 size=1048576 2024-09-19T11:43:05.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.870+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~Z2WWN5RZQEYR.1 size=211587 2024-09-19T11:43:05.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.874+0000 7f3d831968c0 1 < completed multipart upload key=JTPBGWC4T3Y5 upload=Z2WWN5RZQEYR tag=UAFCCV09D0FK type=write size=2308739 2024-09-19T11:43:05.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.878+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=2B51KT42BIYE type=del size=81737 2024-09-19T11:43:05.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.882+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~NOZC2DO2XEMV.0 size=606678 2024-09-19T11:43:05.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.886+0000 7f3d831968c0 1 < completed multipart upload key=LINLTWYV88VU upload=NOZC2DO2XEMV tag=T4UB9QYFQW0I type=write size=1655254 2024-09-19T11:43:05.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.886+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=BDP0MOIGXRCK type=write size=601859 2024-09-19T11:43:05.894 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.890+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=L6DS1N41T9U2 type=del 2024-09-19T11:43:05.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.894+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=A3DIZKJJ20MQ type=del size=2356420 2024-09-19T11:43:05.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.894+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~WZ3PI36BNO4T.0 size=1048576 2024-09-19T11:43:05.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.898+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~WZ3PI36BNO4T.1 size=730632 2024-09-19T11:43:05.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.902+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=WZ3PI36BNO4T tag=8XQUU4P23JGV type=write size=2827784 2024-09-19T11:43:05.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.906+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=86YHM2592ZGN type=del size=1964824 2024-09-19T11:43:05.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.910+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~RJHLO1BBLHCQ.0 size=1048576 2024-09-19T11:43:05.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.910+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~RJHLO1BBLHCQ.1 size=1048576 2024-09-19T11:43:05.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.914+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~RJHLO1BBLHCQ.2 size=839450 2024-09-19T11:43:05.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.918+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=RJHLO1BBLHCQ tag=YPJWOXNYGUDV type=write size=3985178 2024-09-19T11:43:05.927 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.922+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~Z7RQUKQ14HGF.0 size=1048576 2024-09-19T11:43:05.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.926+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~Z7RQUKQ14HGF.1 size=897264 2024-09-19T11:43:05.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.926+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=Z7RQUKQ14HGF tag=FOCS6LM4YWK5 type=write size=2994416 2024-09-19T11:43:05.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.930+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~GMK1DHQGUT48.0 size=50656 2024-09-19T11:43:05.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.934+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=GMK1DHQGUT48 tag=YS48E9XR1IXX type=write size=1099232 2024-09-19T11:43:05.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.938+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=Y0RPD545ACAG type=del size=2513697 2024-09-19T11:43:05.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.938+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~M7XI6GE390D0.0 size=1048576 2024-09-19T11:43:05.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.942+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~M7XI6GE390D0.1 size=1048576 2024-09-19T11:43:05.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.942+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~M7XI6GE390D0.2 size=454461 2024-09-19T11:43:05.952 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.950+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=M7XI6GE390D0 tag=VLPYXEFBQPF3 type=write size=3600189 2024-09-19T11:43:05.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.950+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=DUNQCJVL7HVR type=del size=2662337 2024-09-19T11:43:05.958 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.954+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~NAIVT86LW2NA.0 size=1048576 2024-09-19T11:43:05.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.958+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~NAIVT86LW2NA.1 size=1048576 2024-09-19T11:43:05.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.958+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~NAIVT86LW2NA.2 size=402347 2024-09-19T11:43:05.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.962+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=NAIVT86LW2NA tag=YRLFKIAYUC1M type=write size=3548075 2024-09-19T11:43:05.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.966+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=4RI91IR50DYG type=del size=2102112 2024-09-19T11:43:05.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.970+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=2A4BRPD8KOKX type=del 2024-09-19T11:43:05.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.974+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=AGO5DWRICHOK type=del size=1292265 2024-09-19T11:43:05.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.978+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~EN62YGHQNMQM.0 size=1048576 2024-09-19T11:43:05.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.978+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~EN62YGHQNMQM.1 size=1048576 2024-09-19T11:43:05.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.982+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~EN62YGHQNMQM.2 size=397780 2024-09-19T11:43:05.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.990+0000 7f3d831968c0 1 < completed multipart upload key=LINLTWYV88VU upload=EN62YGHQNMQM tag=HXYV8T1AYBF1 type=write size=3543508 2024-09-19T11:43:05.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.990+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=MMFLAV5AFHUH type=del size=2776453 2024-09-19T11:43:05.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.994+0000 7f3d831968c0 1 < completed write operation key=T9KJH2ZYCLVA tag=6Y06I6WELIZQ type=write size=1023620 2024-09-19T11:43:06.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:05.998+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=GEQ2RE5TCR9M type=del size=3811029 2024-09-19T11:43:06.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.002+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~J2UKNIF88H04.0 size=1048576 2024-09-19T11:43:06.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.006+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~J2UKNIF88H04.1 size=301734 2024-09-19T11:43:06.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.010+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=J2UKNIF88H04 tag=RNI8JTOL8RWG type=write size=2398886 2024-09-19T11:43:06.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.010+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=SDS760QCAESE type=del size=49373 2024-09-19T11:43:06.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.014+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~2ER2VQN8TK7Q.0 size=435106 2024-09-19T11:43:06.024 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.018+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=2ER2VQN8TK7Q tag=H350NZRF8QMO type=write size=1483682 2024-09-19T11:43:06.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.026+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~WVVBM7GVN3JI.0 size=1048576 2024-09-19T11:43:06.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.026+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~WVVBM7GVN3JI.1 size=901114 2024-09-19T11:43:06.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.026+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=WVVBM7GVN3JI tag=6V6J2PMKVOKS type=write size=2998266 2024-09-19T11:43:06.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.030+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~7XSYPVS0QZEA.0 size=1048576 2024-09-19T11:43:06.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.034+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~7XSYPVS0QZEA.1 size=1048576 2024-09-19T11:43:06.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.034+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~7XSYPVS0QZEA.2 size=927194 2024-09-19T11:43:06.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.042+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=7XSYPVS0QZEA tag=2X2V27YOY2S6 type=write size=4072922 2024-09-19T11:43:06.050 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.046+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~8G6R1F9PJRNB.0 size=1048576 2024-09-19T11:43:06.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.050+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~8G6R1F9PJRNB.1 size=621177 2024-09-19T11:43:06.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.050+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=8G6R1F9PJRNB tag=WN79IYE8G3R5 type=write size=2718329 2024-09-19T11:43:06.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.050+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=EFKYVIO4S5DM type=del 2024-09-19T11:43:06.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.054+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~HLE5VQ1C9JJ0.0 size=1048576 2024-09-19T11:43:06.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.058+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~HLE5VQ1C9JJ0.1 size=871783 2024-09-19T11:43:06.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.058+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=HLE5VQ1C9JJ0 tag=J6DKUXHO1F5V type=write size=2968935 2024-09-19T11:43:06.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.062+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~OKTDS3UG8W7N.0 size=1048576 2024-09-19T11:43:06.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.066+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~OKTDS3UG8W7N.1 size=772357 2024-09-19T11:43:06.074 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.070+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=OKTDS3UG8W7N tag=4T407TQEGDNH type=write size=2869509 2024-09-19T11:43:06.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.074+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~XQOPVEG5X1PO.0 size=1048576 2024-09-19T11:43:06.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.078+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~XQOPVEG5X1PO.1 size=1048576 2024-09-19T11:43:06.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.078+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~XQOPVEG5X1PO.2 size=427873 2024-09-19T11:43:06.084 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.078+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=XQOPVEG5X1PO tag=8AVJ3JILET5G type=write size=3573601 2024-09-19T11:43:06.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.082+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=2B51KT42BIYE type=del 2024-09-19T11:43:06.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.086+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=CPH750F2Y422 type=del size=1297473 2024-09-19T11:43:06.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.090+0000 7f3d831968c0 1 < completed write operation key=T9KJH2ZYCLVA tag=BDP0MOIGXRCK type=write size=601859 2024-09-19T11:43:06.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.090+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=EQAGJ9192A4R type=del size=275390 2024-09-19T11:43:06.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.094+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=A3DIZKJJ20MQ type=del 2024-09-19T11:43:06.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.098+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=A9WZTGVMKE6T type=del size=1703243 2024-09-19T11:43:06.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.102+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=86YHM2592ZGN type=del 2024-09-19T11:43:06.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.106+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=H19HGCC1ZW3L type=write size=212798 2024-09-19T11:43:06.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.106+0000 7f3d831968c0 1 < canceled part key=_multipart_CULXGFLZ0HI6.2~Z7RQUKQ14HGF.0 size=1048576 2024-09-19T11:43:06.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.106+0000 7f3d831968c0 1 < canceled part key=_multipart_CULXGFLZ0HI6.2~Z7RQUKQ14HGF.1 size=897264 2024-09-19T11:43:06.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.110+0000 7f3d831968c0 1 < canceled multipart upload key=CULXGFLZ0HI6 upload=Z7RQUKQ14HGF tag=FOCS6LM4YWK5 type=write size=2994416 2024-09-19T11:43:06.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.114+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=2RH07ZE5R37Y type=del size=1837995 2024-09-19T11:43:06.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.118+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=Y0RPD545ACAG type=del 2024-09-19T11:43:06.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.126+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~617ZMANC53C4.0 size=1048576 2024-09-19T11:43:06.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.126+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~617ZMANC53C4.1 size=1048576 2024-09-19T11:43:06.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.130+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~617ZMANC53C4.2 size=175956 2024-09-19T11:43:06.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.130+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=617ZMANC53C4 tag=KBP4RXSS4290 type=write size=3321684 2024-09-19T11:43:06.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.134+0000 7f3d831968c0 1 < completed delete operation key=PB62JE7I55GG tag=DUNQCJVL7HVR type=del 2024-09-19T11:43:06.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.142+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~97FXPCAN7RB1.0 size=1048576 2024-09-19T11:43:06.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.142+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~97FXPCAN7RB1.1 size=1033809 2024-09-19T11:43:06.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.142+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=97FXPCAN7RB1 tag=JFCX363ZHQDY type=write size=3130961 2024-09-19T11:43:06.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.146+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=4RI91IR50DYG type=del 2024-09-19T11:43:06.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.150+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=TGX1VEDPPQB4 type=write size=482960 2024-09-19T11:43:06.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.154+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=AGO5DWRICHOK type=del 2024-09-19T11:43:06.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.158+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=9S8S4G057UP6 type=write size=56805 2024-09-19T11:43:06.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.162+0000 7f3d831968c0 1 < suggested update operation key=PB62JE7I55GG tag=MMFLAV5AFHUH type=del size=2776453 2024-09-19T11:43:06.169 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.166+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=PJ2IXL8P7K3D type=write size=869109 2024-09-19T11:43:06.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.166+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=GEQ2RE5TCR9M type=del 2024-09-19T11:43:06.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.174+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~2CLY6OFUNPJD.0 size=1048576 2024-09-19T11:43:06.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.174+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~2CLY6OFUNPJD.1 size=1048576 2024-09-19T11:43:06.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.178+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~2CLY6OFUNPJD.2 size=419052 2024-09-19T11:43:06.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.178+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=2CLY6OFUNPJD tag=M7JMPX2AFP01 type=write size=3564780 2024-09-19T11:43:06.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.178+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=SDS760QCAESE type=del 2024-09-19T11:43:06.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.186+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~6W3JFD1OBZBB.0 size=1048576 2024-09-19T11:43:06.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.186+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~6W3JFD1OBZBB.1 size=954152 2024-09-19T11:43:06.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.186+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=6W3JFD1OBZBB tag=6OAMVYBXFVS9 type=write size=3051304 2024-09-19T11:43:06.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.190+0000 7f3d831968c0 1 < canceled part key=_multipart_G4P6HIOM1G2E.2~WVVBM7GVN3JI.0 size=1048576 2024-09-19T11:43:06.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.190+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~WVVBM7GVN3JI.1 size=901114 2024-09-19T11:43:06.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.194+0000 7f3d831968c0 1 < canceled multipart upload key=G4P6HIOM1G2E upload=WVVBM7GVN3JI tag=6V6J2PMKVOKS type=write size=2998266 2024-09-19T11:43:06.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.198+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=IDIGE4N0FLRM type=write size=48290 2024-09-19T11:43:06.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.202+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~8G6R1F9PJRNB.0 size=1048576 2024-09-19T11:43:06.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.202+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~8G6R1F9PJRNB.1 size=621177 2024-09-19T11:43:06.213 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.210+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=8G6R1F9PJRNB tag=WN79IYE8G3R5 type=write size=2718329 2024-09-19T11:43:06.217 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.210+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=5KEP9M1NBXZ0 type=del size=533739 2024-09-19T11:43:06.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.214+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~HLE5VQ1C9JJ0.0 size=1048576 2024-09-19T11:43:06.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.218+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~HLE5VQ1C9JJ0.1 size=871783 2024-09-19T11:43:06.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.222+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=HLE5VQ1C9JJ0 tag=J6DKUXHO1F5V type=write size=2968935 2024-09-19T11:43:06.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.226+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~WH2VFPZXZADP.0 size=111538 2024-09-19T11:43:06.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.226+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=WH2VFPZXZADP tag=92FQH7R01U0R type=write size=1160114 2024-09-19T11:43:06.233 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.230+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~XQOPVEG5X1PO.0 size=1048576 2024-09-19T11:43:06.235 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.230+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~XQOPVEG5X1PO.1 size=1048576 2024-09-19T11:43:06.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.234+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~XQOPVEG5X1PO.2 size=427873 2024-09-19T11:43:06.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.238+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=XQOPVEG5X1PO tag=8AVJ3JILET5G type=write size=3573601 2024-09-19T11:43:06.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.238+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=74NHBQFPQ44S type=del size=2959738 2024-09-19T11:43:06.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.242+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=CPH750F2Y422 type=del 2024-09-19T11:43:06.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.246+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=9AA48L4KWAFC type=del size=833064 2024-09-19T11:43:06.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.246+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=EQAGJ9192A4R type=del 2024-09-19T11:43:06.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.250+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=EY9XWSY35QQC type=del size=2722041 2024-09-19T11:43:06.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.254+0000 7f3d831968c0 1 < suggested update operation key=900RV3451AON tag=A9WZTGVMKE6T type=del size=1703243 2024-09-19T11:43:06.260 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.258+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=VKX5T1BL6M3L type=del size=1222807 2024-09-19T11:43:06.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.258+0000 7f3d831968c0 1 < completed write operation key=5RTONAWGYJNE tag=H19HGCC1ZW3L type=write size=212798 2024-09-19T11:43:06.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.262+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=LTSFGCNC5R10 type=del size=90313 2024-09-19T11:43:06.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.266+0000 7f3d831968c0 1 < suggested update operation key=76JFMPOUJZXW tag=2RH07ZE5R37Y type=del size=1837995 2024-09-19T11:43:06.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.270+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=DUQKQ252IZB5 type=del size=1491500 2024-09-19T11:43:06.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.274+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~617ZMANC53C4.0 size=1048576 2024-09-19T11:43:06.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.274+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~617ZMANC53C4.1 size=1048576 2024-09-19T11:43:06.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.278+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~617ZMANC53C4.2 size=175956 2024-09-19T11:43:06.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.282+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=617ZMANC53C4 tag=KBP4RXSS4290 type=write size=3321684 2024-09-19T11:43:06.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.286+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~KA0RP7OWUM53.0 size=241303 2024-09-19T11:43:06.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.286+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=KA0RP7OWUM53 tag=DJSBFDTS0N9I type=write size=1289879 2024-09-19T11:43:06.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.290+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~97FXPCAN7RB1.0 size=1048576 2024-09-19T11:43:06.297 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.294+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~97FXPCAN7RB1.1 size=1033809 2024-09-19T11:43:06.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.298+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=97FXPCAN7RB1 tag=JFCX363ZHQDY type=write size=3130961 2024-09-19T11:43:06.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.302+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=OTRPH7P2S8F4 type=write size=982698 2024-09-19T11:43:06.308 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.306+0000 7f3d831968c0 1 < canceled operation key=3QWBQYLI0SJR tag=TGX1VEDPPQB4 type=write size=482960 2024-09-19T11:43:06.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.306+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=WGSQKLBJM1B3 type=del size=4171002 2024-09-19T11:43:06.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.310+0000 7f3d831968c0 1 < completed write operation key=6NLQ0BK8AJUO tag=9S8S4G057UP6 type=write size=56805 2024-09-19T11:43:06.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.318+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~NFNJEG7YM5E1.0 size=1048576 2024-09-19T11:43:06.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.318+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~NFNJEG7YM5E1.1 size=166691 2024-09-19T11:43:06.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.318+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=NFNJEG7YM5E1 tag=9RYNFZ8GU7YS type=write size=2263843 2024-09-19T11:43:06.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.322+0000 7f3d831968c0 1 < completed write operation key=CULXGFLZ0HI6 tag=PJ2IXL8P7K3D type=write size=869109 2024-09-19T11:43:06.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.326+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~X0RIQ31ROGRJ.0 size=814125 2024-09-19T11:43:06.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.326+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=X0RIQ31ROGRJ tag=S4ZXQOQPIB51 type=write size=1862701 2024-09-19T11:43:06.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.330+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~2CLY6OFUNPJD.0 size=1048576 2024-09-19T11:43:06.337 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.334+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~2CLY6OFUNPJD.1 size=1048576 2024-09-19T11:43:06.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.342+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~2CLY6OFUNPJD.2 size=419052 2024-09-19T11:43:06.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.346+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=2CLY6OFUNPJD tag=M7JMPX2AFP01 type=write size=3564780 2024-09-19T11:43:06.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.350+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~D2413QIG92E6.0 size=1048576 2024-09-19T11:43:06.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.354+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~D2413QIG92E6.1 size=1048576 2024-09-19T11:43:06.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.354+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~D2413QIG92E6.2 size=736616 2024-09-19T11:43:06.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.354+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=D2413QIG92E6 tag=ZROKS5AOH5F3 type=write size=3882344 2024-09-19T11:43:06.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.358+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~6W3JFD1OBZBB.0 size=1048576 2024-09-19T11:43:06.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.362+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~6W3JFD1OBZBB.1 size=954152 2024-09-19T11:43:06.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.366+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=6W3JFD1OBZBB tag=6OAMVYBXFVS9 type=write size=3051304 2024-09-19T11:43:06.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.370+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=1T8JVMM36ECJ type=del size=715393 2024-09-19T11:43:06.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.370+0000 7f3d831968c0 1 < canceled operation key=FKLL38ZNCJ21 tag=IDIGE4N0FLRM type=write size=48290 2024-09-19T11:43:06.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.374+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=ZOTPE5GBLEHC type=write size=366918 2024-09-19T11:43:06.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.378+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=5KEP9M1NBXZ0 type=del 2024-09-19T11:43:06.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.382+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=SMM13O6WUPON type=del size=3176662 2024-09-19T11:43:06.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.386+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~WH2VFPZXZADP.0 size=111538 2024-09-19T11:43:06.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.390+0000 7f3d831968c0 1 < completed multipart upload key=5RTONAWGYJNE upload=WH2VFPZXZADP tag=92FQH7R01U0R type=write size=1160114 2024-09-19T11:43:06.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.394+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~U485YKHGR7VU.0 size=1048576 2024-09-19T11:43:06.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.398+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~U485YKHGR7VU.1 size=1048576 2024-09-19T11:43:06.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.398+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~U485YKHGR7VU.2 size=612565 2024-09-19T11:43:06.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.398+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=U485YKHGR7VU tag=T9CIGA5OBJXD type=write size=3758293 2024-09-19T11:43:06.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.402+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=74NHBQFPQ44S type=del 2024-09-19T11:43:06.413 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.410+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~0XUP4NFXUNLP.0 size=1048576 2024-09-19T11:43:06.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.410+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~0XUP4NFXUNLP.1 size=1048576 2024-09-19T11:43:06.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.414+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~0XUP4NFXUNLP.2 size=898609 2024-09-19T11:43:06.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.414+0000 7f3d831968c0 1 > prepared multipart upload key=JTPBGWC4T3Y5 upload=0XUP4NFXUNLP tag=6CCQX14BRDUZ type=write size=4044337 2024-09-19T11:43:06.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.418+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=9AA48L4KWAFC type=del 2024-09-19T11:43:06.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.418+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=4F4UQIZGQMRU type=del size=2982057 2024-09-19T11:43:06.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.422+0000 7f3d831968c0 1 < canceled operation key=0OOB2SNLVK8E tag=EY9XWSY35QQC type=del size=2722041 2024-09-19T11:43:06.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.426+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=F0T8IG8VPX76 type=del size=3089394 2024-09-19T11:43:06.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.430+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=VKX5T1BL6M3L type=del 2024-09-19T11:43:06.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.430+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=C60Y486H2I9X type=del size=4151249 2024-09-19T11:43:06.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.434+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=LTSFGCNC5R10 type=del 2024-09-19T11:43:06.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.438+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~G8YD7E8TDQ2S.0 size=1048576 2024-09-19T11:43:06.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.442+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~G8YD7E8TDQ2S.1 size=1048576 2024-09-19T11:43:06.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.442+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~G8YD7E8TDQ2S.2 size=1035248 2024-09-19T11:43:06.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.442+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=G8YD7E8TDQ2S tag=GV01Q0EOJ9I0 type=write size=4180976 2024-09-19T11:43:06.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.446+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=DUQKQ252IZB5 type=del 2024-09-19T11:43:06.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.454+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~BYBA130PWAEW.0 size=1048576 2024-09-19T11:43:06.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.454+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~BYBA130PWAEW.1 size=1048576 2024-09-19T11:43:06.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.458+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~BYBA130PWAEW.2 size=30941 2024-09-19T11:43:06.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.458+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=BYBA130PWAEW tag=0AF2C7DUM2KN type=write size=3176669 2024-09-19T11:43:06.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.458+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~KA0RP7OWUM53.0 size=241303 2024-09-19T11:43:06.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.462+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=KA0RP7OWUM53 tag=DJSBFDTS0N9I type=write size=1289879 2024-09-19T11:43:06.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.466+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=BWXDSTKRE3JV type=del size=3747440 2024-09-19T11:43:06.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.470+0000 7f3d831968c0 1 < canceled operation key=66N4QS1R70Z7 tag=OTRPH7P2S8F4 type=write size=982698 2024-09-19T11:43:06.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.474+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=QF2IA5RW5AEK type=write size=756678 2024-09-19T11:43:06.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.478+0000 7f3d831968c0 1 < suggested update operation key=G4P6HIOM1G2E tag=WGSQKLBJM1B3 type=del size=4171002 2024-09-19T11:43:06.485 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.482+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=C5JBQXA60HRO type=del size=7545 2024-09-19T11:43:06.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.486+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~NFNJEG7YM5E1.0 size=1048576 2024-09-19T11:43:06.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.486+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~NFNJEG7YM5E1.1 size=166691 2024-09-19T11:43:06.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.490+0000 7f3d831968c0 1 < completed multipart upload key=3GD7UZCI3WX4 upload=NFNJEG7YM5E1 tag=9RYNFZ8GU7YS type=write size=2263843 2024-09-19T11:43:06.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.494+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=8HYZH4KFK00M type=write size=913243 2024-09-19T11:43:06.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.498+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~X0RIQ31ROGRJ.0 size=814125 2024-09-19T11:43:06.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.502+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=X0RIQ31ROGRJ tag=S4ZXQOQPIB51 type=write size=1862701 2024-09-19T11:43:06.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.506+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=6K81T34DNFDW type=del size=570396 2024-09-19T11:43:06.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.510+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~D2413QIG92E6.0 size=1048576 2024-09-19T11:43:06.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.510+0000 7f3d831968c0 1 < canceled part key=_multipart_3QWBQYLI0SJR.2~D2413QIG92E6.1 size=1048576 2024-09-19T11:43:06.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.510+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~D2413QIG92E6.2 size=736616 2024-09-19T11:43:06.521 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.518+0000 7f3d831968c0 1 < canceled multipart upload key=3QWBQYLI0SJR upload=D2413QIG92E6 tag=ZROKS5AOH5F3 type=write size=3882344 2024-09-19T11:43:06.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.518+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=H71CI4HI2D2M type=del size=106918 2024-09-19T11:43:06.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.522+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=1T8JVMM36ECJ type=del 2024-09-19T11:43:06.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.530+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~AK9S1UTPEYMU.0 size=1048576 2024-09-19T11:43:06.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.530+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~AK9S1UTPEYMU.1 size=1048576 2024-09-19T11:43:06.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.534+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~AK9S1UTPEYMU.2 size=209721 2024-09-19T11:43:06.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.534+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=AK9S1UTPEYMU tag=P3PBVPXTCLUK type=write size=3355449 2024-09-19T11:43:06.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.534+0000 7f3d831968c0 1 < completed write operation key=8FGIZJIY58C7 tag=ZOTPE5GBLEHC type=write size=366918 2024-09-19T11:43:06.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.542+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~36LW9JXSXRLC.0 size=1048576 2024-09-19T11:43:06.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.542+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~36LW9JXSXRLC.1 size=1048576 2024-09-19T11:43:06.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.546+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~36LW9JXSXRLC.2 size=835273 2024-09-19T11:43:06.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.546+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=36LW9JXSXRLC tag=FHU0IEA0WW94 type=write size=3981001 2024-09-19T11:43:06.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.550+0000 7f3d831968c0 1 < suggested update operation key=E8OFSMUZHR02 tag=SMM13O6WUPON type=del size=3176662 2024-09-19T11:43:06.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.554+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=7Y9SX331W04D type=del size=3296697 2024-09-19T11:43:06.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.558+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~U485YKHGR7VU.0 size=1048576 2024-09-19T11:43:06.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.562+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~U485YKHGR7VU.1 size=1048576 2024-09-19T11:43:06.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.562+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~U485YKHGR7VU.2 size=612565 2024-09-19T11:43:06.576 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.570+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=U485YKHGR7VU tag=T9CIGA5OBJXD type=write size=3758293 2024-09-19T11:43:06.576 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.570+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=WT1HXASL76VT type=del size=2301376 2024-09-19T11:43:06.578 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.574+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~0XUP4NFXUNLP.0 size=1048576 2024-09-19T11:43:06.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.578+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~0XUP4NFXUNLP.1 size=1048576 2024-09-19T11:43:06.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.578+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~0XUP4NFXUNLP.2 size=898609 2024-09-19T11:43:06.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.586+0000 7f3d831968c0 1 < completed multipart upload key=JTPBGWC4T3Y5 upload=0XUP4NFXUNLP tag=6CCQX14BRDUZ type=write size=4044337 2024-09-19T11:43:06.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.590+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~LET1HXJBBAS3.0 size=1048576 2024-09-19T11:43:06.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.594+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~LET1HXJBBAS3.1 size=834164 2024-09-19T11:43:06.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.594+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=LET1HXJBBAS3 tag=KIC8ROOV33YB type=write size=2931316 2024-09-19T11:43:06.603 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.598+0000 7f3d831968c0 1 < suggested update operation key=224HPC2Y95N6 tag=4F4UQIZGQMRU type=del size=2982057 2024-09-19T11:43:06.606 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.602+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=3LZW7Z5RNIO9 type=del size=3787569 2024-09-19T11:43:06.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.606+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=F0T8IG8VPX76 type=del 2024-09-19T11:43:06.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.606+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=WTH5B22I28ZQ type=del size=515829 2024-09-19T11:43:06.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.610+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=C60Y486H2I9X type=del 2024-09-19T11:43:06.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.618+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=DQ1JX3KEJZ55 type=del size=713242 2024-09-19T11:43:06.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.622+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~G8YD7E8TDQ2S.0 size=1048576 2024-09-19T11:43:06.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.622+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~G8YD7E8TDQ2S.1 size=1048576 2024-09-19T11:43:06.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.626+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~G8YD7E8TDQ2S.2 size=1035248 2024-09-19T11:43:06.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.630+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=G8YD7E8TDQ2S tag=GV01Q0EOJ9I0 type=write size=4180976 2024-09-19T11:43:06.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.634+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=OIRNRAL5UMIM type=del size=1517748 2024-09-19T11:43:06.641 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.638+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~BYBA130PWAEW.0 size=1048576 2024-09-19T11:43:06.643 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.638+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~BYBA130PWAEW.1 size=1048576 2024-09-19T11:43:06.646 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.642+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~BYBA130PWAEW.2 size=30941 2024-09-19T11:43:06.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.646+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=BYBA130PWAEW tag=0AF2C7DUM2KN type=write size=3176669 2024-09-19T11:43:06.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.654+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~0795PJXB73K2.0 size=1048576 2024-09-19T11:43:06.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.654+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~0795PJXB73K2.1 size=1026880 2024-09-19T11:43:06.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.654+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=0795PJXB73K2 tag=8778GWLZ0XC0 type=write size=3124032 2024-09-19T11:43:06.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.658+0000 7f3d831968c0 -1 < failed to complete operation key=224HPC2Y95N6 tag=BWXDSTKRE3JV type=del size=3747440: (22) Invalid argument 2024-09-19T11:43:06.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.662+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=HZ016IEKOI44 type=del size=3120559 2024-09-19T11:43:06.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.666+0000 7f3d831968c0 1 < completed write operation key=8104Z4OQ7UWQ tag=QF2IA5RW5AEK type=write size=756678 2024-09-19T11:43:06.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.666+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=0SLNCZBRF2GK type=del size=506523 2024-09-19T11:43:06.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.670+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=C5JBQXA60HRO type=del 2024-09-19T11:43:06.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.678+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~0A6ZUGEEFZQ7.0 size=1048576 2024-09-19T11:43:06.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.678+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~0A6ZUGEEFZQ7.1 size=282298 2024-09-19T11:43:06.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.678+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=0A6ZUGEEFZQ7 tag=JBCL4POMB304 type=write size=2379450 2024-09-19T11:43:06.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.682+0000 7f3d831968c0 1 < canceled operation key=0OOB2SNLVK8E tag=8HYZH4KFK00M type=write size=913243 2024-09-19T11:43:06.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.686+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=5AT0KVEHUKK8 type=del size=1593476 2024-09-19T11:43:06.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.690+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=6K81T34DNFDW type=del 2024-09-19T11:43:06.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.690+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=G8S8RGKCLZHV type=write size=209583 2024-09-19T11:43:06.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.698+0000 7f3d831968c0 1 < suggested update operation key=JV7EGEI6062Y tag=H71CI4HI2D2M type=del size=106918 2024-09-19T11:43:06.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.702+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~QINDFF4IAM1Q.0 size=1048576 2024-09-19T11:43:06.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.702+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~QINDFF4IAM1Q.1 size=1014503 2024-09-19T11:43:06.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.702+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=QINDFF4IAM1Q tag=1RBPKA1LF02F type=write size=3111655 2024-09-19T11:43:06.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.706+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~AK9S1UTPEYMU.0 size=1048576 2024-09-19T11:43:06.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.710+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~AK9S1UTPEYMU.1 size=1048576 2024-09-19T11:43:06.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.710+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~AK9S1UTPEYMU.2 size=209721 2024-09-19T11:43:06.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.714+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=AK9S1UTPEYMU tag=P3PBVPXTCLUK type=write size=3355449 2024-09-19T11:43:06.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.718+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=561JR39WJ4UR type=del size=3651961 2024-09-19T11:43:06.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.722+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~36LW9JXSXRLC.0 size=1048576 2024-09-19T11:43:06.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.722+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~36LW9JXSXRLC.1 size=1048576 2024-09-19T11:43:06.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.722+0000 7f3d831968c0 1 < canceled part key=_multipart_FKLL38ZNCJ21.2~36LW9JXSXRLC.2 size=835273 2024-09-19T11:43:06.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.726+0000 7f3d831968c0 1 < canceled multipart upload key=FKLL38ZNCJ21 upload=36LW9JXSXRLC tag=FHU0IEA0WW94 type=write size=3981001 2024-09-19T11:43:06.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.730+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=K3U93GET2FCD type=del size=4049966 2024-09-19T11:43:06.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.734+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=7Y9SX331W04D type=del 2024-09-19T11:43:06.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.738+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~P924WOUE6V37.0 size=662840 2024-09-19T11:43:06.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.738+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=P924WOUE6V37 tag=5RTAEGGRY1ON type=write size=1711416 2024-09-19T11:43:06.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.742+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=WT1HXASL76VT type=del 2024-09-19T11:43:06.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.742+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=MSKYFP4APDT5 type=del size=2507168 2024-09-19T11:43:06.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.746+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~LET1HXJBBAS3.0 size=1048576 2024-09-19T11:43:06.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.750+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~LET1HXJBBAS3.1 size=834164 2024-09-19T11:43:06.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.754+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=LET1HXJBBAS3 tag=KIC8ROOV33YB type=write size=2931316 2024-09-19T11:43:06.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.754+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=10L6AVRS4PKI type=del size=71660 2024-09-19T11:43:06.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.758+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=3LZW7Z5RNIO9 type=del 2024-09-19T11:43:06.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.762+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=W7Z71QVI9AN6 type=del size=1535487 2024-09-19T11:43:06.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.762+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=WTH5B22I28ZQ type=del 2024-09-19T11:43:06.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.766+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=WNVD2MLKD0XZ type=del size=3856826 2024-09-19T11:43:06.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.770+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=DQ1JX3KEJZ55 type=del 2024-09-19T11:43:06.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.770+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=P7LAKZZU5FM5 type=del size=3320194 2024-09-19T11:43:06.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.774+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=OIRNRAL5UMIM type=del 2024-09-19T11:43:06.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.778+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~ZDFOJ02BKNRM.0 size=1048576 2024-09-19T11:43:06.787 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.782+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~ZDFOJ02BKNRM.1 size=1048576 2024-09-19T11:43:06.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.786+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~ZDFOJ02BKNRM.2 size=209339 2024-09-19T11:43:06.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.786+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=ZDFOJ02BKNRM tag=6XQVBUFMWEHI type=write size=3355067 2024-09-19T11:43:06.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.790+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~0795PJXB73K2.0 size=1048576 2024-09-19T11:43:06.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.790+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~0795PJXB73K2.1 size=1026880 2024-09-19T11:43:06.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.798+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=0795PJXB73K2 tag=8778GWLZ0XC0 type=write size=3124032 2024-09-19T11:43:06.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.798+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=CTWCJ1VB9E8P type=write size=347296 2024-09-19T11:43:06.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.802+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=HZ016IEKOI44 type=del 2024-09-19T11:43:06.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.810+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~NSEBEBWZPOB5.0 size=1048576 2024-09-19T11:43:06.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.810+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~NSEBEBWZPOB5.1 size=345813 2024-09-19T11:43:06.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.810+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=NSEBEBWZPOB5 tag=C7523LGLDY68 type=write size=2442965 2024-09-19T11:43:06.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.814+0000 7f3d831968c0 1 < canceled operation key=CULXGFLZ0HI6 tag=0SLNCZBRF2GK type=del size=506523 2024-09-19T11:43:06.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.818+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=606F61T9N2EO type=write size=475585 2024-09-19T11:43:06.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.822+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~0A6ZUGEEFZQ7.0 size=1048576 2024-09-19T11:43:06.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.826+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~0A6ZUGEEFZQ7.1 size=282298 2024-09-19T11:43:06.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.830+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=0A6ZUGEEFZQ7 tag=JBCL4POMB304 type=write size=2379450 2024-09-19T11:43:06.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.834+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=WJH973PSMRA1 type=del size=3163673 2024-09-19T11:43:06.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.838+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=5AT0KVEHUKK8 type=del 2024-09-19T11:43:06.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.838+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=H1TNCG3TIT2X type=del size=841390 2024-09-19T11:43:06.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.842+0000 7f3d831968c0 1 < completed write operation key=FKLL38ZNCJ21 tag=G8S8RGKCLZHV type=write size=209583 2024-09-19T11:43:06.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.846+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=WHF8WNXWNZ6Q type=del size=1306099 2024-09-19T11:43:06.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.850+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~QINDFF4IAM1Q.0 size=1048576 2024-09-19T11:43:06.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.854+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~QINDFF4IAM1Q.1 size=1014503 2024-09-19T11:43:06.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.858+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=QINDFF4IAM1Q tag=1RBPKA1LF02F type=write size=3111655 2024-09-19T11:43:06.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.862+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=MZQSORL9LXVL type=del size=2664277 2024-09-19T11:43:06.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.866+0000 7f3d831968c0 1 < suggested update operation key=3K8P37C015G3 tag=561JR39WJ4UR type=del size=3651961 2024-09-19T11:43:06.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.870+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=YHYGESNZO6XQ type=del size=3539563 2024-09-19T11:43:06.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.874+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=K3U93GET2FCD type=del 2024-09-19T11:43:06.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.878+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=ZB6R3L7YUM6H type=del size=1888176 2024-09-19T11:43:06.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.878+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~P924WOUE6V37.0 size=662840 2024-09-19T11:43:06.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.886+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=P924WOUE6V37 tag=5RTAEGGRY1ON type=write size=1711416 2024-09-19T11:43:06.893 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.890+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~MQTAVI9TKD7F.0 size=1048576 2024-09-19T11:43:06.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.890+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~MQTAVI9TKD7F.1 size=1048576 2024-09-19T11:43:06.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.898+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~MQTAVI9TKD7F.2 size=648408 2024-09-19T11:43:06.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.898+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=MQTAVI9TKD7F tag=K85XDMA5B2DL type=write size=3794136 2024-09-19T11:43:06.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.902+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=MSKYFP4APDT5 type=del 2024-09-19T11:43:06.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.902+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=MGBD7E58J79R type=write size=797774 2024-09-19T11:43:06.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.906+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=10L6AVRS4PKI type=del 2024-09-19T11:43:06.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.914+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~R6ZUFRVICENY.0 size=1048576 2024-09-19T11:43:06.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.918+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~R6ZUFRVICENY.1 size=550706 2024-09-19T11:43:06.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.918+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=R6ZUFRVICENY tag=3HP4J3XSJD6T type=write size=2647858 2024-09-19T11:43:06.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.918+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=W7Z71QVI9AN6 type=del 2024-09-19T11:43:06.927 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.922+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=5RGOGPXE44TS type=del size=1680483 2024-09-19T11:43:06.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.926+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=WNVD2MLKD0XZ type=del 2024-09-19T11:43:06.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.930+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=TMAC2BSL8BBH type=del size=761908 2024-09-19T11:43:06.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.934+0000 7f3d831968c0 1 < canceled operation key=JTPBGWC4T3Y5 tag=P7LAKZZU5FM5 type=del size=3320194 2024-09-19T11:43:06.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.938+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=OBQ3YWQATQSJ type=del size=1255522 2024-09-19T11:43:06.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.942+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~ZDFOJ02BKNRM.0 size=1048576 2024-09-19T11:43:06.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.942+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~ZDFOJ02BKNRM.1 size=1048576 2024-09-19T11:43:06.951 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.946+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~ZDFOJ02BKNRM.2 size=209339 2024-09-19T11:43:06.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.954+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=ZDFOJ02BKNRM tag=6XQVBUFMWEHI type=write size=3355067 2024-09-19T11:43:06.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.958+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=XM9IJ9RTWROC type=del size=3965568 2024-09-19T11:43:06.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.958+0000 7f3d831968c0 1 < completed write operation key=JV7EGEI6062Y tag=CTWCJ1VB9E8P type=write size=347296 2024-09-19T11:43:06.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.966+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~HVL9FJY0W4UY.0 size=1048576 2024-09-19T11:43:06.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.970+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~HVL9FJY0W4UY.1 size=469532 2024-09-19T11:43:06.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.970+0000 7f3d831968c0 1 > prepared multipart upload key=JTPBGWC4T3Y5 upload=HVL9FJY0W4UY tag=ZYGF1FBMWJR4 type=write size=2566684 2024-09-19T11:43:06.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.974+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~NSEBEBWZPOB5.0 size=1048576 2024-09-19T11:43:06.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.978+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~NSEBEBWZPOB5.1 size=345813 2024-09-19T11:43:06.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.982+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=NSEBEBWZPOB5 tag=C7523LGLDY68 type=write size=2442965 2024-09-19T11:43:06.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.986+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=X244EGRV98FL type=del size=2024750 2024-09-19T11:43:06.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.990+0000 7f3d831968c0 1 < completed write operation key=3GD7UZCI3WX4 tag=606F61T9N2EO type=write size=475585 2024-09-19T11:43:07.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.998+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~07MLQW7HSZR8.0 size=1048576 2024-09-19T11:43:07.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:06.998+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~07MLQW7HSZR8.1 size=1048576 2024-09-19T11:43:07.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.002+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~07MLQW7HSZR8.2 size=894993 2024-09-19T11:43:07.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.002+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=07MLQW7HSZR8 tag=FGC12VWPNOSW type=write size=4040721 2024-09-19T11:43:07.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.006+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=WJH973PSMRA1 type=del 2024-09-19T11:43:07.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.010+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=OOA3CSTPP9BN type=write size=299997 2024-09-19T11:43:07.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.014+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=H1TNCG3TIT2X type=del 2024-09-19T11:43:07.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.014+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=EFVHYI905A5B type=del size=629645 2024-09-19T11:43:07.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.022+0000 7f3d831968c0 1 < suggested update operation key=KAPKNZJ2DE6A tag=WHF8WNXWNZ6Q type=del size=1306099 2024-09-19T11:43:07.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.030+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~2AX8L5W3MZ5G.0 size=1048576 2024-09-19T11:43:07.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.030+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~2AX8L5W3MZ5G.1 size=1048576 2024-09-19T11:43:07.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.034+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~2AX8L5W3MZ5G.2 size=1027562 2024-09-19T11:43:07.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.034+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=2AX8L5W3MZ5G tag=7TMKTK8FJCJB type=write size=4173290 2024-09-19T11:43:07.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.042+0000 7f3d831968c0 1 < suggested update operation key=900RV3451AON tag=MZQSORL9LXVL type=del size=2664277 2024-09-19T11:43:07.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.046+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=RJUIPNGC1DUR type=del size=2754963 2024-09-19T11:43:07.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.046+0000 7f3d831968c0 1 < completed delete operation key=PB62JE7I55GG tag=YHYGESNZO6XQ type=del 2024-09-19T11:43:07.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.050+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=RVDT533R126T type=del size=3452491 2024-09-19T11:43:07.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.054+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=ZB6R3L7YUM6H type=del 2024-09-19T11:43:07.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.058+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=22SF1OJ6JEJF type=del size=3754781 2024-09-19T11:43:07.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.062+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~MQTAVI9TKD7F.0 size=1048576 2024-09-19T11:43:07.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.066+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~MQTAVI9TKD7F.1 size=1048576 2024-09-19T11:43:07.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.070+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~MQTAVI9TKD7F.2 size=648408 2024-09-19T11:43:07.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.074+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=MQTAVI9TKD7F tag=K85XDMA5B2DL type=write size=3794136 2024-09-19T11:43:07.084 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.078+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~7AOVA38CHRI9.0 size=1048576 2024-09-19T11:43:07.087 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.082+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~7AOVA38CHRI9.1 size=1048576 2024-09-19T11:43:07.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.086+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~7AOVA38CHRI9.2 size=254167 2024-09-19T11:43:07.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.086+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=7AOVA38CHRI9 tag=IZDSUHB33A55 type=write size=3399895 2024-09-19T11:43:07.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.090+0000 7f3d831968c0 1 < suggested update operation key=FZGRZ06MOHBI tag=MGBD7E58J79R type=write size=797774 2024-09-19T11:43:07.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.094+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=115PSEXOCLNL type=del size=2399639 2024-09-19T11:43:07.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.098+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~R6ZUFRVICENY.0 size=1048576 2024-09-19T11:43:07.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.102+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~R6ZUFRVICENY.1 size=550706 2024-09-19T11:43:07.112 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.110+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=R6ZUFRVICENY tag=3HP4J3XSJD6T type=write size=2647858 2024-09-19T11:43:07.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.110+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=AB2V8SUJSHKK type=del size=531873 2024-09-19T11:43:07.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.118+0000 7f3d831968c0 1 < suggested update operation key=00DYD22W0ZNB tag=5RGOGPXE44TS type=del size=1680483 2024-09-19T11:43:07.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.122+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=XW35T3PASK7C type=del size=1860145 2024-09-19T11:43:07.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.130+0000 7f3d831968c0 1 < suggested remove operation key=QPG75T46BH38 tag=TMAC2BSL8BBH type=del 2024-09-19T11:43:07.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.134+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~XDH4BRJCGIQL.0 size=1048576 2024-09-19T11:43:07.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.138+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~XDH4BRJCGIQL.1 size=1048576 2024-09-19T11:43:07.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.138+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~XDH4BRJCGIQL.2 size=965374 2024-09-19T11:43:07.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.138+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=XDH4BRJCGIQL tag=XIM52UZWE9XD type=write size=4111102 2024-09-19T11:43:07.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.142+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=OBQ3YWQATQSJ type=del 2024-09-19T11:43:07.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.150+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~8NUIM66GTUM4.0 size=1048576 2024-09-19T11:43:07.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.150+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~8NUIM66GTUM4.1 size=1048576 2024-09-19T11:43:07.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.154+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~8NUIM66GTUM4.2 size=60034 2024-09-19T11:43:07.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.154+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=8NUIM66GTUM4 tag=VPK3U82VZ0KE type=write size=3205762 2024-09-19T11:43:07.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.158+0000 7f3d831968c0 -1 < failed to complete operation key=FZGRZ06MOHBI tag=XM9IJ9RTWROC type=del size=3965568: (22) Invalid argument 2024-09-19T11:43:07.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.158+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=FCWAXJPN9DMB type=del size=2352908 2024-09-19T11:43:07.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.162+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~HVL9FJY0W4UY.0 size=1048576 2024-09-19T11:43:07.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.166+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~HVL9FJY0W4UY.1 size=469532 2024-09-19T11:43:07.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.170+0000 7f3d831968c0 1 < completed multipart upload key=JTPBGWC4T3Y5 upload=HVL9FJY0W4UY tag=ZYGF1FBMWJR4 type=write size=2566684 2024-09-19T11:43:07.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.174+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=TIBHK5CWXV73 type=write size=473398 2024-09-19T11:43:07.186 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.182+0000 7f3d831968c0 1 < suggested remove operation key=G4P6HIOM1G2E tag=X244EGRV98FL type=del 2024-09-19T11:43:07.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.190+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~EOF25V3BN8NP.0 size=1048576 2024-09-19T11:43:07.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.190+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~EOF25V3BN8NP.1 size=720565 2024-09-19T11:43:07.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.190+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=EOF25V3BN8NP tag=VPSN26ZUT8OR type=write size=2817717 2024-09-19T11:43:07.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.194+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~07MLQW7HSZR8.0 size=1048576 2024-09-19T11:43:07.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.198+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~07MLQW7HSZR8.1 size=1048576 2024-09-19T11:43:07.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.198+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~07MLQW7HSZR8.2 size=894993 2024-09-19T11:43:07.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.206+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=07MLQW7HSZR8 tag=FGC12VWPNOSW type=write size=4040721 2024-09-19T11:43:07.213 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.210+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=DLIVRFMZ2Y24 type=del size=3034727 2024-09-19T11:43:07.217 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.214+0000 7f3d831968c0 1 < completed write operation key=LINLTWYV88VU tag=OOA3CSTPP9BN type=write size=299997 2024-09-19T11:43:07.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.222+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~J41L9VFE26JA.0 size=1048576 2024-09-19T11:43:07.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.226+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~J41L9VFE26JA.1 size=410641 2024-09-19T11:43:07.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.226+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=J41L9VFE26JA tag=P622BNUL6FJ4 type=write size=2507793 2024-09-19T11:43:07.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.230+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=EFVHYI905A5B type=del 2024-09-19T11:43:07.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.230+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=QG994WL8IDA4 type=del size=78402 2024-09-19T11:43:07.239 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.234+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~2AX8L5W3MZ5G.0 size=1048576 2024-09-19T11:43:07.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.238+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~2AX8L5W3MZ5G.1 size=1048576 2024-09-19T11:43:07.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.238+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~2AX8L5W3MZ5G.2 size=1027562 2024-09-19T11:43:07.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.242+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=2AX8L5W3MZ5G tag=7TMKTK8FJCJB type=write size=4173290 2024-09-19T11:43:07.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.246+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=3TB5I6LEF6VF type=del size=1709592 2024-09-19T11:43:07.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.254+0000 7f3d831968c0 1 < suggested update operation key=2VJRZVU7S8LB tag=RJUIPNGC1DUR type=del size=2754963 2024-09-19T11:43:07.260 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.254+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=JPB77AHN16MO type=del size=805655 2024-09-19T11:43:07.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.258+0000 7f3d831968c0 1 < canceled operation key=KAPKNZJ2DE6A tag=RVDT533R126T type=del size=3452491 2024-09-19T11:43:07.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.266+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~N4758FD7ZOYR.0 size=1048576 2024-09-19T11:43:07.272 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.270+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~N4758FD7ZOYR.1 size=1048576 2024-09-19T11:43:07.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.270+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~N4758FD7ZOYR.2 size=700428 2024-09-19T11:43:07.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.270+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=N4758FD7ZOYR tag=7AJP4373RN8S type=write size=3846156 2024-09-19T11:43:07.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.274+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=22SF1OJ6JEJF type=del 2024-09-19T11:43:07.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.282+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~KXV02V4CPNIL.0 size=1048576 2024-09-19T11:43:07.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.282+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~KXV02V4CPNIL.1 size=642966 2024-09-19T11:43:07.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.282+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=KXV02V4CPNIL tag=S6C617SL7PBA type=write size=2740118 2024-09-19T11:43:07.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.286+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~7AOVA38CHRI9.0 size=1048576 2024-09-19T11:43:07.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.290+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~7AOVA38CHRI9.1 size=1048576 2024-09-19T11:43:07.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.290+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~7AOVA38CHRI9.2 size=254167 2024-09-19T11:43:07.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.298+0000 7f3d831968c0 1 < completed multipart upload key=LINLTWYV88VU upload=7AOVA38CHRI9 tag=IZDSUHB33A55 type=write size=3399895 2024-09-19T11:43:07.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.302+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=N9821M23JFWW type=write size=885619 2024-09-19T11:43:07.308 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.306+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=115PSEXOCLNL type=del 2024-09-19T11:43:07.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.306+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=7AWB6W3D4LC5 type=del size=3045583 2024-09-19T11:43:07.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.314+0000 7f3d831968c0 1 < suggested update operation key=I5XUMA2HKIR5 tag=AB2V8SUJSHKK type=del size=531873 2024-09-19T11:43:07.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.318+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=9RC4WQ5MPSXK type=del size=2785003 2024-09-19T11:43:07.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.318+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=XW35T3PASK7C type=del 2024-09-19T11:43:07.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.322+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=W6VKNTHRF8HO type=write size=14100 2024-09-19T11:43:07.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.326+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~XDH4BRJCGIQL.0 size=1048576 2024-09-19T11:43:07.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.330+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~XDH4BRJCGIQL.1 size=1048576 2024-09-19T11:43:07.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.330+0000 7f3d831968c0 1 < canceled part key=_multipart_6NLQ0BK8AJUO.2~XDH4BRJCGIQL.2 size=965374 2024-09-19T11:43:07.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.334+0000 7f3d831968c0 1 < canceled multipart upload key=6NLQ0BK8AJUO upload=XDH4BRJCGIQL tag=XIM52UZWE9XD type=write size=4111102 2024-09-19T11:43:07.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.338+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~75Z0F7NIWP9L.0 size=1048576 2024-09-19T11:43:07.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.342+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~75Z0F7NIWP9L.1 size=1048576 2024-09-19T11:43:07.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.342+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~75Z0F7NIWP9L.2 size=311326 2024-09-19T11:43:07.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.342+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=75Z0F7NIWP9L tag=WOABKYJJOUNM type=write size=3457054 2024-09-19T11:43:07.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.346+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~8NUIM66GTUM4.0 size=1048576 2024-09-19T11:43:07.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.350+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~8NUIM66GTUM4.1 size=1048576 2024-09-19T11:43:07.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.354+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~8NUIM66GTUM4.2 size=60034 2024-09-19T11:43:07.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.358+0000 7f3d831968c0 1 < completed multipart upload key=5RTONAWGYJNE upload=8NUIM66GTUM4 tag=VPK3U82VZ0KE type=write size=3205762 2024-09-19T11:43:07.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.362+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=HZPVO4J5TBCK type=del size=2099979 2024-09-19T11:43:07.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.362+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=FCWAXJPN9DMB type=del 2024-09-19T11:43:07.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.366+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=52XIPAMCN75J type=del size=1652682 2024-09-19T11:43:07.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.370+0000 7f3d831968c0 1 < completed write operation key=QPG75T46BH38 tag=TIBHK5CWXV73 type=write size=473398 2024-09-19T11:43:07.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.374+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~OBEFX5KVGVQ2.0 size=1048576 2024-09-19T11:43:07.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.378+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~OBEFX5KVGVQ2.1 size=299353 2024-09-19T11:43:07.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.378+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=OBEFX5KVGVQ2 tag=X0EWZ2YG230V type=write size=2396505 2024-09-19T11:43:07.385 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.382+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~EOF25V3BN8NP.0 size=1048576 2024-09-19T11:43:07.385 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.382+0000 7f3d831968c0 1 < canceled part key=_multipart_0OOB2SNLVK8E.2~EOF25V3BN8NP.1 size=720565 2024-09-19T11:43:07.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.386+0000 7f3d831968c0 1 < canceled multipart upload key=0OOB2SNLVK8E upload=EOF25V3BN8NP tag=VPSN26ZUT8OR type=write size=2817717 2024-09-19T11:43:07.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.390+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=PSPCV68YP5JV type=del size=4132155 2024-09-19T11:43:07.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.394+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=DLIVRFMZ2Y24 type=del 2024-09-19T11:43:07.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.398+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~0M169DI6FS1X.0 size=423045 2024-09-19T11:43:07.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.398+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=0M169DI6FS1X tag=3SXCUBPVRFKQ type=write size=1471621 2024-09-19T11:43:07.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.402+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~J41L9VFE26JA.0 size=1048576 2024-09-19T11:43:07.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.406+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~J41L9VFE26JA.1 size=410641 2024-09-19T11:43:07.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.410+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=J41L9VFE26JA tag=P622BNUL6FJ4 type=write size=2507793 2024-09-19T11:43:07.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.414+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=39R2JB1GGDHK type=write size=114930 2024-09-19T11:43:07.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.414+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=QG994WL8IDA4 type=del 2024-09-19T11:43:07.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.418+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=JRDOVLQA0ASG type=del size=646435 2024-09-19T11:43:07.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.426+0000 7f3d831968c0 1 < suggested remove operation key=5RTONAWGYJNE tag=3TB5I6LEF6VF type=del 2024-09-19T11:43:07.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.430+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~YCMEKGJH7VP1.0 size=1048576 2024-09-19T11:43:07.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.434+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~YCMEKGJH7VP1.1 size=317586 2024-09-19T11:43:07.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.434+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=YCMEKGJH7VP1 tag=AIE54TNTTDHT type=write size=2414738 2024-09-19T11:43:07.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.438+0000 7f3d831968c0 1 < suggested update operation key=FKLL38ZNCJ21 tag=JPB77AHN16MO type=del size=805655 2024-09-19T11:43:07.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.442+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=WYZAHLT4TYUS type=del size=1871677 2024-09-19T11:43:07.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.446+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~N4758FD7ZOYR.0 size=1048576 2024-09-19T11:43:07.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.450+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~N4758FD7ZOYR.1 size=1048576 2024-09-19T11:43:07.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.450+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~N4758FD7ZOYR.2 size=700428 2024-09-19T11:43:07.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.458+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=N4758FD7ZOYR tag=7AJP4373RN8S type=write size=3846156 2024-09-19T11:43:07.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.462+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=LQH6T9KLCG6C type=write size=487284 2024-09-19T11:43:07.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.462+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~KXV02V4CPNIL.0 size=1048576 2024-09-19T11:43:07.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.462+0000 7f3d831968c0 1 < canceled part key=_multipart_E8OFSMUZHR02.2~KXV02V4CPNIL.1 size=642966 2024-09-19T11:43:07.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.470+0000 7f3d831968c0 1 < canceled multipart upload key=E8OFSMUZHR02 upload=KXV02V4CPNIL tag=S6C617SL7PBA type=write size=2740118 2024-09-19T11:43:07.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.474+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=Y6LXC68ETMV1 type=del size=2548183 2024-09-19T11:43:07.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.478+0000 7f3d831968c0 1 < completed write operation key=CULXGFLZ0HI6 tag=N9821M23JFWW type=write size=885619 2024-09-19T11:43:07.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.478+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=3Y19ADB5APPJ type=del size=673748 2024-09-19T11:43:07.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.482+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=7AWB6W3D4LC5 type=del 2024-09-19T11:43:07.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.486+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~RX7DKJ70Y6E6.0 size=1048576 2024-09-19T11:43:07.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.490+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~RX7DKJ70Y6E6.1 size=1048576 2024-09-19T11:43:07.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.490+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~RX7DKJ70Y6E6.2 size=74387 2024-09-19T11:43:07.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.490+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=RX7DKJ70Y6E6 tag=C9M751V0149S type=write size=3220115 2024-09-19T11:43:07.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.498+0000 7f3d831968c0 1 < suggested update operation key=KAPKNZJ2DE6A tag=9RC4WQ5MPSXK type=del size=2785003 2024-09-19T11:43:07.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.506+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~1S2X0IAXREIJ.0 size=1048576 2024-09-19T11:43:07.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.506+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~1S2X0IAXREIJ.1 size=831039 2024-09-19T11:43:07.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.506+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=1S2X0IAXREIJ tag=Q530CR0EJ505 type=write size=2928191 2024-09-19T11:43:07.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.514+0000 7f3d831968c0 1 < completed write operation key=PB62JE7I55GG tag=W6VKNTHRF8HO type=write size=14100 2024-09-19T11:43:07.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.518+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~HEPU99VK4PII.0 size=572812 2024-09-19T11:43:07.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.518+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=HEPU99VK4PII tag=0ETYKZE6CW6O type=write size=1621388 2024-09-19T11:43:07.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.522+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~75Z0F7NIWP9L.0 size=1048576 2024-09-19T11:43:07.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.526+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~75Z0F7NIWP9L.1 size=1048576 2024-09-19T11:43:07.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.526+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~75Z0F7NIWP9L.2 size=311326 2024-09-19T11:43:07.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.530+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=75Z0F7NIWP9L tag=WOABKYJJOUNM type=write size=3457054 2024-09-19T11:43:07.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.538+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~0EEIFF81XWTD.0 size=405930 2024-09-19T11:43:07.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.538+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=0EEIFF81XWTD tag=WNG8C0X224M4 type=write size=1454506 2024-09-19T11:43:07.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.538+0000 7f3d831968c0 -1 < failed to complete operation key=FKLL38ZNCJ21 tag=HZPVO4J5TBCK type=del size=2099979: (22) Invalid argument 2024-09-19T11:43:07.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.542+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=9S9HEC9OJAPK type=del size=777619 2024-09-19T11:43:07.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.546+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=52XIPAMCN75J type=del 2024-09-19T11:43:07.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.546+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=HIWQYEJEX56D type=del size=1121749 2024-09-19T11:43:07.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.550+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~OBEFX5KVGVQ2.0 size=1048576 2024-09-19T11:43:07.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.550+0000 7f3d831968c0 1 < canceled part key=_multipart_PB62JE7I55GG.2~OBEFX5KVGVQ2.1 size=299353 2024-09-19T11:43:07.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.554+0000 7f3d831968c0 1 < canceled multipart upload key=PB62JE7I55GG upload=OBEFX5KVGVQ2 tag=X0EWZ2YG230V type=write size=2396505 2024-09-19T11:43:07.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.558+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=SIWE801N5WVO type=del size=3591254 2024-09-19T11:43:07.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.562+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=PSPCV68YP5JV type=del 2024-09-19T11:43:07.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.562+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=Y3GC7KZWITPN type=del size=2926864 2024-09-19T11:43:07.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.566+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~0M169DI6FS1X.0 size=423045 2024-09-19T11:43:07.576 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.570+0000 7f3d831968c0 1 < completed multipart upload key=3GD7UZCI3WX4 upload=0M169DI6FS1X tag=3SXCUBPVRFKQ type=write size=1471621 2024-09-19T11:43:07.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.574+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=VNN4AKALH35V type=del size=1052160 2024-09-19T11:43:07.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.578+0000 7f3d831968c0 -1 < failed to complete operation key=KAPKNZJ2DE6A tag=39R2JB1GGDHK type=write size=114930: (22) Invalid argument 2024-09-19T11:43:07.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.582+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=IZAW6X78CAZA type=write size=402301 2024-09-19T11:43:07.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.582+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=JRDOVLQA0ASG type=del 2024-09-19T11:43:07.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.590+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~LP0N1FR2RJ2V.0 size=1048576 2024-09-19T11:43:07.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.590+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~LP0N1FR2RJ2V.1 size=1048576 2024-09-19T11:43:07.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.594+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~LP0N1FR2RJ2V.2 size=896537 2024-09-19T11:43:07.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.594+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=LP0N1FR2RJ2V tag=2VYBXM5C0O18 type=write size=4042265 2024-09-19T11:43:07.603 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.598+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~YCMEKGJH7VP1.0 size=1048576 2024-09-19T11:43:07.606 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.602+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~YCMEKGJH7VP1.1 size=317586 2024-09-19T11:43:07.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.606+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=YCMEKGJH7VP1 tag=AIE54TNTTDHT type=write size=2414738 2024-09-19T11:43:07.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.610+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=1SPY9QWQBFZN type=del size=2578865 2024-09-19T11:43:07.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.614+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=WYZAHLT4TYUS type=del 2024-09-19T11:43:07.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.622+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~EXF9Y4CKAEZU.0 size=1048576 2024-09-19T11:43:07.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.622+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~EXF9Y4CKAEZU.1 size=1048576 2024-09-19T11:43:07.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.626+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~EXF9Y4CKAEZU.2 size=482975 2024-09-19T11:43:07.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.626+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=EXF9Y4CKAEZU tag=9SLD5MBXLE55 type=write size=3628703 2024-09-19T11:43:07.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.630+0000 7f3d831968c0 1 < suggested update operation key=00DYD22W0ZNB tag=LQH6T9KLCG6C type=write size=487284 2024-09-19T11:43:07.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.634+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=IBYDC436B4FD type=write size=779860 2024-09-19T11:43:07.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.634+0000 7f3d831968c0 -1 < failed to complete operation key=KAPKNZJ2DE6A tag=Y6LXC68ETMV1 type=del size=2548183: (22) Invalid argument 2024-09-19T11:43:07.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.638+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~O00FXSWI9IDG.0 size=1048576 2024-09-19T11:43:07.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.642+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~O00FXSWI9IDG.1 size=1048576 2024-09-19T11:43:07.647 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.642+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~O00FXSWI9IDG.2 size=891873 2024-09-19T11:43:07.647 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.642+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=O00FXSWI9IDG tag=E41II0YVLKU0 type=write size=4037601 2024-09-19T11:43:07.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.646+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=3Y19ADB5APPJ type=del 2024-09-19T11:43:07.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.650+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~A8BH46JP6QDT.0 size=1048576 2024-09-19T11:43:07.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.650+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~A8BH46JP6QDT.1 size=1048576 2024-09-19T11:43:07.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.654+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~A8BH46JP6QDT.2 size=16918 2024-09-19T11:43:07.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.654+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=A8BH46JP6QDT tag=USS7WJ28E2PD type=write size=3162646 2024-09-19T11:43:07.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.654+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~RX7DKJ70Y6E6.0 size=1048576 2024-09-19T11:43:07.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.658+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~RX7DKJ70Y6E6.1 size=1048576 2024-09-19T11:43:07.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.658+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~RX7DKJ70Y6E6.2 size=74387 2024-09-19T11:43:07.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.662+0000 7f3d831968c0 1 < completed multipart upload key=EVFF0F0760OS upload=RX7DKJ70Y6E6 tag=C9M751V0149S type=write size=3220115 2024-09-19T11:43:07.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.662+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=RJKPW8W4IEX4 type=del size=4088965 2024-09-19T11:43:07.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.666+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~1S2X0IAXREIJ.0 size=1048576 2024-09-19T11:43:07.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.670+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~1S2X0IAXREIJ.1 size=831039 2024-09-19T11:43:07.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.670+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=1S2X0IAXREIJ tag=Q530CR0EJ505 type=write size=2928191 2024-09-19T11:43:07.678 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.674+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=LIJJQ9G6BC4X type=write size=938404 2024-09-19T11:43:07.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.678+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~HEPU99VK4PII.0 size=572812 2024-09-19T11:43:07.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.682+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=HEPU99VK4PII tag=0ETYKZE6CW6O type=write size=1621388 2024-09-19T11:43:07.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.682+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=NJVPHKZL50KZ type=del size=176510 2024-09-19T11:43:07.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.686+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~0EEIFF81XWTD.0 size=405930 2024-09-19T11:43:07.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.690+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=0EEIFF81XWTD tag=WNG8C0X224M4 type=write size=1454506 2024-09-19T11:43:07.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.694+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~OYGAWA6LT7WX.0 size=1048576 2024-09-19T11:43:07.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.694+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~OYGAWA6LT7WX.1 size=1048576 2024-09-19T11:43:07.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.698+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~OYGAWA6LT7WX.2 size=803062 2024-09-19T11:43:07.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.698+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=OYGAWA6LT7WX tag=WBIOWSURQTJO type=write size=3948790 2024-09-19T11:43:07.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.698+0000 7f3d831968c0 1 < suggested remove operation key=G4P6HIOM1G2E tag=9S9HEC9OJAPK type=del 2024-09-19T11:43:07.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.702+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~PIVRJNNNFFV3.0 size=710551 2024-09-19T11:43:07.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.702+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=PIVRJNNNFFV3 tag=HVBGSYH0WCZL type=write size=1759127 2024-09-19T11:43:07.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.706+0000 7f3d831968c0 1 < suggested remove operation key=KAPKNZJ2DE6A tag=HIWQYEJEX56D type=del 2024-09-19T11:43:07.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.710+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=7PKUO8F6BFQL type=del size=3008623 2024-09-19T11:43:07.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.714+0000 7f3d831968c0 -1 < failed to complete operation key=G4P6HIOM1G2E tag=SIWE801N5WVO type=del size=3591254: (22) Invalid argument 2024-09-19T11:43:07.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.718+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~YTDTGXHLDVQK.0 size=1048576 2024-09-19T11:43:07.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.718+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~YTDTGXHLDVQK.1 size=1048576 2024-09-19T11:43:07.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.722+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~YTDTGXHLDVQK.2 size=321110 2024-09-19T11:43:07.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.722+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=YTDTGXHLDVQK tag=6MXDD0ZF64RB type=write size=3466838 2024-09-19T11:43:07.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.722+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=Y3GC7KZWITPN type=del 2024-09-19T11:43:07.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.726+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=N84C7Y6KO7Q1 type=write size=559681 2024-09-19T11:43:07.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.726+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=VNN4AKALH35V type=del 2024-09-19T11:43:07.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.730+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=LNI5RKQI197R type=del size=808036 2024-09-19T11:43:07.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.730+0000 7f3d831968c0 1 < completed write operation key=UI7EVZ1SGD8R tag=IZAW6X78CAZA type=write size=402301 2024-09-19T11:43:07.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.734+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=CJ3J0YJ2SQPM type=write size=266972 2024-09-19T11:43:07.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.738+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~LP0N1FR2RJ2V.0 size=1048576 2024-09-19T11:43:07.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.738+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~LP0N1FR2RJ2V.1 size=1048576 2024-09-19T11:43:07.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.742+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~LP0N1FR2RJ2V.2 size=896537 2024-09-19T11:43:07.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.746+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=LP0N1FR2RJ2V tag=2VYBXM5C0O18 type=write size=4042265 2024-09-19T11:43:07.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.750+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=EEWB5UTS0UAZ type=del size=1481890 2024-09-19T11:43:07.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.754+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=1SPY9QWQBFZN type=del 2024-09-19T11:43:07.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.758+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=07PZO12YG7LR type=write size=156040 2024-09-19T11:43:07.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.758+0000 7f3d831968c0 1 < canceled part key=_multipart_G4P6HIOM1G2E.2~EXF9Y4CKAEZU.0 size=1048576 2024-09-19T11:43:07.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.758+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~EXF9Y4CKAEZU.1 size=1048576 2024-09-19T11:43:07.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.758+0000 7f3d831968c0 1 < canceled part key=_multipart_G4P6HIOM1G2E.2~EXF9Y4CKAEZU.2 size=482975 2024-09-19T11:43:07.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.762+0000 7f3d831968c0 1 < canceled multipart upload key=G4P6HIOM1G2E upload=EXF9Y4CKAEZU tag=9SLD5MBXLE55 type=write size=3628703 2024-09-19T11:43:07.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.766+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~3PHIF36U93NS.0 size=557626 2024-09-19T11:43:07.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.766+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=3PHIF36U93NS tag=6DQF794TBU5A type=write size=1606202 2024-09-19T11:43:07.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.770+0000 7f3d831968c0 1 < completed write operation key=224HPC2Y95N6 tag=IBYDC436B4FD type=write size=779860 2024-09-19T11:43:07.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.774+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~EN3M3WWZ98LI.0 size=1048576 2024-09-19T11:43:07.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.774+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~EN3M3WWZ98LI.1 size=1048576 2024-09-19T11:43:07.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.778+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~EN3M3WWZ98LI.2 size=968330 2024-09-19T11:43:07.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.778+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=EN3M3WWZ98LI tag=THVA16EO5GY4 type=write size=4114058 2024-09-19T11:43:07.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.778+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~O00FXSWI9IDG.0 size=1048576 2024-09-19T11:43:07.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.782+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~O00FXSWI9IDG.1 size=1048576 2024-09-19T11:43:07.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.782+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~O00FXSWI9IDG.2 size=891873 2024-09-19T11:43:07.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.786+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=O00FXSWI9IDG tag=E41II0YVLKU0 type=write size=4037601 2024-09-19T11:43:07.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.790+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~3L1A6FM6DSLW.0 size=744396 2024-09-19T11:43:07.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.790+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=3L1A6FM6DSLW tag=FDJMZM87F3II type=write size=1792972 2024-09-19T11:43:07.797 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.794+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~A8BH46JP6QDT.0 size=1048576 2024-09-19T11:43:07.798 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.794+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~A8BH46JP6QDT.1 size=1048576 2024-09-19T11:43:07.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.798+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~A8BH46JP6QDT.2 size=16918 2024-09-19T11:43:07.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.798+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=A8BH46JP6QDT tag=USS7WJ28E2PD type=write size=3162646 2024-09-19T11:43:07.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.802+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=1VFOH24047M8 type=del size=4110241 2024-09-19T11:43:07.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.806+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=RJKPW8W4IEX4 type=del 2024-09-19T11:43:07.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.810+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~WO9P82SGDHGO.0 size=1048576 2024-09-19T11:43:07.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.810+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~WO9P82SGDHGO.1 size=1048576 2024-09-19T11:43:07.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.814+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~WO9P82SGDHGO.2 size=265392 2024-09-19T11:43:07.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.814+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=WO9P82SGDHGO tag=X3LKSYSCSW7C type=write size=3411120 2024-09-19T11:43:07.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.814+0000 7f3d831968c0 1 < canceled operation key=UI7EVZ1SGD8R tag=LIJJQ9G6BC4X type=write size=938404 2024-09-19T11:43:07.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.818+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~LTCKGGBUC75G.0 size=935058 2024-09-19T11:43:07.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.818+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=LTCKGGBUC75G tag=RO43L55U5P7O type=write size=1983634 2024-09-19T11:43:07.824 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.822+0000 7f3d831968c0 1 < canceled operation key=00DYD22W0ZNB tag=NJVPHKZL50KZ type=del size=176510 2024-09-19T11:43:07.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.826+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~LSHLD3TF62Y3.0 size=1048576 2024-09-19T11:43:07.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.826+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~LSHLD3TF62Y3.1 size=1021435 2024-09-19T11:43:07.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.826+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=LSHLD3TF62Y3 tag=BC76ATAKD09D type=write size=3118587 2024-09-19T11:43:07.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.826+0000 7f3d831968c0 1 < canceled part key=_multipart_3GD7UZCI3WX4.2~OYGAWA6LT7WX.0 size=1048576 2024-09-19T11:43:07.832 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.830+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~OYGAWA6LT7WX.1 size=1048576 2024-09-19T11:43:07.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.830+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~OYGAWA6LT7WX.2 size=803062 2024-09-19T11:43:07.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.834+0000 7f3d831968c0 1 < canceled multipart upload key=3GD7UZCI3WX4 upload=OYGAWA6LT7WX tag=WBIOWSURQTJO type=write size=3948790 2024-09-19T11:43:07.840 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.834+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=PRFS5L7RE11P type=del size=976054 2024-09-19T11:43:07.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.838+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~PIVRJNNNFFV3.0 size=710551 2024-09-19T11:43:07.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.842+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=PIVRJNNNFFV3 tag=HVBGSYH0WCZL type=write size=1759127 2024-09-19T11:43:07.849 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.842+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=EA3BXHWKNU3J type=del size=335369 2024-09-19T11:43:07.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.846+0000 7f3d831968c0 1 < suggested remove operation key=EVFF0F0760OS tag=7PKUO8F6BFQL type=del 2024-09-19T11:43:07.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.850+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=508SPYGZ7JLO type=del size=2679030 2024-09-19T11:43:07.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.854+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~YTDTGXHLDVQK.0 size=1048576 2024-09-19T11:43:07.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.854+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~YTDTGXHLDVQK.1 size=1048576 2024-09-19T11:43:07.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.854+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~YTDTGXHLDVQK.2 size=321110 2024-09-19T11:43:07.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.858+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=YTDTGXHLDVQK tag=6MXDD0ZF64RB type=write size=3466838 2024-09-19T11:43:07.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.862+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=YWBGEYRBX20E type=del size=3717215 2024-09-19T11:43:07.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.866+0000 7f3d831968c0 1 < suggested update operation key=T9KJH2ZYCLVA tag=N84C7Y6KO7Q1 type=write size=559681 2024-09-19T11:43:07.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.870+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~KWLJ0PAM3145.0 size=680774 2024-09-19T11:43:07.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.870+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=KWLJ0PAM3145 tag=VOVJ8VG0LNBA type=write size=1729350 2024-09-19T11:43:07.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.874+0000 7f3d831968c0 1 < suggested update operation key=QPG75T46BH38 tag=LNI5RKQI197R type=del size=808036 2024-09-19T11:43:07.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.878+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=SQITNXHUEVMM type=write size=763375 2024-09-19T11:43:07.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.878+0000 7f3d831968c0 1 < completed write operation key=8104Z4OQ7UWQ tag=CJ3J0YJ2SQPM type=write size=266972 2024-09-19T11:43:07.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.882+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=D54QNVW7XI37 type=del size=3199407 2024-09-19T11:43:07.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.886+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=EEWB5UTS0UAZ type=del 2024-09-19T11:43:07.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.886+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=Y2F19RA8HX09 type=write size=444623 2024-09-19T11:43:07.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.890+0000 7f3d831968c0 1 < suggested update operation key=8104Z4OQ7UWQ tag=07PZO12YG7LR type=write size=156040 2024-09-19T11:43:07.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.894+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=STXB0824K2TQ type=write size=770893 2024-09-19T11:43:07.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.894+0000 7f3d831968c0 1 < canceled part key=_multipart_76JFMPOUJZXW.2~3PHIF36U93NS.0 size=557626 2024-09-19T11:43:07.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.898+0000 7f3d831968c0 1 < canceled multipart upload key=76JFMPOUJZXW upload=3PHIF36U93NS tag=6DQF794TBU5A type=write size=1606202 2024-09-19T11:43:07.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.902+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~YYDPMVD2EMXW.0 size=1048576 2024-09-19T11:43:07.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.906+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~YYDPMVD2EMXW.1 size=1048576 2024-09-19T11:43:07.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.906+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~YYDPMVD2EMXW.2 size=30949 2024-09-19T11:43:07.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.906+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=YYDPMVD2EMXW tag=0EGVJF0961A7 type=write size=3176677 2024-09-19T11:43:07.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.910+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~EN3M3WWZ98LI.0 size=1048576 2024-09-19T11:43:07.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.910+0000 7f3d831968c0 1 < canceled part key=_multipart_0OOB2SNLVK8E.2~EN3M3WWZ98LI.1 size=1048576 2024-09-19T11:43:07.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.910+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~EN3M3WWZ98LI.2 size=968330 2024-09-19T11:43:07.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.914+0000 7f3d831968c0 1 < canceled multipart upload key=0OOB2SNLVK8E upload=EN3M3WWZ98LI tag=THVA16EO5GY4 type=write size=4114058 2024-09-19T11:43:07.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.918+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=JE4M90HBBHVO type=del size=2074212 2024-09-19T11:43:07.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.918+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~3L1A6FM6DSLW.0 size=744396 2024-09-19T11:43:07.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.922+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=3L1A6FM6DSLW tag=FDJMZM87F3II type=write size=1792972 2024-09-19T11:43:07.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.926+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=RUV3TDZ7H89X type=del size=664181 2024-09-19T11:43:07.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.930+0000 7f3d831968c0 1 < suggested remove operation key=8104Z4OQ7UWQ tag=1VFOH24047M8 type=del 2024-09-19T11:43:07.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.934+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=OVFKOUFCWB4O type=del size=107167 2024-09-19T11:43:07.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.934+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~WO9P82SGDHGO.0 size=1048576 2024-09-19T11:43:07.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.938+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~WO9P82SGDHGO.1 size=1048576 2024-09-19T11:43:07.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.938+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~WO9P82SGDHGO.2 size=265392 2024-09-19T11:43:07.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.942+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=WO9P82SGDHGO tag=X3LKSYSCSW7C type=write size=3411120 2024-09-19T11:43:07.950 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.946+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~7UZGGNDW51D3.0 size=1048576 2024-09-19T11:43:07.952 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.950+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~7UZGGNDW51D3.1 size=664862 2024-09-19T11:43:07.952 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.950+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=7UZGGNDW51D3 tag=3ZDN89JWFGHY type=write size=2762014 2024-09-19T11:43:07.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.950+0000 7f3d831968c0 1 < canceled part key=_multipart_UI7EVZ1SGD8R.2~LTCKGGBUC75G.0 size=935058 2024-09-19T11:43:07.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.954+0000 7f3d831968c0 1 < canceled multipart upload key=UI7EVZ1SGD8R upload=LTCKGGBUC75G tag=RO43L55U5P7O type=write size=1983634 2024-09-19T11:43:07.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.954+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~3WPR8VI1BJT9.0 size=1048576 2024-09-19T11:43:07.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.958+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~3WPR8VI1BJT9.1 size=494118 2024-09-19T11:43:07.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.958+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=3WPR8VI1BJT9 tag=US25B3UPMGS6 type=write size=2591270 2024-09-19T11:43:07.966 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.962+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~LSHLD3TF62Y3.0 size=1048576 2024-09-19T11:43:07.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.962+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~LSHLD3TF62Y3.1 size=1021435 2024-09-19T11:43:07.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.966+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=LSHLD3TF62Y3 tag=BC76ATAKD09D type=write size=3118587 2024-09-19T11:43:07.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.970+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=TE2XOUJPNUFR type=write size=521393 2024-09-19T11:43:07.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.974+0000 7f3d831968c0 1 < suggested update operation key=JV7EGEI6062Y tag=PRFS5L7RE11P type=del size=976054 2024-09-19T11:43:07.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.978+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~5A3GJUEIZ0DS.0 size=243707 2024-09-19T11:43:07.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.978+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=5A3GJUEIZ0DS tag=G9XCZR57DA3I type=write size=1292283 2024-09-19T11:43:07.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.982+0000 7f3d831968c0 1 < suggested update operation key=E8OFSMUZHR02 tag=EA3BXHWKNU3J type=del size=335369 2024-09-19T11:43:07.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.986+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~HDO4MC4ELK5K.0 size=1048576 2024-09-19T11:43:07.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.990+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~HDO4MC4ELK5K.1 size=171021 2024-09-19T11:43:07.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.990+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=HDO4MC4ELK5K tag=CK2DDLL8KCP1 type=write size=2268173 2024-09-19T11:43:07.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.990+0000 7f3d831968c0 -1 < failed to complete operation key=T9KJH2ZYCLVA tag=508SPYGZ7JLO type=del size=2679030: (22) Invalid argument 2024-09-19T11:43:07.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.994+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=L6VFQENMOLSP type=write size=586514 2024-09-19T11:43:08.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.998+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=YWBGEYRBX20E type=del 2024-09-19T11:43:08.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:07.998+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=OVQAD9D3A098 type=del size=1150070 2024-09-19T11:43:08.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.002+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~KWLJ0PAM3145.0 size=680774 2024-09-19T11:43:08.010 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.006+0000 7f3d831968c0 1 < completed multipart upload key=3GD7UZCI3WX4 upload=KWLJ0PAM3145 tag=VOVJ8VG0LNBA type=write size=1729350 2024-09-19T11:43:08.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.010+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~R45W4O14HFE5.0 size=878588 2024-09-19T11:43:08.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.010+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=R45W4O14HFE5 tag=S3ZJV1LOAXOI type=write size=1927164 2024-09-19T11:43:08.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.014+0000 7f3d831968c0 1 < suggested remove operation key=E8OFSMUZHR02 tag=SQITNXHUEVMM type=write 2024-09-19T11:43:08.024 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.018+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~BDSF12V22QH6.0 size=218338 2024-09-19T11:43:08.024 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.018+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=BDSF12V22QH6 tag=3Z1WCTYA3WGT type=write size=1266914 2024-09-19T11:43:08.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.022+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=D54QNVW7XI37 type=del 2024-09-19T11:43:08.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.026+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=DU13SMXX5GTX type=del size=2739901 2024-09-19T11:43:08.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.026+0000 7f3d831968c0 1 < completed write operation key=224HPC2Y95N6 tag=Y2F19RA8HX09 type=write size=444623 2024-09-19T11:43:08.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.030+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~23LW6PE9ENUF.0 size=301312 2024-09-19T11:43:08.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.030+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=23LW6PE9ENUF tag=3NWNIWAZU2MH type=write size=1349888 2024-09-19T11:43:08.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.034+0000 7f3d831968c0 1 < completed write operation key=224HPC2Y95N6 tag=STXB0824K2TQ type=write size=770893 2024-09-19T11:43:08.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.038+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=2IZMQGEWXJ79 type=del size=3971942 2024-09-19T11:43:08.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.038+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~YYDPMVD2EMXW.0 size=1048576 2024-09-19T11:43:08.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.042+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~YYDPMVD2EMXW.1 size=1048576 2024-09-19T11:43:08.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.042+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~YYDPMVD2EMXW.2 size=30949 2024-09-19T11:43:08.050 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.046+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=YYDPMVD2EMXW tag=0EGVJF0961A7 type=write size=3176677 2024-09-19T11:43:08.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.050+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=46DDWMKSYML3 type=del size=3887687 2024-09-19T11:43:08.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.050+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=JE4M90HBBHVO type=del 2024-09-19T11:43:08.057 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.054+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=8U1B4OFINGYN type=del size=949863 2024-09-19T11:43:08.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.054+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=RUV3TDZ7H89X type=del 2024-09-19T11:43:08.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.058+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=63OP5J18MC5I type=del size=3450474 2024-09-19T11:43:08.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.062+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=OVFKOUFCWB4O type=del 2024-09-19T11:43:08.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.062+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=EX914A1F83GM type=del size=2750417 2024-09-19T11:43:08.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.066+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~7UZGGNDW51D3.0 size=1048576 2024-09-19T11:43:08.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.070+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~7UZGGNDW51D3.1 size=664862 2024-09-19T11:43:08.076 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.070+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=7UZGGNDW51D3 tag=3ZDN89JWFGHY type=write size=2762014 2024-09-19T11:43:08.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.074+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=1C9AD2RW0H97 type=del size=1361990 2024-09-19T11:43:08.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.078+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~3WPR8VI1BJT9.0 size=1048576 2024-09-19T11:43:08.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.078+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~3WPR8VI1BJT9.1 size=494118 2024-09-19T11:43:08.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.082+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=3WPR8VI1BJT9 tag=US25B3UPMGS6 type=write size=2591270 2024-09-19T11:43:08.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.086+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=WWVZ0THDIMEY type=del size=2091604 2024-09-19T11:43:08.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.090+0000 7f3d831968c0 1 < completed write operation key=G4P6HIOM1G2E tag=TE2XOUJPNUFR type=write size=521393 2024-09-19T11:43:08.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.090+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=224QNLCUNT1Y type=del size=1243172 2024-09-19T11:43:08.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.094+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~5A3GJUEIZ0DS.0 size=243707 2024-09-19T11:43:08.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.098+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=5A3GJUEIZ0DS tag=G9XCZR57DA3I type=write size=1292283 2024-09-19T11:43:08.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.102+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=DW9DWDVNP198 type=del size=553435 2024-09-19T11:43:08.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.102+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~HDO4MC4ELK5K.0 size=1048576 2024-09-19T11:43:08.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.106+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~HDO4MC4ELK5K.1 size=171021 2024-09-19T11:43:08.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.110+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=HDO4MC4ELK5K tag=CK2DDLL8KCP1 type=write size=2268173 2024-09-19T11:43:08.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.110+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=8A6FNJYOFLCQ type=write size=474099 2024-09-19T11:43:08.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.114+0000 7f3d831968c0 1 < canceled operation key=3K8P37C015G3 tag=L6VFQENMOLSP type=write size=586514 2024-09-19T11:43:08.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.118+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~2P8PRFPTBJ90.0 size=173500 2024-09-19T11:43:08.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.118+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=2P8PRFPTBJ90 tag=3PBO5P40SCAH type=write size=1222076 2024-09-19T11:43:08.124 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.122+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=OVQAD9D3A098 type=del 2024-09-19T11:43:08.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.122+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=U4OC47802MOY type=del size=3485300 2024-09-19T11:43:08.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.126+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~R45W4O14HFE5.0 size=878588 2024-09-19T11:43:08.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.130+0000 7f3d831968c0 1 < completed multipart upload key=LINLTWYV88VU upload=R45W4O14HFE5 tag=S3ZJV1LOAXOI type=write size=1927164 2024-09-19T11:43:08.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.134+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~VQOCLM6445M3.0 size=1048576 2024-09-19T11:43:08.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.134+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~VQOCLM6445M3.1 size=1048576 2024-09-19T11:43:08.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.134+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~VQOCLM6445M3.2 size=755560 2024-09-19T11:43:08.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.134+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=VQOCLM6445M3 tag=U6H6F3QUHS6F type=write size=3901288 2024-09-19T11:43:08.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.138+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~BDSF12V22QH6.0 size=218338 2024-09-19T11:43:08.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.142+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=BDSF12V22QH6 tag=3Z1WCTYA3WGT type=write size=1266914 2024-09-19T11:43:08.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.146+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=8Z5899U0N8OF type=write size=118991 2024-09-19T11:43:08.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.146+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=DU13SMXX5GTX type=del 2024-09-19T11:43:08.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.150+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=MYGYJ9ZFPLA7 type=del size=372603 2024-09-19T11:43:08.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.154+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~23LW6PE9ENUF.0 size=301312 2024-09-19T11:43:08.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.158+0000 7f3d831968c0 1 < completed multipart upload key=76JFMPOUJZXW upload=23LW6PE9ENUF tag=3NWNIWAZU2MH type=write size=1349888 2024-09-19T11:43:08.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.158+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=IFW11TTBK7UV type=del size=3337190 2024-09-19T11:43:08.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.162+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=2IZMQGEWXJ79 type=del 2024-09-19T11:43:08.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.162+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=A6KAJLYKEEIT type=del size=997610 2024-09-19T11:43:08.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.166+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=46DDWMKSYML3 type=del 2024-09-19T11:43:08.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.170+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=HTCFY6EV7WXU type=del size=2934646 2024-09-19T11:43:08.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.170+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=8U1B4OFINGYN type=del 2024-09-19T11:43:08.177 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.174+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=3515BZ4JD58Z type=del size=3619077 2024-09-19T11:43:08.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.174+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=63OP5J18MC5I type=del 2024-09-19T11:43:08.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.178+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~L4IL7NLBII09.0 size=558677 2024-09-19T11:43:08.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.178+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=L4IL7NLBII09 tag=8YUEZR0DMHKX type=write size=1607253 2024-09-19T11:43:08.186 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.182+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=EX914A1F83GM type=del 2024-09-19T11:43:08.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.186+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=ZS7ZD2A20UJX type=del size=3673154 2024-09-19T11:43:08.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.190+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=1C9AD2RW0H97 type=del 2024-09-19T11:43:08.196 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.194+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=EZU0UVDTP94J type=del size=1700609 2024-09-19T11:43:08.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.198+0000 7f3d831968c0 1 < suggested remove operation key=8FGIZJIY58C7 tag=WWVZ0THDIMEY type=del 2024-09-19T11:43:08.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.202+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~DR6O5BEAW33T.0 size=639876 2024-09-19T11:43:08.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.202+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=DR6O5BEAW33T tag=W0ZDBH4F4MHH type=write size=1688452 2024-09-19T11:43:08.206 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.202+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=224QNLCUNT1Y type=del 2024-09-19T11:43:08.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.206+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=1E31ZQAAD26M type=del size=3565219 2024-09-19T11:43:08.212 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.210+0000 7f3d831968c0 1 < suggested remove operation key=G4P6HIOM1G2E tag=DW9DWDVNP198 type=del 2024-09-19T11:43:08.216 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.214+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~TMYC9CP0VGVX.0 size=703495 2024-09-19T11:43:08.216 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.214+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=TMYC9CP0VGVX tag=TSOSDCUNX7AH type=write size=1752071 2024-09-19T11:43:08.218 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.214+0000 7f3d831968c0 1 < canceled operation key=FKLL38ZNCJ21 tag=8A6FNJYOFLCQ type=write size=474099 2024-09-19T11:43:08.223 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.218+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~TNUTPRSUJSLM.0 size=1048576 2024-09-19T11:43:08.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.222+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~TNUTPRSUJSLM.1 size=826423 2024-09-19T11:43:08.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.222+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=TNUTPRSUJSLM tag=73D76M1WZYE7 type=write size=2923575 2024-09-19T11:43:08.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.226+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~2P8PRFPTBJ90.0 size=173500 2024-09-19T11:43:08.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.226+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=2P8PRFPTBJ90 tag=3PBO5P40SCAH type=write size=1222076 2024-09-19T11:43:08.233 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.230+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=I8TZV22T1S23 type=del size=1089663 2024-09-19T11:43:08.235 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.230+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=U4OC47802MOY type=del 2024-09-19T11:43:08.238 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.234+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~35G0KIH75W3G.0 size=76262 2024-09-19T11:43:08.238 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.234+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=35G0KIH75W3G tag=R056Z50F76BY type=write size=1124838 2024-09-19T11:43:08.240 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.238+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~VQOCLM6445M3.0 size=1048576 2024-09-19T11:43:08.240 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.238+0000 7f3d831968c0 1 < canceled part key=_multipart_8104Z4OQ7UWQ.2~VQOCLM6445M3.1 size=1048576 2024-09-19T11:43:08.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.238+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~VQOCLM6445M3.2 size=755560 2024-09-19T11:43:08.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.242+0000 7f3d831968c0 1 < canceled multipart upload key=8104Z4OQ7UWQ upload=VQOCLM6445M3 tag=U6H6F3QUHS6F type=write size=3901288 2024-09-19T11:43:08.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.242+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=LQNKG6D18114 type=del size=3816642 2024-09-19T11:43:08.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.246+0000 7f3d831968c0 1 < completed write operation key=2VJRZVU7S8LB tag=8Z5899U0N8OF type=write size=118991 2024-09-19T11:43:08.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.246+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=G7QDSV8P17EF type=write size=424094 2024-09-19T11:43:08.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.250+0000 7f3d831968c0 1 < canceled operation key=5RTONAWGYJNE tag=MYGYJ9ZFPLA7 type=del size=372603 2024-09-19T11:43:08.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.250+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=N8X354Q362R0 type=write size=967400 2024-09-19T11:43:08.260 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.254+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=IFW11TTBK7UV type=del 2024-09-19T11:43:08.262 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.258+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~OH5XK75DUTB7.0 size=1048576 2024-09-19T11:43:08.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.262+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~OH5XK75DUTB7.1 size=689775 2024-09-19T11:43:08.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.262+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=OH5XK75DUTB7 tag=UKPGI9ZEEHCA type=write size=2786927 2024-09-19T11:43:08.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.262+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=A6KAJLYKEEIT type=del 2024-09-19T11:43:08.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.266+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=2ZL9LNTIT8BQ type=del size=504792 2024-09-19T11:43:08.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.266+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=HTCFY6EV7WXU type=del 2024-09-19T11:43:08.276 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.270+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~FOZDHRXZ40BU.0 size=1048576 2024-09-19T11:43:08.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.274+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~FOZDHRXZ40BU.1 size=1048576 2024-09-19T11:43:08.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.274+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~FOZDHRXZ40BU.2 size=129198 2024-09-19T11:43:08.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.274+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=FOZDHRXZ40BU tag=HLFJGJM7K1O1 type=write size=3274926 2024-09-19T11:43:08.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.278+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=3515BZ4JD58Z type=del 2024-09-19T11:43:08.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.282+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=GAXQ9O8Z04TB type=write size=750789 2024-09-19T11:43:08.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.282+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~L4IL7NLBII09.0 size=558677 2024-09-19T11:43:08.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.286+0000 7f3d831968c0 1 < completed multipart upload key=76JFMPOUJZXW upload=L4IL7NLBII09 tag=8YUEZR0DMHKX type=write size=1607253 2024-09-19T11:43:08.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.290+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=NLX919X8K2WF type=del size=1905908 2024-09-19T11:43:08.299 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.294+0000 7f3d831968c0 1 < suggested remove operation key=3GD7UZCI3WX4 tag=ZS7ZD2A20UJX type=del 2024-09-19T11:43:08.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.298+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~J0KSEPACWGFR.0 size=1048576 2024-09-19T11:43:08.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.302+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~J0KSEPACWGFR.1 size=230092 2024-09-19T11:43:08.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.302+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=J0KSEPACWGFR tag=914UPAY2JNVA type=write size=2327244 2024-09-19T11:43:08.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.310+0000 7f3d831968c0 1 < suggested remove operation key=5RTONAWGYJNE tag=EZU0UVDTP94J type=del 2024-09-19T11:43:08.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.314+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~D7CYTCU798IO.0 size=1048576 2024-09-19T11:43:08.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.318+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~D7CYTCU798IO.1 size=1048576 2024-09-19T11:43:08.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.318+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~D7CYTCU798IO.2 size=219831 2024-09-19T11:43:08.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.318+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=D7CYTCU798IO tag=S0ZUZNSEH2R6 type=write size=3365559 2024-09-19T11:43:08.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.322+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~DR6O5BEAW33T.0 size=639876 2024-09-19T11:43:08.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.330+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=DR6O5BEAW33T tag=W0ZDBH4F4MHH type=write size=1688452 2024-09-19T11:43:08.337 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.334+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~OQH8AJHWHEEB.0 size=1048576 2024-09-19T11:43:08.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.334+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~OQH8AJHWHEEB.1 size=1048576 2024-09-19T11:43:08.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.338+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~OQH8AJHWHEEB.2 size=376815 2024-09-19T11:43:08.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.338+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=OQH8AJHWHEEB tag=BMRM593QF155 type=write size=3522543 2024-09-19T11:43:08.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.342+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=1E31ZQAAD26M type=del 2024-09-19T11:43:08.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.346+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~R40LS7ZH6YA8.0 size=925114 2024-09-19T11:43:08.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.346+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=R40LS7ZH6YA8 tag=M3KRLBHQQXVM type=write size=1973690 2024-09-19T11:43:08.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.350+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~TMYC9CP0VGVX.0 size=703495 2024-09-19T11:43:08.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.354+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=TMYC9CP0VGVX tag=TSOSDCUNX7AH type=write size=1752071 2024-09-19T11:43:08.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.358+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=V9NYFOE7I2CZ type=del size=907830 2024-09-19T11:43:08.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.362+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~TNUTPRSUJSLM.0 size=1048576 2024-09-19T11:43:08.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.362+0000 7f3d831968c0 1 < canceled part key=_multipart_4I8BY4YYTRT0.2~TNUTPRSUJSLM.1 size=826423 2024-09-19T11:43:08.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.366+0000 7f3d831968c0 1 < canceled multipart upload key=4I8BY4YYTRT0 upload=TNUTPRSUJSLM tag=73D76M1WZYE7 type=write size=2923575 2024-09-19T11:43:08.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.370+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=09K0QT2HUI2H type=write size=596767 2024-09-19T11:43:08.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.370+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=I8TZV22T1S23 type=del 2024-09-19T11:43:08.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.378+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~UCB12E0WIGFQ.0 size=1048576 2024-09-19T11:43:08.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.378+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~UCB12E0WIGFQ.1 size=1048576 2024-09-19T11:43:08.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.382+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~UCB12E0WIGFQ.2 size=456222 2024-09-19T11:43:08.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.382+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=UCB12E0WIGFQ tag=YUKV1QIGU6IW type=write size=3601950 2024-09-19T11:43:08.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.386+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~35G0KIH75W3G.0 size=76262 2024-09-19T11:43:08.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.390+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=35G0KIH75W3G tag=R056Z50F76BY type=write size=1124838 2024-09-19T11:43:08.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.394+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=4GBD5DE20RMH type=del size=2561000 2024-09-19T11:43:08.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.398+0000 7f3d831968c0 1 < suggested update operation key=8104Z4OQ7UWQ tag=LQNKG6D18114 type=del size=3816642 2024-09-19T11:43:08.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.406+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~YMNPNPEF189Q.0 size=296515 2024-09-19T11:43:08.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.406+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=YMNPNPEF189Q tag=O0OI8VZSHKFB type=write size=1345091 2024-09-19T11:43:08.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.410+0000 7f3d831968c0 1 < completed write operation key=8FGIZJIY58C7 tag=G7QDSV8P17EF type=write size=424094 2024-09-19T11:43:08.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.414+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~ZKD170NNFN35.0 size=360953 2024-09-19T11:43:08.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.414+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=ZKD170NNFN35 tag=JOHT14DEHN39 type=write size=1409529 2024-09-19T11:43:08.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.418+0000 7f3d831968c0 1 < canceled operation key=3K8P37C015G3 tag=N8X354Q362R0 type=write size=967400 2024-09-19T11:43:08.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.422+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~2V3EJQZF71I5.0 size=1048576 2024-09-19T11:43:08.428 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.426+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~2V3EJQZF71I5.1 size=74549 2024-09-19T11:43:08.428 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.426+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=2V3EJQZF71I5 tag=X0HRJOFOJXAE type=write size=2171701 2024-09-19T11:43:08.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.426+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~OH5XK75DUTB7.0 size=1048576 2024-09-19T11:43:08.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.430+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~OH5XK75DUTB7.1 size=689775 2024-09-19T11:43:08.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.438+0000 7f3d831968c0 1 < completed multipart upload key=5RTONAWGYJNE upload=OH5XK75DUTB7 tag=UKPGI9ZEEHCA type=write size=2786927 2024-09-19T11:43:08.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.442+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~HRDEVN47R3AD.0 size=886937 2024-09-19T11:43:08.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.442+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=HRDEVN47R3AD tag=2EXZ5L624TH5 type=write size=1935513 2024-09-19T11:43:08.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.446+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=2ZL9LNTIT8BQ type=del 2024-09-19T11:43:08.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.450+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=U7P1H362S4DO type=del size=2930098 2024-09-19T11:43:08.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.450+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~FOZDHRXZ40BU.0 size=1048576 2024-09-19T11:43:08.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.454+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~FOZDHRXZ40BU.1 size=1048576 2024-09-19T11:43:08.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.458+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~FOZDHRXZ40BU.2 size=129198 2024-09-19T11:43:08.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.462+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=FOZDHRXZ40BU tag=HLFJGJM7K1O1 type=write size=3274926 2024-09-19T11:43:08.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.466+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~MM0CMFFG20HH.0 size=1048576 2024-09-19T11:43:08.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.470+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~MM0CMFFG20HH.1 size=1048576 2024-09-19T11:43:08.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.474+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~MM0CMFFG20HH.2 size=279218 2024-09-19T11:43:08.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.474+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=MM0CMFFG20HH tag=920S4F2ZMUA6 type=write size=3424946 2024-09-19T11:43:08.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.478+0000 7f3d831968c0 1 < suggested remove operation key=QPG75T46BH38 tag=GAXQ9O8Z04TB type=write 2024-09-19T11:43:08.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.482+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=IUWF5RKQDIG1 type=del size=3695439 2024-09-19T11:43:08.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.486+0000 7f3d831968c0 1 < canceled operation key=CULXGFLZ0HI6 tag=NLX919X8K2WF type=del size=1905908 2024-09-19T11:43:08.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.486+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=ZQRRKGYOOAEG type=del size=64313 2024-09-19T11:43:08.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.490+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~J0KSEPACWGFR.0 size=1048576 2024-09-19T11:43:08.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.494+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~J0KSEPACWGFR.1 size=230092 2024-09-19T11:43:08.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.498+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=J0KSEPACWGFR tag=914UPAY2JNVA type=write size=2327244 2024-09-19T11:43:08.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.502+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=15GKWB6SIGO9 type=del size=275425 2024-09-19T11:43:08.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.506+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~D7CYTCU798IO.0 size=1048576 2024-09-19T11:43:08.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.506+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~D7CYTCU798IO.1 size=1048576 2024-09-19T11:43:08.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.510+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~D7CYTCU798IO.2 size=219831 2024-09-19T11:43:08.521 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.518+0000 7f3d831968c0 1 < completed multipart upload key=5RTONAWGYJNE upload=D7CYTCU798IO tag=S0ZUZNSEH2R6 type=write size=3365559 2024-09-19T11:43:08.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.522+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~ADAB1FERLAYI.0 size=1048576 2024-09-19T11:43:08.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.526+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~ADAB1FERLAYI.1 size=1048576 2024-09-19T11:43:08.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.530+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~ADAB1FERLAYI.2 size=617509 2024-09-19T11:43:08.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.530+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=ADAB1FERLAYI tag=ODWII7W783YC type=write size=3763237 2024-09-19T11:43:08.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.530+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~OQH8AJHWHEEB.0 size=1048576 2024-09-19T11:43:08.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.534+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~OQH8AJHWHEEB.1 size=1048576 2024-09-19T11:43:08.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.538+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~OQH8AJHWHEEB.2 size=376815 2024-09-19T11:43:08.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.542+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=OQH8AJHWHEEB tag=BMRM593QF155 type=write size=3522543 2024-09-19T11:43:08.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.546+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=8RSR6TO7GHRF type=del size=2913434 2024-09-19T11:43:08.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.550+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~R40LS7ZH6YA8.0 size=925114 2024-09-19T11:43:08.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.554+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=R40LS7ZH6YA8 tag=M3KRLBHQQXVM type=write size=1973690 2024-09-19T11:43:08.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.558+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=MMQ82PEO6SPJ type=write size=717030 2024-09-19T11:43:08.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.558+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=V9NYFOE7I2CZ type=del 2024-09-19T11:43:08.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.562+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=V7TNGUVMXSBO type=write size=308145 2024-09-19T11:43:08.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.566+0000 7f3d831968c0 1 < completed write operation key=LINLTWYV88VU tag=09K0QT2HUI2H type=write size=596767 2024-09-19T11:43:08.573 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.570+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=QM0W6KETMS32 type=write size=334513 2024-09-19T11:43:08.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.570+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~UCB12E0WIGFQ.0 size=1048576 2024-09-19T11:43:08.578 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.574+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~UCB12E0WIGFQ.1 size=1048576 2024-09-19T11:43:08.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.578+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~UCB12E0WIGFQ.2 size=456222 2024-09-19T11:43:08.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.582+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=UCB12E0WIGFQ tag=YUKV1QIGU6IW type=write size=3601950 2024-09-19T11:43:08.592 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.586+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~LCSMV3OS3OP4.0 size=1048576 2024-09-19T11:43:08.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.590+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~LCSMV3OS3OP4.1 size=361124 2024-09-19T11:43:08.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.590+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=LCSMV3OS3OP4 tag=52XII53MKIWA type=write size=2458276 2024-09-19T11:43:08.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.594+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=4GBD5DE20RMH type=del 2024-09-19T11:43:08.603 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.598+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~ULAR5ZO932S1.0 size=218164 2024-09-19T11:43:08.603 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.598+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=ULAR5ZO932S1 tag=2DDFA71WVCVA type=write size=1266740 2024-09-19T11:43:08.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.598+0000 7f3d831968c0 1 < canceled part key=_multipart_8FGIZJIY58C7.2~YMNPNPEF189Q.0 size=296515 2024-09-19T11:43:08.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.606+0000 7f3d831968c0 1 < canceled multipart upload key=8FGIZJIY58C7 upload=YMNPNPEF189Q tag=O0OI8VZSHKFB type=write size=1345091 2024-09-19T11:43:08.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.606+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=A60C9V0F443H type=del size=3926066 2024-09-19T11:43:08.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.610+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~ZKD170NNFN35.0 size=360953 2024-09-19T11:43:08.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.618+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=ZKD170NNFN35 tag=JOHT14DEHN39 type=write size=1409529 2024-09-19T11:43:08.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.622+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~9P36NFODYM6Z.0 size=1048576 2024-09-19T11:43:08.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.626+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~9P36NFODYM6Z.1 size=570233 2024-09-19T11:43:08.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.626+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=9P36NFODYM6Z tag=GOFN2N8WA7RM type=write size=2667385 2024-09-19T11:43:08.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.626+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~2V3EJQZF71I5.0 size=1048576 2024-09-19T11:43:08.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.630+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~2V3EJQZF71I5.1 size=74549 2024-09-19T11:43:08.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.634+0000 7f3d831968c0 1 < completed multipart upload key=LINLTWYV88VU upload=2V3EJQZF71I5 tag=X0HRJOFOJXAE type=write size=2171701 2024-09-19T11:43:08.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.638+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=KVUEKK1D5W8H type=del size=1567383 2024-09-19T11:43:08.646 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.642+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~HRDEVN47R3AD.0 size=886937 2024-09-19T11:43:08.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.646+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=HRDEVN47R3AD tag=2EXZ5L624TH5 type=write size=1935513 2024-09-19T11:43:08.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.650+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=4EJG2KT327EB type=del size=1315057 2024-09-19T11:43:08.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.658+0000 7f3d831968c0 1 < suggested remove operation key=2VJRZVU7S8LB tag=U7P1H362S4DO type=del 2024-09-19T11:43:08.664 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.658+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=A1BNUAO65LQ1 type=del size=2432262 2024-09-19T11:43:08.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.662+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~MM0CMFFG20HH.0 size=1048576 2024-09-19T11:43:08.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.662+0000 7f3d831968c0 1 < canceled part key=_multipart_900RV3451AON.2~MM0CMFFG20HH.1 size=1048576 2024-09-19T11:43:08.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.666+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~MM0CMFFG20HH.2 size=279218 2024-09-19T11:43:08.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.670+0000 7f3d831968c0 1 < canceled multipart upload key=900RV3451AON upload=MM0CMFFG20HH tag=920S4F2ZMUA6 type=write size=3424946 2024-09-19T11:43:08.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.674+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=C900OF8AJA3P type=write size=928767 2024-09-19T11:43:08.684 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.678+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=IUWF5RKQDIG1 type=del 2024-09-19T11:43:08.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.682+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=OHSGU0QMCQ42 type=write size=631843 2024-09-19T11:43:08.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.686+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=ZQRRKGYOOAEG type=del 2024-09-19T11:43:08.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.690+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=GM0PXN8SMQWX type=del size=3323389 2024-09-19T11:43:08.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.694+0000 7f3d831968c0 1 < suggested update operation key=UI7EVZ1SGD8R tag=15GKWB6SIGO9 type=del size=275425 2024-09-19T11:43:08.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.698+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=13ZQXLEW11VY type=del size=1405846 2024-09-19T11:43:08.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.702+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~ADAB1FERLAYI.0 size=1048576 2024-09-19T11:43:08.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.702+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~ADAB1FERLAYI.1 size=1048576 2024-09-19T11:43:08.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.706+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~ADAB1FERLAYI.2 size=617509 2024-09-19T11:43:08.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.710+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=ADAB1FERLAYI tag=ODWII7W783YC type=write size=3763237 2024-09-19T11:43:08.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.714+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=UKSGDN9U2SX2 type=del size=305428 2024-09-19T11:43:08.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.718+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=8RSR6TO7GHRF type=del 2024-09-19T11:43:08.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.718+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=VIEEFDJW8D7W type=del size=993624 2024-09-19T11:43:08.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.726+0000 7f3d831968c0 1 < completed write operation key=4I8BY4YYTRT0 tag=MMQ82PEO6SPJ type=write size=717030 2024-09-19T11:43:08.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.730+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~RCJ1O9GN5WA5.0 size=1048576 2024-09-19T11:43:08.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.734+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~RCJ1O9GN5WA5.1 size=1048576 2024-09-19T11:43:08.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.734+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~RCJ1O9GN5WA5.2 size=1012060 2024-09-19T11:43:08.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.734+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=RCJ1O9GN5WA5 tag=WI8SIA52QE6U type=write size=4157788 2024-09-19T11:43:08.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.742+0000 7f3d831968c0 1 < suggested update operation key=8FGIZJIY58C7 tag=V7TNGUVMXSBO type=write size=308145 2024-09-19T11:43:08.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.746+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~9QY65WIQGDXE.0 size=585458 2024-09-19T11:43:08.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.746+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=9QY65WIQGDXE tag=XDLST1XIBXHH type=write size=1634034 2024-09-19T11:43:08.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.750+0000 7f3d831968c0 1 < completed write operation key=I5XUMA2HKIR5 tag=QM0W6KETMS32 type=write size=334513 2024-09-19T11:43:08.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.754+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=VSC55T7Z2EIY type=del size=3811965 2024-09-19T11:43:08.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.754+0000 7f3d831968c0 1 < canceled part key=_multipart_900RV3451AON.2~LCSMV3OS3OP4.0 size=1048576 2024-09-19T11:43:08.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.754+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~LCSMV3OS3OP4.1 size=361124 2024-09-19T11:43:08.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.762+0000 7f3d831968c0 1 < canceled multipart upload key=900RV3451AON upload=LCSMV3OS3OP4 tag=52XII53MKIWA type=write size=2458276 2024-09-19T11:43:08.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.766+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~HGV9BRPC6LK0.0 size=1048576 2024-09-19T11:43:08.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.770+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~HGV9BRPC6LK0.1 size=1048576 2024-09-19T11:43:08.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.770+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~HGV9BRPC6LK0.2 size=853098 2024-09-19T11:43:08.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.770+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=HGV9BRPC6LK0 tag=LHKX2U2LZVDZ type=write size=3998826 2024-09-19T11:43:08.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.774+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~ULAR5ZO932S1.0 size=218164 2024-09-19T11:43:08.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.778+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=ULAR5ZO932S1 tag=2DDFA71WVCVA type=write size=1266740 2024-09-19T11:43:08.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.778+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=XYCLUDP0PY5R type=write size=126460 2024-09-19T11:43:08.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.782+0000 7f3d831968c0 1 < completed delete operation key=PB62JE7I55GG tag=A60C9V0F443H type=del 2024-09-19T11:43:08.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.786+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~ZJG7ME8VAA9R.0 size=1048576 2024-09-19T11:43:08.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.790+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~ZJG7ME8VAA9R.1 size=212436 2024-09-19T11:43:08.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.790+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=ZJG7ME8VAA9R tag=L2YGUR9HM7Y3 type=write size=2309588 2024-09-19T11:43:08.797 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.794+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~9P36NFODYM6Z.0 size=1048576 2024-09-19T11:43:08.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.794+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~9P36NFODYM6Z.1 size=570233 2024-09-19T11:43:08.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.798+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=9P36NFODYM6Z tag=GOFN2N8WA7RM type=write size=2667385 2024-09-19T11:43:08.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.802+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=VC1EU8VQLOAU type=write size=168904 2024-09-19T11:43:08.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.806+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=KVUEKK1D5W8H type=del 2024-09-19T11:43:08.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.810+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=NBK1FG5NM5GW type=del size=2390600 2024-09-19T11:43:08.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.810+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=4EJG2KT327EB type=del 2024-09-19T11:43:08.820 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.814+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~CANOKLKYKWNB.0 size=1048576 2024-09-19T11:43:08.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.818+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~CANOKLKYKWNB.1 size=312146 2024-09-19T11:43:08.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.818+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=CANOKLKYKWNB tag=Y6VOQKSK5EGC type=write size=2409298 2024-09-19T11:43:08.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.822+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=A1BNUAO65LQ1 type=del 2024-09-19T11:43:08.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.822+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=QMAKTJEWH9FQ type=del size=3492255 2024-09-19T11:43:08.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.826+0000 7f3d831968c0 1 < completed write operation key=8104Z4OQ7UWQ tag=C900OF8AJA3P type=write size=928767 2024-09-19T11:43:08.836 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.830+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~IEYEG34E3Z09.0 size=1048576 2024-09-19T11:43:08.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.834+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~IEYEG34E3Z09.1 size=211985 2024-09-19T11:43:08.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.834+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=IEYEG34E3Z09 tag=N8Z782A1CK23 type=write size=2309137 2024-09-19T11:43:08.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.838+0000 7f3d831968c0 1 < completed write operation key=224HPC2Y95N6 tag=OHSGU0QMCQ42 type=write size=631843 2024-09-19T11:43:08.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.842+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~YQ6UTCK9DYPP.0 size=1048576 2024-09-19T11:43:08.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.842+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~YQ6UTCK9DYPP.1 size=858567 2024-09-19T11:43:08.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.842+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=YQ6UTCK9DYPP tag=NVR680D62QD7 type=write size=2955719 2024-09-19T11:43:08.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.846+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=GM0PXN8SMQWX type=del 2024-09-19T11:43:08.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.850+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=Z76FN242ND7F type=del size=4085627 2024-09-19T11:43:08.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.854+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=13ZQXLEW11VY type=del 2024-09-19T11:43:08.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.858+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=UVS493FR2NP5 type=del size=1557401 2024-09-19T11:43:08.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.858+0000 7f3d831968c0 1 < completed delete operation key=3QWBQYLI0SJR tag=UKSGDN9U2SX2 type=del 2024-09-19T11:43:08.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.862+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=LJDLD0LD3Q3U type=del size=4015625 2024-09-19T11:43:08.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.866+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=VIEEFDJW8D7W type=del 2024-09-19T11:43:08.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.866+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=C9NVXOA214I4 type=del size=2767000 2024-09-19T11:43:08.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.870+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~RCJ1O9GN5WA5.0 size=1048576 2024-09-19T11:43:08.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.870+0000 7f3d831968c0 1 < canceled part key=_multipart_QPG75T46BH38.2~RCJ1O9GN5WA5.1 size=1048576 2024-09-19T11:43:08.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.874+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~RCJ1O9GN5WA5.2 size=1012060 2024-09-19T11:43:08.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.878+0000 7f3d831968c0 1 < canceled multipart upload key=QPG75T46BH38 upload=RCJ1O9GN5WA5 tag=WI8SIA52QE6U type=write size=4157788 2024-09-19T11:43:08.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.882+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=DATF50C553S1 type=del size=859786 2024-09-19T11:43:08.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.882+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~9QY65WIQGDXE.0 size=585458 2024-09-19T11:43:08.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.886+0000 7f3d831968c0 1 < completed multipart upload key=5RTONAWGYJNE upload=9QY65WIQGDXE tag=XDLST1XIBXHH type=write size=1634034 2024-09-19T11:43:08.894 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.890+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=XJ19S4RDA9ZV type=del size=3619193 2024-09-19T11:43:08.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.894+0000 7f3d831968c0 1 < suggested update operation key=UI7EVZ1SGD8R tag=VSC55T7Z2EIY type=del size=3811965 2024-09-19T11:43:08.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.898+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=TJ914VZSYDPR type=del size=1794385 2024-09-19T11:43:08.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.902+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~HGV9BRPC6LK0.0 size=1048576 2024-09-19T11:43:08.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.902+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~HGV9BRPC6LK0.1 size=1048576 2024-09-19T11:43:08.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.906+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~HGV9BRPC6LK0.2 size=853098 2024-09-19T11:43:08.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.910+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=HGV9BRPC6LK0 tag=LHKX2U2LZVDZ type=write size=3998826 2024-09-19T11:43:08.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.914+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~UPH8Q6T7P2NE.0 size=1048576 2024-09-19T11:43:08.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.918+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~UPH8Q6T7P2NE.1 size=1035869 2024-09-19T11:43:08.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.918+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=UPH8Q6T7P2NE tag=B0L8KI3ARHYG type=write size=3133021 2024-09-19T11:43:08.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.922+0000 7f3d831968c0 1 < completed write operation key=3QWBQYLI0SJR tag=XYCLUDP0PY5R type=write size=126460 2024-09-19T11:43:08.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.926+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~JQL2M73ZCW80.0 size=1048576 2024-09-19T11:43:08.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.930+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~JQL2M73ZCW80.1 size=1048576 2024-09-19T11:43:08.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.930+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~JQL2M73ZCW80.2 size=151844 2024-09-19T11:43:08.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.934+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=JQL2M73ZCW80 tag=O3BEECM87AYK type=write size=3297572 2024-09-19T11:43:08.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.934+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~ZJG7ME8VAA9R.0 size=1048576 2024-09-19T11:43:08.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.938+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~ZJG7ME8VAA9R.1 size=212436 2024-09-19T11:43:08.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.942+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=ZJG7ME8VAA9R tag=L2YGUR9HM7Y3 type=write size=2309588 2024-09-19T11:43:08.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.950+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~TCOOP5WJHZMR.0 size=1048576 2024-09-19T11:43:08.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.954+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~TCOOP5WJHZMR.1 size=205699 2024-09-19T11:43:08.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.954+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=TCOOP5WJHZMR tag=0F5H4M6VWXRC type=write size=2302851 2024-09-19T11:43:08.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.958+0000 7f3d831968c0 1 < completed write operation key=6NLQ0BK8AJUO tag=VC1EU8VQLOAU type=write size=168904 2024-09-19T11:43:08.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.962+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~2N7ANZ9SERNS.0 size=1048576 2024-09-19T11:43:08.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.966+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~2N7ANZ9SERNS.1 size=327792 2024-09-19T11:43:08.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.966+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=2N7ANZ9SERNS tag=8IJOPMBW0LC5 type=write size=2424944 2024-09-19T11:43:08.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.970+0000 7f3d831968c0 1 < canceled operation key=KAPKNZJ2DE6A tag=NBK1FG5NM5GW type=del size=2390600 2024-09-19T11:43:08.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.974+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~2A9Y29QS4KRO.0 size=802108 2024-09-19T11:43:08.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.974+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=2A9Y29QS4KRO tag=8C85RXGKMGSD type=write size=1850684 2024-09-19T11:43:08.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.978+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~CANOKLKYKWNB.0 size=1048576 2024-09-19T11:43:08.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.978+0000 7f3d831968c0 1 < canceled part key=_multipart_224HPC2Y95N6.2~CANOKLKYKWNB.1 size=312146 2024-09-19T11:43:08.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.982+0000 7f3d831968c0 1 < canceled multipart upload key=224HPC2Y95N6 upload=CANOKLKYKWNB tag=Y6VOQKSK5EGC type=write size=2409298 2024-09-19T11:43:08.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.986+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=3Z0MF553BF4T type=del size=2052576 2024-09-19T11:43:08.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.990+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=QMAKTJEWH9FQ type=del 2024-09-19T11:43:08.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.990+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=34VUPGIQH3X1 type=del size=3126153 2024-09-19T11:43:09.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:08.998+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~IEYEG34E3Z09.0 size=1048576 2024-09-19T11:43:09.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.002+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~IEYEG34E3Z09.1 size=211985 2024-09-19T11:43:09.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.006+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=IEYEG34E3Z09 tag=N8Z782A1CK23 type=write size=2309137 2024-09-19T11:43:09.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.014+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~2GSV2DC3BT3O.0 size=169094 2024-09-19T11:43:09.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.014+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=2GSV2DC3BT3O tag=Z72PWDRJIR53 type=write size=1217670 2024-09-19T11:43:09.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.014+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~YQ6UTCK9DYPP.0 size=1048576 2024-09-19T11:43:09.022 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.018+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~YQ6UTCK9DYPP.1 size=858567 2024-09-19T11:43:09.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.022+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=YQ6UTCK9DYPP tag=NVR680D62QD7 type=write size=2955719 2024-09-19T11:43:09.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.030+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~5IYKR2639QKB.0 size=1048576 2024-09-19T11:43:09.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.034+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~5IYKR2639QKB.1 size=1048576 2024-09-19T11:43:09.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.034+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~5IYKR2639QKB.2 size=949746 2024-09-19T11:43:09.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.034+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=5IYKR2639QKB tag=TXWLF4ADSVAA type=write size=4095474 2024-09-19T11:43:09.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.038+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=Z76FN242ND7F type=del 2024-09-19T11:43:09.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.042+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=KYMGR98TIMUO type=del size=654552 2024-09-19T11:43:09.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.042+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=UVS493FR2NP5 type=del 2024-09-19T11:43:09.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.046+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=NCJ2TF04WX5A type=del size=1574123 2024-09-19T11:43:09.054 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.050+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=LJDLD0LD3Q3U type=del 2024-09-19T11:43:09.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.054+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=4U0E4YU4PV3U type=write size=215193 2024-09-19T11:43:09.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.054+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=C9NVXOA214I4 type=del 2024-09-19T11:43:09.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.058+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=GTYQ6O2AI52B type=del size=1643498 2024-09-19T11:43:09.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.062+0000 7f3d831968c0 1 < completed delete operation key=PB62JE7I55GG tag=DATF50C553S1 type=del 2024-09-19T11:43:09.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.066+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=TMJD04Y85UIS type=del size=4035489 2024-09-19T11:43:09.071 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.066+0000 7f3d831968c0 1 < canceled operation key=66N4QS1R70Z7 tag=XJ19S4RDA9ZV type=del size=3619193 2024-09-19T11:43:09.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.074+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~8FEUXEMGG64W.0 size=1048576 2024-09-19T11:43:09.080 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.074+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~8FEUXEMGG64W.1 size=1048576 2024-09-19T11:43:09.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.078+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~8FEUXEMGG64W.2 size=308893 2024-09-19T11:43:09.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.078+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=8FEUXEMGG64W tag=UUE9Y55369O2 type=write size=3454621 2024-09-19T11:43:09.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.082+0000 7f3d831968c0 1 < completed delete operation key=3QWBQYLI0SJR tag=TJ914VZSYDPR type=del 2024-09-19T11:43:09.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.086+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=0JTMDWGYTD7A type=del size=2711575 2024-09-19T11:43:09.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.090+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~UPH8Q6T7P2NE.0 size=1048576 2024-09-19T11:43:09.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.090+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~UPH8Q6T7P2NE.1 size=1035869 2024-09-19T11:43:09.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.098+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=UPH8Q6T7P2NE tag=B0L8KI3ARHYG type=write size=3133021 2024-09-19T11:43:09.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.102+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=5VM3DFN4KC37 type=del size=782260 2024-09-19T11:43:09.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.102+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~JQL2M73ZCW80.0 size=1048576 2024-09-19T11:43:09.110 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.106+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~JQL2M73ZCW80.1 size=1048576 2024-09-19T11:43:09.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.110+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~JQL2M73ZCW80.2 size=151844 2024-09-19T11:43:09.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.114+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=JQL2M73ZCW80 tag=O3BEECM87AYK type=write size=3297572 2024-09-19T11:43:09.121 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.118+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=IJTJ60Q4WFRX type=del size=3386973 2024-09-19T11:43:09.124 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.118+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~TCOOP5WJHZMR.0 size=1048576 2024-09-19T11:43:09.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.122+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~TCOOP5WJHZMR.1 size=205699 2024-09-19T11:43:09.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.126+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=TCOOP5WJHZMR tag=0F5H4M6VWXRC type=write size=2302851 2024-09-19T11:43:09.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.134+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~ZNHKNOK4M26S.0 size=1048576 2024-09-19T11:43:09.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.134+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~ZNHKNOK4M26S.1 size=580657 2024-09-19T11:43:09.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.134+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=ZNHKNOK4M26S tag=YSRH4MF2EO09 type=write size=2677809 2024-09-19T11:43:09.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.138+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~2N7ANZ9SERNS.0 size=1048576 2024-09-19T11:43:09.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.142+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~2N7ANZ9SERNS.1 size=327792 2024-09-19T11:43:09.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.146+0000 7f3d831968c0 1 < completed multipart upload key=5RTONAWGYJNE upload=2N7ANZ9SERNS tag=8IJOPMBW0LC5 type=write size=2424944 2024-09-19T11:43:09.153 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.150+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=HMYLKA8F1GOD type=write size=152403 2024-09-19T11:43:09.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.150+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~2A9Y29QS4KRO.0 size=802108 2024-09-19T11:43:09.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.158+0000 7f3d831968c0 1 < completed multipart upload key=5RTONAWGYJNE upload=2A9Y29QS4KRO tag=8C85RXGKMGSD type=write size=1850684 2024-09-19T11:43:09.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.158+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=3LMG2UH2RUBG type=del size=3168317 2024-09-19T11:43:09.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.170+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=3Z0MF553BF4T type=del 2024-09-19T11:43:09.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.170+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=3B6BWXSWH87Z type=write size=922180 2024-09-19T11:43:09.178 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.174+0000 7f3d831968c0 1 < canceled operation key=224HPC2Y95N6 tag=34VUPGIQH3X1 type=del size=3126153 2024-09-19T11:43:09.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.178+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=D4YJT54T9IYQ type=del size=3330452 2024-09-19T11:43:09.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.182+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~2GSV2DC3BT3O.0 size=169094 2024-09-19T11:43:09.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.186+0000 7f3d831968c0 1 < completed multipart upload key=3GD7UZCI3WX4 upload=2GSV2DC3BT3O tag=Z72PWDRJIR53 type=write size=1217670 2024-09-19T11:43:09.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.190+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~4SI8EL487GG2.0 size=780975 2024-09-19T11:43:09.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.190+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=4SI8EL487GG2 tag=UFVOFYBMRIRE type=write size=1829551 2024-09-19T11:43:09.197 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.194+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~5IYKR2639QKB.0 size=1048576 2024-09-19T11:43:09.197 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.194+0000 7f3d831968c0 1 < canceled part key=_multipart_5RTONAWGYJNE.2~5IYKR2639QKB.1 size=1048576 2024-09-19T11:43:09.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.194+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~5IYKR2639QKB.2 size=949746 2024-09-19T11:43:09.206 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.202+0000 7f3d831968c0 1 < canceled multipart upload key=5RTONAWGYJNE upload=5IYKR2639QKB tag=TXWLF4ADSVAA type=write size=4095474 2024-09-19T11:43:09.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.202+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=TWT04215CZKC type=del size=2690338 2024-09-19T11:43:09.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.206+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=KYMGR98TIMUO type=del 2024-09-19T11:43:09.215 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.210+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=MDNSWJFH2GOB type=del size=2857515 2024-09-19T11:43:09.218 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.214+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=NCJ2TF04WX5A type=del 2024-09-19T11:43:09.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.218+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=YML381FV0D7K type=del size=1445044 2024-09-19T11:43:09.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.222+0000 7f3d831968c0 1 < suggested update operation key=66N4QS1R70Z7 tag=4U0E4YU4PV3U type=write size=215193 2024-09-19T11:43:09.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.230+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~D7TBFATITNV6.0 size=1048576 2024-09-19T11:43:09.235 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.230+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~D7TBFATITNV6.1 size=743762 2024-09-19T11:43:09.235 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.230+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=D7TBFATITNV6 tag=ACIKZK912ER8 type=write size=2840914 2024-09-19T11:43:09.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.234+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=GTYQ6O2AI52B type=del 2024-09-19T11:43:09.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.238+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~F1O2R0GFYUFW.0 size=1048576 2024-09-19T11:43:09.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.242+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~F1O2R0GFYUFW.1 size=1048576 2024-09-19T11:43:09.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.242+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~F1O2R0GFYUFW.2 size=913148 2024-09-19T11:43:09.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.242+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=F1O2R0GFYUFW tag=YDOG7Z826QW1 type=write size=4058876 2024-09-19T11:43:09.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.246+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=TMJD04Y85UIS type=del 2024-09-19T11:43:09.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.246+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=J4O9HW72VA7E type=write size=58720 2024-09-19T11:43:09.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.250+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~8FEUXEMGG64W.0 size=1048576 2024-09-19T11:43:09.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.254+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~8FEUXEMGG64W.1 size=1048576 2024-09-19T11:43:09.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.254+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~8FEUXEMGG64W.2 size=308893 2024-09-19T11:43:09.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.258+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=8FEUXEMGG64W tag=UUE9Y55369O2 type=write size=3454621 2024-09-19T11:43:09.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.262+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=1KJ8U2MSQD71 type=del size=2811824 2024-09-19T11:43:09.272 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.270+0000 7f3d831968c0 1 < suggested remove operation key=00DYD22W0ZNB tag=0JTMDWGYTD7A type=del 2024-09-19T11:43:09.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.270+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=2LD9YRQ1AFFM type=del size=1815699 2024-09-19T11:43:09.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.274+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=5VM3DFN4KC37 type=del 2024-09-19T11:43:09.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.278+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=R44104LLL3YG type=del size=43720 2024-09-19T11:43:09.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.282+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=IJTJ60Q4WFRX type=del 2024-09-19T11:43:09.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.290+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=V0BRB7HH19K1 type=del size=2534261 2024-09-19T11:43:09.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.290+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~ZNHKNOK4M26S.0 size=1048576 2024-09-19T11:43:09.298 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.294+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~ZNHKNOK4M26S.1 size=580657 2024-09-19T11:43:09.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.298+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=ZNHKNOK4M26S tag=YSRH4MF2EO09 type=write size=2677809 2024-09-19T11:43:09.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.302+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=EI4V4706DE8Q type=del size=3867243 2024-09-19T11:43:09.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.306+0000 7f3d831968c0 1 < suggested update operation key=Y3LO4H9RI4X0 tag=HMYLKA8F1GOD type=write size=152403 2024-09-19T11:43:09.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.314+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~260N8QVE0PVJ.0 size=1048576 2024-09-19T11:43:09.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.314+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~260N8QVE0PVJ.1 size=706347 2024-09-19T11:43:09.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.314+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=260N8QVE0PVJ tag=LZ1MCRZ164MW type=write size=2803499 2024-09-19T11:43:09.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.318+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=3LMG2UH2RUBG type=del 2024-09-19T11:43:09.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.322+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=377KEQ6KKJY0 type=del size=1873407 2024-09-19T11:43:09.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.326+0000 7f3d831968c0 1 < suggested remove operation key=CULXGFLZ0HI6 tag=3B6BWXSWH87Z type=write 2024-09-19T11:43:09.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.330+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=LIT5C7LJOVVU type=write size=304627 2024-09-19T11:43:09.336 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.330+0000 7f3d831968c0 -1 < no bi entry to suggest for operation key=00DYD22W0ZNB tag=D4YJT54T9IYQ type=del size=3330452: (2) No such file or directory 2024-09-19T11:43:09.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.338+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~AFRBAIJBH8AF.0 size=1048576 2024-09-19T11:43:09.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.338+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~AFRBAIJBH8AF.1 size=626377 2024-09-19T11:43:09.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.338+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=AFRBAIJBH8AF tag=QQJU50RS8ISX type=write size=2723529 2024-09-19T11:43:09.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.342+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~4SI8EL487GG2.0 size=780975 2024-09-19T11:43:09.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.346+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=4SI8EL487GG2 tag=UFVOFYBMRIRE type=write size=1829551 2024-09-19T11:43:09.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.354+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~SIMJN05GH9LE.0 size=227872 2024-09-19T11:43:09.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.354+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=SIMJN05GH9LE tag=OV2ECI0L8HOZ type=write size=1276448 2024-09-19T11:43:09.359 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.354+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=TWT04215CZKC type=del 2024-09-19T11:43:09.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.358+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=YCSLBK0KE69Y type=write size=22402 2024-09-19T11:43:09.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.362+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=MDNSWJFH2GOB type=del 2024-09-19T11:43:09.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.366+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~7I9Z34AV1FEM.0 size=1048576 2024-09-19T11:43:09.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.370+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~7I9Z34AV1FEM.1 size=1048576 2024-09-19T11:43:09.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.370+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~7I9Z34AV1FEM.2 size=488534 2024-09-19T11:43:09.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.370+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=7I9Z34AV1FEM tag=EIRLBM21UPPG type=write size=3634262 2024-09-19T11:43:09.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.374+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=YML381FV0D7K type=del 2024-09-19T11:43:09.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.378+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=EMHP2B1GELRX type=del size=1039891 2024-09-19T11:43:09.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.378+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~D7TBFATITNV6.0 size=1048576 2024-09-19T11:43:09.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.382+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~D7TBFATITNV6.1 size=743762 2024-09-19T11:43:09.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.386+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=D7TBFATITNV6 tag=ACIKZK912ER8 type=write size=2840914 2024-09-19T11:43:09.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.390+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=BJJ6LK8OY2PS type=del size=1624387 2024-09-19T11:43:09.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.394+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~F1O2R0GFYUFW.0 size=1048576 2024-09-19T11:43:09.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.394+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~F1O2R0GFYUFW.1 size=1048576 2024-09-19T11:43:09.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.398+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~F1O2R0GFYUFW.2 size=913148 2024-09-19T11:43:09.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.402+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=F1O2R0GFYUFW tag=YDOG7Z826QW1 type=write size=4058876 2024-09-19T11:43:09.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.406+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~RNYHYOQ4H6W1.0 size=1048576 2024-09-19T11:43:09.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.410+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~RNYHYOQ4H6W1.1 size=736321 2024-09-19T11:43:09.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.410+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=RNYHYOQ4H6W1 tag=V7KJXAS9R6P9 type=write size=2833473 2024-09-19T11:43:09.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.414+0000 7f3d831968c0 1 < completed write operation key=3K8P37C015G3 tag=J4O9HW72VA7E type=write size=58720 2024-09-19T11:43:09.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.418+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~QTWAQIRAT3IB.0 size=1048576 2024-09-19T11:43:09.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.422+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~QTWAQIRAT3IB.1 size=1048576 2024-09-19T11:43:09.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.426+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~QTWAQIRAT3IB.2 size=127292 2024-09-19T11:43:09.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.426+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=QTWAQIRAT3IB tag=8QEPADILDPRI type=write size=3273020 2024-09-19T11:43:09.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.426+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=1KJ8U2MSQD71 type=del 2024-09-19T11:43:09.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.434+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~6OB5T5Z6YN2M.0 size=1048576 2024-09-19T11:43:09.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.434+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~6OB5T5Z6YN2M.1 size=1048576 2024-09-19T11:43:09.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.438+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~6OB5T5Z6YN2M.2 size=531732 2024-09-19T11:43:09.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.438+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=6OB5T5Z6YN2M tag=VD2DX8U9Q8LW type=write size=3677460 2024-09-19T11:43:09.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.446+0000 7f3d831968c0 1 < suggested update operation key=3GD7UZCI3WX4 tag=2LD9YRQ1AFFM type=del size=1815699 2024-09-19T11:43:09.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.454+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~WWER45V8VHIR.0 size=1048576 2024-09-19T11:43:09.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.454+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~WWER45V8VHIR.1 size=1048576 2024-09-19T11:43:09.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.458+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~WWER45V8VHIR.2 size=509488 2024-09-19T11:43:09.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.458+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=WWER45V8VHIR tag=J2FDYE2AEHEX type=write size=3655216 2024-09-19T11:43:09.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.466+0000 7f3d831968c0 1 < suggested remove operation key=224HPC2Y95N6 tag=R44104LLL3YG type=del 2024-09-19T11:43:09.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.470+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~5ECB9XH92U99.0 size=1048576 2024-09-19T11:43:09.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.474+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~5ECB9XH92U99.1 size=55400 2024-09-19T11:43:09.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.474+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=5ECB9XH92U99 tag=18N97935B88V type=write size=2152552 2024-09-19T11:43:09.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.478+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=V0BRB7HH19K1 type=del 2024-09-19T11:43:09.485 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.478+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=Z1ETJPMHFOOX type=del size=2457382 2024-09-19T11:43:09.487 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.482+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=EI4V4706DE8Q type=del 2024-09-19T11:43:09.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.486+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=B83N7YWG01E7 type=write size=994964 2024-09-19T11:43:09.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.490+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~260N8QVE0PVJ.0 size=1048576 2024-09-19T11:43:09.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.494+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~260N8QVE0PVJ.1 size=706347 2024-09-19T11:43:09.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.498+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=260N8QVE0PVJ tag=LZ1MCRZ164MW type=write size=2803499 2024-09-19T11:43:09.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.502+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=KE75ATIXBQJ6 type=del size=3251883 2024-09-19T11:43:09.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.506+0000 7f3d831968c0 1 < suggested update operation key=CULXGFLZ0HI6 tag=377KEQ6KKJY0 type=del size=1873407 2024-09-19T11:43:09.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.510+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=ZKJHLWN95G0L type=write size=424500 2024-09-19T11:43:09.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.514+0000 7f3d831968c0 1 < completed write operation key=E8OFSMUZHR02 tag=LIT5C7LJOVVU type=write size=304627 2024-09-19T11:43:09.522 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.518+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=UXRABDWB5T8B type=del size=3151680 2024-09-19T11:43:09.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.522+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~AFRBAIJBH8AF.0 size=1048576 2024-09-19T11:43:09.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.522+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~AFRBAIJBH8AF.1 size=626377 2024-09-19T11:43:09.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.526+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=AFRBAIJBH8AF tag=QQJU50RS8ISX type=write size=2723529 2024-09-19T11:43:09.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.530+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=8OG21PR4X3FF type=write size=162845 2024-09-19T11:43:09.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.534+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~SIMJN05GH9LE.0 size=227872 2024-09-19T11:43:09.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.538+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=SIMJN05GH9LE tag=OV2ECI0L8HOZ type=write size=1276448 2024-09-19T11:43:09.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.542+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~QOCC7L3YTXF0.0 size=1048576 2024-09-19T11:43:09.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.546+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~QOCC7L3YTXF0.1 size=880730 2024-09-19T11:43:09.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.546+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=QOCC7L3YTXF0 tag=NWOWASM4L9WV type=write size=2977882 2024-09-19T11:43:09.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.550+0000 7f3d831968c0 -1 < failed to complete operation key=CULXGFLZ0HI6 tag=YCSLBK0KE69Y type=write size=22402: (22) Invalid argument 2024-09-19T11:43:09.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.550+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=7M9OJCWGOKTU type=write size=956596 2024-09-19T11:43:09.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.554+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~7I9Z34AV1FEM.0 size=1048576 2024-09-19T11:43:09.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.558+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~7I9Z34AV1FEM.1 size=1048576 2024-09-19T11:43:09.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.558+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~7I9Z34AV1FEM.2 size=488534 2024-09-19T11:43:09.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.562+0000 7f3d831968c0 1 < completed multipart upload key=EVFF0F0760OS upload=7I9Z34AV1FEM tag=EIRLBM21UPPG type=write size=3634262 2024-09-19T11:43:09.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.566+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=029290I3Z264 type=del size=568454 2024-09-19T11:43:09.578 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.574+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=EMHP2B1GELRX type=del 2024-09-19T11:43:09.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.578+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~MY3ITFJSZB7J.0 size=1048576 2024-09-19T11:43:09.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.582+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~MY3ITFJSZB7J.1 size=1048576 2024-09-19T11:43:09.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.582+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~MY3ITFJSZB7J.2 size=978277 2024-09-19T11:43:09.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.582+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=MY3ITFJSZB7J tag=ZF1EUXONICDP type=write size=4124005 2024-09-19T11:43:09.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.586+0000 7f3d831968c0 1 < canceled operation key=T9KJH2ZYCLVA tag=BJJ6LK8OY2PS type=del size=1624387 2024-09-19T11:43:09.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.590+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=QNZYC7QD4MO0 type=del size=954188 2024-09-19T11:43:09.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.590+0000 7f3d831968c0 1 < canceled part key=_multipart_6NLQ0BK8AJUO.2~RNYHYOQ4H6W1.0 size=1048576 2024-09-19T11:43:09.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.590+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~RNYHYOQ4H6W1.1 size=736321 2024-09-19T11:43:09.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.598+0000 7f3d831968c0 1 < canceled multipart upload key=6NLQ0BK8AJUO upload=RNYHYOQ4H6W1 tag=V7KJXAS9R6P9 type=write size=2833473 2024-09-19T11:43:09.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.602+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~6VKPI1WUIESL.0 size=1048576 2024-09-19T11:43:09.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.602+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~6VKPI1WUIESL.1 size=1048576 2024-09-19T11:43:09.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.606+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~6VKPI1WUIESL.2 size=586529 2024-09-19T11:43:09.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.606+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=6VKPI1WUIESL tag=DMC5E7RNC5PM type=write size=3732257 2024-09-19T11:43:09.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.606+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~QTWAQIRAT3IB.0 size=1048576 2024-09-19T11:43:09.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.610+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~QTWAQIRAT3IB.1 size=1048576 2024-09-19T11:43:09.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.614+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~QTWAQIRAT3IB.2 size=127292 2024-09-19T11:43:09.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.618+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=QTWAQIRAT3IB tag=8QEPADILDPRI type=write size=3273020 2024-09-19T11:43:09.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.622+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=NJA4HHDWSS6I type=del size=478191 2024-09-19T11:43:09.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.622+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~6OB5T5Z6YN2M.0 size=1048576 2024-09-19T11:43:09.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.626+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~6OB5T5Z6YN2M.1 size=1048576 2024-09-19T11:43:09.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.630+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~6OB5T5Z6YN2M.2 size=531732 2024-09-19T11:43:09.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.634+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=6OB5T5Z6YN2M tag=VD2DX8U9Q8LW type=write size=3677460 2024-09-19T11:43:09.641 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.638+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=B0QH026WYFHR type=del size=822309 2024-09-19T11:43:09.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.638+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~WWER45V8VHIR.0 size=1048576 2024-09-19T11:43:09.646 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.642+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~WWER45V8VHIR.1 size=1048576 2024-09-19T11:43:09.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.642+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~WWER45V8VHIR.2 size=509488 2024-09-19T11:43:09.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.650+0000 7f3d831968c0 1 < completed multipart upload key=LINLTWYV88VU upload=WWER45V8VHIR tag=J2FDYE2AEHEX type=write size=3655216 2024-09-19T11:43:09.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.650+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=5DSFSG0WJ0WF type=del size=241608 2024-09-19T11:43:09.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.654+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~5ECB9XH92U99.0 size=1048576 2024-09-19T11:43:09.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.658+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~5ECB9XH92U99.1 size=55400 2024-09-19T11:43:09.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.662+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=5ECB9XH92U99 tag=18N97935B88V type=write size=2152552 2024-09-19T11:43:09.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.666+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~3ZLHSWDACZ2M.0 size=1048576 2024-09-19T11:43:09.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.670+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~3ZLHSWDACZ2M.1 size=1048576 2024-09-19T11:43:09.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.670+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~3ZLHSWDACZ2M.2 size=170288 2024-09-19T11:43:09.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.670+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=3ZLHSWDACZ2M tag=GRX4TC767IAJ type=write size=3316016 2024-09-19T11:43:09.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.674+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=Z1ETJPMHFOOX type=del 2024-09-19T11:43:09.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.678+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~ANBMXF653DIB.0 size=871265 2024-09-19T11:43:09.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.678+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=ANBMXF653DIB tag=J850BGLVCJPO type=write size=1919841 2024-09-19T11:43:09.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.682+0000 7f3d831968c0 1 < completed write operation key=E8OFSMUZHR02 tag=B83N7YWG01E7 type=write size=994964 2024-09-19T11:43:09.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.686+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~YBHOWANU865W.0 size=226709 2024-09-19T11:43:09.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.686+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=YBHOWANU865W tag=KUQPY3NS4M20 type=write size=1275285 2024-09-19T11:43:09.696 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.690+0000 7f3d831968c0 1 < suggested remove operation key=2VJRZVU7S8LB tag=KE75ATIXBQJ6 type=del 2024-09-19T11:43:09.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.694+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=91TFMZ53R3R9 type=del size=2332916 2024-09-19T11:43:09.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.698+0000 7f3d831968c0 1 < completed write operation key=E8OFSMUZHR02 tag=ZKJHLWN95G0L type=write size=424500 2024-09-19T11:43:09.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.702+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=CL3QI9JDI5Z2 type=del size=3529595 2024-09-19T11:43:09.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.702+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=UXRABDWB5T8B type=del 2024-09-19T11:43:09.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.706+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~ZZHX7G1BU5A3.0 size=952666 2024-09-19T11:43:09.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.706+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=ZZHX7G1BU5A3 tag=V5OJVZP8929X type=write size=2001242 2024-09-19T11:43:09.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.710+0000 7f3d831968c0 1 < completed write operation key=3QWBQYLI0SJR tag=8OG21PR4X3FF type=write size=162845 2024-09-19T11:43:09.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.714+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~X97RQOUZ9US6.0 size=1048576 2024-09-19T11:43:09.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.714+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~X97RQOUZ9US6.1 size=978364 2024-09-19T11:43:09.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.714+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=X97RQOUZ9US6 tag=YX4WO1WJWU9R type=write size=3075516 2024-09-19T11:43:09.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.718+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~QOCC7L3YTXF0.0 size=1048576 2024-09-19T11:43:09.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.718+0000 7f3d831968c0 1 < canceled part key=_multipart_E8OFSMUZHR02.2~QOCC7L3YTXF0.1 size=880730 2024-09-19T11:43:09.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.722+0000 7f3d831968c0 1 < canceled multipart upload key=E8OFSMUZHR02 upload=QOCC7L3YTXF0 tag=NWOWASM4L9WV type=write size=2977882 2024-09-19T11:43:09.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.722+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=YCIGV5TDK9V2 type=write size=1019049 2024-09-19T11:43:09.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.726+0000 7f3d831968c0 1 < completed write operation key=66N4QS1R70Z7 tag=7M9OJCWGOKTU type=write size=956596 2024-09-19T11:43:09.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.726+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=VUF7UGZQE4EO type=del size=25946 2024-09-19T11:43:09.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.730+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=029290I3Z264 type=del 2024-09-19T11:43:09.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.730+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=V9YORR9IDWLU type=del size=1507602 2024-09-19T11:43:09.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.734+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~MY3ITFJSZB7J.0 size=1048576 2024-09-19T11:43:09.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.734+0000 7f3d831968c0 1 < canceled part key=_multipart_00DYD22W0ZNB.2~MY3ITFJSZB7J.1 size=1048576 2024-09-19T11:43:09.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.738+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~MY3ITFJSZB7J.2 size=978277 2024-09-19T11:43:09.744 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.738+0000 7f3d831968c0 1 < canceled multipart upload key=00DYD22W0ZNB upload=MY3ITFJSZB7J tag=ZF1EUXONICDP type=write size=4124005 2024-09-19T11:43:09.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.742+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=G7VSPHAFT09B type=del size=3576926 2024-09-19T11:43:09.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.746+0000 7f3d831968c0 1 < suggested update operation key=4I8BY4YYTRT0 tag=QNZYC7QD4MO0 type=del size=954188 2024-09-19T11:43:09.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.750+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~EWYAEIZKCW9E.0 size=131434 2024-09-19T11:43:09.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.750+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=EWYAEIZKCW9E tag=QLJW0MZDVOFP type=write size=1180010 2024-09-19T11:43:09.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.754+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~6VKPI1WUIESL.0 size=1048576 2024-09-19T11:43:09.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.754+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~6VKPI1WUIESL.1 size=1048576 2024-09-19T11:43:09.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.758+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~6VKPI1WUIESL.2 size=586529 2024-09-19T11:43:09.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.762+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=6VKPI1WUIESL tag=DMC5E7RNC5PM type=write size=3732257 2024-09-19T11:43:09.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.766+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~BOMSFPHC5EPD.0 size=1048576 2024-09-19T11:43:09.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.766+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~BOMSFPHC5EPD.1 size=1048576 2024-09-19T11:43:09.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.770+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~BOMSFPHC5EPD.2 size=697436 2024-09-19T11:43:09.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.770+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=BOMSFPHC5EPD tag=C7LGJCMAZIVW type=write size=3843164 2024-09-19T11:43:09.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.770+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=NJA4HHDWSS6I type=del 2024-09-19T11:43:09.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.774+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~DN43Y8AA60DG.0 size=1048576 2024-09-19T11:43:09.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.778+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~DN43Y8AA60DG.1 size=329793 2024-09-19T11:43:09.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.778+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=DN43Y8AA60DG tag=K6E65NI88570 type=write size=2426945 2024-09-19T11:43:09.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.782+0000 7f3d831968c0 1 < canceled operation key=8FGIZJIY58C7 tag=B0QH026WYFHR type=del size=822309 2024-09-19T11:43:09.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.782+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=JMYBFXM70COO type=write size=907495 2024-09-19T11:43:09.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.786+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=5DSFSG0WJ0WF type=del 2024-09-19T11:43:09.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.786+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=QPVFKGLZZIIK type=del size=3537646 2024-09-19T11:43:09.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.790+0000 7f3d831968c0 1 < canceled part key=_multipart_CULXGFLZ0HI6.2~3ZLHSWDACZ2M.0 size=1048576 2024-09-19T11:43:09.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.790+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~3ZLHSWDACZ2M.1 size=1048576 2024-09-19T11:43:09.796 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.790+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~3ZLHSWDACZ2M.2 size=170288 2024-09-19T11:43:09.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.798+0000 7f3d831968c0 1 < canceled multipart upload key=CULXGFLZ0HI6 upload=3ZLHSWDACZ2M tag=GRX4TC767IAJ type=write size=3316016 2024-09-19T11:43:09.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.802+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~F5CFVJZ3NJ33.0 size=1048576 2024-09-19T11:43:09.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.802+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~F5CFVJZ3NJ33.1 size=347505 2024-09-19T11:43:09.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.802+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=F5CFVJZ3NJ33 tag=YUF0SGQL22LW type=write size=2444657 2024-09-19T11:43:09.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.806+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~ANBMXF653DIB.0 size=871265 2024-09-19T11:43:09.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.814+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=ANBMXF653DIB tag=J850BGLVCJPO type=write size=1919841 2024-09-19T11:43:09.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.814+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=J5VRPH02QTKV type=write size=329984 2024-09-19T11:43:09.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.818+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~YBHOWANU865W.0 size=226709 2024-09-19T11:43:09.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.822+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=YBHOWANU865W tag=KUQPY3NS4M20 type=write size=1275285 2024-09-19T11:43:09.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.822+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=059JZKV12AQT type=del size=3517688 2024-09-19T11:43:09.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.830+0000 7f3d831968c0 1 < suggested update operation key=00DYD22W0ZNB tag=91TFMZ53R3R9 type=del size=2332916 2024-09-19T11:43:09.836 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.834+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=Q7QSKGVCM9P8 type=del size=3425347 2024-09-19T11:43:09.839 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.834+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=CL3QI9JDI5Z2 type=del 2024-09-19T11:43:09.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.838+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~EWEPQWAKLPBP.0 size=1048576 2024-09-19T11:43:09.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.842+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~EWEPQWAKLPBP.1 size=1048576 2024-09-19T11:43:09.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.846+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~EWEPQWAKLPBP.2 size=387711 2024-09-19T11:43:09.849 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.846+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=EWEPQWAKLPBP tag=L7MMAMKEHEUU type=write size=3533439 2024-09-19T11:43:09.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.846+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~ZZHX7G1BU5A3.0 size=952666 2024-09-19T11:43:09.855 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.850+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=ZZHX7G1BU5A3 tag=V5OJVZP8929X type=write size=2001242 2024-09-19T11:43:09.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.854+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=JN7Y4OAYOH41 type=del size=1255230 2024-09-19T11:43:09.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.854+0000 7f3d831968c0 1 < canceled part key=_multipart_4I8BY4YYTRT0.2~X97RQOUZ9US6.0 size=1048576 2024-09-19T11:43:09.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.854+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~X97RQOUZ9US6.1 size=978364 2024-09-19T11:43:09.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.858+0000 7f3d831968c0 1 < canceled multipart upload key=4I8BY4YYTRT0 upload=X97RQOUZ9US6 tag=YX4WO1WJWU9R type=write size=3075516 2024-09-19T11:43:09.868 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.866+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~5BIQZFG3X58E.0 size=1033981 2024-09-19T11:43:09.868 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.866+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=5BIQZFG3X58E tag=MN8W2D0S1B2B type=write size=2082557 2024-09-19T11:43:09.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.866+0000 7f3d831968c0 1 < completed write operation key=3K8P37C015G3 tag=YCIGV5TDK9V2 type=write size=1019049 2024-09-19T11:43:09.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.870+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=NLGF1W626ZHS type=write size=90698 2024-09-19T11:43:09.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.874+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=VUF7UGZQE4EO type=del 2024-09-19T11:43:09.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.874+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=MMCDU8TAY14Q type=del size=2719781 2024-09-19T11:43:09.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.878+0000 7f3d831968c0 1 < suggested update operation key=00DYD22W0ZNB tag=V9YORR9IDWLU type=del size=1507602 2024-09-19T11:43:09.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.882+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=04RIY17ZPFLC type=del size=1223605 2024-09-19T11:43:09.889 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.886+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=G7VSPHAFT09B type=del 2024-09-19T11:43:09.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.890+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~IYCZ225QBZBV.0 size=358164 2024-09-19T11:43:09.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.890+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=IYCZ225QBZBV tag=ALJCC78YOLZZ type=write size=1406740 2024-09-19T11:43:09.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.894+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~EWYAEIZKCW9E.0 size=131434 2024-09-19T11:43:09.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.898+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=EWYAEIZKCW9E tag=QLJW0MZDVOFP type=write size=1180010 2024-09-19T11:43:09.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.902+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~DQTCN19JI8QY.0 size=1048576 2024-09-19T11:43:09.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.906+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~DQTCN19JI8QY.1 size=568891 2024-09-19T11:43:09.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.906+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=DQTCN19JI8QY tag=AAZ87WYH6JYE type=write size=2666043 2024-09-19T11:43:09.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.910+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~BOMSFPHC5EPD.0 size=1048576 2024-09-19T11:43:09.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.910+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~BOMSFPHC5EPD.1 size=1048576 2024-09-19T11:43:09.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.914+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~BOMSFPHC5EPD.2 size=697436 2024-09-19T11:43:09.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.918+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=BOMSFPHC5EPD tag=C7LGJCMAZIVW type=write size=3843164 2024-09-19T11:43:09.927 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.922+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~7ABNMGOYVXNZ.0 size=1048576 2024-09-19T11:43:09.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.926+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~7ABNMGOYVXNZ.1 size=304999 2024-09-19T11:43:09.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.926+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=7ABNMGOYVXNZ tag=ZNSQ7FTDT1NN type=write size=2402151 2024-09-19T11:43:09.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.930+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~DN43Y8AA60DG.0 size=1048576 2024-09-19T11:43:09.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.930+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~DN43Y8AA60DG.1 size=329793 2024-09-19T11:43:09.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.934+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=DN43Y8AA60DG tag=K6E65NI88570 type=write size=2426945 2024-09-19T11:43:09.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.942+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~MZT81DNLRAQB.0 size=852237 2024-09-19T11:43:09.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.942+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=MZT81DNLRAQB tag=C8HPFW6Y9N7J type=write size=1900813 2024-09-19T11:43:09.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.942+0000 7f3d831968c0 1 < completed write operation key=224HPC2Y95N6 tag=JMYBFXM70COO type=write size=907495 2024-09-19T11:43:09.951 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.946+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=WX5IPSH1161J type=del size=2288783 2024-09-19T11:43:09.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.950+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=QPVFKGLZZIIK type=del 2024-09-19T11:43:09.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.954+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=U01H8QHVL39A type=write size=745461 2024-09-19T11:43:09.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.954+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~F5CFVJZ3NJ33.0 size=1048576 2024-09-19T11:43:09.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.958+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~F5CFVJZ3NJ33.1 size=347505 2024-09-19T11:43:09.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.962+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=F5CFVJZ3NJ33 tag=YUF0SGQL22LW type=write size=2444657 2024-09-19T11:43:09.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.966+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=7F1X8R1HFM8Z type=del size=1999100 2024-09-19T11:43:09.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.966+0000 7f3d831968c0 1 < completed write operation key=G4P6HIOM1G2E tag=J5VRPH02QTKV type=write size=329984 2024-09-19T11:43:09.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.970+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~XCFNFH3N28LN.0 size=1048576 2024-09-19T11:43:09.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.974+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~XCFNFH3N28LN.1 size=1048576 2024-09-19T11:43:09.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.974+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~XCFNFH3N28LN.2 size=794613 2024-09-19T11:43:09.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.974+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=XCFNFH3N28LN tag=0GNOJH2Y6K5Z type=write size=3940341 2024-09-19T11:43:09.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.978+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=059JZKV12AQT type=del 2024-09-19T11:43:09.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.982+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=4W8RJUY7PVVI type=del size=663785 2024-09-19T11:43:09.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.986+0000 7f3d831968c0 1 < completed delete operation key=PB62JE7I55GG tag=Q7QSKGVCM9P8 type=del 2024-09-19T11:43:09.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.986+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=13AQW4QKHTIS type=del size=118714 2024-09-19T11:43:09.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.990+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~EWEPQWAKLPBP.0 size=1048576 2024-09-19T11:43:09.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.994+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~EWEPQWAKLPBP.1 size=1048576 2024-09-19T11:43:10.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:09.994+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~EWEPQWAKLPBP.2 size=387711 2024-09-19T11:43:10.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.002+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=EWEPQWAKLPBP tag=L7MMAMKEHEUU type=write size=3533439 2024-09-19T11:43:10.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.002+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=YCC7MJUQXKC4 type=del size=1144095 2024-09-19T11:43:10.010 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.006+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=JN7Y4OAYOH41 type=del 2024-09-19T11:43:10.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.010+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~EB0SUQ0D9KL0.0 size=1048576 2024-09-19T11:43:10.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.010+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~EB0SUQ0D9KL0.1 size=1048576 2024-09-19T11:43:10.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.014+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~EB0SUQ0D9KL0.2 size=970316 2024-09-19T11:43:10.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.014+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=EB0SUQ0D9KL0 tag=76UTPEBMZ2TW type=write size=4116044 2024-09-19T11:43:10.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.014+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~5BIQZFG3X58E.0 size=1033981 2024-09-19T11:43:10.023 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.018+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=5BIQZFG3X58E tag=MN8W2D0S1B2B type=write size=2082557 2024-09-19T11:43:10.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.022+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=9VBXNZFPKAJE type=del size=3834474 2024-09-19T11:43:10.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.026+0000 7f3d831968c0 1 < suggested update operation key=3QWBQYLI0SJR tag=NLGF1W626ZHS type=write size=90698 2024-09-19T11:43:10.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.030+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=Q72ASMONDVUR type=del size=2582047 2024-09-19T11:43:10.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.030+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=MMCDU8TAY14Q type=del 2024-09-19T11:43:10.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.034+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~I61V8C15EWX7.0 size=1048576 2024-09-19T11:43:10.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.038+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~I61V8C15EWX7.1 size=1048576 2024-09-19T11:43:10.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.042+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~I61V8C15EWX7.2 size=928312 2024-09-19T11:43:10.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.042+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=I61V8C15EWX7 tag=KXGCB9BSWAKG type=write size=4074040 2024-09-19T11:43:10.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.046+0000 7f3d831968c0 1 < suggested remove operation key=3QWBQYLI0SJR tag=04RIY17ZPFLC type=del 2024-09-19T11:43:10.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.050+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~YYTSWY393Y26.0 size=398895 2024-09-19T11:43:10.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.050+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=YYTSWY393Y26 tag=6EB8FQQTQWS3 type=write size=1447471 2024-09-19T11:43:10.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.054+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~IYCZ225QBZBV.0 size=358164 2024-09-19T11:43:10.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.062+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=IYCZ225QBZBV tag=ALJCC78YOLZZ type=write size=1406740 2024-09-19T11:43:10.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.070+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~EW73GZ3URU91.0 size=426479 2024-09-19T11:43:10.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.070+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=EW73GZ3URU91 tag=LHACDJWAUVF3 type=write size=1475055 2024-09-19T11:43:10.075 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.070+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~DQTCN19JI8QY.0 size=1048576 2024-09-19T11:43:10.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.074+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~DQTCN19JI8QY.1 size=568891 2024-09-19T11:43:10.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.078+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=DQTCN19JI8QY tag=AAZ87WYH6JYE type=write size=2666043 2024-09-19T11:43:10.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.082+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=KEPVQHPVHJNF type=del size=2330211 2024-09-19T11:43:10.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.086+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~7ABNMGOYVXNZ.0 size=1048576 2024-09-19T11:43:10.091 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.086+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~7ABNMGOYVXNZ.1 size=304999 2024-09-19T11:43:10.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.094+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=7ABNMGOYVXNZ tag=ZNSQ7FTDT1NN type=write size=2402151 2024-09-19T11:43:10.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.098+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=ZL1U0Q5PT16C type=del size=1005211 2024-09-19T11:43:10.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.102+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~MZT81DNLRAQB.0 size=852237 2024-09-19T11:43:10.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.106+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=MZT81DNLRAQB tag=C8HPFW6Y9N7J type=write size=1900813 2024-09-19T11:43:10.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.110+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~WQ699JSWB5JS.0 size=1048576 2024-09-19T11:43:10.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.114+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~WQ699JSWB5JS.1 size=832496 2024-09-19T11:43:10.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.114+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=WQ699JSWB5JS tag=A4F5VEAUPBG0 type=write size=2929648 2024-09-19T11:43:10.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.118+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=WX5IPSH1161J type=del 2024-09-19T11:43:10.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.126+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~B1ZD7VQAG2W6.0 size=292848 2024-09-19T11:43:10.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.126+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=B1ZD7VQAG2W6 tag=EJFFJPMKV1AY type=write size=1341424 2024-09-19T11:43:10.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.126+0000 7f3d831968c0 1 < completed write operation key=Y3LO4H9RI4X0 tag=U01H8QHVL39A type=write size=745461 2024-09-19T11:43:10.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.134+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~2OPZCO3C2RGR.0 size=1048576 2024-09-19T11:43:10.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.134+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~2OPZCO3C2RGR.1 size=693510 2024-09-19T11:43:10.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.134+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=2OPZCO3C2RGR tag=Q13NFTK44980 type=write size=2790662 2024-09-19T11:43:10.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.138+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=7F1X8R1HFM8Z type=del 2024-09-19T11:43:10.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.142+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=S964O6TIG16J type=del size=769092 2024-09-19T11:43:10.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.146+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~XCFNFH3N28LN.0 size=1048576 2024-09-19T11:43:10.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.146+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~XCFNFH3N28LN.1 size=1048576 2024-09-19T11:43:10.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.146+0000 7f3d831968c0 1 < canceled part key=_multipart_CULXGFLZ0HI6.2~XCFNFH3N28LN.2 size=794613 2024-09-19T11:43:10.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.154+0000 7f3d831968c0 1 < canceled multipart upload key=CULXGFLZ0HI6 upload=XCFNFH3N28LN tag=0GNOJH2Y6K5Z type=write size=3940341 2024-09-19T11:43:10.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.154+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=69UX8239UWJH type=del size=1769495 2024-09-19T11:43:10.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.158+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=4W8RJUY7PVVI type=del 2024-09-19T11:43:10.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.162+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=P4GRC19U72NB type=del size=262884 2024-09-19T11:43:10.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.166+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=13AQW4QKHTIS type=del 2024-09-19T11:43:10.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.174+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~6IFJE7PE32SW.0 size=1048576 2024-09-19T11:43:10.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.174+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~6IFJE7PE32SW.1 size=523765 2024-09-19T11:43:10.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.174+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=6IFJE7PE32SW tag=7A5YUZNHZB55 type=write size=2620917 2024-09-19T11:43:10.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.178+0000 7f3d831968c0 1 < completed delete operation key=PB62JE7I55GG tag=YCC7MJUQXKC4 type=del 2024-09-19T11:43:10.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.182+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=RBI8CFL8V3B5 type=del size=4098282 2024-09-19T11:43:10.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.186+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~EB0SUQ0D9KL0.0 size=1048576 2024-09-19T11:43:10.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.190+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~EB0SUQ0D9KL0.1 size=1048576 2024-09-19T11:43:10.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.190+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~EB0SUQ0D9KL0.2 size=970316 2024-09-19T11:43:10.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.198+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=EB0SUQ0D9KL0 tag=76UTPEBMZ2TW type=write size=4116044 2024-09-19T11:43:10.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.198+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=R9YIAUWET08T type=del size=3044755 2024-09-19T11:43:10.207 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.202+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=9VBXNZFPKAJE type=del 2024-09-19T11:43:10.214 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.210+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~CWJ6LP6053UO.0 size=291863 2024-09-19T11:43:10.214 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.210+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=CWJ6LP6053UO tag=PV660D2922KG type=write size=1340439 2024-09-19T11:43:10.217 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.214+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=Q72ASMONDVUR type=del 2024-09-19T11:43:10.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.218+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=C2BXU4QT8JR4 type=del size=2753871 2024-09-19T11:43:10.225 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.222+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~I61V8C15EWX7.0 size=1048576 2024-09-19T11:43:10.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.226+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~I61V8C15EWX7.1 size=1048576 2024-09-19T11:43:10.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.226+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~I61V8C15EWX7.2 size=928312 2024-09-19T11:43:10.235 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.230+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=I61V8C15EWX7 tag=KXGCB9BSWAKG type=write size=4074040 2024-09-19T11:43:10.240 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.234+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~CAQWUO6DBVA2.0 size=1048576 2024-09-19T11:43:10.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.238+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~CAQWUO6DBVA2.1 size=1048576 2024-09-19T11:43:10.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.242+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~CAQWUO6DBVA2.2 size=488604 2024-09-19T11:43:10.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.242+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=CAQWUO6DBVA2 tag=EWWZJQYKALPR type=write size=3634332 2024-09-19T11:43:10.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.242+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~YYTSWY393Y26.0 size=398895 2024-09-19T11:43:10.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.246+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=YYTSWY393Y26 tag=6EB8FQQTQWS3 type=write size=1447471 2024-09-19T11:43:10.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.254+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~WAFMMHKMZR51.0 size=965233 2024-09-19T11:43:10.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.254+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=WAFMMHKMZR51 tag=2D8REHF7MFCF type=write size=2013809 2024-09-19T11:43:10.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.254+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~EW73GZ3URU91.0 size=426479 2024-09-19T11:43:10.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.258+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=EW73GZ3URU91 tag=LHACDJWAUVF3 type=write size=1475055 2024-09-19T11:43:10.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.262+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=J3KIUIUGK6AE type=del size=250664 2024-09-19T11:43:10.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.266+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=KEPVQHPVHJNF type=del 2024-09-19T11:43:10.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.266+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=IA857DIM1VE2 type=del size=1814992 2024-09-19T11:43:10.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.270+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=ZL1U0Q5PT16C type=del 2024-09-19T11:43:10.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.274+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~4AGVNPVGAQV3.0 size=827270 2024-09-19T11:43:10.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.274+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=4AGVNPVGAQV3 tag=L1TXKGIJ7ZAZ type=write size=1875846 2024-09-19T11:43:10.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.274+0000 7f3d831968c0 1 < canceled part key=_multipart_4I8BY4YYTRT0.2~WQ699JSWB5JS.0 size=1048576 2024-09-19T11:43:10.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.278+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~WQ699JSWB5JS.1 size=832496 2024-09-19T11:43:10.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.282+0000 7f3d831968c0 1 < canceled multipart upload key=4I8BY4YYTRT0 upload=WQ699JSWB5JS tag=A4F5VEAUPBG0 type=write size=2929648 2024-09-19T11:43:10.288 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.282+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=5BAT0ITR7P1B type=del size=982780 2024-09-19T11:43:10.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.286+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~B1ZD7VQAG2W6.0 size=292848 2024-09-19T11:43:10.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.290+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=B1ZD7VQAG2W6 tag=EJFFJPMKV1AY type=write size=1341424 2024-09-19T11:43:10.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.294+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~CRM5WT6BGXYV.0 size=1048576 2024-09-19T11:43:10.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.298+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~CRM5WT6BGXYV.1 size=1048576 2024-09-19T11:43:10.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.298+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~CRM5WT6BGXYV.2 size=126211 2024-09-19T11:43:10.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.298+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=CRM5WT6BGXYV tag=7DRHCFAHH645 type=write size=3271939 2024-09-19T11:43:10.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.302+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~2OPZCO3C2RGR.0 size=1048576 2024-09-19T11:43:10.308 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.302+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~2OPZCO3C2RGR.1 size=693510 2024-09-19T11:43:10.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.310+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=2OPZCO3C2RGR tag=Q13NFTK44980 type=write size=2790662 2024-09-19T11:43:10.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.310+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=9EZS868X7X90 type=del size=302769 2024-09-19T11:43:10.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.314+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=S964O6TIG16J type=del 2024-09-19T11:43:10.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.318+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=PT3LPXAMRDJJ type=del size=2600175 2024-09-19T11:43:10.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.318+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=69UX8239UWJH type=del 2024-09-19T11:43:10.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.322+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=LR175IIL12LO type=del size=252737 2024-09-19T11:43:10.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.326+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=P4GRC19U72NB type=del 2024-09-19T11:43:10.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.330+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~5TBUBS64R04S.0 size=806970 2024-09-19T11:43:10.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.330+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=5TBUBS64R04S tag=F7W8OYLRY79X type=write size=1855546 2024-09-19T11:43:10.336 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.330+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~6IFJE7PE32SW.0 size=1048576 2024-09-19T11:43:10.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.338+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~6IFJE7PE32SW.1 size=523765 2024-09-19T11:43:10.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.338+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=6IFJE7PE32SW tag=7A5YUZNHZB55 type=write size=2620917 2024-09-19T11:43:10.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.346+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~3THGL8Y920FZ.0 size=488669 2024-09-19T11:43:10.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.346+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=3THGL8Y920FZ tag=S60L3PDTGBWE type=write size=1537245 2024-09-19T11:43:10.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.346+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=RBI8CFL8V3B5 type=del 2024-09-19T11:43:10.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.350+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=I39RSHFHJ9Q0 type=del size=1807463 2024-09-19T11:43:10.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.350+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=R9YIAUWET08T type=del 2024-09-19T11:43:10.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.358+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~SMT4GBT17QAD.0 size=1048576 2024-09-19T11:43:10.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.358+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~SMT4GBT17QAD.1 size=1048576 2024-09-19T11:43:10.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.362+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~SMT4GBT17QAD.2 size=94427 2024-09-19T11:43:10.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.362+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=SMT4GBT17QAD tag=2MHGFXA56JI1 type=write size=3240155 2024-09-19T11:43:10.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.362+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~CWJ6LP6053UO.0 size=291863 2024-09-19T11:43:10.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.370+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=CWJ6LP6053UO tag=PV660D2922KG type=write size=1340439 2024-09-19T11:43:10.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.370+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=TUT705JL8W9J type=del size=2451261 2024-09-19T11:43:10.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.378+0000 7f3d831968c0 1 < suggested remove operation key=FZGRZ06MOHBI tag=C2BXU4QT8JR4 type=del 2024-09-19T11:43:10.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.382+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~40O1M01JL3MT.0 size=90124 2024-09-19T11:43:10.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.382+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=40O1M01JL3MT tag=7Q127GQRRK1G type=write size=1138700 2024-09-19T11:43:10.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.386+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~CAQWUO6DBVA2.0 size=1048576 2024-09-19T11:43:10.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.386+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~CAQWUO6DBVA2.1 size=1048576 2024-09-19T11:43:10.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.390+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~CAQWUO6DBVA2.2 size=488604 2024-09-19T11:43:10.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.394+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=CAQWUO6DBVA2 tag=EWWZJQYKALPR type=write size=3634332 2024-09-19T11:43:10.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.402+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~062J7E7S93AP.0 size=153197 2024-09-19T11:43:10.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.402+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=062J7E7S93AP tag=NE0J21E4OH1R type=write size=1201773 2024-09-19T11:43:10.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.402+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~WAFMMHKMZR51.0 size=965233 2024-09-19T11:43:10.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.410+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=WAFMMHKMZR51 tag=2D8REHF7MFCF type=write size=2013809 2024-09-19T11:43:10.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.414+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=9RNDUGJMDHKZ type=del size=2163534 2024-09-19T11:43:10.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.418+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=J3KIUIUGK6AE type=del 2024-09-19T11:43:10.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.418+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=BLQV01V0KH20 type=del size=148181 2024-09-19T11:43:10.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.422+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=IA857DIM1VE2 type=del 2024-09-19T11:43:10.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.430+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~3P6FKVB8X2Z3.0 size=555956 2024-09-19T11:43:10.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.430+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=3P6FKVB8X2Z3 tag=CMK47TXCUB57 type=write size=1604532 2024-09-19T11:43:10.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.430+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~4AGVNPVGAQV3.0 size=827270 2024-09-19T11:43:10.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.434+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=4AGVNPVGAQV3 tag=L1TXKGIJ7ZAZ type=write size=1875846 2024-09-19T11:43:10.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.438+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=2SZTNJ0UQ90E type=del size=3573782 2024-09-19T11:43:10.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.442+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=5BAT0ITR7P1B type=del 2024-09-19T11:43:10.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.446+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=8JV7Q7DXG9NS type=del size=1808564 2024-09-19T11:43:10.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.446+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~CRM5WT6BGXYV.0 size=1048576 2024-09-19T11:43:10.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.450+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~CRM5WT6BGXYV.1 size=1048576 2024-09-19T11:43:10.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.450+0000 7f3d831968c0 1 < canceled part key=_multipart_E8OFSMUZHR02.2~CRM5WT6BGXYV.2 size=126211 2024-09-19T11:43:10.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.454+0000 7f3d831968c0 1 < canceled multipart upload key=E8OFSMUZHR02 upload=CRM5WT6BGXYV tag=7DRHCFAHH645 type=write size=3271939 2024-09-19T11:43:10.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.458+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=X7SOES2KD8OC type=write size=521498 2024-09-19T11:43:10.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.458+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=9EZS868X7X90 type=del 2024-09-19T11:43:10.467 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.462+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=Q55QTPP4IZM4 type=del size=3478240 2024-09-19T11:43:10.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.466+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=PT3LPXAMRDJJ type=del 2024-09-19T11:43:10.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.470+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=00PHCAEXPLCL type=del size=658848 2024-09-19T11:43:10.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.470+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=LR175IIL12LO type=del 2024-09-19T11:43:10.478 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.474+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=WLCZ6HEF2OVQ type=del size=1458747 2024-09-19T11:43:10.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.478+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~5TBUBS64R04S.0 size=806970 2024-09-19T11:43:10.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.482+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=5TBUBS64R04S tag=F7W8OYLRY79X type=write size=1855546 2024-09-19T11:43:10.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.486+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=B87T7NULXG6O type=del size=1416142 2024-09-19T11:43:10.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.490+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~3THGL8Y920FZ.0 size=488669 2024-09-19T11:43:10.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.494+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=3THGL8Y920FZ tag=S60L3PDTGBWE type=write size=1537245 2024-09-19T11:43:10.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.498+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~ZFQADKIWOD7Q.0 size=552415 2024-09-19T11:43:10.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.498+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=ZFQADKIWOD7Q tag=2KT4PADCCLBK type=write size=1600991 2024-09-19T11:43:10.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.502+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=I39RSHFHJ9Q0 type=del 2024-09-19T11:43:10.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.506+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=1ZIZON9ELA5D type=del size=3445061 2024-09-19T11:43:10.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.510+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~SMT4GBT17QAD.0 size=1048576 2024-09-19T11:43:10.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.510+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~SMT4GBT17QAD.1 size=1048576 2024-09-19T11:43:10.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.514+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~SMT4GBT17QAD.2 size=94427 2024-09-19T11:43:10.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.518+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=SMT4GBT17QAD tag=2MHGFXA56JI1 type=write size=3240155 2024-09-19T11:43:10.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.522+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~1Z1SBQDI2651.0 size=1048576 2024-09-19T11:43:10.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.526+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~1Z1SBQDI2651.1 size=1048576 2024-09-19T11:43:10.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.530+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~1Z1SBQDI2651.2 size=611054 2024-09-19T11:43:10.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.530+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=1Z1SBQDI2651 tag=SQC7IKAHSALB type=write size=3756782 2024-09-19T11:43:10.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.530+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=TUT705JL8W9J type=del 2024-09-19T11:43:10.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.534+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=EEDFZAF511KA type=del size=947451 2024-09-19T11:43:10.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.538+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~40O1M01JL3MT.0 size=90124 2024-09-19T11:43:10.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.542+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=40O1M01JL3MT tag=7Q127GQRRK1G type=write size=1138700 2024-09-19T11:43:10.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.546+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=PL9DQQVIDON9 type=del size=603904 2024-09-19T11:43:10.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.546+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~062J7E7S93AP.0 size=153197 2024-09-19T11:43:10.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.554+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=062J7E7S93AP tag=NE0J21E4OH1R type=write size=1201773 2024-09-19T11:43:10.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.554+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=62K4Q4IFVFC1 type=del size=570915 2024-09-19T11:43:10.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.562+0000 7f3d831968c0 1 < suggested remove operation key=4I8BY4YYTRT0 tag=9RNDUGJMDHKZ type=del 2024-09-19T11:43:10.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.566+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=R58N60H3866T type=del size=3654591 2024-09-19T11:43:10.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.566+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=BLQV01V0KH20 type=del 2024-09-19T11:43:10.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.570+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=9B0CKVKO141U type=del size=2648106 2024-09-19T11:43:10.577 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.574+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~3P6FKVB8X2Z3.0 size=555956 2024-09-19T11:43:10.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.578+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=3P6FKVB8X2Z3 tag=CMK47TXCUB57 type=write size=1604532 2024-09-19T11:43:10.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.582+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=G1ZN1KJS9HC3 type=del size=1311890 2024-09-19T11:43:10.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.586+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=2SZTNJ0UQ90E type=del 2024-09-19T11:43:10.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.590+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~NHRH25P9BKX0.0 size=1048576 2024-09-19T11:43:10.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.594+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~NHRH25P9BKX0.1 size=1048576 2024-09-19T11:43:10.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.594+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~NHRH25P9BKX0.2 size=493319 2024-09-19T11:43:10.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.594+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=NHRH25P9BKX0 tag=FYPYJKXPSUTB type=write size=3639047 2024-09-19T11:43:10.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.598+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=8JV7Q7DXG9NS type=del 2024-09-19T11:43:10.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.598+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=WFZ2CMJG0GWO type=del size=3665788 2024-09-19T11:43:10.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.602+0000 7f3d831968c0 1 < completed write operation key=T9KJH2ZYCLVA tag=X7SOES2KD8OC type=write size=521498 2024-09-19T11:43:10.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.610+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=26LO4M8MWYBB type=write size=887293 2024-09-19T11:43:10.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.610+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=Q55QTPP4IZM4 type=del 2024-09-19T11:43:10.618 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.614+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=7R0GWC3FWFGW type=del size=4024819 2024-09-19T11:43:10.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.618+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=00PHCAEXPLCL type=del 2024-09-19T11:43:10.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.622+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~2WJ0IJ4UKJP5.0 size=1048576 2024-09-19T11:43:10.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.622+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~2WJ0IJ4UKJP5.1 size=1048576 2024-09-19T11:43:10.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.626+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~2WJ0IJ4UKJP5.2 size=617589 2024-09-19T11:43:10.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.626+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=2WJ0IJ4UKJP5 tag=Y2JS510MER86 type=write size=3763317 2024-09-19T11:43:10.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.630+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=WLCZ6HEF2OVQ type=del 2024-09-19T11:43:10.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.634+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~PYXJUI7Q22WH.0 size=730093 2024-09-19T11:43:10.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.634+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=PYXJUI7Q22WH tag=4N771R2YR91S type=write size=1778669 2024-09-19T11:43:10.641 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.638+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=B87T7NULXG6O type=del 2024-09-19T11:43:10.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.642+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=2XR4QH330S2D type=write size=920122 2024-09-19T11:43:10.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.642+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~ZFQADKIWOD7Q.0 size=552415 2024-09-19T11:43:10.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.650+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=ZFQADKIWOD7Q tag=2KT4PADCCLBK type=write size=1600991 2024-09-19T11:43:10.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.654+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~D0RHWGJRC8KF.0 size=1048576 2024-09-19T11:43:10.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.658+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~D0RHWGJRC8KF.1 size=1048576 2024-09-19T11:43:10.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.658+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~D0RHWGJRC8KF.2 size=1011236 2024-09-19T11:43:10.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.658+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=D0RHWGJRC8KF tag=9GLXIHDUI958 type=write size=4156964 2024-09-19T11:43:10.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.662+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=1ZIZON9ELA5D type=del 2024-09-19T11:43:10.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.666+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=DTE1DH5IWKEE type=del size=654488 2024-09-19T11:43:10.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.670+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~1Z1SBQDI2651.0 size=1048576 2024-09-19T11:43:10.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.670+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~1Z1SBQDI2651.1 size=1048576 2024-09-19T11:43:10.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.674+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~1Z1SBQDI2651.2 size=611054 2024-09-19T11:43:10.684 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.678+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=1Z1SBQDI2651 tag=SQC7IKAHSALB type=write size=3756782 2024-09-19T11:43:10.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.682+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=UB7CDH5L510K type=del size=3869583 2024-09-19T11:43:10.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.686+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=EEDFZAF511KA type=del 2024-09-19T11:43:10.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.690+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=LXTIRBLXSC7N type=del size=1857931 2024-09-19T11:43:10.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.690+0000 7f3d831968c0 1 < completed delete operation key=PB62JE7I55GG tag=PL9DQQVIDON9 type=del 2024-09-19T11:43:10.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.694+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=IJTFROV8T1H1 type=write size=478871 2024-09-19T11:43:10.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.698+0000 7f3d831968c0 1 < suggested update operation key=5RTONAWGYJNE tag=62K4Q4IFVFC1 type=del size=570915 2024-09-19T11:43:10.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.702+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=2CH69GO7P4GM type=del size=4163146 2024-09-19T11:43:10.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.706+0000 7f3d831968c0 1 < completed delete operation key=PB62JE7I55GG tag=R58N60H3866T type=del 2024-09-19T11:43:10.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.710+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=BWRLWNOO2OG8 type=del size=2520478 2024-09-19T11:43:10.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.710+0000 7f3d831968c0 1 < canceled operation key=KAPKNZJ2DE6A tag=9B0CKVKO141U type=del size=2648106 2024-09-19T11:43:10.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.714+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~CYUFBNODT0ER.0 size=1048576 2024-09-19T11:43:10.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.718+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~CYUFBNODT0ER.1 size=1048576 2024-09-19T11:43:10.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.722+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~CYUFBNODT0ER.2 size=686463 2024-09-19T11:43:10.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.722+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=CYUFBNODT0ER tag=3HGN43E98Y10 type=write size=3832191 2024-09-19T11:43:10.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.722+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=G1ZN1KJS9HC3 type=del 2024-09-19T11:43:10.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.726+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=U9DKEOWTB0TJ type=del size=1682891 2024-09-19T11:43:10.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.730+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~NHRH25P9BKX0.0 size=1048576 2024-09-19T11:43:10.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.730+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~NHRH25P9BKX0.1 size=1048576 2024-09-19T11:43:10.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.734+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~NHRH25P9BKX0.2 size=493319 2024-09-19T11:43:10.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.738+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=NHRH25P9BKX0 tag=FYPYJKXPSUTB type=write size=3639047 2024-09-19T11:43:10.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.742+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=08WX4FUY9OAL type=del size=4010837 2024-09-19T11:43:10.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.742+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=WFZ2CMJG0GWO type=del 2024-09-19T11:43:10.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.746+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=DAOD1R7DG09X type=del size=1287974 2024-09-19T11:43:10.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.750+0000 7f3d831968c0 1 < completed write operation key=PB62JE7I55GG tag=26LO4M8MWYBB type=write size=887293 2024-09-19T11:43:10.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.754+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~0AW8MF8H0MWM.0 size=1048576 2024-09-19T11:43:10.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.754+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~0AW8MF8H0MWM.1 size=220106 2024-09-19T11:43:10.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.754+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=0AW8MF8H0MWM tag=NNXVVX0KRA05 type=write size=2317258 2024-09-19T11:43:10.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.758+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=7R0GWC3FWFGW type=del 2024-09-19T11:43:10.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.762+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=WRWG1U3W8C6N type=del size=2925703 2024-09-19T11:43:10.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.762+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~2WJ0IJ4UKJP5.0 size=1048576 2024-09-19T11:43:10.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.766+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~2WJ0IJ4UKJP5.1 size=1048576 2024-09-19T11:43:10.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.770+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~2WJ0IJ4UKJP5.2 size=617589 2024-09-19T11:43:10.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.774+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=2WJ0IJ4UKJP5 tag=Y2JS510MER86 type=write size=3763317 2024-09-19T11:43:10.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.778+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~9XBKEOXUX1J2.0 size=1048576 2024-09-19T11:43:10.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.782+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~9XBKEOXUX1J2.1 size=99277 2024-09-19T11:43:10.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.782+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=9XBKEOXUX1J2 tag=042VE5ZVJND9 type=write size=2196429 2024-09-19T11:43:10.787 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.782+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~PYXJUI7Q22WH.0 size=730093 2024-09-19T11:43:10.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.786+0000 7f3d831968c0 1 < completed multipart upload key=LINLTWYV88VU upload=PYXJUI7Q22WH tag=4N771R2YR91S type=write size=1778669 2024-09-19T11:43:10.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.790+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=T766E201Z3Z0 type=del size=403834 2024-09-19T11:43:10.798 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.794+0000 7f3d831968c0 1 < canceled operation key=2VJRZVU7S8LB tag=2XR4QH330S2D type=write size=920122 2024-09-19T11:43:10.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.798+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~L7MLIFI0SS2Y.0 size=1048576 2024-09-19T11:43:10.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.802+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~L7MLIFI0SS2Y.1 size=814786 2024-09-19T11:43:10.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.802+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=L7MLIFI0SS2Y tag=9NT92XS7AQQU type=write size=2911938 2024-09-19T11:43:10.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.806+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~D0RHWGJRC8KF.0 size=1048576 2024-09-19T11:43:10.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.806+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~D0RHWGJRC8KF.1 size=1048576 2024-09-19T11:43:10.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.810+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~D0RHWGJRC8KF.2 size=1011236 2024-09-19T11:43:10.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.814+0000 7f3d831968c0 1 < completed multipart upload key=LINLTWYV88VU upload=D0RHWGJRC8KF tag=9GLXIHDUI958 type=write size=4156964 2024-09-19T11:43:10.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.818+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~ICPSPFUY3MFA.0 size=1048576 2024-09-19T11:43:10.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.822+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~ICPSPFUY3MFA.1 size=696466 2024-09-19T11:43:10.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.822+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=ICPSPFUY3MFA tag=D220K54C5270 type=write size=2793618 2024-09-19T11:43:10.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.826+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=DTE1DH5IWKEE type=del 2024-09-19T11:43:10.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.830+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~56IVMYGULS4B.0 size=807142 2024-09-19T11:43:10.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.830+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=56IVMYGULS4B tag=6G179CB39AJH type=write size=1855718 2024-09-19T11:43:10.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.830+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=UB7CDH5L510K type=del 2024-09-19T11:43:10.840 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.838+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~RIJ6LM8RHJQW.0 size=1048576 2024-09-19T11:43:10.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.838+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~RIJ6LM8RHJQW.1 size=1048576 2024-09-19T11:43:10.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.842+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~RIJ6LM8RHJQW.2 size=406050 2024-09-19T11:43:10.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.842+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=RIJ6LM8RHJQW tag=ZPSXGBLYYZNT type=write size=3551778 2024-09-19T11:43:10.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.842+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=LXTIRBLXSC7N type=del 2024-09-19T11:43:10.849 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.846+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=G3FPTB8RRKRJ type=del size=701263 2024-09-19T11:43:10.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.846+0000 7f3d831968c0 -1 < failed to complete operation key=5RTONAWGYJNE tag=IJTFROV8T1H1 type=write size=478871: (22) Invalid argument 2024-09-19T11:43:10.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.850+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=1TL1SRM1BSPH type=del size=2298430 2024-09-19T11:43:10.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.854+0000 7f3d831968c0 1 < canceled operation key=3K8P37C015G3 tag=2CH69GO7P4GM type=del size=4163146 2024-09-19T11:43:10.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.858+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~G1DHMN6176ZW.0 size=1048576 2024-09-19T11:43:10.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.862+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~G1DHMN6176ZW.1 size=1048576 2024-09-19T11:43:10.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.862+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~G1DHMN6176ZW.2 size=403031 2024-09-19T11:43:10.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.862+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=G1DHMN6176ZW tag=5LRQIB9SIEM6 type=write size=3548759 2024-09-19T11:43:10.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.866+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=BWRLWNOO2OG8 type=del 2024-09-19T11:43:10.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.870+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=D2DM1Z9S8FOO type=del size=1036634 2024-09-19T11:43:10.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.874+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~CYUFBNODT0ER.0 size=1048576 2024-09-19T11:43:10.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.874+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~CYUFBNODT0ER.1 size=1048576 2024-09-19T11:43:10.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.878+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~CYUFBNODT0ER.2 size=686463 2024-09-19T11:43:10.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.882+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=CYUFBNODT0ER tag=3HGN43E98Y10 type=write size=3832191 2024-09-19T11:43:10.889 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.886+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=KNE7QN3AW06U type=write size=387065 2024-09-19T11:43:10.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.890+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=U9DKEOWTB0TJ type=del 2024-09-19T11:43:10.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.890+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=APSGYZG0B53G type=del size=245668 2024-09-19T11:43:10.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.894+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=08WX4FUY9OAL type=del 2024-09-19T11:43:10.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.898+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~WY2TKCXLZVR2.0 size=1048576 2024-09-19T11:43:10.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.902+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~WY2TKCXLZVR2.1 size=1025265 2024-09-19T11:43:10.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.902+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=WY2TKCXLZVR2 tag=IN04O4LUO77B type=write size=3122417 2024-09-19T11:43:10.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.906+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=DAOD1R7DG09X type=del 2024-09-19T11:43:10.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.910+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=ENXNB991J5GN type=write size=218426 2024-09-19T11:43:10.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.910+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~0AW8MF8H0MWM.0 size=1048576 2024-09-19T11:43:10.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.914+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~0AW8MF8H0MWM.1 size=220106 2024-09-19T11:43:10.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.918+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=0AW8MF8H0MWM tag=NNXVVX0KRA05 type=write size=2317258 2024-09-19T11:43:10.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.922+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=WB1HVL1DG735 type=del size=3906808 2024-09-19T11:43:10.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.922+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=WRWG1U3W8C6N type=del 2024-09-19T11:43:10.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.930+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~X564ZIRMPXSZ.0 size=102450 2024-09-19T11:43:10.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.930+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=X564ZIRMPXSZ tag=TGEXNME1HJGB type=write size=1151026 2024-09-19T11:43:10.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.934+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~9XBKEOXUX1J2.0 size=1048576 2024-09-19T11:43:10.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.938+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~9XBKEOXUX1J2.1 size=99277 2024-09-19T11:43:10.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.942+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=9XBKEOXUX1J2 tag=042VE5ZVJND9 type=write size=2196429 2024-09-19T11:43:10.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.950+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~M1Y1RNC0K514.0 size=1048576 2024-09-19T11:43:10.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.950+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~M1Y1RNC0K514.1 size=1048576 2024-09-19T11:43:10.958 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.954+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~M1Y1RNC0K514.2 size=758125 2024-09-19T11:43:10.958 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.954+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=M1Y1RNC0K514 tag=A57P3X2RGBOS type=write size=3903853 2024-09-19T11:43:10.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.958+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=T766E201Z3Z0 type=del 2024-09-19T11:43:10.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.958+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=C89XASXSWK1D type=del size=2892444 2024-09-19T11:43:10.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.962+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~L7MLIFI0SS2Y.0 size=1048576 2024-09-19T11:43:10.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.966+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~L7MLIFI0SS2Y.1 size=814786 2024-09-19T11:43:10.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.970+0000 7f3d831968c0 1 < completed multipart upload key=EVFF0F0760OS upload=L7MLIFI0SS2Y tag=9NT92XS7AQQU type=write size=2911938 2024-09-19T11:43:10.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.974+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=Z7CJPS3F3033 type=del size=2338295 2024-09-19T11:43:10.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.978+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~ICPSPFUY3MFA.0 size=1048576 2024-09-19T11:43:10.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.982+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~ICPSPFUY3MFA.1 size=696466 2024-09-19T11:43:10.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.986+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=ICPSPFUY3MFA tag=D220K54C5270 type=write size=2793618 2024-09-19T11:43:10.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.990+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=MO5GGOFPUFWC type=del size=2673647 2024-09-19T11:43:10.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:10.994+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~56IVMYGULS4B.0 size=807142 2024-09-19T11:43:11.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.002+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=56IVMYGULS4B tag=6G179CB39AJH type=write size=1855718 2024-09-19T11:43:11.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.006+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=W2XQ20Q0COLX type=del size=179504 2024-09-19T11:43:11.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.006+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~RIJ6LM8RHJQW.0 size=1048576 2024-09-19T11:43:11.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.010+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~RIJ6LM8RHJQW.1 size=1048576 2024-09-19T11:43:11.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.014+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~RIJ6LM8RHJQW.2 size=406050 2024-09-19T11:43:11.022 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.018+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=RIJ6LM8RHJQW tag=ZPSXGBLYYZNT type=write size=3551778 2024-09-19T11:43:11.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.022+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=ZLK2L0AWTXDA type=del size=3145919 2024-09-19T11:43:11.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.026+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=G3FPTB8RRKRJ type=del 2024-09-19T11:43:11.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.026+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=HTOVNH184ACR type=del size=2904196 2024-09-19T11:43:11.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.030+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=1TL1SRM1BSPH type=del 2024-09-19T11:43:11.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.034+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=BG40MZPLZ10R type=del size=2446770 2024-09-19T11:43:11.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.038+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~G1DHMN6176ZW.0 size=1048576 2024-09-19T11:43:11.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.042+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~G1DHMN6176ZW.1 size=1048576 2024-09-19T11:43:11.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.046+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~G1DHMN6176ZW.2 size=403031 2024-09-19T11:43:11.054 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.050+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=G1DHMN6176ZW tag=5LRQIB9SIEM6 type=write size=3548759 2024-09-19T11:43:11.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.054+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~K6BULZCBDCLX.0 size=1048576 2024-09-19T11:43:11.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.058+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~K6BULZCBDCLX.1 size=195403 2024-09-19T11:43:11.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.058+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=K6BULZCBDCLX tag=6ZS7OTJHTS4D type=write size=2292555 2024-09-19T11:43:11.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.062+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=D2DM1Z9S8FOO type=del 2024-09-19T11:43:11.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.062+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=HJE9PXXDE0R4 type=del size=1730211 2024-09-19T11:43:11.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.066+0000 7f3d831968c0 1 < completed write operation key=FKLL38ZNCJ21 tag=KNE7QN3AW06U type=write size=387065 2024-09-19T11:43:11.074 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.070+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=WITLQPRQX5VE type=del size=3693796 2024-09-19T11:43:11.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.074+0000 7f3d831968c0 1 < completed delete operation key=3QWBQYLI0SJR tag=APSGYZG0B53G type=del 2024-09-19T11:43:11.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.078+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~HMQVGC7CXGY4.0 size=1048576 2024-09-19T11:43:11.087 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.082+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~HMQVGC7CXGY4.1 size=1048576 2024-09-19T11:43:11.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.086+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~HMQVGC7CXGY4.2 size=155944 2024-09-19T11:43:11.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.086+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=HMQVGC7CXGY4 tag=SPARWQT2PUK8 type=write size=3301672 2024-09-19T11:43:11.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.090+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~WY2TKCXLZVR2.0 size=1048576 2024-09-19T11:43:11.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.090+0000 7f3d831968c0 1 < canceled part key=_multipart_LINLTWYV88VU.2~WY2TKCXLZVR2.1 size=1025265 2024-09-19T11:43:11.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.094+0000 7f3d831968c0 1 < canceled multipart upload key=LINLTWYV88VU upload=WY2TKCXLZVR2 tag=IN04O4LUO77B type=write size=3122417 2024-09-19T11:43:11.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.098+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=0PXTFL45JSAT type=del size=1316846 2024-09-19T11:43:11.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.102+0000 7f3d831968c0 1 < completed write operation key=PB62JE7I55GG tag=ENXNB991J5GN type=write size=218426 2024-09-19T11:43:11.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.106+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~DDQ825B9HISA.0 size=1048576 2024-09-19T11:43:11.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.110+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~DDQ825B9HISA.1 size=1048576 2024-09-19T11:43:11.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.110+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~DDQ825B9HISA.2 size=814717 2024-09-19T11:43:11.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.110+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=DDQ825B9HISA tag=67U8B3PR3RGU type=write size=3960445 2024-09-19T11:43:11.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.114+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=WB1HVL1DG735 type=del 2024-09-19T11:43:11.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.118+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=SMTUQ9JLAD8O type=write size=69011 2024-09-19T11:43:11.125 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.122+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~X564ZIRMPXSZ.0 size=102450 2024-09-19T11:43:11.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.126+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=X564ZIRMPXSZ tag=TGEXNME1HJGB type=write size=1151026 2024-09-19T11:43:11.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.134+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~ZBB0BXNZ9ZF9.0 size=270631 2024-09-19T11:43:11.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.134+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=ZBB0BXNZ9ZF9 tag=707WX2D6ODX8 type=write size=1319207 2024-09-19T11:43:11.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.134+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~M1Y1RNC0K514.0 size=1048576 2024-09-19T11:43:11.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.134+0000 7f3d831968c0 1 < canceled part key=_multipart_G4P6HIOM1G2E.2~M1Y1RNC0K514.1 size=1048576 2024-09-19T11:43:11.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.138+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~M1Y1RNC0K514.2 size=758125 2024-09-19T11:43:11.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.142+0000 7f3d831968c0 1 < canceled multipart upload key=G4P6HIOM1G2E upload=M1Y1RNC0K514 tag=A57P3X2RGBOS type=write size=3903853 2024-09-19T11:43:11.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.146+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=8FFOGNJYTNSD type=del size=1562510 2024-09-19T11:43:11.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.150+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=C89XASXSWK1D type=del 2024-09-19T11:43:11.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.154+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=K5UQM7ONYAS1 type=del size=3108460 2024-09-19T11:43:11.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.158+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=Z7CJPS3F3033 type=del 2024-09-19T11:43:11.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.162+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~NZDLPR7C0D4H.0 size=482480 2024-09-19T11:43:11.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.162+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=NZDLPR7C0D4H tag=SMA31VZBWR7M type=write size=1531056 2024-09-19T11:43:11.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.170+0000 7f3d831968c0 1 < suggested update operation key=3GD7UZCI3WX4 tag=MO5GGOFPUFWC type=del size=2673647 2024-09-19T11:43:11.178 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.174+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=FLOAZNOF3IBH type=del size=1977630 2024-09-19T11:43:11.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.178+0000 7f3d831968c0 1 < canceled operation key=3K8P37C015G3 tag=W2XQ20Q0COLX type=del size=179504 2024-09-19T11:43:11.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.178+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=9CC0Q60BTUPF type=del size=3135826 2024-09-19T11:43:11.186 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.182+0000 7f3d831968c0 -1 < failed to complete operation key=3GD7UZCI3WX4 tag=ZLK2L0AWTXDA type=del size=3145919: (22) Invalid argument 2024-09-19T11:43:11.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.186+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=YTPXFA262GOJ type=del size=1125378 2024-09-19T11:43:11.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.186+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=HTOVNH184ACR type=del 2024-09-19T11:43:11.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.190+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=J505B9LQNM1P type=del size=1471443 2024-09-19T11:43:11.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.194+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=BG40MZPLZ10R type=del 2024-09-19T11:43:11.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.198+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~HRDGK32RFSUS.0 size=1048576 2024-09-19T11:43:11.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.202+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~HRDGK32RFSUS.1 size=1048576 2024-09-19T11:43:11.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.202+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~HRDGK32RFSUS.2 size=269206 2024-09-19T11:43:11.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.202+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=HRDGK32RFSUS tag=X00SDS9BKJ76 type=write size=3414934 2024-09-19T11:43:11.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.206+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~K6BULZCBDCLX.0 size=1048576 2024-09-19T11:43:11.214 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.210+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~K6BULZCBDCLX.1 size=195403 2024-09-19T11:43:11.218 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.214+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=K6BULZCBDCLX tag=6ZS7OTJHTS4D type=write size=2292555 2024-09-19T11:43:11.223 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.218+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~DS3HEHDT2ENA.0 size=428243 2024-09-19T11:43:11.223 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.218+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=DS3HEHDT2ENA tag=UGW2MWH2U5TP type=write size=1476819 2024-09-19T11:43:11.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.226+0000 7f3d831968c0 1 < suggested remove operation key=QPG75T46BH38 tag=HJE9PXXDE0R4 type=del 2024-09-19T11:43:11.233 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.230+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~O4ED7W86YYWS.0 size=1048576 2024-09-19T11:43:11.236 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.230+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~O4ED7W86YYWS.1 size=1048576 2024-09-19T11:43:11.238 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.234+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~O4ED7W86YYWS.2 size=1005620 2024-09-19T11:43:11.238 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.234+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=O4ED7W86YYWS tag=T2MP938X8ZO3 type=write size=4151348 2024-09-19T11:43:11.240 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.238+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=WITLQPRQX5VE type=del 2024-09-19T11:43:11.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.238+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=VUYIAM8934FP type=del size=3789128 2024-09-19T11:43:11.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.242+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~HMQVGC7CXGY4.0 size=1048576 2024-09-19T11:43:11.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.250+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~HMQVGC7CXGY4.1 size=1048576 2024-09-19T11:43:11.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.254+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~HMQVGC7CXGY4.2 size=155944 2024-09-19T11:43:11.262 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.258+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=HMQVGC7CXGY4 tag=SPARWQT2PUK8 type=write size=3301672 2024-09-19T11:43:11.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.262+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~NY5J3SMU9HMV.0 size=1048576 2024-09-19T11:43:11.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.266+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~NY5J3SMU9HMV.1 size=1048576 2024-09-19T11:43:11.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.266+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~NY5J3SMU9HMV.2 size=298251 2024-09-19T11:43:11.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.266+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=NY5J3SMU9HMV tag=1FSIBZ76WYBE type=write size=3443979 2024-09-19T11:43:11.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.270+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=0PXTFL45JSAT type=del 2024-09-19T11:43:11.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.274+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~F2CK923PKT43.0 size=1048576 2024-09-19T11:43:11.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.278+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~F2CK923PKT43.1 size=1048576 2024-09-19T11:43:11.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.278+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~F2CK923PKT43.2 size=969627 2024-09-19T11:43:11.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.278+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=F2CK923PKT43 tag=TZKMFIM025UH type=write size=4115355 2024-09-19T11:43:11.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.282+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~DDQ825B9HISA.0 size=1048576 2024-09-19T11:43:11.288 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.286+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~DDQ825B9HISA.1 size=1048576 2024-09-19T11:43:11.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.286+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~DDQ825B9HISA.2 size=814717 2024-09-19T11:43:11.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.294+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=DDQ825B9HISA tag=67U8B3PR3RGU type=write size=3960445 2024-09-19T11:43:11.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.298+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~Z0XY0V4CRWCN.0 size=1048576 2024-09-19T11:43:11.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.298+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~Z0XY0V4CRWCN.1 size=1048576 2024-09-19T11:43:11.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.302+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~Z0XY0V4CRWCN.2 size=203220 2024-09-19T11:43:11.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.302+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=Z0XY0V4CRWCN tag=T3LN8STYPOXF type=write size=3348948 2024-09-19T11:43:11.309 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.306+0000 7f3d831968c0 1 < completed write operation key=E8OFSMUZHR02 tag=SMTUQ9JLAD8O type=write size=69011 2024-09-19T11:43:11.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.310+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~SBI6ZG184ZL2.0 size=273325 2024-09-19T11:43:11.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.310+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=SBI6ZG184ZL2 tag=63Y3TEQCVUIE type=write size=1321901 2024-09-19T11:43:11.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.314+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~ZBB0BXNZ9ZF9.0 size=270631 2024-09-19T11:43:11.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.318+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=ZBB0BXNZ9ZF9 tag=707WX2D6ODX8 type=write size=1319207 2024-09-19T11:43:11.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.322+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=YB3V8T2KO1AN type=del size=3007118 2024-09-19T11:43:11.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.326+0000 7f3d831968c0 1 < suggested remove operation key=2VJRZVU7S8LB tag=8FFOGNJYTNSD type=del 2024-09-19T11:43:11.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.330+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=JMVBQT2WOXTT type=del size=3005768 2024-09-19T11:43:11.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.334+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=K5UQM7ONYAS1 type=del 2024-09-19T11:43:11.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.342+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~2Q9JQB4L4CZU.0 size=1048576 2024-09-19T11:43:11.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.342+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~2Q9JQB4L4CZU.1 size=1048576 2024-09-19T11:43:11.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.346+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~2Q9JQB4L4CZU.2 size=573960 2024-09-19T11:43:11.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.346+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=2Q9JQB4L4CZU tag=Q23PKERW8JLA type=write size=3719688 2024-09-19T11:43:11.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.346+0000 7f3d831968c0 1 < canceled part key=_multipart_CULXGFLZ0HI6.2~NZDLPR7C0D4H.0 size=482480 2024-09-19T11:43:11.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.350+0000 7f3d831968c0 1 < canceled multipart upload key=CULXGFLZ0HI6 upload=NZDLPR7C0D4H tag=SMA31VZBWR7M type=write size=1531056 2024-09-19T11:43:11.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.358+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~54U32Q3EAEQ6.0 size=899016 2024-09-19T11:43:11.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.358+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=54U32Q3EAEQ6 tag=29C1LPTNQ4UD type=write size=1947592 2024-09-19T11:43:11.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.362+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=FLOAZNOF3IBH type=del 2024-09-19T11:43:11.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.362+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=Y6KALDQQR8KA type=del size=4187097 2024-09-19T11:43:11.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.366+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=9CC0Q60BTUPF type=del 2024-09-19T11:43:11.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.370+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=RLLIKLIJ963D type=del size=438379 2024-09-19T11:43:11.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.374+0000 7f3d831968c0 1 < suggested update operation key=8FGIZJIY58C7 tag=YTPXFA262GOJ type=del size=1125378 2024-09-19T11:43:11.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.378+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=ZDZ57H73ELH2 type=del size=2671729 2024-09-19T11:43:11.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.382+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=J505B9LQNM1P type=del 2024-09-19T11:43:11.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.390+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~VYSLMJ8BNCKZ.0 size=1048576 2024-09-19T11:43:11.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.390+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~VYSLMJ8BNCKZ.1 size=473271 2024-09-19T11:43:11.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.390+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=VYSLMJ8BNCKZ tag=IZFIW978FO4F type=write size=2570423 2024-09-19T11:43:11.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.394+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~HRDGK32RFSUS.0 size=1048576 2024-09-19T11:43:11.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.398+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~HRDGK32RFSUS.1 size=1048576 2024-09-19T11:43:11.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.398+0000 7f3d831968c0 1 < canceled part key=_multipart_66N4QS1R70Z7.2~HRDGK32RFSUS.2 size=269206 2024-09-19T11:43:11.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.402+0000 7f3d831968c0 1 < canceled multipart upload key=66N4QS1R70Z7 upload=HRDGK32RFSUS tag=X00SDS9BKJ76 type=write size=3414934 2024-09-19T11:43:11.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.406+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=HGUBH8WOSQ4H type=del size=4102300 2024-09-19T11:43:11.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.410+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~DS3HEHDT2ENA.0 size=428243 2024-09-19T11:43:11.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.414+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=DS3HEHDT2ENA tag=UGW2MWH2U5TP type=write size=1476819 2024-09-19T11:43:11.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.418+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=U8IV5JH33UKY type=del size=3462754 2024-09-19T11:43:11.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.422+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~O4ED7W86YYWS.0 size=1048576 2024-09-19T11:43:11.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.426+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~O4ED7W86YYWS.1 size=1048576 2024-09-19T11:43:11.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.430+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~O4ED7W86YYWS.2 size=1005620 2024-09-19T11:43:11.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.434+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=O4ED7W86YYWS tag=T2MP938X8ZO3 type=write size=4151348 2024-09-19T11:43:11.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.438+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=BX29DHE7EZ97 type=del size=2682912 2024-09-19T11:43:11.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.442+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=VUYIAM8934FP type=del 2024-09-19T11:43:11.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.446+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~DI1A63N76B02.0 size=220250 2024-09-19T11:43:11.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.446+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=DI1A63N76B02 tag=KTU03B4BP4HV type=write size=1268826 2024-09-19T11:43:11.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.450+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~NY5J3SMU9HMV.0 size=1048576 2024-09-19T11:43:11.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.458+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~NY5J3SMU9HMV.1 size=1048576 2024-09-19T11:43:11.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.462+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~NY5J3SMU9HMV.2 size=298251 2024-09-19T11:43:11.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.466+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=NY5J3SMU9HMV tag=1FSIBZ76WYBE type=write size=3443979 2024-09-19T11:43:11.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.470+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=PFHWNE0VI73M type=write size=752049 2024-09-19T11:43:11.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.474+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~F2CK923PKT43.0 size=1048576 2024-09-19T11:43:11.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.474+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~F2CK923PKT43.1 size=1048576 2024-09-19T11:43:11.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.478+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~F2CK923PKT43.2 size=969627 2024-09-19T11:43:11.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.482+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=F2CK923PKT43 tag=TZKMFIM025UH type=write size=4115355 2024-09-19T11:43:11.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.486+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=QJCLNRU76RM2 type=del size=1743783 2024-09-19T11:43:11.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.490+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~Z0XY0V4CRWCN.0 size=1048576 2024-09-19T11:43:11.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.494+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~Z0XY0V4CRWCN.1 size=1048576 2024-09-19T11:43:11.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.494+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~Z0XY0V4CRWCN.2 size=203220 2024-09-19T11:43:11.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.502+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=Z0XY0V4CRWCN tag=T3LN8STYPOXF type=write size=3348948 2024-09-19T11:43:11.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.506+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~5EAWJ556LCE7.0 size=186757 2024-09-19T11:43:11.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.506+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=5EAWJ556LCE7 tag=29UEZ3CEJU4B type=write size=1235333 2024-09-19T11:43:11.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.510+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~SBI6ZG184ZL2.0 size=273325 2024-09-19T11:43:11.520 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.518+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=SBI6ZG184ZL2 tag=63Y3TEQCVUIE type=write size=1321901 2024-09-19T11:43:11.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.518+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=GNMOBD0XT7ZP type=del size=1249452 2024-09-19T11:43:11.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.522+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=YB3V8T2KO1AN type=del 2024-09-19T11:43:11.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.526+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=55IBEUSH9B2R type=del size=310008 2024-09-19T11:43:11.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.530+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=JMVBQT2WOXTT type=del 2024-09-19T11:43:11.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.534+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=DHIWG6EFNSDQ type=write size=279393 2024-09-19T11:43:11.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.538+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~2Q9JQB4L4CZU.0 size=1048576 2024-09-19T11:43:11.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.538+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~2Q9JQB4L4CZU.1 size=1048576 2024-09-19T11:43:11.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.542+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~2Q9JQB4L4CZU.2 size=573960 2024-09-19T11:43:11.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.546+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=2Q9JQB4L4CZU tag=Q23PKERW8JLA type=write size=3719688 2024-09-19T11:43:11.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.554+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~OM1699UZU417.0 size=1048576 2024-09-19T11:43:11.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.558+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~OM1699UZU417.1 size=1048576 2024-09-19T11:43:11.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.562+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~OM1699UZU417.2 size=1044516 2024-09-19T11:43:11.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.562+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=OM1699UZU417 tag=SJTG6SGT41U4 type=write size=4190244 2024-09-19T11:43:11.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.562+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~54U32Q3EAEQ6.0 size=899016 2024-09-19T11:43:11.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.570+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=54U32Q3EAEQ6 tag=29C1LPTNQ4UD type=write size=1947592 2024-09-19T11:43:11.577 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.574+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=7X0W7YU58CJA type=write size=784115 2024-09-19T11:43:11.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.574+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=Y6KALDQQR8KA type=del 2024-09-19T11:43:11.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.578+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=7QXRYK7JION0 type=write size=459764 2024-09-19T11:43:11.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.582+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=RLLIKLIJ963D type=del 2024-09-19T11:43:11.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.586+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=E1MQXTZMHDS2 type=del size=1924796 2024-09-19T11:43:11.592 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.586+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=ZDZ57H73ELH2 type=del 2024-09-19T11:43:11.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.590+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=VBG0VVKW3UHG type=write size=452292 2024-09-19T11:43:11.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.594+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~VYSLMJ8BNCKZ.0 size=1048576 2024-09-19T11:43:11.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.598+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~VYSLMJ8BNCKZ.1 size=473271 2024-09-19T11:43:11.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.602+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=VYSLMJ8BNCKZ tag=IZFIW978FO4F type=write size=2570423 2024-09-19T11:43:11.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.610+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~40CR26FUEMVS.0 size=1048576 2024-09-19T11:43:11.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.610+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~40CR26FUEMVS.1 size=415184 2024-09-19T11:43:11.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.610+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=40CR26FUEMVS tag=D7KLZUYFEWGJ type=write size=2512336 2024-09-19T11:43:11.618 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.614+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=HGUBH8WOSQ4H type=del 2024-09-19T11:43:11.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.622+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~BBYVZX2SOOYR.0 size=1048576 2024-09-19T11:43:11.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.622+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~BBYVZX2SOOYR.1 size=1048576 2024-09-19T11:43:11.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.626+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~BBYVZX2SOOYR.2 size=46087 2024-09-19T11:43:11.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.626+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=BBYVZX2SOOYR tag=357NS9HK9QA0 type=write size=3191815 2024-09-19T11:43:11.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.630+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=U8IV5JH33UKY type=del 2024-09-19T11:43:11.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.634+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=NC37EX1E8C68 type=del size=2723621 2024-09-19T11:43:11.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.634+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=BX29DHE7EZ97 type=del 2024-09-19T11:43:11.643 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.638+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=AHVZWVG2MQ36 type=del size=2980734 2024-09-19T11:43:11.647 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.642+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~DI1A63N76B02.0 size=220250 2024-09-19T11:43:11.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.646+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=DI1A63N76B02 tag=KTU03B4BP4HV type=write size=1268826 2024-09-19T11:43:11.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.654+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~7FJ0BLMFYU9J.0 size=1048576 2024-09-19T11:43:11.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.658+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~7FJ0BLMFYU9J.1 size=672225 2024-09-19T11:43:11.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.658+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=7FJ0BLMFYU9J tag=LEXK24HL31MT type=write size=2769377 2024-09-19T11:43:11.664 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.658+0000 7f3d831968c0 1 < completed write operation key=FKLL38ZNCJ21 tag=PFHWNE0VI73M type=write size=752049 2024-09-19T11:43:11.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.662+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=QQ53SAYIPRKF type=del size=1519394 2024-09-19T11:43:11.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.666+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=QJCLNRU76RM2 type=del 2024-09-19T11:43:11.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.670+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~VP3AVDU9ZTDC.0 size=5482 2024-09-19T11:43:11.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.670+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=VP3AVDU9ZTDC tag=TO3CIM5PU8SR type=write size=1054058 2024-09-19T11:43:11.678 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.674+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~5EAWJ556LCE7.0 size=186757 2024-09-19T11:43:11.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.678+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=5EAWJ556LCE7 tag=29UEZ3CEJU4B type=write size=1235333 2024-09-19T11:43:11.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.686+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~8I93Z8CVSLJQ.0 size=1048576 2024-09-19T11:43:11.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.686+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~8I93Z8CVSLJQ.1 size=752468 2024-09-19T11:43:11.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.686+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=8I93Z8CVSLJQ tag=E89KXPFSRAVT type=write size=2849620 2024-09-19T11:43:11.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.690+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=GNMOBD0XT7ZP type=del 2024-09-19T11:43:11.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.694+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=U8AWDQP2X7BK type=del size=4121453 2024-09-19T11:43:11.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.698+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=55IBEUSH9B2R type=del 2024-09-19T11:43:11.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.702+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=V3X2OXWD8KJ4 type=del size=240379 2024-09-19T11:43:11.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.706+0000 7f3d831968c0 1 < completed write operation key=66N4QS1R70Z7 tag=DHIWG6EFNSDQ type=write size=279393 2024-09-19T11:43:11.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.710+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~CT3AGXXIW6Y0.0 size=98163 2024-09-19T11:43:11.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.710+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=CT3AGXXIW6Y0 tag=JC3YB723QHR1 type=write size=1146739 2024-09-19T11:43:11.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.714+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~OM1699UZU417.0 size=1048576 2024-09-19T11:43:11.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.718+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~OM1699UZU417.1 size=1048576 2024-09-19T11:43:11.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.722+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~OM1699UZU417.2 size=1044516 2024-09-19T11:43:11.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.726+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=OM1699UZU417 tag=SJTG6SGT41U4 type=write size=4190244 2024-09-19T11:43:11.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.734+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~EGL0RY74AS2Y.0 size=1048576 2024-09-19T11:43:11.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.734+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~EGL0RY74AS2Y.1 size=33573 2024-09-19T11:43:11.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.734+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=EGL0RY74AS2Y tag=T652Q3YFHLKB type=write size=2130725 2024-09-19T11:43:11.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.738+0000 7f3d831968c0 1 < completed write operation key=E8OFSMUZHR02 tag=7X0W7YU58CJA type=write size=784115 2024-09-19T11:43:11.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.742+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=QSXBA4VU0CWY type=del size=2148894 2024-09-19T11:43:11.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.746+0000 7f3d831968c0 1 < canceled operation key=UI7EVZ1SGD8R tag=7QXRYK7JION0 type=write size=459764 2024-09-19T11:43:11.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.746+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=NPV1VWMUCTXK type=write size=817212 2024-09-19T11:43:11.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.754+0000 7f3d831968c0 1 < suggested remove operation key=900RV3451AON tag=E1MQXTZMHDS2 type=del 2024-09-19T11:43:11.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.758+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=VJ5PGW6SNR26 type=del size=1670905 2024-09-19T11:43:11.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.762+0000 7f3d831968c0 1 < completed write operation key=00DYD22W0ZNB tag=VBG0VVKW3UHG type=write size=452292 2024-09-19T11:43:11.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.766+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=VRZOUBPW1Q37 type=del size=2673953 2024-09-19T11:43:11.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.770+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~40CR26FUEMVS.0 size=1048576 2024-09-19T11:43:11.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.770+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~40CR26FUEMVS.1 size=415184 2024-09-19T11:43:11.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.778+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=40CR26FUEMVS tag=D7KLZUYFEWGJ type=write size=2512336 2024-09-19T11:43:11.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.782+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~HU3SS3PLB9WM.0 size=143070 2024-09-19T11:43:11.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.782+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=HU3SS3PLB9WM tag=DFA75M2R53SW type=write size=1191646 2024-09-19T11:43:11.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.786+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~BBYVZX2SOOYR.0 size=1048576 2024-09-19T11:43:11.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.786+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~BBYVZX2SOOYR.1 size=1048576 2024-09-19T11:43:11.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.790+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~BBYVZX2SOOYR.2 size=46087 2024-09-19T11:43:11.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.794+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=BBYVZX2SOOYR tag=357NS9HK9QA0 type=write size=3191815 2024-09-19T11:43:11.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.802+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~0RRQ5OXQIVZQ.0 size=1048576 2024-09-19T11:43:11.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.806+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~0RRQ5OXQIVZQ.1 size=810178 2024-09-19T11:43:11.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.806+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=0RRQ5OXQIVZQ tag=KFRC3WXG98BD type=write size=2907330 2024-09-19T11:43:11.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.810+0000 7f3d831968c0 1 < suggested remove operation key=4V17CRW6EB65 tag=NC37EX1E8C68 type=del 2024-09-19T11:43:11.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.814+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=VPZUGF0F61JZ type=write size=796769 2024-09-19T11:43:11.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.818+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=AHVZWVG2MQ36 type=del 2024-09-19T11:43:11.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.822+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=Z3AZTF0PN6M0 type=del size=460526 2024-09-19T11:43:11.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.826+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~7FJ0BLMFYU9J.0 size=1048576 2024-09-19T11:43:11.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.830+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~7FJ0BLMFYU9J.1 size=672225 2024-09-19T11:43:11.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.834+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=7FJ0BLMFYU9J tag=LEXK24HL31MT type=write size=2769377 2024-09-19T11:43:11.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.838+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~SKVVZ0QKF7NH.0 size=1048576 2024-09-19T11:43:11.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.842+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~SKVVZ0QKF7NH.1 size=332322 2024-09-19T11:43:11.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.842+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=SKVVZ0QKF7NH tag=AHYSWT4YDLUR type=write size=2429474 2024-09-19T11:43:11.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.850+0000 7f3d831968c0 1 < suggested update operation key=2VJRZVU7S8LB tag=QQ53SAYIPRKF type=del size=1519394 2024-09-19T11:43:11.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.854+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~9JFG4E77JLMP.0 size=1048576 2024-09-19T11:43:11.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.858+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~9JFG4E77JLMP.1 size=1025073 2024-09-19T11:43:11.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.858+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=9JFG4E77JLMP tag=TRASP2EUZE2L type=write size=3122225 2024-09-19T11:43:11.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.858+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~VP3AVDU9ZTDC.0 size=5482 2024-09-19T11:43:11.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.866+0000 7f3d831968c0 1 < completed multipart upload key=76JFMPOUJZXW upload=VP3AVDU9ZTDC tag=TO3CIM5PU8SR type=write size=1054058 2024-09-19T11:43:11.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.870+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~MPJPYI57FQFI.0 size=1048576 2024-09-19T11:43:11.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.874+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~MPJPYI57FQFI.1 size=1048576 2024-09-19T11:43:11.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.874+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~MPJPYI57FQFI.2 size=899731 2024-09-19T11:43:11.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.874+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=MPJPYI57FQFI tag=PSEY11O0TU6Y type=write size=4045459 2024-09-19T11:43:11.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.878+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~8I93Z8CVSLJQ.0 size=1048576 2024-09-19T11:43:11.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.882+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~8I93Z8CVSLJQ.1 size=752468 2024-09-19T11:43:11.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.886+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=8I93Z8CVSLJQ tag=E89KXPFSRAVT type=write size=2849620 2024-09-19T11:43:11.894 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.890+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=NB3Q00F4540E type=del size=2090973 2024-09-19T11:43:11.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.894+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=U8AWDQP2X7BK type=del 2024-09-19T11:43:11.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.898+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=B2F9UCP1A0JC type=del size=2768127 2024-09-19T11:43:11.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.898+0000 7f3d831968c0 1 < completed delete operation key=3QWBQYLI0SJR tag=V3X2OXWD8KJ4 type=del 2024-09-19T11:43:11.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.906+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~QT5WTUK6SBVJ.0 size=764868 2024-09-19T11:43:11.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.906+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=QT5WTUK6SBVJ tag=7EIOCG9B9FLK type=write size=1813444 2024-09-19T11:43:11.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.910+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~CT3AGXXIW6Y0.0 size=98163 2024-09-19T11:43:11.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.914+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=CT3AGXXIW6Y0 tag=JC3YB723QHR1 type=write size=1146739 2024-09-19T11:43:11.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.918+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=WSYNZO9K5T8N type=write size=555242 2024-09-19T11:43:11.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.922+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~EGL0RY74AS2Y.0 size=1048576 2024-09-19T11:43:11.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.926+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~EGL0RY74AS2Y.1 size=33573 2024-09-19T11:43:11.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.930+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=EGL0RY74AS2Y tag=T652Q3YFHLKB type=write size=2130725 2024-09-19T11:43:11.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.934+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=4ZF08B32OYFW type=del size=188157 2024-09-19T11:43:11.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.938+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=QSXBA4VU0CWY type=del 2024-09-19T11:43:11.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.942+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~HOL62OUC9996.0 size=1048576 2024-09-19T11:43:11.949 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.946+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~HOL62OUC9996.1 size=765718 2024-09-19T11:43:11.949 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.946+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=HOL62OUC9996 tag=ZLFG3J9IVSN5 type=write size=2862870 2024-09-19T11:43:11.952 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.950+0000 7f3d831968c0 1 < completed write operation key=I5XUMA2HKIR5 tag=NPV1VWMUCTXK type=write size=817212 2024-09-19T11:43:11.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.954+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=THPHX1EQPSJ0 type=del size=1421102 2024-09-19T11:43:11.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.954+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=VJ5PGW6SNR26 type=del 2024-09-19T11:43:11.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.958+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=0YXVI9UNR2Y7 type=write size=721437 2024-09-19T11:43:11.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.966+0000 7f3d831968c0 1 < suggested remove operation key=JV7EGEI6062Y tag=VRZOUBPW1Q37 type=del 2024-09-19T11:43:11.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.970+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=7RTKQUITD8GE type=write size=813996 2024-09-19T11:43:11.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.974+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~HU3SS3PLB9WM.0 size=143070 2024-09-19T11:43:11.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.978+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=HU3SS3PLB9WM tag=DFA75M2R53SW type=write size=1191646 2024-09-19T11:43:11.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.982+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=325ZBMLTWE4D type=del size=2476342 2024-09-19T11:43:11.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.986+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~0RRQ5OXQIVZQ.0 size=1048576 2024-09-19T11:43:11.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.990+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~0RRQ5OXQIVZQ.1 size=810178 2024-09-19T11:43:11.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.994+0000 7f3d831968c0 1 < completed multipart upload key=76JFMPOUJZXW upload=0RRQ5OXQIVZQ tag=KFRC3WXG98BD type=write size=2907330 2024-09-19T11:43:12.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:11.998+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=DYKOLTB1BKTK type=del size=2409954 2024-09-19T11:43:12.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.002+0000 7f3d831968c0 1 < canceled operation key=PB62JE7I55GG tag=VPZUGF0F61JZ type=write size=796769 2024-09-19T11:43:12.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.006+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=DBJL3TLSP51A type=del size=985478 2024-09-19T11:43:12.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.010+0000 7f3d831968c0 1 < suggested update operation key=5RTONAWGYJNE tag=Z3AZTF0PN6M0 type=del size=460526 2024-09-19T11:43:12.023 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.018+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~1DZ5JDSNJSNK.0 size=1048576 2024-09-19T11:43:12.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.022+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~1DZ5JDSNJSNK.1 size=1048576 2024-09-19T11:43:12.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.026+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~1DZ5JDSNJSNK.2 size=621923 2024-09-19T11:43:12.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.026+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=1DZ5JDSNJSNK tag=JIUQE30XR06A type=write size=3767651 2024-09-19T11:43:12.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.030+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~SKVVZ0QKF7NH.0 size=1048576 2024-09-19T11:43:12.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.034+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~SKVVZ0QKF7NH.1 size=332322 2024-09-19T11:43:12.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.038+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=SKVVZ0QKF7NH tag=AHYSWT4YDLUR type=write size=2429474 2024-09-19T11:43:12.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.042+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=5AYVSBJU2IOV type=del size=1102048 2024-09-19T11:43:12.050 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.046+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~9JFG4E77JLMP.0 size=1048576 2024-09-19T11:43:12.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.050+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~9JFG4E77JLMP.1 size=1025073 2024-09-19T11:43:12.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.054+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=9JFG4E77JLMP tag=TRASP2EUZE2L type=write size=3122225 2024-09-19T11:43:12.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.058+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=ZAKGERQRAJVY type=del size=2097038 2024-09-19T11:43:12.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.062+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~MPJPYI57FQFI.0 size=1048576 2024-09-19T11:43:12.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.062+0000 7f3d831968c0 1 < canceled part key=_multipart_G4P6HIOM1G2E.2~MPJPYI57FQFI.1 size=1048576 2024-09-19T11:43:12.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.066+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~MPJPYI57FQFI.2 size=899731 2024-09-19T11:43:12.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.078+0000 7f3d831968c0 1 < canceled multipart upload key=G4P6HIOM1G2E upload=MPJPYI57FQFI tag=PSEY11O0TU6Y type=write size=4045459 2024-09-19T11:43:12.087 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.082+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~GQRFW3J4OO65.0 size=1048576 2024-09-19T11:43:12.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.086+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~GQRFW3J4OO65.1 size=90308 2024-09-19T11:43:12.091 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.086+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=GQRFW3J4OO65 tag=NVOK1ICFM3W5 type=write size=2187460 2024-09-19T11:43:12.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.094+0000 7f3d831968c0 1 < suggested remove operation key=224HPC2Y95N6 tag=NB3Q00F4540E type=del 2024-09-19T11:43:12.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.094+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=3O9LP0B3PLUA type=del size=1225111 2024-09-19T11:43:12.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.098+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=B2F9UCP1A0JC type=del 2024-09-19T11:43:12.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.106+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~QSC2BQWL4AX8.0 size=1048576 2024-09-19T11:43:12.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.106+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~QSC2BQWL4AX8.1 size=477540 2024-09-19T11:43:12.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.106+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=QSC2BQWL4AX8 tag=DEURRQ48DVMQ type=write size=2574692 2024-09-19T11:43:12.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.110+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~QT5WTUK6SBVJ.0 size=764868 2024-09-19T11:43:12.120 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.118+0000 7f3d831968c0 1 < completed multipart upload key=3GD7UZCI3WX4 upload=QT5WTUK6SBVJ tag=7EIOCG9B9FLK type=write size=1813444 2024-09-19T11:43:12.123 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.118+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=V6EF5POWYR03 type=del size=3786652 2024-09-19T11:43:12.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.122+0000 7f3d831968c0 1 < completed write operation key=LINLTWYV88VU tag=WSYNZO9K5T8N type=write size=555242 2024-09-19T11:43:12.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.126+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=3TP0ZRB85XZN type=del size=2350103 2024-09-19T11:43:12.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.130+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=4ZF08B32OYFW type=del 2024-09-19T11:43:12.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.134+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=Y27Q7F5SXB0W type=del size=912500 2024-09-19T11:43:12.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.134+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~HOL62OUC9996.0 size=1048576 2024-09-19T11:43:12.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.138+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~HOL62OUC9996.1 size=765718 2024-09-19T11:43:12.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.142+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=HOL62OUC9996 tag=ZLFG3J9IVSN5 type=write size=2862870 2024-09-19T11:43:12.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.146+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=9G658HGL6HH0 type=del size=3978075 2024-09-19T11:43:12.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.150+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=THPHX1EQPSJ0 type=del 2024-09-19T11:43:12.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.154+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=3AXF580LZZMV type=del size=3015104 2024-09-19T11:43:12.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.158+0000 7f3d831968c0 1 < suggested remove operation key=EVFF0F0760OS tag=0YXVI9UNR2Y7 type=write 2024-09-19T11:43:12.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.162+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=L9SCIJ01EL9S type=del size=1110955 2024-09-19T11:43:12.169 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.166+0000 7f3d831968c0 1 < canceled operation key=76JFMPOUJZXW tag=7RTKQUITD8GE type=write size=813996 2024-09-19T11:43:12.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.170+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=3T6KKZRLK58K type=del size=1032717 2024-09-19T11:43:12.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.174+0000 7f3d831968c0 1 < suggested update operation key=3K8P37C015G3 tag=325ZBMLTWE4D type=del size=2476342 2024-09-19T11:43:12.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.182+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~N8TJ2KV29HL2.0 size=229440 2024-09-19T11:43:12.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.182+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=N8TJ2KV29HL2 tag=YHC6ZDKNRE6Q type=write size=1278016 2024-09-19T11:43:12.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.186+0000 7f3d831968c0 1 < suggested update operation key=E8OFSMUZHR02 tag=DYKOLTB1BKTK type=del size=2409954 2024-09-19T11:43:12.196 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.194+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~OVKXW9GJ15J5.0 size=1048576 2024-09-19T11:43:12.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.194+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~OVKXW9GJ15J5.1 size=629538 2024-09-19T11:43:12.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.194+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=OVKXW9GJ15J5 tag=2FJYIXRNBC16 type=write size=2726690 2024-09-19T11:43:12.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.198+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=DBJL3TLSP51A type=del 2024-09-19T11:43:12.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.202+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=219LAPMDEBGC type=del size=1125122 2024-09-19T11:43:12.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.206+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~1DZ5JDSNJSNK.0 size=1048576 2024-09-19T11:43:12.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.206+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~1DZ5JDSNJSNK.1 size=1048576 2024-09-19T11:43:12.213 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.210+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~1DZ5JDSNJSNK.2 size=621923 2024-09-19T11:43:12.218 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.214+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=1DZ5JDSNJSNK tag=JIUQE30XR06A type=write size=3767651 2024-09-19T11:43:12.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.218+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=PX4QJJ8CRBD1 type=del size=458826 2024-09-19T11:43:12.225 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.222+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=5AYVSBJU2IOV type=del 2024-09-19T11:43:12.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.226+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~R3S1K52CDGSU.0 size=1048576 2024-09-19T11:43:12.234 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.230+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~R3S1K52CDGSU.1 size=1048576 2024-09-19T11:43:12.236 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.230+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~R3S1K52CDGSU.2 size=795840 2024-09-19T11:43:12.236 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.230+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=R3S1K52CDGSU tag=4S20ODB8Z7ZU type=write size=3941568 2024-09-19T11:43:12.239 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.234+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=ZAKGERQRAJVY type=del 2024-09-19T11:43:12.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.238+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=KJE0L7TXFY0Q type=del size=2188215 2024-09-19T11:43:12.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.242+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~GQRFW3J4OO65.0 size=1048576 2024-09-19T11:43:12.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.242+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~GQRFW3J4OO65.1 size=90308 2024-09-19T11:43:12.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.246+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=GQRFW3J4OO65 tag=NVOK1ICFM3W5 type=write size=2187460 2024-09-19T11:43:12.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.250+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=AICLIM9FS83C type=del size=1993178 2024-09-19T11:43:12.260 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.258+0000 7f3d831968c0 1 < suggested remove operation key=FKLL38ZNCJ21 tag=3O9LP0B3PLUA type=del 2024-09-19T11:43:12.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.258+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=ZH4GZB1OA6HT type=del size=1830057 2024-09-19T11:43:12.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.262+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~QSC2BQWL4AX8.0 size=1048576 2024-09-19T11:43:12.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.266+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~QSC2BQWL4AX8.1 size=477540 2024-09-19T11:43:12.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.270+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=QSC2BQWL4AX8 tag=DEURRQ48DVMQ type=write size=2574692 2024-09-19T11:43:12.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.274+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~6LZDPQT1S0MB.0 size=135761 2024-09-19T11:43:12.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.274+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=6LZDPQT1S0MB tag=VZUP8XE2F14V type=write size=1184337 2024-09-19T11:43:12.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.278+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=V6EF5POWYR03 type=del 2024-09-19T11:43:12.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.282+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=CNV3B4L32P7X type=del size=3183894 2024-09-19T11:43:12.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.286+0000 7f3d831968c0 1 < suggested remove operation key=QPG75T46BH38 tag=3TP0ZRB85XZN type=del 2024-09-19T11:43:12.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.290+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=X7914A1Y288L type=del size=1444435 2024-09-19T11:43:12.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.290+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=Y27Q7F5SXB0W type=del 2024-09-19T11:43:12.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.298+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~WVQ03JJCWNT7.0 size=1048576 2024-09-19T11:43:12.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.298+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~WVQ03JJCWNT7.1 size=887746 2024-09-19T11:43:12.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.298+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=WVQ03JJCWNT7 tag=VXJJXEHAS927 type=write size=2984898 2024-09-19T11:43:12.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.302+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=9G658HGL6HH0 type=del 2024-09-19T11:43:12.309 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.306+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=D2EQUWJ2ACLG type=del size=367414 2024-09-19T11:43:12.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.306+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=3AXF580LZZMV type=del 2024-09-19T11:43:12.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.310+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=16IRE7HJBDZ4 type=write size=32705 2024-09-19T11:43:12.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.314+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=L9SCIJ01EL9S type=del 2024-09-19T11:43:12.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.314+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=U469XX5JAIO6 type=write size=812687 2024-09-19T11:43:12.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.322+0000 7f3d831968c0 1 < suggested update operation key=T9KJH2ZYCLVA tag=3T6KKZRLK58K type=del size=1032717 2024-09-19T11:43:12.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.326+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~RNX7RUFLQO1E.0 size=1048576 2024-09-19T11:43:12.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.326+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~RNX7RUFLQO1E.1 size=424824 2024-09-19T11:43:12.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.326+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=RNX7RUFLQO1E tag=UPPBK12OM39V type=write size=2521976 2024-09-19T11:43:12.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.326+0000 7f3d831968c0 1 < canceled part key=_multipart_0OOB2SNLVK8E.2~N8TJ2KV29HL2.0 size=229440 2024-09-19T11:43:12.336 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.330+0000 7f3d831968c0 1 < canceled multipart upload key=0OOB2SNLVK8E upload=N8TJ2KV29HL2 tag=YHC6ZDKNRE6Q type=write size=1278016 2024-09-19T11:43:12.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.334+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=U3ZSQNXHFEJS type=del size=3415342 2024-09-19T11:43:12.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.338+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~OVKXW9GJ15J5.0 size=1048576 2024-09-19T11:43:12.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.338+0000 7f3d831968c0 1 < canceled part key=_multipart_4V17CRW6EB65.2~OVKXW9GJ15J5.1 size=629538 2024-09-19T11:43:12.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.342+0000 7f3d831968c0 1 < canceled multipart upload key=4V17CRW6EB65 upload=OVKXW9GJ15J5 tag=2FJYIXRNBC16 type=write size=2726690 2024-09-19T11:43:12.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.350+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~8Z17JAEFW1MT.0 size=664894 2024-09-19T11:43:12.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.350+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=8Z17JAEFW1MT tag=RA63XV7BOM65 type=write size=1713470 2024-09-19T11:43:12.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.350+0000 7f3d831968c0 1 < completed delete operation key=3QWBQYLI0SJR tag=219LAPMDEBGC type=del 2024-09-19T11:43:12.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.354+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=5FHFS81MGGNK type=del size=2184549 2024-09-19T11:43:12.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.358+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=PX4QJJ8CRBD1 type=del 2024-09-19T11:43:12.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.362+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=HBRJSWIP477O type=del size=646029 2024-09-19T11:43:12.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.366+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~R3S1K52CDGSU.0 size=1048576 2024-09-19T11:43:12.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.370+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~R3S1K52CDGSU.1 size=1048576 2024-09-19T11:43:12.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.370+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~R3S1K52CDGSU.2 size=795840 2024-09-19T11:43:12.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.378+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=R3S1K52CDGSU tag=4S20ODB8Z7ZU type=write size=3941568 2024-09-19T11:43:12.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.382+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~MTWAGQXFTFLZ.0 size=1048576 2024-09-19T11:43:12.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.386+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~MTWAGQXFTFLZ.1 size=817837 2024-09-19T11:43:12.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.386+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=MTWAGQXFTFLZ tag=9Z17E08OSYYU type=write size=2914989 2024-09-19T11:43:12.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.386+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=KJE0L7TXFY0Q type=del 2024-09-19T11:43:12.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.394+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~MRRYJ8GEGM22.0 size=664576 2024-09-19T11:43:12.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.394+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=MRRYJ8GEGM22 tag=1Q8GVU6KTGMU type=write size=1713152 2024-09-19T11:43:12.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.394+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=AICLIM9FS83C type=del 2024-09-19T11:43:12.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.398+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~5DF7IZ4J9DPZ.0 size=1048576 2024-09-19T11:43:12.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.402+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~5DF7IZ4J9DPZ.1 size=1048576 2024-09-19T11:43:12.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.406+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~5DF7IZ4J9DPZ.2 size=996098 2024-09-19T11:43:12.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.406+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=5DF7IZ4J9DPZ tag=39CSMHQU713J type=write size=4141826 2024-09-19T11:43:12.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.410+0000 7f3d831968c0 1 < suggested remove operation key=224HPC2Y95N6 tag=ZH4GZB1OA6HT type=del 2024-09-19T11:43:12.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.414+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=9E433XQZKGVY type=del size=3666700 2024-09-19T11:43:12.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.414+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~6LZDPQT1S0MB.0 size=135761 2024-09-19T11:43:12.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.422+0000 7f3d831968c0 1 < completed multipart upload key=3GD7UZCI3WX4 upload=6LZDPQT1S0MB tag=VZUP8XE2F14V type=write size=1184337 2024-09-19T11:43:12.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.426+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~WTZRR9FXVNEB.0 size=495794 2024-09-19T11:43:12.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.426+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=WTZRR9FXVNEB tag=JV20YQPPBWGU type=write size=1544370 2024-09-19T11:43:12.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.430+0000 7f3d831968c0 -1 < failed to complete operation key=224HPC2Y95N6 tag=CNV3B4L32P7X type=del size=3183894: (22) Invalid argument 2024-09-19T11:43:12.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.434+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~SYZOZSTT5RYT.0 size=1048576 2024-09-19T11:43:12.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.438+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~SYZOZSTT5RYT.1 size=1048576 2024-09-19T11:43:12.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.438+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~SYZOZSTT5RYT.2 size=188197 2024-09-19T11:43:12.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.438+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=SYZOZSTT5RYT tag=E8R1DIFSINI9 type=write size=3333925 2024-09-19T11:43:12.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.446+0000 7f3d831968c0 1 < suggested remove operation key=4V17CRW6EB65 tag=X7914A1Y288L type=del 2024-09-19T11:43:12.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.450+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~LIW21EJRDI0E.0 size=1048576 2024-09-19T11:43:12.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.450+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~LIW21EJRDI0E.1 size=199215 2024-09-19T11:43:12.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.450+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=LIW21EJRDI0E tag=NOKLK6PBOT3B type=write size=2296367 2024-09-19T11:43:12.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.454+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~WVQ03JJCWNT7.0 size=1048576 2024-09-19T11:43:12.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.458+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~WVQ03JJCWNT7.1 size=887746 2024-09-19T11:43:12.467 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.462+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=WVQ03JJCWNT7 tag=VXJJXEHAS927 type=write size=2984898 2024-09-19T11:43:12.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.466+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=6X1E4LSE7W33 type=del size=905243 2024-09-19T11:43:12.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.470+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=D2EQUWJ2ACLG type=del 2024-09-19T11:43:12.478 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.474+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~ULSVG6K98IP6.0 size=1048576 2024-09-19T11:43:12.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.478+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~ULSVG6K98IP6.1 size=585408 2024-09-19T11:43:12.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.478+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=ULSVG6K98IP6 tag=HL36HBPLO4NI type=write size=2682560 2024-09-19T11:43:12.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.482+0000 7f3d831968c0 1 < suggested remove operation key=FKLL38ZNCJ21 tag=16IRE7HJBDZ4 type=write 2024-09-19T11:43:12.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.486+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~Z1I8OORX29DL.0 size=533873 2024-09-19T11:43:12.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.486+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=Z1I8OORX29DL tag=HJ7I8E075WJ3 type=write size=1582449 2024-09-19T11:43:12.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.490+0000 7f3d831968c0 1 < completed write operation key=5RTONAWGYJNE tag=U469XX5JAIO6 type=write size=812687 2024-09-19T11:43:12.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.494+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=KUGOOT89OB2I type=del size=3321288 2024-09-19T11:43:12.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.498+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~RNX7RUFLQO1E.0 size=1048576 2024-09-19T11:43:12.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.502+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~RNX7RUFLQO1E.1 size=424824 2024-09-19T11:43:12.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.506+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=RNX7RUFLQO1E tag=UPPBK12OM39V type=write size=2521976 2024-09-19T11:43:12.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.510+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=19DY5I2DHFEO type=del size=526747 2024-09-19T11:43:12.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.510+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=U3ZSQNXHFEJS type=del 2024-09-19T11:43:12.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.514+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=6ECTFN2JDMEN type=write size=475426 2024-09-19T11:43:12.521 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.518+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~8Z17JAEFW1MT.0 size=664894 2024-09-19T11:43:12.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.522+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=8Z17JAEFW1MT tag=RA63XV7BOM65 type=write size=1713470 2024-09-19T11:43:12.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.526+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~HMH91ICTH5TK.0 size=1048576 2024-09-19T11:43:12.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.530+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~HMH91ICTH5TK.1 size=355328 2024-09-19T11:43:12.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.530+0000 7f3d831968c0 1 > prepared multipart upload key=JTPBGWC4T3Y5 upload=HMH91ICTH5TK tag=WK3P7UG100GO type=write size=2452480 2024-09-19T11:43:12.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.534+0000 7f3d831968c0 1 < suggested update operation key=3QWBQYLI0SJR tag=5FHFS81MGGNK type=del size=2184549 2024-09-19T11:43:12.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.538+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~IFP89J3PMXUH.0 size=1048576 2024-09-19T11:43:12.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.542+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~IFP89J3PMXUH.1 size=1048576 2024-09-19T11:43:12.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.546+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~IFP89J3PMXUH.2 size=908617 2024-09-19T11:43:12.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.546+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=IFP89J3PMXUH tag=63TFRWHMD6RB type=write size=4054345 2024-09-19T11:43:12.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.546+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=HBRJSWIP477O type=del 2024-09-19T11:43:12.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.554+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~IHUN4V0QW61B.0 size=545033 2024-09-19T11:43:12.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.554+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=IHUN4V0QW61B tag=CJ4F72DR21XW type=write size=1593609 2024-09-19T11:43:12.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.554+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~MTWAGQXFTFLZ.0 size=1048576 2024-09-19T11:43:12.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.554+0000 7f3d831968c0 1 < canceled part key=_multipart_76JFMPOUJZXW.2~MTWAGQXFTFLZ.1 size=817837 2024-09-19T11:43:12.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.558+0000 7f3d831968c0 1 < canceled multipart upload key=76JFMPOUJZXW upload=MTWAGQXFTFLZ tag=9Z17E08OSYYU type=write size=2914989 2024-09-19T11:43:12.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.562+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=VRALUU58OYFK type=del size=3993071 2024-09-19T11:43:12.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.566+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~MRRYJ8GEGM22.0 size=664576 2024-09-19T11:43:12.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.570+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=MRRYJ8GEGM22 tag=1Q8GVU6KTGMU type=write size=1713152 2024-09-19T11:43:12.577 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.574+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=7LYUIADH2EJ0 type=write size=478058 2024-09-19T11:43:12.580 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.574+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~5DF7IZ4J9DPZ.0 size=1048576 2024-09-19T11:43:12.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.578+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~5DF7IZ4J9DPZ.1 size=1048576 2024-09-19T11:43:12.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.582+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~5DF7IZ4J9DPZ.2 size=996098 2024-09-19T11:43:12.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.586+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=5DF7IZ4J9DPZ tag=39CSMHQU713J type=write size=4141826 2024-09-19T11:43:12.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.590+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=ICZTOI7YL9V0 type=del size=4147795 2024-09-19T11:43:12.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.598+0000 7f3d831968c0 1 < suggested update operation key=6NLQ0BK8AJUO tag=9E433XQZKGVY type=del size=3666700 2024-09-19T11:43:12.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.598+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=0VWORXV4ZTO6 type=write size=793580 2024-09-19T11:43:12.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.602+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~WTZRR9FXVNEB.0 size=495794 2024-09-19T11:43:12.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.610+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=WTZRR9FXVNEB tag=JV20YQPPBWGU type=write size=1544370 2024-09-19T11:43:12.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.614+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=57PO6HIE3CSD type=del size=1068682 2024-09-19T11:43:12.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.614+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~SYZOZSTT5RYT.0 size=1048576 2024-09-19T11:43:12.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.614+0000 7f3d831968c0 1 < canceled part key=_multipart_900RV3451AON.2~SYZOZSTT5RYT.1 size=1048576 2024-09-19T11:43:12.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.618+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~SYZOZSTT5RYT.2 size=188197 2024-09-19T11:43:12.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.626+0000 7f3d831968c0 1 < canceled multipart upload key=900RV3451AON upload=SYZOZSTT5RYT tag=E8R1DIFSINI9 type=write size=3333925 2024-09-19T11:43:12.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.626+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=VFHI0UVAZ266 type=del size=1335476 2024-09-19T11:43:12.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.630+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~LIW21EJRDI0E.0 size=1048576 2024-09-19T11:43:12.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.634+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~LIW21EJRDI0E.1 size=199215 2024-09-19T11:43:12.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.646+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=LIW21EJRDI0E tag=NOKLK6PBOT3B type=write size=2296367 2024-09-19T11:43:12.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.646+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=GGH7YT2BYHR8 type=del size=776289 2024-09-19T11:43:12.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.650+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=6X1E4LSE7W33 type=del 2024-09-19T11:43:12.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.654+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=LVZQ1OMXJWTS type=del size=970382 2024-09-19T11:43:12.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.658+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~ULSVG6K98IP6.0 size=1048576 2024-09-19T11:43:12.664 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.658+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~ULSVG6K98IP6.1 size=585408 2024-09-19T11:43:12.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.666+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=ULSVG6K98IP6 tag=HL36HBPLO4NI type=write size=2682560 2024-09-19T11:43:12.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.666+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=OCQKO6SK0PE0 type=del size=3222481 2024-09-19T11:43:12.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.670+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~Z1I8OORX29DL.0 size=533873 2024-09-19T11:43:12.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.674+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=Z1I8OORX29DL tag=HJ7I8E075WJ3 type=write size=1582449 2024-09-19T11:43:12.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.678+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=ZR4LL0IAECVN type=del size=1603967 2024-09-19T11:43:12.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.682+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=KUGOOT89OB2I type=del 2024-09-19T11:43:12.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.686+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~65Y5YXO0KXG4.0 size=1048576 2024-09-19T11:43:12.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.690+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~65Y5YXO0KXG4.1 size=782227 2024-09-19T11:43:12.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.690+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=65Y5YXO0KXG4 tag=0QFTZG2C4L5B type=write size=2879379 2024-09-19T11:43:12.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.694+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=19DY5I2DHFEO type=del 2024-09-19T11:43:12.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.698+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=RE3GOJOX8FTH type=del size=1245522 2024-09-19T11:43:12.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.702+0000 7f3d831968c0 1 < suggested update operation key=3QWBQYLI0SJR tag=6ECTFN2JDMEN type=write size=475426 2024-09-19T11:43:12.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.706+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=PG9LDWHMI7CB type=write size=725173 2024-09-19T11:43:12.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.710+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~HMH91ICTH5TK.0 size=1048576 2024-09-19T11:43:12.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.714+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~HMH91ICTH5TK.1 size=355328 2024-09-19T11:43:12.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.718+0000 7f3d831968c0 1 < completed multipart upload key=JTPBGWC4T3Y5 upload=HMH91ICTH5TK tag=WK3P7UG100GO type=write size=2452480 2024-09-19T11:43:12.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.722+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=MCN6KPHCT1XZ type=del size=284910 2024-09-19T11:43:12.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.726+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~IFP89J3PMXUH.0 size=1048576 2024-09-19T11:43:12.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.730+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~IFP89J3PMXUH.1 size=1048576 2024-09-19T11:43:12.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.730+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~IFP89J3PMXUH.2 size=908617 2024-09-19T11:43:12.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.738+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=IFP89J3PMXUH tag=63TFRWHMD6RB type=write size=4054345 2024-09-19T11:43:12.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.742+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~2R95JE8AHINH.0 size=1048576 2024-09-19T11:43:12.748 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.746+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~2R95JE8AHINH.1 size=661210 2024-09-19T11:43:12.748 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.746+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=2R95JE8AHINH tag=JAOOTSXM8I10 type=write size=2758362 2024-09-19T11:43:12.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.746+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~IHUN4V0QW61B.0 size=545033 2024-09-19T11:43:12.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.750+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=IHUN4V0QW61B tag=CJ4F72DR21XW type=write size=1593609 2024-09-19T11:43:12.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.754+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=L0P1RNQPS6WE type=del size=2070885 2024-09-19T11:43:12.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.758+0000 7f3d831968c0 1 < canceled operation key=76JFMPOUJZXW tag=VRALUU58OYFK type=del size=3993071 2024-09-19T11:43:12.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.758+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=6MSBF954ZCTB type=del size=448730 2024-09-19T11:43:12.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.762+0000 7f3d831968c0 1 < completed write operation key=2VJRZVU7S8LB tag=7LYUIADH2EJ0 type=write size=478058 2024-09-19T11:43:12.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.766+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=8JV4H2FQ781D type=del size=2454766 2024-09-19T11:43:12.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.770+0000 7f3d831968c0 1 < suggested remove operation key=00DYD22W0ZNB tag=ICZTOI7YL9V0 type=del 2024-09-19T11:43:12.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.774+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=KDR8UTE2HJZ1 type=del size=714592 2024-09-19T11:43:12.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.774+0000 7f3d831968c0 1 < completed write operation key=5RTONAWGYJNE tag=0VWORXV4ZTO6 type=write size=793580 2024-09-19T11:43:12.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.782+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~RAK3KRF78BD3.0 size=1048576 2024-09-19T11:43:12.787 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.782+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~RAK3KRF78BD3.1 size=157468 2024-09-19T11:43:12.787 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.782+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=RAK3KRF78BD3 tag=LYJHIX28RE7D type=write size=2254620 2024-09-19T11:43:12.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.786+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=57PO6HIE3CSD type=del 2024-09-19T11:43:12.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.790+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=JXU5DBQDBZZB type=write size=1029747 2024-09-19T11:43:12.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.794+0000 7f3d831968c0 1 < suggested remove operation key=4V17CRW6EB65 tag=VFHI0UVAZ266 type=del 2024-09-19T11:43:12.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.798+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=AQOSKF7ZUXD2 type=del size=3187149 2024-09-19T11:43:12.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.806+0000 7f3d831968c0 1 < suggested remove operation key=8104Z4OQ7UWQ tag=GGH7YT2BYHR8 type=del 2024-09-19T11:43:12.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.806+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=33T8P9F3WBE9 type=del size=142778 2024-09-19T11:43:12.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.810+0000 7f3d831968c0 1 < canceled operation key=8FGIZJIY58C7 tag=LVZQ1OMXJWTS type=del size=970382 2024-09-19T11:43:12.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.818+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~RWREZ3R4GUDH.0 size=1048576 2024-09-19T11:43:12.824 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.818+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~RWREZ3R4GUDH.1 size=518196 2024-09-19T11:43:12.824 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.818+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=RWREZ3R4GUDH tag=QE9WG7QX7IYR type=write size=2615348 2024-09-19T11:43:12.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.822+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=OCQKO6SK0PE0 type=del 2024-09-19T11:43:12.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.826+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=V3S2VP0ZDR4U type=del size=36430 2024-09-19T11:43:12.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.830+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=ZR4LL0IAECVN type=del 2024-09-19T11:43:12.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.834+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=SSRUW9JUKUFQ type=del size=49645 2024-09-19T11:43:12.840 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.834+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~65Y5YXO0KXG4.0 size=1048576 2024-09-19T11:43:12.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.838+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~65Y5YXO0KXG4.1 size=782227 2024-09-19T11:43:12.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.842+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=65Y5YXO0KXG4 tag=0QFTZG2C4L5B type=write size=2879379 2024-09-19T11:43:12.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.850+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~L20M54CM3U41.0 size=989925 2024-09-19T11:43:12.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.850+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=L20M54CM3U41 tag=AJ9Y8RHRB6GN type=write size=2038501 2024-09-19T11:43:12.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.854+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=RE3GOJOX8FTH type=del 2024-09-19T11:43:12.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.858+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~3K7KIOCN97OU.0 size=1048576 2024-09-19T11:43:12.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.862+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~3K7KIOCN97OU.1 size=183274 2024-09-19T11:43:12.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.862+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=3K7KIOCN97OU tag=32Y9WR1BG2GK type=write size=2280426 2024-09-19T11:43:12.868 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.862+0000 7f3d831968c0 1 < canceled operation key=3K8P37C015G3 tag=PG9LDWHMI7CB type=write size=725173 2024-09-19T11:43:12.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.866+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=KF9DIUX3KRKE type=write size=379600 2024-09-19T11:43:12.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.874+0000 7f3d831968c0 1 < suggested update operation key=3GD7UZCI3WX4 tag=MCN6KPHCT1XZ type=del size=284910 2024-09-19T11:43:12.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.878+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=8IF9ZMOX1GHD type=del size=455388 2024-09-19T11:43:12.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.878+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~2R95JE8AHINH.0 size=1048576 2024-09-19T11:43:12.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.882+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~2R95JE8AHINH.1 size=661210 2024-09-19T11:43:12.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.886+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=2R95JE8AHINH tag=JAOOTSXM8I10 type=write size=2758362 2024-09-19T11:43:12.894 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.890+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=CN9BEQS6CRNM type=del size=182510 2024-09-19T11:43:12.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.894+0000 7f3d831968c0 -1 < failed to complete operation key=3GD7UZCI3WX4 tag=L0P1RNQPS6WE type=del size=2070885: (22) Invalid argument 2024-09-19T11:43:12.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.898+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~OGGHFJI0GA3I.0 size=798210 2024-09-19T11:43:12.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.898+0000 7f3d831968c0 1 > prepared multipart upload key=JTPBGWC4T3Y5 upload=OGGHFJI0GA3I tag=VH9RGV027WQK type=write size=1846786 2024-09-19T11:43:12.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.902+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=6MSBF954ZCTB type=del 2024-09-19T11:43:12.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.906+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=JAJ8ND13YHUI type=del size=3391655 2024-09-19T11:43:12.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.914+0000 7f3d831968c0 1 < suggested update operation key=CULXGFLZ0HI6 tag=8JV4H2FQ781D type=del size=2454766 2024-09-19T11:43:12.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.914+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=2ZJ8QQK223LJ type=write size=69760 2024-09-19T11:43:12.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.918+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=KDR8UTE2HJZ1 type=del 2024-09-19T11:43:12.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.922+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=JHT2REG97A64 type=del size=3782269 2024-09-19T11:43:12.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.926+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~RAK3KRF78BD3.0 size=1048576 2024-09-19T11:43:12.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.926+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~RAK3KRF78BD3.1 size=157468 2024-09-19T11:43:12.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.938+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=RAK3KRF78BD3 tag=LYJHIX28RE7D type=write size=2254620 2024-09-19T11:43:12.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.942+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=JIKQ13XQP8GH type=del size=826768 2024-09-19T11:43:12.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.942+0000 7f3d831968c0 1 < completed write operation key=76JFMPOUJZXW tag=JXU5DBQDBZZB type=write size=1029747 2024-09-19T11:43:12.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.950+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~YSTIID2FKQFE.0 size=1048576 2024-09-19T11:43:12.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.954+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~YSTIID2FKQFE.1 size=205268 2024-09-19T11:43:12.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.954+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=YSTIID2FKQFE tag=XVJ1B4BUF8DQ type=write size=2302420 2024-09-19T11:43:12.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.954+0000 7f3d831968c0 1 < canceled operation key=JTPBGWC4T3Y5 tag=AQOSKF7ZUXD2 type=del size=3187149 2024-09-19T11:43:12.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.958+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=EAAJBI71NTZJ type=del size=2800458 2024-09-19T11:43:12.966 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.962+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=33T8P9F3WBE9 type=del 2024-09-19T11:43:12.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.966+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=4PY2K0B9N9JH type=del size=3629560 2024-09-19T11:43:12.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.966+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~RWREZ3R4GUDH.0 size=1048576 2024-09-19T11:43:12.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.970+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~RWREZ3R4GUDH.1 size=518196 2024-09-19T11:43:12.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.978+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=RWREZ3R4GUDH tag=QE9WG7QX7IYR type=write size=2615348 2024-09-19T11:43:12.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.982+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~YYHKTOJ1JLIE.0 size=1048576 2024-09-19T11:43:12.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.986+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~YYHKTOJ1JLIE.1 size=316046 2024-09-19T11:43:12.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.986+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=YYHKTOJ1JLIE tag=HNOHK8VQZKAY type=write size=2413198 2024-09-19T11:43:12.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.990+0000 7f3d831968c0 1 < canceled operation key=6NLQ0BK8AJUO tag=V3S2VP0ZDR4U type=del size=36430 2024-09-19T11:43:13.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.994+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~BO5PSCJHJCKO.0 size=1048576 2024-09-19T11:43:13.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:12.998+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~BO5PSCJHJCKO.1 size=1048576 2024-09-19T11:43:13.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.002+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~BO5PSCJHJCKO.2 size=50984 2024-09-19T11:43:13.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.002+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=BO5PSCJHJCKO tag=Z5KXB03CMI34 type=write size=3196712 2024-09-19T11:43:13.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.006+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=SSRUW9JUKUFQ type=del 2024-09-19T11:43:13.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.006+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=Q02ZSK5NOQOU type=del size=453740 2024-09-19T11:43:13.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.010+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~L20M54CM3U41.0 size=989925 2024-09-19T11:43:13.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.018+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=L20M54CM3U41 tag=AJ9Y8RHRB6GN type=write size=2038501 2024-09-19T11:43:13.024 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.018+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=1PZKCFNMCTIH type=del size=1629014 2024-09-19T11:43:13.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.022+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~3K7KIOCN97OU.0 size=1048576 2024-09-19T11:43:13.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.026+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~3K7KIOCN97OU.1 size=183274 2024-09-19T11:43:13.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.030+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=3K7KIOCN97OU tag=32Y9WR1BG2GK type=write size=2280426 2024-09-19T11:43:13.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.034+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=VY74PJXWPE9J type=del size=1192874 2024-09-19T11:43:13.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.038+0000 7f3d831968c0 1 < completed write operation key=76JFMPOUJZXW tag=KF9DIUX3KRKE type=write size=379600 2024-09-19T11:43:13.050 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.046+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~W1LAA1CPVF6I.0 size=575150 2024-09-19T11:43:13.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.046+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=W1LAA1CPVF6I tag=52DRD9COFEX0 type=write size=1623726 2024-09-19T11:43:13.054 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.050+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=8IF9ZMOX1GHD type=del 2024-09-19T11:43:13.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.054+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=U1ITVPQK31ZR type=del size=751819 2024-09-19T11:43:13.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.058+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=CN9BEQS6CRNM type=del 2024-09-19T11:43:13.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.062+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=FRN3XS24A3Z1 type=del size=1213923 2024-09-19T11:43:13.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.066+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~OGGHFJI0GA3I.0 size=798210 2024-09-19T11:43:13.075 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.070+0000 7f3d831968c0 1 < completed multipart upload key=JTPBGWC4T3Y5 upload=OGGHFJI0GA3I tag=VH9RGV027WQK type=write size=1846786 2024-09-19T11:43:13.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.074+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=LV6O7H9SRA4H type=del size=3611360 2024-09-19T11:43:13.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.078+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=JAJ8ND13YHUI type=del 2024-09-19T11:43:13.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.082+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=G4U9TMXXYY6K type=del size=3861875 2024-09-19T11:43:13.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.086+0000 7f3d831968c0 1 < completed write operation key=FZGRZ06MOHBI tag=2ZJ8QQK223LJ type=write size=69760 2024-09-19T11:43:13.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.090+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=P6IVXYHO0QDC type=del size=42716 2024-09-19T11:43:13.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.094+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=JHT2REG97A64 type=del 2024-09-19T11:43:13.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.102+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~6X8O8HL4RKYP.0 size=1048576 2024-09-19T11:43:13.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.102+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~6X8O8HL4RKYP.1 size=1048576 2024-09-19T11:43:13.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.106+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~6X8O8HL4RKYP.2 size=850184 2024-09-19T11:43:13.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.106+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=6X8O8HL4RKYP tag=IUU176Q06Z5O type=write size=3995912 2024-09-19T11:43:13.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.110+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=JIKQ13XQP8GH type=del 2024-09-19T11:43:13.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.114+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=G6VQ8OZ4PZXQ type=del size=1479304 2024-09-19T11:43:13.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.118+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~YSTIID2FKQFE.0 size=1048576 2024-09-19T11:43:13.124 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.122+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~YSTIID2FKQFE.1 size=205268 2024-09-19T11:43:13.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.126+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=YSTIID2FKQFE tag=XVJ1B4BUF8DQ type=write size=2302420 2024-09-19T11:43:13.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.130+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=IZ6YFMQRANXJ type=del size=249926 2024-09-19T11:43:13.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.134+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=EAAJBI71NTZJ type=del 2024-09-19T11:43:13.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.138+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=092CNWE466M0 type=write size=796618 2024-09-19T11:43:13.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.142+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=4PY2K0B9N9JH type=del 2024-09-19T11:43:13.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.142+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=BANOJW4IIO3I type=del size=175758 2024-09-19T11:43:13.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.146+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~YYHKTOJ1JLIE.0 size=1048576 2024-09-19T11:43:13.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.150+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~YYHKTOJ1JLIE.1 size=316046 2024-09-19T11:43:13.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.158+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=YYHKTOJ1JLIE tag=HNOHK8VQZKAY type=write size=2413198 2024-09-19T11:43:13.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.162+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~AMF80V1SOYZO.0 size=849855 2024-09-19T11:43:13.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.162+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=AMF80V1SOYZO tag=V548ST1ZU754 type=write size=1898431 2024-09-19T11:43:13.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.166+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~BO5PSCJHJCKO.0 size=1048576 2024-09-19T11:43:13.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.170+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~BO5PSCJHJCKO.1 size=1048576 2024-09-19T11:43:13.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.170+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~BO5PSCJHJCKO.2 size=50984 2024-09-19T11:43:13.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.178+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=BO5PSCJHJCKO tag=Z5KXB03CMI34 type=write size=3196712 2024-09-19T11:43:13.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.178+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=KDFNWDEC3V13 type=del size=864850 2024-09-19T11:43:13.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.182+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=Q02ZSK5NOQOU type=del 2024-09-19T11:43:13.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.186+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=SWL3D890STRH type=del size=1779994 2024-09-19T11:43:13.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.190+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=1PZKCFNMCTIH type=del 2024-09-19T11:43:13.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.194+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=Y4V2GLKGLIQ2 type=del size=153243 2024-09-19T11:43:13.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.198+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=VY74PJXWPE9J type=del 2024-09-19T11:43:13.207 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.202+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~GLM9E94RWF0U.0 size=1048576 2024-09-19T11:43:13.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.206+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~GLM9E94RWF0U.1 size=1048576 2024-09-19T11:43:13.213 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.210+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~GLM9E94RWF0U.2 size=1028100 2024-09-19T11:43:13.213 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.210+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=GLM9E94RWF0U tag=QRGRWRSCQVOC type=write size=4173828 2024-09-19T11:43:13.217 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.214+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~W1LAA1CPVF6I.0 size=575150 2024-09-19T11:43:13.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.218+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=W1LAA1CPVF6I tag=52DRD9COFEX0 type=write size=1623726 2024-09-19T11:43:13.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.222+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=AAX6FAY0X5DN type=del size=3816232 2024-09-19T11:43:13.233 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.230+0000 7f3d831968c0 1 < suggested update operation key=E8OFSMUZHR02 tag=U1ITVPQK31ZR type=del size=751819 2024-09-19T11:43:13.240 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.234+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~E0VEV7UN5OBJ.0 size=1048576 2024-09-19T11:43:13.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.238+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~E0VEV7UN5OBJ.1 size=383536 2024-09-19T11:43:13.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.238+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=E0VEV7UN5OBJ tag=EGIP8BXCC95M type=write size=2480688 2024-09-19T11:43:13.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.242+0000 7f3d831968c0 -1 < failed to complete operation key=E8OFSMUZHR02 tag=FRN3XS24A3Z1 type=del size=1213923: (22) Invalid argument 2024-09-19T11:43:13.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.246+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~7ND1F4A3CFFP.0 size=553376 2024-09-19T11:43:13.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.246+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=7ND1F4A3CFFP tag=AVICDZ9RJPKE type=write size=1601952 2024-09-19T11:43:13.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.250+0000 7f3d831968c0 1 < completed delete operation key=3QWBQYLI0SJR tag=LV6O7H9SRA4H type=del 2024-09-19T11:43:13.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.254+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~Q5HG06I2PLGY.0 size=996025 2024-09-19T11:43:13.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.254+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=Q5HG06I2PLGY tag=MV2M9B5GYGR3 type=write size=2044601 2024-09-19T11:43:13.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.262+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=G4U9TMXXYY6K type=del 2024-09-19T11:43:13.272 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.266+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~TIHC2KTR3HHL.0 size=235831 2024-09-19T11:43:13.272 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.266+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=TIHC2KTR3HHL tag=SGF32T8KVM0Y type=write size=1284407 2024-09-19T11:43:13.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.270+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=P6IVXYHO0QDC type=del 2024-09-19T11:43:13.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.274+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~C623WLUTPSTT.0 size=1048576 2024-09-19T11:43:13.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.278+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~C623WLUTPSTT.1 size=751718 2024-09-19T11:43:13.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.278+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=C623WLUTPSTT tag=TUD0634P1O2U type=write size=2848870 2024-09-19T11:43:13.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.282+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~6X8O8HL4RKYP.0 size=1048576 2024-09-19T11:43:13.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.282+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~6X8O8HL4RKYP.1 size=1048576 2024-09-19T11:43:13.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.286+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~6X8O8HL4RKYP.2 size=850184 2024-09-19T11:43:13.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.290+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=6X8O8HL4RKYP tag=IUU176Q06Z5O type=write size=3995912 2024-09-19T11:43:13.299 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.294+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~ZS43BCN1BM7I.0 size=1048576 2024-09-19T11:43:13.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.298+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~ZS43BCN1BM7I.1 size=1048576 2024-09-19T11:43:13.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.298+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~ZS43BCN1BM7I.2 size=316258 2024-09-19T11:43:13.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.298+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=ZS43BCN1BM7I tag=W14U9IMGNO0Y type=write size=3461986 2024-09-19T11:43:13.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.302+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=G6VQ8OZ4PZXQ type=del 2024-09-19T11:43:13.309 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.306+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=0SV66JMHMH6C type=del size=1779298 2024-09-19T11:43:13.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.310+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=IZ6YFMQRANXJ type=del 2024-09-19T11:43:13.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.314+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~XJDF5O9FDSHH.0 size=1048576 2024-09-19T11:43:13.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.318+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~XJDF5O9FDSHH.1 size=1048576 2024-09-19T11:43:13.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.318+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~XJDF5O9FDSHH.2 size=817696 2024-09-19T11:43:13.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.318+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=XJDF5O9FDSHH tag=CFJ30TS4PW6S type=write size=3963424 2024-09-19T11:43:13.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.322+0000 7f3d831968c0 1 < completed write operation key=76JFMPOUJZXW tag=092CNWE466M0 type=write size=796618 2024-09-19T11:43:13.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.326+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=3MTNUYDGO3XN type=del size=2527018 2024-09-19T11:43:13.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.330+0000 7f3d831968c0 1 < suggested remove operation key=UI7EVZ1SGD8R tag=BANOJW4IIO3I type=del 2024-09-19T11:43:13.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.334+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=JE4GXSNR5MWT type=del size=3875873 2024-09-19T11:43:13.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.338+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~AMF80V1SOYZO.0 size=849855 2024-09-19T11:43:13.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.342+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=AMF80V1SOYZO tag=V548ST1ZU754 type=write size=1898431 2024-09-19T11:43:13.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.346+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=OALB5K0V6156 type=write size=934101 2024-09-19T11:43:13.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.350+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=KDFNWDEC3V13 type=del 2024-09-19T11:43:13.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.354+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=4N8TAPLUKJIF type=del size=3456716 2024-09-19T11:43:13.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.358+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=SWL3D890STRH type=del 2024-09-19T11:43:13.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.362+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~K238KIMU6PU5.0 size=1048576 2024-09-19T11:43:13.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.366+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~K238KIMU6PU5.1 size=602253 2024-09-19T11:43:13.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.366+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=K238KIMU6PU5 tag=F9SKIH10LO7C type=write size=2699405 2024-09-19T11:43:13.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.370+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=Y4V2GLKGLIQ2 type=del 2024-09-19T11:43:13.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.370+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=OREBTWOCYPV2 type=write size=24642 2024-09-19T11:43:13.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.374+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~GLM9E94RWF0U.0 size=1048576 2024-09-19T11:43:13.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.378+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~GLM9E94RWF0U.1 size=1048576 2024-09-19T11:43:13.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.382+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~GLM9E94RWF0U.2 size=1028100 2024-09-19T11:43:13.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.386+0000 7f3d831968c0 1 < completed multipart upload key=EVFF0F0760OS upload=GLM9E94RWF0U tag=QRGRWRSCQVOC type=write size=4173828 2024-09-19T11:43:13.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.390+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=YNJFW8IUQ1M3 type=del size=855588 2024-09-19T11:43:13.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.394+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=AAX6FAY0X5DN type=del 2024-09-19T11:43:13.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.398+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=IPC8JDP1DBSD type=write size=424714 2024-09-19T11:43:13.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.402+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~E0VEV7UN5OBJ.0 size=1048576 2024-09-19T11:43:13.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.402+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~E0VEV7UN5OBJ.1 size=383536 2024-09-19T11:43:13.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.410+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=E0VEV7UN5OBJ tag=EGIP8BXCC95M type=write size=2480688 2024-09-19T11:43:13.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.414+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=Z7R0XA7T812T type=write size=193930 2024-09-19T11:43:13.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.418+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~7ND1F4A3CFFP.0 size=553376 2024-09-19T11:43:13.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.422+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=7ND1F4A3CFFP tag=AVICDZ9RJPKE type=write size=1601952 2024-09-19T11:43:13.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.430+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~P7WEKTKGQ3DR.0 size=148110 2024-09-19T11:43:13.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.430+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=P7WEKTKGQ3DR tag=VS8MKVSNEXI4 type=write size=1196686 2024-09-19T11:43:13.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.434+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~Q5HG06I2PLGY.0 size=996025 2024-09-19T11:43:13.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.438+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=Q5HG06I2PLGY tag=MV2M9B5GYGR3 type=write size=2044601 2024-09-19T11:43:13.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.442+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=CVBLKRTTC186 type=write size=636036 2024-09-19T11:43:13.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.446+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~TIHC2KTR3HHL.0 size=235831 2024-09-19T11:43:13.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.454+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=TIHC2KTR3HHL tag=SGF32T8KVM0Y type=write size=1284407 2024-09-19T11:43:13.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.454+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=1GIFPU1280W9 type=del size=1421204 2024-09-19T11:43:13.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.458+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~C623WLUTPSTT.0 size=1048576 2024-09-19T11:43:13.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.462+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~C623WLUTPSTT.1 size=751718 2024-09-19T11:43:13.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.470+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=C623WLUTPSTT tag=TUD0634P1O2U type=write size=2848870 2024-09-19T11:43:13.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.470+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=A033RVMUUJ1T type=del size=3465662 2024-09-19T11:43:13.479 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.474+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~ZS43BCN1BM7I.0 size=1048576 2024-09-19T11:43:13.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.478+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~ZS43BCN1BM7I.1 size=1048576 2024-09-19T11:43:13.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.482+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~ZS43BCN1BM7I.2 size=316258 2024-09-19T11:43:13.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.486+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=ZS43BCN1BM7I tag=W14U9IMGNO0Y type=write size=3461986 2024-09-19T11:43:13.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.490+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=RIK5UNK31LOR type=del size=2340738 2024-09-19T11:43:13.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.494+0000 7f3d831968c0 1 < suggested remove operation key=3GD7UZCI3WX4 tag=0SV66JMHMH6C type=del 2024-09-19T11:43:13.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.498+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=EQIIZ6VUCX55 type=del size=231259 2024-09-19T11:43:13.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.502+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~XJDF5O9FDSHH.0 size=1048576 2024-09-19T11:43:13.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.506+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~XJDF5O9FDSHH.1 size=1048576 2024-09-19T11:43:13.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.506+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~XJDF5O9FDSHH.2 size=817696 2024-09-19T11:43:13.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.514+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=XJDF5O9FDSHH tag=CFJ30TS4PW6S type=write size=3963424 2024-09-19T11:43:13.521 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.518+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=AKB66JFRSGPC type=del size=901186 2024-09-19T11:43:13.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.522+0000 7f3d831968c0 1 < canceled operation key=8104Z4OQ7UWQ tag=3MTNUYDGO3XN type=del size=2527018 2024-09-19T11:43:13.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.526+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~AO394CFLVV0I.0 size=1048576 2024-09-19T11:43:13.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.530+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~AO394CFLVV0I.1 size=321429 2024-09-19T11:43:13.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.530+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=AO394CFLVV0I tag=7Q0RW3JC1550 type=write size=2418581 2024-09-19T11:43:13.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.534+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=JE4GXSNR5MWT type=del 2024-09-19T11:43:13.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.538+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=VO61ZC1P4CEY type=del size=1591198 2024-09-19T11:43:13.545 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.542+0000 7f3d831968c0 1 < completed write operation key=LINLTWYV88VU tag=OALB5K0V6156 type=write size=934101 2024-09-19T11:43:13.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.546+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=PQ0JPAS3SFMO type=del size=737946 2024-09-19T11:43:13.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.554+0000 7f3d831968c0 1 < suggested remove operation key=76JFMPOUJZXW tag=4N8TAPLUKJIF type=del 2024-09-19T11:43:13.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.554+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=360EC0D7RHFB type=del size=436877 2024-09-19T11:43:13.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.558+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~K238KIMU6PU5.0 size=1048576 2024-09-19T11:43:13.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.558+0000 7f3d831968c0 1 < canceled part key=_multipart_3QWBQYLI0SJR.2~K238KIMU6PU5.1 size=602253 2024-09-19T11:43:13.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.566+0000 7f3d831968c0 1 < canceled multipart upload key=3QWBQYLI0SJR upload=K238KIMU6PU5 tag=F9SKIH10LO7C type=write size=2699405 2024-09-19T11:43:13.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.574+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~MVCZSCSQ0D3J.0 size=1048576 2024-09-19T11:43:13.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.578+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~MVCZSCSQ0D3J.1 size=1048576 2024-09-19T11:43:13.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.582+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~MVCZSCSQ0D3J.2 size=876215 2024-09-19T11:43:13.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.582+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=MVCZSCSQ0D3J tag=L0D6RU64CK5S type=write size=4021943 2024-09-19T11:43:13.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.582+0000 7f3d831968c0 1 < completed write operation key=66N4QS1R70Z7 tag=OREBTWOCYPV2 type=write size=24642 2024-09-19T11:43:13.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.586+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=ZVNKTZ9QGRL1 type=write size=2048 2024-09-19T11:43:13.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.594+0000 7f3d831968c0 1 < suggested update operation key=5RTONAWGYJNE tag=YNJFW8IUQ1M3 type=del size=855588 2024-09-19T11:43:13.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.598+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=3DM79UD9G8LW type=del size=4144402 2024-09-19T11:43:13.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.602+0000 7f3d831968c0 1 < completed write operation key=8FGIZJIY58C7 tag=IPC8JDP1DBSD type=write size=424714 2024-09-19T11:43:13.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.606+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=CRYOZW0LEPS9 type=del size=1309477 2024-09-19T11:43:13.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.610+0000 7f3d831968c0 1 < completed write operation key=PB62JE7I55GG tag=Z7R0XA7T812T type=write size=193930 2024-09-19T11:43:13.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.610+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=4BN0E5X3NZL2 type=del size=2144816 2024-09-19T11:43:13.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.614+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~P7WEKTKGQ3DR.0 size=148110 2024-09-19T11:43:13.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.622+0000 7f3d831968c0 1 < completed multipart upload key=EVFF0F0760OS upload=P7WEKTKGQ3DR tag=VS8MKVSNEXI4 type=write size=1196686 2024-09-19T11:43:13.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.630+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~94C04BVP93OW.0 size=1048576 2024-09-19T11:43:13.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.630+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~94C04BVP93OW.1 size=1048576 2024-09-19T11:43:13.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.634+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~94C04BVP93OW.2 size=60677 2024-09-19T11:43:13.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.634+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=94C04BVP93OW tag=ACRCELI8GD2C type=write size=3206405 2024-09-19T11:43:13.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.642+0000 7f3d831968c0 1 < suggested remove operation key=3K8P37C015G3 tag=CVBLKRTTC186 type=write 2024-09-19T11:43:13.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.646+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~07F2H94I284E.0 size=720687 2024-09-19T11:43:13.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.646+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=07F2H94I284E tag=3NPB4ZJ37YRG type=write size=1769263 2024-09-19T11:43:13.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.650+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=1GIFPU1280W9 type=del 2024-09-19T11:43:13.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.654+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=Y82BE76GDEN7 type=del size=2119393 2024-09-19T11:43:13.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.658+0000 7f3d831968c0 1 < canceled operation key=G4P6HIOM1G2E tag=A033RVMUUJ1T type=del size=3465662 2024-09-19T11:43:13.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.658+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=O3L42JLM15HZ type=del size=1218077 2024-09-19T11:43:13.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.662+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=RIK5UNK31LOR type=del 2024-09-19T11:43:13.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.666+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=K3QDE2C3XIU8 type=del size=913031 2024-09-19T11:43:13.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.666+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=EQIIZ6VUCX55 type=del 2024-09-19T11:43:13.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.670+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=G95OB5H6FCQS type=del size=3457148 2024-09-19T11:43:13.678 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.674+0000 7f3d831968c0 1 < canceled operation key=3QWBQYLI0SJR tag=AKB66JFRSGPC type=del size=901186 2024-09-19T11:43:13.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.678+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~2JMEO033DN5C.0 size=1048576 2024-09-19T11:43:13.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.682+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~2JMEO033DN5C.1 size=604273 2024-09-19T11:43:13.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.682+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=2JMEO033DN5C tag=OLOYFGASD0JZ type=write size=2701425 2024-09-19T11:43:13.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.682+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~AO394CFLVV0I.0 size=1048576 2024-09-19T11:43:13.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.686+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~AO394CFLVV0I.1 size=321429 2024-09-19T11:43:13.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.690+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=AO394CFLVV0I tag=7Q0RW3JC1550 type=write size=2418581 2024-09-19T11:43:13.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.698+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~0J9RAC3D6U4B.0 size=1048576 2024-09-19T11:43:13.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.698+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~0J9RAC3D6U4B.1 size=1048576 2024-09-19T11:43:13.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.702+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~0J9RAC3D6U4B.2 size=762537 2024-09-19T11:43:13.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.702+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=0J9RAC3D6U4B tag=73SM6D0OAG4W type=write size=3908265 2024-09-19T11:43:13.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.706+0000 7f3d831968c0 1 < suggested remove operation key=6NLQ0BK8AJUO tag=VO61ZC1P4CEY type=del 2024-09-19T11:43:13.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.710+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~BJCLKZ1Y1WGJ.0 size=1048576 2024-09-19T11:43:13.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.714+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~BJCLKZ1Y1WGJ.1 size=513607 2024-09-19T11:43:13.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.714+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=BJCLKZ1Y1WGJ tag=QZ2YUZ6SXMKG type=write size=2610759 2024-09-19T11:43:13.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.718+0000 7f3d831968c0 1 < suggested update operation key=3QWBQYLI0SJR tag=PQ0JPAS3SFMO type=del size=737946 2024-09-19T11:43:13.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.722+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=KH03G05GKXBE type=del size=4133265 2024-09-19T11:43:13.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.722+0000 7f3d831968c0 1 < canceled operation key=G4P6HIOM1G2E tag=360EC0D7RHFB type=del size=436877 2024-09-19T11:43:13.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.726+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=HGHSV5N17O9I type=del size=2387642 2024-09-19T11:43:13.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.730+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~MVCZSCSQ0D3J.0 size=1048576 2024-09-19T11:43:13.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.730+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~MVCZSCSQ0D3J.1 size=1048576 2024-09-19T11:43:13.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.734+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~MVCZSCSQ0D3J.2 size=876215 2024-09-19T11:43:13.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.738+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=MVCZSCSQ0D3J tag=L0D6RU64CK5S type=write size=4021943 2024-09-19T11:43:13.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.742+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~5BON2PHMFUDH.0 size=1048576 2024-09-19T11:43:13.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.746+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~5BON2PHMFUDH.1 size=665638 2024-09-19T11:43:13.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.746+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=5BON2PHMFUDH tag=ADD0VT3XCAJ4 type=write size=2762790 2024-09-19T11:43:13.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.750+0000 7f3d831968c0 1 < suggested update operation key=FZGRZ06MOHBI tag=ZVNKTZ9QGRL1 type=write size=2048 2024-09-19T11:43:13.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.754+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=X9GGLFO40ZLN type=del size=2664125 2024-09-19T11:43:13.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.758+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=3DM79UD9G8LW type=del 2024-09-19T11:43:13.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.762+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=OEMHR74NYO0Y type=del size=1195573 2024-09-19T11:43:13.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.762+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=CRYOZW0LEPS9 type=del 2024-09-19T11:43:13.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.766+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=8JLSI3VS0H38 type=write size=611266 2024-09-19T11:43:13.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.770+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=4BN0E5X3NZL2 type=del 2024-09-19T11:43:13.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.774+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~J3Y5I61EL0PQ.0 size=1048576 2024-09-19T11:43:13.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.778+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~J3Y5I61EL0PQ.1 size=1048576 2024-09-19T11:43:13.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.782+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~J3Y5I61EL0PQ.2 size=334122 2024-09-19T11:43:13.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.782+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=J3Y5I61EL0PQ tag=Q7G8BKKO1FKN type=write size=3479850 2024-09-19T11:43:13.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.782+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~94C04BVP93OW.0 size=1048576 2024-09-19T11:43:13.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.786+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~94C04BVP93OW.1 size=1048576 2024-09-19T11:43:13.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.790+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~94C04BVP93OW.2 size=60677 2024-09-19T11:43:13.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.794+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=94C04BVP93OW tag=ACRCELI8GD2C type=write size=3206405 2024-09-19T11:43:13.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.798+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=EWKVAETH04AL type=write size=272760 2024-09-19T11:43:13.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.802+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~07F2H94I284E.0 size=720687 2024-09-19T11:43:13.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.806+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=07F2H94I284E tag=3NPB4ZJ37YRG type=write size=1769263 2024-09-19T11:43:13.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.810+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=BRNK83EA76RG type=del size=3430071 2024-09-19T11:43:13.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.814+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=Y82BE76GDEN7 type=del 2024-09-19T11:43:13.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.818+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=ONNBLFFIA242 type=write size=142741 2024-09-19T11:43:13.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.822+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=O3L42JLM15HZ type=del 2024-09-19T11:43:13.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.826+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~J2CFDQNVY7SJ.0 size=1048576 2024-09-19T11:43:13.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.830+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~J2CFDQNVY7SJ.1 size=746494 2024-09-19T11:43:13.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.830+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=J2CFDQNVY7SJ tag=VLYWKTNZ4PLE type=write size=2843646 2024-09-19T11:43:13.836 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.834+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=K3QDE2C3XIU8 type=del 2024-09-19T11:43:13.839 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.834+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=UF8WVVFVYZLW type=del size=317972 2024-09-19T11:43:13.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.838+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=G95OB5H6FCQS type=del 2024-09-19T11:43:13.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.842+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=LYXGJ77G76BC type=del size=2543958 2024-09-19T11:43:13.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.846+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~2JMEO033DN5C.0 size=1048576 2024-09-19T11:43:13.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.846+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~2JMEO033DN5C.1 size=604273 2024-09-19T11:43:13.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.854+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=2JMEO033DN5C tag=OLOYFGASD0JZ type=write size=2701425 2024-09-19T11:43:13.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.854+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=7BPC1W5QQZ07 type=del size=1485281 2024-09-19T11:43:13.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.854+0000 7f3d831968c0 1 < canceled part key=_multipart_LINLTWYV88VU.2~0J9RAC3D6U4B.0 size=1048576 2024-09-19T11:43:13.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.858+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~0J9RAC3D6U4B.1 size=1048576 2024-09-19T11:43:13.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.866+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~0J9RAC3D6U4B.2 size=762537 2024-09-19T11:43:13.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.870+0000 7f3d831968c0 1 < canceled multipart upload key=LINLTWYV88VU upload=0J9RAC3D6U4B tag=73SM6D0OAG4W type=write size=3908265 2024-09-19T11:43:13.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.874+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=O0J8T47D6BQQ type=del size=3974905 2024-09-19T11:43:13.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.878+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~BJCLKZ1Y1WGJ.0 size=1048576 2024-09-19T11:43:13.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.878+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~BJCLKZ1Y1WGJ.1 size=513607 2024-09-19T11:43:13.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.886+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=BJCLKZ1Y1WGJ tag=QZ2YUZ6SXMKG type=write size=2610759 2024-09-19T11:43:13.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.890+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~0AXUPLGXQ9OE.0 size=1048576 2024-09-19T11:43:13.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.894+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~0AXUPLGXQ9OE.1 size=1048576 2024-09-19T11:43:13.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.898+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~0AXUPLGXQ9OE.2 size=682375 2024-09-19T11:43:13.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.898+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=0AXUPLGXQ9OE tag=8W9IH2I4K3WQ type=write size=3828103 2024-09-19T11:43:13.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.902+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=KH03G05GKXBE type=del 2024-09-19T11:43:13.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.906+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~5JG23CMXX4Q6.0 size=1048576 2024-09-19T11:43:13.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.910+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~5JG23CMXX4Q6.1 size=1048576 2024-09-19T11:43:13.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.910+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~5JG23CMXX4Q6.2 size=252454 2024-09-19T11:43:13.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.910+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=5JG23CMXX4Q6 tag=IYT236TNE4SQ type=write size=3398182 2024-09-19T11:43:13.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.918+0000 7f3d831968c0 1 < suggested remove operation key=0OOB2SNLVK8E tag=HGHSV5N17O9I type=del 2024-09-19T11:43:13.927 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.922+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~QLFWVG9L86WK.0 size=1048576 2024-09-19T11:43:13.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.926+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~QLFWVG9L86WK.1 size=1048576 2024-09-19T11:43:13.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.930+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~QLFWVG9L86WK.2 size=668391 2024-09-19T11:43:13.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.930+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=QLFWVG9L86WK tag=7F95DCXDJYQK type=write size=3814119 2024-09-19T11:43:13.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.930+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~5BON2PHMFUDH.0 size=1048576 2024-09-19T11:43:13.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.934+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~5BON2PHMFUDH.1 size=665638 2024-09-19T11:43:13.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.942+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=5BON2PHMFUDH tag=ADD0VT3XCAJ4 type=write size=2762790 2024-09-19T11:43:13.950 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.946+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~TOE9BGZSWPY1.0 size=1048576 2024-09-19T11:43:13.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.950+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~TOE9BGZSWPY1.1 size=132579 2024-09-19T11:43:13.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.950+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=TOE9BGZSWPY1 tag=GXGTLU2UWB8F type=write size=2229731 2024-09-19T11:43:13.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.950+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=X9GGLFO40ZLN type=del 2024-09-19T11:43:13.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.954+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=8OEV4B0SY87K type=del size=2528171 2024-09-19T11:43:13.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.958+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=OEMHR74NYO0Y type=del 2024-09-19T11:43:13.966 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.962+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=MQ8JOB2YQNPX type=del size=1394836 2024-09-19T11:43:13.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.966+0000 7f3d831968c0 1 < completed write operation key=4I8BY4YYTRT0 tag=8JLSI3VS0H38 type=write size=611266 2024-09-19T11:43:13.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.970+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~0WEY998DH9WF.0 size=576279 2024-09-19T11:43:13.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.970+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=0WEY998DH9WF tag=9FN1RF79W4LI type=write size=1624855 2024-09-19T11:43:13.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.974+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~J3Y5I61EL0PQ.0 size=1048576 2024-09-19T11:43:13.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.978+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~J3Y5I61EL0PQ.1 size=1048576 2024-09-19T11:43:13.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.978+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~J3Y5I61EL0PQ.2 size=334122 2024-09-19T11:43:13.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.986+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=J3Y5I61EL0PQ tag=Q7G8BKKO1FKN type=write size=3479850 2024-09-19T11:43:13.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.990+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~1L3TAPE1QXMU.0 size=1048576 2024-09-19T11:43:13.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.994+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~1L3TAPE1QXMU.1 size=131087 2024-09-19T11:43:13.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.994+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=1L3TAPE1QXMU tag=0791C9I386U6 type=write size=2228239 2024-09-19T11:43:14.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.998+0000 7f3d831968c0 1 < completed write operation key=E8OFSMUZHR02 tag=EWKVAETH04AL type=write size=272760 2024-09-19T11:43:14.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:13.998+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=W7UBLTMG3TUA type=del size=3777233 2024-09-19T11:43:14.010 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.006+0000 7f3d831968c0 1 < suggested update operation key=FKLL38ZNCJ21 tag=BRNK83EA76RG type=del size=3430071 2024-09-19T11:43:14.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.010+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=4ZRFA686ZCHC type=del size=3629091 2024-09-19T11:43:14.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.014+0000 7f3d831968c0 1 < completed write operation key=LINLTWYV88VU tag=ONNBLFFIA242 type=write size=142741 2024-09-19T11:43:14.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.018+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=HI3MHD04S14F type=del size=3365859 2024-09-19T11:43:14.024 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.022+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~J2CFDQNVY7SJ.0 size=1048576 2024-09-19T11:43:14.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.022+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~J2CFDQNVY7SJ.1 size=746494 2024-09-19T11:43:14.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.030+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=J2CFDQNVY7SJ tag=VLYWKTNZ4PLE type=write size=2843646 2024-09-19T11:43:14.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.030+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=22RVTS0D0528 type=del size=174086 2024-09-19T11:43:14.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.038+0000 7f3d831968c0 1 < suggested remove operation key=66N4QS1R70Z7 tag=UF8WVVFVYZLW type=del 2024-09-19T11:43:14.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.042+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=AWKNQ7P7FQUC type=del size=3820232 2024-09-19T11:43:14.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.050+0000 7f3d831968c0 1 < suggested update operation key=QPG75T46BH38 tag=LYXGJ77G76BC type=del size=2543958 2024-09-19T11:43:14.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.054+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~I92KR253GH8E.0 size=878426 2024-09-19T11:43:14.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.054+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=I92KR253GH8E tag=JD3ZMVGB01A0 type=write size=1927002 2024-09-19T11:43:14.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.058+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=7BPC1W5QQZ07 type=del 2024-09-19T11:43:14.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.062+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=MVOUQA3RJTXN type=del size=4183374 2024-09-19T11:43:14.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.066+0000 7f3d831968c0 -1 < failed to complete operation key=0OOB2SNLVK8E tag=O0J8T47D6BQQ type=del size=3974905: (22) Invalid argument 2024-09-19T11:43:14.071 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.066+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=VIB41RR0POMZ type=del size=1277115 2024-09-19T11:43:14.075 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.070+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~0AXUPLGXQ9OE.0 size=1048576 2024-09-19T11:43:14.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.074+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~0AXUPLGXQ9OE.1 size=1048576 2024-09-19T11:43:14.080 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.078+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~0AXUPLGXQ9OE.2 size=682375 2024-09-19T11:43:14.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.082+0000 7f3d831968c0 1 < completed multipart upload key=3GD7UZCI3WX4 upload=0AXUPLGXQ9OE tag=8W9IH2I4K3WQ type=write size=3828103 2024-09-19T11:43:14.092 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.086+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~3UM2M1NNJF9R.0 size=32551 2024-09-19T11:43:14.092 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.086+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=3UM2M1NNJF9R tag=0AL9OUINCTP2 type=write size=1081127 2024-09-19T11:43:14.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.090+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~5JG23CMXX4Q6.0 size=1048576 2024-09-19T11:43:14.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.094+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~5JG23CMXX4Q6.1 size=1048576 2024-09-19T11:43:14.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.098+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~5JG23CMXX4Q6.2 size=252454 2024-09-19T11:43:14.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.102+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=5JG23CMXX4Q6 tag=IYT236TNE4SQ type=write size=3398182 2024-09-19T11:43:14.110 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.106+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=F3TRQU58H8L3 type=write size=500052 2024-09-19T11:43:14.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.110+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~QLFWVG9L86WK.0 size=1048576 2024-09-19T11:43:14.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.110+0000 7f3d831968c0 1 < canceled part key=_multipart_CULXGFLZ0HI6.2~QLFWVG9L86WK.1 size=1048576 2024-09-19T11:43:14.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.114+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~QLFWVG9L86WK.2 size=668391 2024-09-19T11:43:14.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.118+0000 7f3d831968c0 1 < canceled multipart upload key=CULXGFLZ0HI6 upload=QLFWVG9L86WK tag=7F95DCXDJYQK type=write size=3814119 2024-09-19T11:43:14.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.122+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=PTYG02TSSL5L type=write size=938785 2024-09-19T11:43:14.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.126+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~TOE9BGZSWPY1.0 size=1048576 2024-09-19T11:43:14.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.130+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~TOE9BGZSWPY1.1 size=132579 2024-09-19T11:43:14.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.134+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=TOE9BGZSWPY1 tag=GXGTLU2UWB8F type=write size=2229731 2024-09-19T11:43:14.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.142+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~7FEAPOAHG8JB.0 size=1032497 2024-09-19T11:43:14.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.142+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=7FEAPOAHG8JB tag=FQYSO3H722V8 type=write size=2081073 2024-09-19T11:43:14.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.146+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=8OEV4B0SY87K type=del 2024-09-19T11:43:14.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.150+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=FBK13IBB67HC type=del size=961196 2024-09-19T11:43:14.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.154+0000 7f3d831968c0 1 < canceled operation key=EVFF0F0760OS tag=MQ8JOB2YQNPX type=del size=1394836 2024-09-19T11:43:14.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.154+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=5VCKVEF35PGW type=del size=821757 2024-09-19T11:43:14.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.158+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~0WEY998DH9WF.0 size=576279 2024-09-19T11:43:14.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.166+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=0WEY998DH9WF tag=9FN1RF79W4LI type=write size=1624855 2024-09-19T11:43:14.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.170+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=N0K82UUL7VX9 type=write size=272105 2024-09-19T11:43:14.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.178+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~1L3TAPE1QXMU.0 size=1048576 2024-09-19T11:43:14.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.178+0000 7f3d831968c0 1 < canceled part key=_multipart_66N4QS1R70Z7.2~1L3TAPE1QXMU.1 size=131087 2024-09-19T11:43:14.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.182+0000 7f3d831968c0 1 < canceled multipart upload key=66N4QS1R70Z7 upload=1L3TAPE1QXMU tag=0791C9I386U6 type=write size=2228239 2024-09-19T11:43:14.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.186+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=QIZG1VJT6OHY type=del size=2302791 2024-09-19T11:43:14.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.190+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=W7UBLTMG3TUA type=del 2024-09-19T11:43:14.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.194+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=1NNF45E7SGIX type=del size=1523726 2024-09-19T11:43:14.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.198+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=4ZRFA686ZCHC type=del 2024-09-19T11:43:14.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.206+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~N66MNEOCI09U.0 size=1048576 2024-09-19T11:43:14.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.206+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~N66MNEOCI09U.1 size=345072 2024-09-19T11:43:14.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.206+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=N66MNEOCI09U tag=KR3X81WJ69E3 type=write size=2442224 2024-09-19T11:43:14.218 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.214+0000 7f3d831968c0 1 < suggested update operation key=3GD7UZCI3WX4 tag=HI3MHD04S14F type=del size=3365859 2024-09-19T11:43:14.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.218+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=XHWEUYYMF8MM type=del size=1013568 2024-09-19T11:43:14.225 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.222+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=22RVTS0D0528 type=del 2024-09-19T11:43:14.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.226+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=2IQJ0L0YP1B9 type=del size=3932592 2024-09-19T11:43:14.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.226+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=AWKNQ7P7FQUC type=del 2024-09-19T11:43:14.238 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.234+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~LVW6EQMZWUPK.0 size=1048576 2024-09-19T11:43:14.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.238+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~LVW6EQMZWUPK.1 size=771291 2024-09-19T11:43:14.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.238+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=LVW6EQMZWUPK tag=RVR62IFA300O type=write size=2868443 2024-09-19T11:43:14.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.242+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~I92KR253GH8E.0 size=878426 2024-09-19T11:43:14.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.246+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=I92KR253GH8E tag=JD3ZMVGB01A0 type=write size=1927002 2024-09-19T11:43:14.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.250+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=TVJVT9S30TD2 type=del size=1567500 2024-09-19T11:43:14.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.250+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=MVOUQA3RJTXN type=del 2024-09-19T11:43:14.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.254+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=B2VY26L5WIEA type=del size=3585504 2024-09-19T11:43:14.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.258+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=VIB41RR0POMZ type=del 2024-09-19T11:43:14.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.262+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=1BR54DHPB4B9 type=del size=2618737 2024-09-19T11:43:14.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.262+0000 7f3d831968c0 1 < canceled part key=_multipart_224HPC2Y95N6.2~3UM2M1NNJF9R.0 size=32551 2024-09-19T11:43:14.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.266+0000 7f3d831968c0 1 < canceled multipart upload key=224HPC2Y95N6 upload=3UM2M1NNJF9R tag=0AL9OUINCTP2 type=write size=1081127 2024-09-19T11:43:14.276 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.270+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~AQKVSDSW480G.0 size=1048576 2024-09-19T11:43:14.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.274+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~AQKVSDSW480G.1 size=927384 2024-09-19T11:43:14.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.274+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=AQKVSDSW480G tag=DC1F7AVHVENQ type=write size=3024536 2024-09-19T11:43:14.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.278+0000 7f3d831968c0 1 < completed write operation key=FKLL38ZNCJ21 tag=F3TRQU58H8L3 type=write size=500052 2024-09-19T11:43:14.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.282+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~QGYDAEQWLYT6.0 size=1048576 2024-09-19T11:43:14.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.286+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~QGYDAEQWLYT6.1 size=263920 2024-09-19T11:43:14.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.286+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=QGYDAEQWLYT6 tag=65TEJ6SO0P7B type=write size=2361072 2024-09-19T11:43:14.292 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.290+0000 7f3d831968c0 1 < completed write operation key=JTPBGWC4T3Y5 tag=PTYG02TSSL5L type=write size=938785 2024-09-19T11:43:14.298 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.294+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~H3AM0HD874IA.0 size=292899 2024-09-19T11:43:14.298 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.294+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=H3AM0HD874IA tag=ARJCP9A4VZBJ type=write size=1341475 2024-09-19T11:43:14.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.298+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~7FEAPOAHG8JB.0 size=1032497 2024-09-19T11:43:14.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.302+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=7FEAPOAHG8JB tag=FQYSO3H722V8 type=write size=2081073 2024-09-19T11:43:14.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.306+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~VV1F5LD405CT.0 size=1048576 2024-09-19T11:43:14.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.310+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~VV1F5LD405CT.1 size=1048576 2024-09-19T11:43:14.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.310+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~VV1F5LD405CT.2 size=665166 2024-09-19T11:43:14.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.310+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=VV1F5LD405CT tag=XKIOE66VZ5E3 type=write size=3810894 2024-09-19T11:43:14.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.314+0000 7f3d831968c0 1 < completed delete operation key=3QWBQYLI0SJR tag=FBK13IBB67HC type=del 2024-09-19T11:43:14.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.318+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=C7XV4F0DY2WB type=write size=443350 2024-09-19T11:43:14.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.322+0000 7f3d831968c0 1 < canceled operation key=PB62JE7I55GG tag=5VCKVEF35PGW type=del size=821757 2024-09-19T11:43:14.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.326+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~B2XQ0LNJIUPO.0 size=1048576 2024-09-19T11:43:14.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.330+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~B2XQ0LNJIUPO.1 size=1048576 2024-09-19T11:43:14.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.330+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~B2XQ0LNJIUPO.2 size=145216 2024-09-19T11:43:14.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.330+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=B2XQ0LNJIUPO tag=RH1SMK6RMWFY type=write size=3290944 2024-09-19T11:43:14.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.334+0000 7f3d831968c0 1 < completed write operation key=3K8P37C015G3 tag=N0K82UUL7VX9 type=write size=272105 2024-09-19T11:43:14.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.338+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=UVNGSHSTQKFF type=del size=498804 2024-09-19T11:43:14.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.342+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=QIZG1VJT6OHY type=del 2024-09-19T11:43:14.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.346+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~3LHOCST8DJHO.0 size=657665 2024-09-19T11:43:14.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.346+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=3LHOCST8DJHO tag=7IUOC08KN0LP type=write size=1706241 2024-09-19T11:43:14.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.350+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=1NNF45E7SGIX type=del 2024-09-19T11:43:14.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.358+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~W30S9W6L7CKQ.0 size=279620 2024-09-19T11:43:14.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.358+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=W30S9W6L7CKQ tag=7BXE2SHBDQHV type=write size=1328196 2024-09-19T11:43:14.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.358+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~N66MNEOCI09U.0 size=1048576 2024-09-19T11:43:14.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.362+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~N66MNEOCI09U.1 size=345072 2024-09-19T11:43:14.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.370+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=N66MNEOCI09U tag=KR3X81WJ69E3 type=write size=2442224 2024-09-19T11:43:14.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.370+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=9VM91I6JB4WW type=write size=258652 2024-09-19T11:43:14.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.374+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=XHWEUYYMF8MM type=del 2024-09-19T11:43:14.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.378+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=W73Y59HY3BE6 type=del size=2526521 2024-09-19T11:43:14.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.386+0000 7f3d831968c0 1 < suggested remove operation key=G4P6HIOM1G2E tag=2IQJ0L0YP1B9 type=del 2024-09-19T11:43:14.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.390+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=G8GEVNHI35NS type=del size=3318731 2024-09-19T11:43:14.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.394+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~LVW6EQMZWUPK.0 size=1048576 2024-09-19T11:43:14.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.394+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~LVW6EQMZWUPK.1 size=771291 2024-09-19T11:43:14.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.402+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=LVW6EQMZWUPK tag=RVR62IFA300O type=write size=2868443 2024-09-19T11:43:14.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.402+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=V6HDAME1NCF5 type=write size=541969 2024-09-19T11:43:14.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.406+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=TVJVT9S30TD2 type=del 2024-09-19T11:43:14.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.410+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=FPKDU7N75F3Q type=write size=820228 2024-09-19T11:43:14.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.414+0000 7f3d831968c0 1 < completed delete operation key=FZGRZ06MOHBI tag=B2VY26L5WIEA type=del 2024-09-19T11:43:14.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.414+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=KXTQLLGFZ6OU type=del size=1024384 2024-09-19T11:43:14.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.418+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=1BR54DHPB4B9 type=del 2024-09-19T11:43:14.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.422+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=TPVT04TY9A1Q type=del size=677542 2024-09-19T11:43:14.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.426+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~AQKVSDSW480G.0 size=1048576 2024-09-19T11:43:14.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.426+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~AQKVSDSW480G.1 size=927384 2024-09-19T11:43:14.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.430+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=AQKVSDSW480G tag=DC1F7AVHVENQ type=write size=3024536 2024-09-19T11:43:14.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.434+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=12TGK1CCXA37 type=del size=1921126 2024-09-19T11:43:14.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.438+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~QGYDAEQWLYT6.0 size=1048576 2024-09-19T11:43:14.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.442+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~QGYDAEQWLYT6.1 size=263920 2024-09-19T11:43:14.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.446+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=QGYDAEQWLYT6 tag=65TEJ6SO0P7B type=write size=2361072 2024-09-19T11:43:14.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.450+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=V04R227GM9FR type=write size=842904 2024-09-19T11:43:14.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.450+0000 7f3d831968c0 1 < canceled part key=_multipart_900RV3451AON.2~H3AM0HD874IA.0 size=292899 2024-09-19T11:43:14.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.454+0000 7f3d831968c0 1 < canceled multipart upload key=900RV3451AON upload=H3AM0HD874IA tag=ARJCP9A4VZBJ type=write size=1341475 2024-09-19T11:43:14.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.458+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=N3OZPEXIOAPS type=write size=190134 2024-09-19T11:43:14.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.462+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~VV1F5LD405CT.0 size=1048576 2024-09-19T11:43:14.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.466+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~VV1F5LD405CT.1 size=1048576 2024-09-19T11:43:14.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.466+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~VV1F5LD405CT.2 size=665166 2024-09-19T11:43:14.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.470+0000 7f3d831968c0 1 < completed multipart upload key=5RTONAWGYJNE upload=VV1F5LD405CT tag=XKIOE66VZ5E3 type=write size=3810894 2024-09-19T11:43:14.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.478+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=W237SGF7NDCY type=write size=692040 2024-09-19T11:43:14.487 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.482+0000 7f3d831968c0 1 < completed write operation key=PB62JE7I55GG tag=C7XV4F0DY2WB type=write size=443350 2024-09-19T11:43:14.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.486+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=1WWZX16UQOEG type=del size=3516839 2024-09-19T11:43:14.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.490+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~B2XQ0LNJIUPO.0 size=1048576 2024-09-19T11:43:14.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.490+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~B2XQ0LNJIUPO.1 size=1048576 2024-09-19T11:43:14.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.494+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~B2XQ0LNJIUPO.2 size=145216 2024-09-19T11:43:14.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.498+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=B2XQ0LNJIUPO tag=RH1SMK6RMWFY type=write size=3290944 2024-09-19T11:43:14.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.502+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=LESG9TUVOKAP type=del size=178041 2024-09-19T11:43:14.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.506+0000 7f3d831968c0 -1 < failed to complete operation key=G4P6HIOM1G2E tag=UVNGSHSTQKFF type=del size=498804: (22) Invalid argument 2024-09-19T11:43:14.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.510+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=SXH2XVV1QJMR type=del size=3024446 2024-09-19T11:43:14.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.514+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~3LHOCST8DJHO.0 size=657665 2024-09-19T11:43:14.521 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.518+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=3LHOCST8DJHO tag=7IUOC08KN0LP type=write size=1706241 2024-09-19T11:43:14.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.522+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=AXL170YEG2PB type=del size=1016122 2024-09-19T11:43:14.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.522+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~W30S9W6L7CKQ.0 size=279620 2024-09-19T11:43:14.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.530+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=W30S9W6L7CKQ tag=7BXE2SHBDQHV type=write size=1328196 2024-09-19T11:43:14.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.530+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=Z3TMSIOILPMW type=write size=175967 2024-09-19T11:43:14.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.534+0000 7f3d831968c0 1 < completed write operation key=0OOB2SNLVK8E tag=9VM91I6JB4WW type=write size=258652 2024-09-19T11:43:14.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.538+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=UKYZ93313OZI type=del size=3637209 2024-09-19T11:43:14.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.542+0000 7f3d831968c0 1 < suggested update operation key=JV7EGEI6062Y tag=W73Y59HY3BE6 type=del size=2526521 2024-09-19T11:43:14.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.546+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~F4RR4INQVO04.0 size=1048576 2024-09-19T11:43:14.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.550+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~F4RR4INQVO04.1 size=1027328 2024-09-19T11:43:14.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.550+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=F4RR4INQVO04 tag=AVJ6NN4UAQCP type=write size=3124480 2024-09-19T11:43:14.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.554+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=G8GEVNHI35NS type=del 2024-09-19T11:43:14.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.554+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=QCDQEVOXLQFB type=del size=3440045 2024-09-19T11:43:14.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.558+0000 7f3d831968c0 1 < completed write operation key=QPG75T46BH38 tag=V6HDAME1NCF5 type=write size=541969 2024-09-19T11:43:14.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.566+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~2905P5M1R8RW.0 size=1048576 2024-09-19T11:43:14.570 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.566+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~2905P5M1R8RW.1 size=408577 2024-09-19T11:43:14.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.566+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=2905P5M1R8RW tag=DCJO1U8EUAPR type=write size=2505729 2024-09-19T11:43:14.573 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.570+0000 7f3d831968c0 1 < canceled operation key=CULXGFLZ0HI6 tag=FPKDU7N75F3Q type=write size=820228 2024-09-19T11:43:14.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.570+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=7RBER0YW02HF type=del size=2948932 2024-09-19T11:43:14.578 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.574+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=KXTQLLGFZ6OU type=del 2024-09-19T11:43:14.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.578+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=BVB5TWMZ1Q3I type=del size=1915773 2024-09-19T11:43:14.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.578+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=TPVT04TY9A1Q type=del 2024-09-19T11:43:14.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.582+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=3QSL3GPGXQ21 type=del size=301523 2024-09-19T11:43:14.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.586+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=12TGK1CCXA37 type=del 2024-09-19T11:43:14.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.590+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~7TB8LC8ZV94O.0 size=203258 2024-09-19T11:43:14.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.590+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=7TB8LC8ZV94O tag=GHCADZ9A5YOQ type=write size=1251834 2024-09-19T11:43:14.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.594+0000 7f3d831968c0 1 < completed write operation key=3K8P37C015G3 tag=V04R227GM9FR type=write size=842904 2024-09-19T11:43:14.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.598+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=COGC6Q1JX4IM type=del size=3949166 2024-09-19T11:43:14.603 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.598+0000 7f3d831968c0 1 < completed write operation key=UI7EVZ1SGD8R tag=N3OZPEXIOAPS type=write size=190134 2024-09-19T11:43:14.606 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.602+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=UTW49BP936I0 type=write size=585597 2024-09-19T11:43:14.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.606+0000 7f3d831968c0 1 < completed write operation key=UI7EVZ1SGD8R tag=W237SGF7NDCY type=write size=692040 2024-09-19T11:43:14.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.610+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~A42B6LD082TL.0 size=1048576 2024-09-19T11:43:14.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.614+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~A42B6LD082TL.1 size=1048576 2024-09-19T11:43:14.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.614+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~A42B6LD082TL.2 size=212221 2024-09-19T11:43:14.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.614+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=A42B6LD082TL tag=5LH7JB0GHUVG type=write size=3357949 2024-09-19T11:43:14.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.618+0000 7f3d831968c0 1 < completed delete operation key=PB62JE7I55GG tag=1WWZX16UQOEG type=del 2024-09-19T11:43:14.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.622+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=U92IM3M6QYN0 type=del size=2412201 2024-09-19T11:43:14.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.626+0000 7f3d831968c0 1 < canceled operation key=EVFF0F0760OS tag=LESG9TUVOKAP type=del size=178041 2024-09-19T11:43:14.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.630+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~DSOYL9I4BG6U.0 size=596859 2024-09-19T11:43:14.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.630+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=DSOYL9I4BG6U tag=QUZU1JO36OYY type=write size=1645435 2024-09-19T11:43:14.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.634+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=SXH2XVV1QJMR type=del 2024-09-19T11:43:14.641 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.638+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=IASKF53ICSNN type=del size=12425 2024-09-19T11:43:14.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.642+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=AXL170YEG2PB type=del 2024-09-19T11:43:14.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.642+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=24LADLETFLA2 type=write size=992077 2024-09-19T11:43:14.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.646+0000 7f3d831968c0 1 < completed write operation key=3GD7UZCI3WX4 tag=Z3TMSIOILPMW type=write size=175967 2024-09-19T11:43:14.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.654+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~RSMRZ3K0O73W.0 size=684028 2024-09-19T11:43:14.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.654+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=RSMRZ3K0O73W tag=QPL8GC1WPFAN type=write size=1732604 2024-09-19T11:43:14.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.658+0000 7f3d831968c0 1 < suggested update operation key=00DYD22W0ZNB tag=UKYZ93313OZI type=del size=3637209 2024-09-19T11:43:14.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.662+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=2MGHL19U8DNQ type=del size=1724957 2024-09-19T11:43:14.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.666+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~F4RR4INQVO04.0 size=1048576 2024-09-19T11:43:14.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.666+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~F4RR4INQVO04.1 size=1027328 2024-09-19T11:43:14.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.674+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=F4RR4INQVO04 tag=AVJ6NN4UAQCP type=write size=3124480 2024-09-19T11:43:14.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.678+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~OSPYVDTTYVVH.0 size=1048576 2024-09-19T11:43:14.684 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.682+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~OSPYVDTTYVVH.1 size=479300 2024-09-19T11:43:14.684 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.682+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=OSPYVDTTYVVH tag=H0UJCAJG8RQR type=write size=2576452 2024-09-19T11:43:14.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.682+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=QCDQEVOXLQFB type=del 2024-09-19T11:43:14.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.690+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~0FUKM3HIZETX.0 size=1048576 2024-09-19T11:43:14.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.690+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~0FUKM3HIZETX.1 size=123353 2024-09-19T11:43:14.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.690+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=0FUKM3HIZETX tag=GVWS9SX9I1OJ type=write size=2220505 2024-09-19T11:43:14.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.694+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~2905P5M1R8RW.0 size=1048576 2024-09-19T11:43:14.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.694+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~2905P5M1R8RW.1 size=408577 2024-09-19T11:43:14.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.702+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=2905P5M1R8RW tag=DCJO1U8EUAPR type=write size=2505729 2024-09-19T11:43:14.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.702+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=GORLPO8AG6QC type=del size=3558390 2024-09-19T11:43:14.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.706+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=7RBER0YW02HF type=del 2024-09-19T11:43:14.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.710+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~O2JUE9CQ8446.0 size=1048576 2024-09-19T11:43:14.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.714+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~O2JUE9CQ8446.1 size=1048576 2024-09-19T11:43:14.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.714+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~O2JUE9CQ8446.2 size=859953 2024-09-19T11:43:14.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.714+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=O2JUE9CQ8446 tag=1IDHSCS0DMFT type=write size=4005681 2024-09-19T11:43:14.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.718+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=BVB5TWMZ1Q3I type=del 2024-09-19T11:43:14.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.722+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~XUCE4M9F45XI.0 size=1048576 2024-09-19T11:43:14.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.722+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~XUCE4M9F45XI.1 size=1048576 2024-09-19T11:43:14.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.726+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~XUCE4M9F45XI.2 size=957746 2024-09-19T11:43:14.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.726+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=XUCE4M9F45XI tag=TXXOXJHNOY16 type=write size=4103474 2024-09-19T11:43:14.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.730+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=3QSL3GPGXQ21 type=del 2024-09-19T11:43:14.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.730+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=TWSFXWK75MG7 type=del size=4077076 2024-09-19T11:43:14.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.734+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~7TB8LC8ZV94O.0 size=203258 2024-09-19T11:43:14.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.738+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=7TB8LC8ZV94O tag=GHCADZ9A5YOQ type=write size=1251834 2024-09-19T11:43:14.744 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.738+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=UXB0466HLMUS type=del size=2885622 2024-09-19T11:43:14.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.742+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=COGC6Q1JX4IM type=del 2024-09-19T11:43:14.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.746+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=2PLV76GDYPO7 type=del size=2838352 2024-09-19T11:43:14.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.750+0000 7f3d831968c0 1 < completed write operation key=T9KJH2ZYCLVA tag=UTW49BP936I0 type=write size=585597 2024-09-19T11:43:14.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.754+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=9P1Z1KLHJ25R type=del size=38765 2024-09-19T11:43:14.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.754+0000 7f3d831968c0 1 < canceled part key=_multipart_6NLQ0BK8AJUO.2~A42B6LD082TL.0 size=1048576 2024-09-19T11:43:14.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.758+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~A42B6LD082TL.1 size=1048576 2024-09-19T11:43:14.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.762+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~A42B6LD082TL.2 size=212221 2024-09-19T11:43:14.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.766+0000 7f3d831968c0 1 < canceled multipart upload key=6NLQ0BK8AJUO upload=A42B6LD082TL tag=5LH7JB0GHUVG type=write size=3357949 2024-09-19T11:43:14.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.770+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=5T9T5UT46U07 type=del size=3780773 2024-09-19T11:43:14.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.770+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=U92IM3M6QYN0 type=del 2024-09-19T11:43:14.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.778+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~YJIRFZAKCWY0.0 size=16861 2024-09-19T11:43:14.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.778+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=YJIRFZAKCWY0 tag=ELTNJOUVAOO8 type=write size=1065437 2024-09-19T11:43:14.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.782+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~DSOYL9I4BG6U.0 size=596859 2024-09-19T11:43:14.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.786+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=DSOYL9I4BG6U tag=QUZU1JO36OYY type=write size=1645435 2024-09-19T11:43:14.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.790+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=WKVH59SWGB20 type=del size=209348 2024-09-19T11:43:14.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.794+0000 7f3d831968c0 1 < suggested remove operation key=G4P6HIOM1G2E tag=IASKF53ICSNN type=del 2024-09-19T11:43:14.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.798+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=R8TUBBQS54C3 type=write size=710121 2024-09-19T11:43:14.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.802+0000 7f3d831968c0 1 < completed write operation key=5RTONAWGYJNE tag=24LADLETFLA2 type=write size=992077 2024-09-19T11:43:14.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.806+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=IZYL03PRB13P type=write size=1017653 2024-09-19T11:43:14.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.806+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~RSMRZ3K0O73W.0 size=684028 2024-09-19T11:43:14.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.810+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=RSMRZ3K0O73W tag=QPL8GC1WPFAN type=write size=1732604 2024-09-19T11:43:14.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.814+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=S1P159CP2196 type=del size=1906151 2024-09-19T11:43:14.824 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.818+0000 7f3d831968c0 1 < suggested remove operation key=UI7EVZ1SGD8R tag=2MGHL19U8DNQ type=del 2024-09-19T11:43:14.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.826+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~OVHJATZV6V1G.0 size=1048576 2024-09-19T11:43:14.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.826+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~OVHJATZV6V1G.1 size=1048576 2024-09-19T11:43:14.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.830+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~OVHJATZV6V1G.2 size=824987 2024-09-19T11:43:14.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.830+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=OVHJATZV6V1G tag=WW56ND24DM4Y type=write size=3970715 2024-09-19T11:43:14.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.834+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~OSPYVDTTYVVH.0 size=1048576 2024-09-19T11:43:14.839 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.834+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~OSPYVDTTYVVH.1 size=479300 2024-09-19T11:43:14.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.838+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=OSPYVDTTYVVH tag=H0UJCAJG8RQR type=write size=2576452 2024-09-19T11:43:14.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.842+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=2HCMZ0ABUBJZ type=del size=2237134 2024-09-19T11:43:14.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.846+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~0FUKM3HIZETX.0 size=1048576 2024-09-19T11:43:14.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.846+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~0FUKM3HIZETX.1 size=123353 2024-09-19T11:43:14.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.850+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=0FUKM3HIZETX tag=GVWS9SX9I1OJ type=write size=2220505 2024-09-19T11:43:14.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.854+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=EOQ7Z72GPO18 type=write size=1015092 2024-09-19T11:43:14.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.858+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=GORLPO8AG6QC type=del 2024-09-19T11:43:14.867 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.862+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~H48H5OL4B9CC.0 size=108913 2024-09-19T11:43:14.868 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.862+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=H48H5OL4B9CC tag=XX11P900NKQ9 type=write size=1157489 2024-09-19T11:43:14.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.866+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~O2JUE9CQ8446.0 size=1048576 2024-09-19T11:43:14.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.870+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~O2JUE9CQ8446.1 size=1048576 2024-09-19T11:43:14.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.870+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~O2JUE9CQ8446.2 size=859953 2024-09-19T11:43:14.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.878+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=O2JUE9CQ8446 tag=1IDHSCS0DMFT type=write size=4005681 2024-09-19T11:43:14.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.882+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=WOY42PC92NNA type=del size=3029509 2024-09-19T11:43:14.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.882+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~XUCE4M9F45XI.0 size=1048576 2024-09-19T11:43:14.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.886+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~XUCE4M9F45XI.1 size=1048576 2024-09-19T11:43:14.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.890+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~XUCE4M9F45XI.2 size=957746 2024-09-19T11:43:14.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.894+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=XUCE4M9F45XI tag=TXXOXJHNOY16 type=write size=4103474 2024-09-19T11:43:14.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.898+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~897DEMDF3EDI.0 size=1048576 2024-09-19T11:43:14.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.902+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~897DEMDF3EDI.1 size=54413 2024-09-19T11:43:14.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.902+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=897DEMDF3EDI tag=WZC50DB3HNTZ type=write size=2151565 2024-09-19T11:43:14.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.906+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=TWSFXWK75MG7 type=del 2024-09-19T11:43:14.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.910+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~UW09AD4CQ6PU.0 size=813106 2024-09-19T11:43:14.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.910+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=UW09AD4CQ6PU tag=UJKGPX9F8AV3 type=write size=1861682 2024-09-19T11:43:14.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.914+0000 7f3d831968c0 -1 < failed to complete operation key=G4P6HIOM1G2E tag=UXB0466HLMUS type=del size=2885622: (22) Invalid argument 2024-09-19T11:43:14.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.914+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=YKQ2KS3WC0HZ type=del size=1210574 2024-09-19T11:43:14.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.918+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=2PLV76GDYPO7 type=del 2024-09-19T11:43:14.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.926+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~S45D8NCAWHAO.0 size=1048576 2024-09-19T11:43:14.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.926+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~S45D8NCAWHAO.1 size=1048576 2024-09-19T11:43:14.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.930+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~S45D8NCAWHAO.2 size=910000 2024-09-19T11:43:14.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.930+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=S45D8NCAWHAO tag=7TZRNFW6VJC0 type=write size=4055728 2024-09-19T11:43:14.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.934+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=9P1Z1KLHJ25R type=del 2024-09-19T11:43:14.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.938+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=LCSDFL51KJNE type=del size=3973505 2024-09-19T11:43:14.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.942+0000 7f3d831968c0 1 < suggested update operation key=2VJRZVU7S8LB tag=5T9T5UT46U07 type=del size=3780773 2024-09-19T11:43:14.950 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.946+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=A3THDNP1V2PQ type=del size=2164089 2024-09-19T11:43:14.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.950+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~YJIRFZAKCWY0.0 size=16861 2024-09-19T11:43:14.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.954+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=YJIRFZAKCWY0 tag=ELTNJOUVAOO8 type=write size=1065437 2024-09-19T11:43:14.966 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.962+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~GKKUDL006NC0.0 size=1048576 2024-09-19T11:43:14.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.966+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~GKKUDL006NC0.1 size=374583 2024-09-19T11:43:14.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.966+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=GKKUDL006NC0 tag=UITY7IK7G7F9 type=write size=2471735 2024-09-19T11:43:14.976 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.970+0000 7f3d831968c0 1 < suggested update operation key=I5XUMA2HKIR5 tag=WKVH59SWGB20 type=del size=209348 2024-09-19T11:43:14.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.974+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=QSL21BRG68D0 type=del size=685403 2024-09-19T11:43:14.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.982+0000 7f3d831968c0 1 < suggested update operation key=PB62JE7I55GG tag=R8TUBBQS54C3 type=write size=710121 2024-09-19T11:43:14.988 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.986+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=W2JG7V79B5MI type=del size=3401437 2024-09-19T11:43:14.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.990+0000 7f3d831968c0 1 < suggested remove operation key=900RV3451AON tag=IZYL03PRB13P type=write 2024-09-19T11:43:14.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.994+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=1DHQS98FENUZ type=del size=2286830 2024-09-19T11:43:15.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:14.998+0000 7f3d831968c0 1 < completed delete operation key=3QWBQYLI0SJR tag=S1P159CP2196 type=del 2024-09-19T11:43:15.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.002+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=9WTM001TZKXU type=del size=3250622 2024-09-19T11:43:15.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.002+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~OVHJATZV6V1G.0 size=1048576 2024-09-19T11:43:15.010 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.006+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~OVHJATZV6V1G.1 size=1048576 2024-09-19T11:43:15.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.010+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~OVHJATZV6V1G.2 size=824987 2024-09-19T11:43:15.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.014+0000 7f3d831968c0 1 < completed multipart upload key=LINLTWYV88VU upload=OVHJATZV6V1G tag=WW56ND24DM4Y type=write size=3970715 2024-09-19T11:43:15.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.018+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=508KXVRBSP9R type=del size=1379432 2024-09-19T11:43:15.023 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.018+0000 7f3d831968c0 -1 < failed to complete operation key=2VJRZVU7S8LB tag=2HCMZ0ABUBJZ type=del size=2237134: (22) Invalid argument 2024-09-19T11:43:15.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.026+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~PWC7PI03N02T.0 size=1048576 2024-09-19T11:43:15.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.026+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~PWC7PI03N02T.1 size=653737 2024-09-19T11:43:15.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.026+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=PWC7PI03N02T tag=K04DZ0N2PC79 type=write size=2750889 2024-09-19T11:43:15.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.030+0000 7f3d831968c0 1 < completed write operation key=8104Z4OQ7UWQ tag=EOQ7Z72GPO18 type=write size=1015092 2024-09-19T11:43:15.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.034+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=98XL3YJBGGZJ type=write size=474102 2024-09-19T11:43:15.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.034+0000 7f3d831968c0 1 < canceled part key=_multipart_4V17CRW6EB65.2~H48H5OL4B9CC.0 size=108913 2024-09-19T11:43:15.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.042+0000 7f3d831968c0 1 < canceled multipart upload key=4V17CRW6EB65 upload=H48H5OL4B9CC tag=XX11P900NKQ9 type=write size=1157489 2024-09-19T11:43:15.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.046+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=9PEUB3H0VQD2 type=del size=73240 2024-09-19T11:43:15.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.050+0000 7f3d831968c0 1 < completed delete operation key=QPG75T46BH38 tag=WOY42PC92NNA type=del 2024-09-19T11:43:15.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.058+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~CBD9MF484HJ1.0 size=1048576 2024-09-19T11:43:15.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.062+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~CBD9MF484HJ1.1 size=1048576 2024-09-19T11:43:15.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.062+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~CBD9MF484HJ1.2 size=681052 2024-09-19T11:43:15.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.062+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=CBD9MF484HJ1 tag=7176FJ44KUCT type=write size=3826780 2024-09-19T11:43:15.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.066+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~897DEMDF3EDI.0 size=1048576 2024-09-19T11:43:15.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.070+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~897DEMDF3EDI.1 size=54413 2024-09-19T11:43:15.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.074+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=897DEMDF3EDI tag=WZC50DB3HNTZ type=write size=2151565 2024-09-19T11:43:15.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.078+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=T3TPXEZOWBTF type=write size=997873 2024-09-19T11:43:15.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.082+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~UW09AD4CQ6PU.0 size=813106 2024-09-19T11:43:15.091 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.086+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=UW09AD4CQ6PU tag=UJKGPX9F8AV3 type=write size=1861682 2024-09-19T11:43:15.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.094+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~ZXWN52VQXAVF.0 size=485082 2024-09-19T11:43:15.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.094+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=ZXWN52VQXAVF tag=LG8P77ADFZ5R type=write size=1533658 2024-09-19T11:43:15.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.098+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=YKQ2KS3WC0HZ type=del 2024-09-19T11:43:15.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.102+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=6NARD6PNS8WV type=del size=1458770 2024-09-19T11:43:15.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.102+0000 7f3d831968c0 1 < canceled part key=_multipart_KAPKNZJ2DE6A.2~S45D8NCAWHAO.0 size=1048576 2024-09-19T11:43:15.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.106+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~S45D8NCAWHAO.1 size=1048576 2024-09-19T11:43:15.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.106+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~S45D8NCAWHAO.2 size=910000 2024-09-19T11:43:15.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.114+0000 7f3d831968c0 1 < canceled multipart upload key=KAPKNZJ2DE6A upload=S45D8NCAWHAO tag=7TZRNFW6VJC0 type=write size=4055728 2024-09-19T11:43:15.121 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.118+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=VZRJ4OF9WW13 type=write size=784160 2024-09-19T11:43:15.124 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.122+0000 7f3d831968c0 1 < canceled operation key=3K8P37C015G3 tag=LCSDFL51KJNE type=del size=3973505 2024-09-19T11:43:15.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.126+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~3N3727CBG2G7.0 size=1048576 2024-09-19T11:43:15.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.130+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~3N3727CBG2G7.1 size=781920 2024-09-19T11:43:15.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.130+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=3N3727CBG2G7 tag=QRE5YAOTJM4X type=write size=2879072 2024-09-19T11:43:15.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.138+0000 7f3d831968c0 1 < suggested update operation key=I5XUMA2HKIR5 tag=A3THDNP1V2PQ type=del size=2164089 2024-09-19T11:43:15.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.138+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=VWHDO0TAJR6E type=del size=1861220 2024-09-19T11:43:15.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.142+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~GKKUDL006NC0.0 size=1048576 2024-09-19T11:43:15.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.146+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~GKKUDL006NC0.1 size=374583 2024-09-19T11:43:15.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.154+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=GKKUDL006NC0 tag=UITY7IK7G7F9 type=write size=2471735 2024-09-19T11:43:15.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.154+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=XXMT1BKCXK6P type=del size=4170764 2024-09-19T11:43:15.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.158+0000 7f3d831968c0 1 < canceled operation key=76JFMPOUJZXW tag=QSL21BRG68D0 type=del size=685403 2024-09-19T11:43:15.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.162+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=BTQ1BVZY61UT type=write size=973298 2024-09-19T11:43:15.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.166+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=W2JG7V79B5MI type=del 2024-09-19T11:43:15.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.170+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=9XIC1DY97H27 type=del size=451990 2024-09-19T11:43:15.178 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.174+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=1DHQS98FENUZ type=del 2024-09-19T11:43:15.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.178+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=R7ZNV9FTFQ9K type=del size=1376261 2024-09-19T11:43:15.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.182+0000 7f3d831968c0 1 < canceled operation key=8104Z4OQ7UWQ tag=9WTM001TZKXU type=del size=3250622 2024-09-19T11:43:15.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.186+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=AUOJ8H195CEX type=del size=1944672 2024-09-19T11:43:15.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.190+0000 7f3d831968c0 1 < suggested remove operation key=224HPC2Y95N6 tag=508KXVRBSP9R type=del 2024-09-19T11:43:15.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.194+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=SS7AQPCTJ1NY type=del size=2402711 2024-09-19T11:43:15.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.194+0000 7f3d831968c0 1 < canceled part key=_multipart_QPG75T46BH38.2~PWC7PI03N02T.0 size=1048576 2024-09-19T11:43:15.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.198+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~PWC7PI03N02T.1 size=653737 2024-09-19T11:43:15.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.202+0000 7f3d831968c0 1 < canceled multipart upload key=QPG75T46BH38 upload=PWC7PI03N02T tag=K04DZ0N2PC79 type=write size=2750889 2024-09-19T11:43:15.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.206+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=79EUICFIG458 type=del size=3518972 2024-09-19T11:43:15.214 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.210+0000 7f3d831968c0 -1 < failed to complete operation key=I5XUMA2HKIR5 tag=98XL3YJBGGZJ type=write size=474102: (22) Invalid argument 2024-09-19T11:43:15.217 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.214+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=T1F7XYR5M0SL type=del size=580299 2024-09-19T11:43:15.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.218+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=9PEUB3H0VQD2 type=del 2024-09-19T11:43:15.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.218+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=R770I0W9OJDQ type=del size=4061921 2024-09-19T11:43:15.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.226+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~CBD9MF484HJ1.0 size=1048576 2024-09-19T11:43:15.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.226+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~CBD9MF484HJ1.1 size=1048576 2024-09-19T11:43:15.234 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.230+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~CBD9MF484HJ1.2 size=681052 2024-09-19T11:43:15.240 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.238+0000 7f3d831968c0 1 < completed multipart upload key=76JFMPOUJZXW upload=CBD9MF484HJ1 tag=7176FJ44KUCT type=write size=3826780 2024-09-19T11:43:15.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.242+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=7OVYX6GZ35ZL type=del size=1501844 2024-09-19T11:43:15.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.246+0000 7f3d831968c0 1 < suggested remove operation key=FZGRZ06MOHBI tag=T3TPXEZOWBTF type=write 2024-09-19T11:43:15.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.254+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~UBW8G40360NC.0 size=1048576 2024-09-19T11:43:15.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.254+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~UBW8G40360NC.1 size=1048576 2024-09-19T11:43:15.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.258+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~UBW8G40360NC.2 size=433070 2024-09-19T11:43:15.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.258+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=UBW8G40360NC tag=C721MC5IWN9T type=write size=3578798 2024-09-19T11:43:15.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.262+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~ZXWN52VQXAVF.0 size=485082 2024-09-19T11:43:15.270 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.266+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=ZXWN52VQXAVF tag=LG8P77ADFZ5R type=write size=1533658 2024-09-19T11:43:15.272 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.270+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=GQS5MVAQTEFS type=del size=3083296 2024-09-19T11:43:15.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.270+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=6NARD6PNS8WV type=del 2024-09-19T11:43:15.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.274+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=F427N34JQZVE type=del size=3611074 2024-09-19T11:43:15.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.278+0000 7f3d831968c0 1 < completed write operation key=00DYD22W0ZNB tag=VZRJ4OF9WW13 type=write size=784160 2024-09-19T11:43:15.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.278+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=SHPQ56G9I5B9 type=del size=1670534 2024-09-19T11:43:15.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.282+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~3N3727CBG2G7.0 size=1048576 2024-09-19T11:43:15.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.286+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~3N3727CBG2G7.1 size=781920 2024-09-19T11:43:15.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.290+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=3N3727CBG2G7 tag=QRE5YAOTJM4X type=write size=2879072 2024-09-19T11:43:15.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.294+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~QVXXQZ4LMC0L.0 size=1048576 2024-09-19T11:43:15.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.298+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~QVXXQZ4LMC0L.1 size=1048576 2024-09-19T11:43:15.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.302+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~QVXXQZ4LMC0L.2 size=262385 2024-09-19T11:43:15.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.302+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=QVXXQZ4LMC0L tag=8LZB8WNFO4SC type=write size=3408113 2024-09-19T11:43:15.308 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.302+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=VWHDO0TAJR6E type=del 2024-09-19T11:43:15.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.306+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=ZPYNBQQS2V33 type=del size=388014 2024-09-19T11:43:15.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.310+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=XXMT1BKCXK6P type=del 2024-09-19T11:43:15.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.314+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=Q0OB4T66TNLK type=del size=590379 2024-09-19T11:43:15.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.314+0000 7f3d831968c0 1 < canceled operation key=900RV3451AON tag=BTQ1BVZY61UT type=write size=973298 2024-09-19T11:43:15.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.318+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=4T2INDLDC9Q1 type=del size=1543913 2024-09-19T11:43:15.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.322+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=9XIC1DY97H27 type=del 2024-09-19T11:43:15.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.326+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=NFMFMSFTHTOD type=del size=864319 2024-09-19T11:43:15.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.326+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=R7ZNV9FTFQ9K type=del 2024-09-19T11:43:15.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.330+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=UPXVR5JXFPRJ type=del size=2857056 2024-09-19T11:43:15.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.338+0000 7f3d831968c0 1 < suggested update operation key=900RV3451AON tag=AUOJ8H195CEX type=del size=1944672 2024-09-19T11:43:15.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.342+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~DGTTR8YIR41F.0 size=1048576 2024-09-19T11:43:15.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.346+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~DGTTR8YIR41F.1 size=1048576 2024-09-19T11:43:15.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.346+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~DGTTR8YIR41F.2 size=739619 2024-09-19T11:43:15.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.346+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=DGTTR8YIR41F tag=901X26FZLK6B type=write size=3885347 2024-09-19T11:43:15.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.350+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=SS7AQPCTJ1NY type=del 2024-09-19T11:43:15.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.358+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~X5AS5MRJTILM.0 size=1038569 2024-09-19T11:43:15.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.358+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=X5AS5MRJTILM tag=57SMA17482JV type=write size=2087145 2024-09-19T11:43:15.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.362+0000 7f3d831968c0 1 < canceled operation key=66N4QS1R70Z7 tag=79EUICFIG458 type=del size=3518972 2024-09-19T11:43:15.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.366+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=TEZRJJW1480O type=del size=3821779 2024-09-19T11:43:15.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.370+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=T1F7XYR5M0SL type=del 2024-09-19T11:43:15.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.374+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=4B6I1JA9L9HB type=del size=2236919 2024-09-19T11:43:15.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.374+0000 7f3d831968c0 1 < canceled operation key=JV7EGEI6062Y tag=R770I0W9OJDQ type=del size=4061921 2024-09-19T11:43:15.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.378+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=EWHQY226VLKS type=del size=489346 2024-09-19T11:43:15.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.382+0000 7f3d831968c0 1 < canceled operation key=76JFMPOUJZXW tag=7OVYX6GZ35ZL type=del size=1501844 2024-09-19T11:43:15.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.386+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=4H4FSWEBT1IO type=del size=3361500 2024-09-19T11:43:15.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.390+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~UBW8G40360NC.0 size=1048576 2024-09-19T11:43:15.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.390+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~UBW8G40360NC.1 size=1048576 2024-09-19T11:43:15.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.390+0000 7f3d831968c0 1 < canceled part key=_multipart_Y3LO4H9RI4X0.2~UBW8G40360NC.2 size=433070 2024-09-19T11:43:15.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.398+0000 7f3d831968c0 1 < canceled multipart upload key=Y3LO4H9RI4X0 upload=UBW8G40360NC tag=C721MC5IWN9T type=write size=3578798 2024-09-19T11:43:15.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.402+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=L2YWIH8CUFNL type=del size=772548 2024-09-19T11:43:15.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.406+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=GQS5MVAQTEFS type=del 2024-09-19T11:43:15.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.410+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~L4GK82ZX0LNW.0 size=1048576 2024-09-19T11:43:15.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.414+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~L4GK82ZX0LNW.1 size=1048576 2024-09-19T11:43:15.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.418+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~L4GK82ZX0LNW.2 size=770892 2024-09-19T11:43:15.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.418+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=L4GK82ZX0LNW tag=SZL23DBT0K9O type=write size=3916620 2024-09-19T11:43:15.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.418+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=F427N34JQZVE type=del 2024-09-19T11:43:15.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.422+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=UE0KVHSNBZY1 type=del size=2012154 2024-09-19T11:43:15.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.430+0000 7f3d831968c0 1 < suggested update operation key=KAPKNZJ2DE6A tag=SHPQ56G9I5B9 type=del size=1670534 2024-09-19T11:43:15.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.434+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=GLLQJ8N0TJZX type=del size=551396 2024-09-19T11:43:15.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.438+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~QVXXQZ4LMC0L.0 size=1048576 2024-09-19T11:43:15.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.438+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~QVXXQZ4LMC0L.1 size=1048576 2024-09-19T11:43:15.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.442+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~QVXXQZ4LMC0L.2 size=262385 2024-09-19T11:43:15.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.446+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=QVXXQZ4LMC0L tag=8LZB8WNFO4SC type=write size=3408113 2024-09-19T11:43:15.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.450+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=15EQ0QSI1L62 type=del size=2574144 2024-09-19T11:43:15.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.454+0000 7f3d831968c0 1 < completed delete operation key=PB62JE7I55GG tag=ZPYNBQQS2V33 type=del 2024-09-19T11:43:15.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.462+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~SHOIUK6XKWGL.0 size=1048576 2024-09-19T11:43:15.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.466+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~SHOIUK6XKWGL.1 size=1048576 2024-09-19T11:43:15.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.466+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~SHOIUK6XKWGL.2 size=637592 2024-09-19T11:43:15.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.466+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=SHOIUK6XKWGL tag=NGJDNOERXLIS type=write size=3783320 2024-09-19T11:43:15.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.470+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=Q0OB4T66TNLK type=del 2024-09-19T11:43:15.478 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.474+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=U53UB3GZ3564 type=del size=3136030 2024-09-19T11:43:15.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.478+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=4T2INDLDC9Q1 type=del 2024-09-19T11:43:15.487 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.482+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~ECFCCS1CM8O2.0 size=1048576 2024-09-19T11:43:15.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.486+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~ECFCCS1CM8O2.1 size=564752 2024-09-19T11:43:15.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.486+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=ECFCCS1CM8O2 tag=8VKJK7CLZZ54 type=write size=2661904 2024-09-19T11:43:15.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.490+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=NFMFMSFTHTOD type=del 2024-09-19T11:43:15.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.494+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~WNG1W18YN67I.0 size=438596 2024-09-19T11:43:15.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.494+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=WNG1W18YN67I tag=JXWVI5XW5DGV type=write size=1487172 2024-09-19T11:43:15.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.498+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=UPXVR5JXFPRJ type=del 2024-09-19T11:43:15.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.502+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=DQ1VWJVXXAF6 type=del size=974087 2024-09-19T11:43:15.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.506+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~DGTTR8YIR41F.0 size=1048576 2024-09-19T11:43:15.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.506+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~DGTTR8YIR41F.1 size=1048576 2024-09-19T11:43:15.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.510+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~DGTTR8YIR41F.2 size=739619 2024-09-19T11:43:15.520 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.514+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=DGTTR8YIR41F tag=901X26FZLK6B type=write size=3885347 2024-09-19T11:43:15.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.518+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=VMSZ7ONTV8CY type=del size=3611641 2024-09-19T11:43:15.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.522+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~X5AS5MRJTILM.0 size=1038569 2024-09-19T11:43:15.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.526+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=X5AS5MRJTILM tag=57SMA17482JV type=write size=2087145 2024-09-19T11:43:15.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.534+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~4XX8EJ0B8XZ9.0 size=1048576 2024-09-19T11:43:15.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.534+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~4XX8EJ0B8XZ9.1 size=1048576 2024-09-19T11:43:15.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.538+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~4XX8EJ0B8XZ9.2 size=471247 2024-09-19T11:43:15.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.538+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=4XX8EJ0B8XZ9 tag=B9MUW9E572ND type=write size=3616975 2024-09-19T11:43:15.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.546+0000 7f3d831968c0 1 < suggested remove operation key=T9KJH2ZYCLVA tag=TEZRJJW1480O type=del 2024-09-19T11:43:15.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.550+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~Z138SL1O1XOC.0 size=1048576 2024-09-19T11:43:15.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.554+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~Z138SL1O1XOC.1 size=74350 2024-09-19T11:43:15.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.554+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=Z138SL1O1XOC tag=IUUECQ6EYBWS type=write size=2171502 2024-09-19T11:43:15.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.554+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=4B6I1JA9L9HB type=del 2024-09-19T11:43:15.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.558+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=DTUH643891AL type=write size=860318 2024-09-19T11:43:15.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.562+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=EWHQY226VLKS type=del 2024-09-19T11:43:15.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.566+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=FRUYQ1NZIB47 type=del size=3275072 2024-09-19T11:43:15.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.570+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=4H4FSWEBT1IO type=del 2024-09-19T11:43:15.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.574+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~38FBGI8A85UD.0 size=1048576 2024-09-19T11:43:15.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.578+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~38FBGI8A85UD.1 size=1048576 2024-09-19T11:43:15.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.578+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~38FBGI8A85UD.2 size=986310 2024-09-19T11:43:15.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.578+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=38FBGI8A85UD tag=K5ZBL078CD61 type=write size=4132038 2024-09-19T11:43:15.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.586+0000 7f3d831968c0 1 < suggested update operation key=LINLTWYV88VU tag=L2YWIH8CUFNL type=del size=772548 2024-09-19T11:43:15.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.594+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~BJGN0MMNRT0N.0 size=992946 2024-09-19T11:43:15.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.594+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=BJGN0MMNRT0N tag=WER41022P4FT type=write size=2041522 2024-09-19T11:43:15.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.598+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~L4GK82ZX0LNW.0 size=1048576 2024-09-19T11:43:15.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.598+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~L4GK82ZX0LNW.1 size=1048576 2024-09-19T11:43:15.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.602+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~L4GK82ZX0LNW.2 size=770892 2024-09-19T11:43:15.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.606+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=L4GK82ZX0LNW tag=SZL23DBT0K9O type=write size=3916620 2024-09-19T11:43:15.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.614+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~IDV3986387TC.0 size=1048576 2024-09-19T11:43:15.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.618+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~IDV3986387TC.1 size=643142 2024-09-19T11:43:15.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.618+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=IDV3986387TC tag=3MKJ73HIEVSJ type=write size=2740294 2024-09-19T11:43:15.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.622+0000 7f3d831968c0 1 < suggested update operation key=EVFF0F0760OS tag=UE0KVHSNBZY1 type=del size=2012154 2024-09-19T11:43:15.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.626+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~ZUDO35DCZBR1.0 size=1048576 2024-09-19T11:43:15.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.630+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~ZUDO35DCZBR1.1 size=46408 2024-09-19T11:43:15.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.630+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=ZUDO35DCZBR1 tag=JWP45J1U0B3T type=write size=2143560 2024-09-19T11:43:15.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.634+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=GLLQJ8N0TJZX type=del 2024-09-19T11:43:15.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.638+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~SG3NLZ6MCI1K.0 size=1048576 2024-09-19T11:43:15.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.642+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~SG3NLZ6MCI1K.1 size=1048576 2024-09-19T11:43:15.646 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.642+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~SG3NLZ6MCI1K.2 size=91763 2024-09-19T11:43:15.646 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.642+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=SG3NLZ6MCI1K tag=FRDYQ18ESMGY type=write size=3237491 2024-09-19T11:43:15.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.646+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=15EQ0QSI1L62 type=del 2024-09-19T11:43:15.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.646+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=O6I58YD8DS73 type=del size=1987314 2024-09-19T11:43:15.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.650+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~SHOIUK6XKWGL.0 size=1048576 2024-09-19T11:43:15.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.650+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~SHOIUK6XKWGL.1 size=1048576 2024-09-19T11:43:15.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.654+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~SHOIUK6XKWGL.2 size=637592 2024-09-19T11:43:15.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.658+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=SHOIUK6XKWGL tag=NGJDNOERXLIS type=write size=3783320 2024-09-19T11:43:15.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.662+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=EY5FD8GWE2H6 type=del size=3724700 2024-09-19T11:43:15.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.666+0000 7f3d831968c0 -1 < failed to complete operation key=LINLTWYV88VU tag=U53UB3GZ3564 type=del size=3136030: (22) Invalid argument 2024-09-19T11:43:15.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.670+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~DT92XGBXV7P8.0 size=1048576 2024-09-19T11:43:15.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.670+0000 7f3d831968c0 1 > prepared part key=_multipart_Y3LO4H9RI4X0.2~DT92XGBXV7P8.1 size=178903 2024-09-19T11:43:15.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.670+0000 7f3d831968c0 1 > prepared multipart upload key=Y3LO4H9RI4X0 upload=DT92XGBXV7P8 tag=SL39HL6AWBGS type=write size=2276055 2024-09-19T11:43:15.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.674+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~ECFCCS1CM8O2.0 size=1048576 2024-09-19T11:43:15.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.674+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~ECFCCS1CM8O2.1 size=564752 2024-09-19T11:43:15.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.678+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=ECFCCS1CM8O2 tag=8VKJK7CLZZ54 type=write size=2661904 2024-09-19T11:43:15.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.682+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~49IVXYNEI4NA.0 size=578105 2024-09-19T11:43:15.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.682+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=49IVXYNEI4NA tag=3LKKKVL36436 type=write size=1626681 2024-09-19T11:43:15.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.686+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~WNG1W18YN67I.0 size=438596 2024-09-19T11:43:15.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.690+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=WNG1W18YN67I tag=JXWVI5XW5DGV type=write size=1487172 2024-09-19T11:43:15.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.690+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=2MNMKUX92GZJ type=del size=3059046 2024-09-19T11:43:15.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.694+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=DQ1VWJVXXAF6 type=del 2024-09-19T11:43:15.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.698+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~WI9EEQ4SC307.0 size=263838 2024-09-19T11:43:15.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.698+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=WI9EEQ4SC307 tag=NMQ0NUI87BL0 type=write size=1312414 2024-09-19T11:43:15.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.702+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=VMSZ7ONTV8CY type=del 2024-09-19T11:43:15.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.706+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~CP0MBVDA2K27.0 size=1048576 2024-09-19T11:43:15.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.706+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~CP0MBVDA2K27.1 size=385724 2024-09-19T11:43:15.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.706+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=CP0MBVDA2K27 tag=ES11VGHBRVFR type=write size=2482876 2024-09-19T11:43:15.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.710+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~4XX8EJ0B8XZ9.0 size=1048576 2024-09-19T11:43:15.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.710+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~4XX8EJ0B8XZ9.1 size=1048576 2024-09-19T11:43:15.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.714+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~4XX8EJ0B8XZ9.2 size=471247 2024-09-19T11:43:15.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.718+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=4XX8EJ0B8XZ9 tag=B9MUW9E572ND type=write size=3616975 2024-09-19T11:43:15.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.722+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~FVDK5U6WCLJ5.0 size=339487 2024-09-19T11:43:15.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.722+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=FVDK5U6WCLJ5 tag=TRUQCX3AVUVU type=write size=1388063 2024-09-19T11:43:15.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.722+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~Z138SL1O1XOC.0 size=1048576 2024-09-19T11:43:15.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.726+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~Z138SL1O1XOC.1 size=74350 2024-09-19T11:43:15.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.730+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=Z138SL1O1XOC tag=IUUECQ6EYBWS type=write size=2171502 2024-09-19T11:43:15.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.734+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~Q970W7OYXFL8.0 size=1048576 2024-09-19T11:43:15.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.734+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~Q970W7OYXFL8.1 size=167619 2024-09-19T11:43:15.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.734+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=Q970W7OYXFL8 tag=CDJ7P1M9FLI7 type=write size=2264771 2024-09-19T11:43:15.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.738+0000 7f3d831968c0 1 < completed write operation key=CULXGFLZ0HI6 tag=DTUH643891AL type=write size=860318 2024-09-19T11:43:15.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.738+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=RNSTN6ZX0JS7 type=del size=2995041 2024-09-19T11:43:15.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.742+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=FRUYQ1NZIB47 type=del 2024-09-19T11:43:15.748 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.746+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=BE0M2RP5QRB5 type=del size=2837116 2024-09-19T11:43:15.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.746+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~38FBGI8A85UD.0 size=1048576 2024-09-19T11:43:15.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.750+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~38FBGI8A85UD.1 size=1048576 2024-09-19T11:43:15.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.750+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~38FBGI8A85UD.2 size=986310 2024-09-19T11:43:15.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.754+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=38FBGI8A85UD tag=K5ZBL078CD61 type=write size=4132038 2024-09-19T11:43:15.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.758+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=X04CXY0WIY1W type=del size=1362762 2024-09-19T11:43:15.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.758+0000 7f3d831968c0 1 < canceled part key=_multipart_QPG75T46BH38.2~BJGN0MMNRT0N.0 size=992946 2024-09-19T11:43:15.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.762+0000 7f3d831968c0 1 < canceled multipart upload key=QPG75T46BH38 upload=BJGN0MMNRT0N tag=WER41022P4FT type=write size=2041522 2024-09-19T11:43:15.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.766+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~3R7QQ0WSZXJ7.0 size=1048576 2024-09-19T11:43:15.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.770+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~3R7QQ0WSZXJ7.1 size=445792 2024-09-19T11:43:15.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.770+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=3R7QQ0WSZXJ7 tag=1BAQKKFZR1NS type=write size=2542944 2024-09-19T11:43:15.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.770+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~IDV3986387TC.0 size=1048576 2024-09-19T11:43:15.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.774+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~IDV3986387TC.1 size=643142 2024-09-19T11:43:15.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.778+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=IDV3986387TC tag=3MKJ73HIEVSJ type=write size=2740294 2024-09-19T11:43:15.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.782+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~L2AA9TQFLXIG.0 size=1048576 2024-09-19T11:43:15.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.782+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~L2AA9TQFLXIG.1 size=1048576 2024-09-19T11:43:15.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.786+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~L2AA9TQFLXIG.2 size=698123 2024-09-19T11:43:15.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.786+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=L2AA9TQFLXIG tag=C1BKMYRS5UMS type=write size=3843851 2024-09-19T11:43:15.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.786+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~ZUDO35DCZBR1.0 size=1048576 2024-09-19T11:43:15.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.786+0000 7f3d831968c0 1 < canceled part key=_multipart_LINLTWYV88VU.2~ZUDO35DCZBR1.1 size=46408 2024-09-19T11:43:15.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.790+0000 7f3d831968c0 1 < canceled multipart upload key=LINLTWYV88VU upload=ZUDO35DCZBR1 tag=JWP45J1U0B3T type=write size=2143560 2024-09-19T11:43:15.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.794+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~77TFJK4L598W.0 size=1048576 2024-09-19T11:43:15.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.798+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~77TFJK4L598W.1 size=937152 2024-09-19T11:43:15.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.798+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=77TFJK4L598W tag=XFSOD160Q2PG type=write size=3034304 2024-09-19T11:43:15.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.798+0000 7f3d831968c0 1 < canceled part key=_multipart_76JFMPOUJZXW.2~SG3NLZ6MCI1K.0 size=1048576 2024-09-19T11:43:15.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.798+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~SG3NLZ6MCI1K.1 size=1048576 2024-09-19T11:43:15.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.802+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~SG3NLZ6MCI1K.2 size=91763 2024-09-19T11:43:15.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.806+0000 7f3d831968c0 1 < canceled multipart upload key=76JFMPOUJZXW upload=SG3NLZ6MCI1K tag=FRDYQ18ESMGY type=write size=3237491 2024-09-19T11:43:15.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.810+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=DT3GQ2XF1FQA type=del size=972863 2024-09-19T11:43:15.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.810+0000 7f3d831968c0 1 < completed delete operation key=LINLTWYV88VU tag=O6I58YD8DS73 type=del 2024-09-19T11:43:15.820 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.814+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=D2JWO6QW6BKQ type=write size=296617 2024-09-19T11:43:15.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.818+0000 7f3d831968c0 1 < suggested remove operation key=76JFMPOUJZXW tag=EY5FD8GWE2H6 type=del 2024-09-19T11:43:15.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.822+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=WIOLJUNS5WZ8 type=write size=742371 2024-09-19T11:43:15.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.822+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~DT92XGBXV7P8.0 size=1048576 2024-09-19T11:43:15.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.826+0000 7f3d831968c0 1 < completed part key=_multipart_Y3LO4H9RI4X0.2~DT92XGBXV7P8.1 size=178903 2024-09-19T11:43:15.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.830+0000 7f3d831968c0 1 < completed multipart upload key=Y3LO4H9RI4X0 upload=DT92XGBXV7P8 tag=SL39HL6AWBGS type=write size=2276055 2024-09-19T11:43:15.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.830+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=L3V4WZF6U8GQ type=write size=369561 2024-09-19T11:43:15.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.834+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~49IVXYNEI4NA.0 size=578105 2024-09-19T11:43:15.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.838+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=49IVXYNEI4NA tag=3LKKKVL36436 type=write size=1626681 2024-09-19T11:43:15.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.838+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=5Z9GJGTBQ6GD type=del size=3221905 2024-09-19T11:43:15.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.842+0000 7f3d831968c0 1 < suggested remove operation key=0OOB2SNLVK8E tag=2MNMKUX92GZJ type=del 2024-09-19T11:43:15.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.850+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~GBA5B37NTQWT.0 size=1048576 2024-09-19T11:43:15.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.850+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~GBA5B37NTQWT.1 size=1048576 2024-09-19T11:43:15.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.854+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~GBA5B37NTQWT.2 size=1002911 2024-09-19T11:43:15.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.854+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=GBA5B37NTQWT tag=F6W5X298MLCO type=write size=4148639 2024-09-19T11:43:15.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.854+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~WI9EEQ4SC307.0 size=263838 2024-09-19T11:43:15.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.858+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=WI9EEQ4SC307 tag=NMQ0NUI87BL0 type=write size=1312414 2024-09-19T11:43:15.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.862+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=SRLAKAE986C6 type=write size=1003697 2024-09-19T11:43:15.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.862+0000 7f3d831968c0 1 < canceled part key=_multipart_2VJRZVU7S8LB.2~CP0MBVDA2K27.0 size=1048576 2024-09-19T11:43:15.868 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.866+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~CP0MBVDA2K27.1 size=385724 2024-09-19T11:43:15.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.870+0000 7f3d831968c0 1 < canceled multipart upload key=2VJRZVU7S8LB upload=CP0MBVDA2K27 tag=ES11VGHBRVFR type=write size=2482876 2024-09-19T11:43:15.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.874+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=AWMNXSDUMG93 type=del size=1740695 2024-09-19T11:43:15.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.878+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~FVDK5U6WCLJ5.0 size=339487 2024-09-19T11:43:15.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.882+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=FVDK5U6WCLJ5 tag=TRUQCX3AVUVU type=write size=1388063 2024-09-19T11:43:15.889 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.886+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=EXUITC6HX00Y type=del size=685890 2024-09-19T11:43:15.889 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.886+0000 7f3d831968c0 1 < canceled part key=_multipart_I5XUMA2HKIR5.2~Q970W7OYXFL8.0 size=1048576 2024-09-19T11:43:15.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.886+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~Q970W7OYXFL8.1 size=167619 2024-09-19T11:43:15.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.890+0000 7f3d831968c0 1 < canceled multipart upload key=I5XUMA2HKIR5 upload=Q970W7OYXFL8 tag=CDJ7P1M9FLI7 type=write size=2264771 2024-09-19T11:43:15.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.894+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=ZTWTLVQX3OQC type=del size=3745443 2024-09-19T11:43:15.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.898+0000 7f3d831968c0 1 < canceled operation key=900RV3451AON tag=RNSTN6ZX0JS7 type=del size=2995041 2024-09-19T11:43:15.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.898+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=P5UEYJA039AK type=del size=2144720 2024-09-19T11:43:15.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.902+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=BE0M2RP5QRB5 type=del 2024-09-19T11:43:15.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.906+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=AC1IC5QEQTMS type=write size=400019 2024-09-19T11:43:15.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.906+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=X04CXY0WIY1W type=del 2024-09-19T11:43:15.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.910+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=6DSFW3UDOBWZ type=del size=2108329 2024-09-19T11:43:15.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.914+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~3R7QQ0WSZXJ7.0 size=1048576 2024-09-19T11:43:15.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.914+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~3R7QQ0WSZXJ7.1 size=445792 2024-09-19T11:43:15.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.922+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=3R7QQ0WSZXJ7 tag=1BAQKKFZR1NS type=write size=2542944 2024-09-19T11:43:15.927 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.922+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=18AEUAHJ6QLI type=del size=3169110 2024-09-19T11:43:15.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.926+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~L2AA9TQFLXIG.0 size=1048576 2024-09-19T11:43:15.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.926+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~L2AA9TQFLXIG.1 size=1048576 2024-09-19T11:43:15.933 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.930+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~L2AA9TQFLXIG.2 size=698123 2024-09-19T11:43:15.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.934+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=L2AA9TQFLXIG tag=C1BKMYRS5UMS type=write size=3843851 2024-09-19T11:43:15.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.934+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=DVZHKPTA2SY9 type=del size=2405782 2024-09-19T11:43:15.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.938+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~77TFJK4L598W.0 size=1048576 2024-09-19T11:43:15.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.942+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~77TFJK4L598W.1 size=937152 2024-09-19T11:43:15.949 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.946+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=77TFJK4L598W tag=XFSOD160Q2PG type=write size=3034304 2024-09-19T11:43:15.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.950+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~GRLDKTM1X5R9.0 size=851515 2024-09-19T11:43:15.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.950+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=GRLDKTM1X5R9 tag=TLC09276GDSW type=write size=1900091 2024-09-19T11:43:15.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.954+0000 7f3d831968c0 1 < completed delete operation key=900RV3451AON tag=DT3GQ2XF1FQA type=del 2024-09-19T11:43:15.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.954+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=85MPIV0I3HH4 type=write size=215887 2024-09-19T11:43:15.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.958+0000 7f3d831968c0 1 < completed write operation key=T9KJH2ZYCLVA tag=D2JWO6QW6BKQ type=write size=296617 2024-09-19T11:43:15.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.962+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=T9Z8JLX27NYB type=del size=3052926 2024-09-19T11:43:15.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.962+0000 7f3d831968c0 1 < completed write operation key=JTPBGWC4T3Y5 tag=WIOLJUNS5WZ8 type=write size=742371 2024-09-19T11:43:15.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.966+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=KJ250XF8R631 type=del size=2193021 2024-09-19T11:43:15.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.970+0000 7f3d831968c0 1 < completed write operation key=2VJRZVU7S8LB tag=L3V4WZF6U8GQ type=write size=369561 2024-09-19T11:43:15.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.970+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=HE2HK2NLLFD1 type=del size=2607407 2024-09-19T11:43:15.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.974+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=5Z9GJGTBQ6GD type=del 2024-09-19T11:43:15.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.978+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~41NV5TZSN2LN.0 size=1048576 2024-09-19T11:43:15.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.978+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~41NV5TZSN2LN.1 size=1048576 2024-09-19T11:43:15.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.982+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~41NV5TZSN2LN.2 size=987050 2024-09-19T11:43:15.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.982+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=41NV5TZSN2LN tag=893NER9OPM7G type=write size=4132778 2024-09-19T11:43:15.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.982+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~GBA5B37NTQWT.0 size=1048576 2024-09-19T11:43:15.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.986+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~GBA5B37NTQWT.1 size=1048576 2024-09-19T11:43:15.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.986+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~GBA5B37NTQWT.2 size=1002911 2024-09-19T11:43:15.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.990+0000 7f3d831968c0 1 < completed multipart upload key=3GD7UZCI3WX4 upload=GBA5B37NTQWT tag=F6W5X298MLCO type=write size=4148639 2024-09-19T11:43:15.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.994+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=NW06AOM4QPIT type=write size=220660 2024-09-19T11:43:16.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.994+0000 7f3d831968c0 1 < completed write operation key=UI7EVZ1SGD8R tag=SRLAKAE986C6 type=write size=1003697 2024-09-19T11:43:16.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:15.998+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~C3CBKNE4IODT.0 size=1048576 2024-09-19T11:43:16.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.002+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~C3CBKNE4IODT.1 size=181477 2024-09-19T11:43:16.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.002+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=C3CBKNE4IODT tag=JELBJNMR8R2F type=write size=2278629 2024-09-19T11:43:16.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.006+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=AWMNXSDUMG93 type=del 2024-09-19T11:43:16.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.006+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=HEODROQFIFEP type=del size=3528350 2024-09-19T11:43:16.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.010+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=EXUITC6HX00Y type=del 2024-09-19T11:43:16.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.014+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~RB9BZC3SPJPL.0 size=1048576 2024-09-19T11:43:16.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.018+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~RB9BZC3SPJPL.1 size=1048576 2024-09-19T11:43:16.022 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.018+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~RB9BZC3SPJPL.2 size=734880 2024-09-19T11:43:16.023 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.018+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=RB9BZC3SPJPL tag=JYAZZG6YCI84 type=write size=3880608 2024-09-19T11:43:16.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.022+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=ZTWTLVQX3OQC type=del 2024-09-19T11:43:16.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.026+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~9QIONFNZVO3B.0 size=1048576 2024-09-19T11:43:16.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.026+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~9QIONFNZVO3B.1 size=1048576 2024-09-19T11:43:16.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.030+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~9QIONFNZVO3B.2 size=418479 2024-09-19T11:43:16.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.030+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=9QIONFNZVO3B tag=W58M7NVWYQQ8 type=write size=3564207 2024-09-19T11:43:16.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.034+0000 7f3d831968c0 1 < suggested remove operation key=CULXGFLZ0HI6 tag=P5UEYJA039AK type=del 2024-09-19T11:43:16.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.038+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~QXV02C1PLCZX.0 size=48942 2024-09-19T11:43:16.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.038+0000 7f3d831968c0 1 > prepared multipart upload key=JTPBGWC4T3Y5 upload=QXV02C1PLCZX tag=B1QFG32YYM9S type=write size=1097518 2024-09-19T11:43:16.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.042+0000 7f3d831968c0 1 < suggested remove operation key=6NLQ0BK8AJUO tag=AC1IC5QEQTMS type=write 2024-09-19T11:43:16.050 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.046+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=9Y1Q7K3GXX0Z type=del size=1942794 2024-09-19T11:43:16.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.050+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=6DSFW3UDOBWZ type=del 2024-09-19T11:43:16.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.050+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=MSH3Z29PFJKW type=del size=3140714 2024-09-19T11:43:16.057 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.054+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=18AEUAHJ6QLI type=del 2024-09-19T11:43:16.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.054+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=O51L9ZKAX2V2 type=write size=646374 2024-09-19T11:43:16.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.058+0000 7f3d831968c0 1 < canceled operation key=T9KJH2ZYCLVA tag=DVZHKPTA2SY9 type=del size=2405782 2024-09-19T11:43:16.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.062+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~BNSX2TFGQOI4.0 size=752516 2024-09-19T11:43:16.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.062+0000 7f3d831968c0 1 > prepared multipart upload key=JTPBGWC4T3Y5 upload=BNSX2TFGQOI4 tag=37Y27KFJEZCX type=write size=1801092 2024-09-19T11:43:16.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.062+0000 7f3d831968c0 1 < canceled part key=_multipart_T9KJH2ZYCLVA.2~GRLDKTM1X5R9.0 size=851515 2024-09-19T11:43:16.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.066+0000 7f3d831968c0 1 < canceled multipart upload key=T9KJH2ZYCLVA upload=GRLDKTM1X5R9 tag=TLC09276GDSW type=write size=1900091 2024-09-19T11:43:16.074 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.070+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=TWYPQ9CI2R0I type=del size=928371 2024-09-19T11:43:16.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.074+0000 7f3d831968c0 -1 < failed to complete operation key=6NLQ0BK8AJUO tag=85MPIV0I3HH4 type=write size=215887: (22) Invalid argument 2024-09-19T11:43:16.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.078+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~75LC19X0LIPH.0 size=1048576 2024-09-19T11:43:16.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.078+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~75LC19X0LIPH.1 size=1016912 2024-09-19T11:43:16.084 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.078+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=75LC19X0LIPH tag=UV0S3B6SO6IZ type=write size=3114064 2024-09-19T11:43:16.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.082+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=T9Z8JLX27NYB type=del 2024-09-19T11:43:16.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.086+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=5OFSPKXXJSBX type=del size=1999270 2024-09-19T11:43:16.091 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.086+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=KJ250XF8R631 type=del 2024-09-19T11:43:16.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.090+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=WGNLLFAAO4OR type=del size=1118709 2024-09-19T11:43:16.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.094+0000 7f3d831968c0 1 < canceled operation key=66N4QS1R70Z7 tag=HE2HK2NLLFD1 type=del size=2607407 2024-09-19T11:43:16.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.094+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=9EGTLYN5TGWF type=write size=197568 2024-09-19T11:43:16.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.098+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~41NV5TZSN2LN.0 size=1048576 2024-09-19T11:43:16.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.098+0000 7f3d831968c0 1 < canceled part key=_multipart_4I8BY4YYTRT0.2~41NV5TZSN2LN.1 size=1048576 2024-09-19T11:43:16.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.102+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~41NV5TZSN2LN.2 size=987050 2024-09-19T11:43:16.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.106+0000 7f3d831968c0 1 < canceled multipart upload key=4I8BY4YYTRT0 upload=41NV5TZSN2LN tag=893NER9OPM7G type=write size=4132778 2024-09-19T11:43:16.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.110+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=WZ3HMGCR6LGD type=del size=2194066 2024-09-19T11:43:16.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.114+0000 7f3d831968c0 1 < completed write operation key=EVFF0F0760OS tag=NW06AOM4QPIT type=write size=220660 2024-09-19T11:43:16.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.122+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~UWREBFBTYSZ7.0 size=759105 2024-09-19T11:43:16.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.122+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=UWREBFBTYSZ7 tag=Z0WPR5ISXDN0 type=write size=1807681 2024-09-19T11:43:16.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.126+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~C3CBKNE4IODT.0 size=1048576 2024-09-19T11:43:16.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.130+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~C3CBKNE4IODT.1 size=181477 2024-09-19T11:43:16.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.134+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=C3CBKNE4IODT tag=JELBJNMR8R2F type=write size=2278629 2024-09-19T11:43:16.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.138+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~Y4OMZ7N93N83.0 size=1048576 2024-09-19T11:43:16.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.142+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~Y4OMZ7N93N83.1 size=1048576 2024-09-19T11:43:16.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.146+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~Y4OMZ7N93N83.2 size=898232 2024-09-19T11:43:16.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.146+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=Y4OMZ7N93N83 tag=NJCJ0N821X7F type=write size=4043960 2024-09-19T11:43:16.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.150+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=HEODROQFIFEP type=del 2024-09-19T11:43:16.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.150+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=BWVBMLIJVEIT type=write size=101048 2024-09-19T11:43:16.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.154+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~RB9BZC3SPJPL.0 size=1048576 2024-09-19T11:43:16.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.158+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~RB9BZC3SPJPL.1 size=1048576 2024-09-19T11:43:16.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.158+0000 7f3d831968c0 1 < canceled part key=_multipart_5RTONAWGYJNE.2~RB9BZC3SPJPL.2 size=734880 2024-09-19T11:43:16.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.162+0000 7f3d831968c0 1 < canceled multipart upload key=5RTONAWGYJNE upload=RB9BZC3SPJPL tag=JYAZZG6YCI84 type=write size=3880608 2024-09-19T11:43:16.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.166+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=MG4JD9ZCD4OA type=del size=308543 2024-09-19T11:43:16.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.170+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~9QIONFNZVO3B.0 size=1048576 2024-09-19T11:43:16.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.170+0000 7f3d831968c0 1 < canceled part key=_multipart_224HPC2Y95N6.2~9QIONFNZVO3B.1 size=1048576 2024-09-19T11:43:16.177 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.174+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~9QIONFNZVO3B.2 size=418479 2024-09-19T11:43:16.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.178+0000 7f3d831968c0 1 < canceled multipart upload key=224HPC2Y95N6 upload=9QIONFNZVO3B tag=W58M7NVWYQQ8 type=write size=3564207 2024-09-19T11:43:16.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.182+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=B1AADLQB0DJD type=del size=2520608 2024-09-19T11:43:16.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.186+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~QXV02C1PLCZX.0 size=48942 2024-09-19T11:43:16.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.190+0000 7f3d831968c0 1 < completed multipart upload key=JTPBGWC4T3Y5 upload=QXV02C1PLCZX tag=B1QFG32YYM9S type=write size=1097518 2024-09-19T11:43:16.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.194+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~VTR5ES10OOKZ.0 size=1048576 2024-09-19T11:43:16.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.198+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~VTR5ES10OOKZ.1 size=534370 2024-09-19T11:43:16.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.198+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=VTR5ES10OOKZ tag=6E0FF09OKKHP type=write size=2631522 2024-09-19T11:43:16.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.206+0000 7f3d831968c0 1 < suggested update operation key=6NLQ0BK8AJUO tag=9Y1Q7K3GXX0Z type=del size=1942794 2024-09-19T11:43:16.215 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.210+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~6X8UE4Q80MPA.0 size=1048576 2024-09-19T11:43:16.218 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.214+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~6X8UE4Q80MPA.1 size=1048576 2024-09-19T11:43:16.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.218+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~6X8UE4Q80MPA.2 size=566057 2024-09-19T11:43:16.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.218+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=6X8UE4Q80MPA tag=MB2SR7D6YB8B type=write size=3711785 2024-09-19T11:43:16.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.218+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=MSH3Z29PFJKW type=del 2024-09-19T11:43:16.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.222+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=1LHNZ7BPSCHK type=write size=899839 2024-09-19T11:43:16.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.226+0000 7f3d831968c0 1 < completed write operation key=0OOB2SNLVK8E tag=O51L9ZKAX2V2 type=write size=646374 2024-09-19T11:43:16.235 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.230+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~OHYNAYNL0B45.0 size=1048576 2024-09-19T11:43:16.238 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.234+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~OHYNAYNL0B45.1 size=1048576 2024-09-19T11:43:16.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.238+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~OHYNAYNL0B45.2 size=288099 2024-09-19T11:43:16.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.238+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=OHYNAYNL0B45 tag=2IHZT8NYA7PU type=write size=3433827 2024-09-19T11:43:16.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.238+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~BNSX2TFGQOI4.0 size=752516 2024-09-19T11:43:16.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.242+0000 7f3d831968c0 1 < completed multipart upload key=JTPBGWC4T3Y5 upload=BNSX2TFGQOI4 tag=37Y27KFJEZCX type=write size=1801092 2024-09-19T11:43:16.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.250+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~OTRMZKQSD8SR.0 size=1048576 2024-09-19T11:43:16.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.250+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~OTRMZKQSD8SR.1 size=486489 2024-09-19T11:43:16.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.250+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=OTRMZKQSD8SR tag=1NEC48PAMGIV type=write size=2583641 2024-09-19T11:43:16.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.254+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=TWYPQ9CI2R0I type=del 2024-09-19T11:43:16.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.258+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=NWN08SQVI08N type=del size=2013305 2024-09-19T11:43:16.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.258+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~75LC19X0LIPH.0 size=1048576 2024-09-19T11:43:16.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.262+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~75LC19X0LIPH.1 size=1016912 2024-09-19T11:43:16.270 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.266+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=75LC19X0LIPH tag=UV0S3B6SO6IZ type=write size=3114064 2024-09-19T11:43:16.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.270+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=I2FUI2O95I32 type=del size=3548763 2024-09-19T11:43:16.276 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.270+0000 7f3d831968c0 1 < completed delete operation key=8FGIZJIY58C7 tag=5OFSPKXXJSBX type=del 2024-09-19T11:43:16.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.274+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=PW1BVNYXQACT type=del size=2490211 2024-09-19T11:43:16.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.278+0000 7f3d831968c0 1 < canceled operation key=224HPC2Y95N6 tag=WGNLLFAAO4OR type=del size=1118709 2024-09-19T11:43:16.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.282+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~FYKH1WTPJA8H.0 size=653676 2024-09-19T11:43:16.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.282+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=FYKH1WTPJA8H tag=BQOE0E3SJLGP type=write size=1702252 2024-09-19T11:43:16.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.286+0000 7f3d831968c0 1 < completed write operation key=3GD7UZCI3WX4 tag=9EGTLYN5TGWF type=write size=197568 2024-09-19T11:43:16.292 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.286+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=9X11GEKL8A6F type=write size=188826 2024-09-19T11:43:16.297 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.294+0000 7f3d831968c0 1 < suggested update operation key=2VJRZVU7S8LB tag=WZ3HMGCR6LGD type=del size=2194066 2024-09-19T11:43:16.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.298+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~9V2781UH2HK5.0 size=514270 2024-09-19T11:43:16.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.298+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=9V2781UH2HK5 tag=LOANJK77J87J type=write size=1562846 2024-09-19T11:43:16.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.302+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~UWREBFBTYSZ7.0 size=759105 2024-09-19T11:43:16.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.306+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=UWREBFBTYSZ7 tag=Z0WPR5ISXDN0 type=write size=1807681 2024-09-19T11:43:16.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.310+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~5BABAFRT9D8V.0 size=1048576 2024-09-19T11:43:16.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.314+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~5BABAFRT9D8V.1 size=1048576 2024-09-19T11:43:16.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.314+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~5BABAFRT9D8V.2 size=791630 2024-09-19T11:43:16.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.314+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=5BABAFRT9D8V tag=VK06MG05I9KP type=write size=3937358 2024-09-19T11:43:16.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.318+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~Y4OMZ7N93N83.0 size=1048576 2024-09-19T11:43:16.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.322+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~Y4OMZ7N93N83.1 size=1048576 2024-09-19T11:43:16.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.322+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~Y4OMZ7N93N83.2 size=898232 2024-09-19T11:43:16.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.330+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=Y4OMZ7N93N83 tag=NJCJ0N821X7F type=write size=4043960 2024-09-19T11:43:16.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.334+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~GC105EBT449D.0 size=284942 2024-09-19T11:43:16.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.334+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=GC105EBT449D tag=TQSWECU4XKH2 type=write size=1333518 2024-09-19T11:43:16.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.342+0000 7f3d831968c0 1 < suggested update operation key=FKLL38ZNCJ21 tag=BWVBMLIJVEIT type=write size=101048 2024-09-19T11:43:16.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.350+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~L75MTRTZPT4L.0 size=642732 2024-09-19T11:43:16.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.350+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=L75MTRTZPT4L tag=TR4B4H479PG0 type=write size=1691308 2024-09-19T11:43:16.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.350+0000 7f3d831968c0 1 < canceled operation key=UI7EVZ1SGD8R tag=MG4JD9ZCD4OA type=del size=308543 2024-09-19T11:43:16.359 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.354+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=WLMW6FT5HQ3Y type=del size=3450003 2024-09-19T11:43:16.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.358+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=B1AADLQB0DJD type=del 2024-09-19T11:43:16.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.362+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=SXTD0FAAUSOO type=del size=2953116 2024-09-19T11:43:16.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.366+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~VTR5ES10OOKZ.0 size=1048576 2024-09-19T11:43:16.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.370+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~VTR5ES10OOKZ.1 size=534370 2024-09-19T11:43:16.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.374+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=VTR5ES10OOKZ tag=6E0FF09OKKHP type=write size=2631522 2024-09-19T11:43:16.385 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.382+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~992M6WRRU96Z.0 size=1048576 2024-09-19T11:43:16.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.382+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~992M6WRRU96Z.1 size=1048576 2024-09-19T11:43:16.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.386+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~992M6WRRU96Z.2 size=4324 2024-09-19T11:43:16.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.386+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=992M6WRRU96Z tag=DPXIQBB18PXL type=write size=3150052 2024-09-19T11:43:16.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.390+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~6X8UE4Q80MPA.0 size=1048576 2024-09-19T11:43:16.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.390+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~6X8UE4Q80MPA.1 size=1048576 2024-09-19T11:43:16.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.394+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~6X8UE4Q80MPA.2 size=566057 2024-09-19T11:43:16.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.402+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=6X8UE4Q80MPA tag=MB2SR7D6YB8B type=write size=3711785 2024-09-19T11:43:16.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.406+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=19MUN3VR3D4N type=del size=1407581 2024-09-19T11:43:16.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.410+0000 7f3d831968c0 1 < completed write operation key=224HPC2Y95N6 tag=1LHNZ7BPSCHK type=write size=899839 2024-09-19T11:43:16.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.414+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=H3RSQY0J27TO type=del size=1246587 2024-09-19T11:43:16.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.418+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~OHYNAYNL0B45.0 size=1048576 2024-09-19T11:43:16.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.418+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~OHYNAYNL0B45.1 size=1048576 2024-09-19T11:43:16.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.422+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~OHYNAYNL0B45.2 size=288099 2024-09-19T11:43:16.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.426+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=OHYNAYNL0B45 tag=2IHZT8NYA7PU type=write size=3433827 2024-09-19T11:43:16.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.434+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~U1EX4CVEHHOS.0 size=1048576 2024-09-19T11:43:16.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.438+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~U1EX4CVEHHOS.1 size=1048576 2024-09-19T11:43:16.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.438+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~U1EX4CVEHHOS.2 size=827143 2024-09-19T11:43:16.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.438+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=U1EX4CVEHHOS tag=4XPF866GX0RW type=write size=3972871 2024-09-19T11:43:16.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.442+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~OTRMZKQSD8SR.0 size=1048576 2024-09-19T11:43:16.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.446+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~OTRMZKQSD8SR.1 size=486489 2024-09-19T11:43:16.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.450+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=OTRMZKQSD8SR tag=1NEC48PAMGIV type=write size=2583641 2024-09-19T11:43:16.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.454+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=IH6WLLI10TI9 type=del size=2932041 2024-09-19T11:43:16.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.458+0000 7f3d831968c0 1 < canceled operation key=UI7EVZ1SGD8R tag=NWN08SQVI08N type=del size=2013305 2024-09-19T11:43:16.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.458+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=ZZXM7CQN4S1M type=del size=477165 2024-09-19T11:43:16.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.462+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=I2FUI2O95I32 type=del 2024-09-19T11:43:16.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.466+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=52NI570023DO type=del size=1522058 2024-09-19T11:43:16.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.474+0000 7f3d831968c0 1 < suggested update operation key=00DYD22W0ZNB tag=PW1BVNYXQACT type=del size=2490211 2024-09-19T11:43:16.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.478+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=3KQGS5BFGPXZ type=write size=1034789 2024-09-19T11:43:16.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.478+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~FYKH1WTPJA8H.0 size=653676 2024-09-19T11:43:16.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.486+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=FYKH1WTPJA8H tag=BQOE0E3SJLGP type=write size=1702252 2024-09-19T11:43:16.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.486+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=HLTMZ3N1BFF9 type=write size=551713 2024-09-19T11:43:16.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.490+0000 7f3d831968c0 1 < completed write operation key=66N4QS1R70Z7 tag=9X11GEKL8A6F type=write size=188826 2024-09-19T11:43:16.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.494+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=9052CQC0CPH1 type=del size=2806472 2024-09-19T11:43:16.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.498+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~9V2781UH2HK5.0 size=514270 2024-09-19T11:43:16.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.502+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=9V2781UH2HK5 tag=LOANJK77J87J type=write size=1562846 2024-09-19T11:43:16.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.506+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=KHMNMV0JL1G6 type=del size=1477826 2024-09-19T11:43:16.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.510+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~5BABAFRT9D8V.0 size=1048576 2024-09-19T11:43:16.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.510+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~5BABAFRT9D8V.1 size=1048576 2024-09-19T11:43:16.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.514+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~5BABAFRT9D8V.2 size=791630 2024-09-19T11:43:16.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.522+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=5BABAFRT9D8V tag=VK06MG05I9KP type=write size=3937358 2024-09-19T11:43:16.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.526+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~KIYWVGUQSUEE.0 size=1048576 2024-09-19T11:43:16.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.530+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~KIYWVGUQSUEE.1 size=272351 2024-09-19T11:43:16.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.530+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=KIYWVGUQSUEE tag=MA0CK0K0B3OP type=write size=2369503 2024-09-19T11:43:16.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.534+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~GC105EBT449D.0 size=284942 2024-09-19T11:43:16.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.538+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=GC105EBT449D tag=TQSWECU4XKH2 type=write size=1333518 2024-09-19T11:43:16.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.542+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=I0K11XWL2WK0 type=del size=2299276 2024-09-19T11:43:16.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.542+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~L75MTRTZPT4L.0 size=642732 2024-09-19T11:43:16.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.550+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=L75MTRTZPT4L tag=TR4B4H479PG0 type=write size=1691308 2024-09-19T11:43:16.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.550+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=TID0UNOXQOR0 type=del size=1529552 2024-09-19T11:43:16.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.554+0000 7f3d831968c0 1 < canceled operation key=3QWBQYLI0SJR tag=WLMW6FT5HQ3Y type=del size=3450003 2024-09-19T11:43:16.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.558+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=CWYWQOKXIHE9 type=del size=2187561 2024-09-19T11:43:16.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.562+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=SXTD0FAAUSOO type=del 2024-09-19T11:43:16.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.566+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~83FILIO74RBV.0 size=1048576 2024-09-19T11:43:16.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.570+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~83FILIO74RBV.1 size=617373 2024-09-19T11:43:16.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.570+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=83FILIO74RBV tag=0WP9XX048CEP type=write size=2714525 2024-09-19T11:43:16.577 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.574+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~992M6WRRU96Z.0 size=1048576 2024-09-19T11:43:16.580 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.574+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~992M6WRRU96Z.1 size=1048576 2024-09-19T11:43:16.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.578+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~992M6WRRU96Z.2 size=4324 2024-09-19T11:43:16.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.582+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=992M6WRRU96Z tag=DPXIQBB18PXL type=write size=3150052 2024-09-19T11:43:16.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.586+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=WXPCEXZIW7J3 type=del size=2519184 2024-09-19T11:43:16.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.590+0000 7f3d831968c0 -1 < failed to complete operation key=00DYD22W0ZNB tag=19MUN3VR3D4N type=del size=1407581: (22) Invalid argument 2024-09-19T11:43:16.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.594+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=G5V07RRHH78C type=del size=1041828 2024-09-19T11:43:16.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.594+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=H3RSQY0J27TO type=del 2024-09-19T11:43:16.603 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.598+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=QN84BDRUWL0C type=write size=67605 2024-09-19T11:43:16.606 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.602+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~U1EX4CVEHHOS.0 size=1048576 2024-09-19T11:43:16.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.602+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~U1EX4CVEHHOS.1 size=1048576 2024-09-19T11:43:16.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.606+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~U1EX4CVEHHOS.2 size=827143 2024-09-19T11:43:16.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.610+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=U1EX4CVEHHOS tag=4XPF866GX0RW type=write size=3972871 2024-09-19T11:43:16.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.614+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~6K0ZCI992812.0 size=1044671 2024-09-19T11:43:16.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.614+0000 7f3d831968c0 1 > prepared multipart upload key=JTPBGWC4T3Y5 upload=6K0ZCI992812 tag=ECH1GVFPXOBS type=write size=2093247 2024-09-19T11:43:16.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.618+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=IH6WLLI10TI9 type=del 2024-09-19T11:43:16.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.622+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=1FWP8HE4S348 type=del size=2142456 2024-09-19T11:43:16.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.626+0000 7f3d831968c0 1 < suggested remove operation key=224HPC2Y95N6 tag=ZZXM7CQN4S1M type=del 2024-09-19T11:43:16.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.634+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~7T2GME7NAVPE.0 size=1048576 2024-09-19T11:43:16.641 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.634+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~7T2GME7NAVPE.1 size=295567 2024-09-19T11:43:16.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.634+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=7T2GME7NAVPE tag=ZSFGJGPF2JDS type=write size=2392719 2024-09-19T11:43:16.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.642+0000 7f3d831968c0 1 < suggested update operation key=76JFMPOUJZXW tag=52NI570023DO type=del size=1522058 2024-09-19T11:43:16.650 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.646+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~V8YM3ZMNR0RQ.0 size=1048576 2024-09-19T11:43:16.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.650+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~V8YM3ZMNR0RQ.1 size=1046063 2024-09-19T11:43:16.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.650+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=V8YM3ZMNR0RQ tag=3PMXZD8ENWRT type=write size=3143215 2024-09-19T11:43:16.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.650+0000 7f3d831968c0 1 < completed write operation key=900RV3451AON tag=3KQGS5BFGPXZ type=write size=1034789 2024-09-19T11:43:16.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.658+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~4JQZ3G9I0E5X.0 size=563577 2024-09-19T11:43:16.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.658+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=4JQZ3G9I0E5X tag=C98H5HFOESDZ type=write size=1612153 2024-09-19T11:43:16.664 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.662+0000 7f3d831968c0 1 < completed write operation key=8FGIZJIY58C7 tag=HLTMZ3N1BFF9 type=write size=551713 2024-09-19T11:43:16.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.666+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~5QNQDNHZPG5R.0 size=114796 2024-09-19T11:43:16.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.666+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=5QNQDNHZPG5R tag=SAFWND8BOYZX type=write size=1163372 2024-09-19T11:43:16.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.670+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=9052CQC0CPH1 type=del 2024-09-19T11:43:16.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.670+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=KR5NABD1VR9A type=del size=222953 2024-09-19T11:43:16.678 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.674+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=KHMNMV0JL1G6 type=del 2024-09-19T11:43:16.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.678+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=3WGO8RIMILIA type=write size=847646 2024-09-19T11:43:16.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.682+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~KIYWVGUQSUEE.0 size=1048576 2024-09-19T11:43:16.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.682+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~KIYWVGUQSUEE.1 size=272351 2024-09-19T11:43:16.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.690+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=KIYWVGUQSUEE tag=MA0CK0K0B3OP type=write size=2369503 2024-09-19T11:43:16.696 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.690+0000 7f3d831968c0 1 > prepared operation key=8FGIZJIY58C7 tag=T2M0H2M9UXT8 type=del size=1865111 2024-09-19T11:43:16.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.698+0000 7f3d831968c0 1 < canceled operation key=LINLTWYV88VU tag=I0K11XWL2WK0 type=del size=2299276 2024-09-19T11:43:16.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.702+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=BOXIUXZ86GJV type=del size=3240858 2024-09-19T11:43:16.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.706+0000 7f3d831968c0 1 < canceled operation key=4V17CRW6EB65 tag=TID0UNOXQOR0 type=del size=1529552 2024-09-19T11:43:16.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.710+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~B1WR4XZELCRI.0 size=1048576 2024-09-19T11:43:16.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.714+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~B1WR4XZELCRI.1 size=1048576 2024-09-19T11:43:16.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.718+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~B1WR4XZELCRI.2 size=691803 2024-09-19T11:43:16.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.718+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=B1WR4XZELCRI tag=D2W3A428W0LY type=write size=3837531 2024-09-19T11:43:16.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.722+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=CWYWQOKXIHE9 type=del 2024-09-19T11:43:16.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.726+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~ZSFFN3JNPUOJ.0 size=1048576 2024-09-19T11:43:16.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.730+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~ZSFFN3JNPUOJ.1 size=624179 2024-09-19T11:43:16.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.730+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=ZSFFN3JNPUOJ tag=Y1CQHFF96WJP type=write size=2721331 2024-09-19T11:43:16.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.730+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~83FILIO74RBV.0 size=1048576 2024-09-19T11:43:16.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.730+0000 7f3d831968c0 1 < canceled part key=_multipart_EVFF0F0760OS.2~83FILIO74RBV.1 size=617373 2024-09-19T11:43:16.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.738+0000 7f3d831968c0 1 < canceled multipart upload key=EVFF0F0760OS upload=83FILIO74RBV tag=0WP9XX048CEP type=write size=2714525 2024-09-19T11:43:16.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.742+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=8J2F4SJOIN1D type=del size=2501805 2024-09-19T11:43:16.748 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.746+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=WXPCEXZIW7J3 type=del 2024-09-19T11:43:16.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.746+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=H07ZKEAQ2TCW type=write size=89654 2024-09-19T11:43:16.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.750+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=G5V07RRHH78C type=del 2024-09-19T11:43:16.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.754+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=C7TXPQ1V8RWJ type=del size=525290 2024-09-19T11:43:16.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.758+0000 7f3d831968c0 1 < completed write operation key=8FGIZJIY58C7 tag=QN84BDRUWL0C type=write size=67605 2024-09-19T11:43:16.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.758+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=NXVB06O22G60 type=del size=1012974 2024-09-19T11:43:16.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.762+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~6K0ZCI992812.0 size=1044671 2024-09-19T11:43:16.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.770+0000 7f3d831968c0 1 < completed multipart upload key=JTPBGWC4T3Y5 upload=6K0ZCI992812 tag=ECH1GVFPXOBS type=write size=2093247 2024-09-19T11:43:16.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.774+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=C4BEXAUZYRG4 type=del size=331644 2024-09-19T11:43:16.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.774+0000 7f3d831968c0 1 < completed delete operation key=4I8BY4YYTRT0 tag=1FWP8HE4S348 type=del 2024-09-19T11:43:16.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.778+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=HQ2UH1ESRBW5 type=del size=2651122 2024-09-19T11:43:16.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.782+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~7T2GME7NAVPE.0 size=1048576 2024-09-19T11:43:16.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.786+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~7T2GME7NAVPE.1 size=295567 2024-09-19T11:43:16.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.790+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=7T2GME7NAVPE tag=ZSFGJGPF2JDS type=write size=2392719 2024-09-19T11:43:16.797 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.794+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=5L7VFMVAQPM0 type=del size=795983 2024-09-19T11:43:16.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.798+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~V8YM3ZMNR0RQ.0 size=1048576 2024-09-19T11:43:16.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.798+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~V8YM3ZMNR0RQ.1 size=1046063 2024-09-19T11:43:16.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.806+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=V8YM3ZMNR0RQ tag=3PMXZD8ENWRT type=write size=3143215 2024-09-19T11:43:16.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.810+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=L73F18CK1YLN type=del size=300615 2024-09-19T11:43:16.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.814+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~4JQZ3G9I0E5X.0 size=563577 2024-09-19T11:43:16.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.818+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=4JQZ3G9I0E5X tag=C98H5HFOESDZ type=write size=1612153 2024-09-19T11:43:16.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.822+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=AVHANE9BM721 type=del size=714193 2024-09-19T11:43:16.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.826+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~5QNQDNHZPG5R.0 size=114796 2024-09-19T11:43:16.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.834+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=5QNQDNHZPG5R tag=SAFWND8BOYZX type=write size=1163372 2024-09-19T11:43:16.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.834+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=KPQF7LOI3IK4 type=del size=1893078 2024-09-19T11:43:16.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.838+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=KR5NABD1VR9A type=del 2024-09-19T11:43:16.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.842+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=9KITZ5JRCFAN type=del size=3676854 2024-09-19T11:43:16.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.846+0000 7f3d831968c0 1 < completed write operation key=8104Z4OQ7UWQ tag=3WGO8RIMILIA type=write size=847646 2024-09-19T11:43:16.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.850+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=LY6NM4VIP3EH type=del size=910666 2024-09-19T11:43:16.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.854+0000 7f3d831968c0 1 < canceled operation key=8FGIZJIY58C7 tag=T2M0H2M9UXT8 type=del size=1865111 2024-09-19T11:43:16.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.858+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=VIGD0YTRWJCS type=write size=902313 2024-09-19T11:43:16.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.862+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=BOXIUXZ86GJV type=del 2024-09-19T11:43:16.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.866+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~KCHXL9OY3PLK.0 size=1048576 2024-09-19T11:43:16.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.870+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~KCHXL9OY3PLK.1 size=1048576 2024-09-19T11:43:16.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.870+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~KCHXL9OY3PLK.2 size=422272 2024-09-19T11:43:16.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.870+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=KCHXL9OY3PLK tag=J5R1UXU75HW7 type=write size=3568000 2024-09-19T11:43:16.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.874+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~B1WR4XZELCRI.0 size=1048576 2024-09-19T11:43:16.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.878+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~B1WR4XZELCRI.1 size=1048576 2024-09-19T11:43:16.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.882+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~B1WR4XZELCRI.2 size=691803 2024-09-19T11:43:16.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.886+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=B1WR4XZELCRI tag=D2W3A428W0LY type=write size=3837531 2024-09-19T11:43:16.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.890+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~WJ6MNLA2GHBM.0 size=1048576 2024-09-19T11:43:16.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.894+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~WJ6MNLA2GHBM.1 size=944745 2024-09-19T11:43:16.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.894+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=WJ6MNLA2GHBM tag=MC71I19C9CBA type=write size=3041897 2024-09-19T11:43:16.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.898+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~ZSFFN3JNPUOJ.0 size=1048576 2024-09-19T11:43:16.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.902+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~ZSFFN3JNPUOJ.1 size=624179 2024-09-19T11:43:16.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.906+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=ZSFFN3JNPUOJ tag=Y1CQHFF96WJP type=write size=2721331 2024-09-19T11:43:16.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.910+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=78SF5WD5X40U type=del size=3353826 2024-09-19T11:43:16.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.914+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=8J2F4SJOIN1D type=del 2024-09-19T11:43:16.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.918+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~TSSWIATVEZUR.0 size=1048576 2024-09-19T11:43:16.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.922+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~TSSWIATVEZUR.1 size=314922 2024-09-19T11:43:16.925 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.922+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=TSSWIATVEZUR tag=TK6B6OD37YI4 type=write size=2412074 2024-09-19T11:43:16.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.922+0000 7f3d831968c0 1 < completed write operation key=4V17CRW6EB65 tag=H07ZKEAQ2TCW type=write size=89654 2024-09-19T11:43:16.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.926+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=G6LKVWPJSEA9 type=del size=1823112 2024-09-19T11:43:16.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.934+0000 7f3d831968c0 1 < suggested update operation key=5RTONAWGYJNE tag=C7TXPQ1V8RWJ type=del size=525290 2024-09-19T11:43:16.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.938+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~NCTNKLPQYJA3.0 size=983073 2024-09-19T11:43:16.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.938+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=NCTNKLPQYJA3 tag=YZZDDKJ30P1S type=write size=2031649 2024-09-19T11:43:16.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.942+0000 7f3d831968c0 1 < suggested update operation key=Y3LO4H9RI4X0 tag=NXVB06O22G60 type=del size=1012974 2024-09-19T11:43:16.949 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.946+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=YH1Y8401TSIP type=del size=987414 2024-09-19T11:43:16.952 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.946+0000 7f3d831968c0 -1 < failed to complete operation key=5RTONAWGYJNE tag=C4BEXAUZYRG4 type=del size=331644: (22) Invalid argument 2024-09-19T11:43:16.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.950+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=53MG0V823SB0 type=del size=1096927 2024-09-19T11:43:16.958 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.954+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=HQ2UH1ESRBW5 type=del 2024-09-19T11:43:16.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.958+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=2GNITJDGV3CZ type=del size=2535984 2024-09-19T11:43:16.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.958+0000 7f3d831968c0 1 < canceled operation key=E8OFSMUZHR02 tag=5L7VFMVAQPM0 type=del size=795983 2024-09-19T11:43:16.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.962+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=0G0PTOU1FFXX type=del size=3660240 2024-09-19T11:43:16.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.966+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=L73F18CK1YLN type=del 2024-09-19T11:43:16.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.970+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=7905B2IMVBVB type=del size=1027345 2024-09-19T11:43:16.976 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.970+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=AVHANE9BM721 type=del 2024-09-19T11:43:16.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.974+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=R3ZGQ5DRQ5F8 type=write size=790813 2024-09-19T11:43:16.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.978+0000 7f3d831968c0 1 < completed delete operation key=3QWBQYLI0SJR tag=KPQF7LOI3IK4 type=del 2024-09-19T11:43:16.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.982+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=8R90NBUGEF8E type=del size=3591651 2024-09-19T11:43:16.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.986+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=9KITZ5JRCFAN type=del 2024-09-19T11:43:16.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.990+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=ST6HT3PZ3LVG type=write size=392528 2024-09-19T11:43:16.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.994+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=LY6NM4VIP3EH type=del 2024-09-19T11:43:17.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.998+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=N34LO0Z1RXGY type=del size=3000511 2024-09-19T11:43:17.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:16.998+0000 7f3d831968c0 1 < completed write operation key=QPG75T46BH38 tag=VIGD0YTRWJCS type=write size=902313 2024-09-19T11:43:17.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.010+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~8BPAA21MO0KP.0 size=1048576 2024-09-19T11:43:17.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.010+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~8BPAA21MO0KP.1 size=955270 2024-09-19T11:43:17.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.010+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=8BPAA21MO0KP tag=AO8JQVAA6XZS type=write size=3052422 2024-09-19T11:43:17.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.014+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~KCHXL9OY3PLK.0 size=1048576 2024-09-19T11:43:17.023 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.018+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~KCHXL9OY3PLK.1 size=1048576 2024-09-19T11:43:17.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.022+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~KCHXL9OY3PLK.2 size=422272 2024-09-19T11:43:17.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.026+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=KCHXL9OY3PLK tag=J5R1UXU75HW7 type=write size=3568000 2024-09-19T11:43:17.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.034+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~JKJXMUI6VM7R.0 size=1048576 2024-09-19T11:43:17.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.034+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~JKJXMUI6VM7R.1 size=857519 2024-09-19T11:43:17.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.034+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=JKJXMUI6VM7R tag=DPXQ3JR474U8 type=write size=2954671 2024-09-19T11:43:17.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.038+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~WJ6MNLA2GHBM.0 size=1048576 2024-09-19T11:43:17.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.042+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~WJ6MNLA2GHBM.1 size=944745 2024-09-19T11:43:17.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.046+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=WJ6MNLA2GHBM tag=MC71I19C9CBA type=write size=3041897 2024-09-19T11:43:17.057 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.054+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~F2E5OX8VC7I5.0 size=1048576 2024-09-19T11:43:17.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.054+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~F2E5OX8VC7I5.1 size=1048576 2024-09-19T11:43:17.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.058+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~F2E5OX8VC7I5.2 size=513561 2024-09-19T11:43:17.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.058+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=F2E5OX8VC7I5 tag=0JC135W1YKIU type=write size=3659289 2024-09-19T11:43:17.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.062+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=78SF5WD5X40U type=del 2024-09-19T11:43:17.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.066+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=3XLELY4HQRC5 type=del size=3485135 2024-09-19T11:43:17.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.066+0000 7f3d831968c0 1 < canceled part key=_multipart_KAPKNZJ2DE6A.2~TSSWIATVEZUR.0 size=1048576 2024-09-19T11:43:17.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.070+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~TSSWIATVEZUR.1 size=314922 2024-09-19T11:43:17.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.074+0000 7f3d831968c0 1 < canceled multipart upload key=KAPKNZJ2DE6A upload=TSSWIATVEZUR tag=TK6B6OD37YI4 type=write size=2412074 2024-09-19T11:43:17.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.078+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=E80KM2C9I6O2 type=del size=1036384 2024-09-19T11:43:17.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.082+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=G6LKVWPJSEA9 type=del 2024-09-19T11:43:17.092 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.086+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~2PEIHMFNAL1O.0 size=1048576 2024-09-19T11:43:17.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.090+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~2PEIHMFNAL1O.1 size=1048576 2024-09-19T11:43:17.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.094+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~2PEIHMFNAL1O.2 size=847986 2024-09-19T11:43:17.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.094+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=2PEIHMFNAL1O tag=7QIWI3CRK7IF type=write size=3993714 2024-09-19T11:43:17.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.098+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~NCTNKLPQYJA3.0 size=983073 2024-09-19T11:43:17.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.102+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=NCTNKLPQYJA3 tag=YZZDDKJ30P1S type=write size=2031649 2024-09-19T11:43:17.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.106+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=KD71N7FA8HKE type=del size=2770643 2024-09-19T11:43:17.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.110+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=YH1Y8401TSIP type=del 2024-09-19T11:43:17.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.110+0000 7f3d831968c0 1 > prepared operation key=900RV3451AON tag=12O0XH0EC6M3 type=del size=1187404 2024-09-19T11:43:17.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.114+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=53MG0V823SB0 type=del 2024-09-19T11:43:17.123 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.118+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=8045VLM4ZUTK type=del size=3463712 2024-09-19T11:43:17.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.122+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=2GNITJDGV3CZ type=del 2024-09-19T11:43:17.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.126+0000 7f3d831968c0 1 > prepared operation key=PB62JE7I55GG tag=U02A2LCR1BUX type=write size=848455 2024-09-19T11:43:17.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.130+0000 7f3d831968c0 1 < suggested remove operation key=JTPBGWC4T3Y5 tag=0G0PTOU1FFXX type=del 2024-09-19T11:43:17.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.138+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~7F2EWR4KF046.0 size=1048576 2024-09-19T11:43:17.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.142+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~7F2EWR4KF046.1 size=1048576 2024-09-19T11:43:17.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.142+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~7F2EWR4KF046.2 size=810920 2024-09-19T11:43:17.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.142+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=7F2EWR4KF046 tag=GTSOS5ZTE6OI type=write size=3956648 2024-09-19T11:43:17.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.146+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=7905B2IMVBVB type=del 2024-09-19T11:43:17.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.154+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~GJQ2AF72SO8K.0 size=1048576 2024-09-19T11:43:17.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.154+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~GJQ2AF72SO8K.1 size=907102 2024-09-19T11:43:17.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.154+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=GJQ2AF72SO8K tag=K769JCEVIR19 type=write size=3004254 2024-09-19T11:43:17.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.158+0000 7f3d831968c0 1 < completed write operation key=I5XUMA2HKIR5 tag=R3ZGQ5DRQ5F8 type=write size=790813 2024-09-19T11:43:17.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.162+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=TI1DREKITNI8 type=del size=28011 2024-09-19T11:43:17.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.166+0000 7f3d831968c0 1 < canceled operation key=T9KJH2ZYCLVA tag=8R90NBUGEF8E type=del size=3591651 2024-09-19T11:43:17.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.170+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=KSBKAHHDM4TZ type=del size=3101098 2024-09-19T11:43:17.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.174+0000 7f3d831968c0 1 < suggested update operation key=JTPBGWC4T3Y5 tag=ST6HT3PZ3LVG type=write size=392528 2024-09-19T11:43:17.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.178+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=U66CEB558OYU type=del size=779166 2024-09-19T11:43:17.186 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.182+0000 7f3d831968c0 1 < canceled operation key=LINLTWYV88VU tag=N34LO0Z1RXGY type=del size=3000511 2024-09-19T11:43:17.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.186+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~BZSLVTV8DU3K.0 size=1048576 2024-09-19T11:43:17.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.190+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~BZSLVTV8DU3K.1 size=652937 2024-09-19T11:43:17.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.190+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=BZSLVTV8DU3K tag=AI72KB8091K5 type=write size=2750089 2024-09-19T11:43:17.197 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.194+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~8BPAA21MO0KP.0 size=1048576 2024-09-19T11:43:17.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.194+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~8BPAA21MO0KP.1 size=955270 2024-09-19T11:43:17.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.202+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=8BPAA21MO0KP tag=AO8JQVAA6XZS type=write size=3052422 2024-09-19T11:43:17.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.206+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~4SFJWKNNCVE2.0 size=1048576 2024-09-19T11:43:17.213 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.210+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~4SFJWKNNCVE2.1 size=1048576 2024-09-19T11:43:17.216 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.210+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~4SFJWKNNCVE2.2 size=1040973 2024-09-19T11:43:17.216 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.210+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=4SFJWKNNCVE2 tag=V2Q2GTPEX1JS type=write size=4186701 2024-09-19T11:43:17.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.214+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~JKJXMUI6VM7R.0 size=1048576 2024-09-19T11:43:17.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.218+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~JKJXMUI6VM7R.1 size=857519 2024-09-19T11:43:17.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.222+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=JKJXMUI6VM7R tag=DPXQ3JR474U8 type=write size=2954671 2024-09-19T11:43:17.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.226+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=IBQZW28O4HTT type=write size=90399 2024-09-19T11:43:17.234 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.230+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~F2E5OX8VC7I5.0 size=1048576 2024-09-19T11:43:17.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.234+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~F2E5OX8VC7I5.1 size=1048576 2024-09-19T11:43:17.239 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.234+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~F2E5OX8VC7I5.2 size=513561 2024-09-19T11:43:17.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.242+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=F2E5OX8VC7I5 tag=0JC135W1YKIU type=write size=3659289 2024-09-19T11:43:17.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.246+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=WSG1UPEAK3GY type=del size=393985 2024-09-19T11:43:17.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.246+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=3XLELY4HQRC5 type=del 2024-09-19T11:43:17.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.254+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~TN3VOXINCG2X.0 size=849067 2024-09-19T11:43:17.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.254+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=TN3VOXINCG2X tag=7YHMN59S64RF type=write size=1897643 2024-09-19T11:43:17.262 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.258+0000 7f3d831968c0 1 < suggested update operation key=76JFMPOUJZXW tag=E80KM2C9I6O2 type=del size=1036384 2024-09-19T11:43:17.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.262+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~0XP7PQ2FW21P.0 size=659622 2024-09-19T11:43:17.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.262+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=0XP7PQ2FW21P tag=NS73ARIYN7GP type=write size=1708198 2024-09-19T11:43:17.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.266+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~2PEIHMFNAL1O.0 size=1048576 2024-09-19T11:43:17.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.270+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~2PEIHMFNAL1O.1 size=1048576 2024-09-19T11:43:17.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.270+0000 7f3d831968c0 1 < canceled part key=_multipart_8FGIZJIY58C7.2~2PEIHMFNAL1O.2 size=847986 2024-09-19T11:43:17.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.274+0000 7f3d831968c0 1 < canceled multipart upload key=8FGIZJIY58C7 upload=2PEIHMFNAL1O tag=7QIWI3CRK7IF type=write size=3993714 2024-09-19T11:43:17.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.278+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=S42MOCTIC38Q type=del size=1244912 2024-09-19T11:43:17.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.278+0000 7f3d831968c0 1 < completed delete operation key=T9KJH2ZYCLVA tag=KD71N7FA8HKE type=del 2024-09-19T11:43:17.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.282+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=X70FRX3GGLTG type=del size=3481909 2024-09-19T11:43:17.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.286+0000 7f3d831968c0 1 < suggested update operation key=900RV3451AON tag=12O0XH0EC6M3 type=del size=1187404 2024-09-19T11:43:17.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.290+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=1MIVYWNXWVU3 type=del size=1115235 2024-09-19T11:43:17.299 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.294+0000 7f3d831968c0 1 < suggested update operation key=2VJRZVU7S8LB tag=8045VLM4ZUTK type=del size=3463712 2024-09-19T11:43:17.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.298+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=VKOETSBPNJ3P type=del size=1464556 2024-09-19T11:43:17.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.310+0000 7f3d831968c0 1 < suggested update operation key=PB62JE7I55GG tag=U02A2LCR1BUX type=write size=848455 2024-09-19T11:43:17.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.314+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~RSKZ9C9GWDPG.0 size=1048576 2024-09-19T11:43:17.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.318+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~RSKZ9C9GWDPG.1 size=131152 2024-09-19T11:43:17.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.318+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=RSKZ9C9GWDPG tag=Q9GAQEPBXJTT type=write size=2228304 2024-09-19T11:43:17.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.318+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~7F2EWR4KF046.0 size=1048576 2024-09-19T11:43:17.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.322+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~7F2EWR4KF046.1 size=1048576 2024-09-19T11:43:17.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.322+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~7F2EWR4KF046.2 size=810920 2024-09-19T11:43:17.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.330+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=7F2EWR4KF046 tag=GTSOS5ZTE6OI type=write size=3956648 2024-09-19T11:43:17.336 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.334+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=MW2KNBHP410K type=del size=1164460 2024-09-19T11:43:17.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.334+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~GJQ2AF72SO8K.0 size=1048576 2024-09-19T11:43:17.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.338+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~GJQ2AF72SO8K.1 size=907102 2024-09-19T11:43:17.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.342+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=GJQ2AF72SO8K tag=K769JCEVIR19 type=write size=3004254 2024-09-19T11:43:17.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.346+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=5390B6WUOVP0 type=del size=3770850 2024-09-19T11:43:17.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.350+0000 7f3d831968c0 1 < completed delete operation key=EVFF0F0760OS tag=TI1DREKITNI8 type=del 2024-09-19T11:43:17.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.354+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=4FLNUQMQKN8D type=del size=1228888 2024-09-19T11:43:17.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.358+0000 7f3d831968c0 -1 < failed to complete operation key=JTPBGWC4T3Y5 tag=KSBKAHHDM4TZ type=del size=3101098: (22) Invalid argument 2024-09-19T11:43:17.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.362+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~GDRJCT3BD3ZU.0 size=1048576 2024-09-19T11:43:17.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.366+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~GDRJCT3BD3ZU.1 size=1048576 2024-09-19T11:43:17.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.366+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~GDRJCT3BD3ZU.2 size=860533 2024-09-19T11:43:17.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.366+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=GDRJCT3BD3ZU tag=Z2I7SRK22MCG type=write size=4006261 2024-09-19T11:43:17.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.374+0000 7f3d831968c0 1 < suggested update operation key=QPG75T46BH38 tag=U66CEB558OYU type=del size=779166 2024-09-19T11:43:17.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.378+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~ZW0KZQIQU4IR.0 size=229999 2024-09-19T11:43:17.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.378+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=ZW0KZQIQU4IR tag=GSYGHLPJOO6T type=write size=1278575 2024-09-19T11:43:17.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.382+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~BZSLVTV8DU3K.0 size=1048576 2024-09-19T11:43:17.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.386+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~BZSLVTV8DU3K.1 size=652937 2024-09-19T11:43:17.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.390+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=BZSLVTV8DU3K tag=AI72KB8091K5 type=write size=2750089 2024-09-19T11:43:17.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.398+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~BJG4IJQ9UJ6Q.0 size=1048576 2024-09-19T11:43:17.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.402+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~BJG4IJQ9UJ6Q.1 size=485698 2024-09-19T11:43:17.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.402+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=BJG4IJQ9UJ6Q tag=51D8FRJKPR8A type=write size=2582850 2024-09-19T11:43:17.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.406+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~4SFJWKNNCVE2.0 size=1048576 2024-09-19T11:43:17.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.406+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~4SFJWKNNCVE2.1 size=1048576 2024-09-19T11:43:17.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.410+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~4SFJWKNNCVE2.2 size=1040973 2024-09-19T11:43:17.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.418+0000 7f3d831968c0 1 < completed multipart upload key=4V17CRW6EB65 upload=4SFJWKNNCVE2 tag=V2Q2GTPEX1JS type=write size=4186701 2024-09-19T11:43:17.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.418+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=JSBE1HJ7HGW6 type=del size=3463864 2024-09-19T11:43:17.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.422+0000 7f3d831968c0 1 < completed write operation key=3GD7UZCI3WX4 tag=IBQZW28O4HTT type=write size=90399 2024-09-19T11:43:17.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.430+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~3CSRP6XT6JN2.0 size=1048576 2024-09-19T11:43:17.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.434+0000 7f3d831968c0 1 > prepared part key=_multipart_6NLQ0BK8AJUO.2~3CSRP6XT6JN2.1 size=212414 2024-09-19T11:43:17.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.434+0000 7f3d831968c0 1 > prepared multipart upload key=6NLQ0BK8AJUO upload=3CSRP6XT6JN2 tag=BE81X9GQZ27P type=write size=2309566 2024-09-19T11:43:17.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.434+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=WSG1UPEAK3GY type=del 2024-09-19T11:43:17.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.438+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=WSQKJ0R0ULPJ type=del size=3287602 2024-09-19T11:43:17.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.442+0000 7f3d831968c0 1 < canceled part key=_multipart_66N4QS1R70Z7.2~TN3VOXINCG2X.0 size=849067 2024-09-19T11:43:17.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.446+0000 7f3d831968c0 1 < canceled multipart upload key=66N4QS1R70Z7 upload=TN3VOXINCG2X tag=7YHMN59S64RF type=write size=1897643 2024-09-19T11:43:17.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.450+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=47UONN28IPF9 type=del size=992293 2024-09-19T11:43:17.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.454+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~0XP7PQ2FW21P.0 size=659622 2024-09-19T11:43:17.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.458+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=0XP7PQ2FW21P tag=NS73ARIYN7GP type=write size=1708198 2024-09-19T11:43:17.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.462+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=OSDMPFYR4KL4 type=del size=2764208 2024-09-19T11:43:17.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.466+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=S42MOCTIC38Q type=del 2024-09-19T11:43:17.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.470+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~PNTW7RVJ6Z9J.0 size=1048576 2024-09-19T11:43:17.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.474+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~PNTW7RVJ6Z9J.1 size=1048576 2024-09-19T11:43:17.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.474+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~PNTW7RVJ6Z9J.2 size=553627 2024-09-19T11:43:17.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.474+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=PNTW7RVJ6Z9J tag=93KB191CBJQT type=write size=3699355 2024-09-19T11:43:17.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.478+0000 7f3d831968c0 1 < completed delete operation key=5RTONAWGYJNE tag=X70FRX3GGLTG type=del 2024-09-19T11:43:17.485 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.482+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=M9MV4FBOATVV type=del size=459842 2024-09-19T11:43:17.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.486+0000 7f3d831968c0 1 < canceled operation key=JV7EGEI6062Y tag=1MIVYWNXWVU3 type=del size=1115235 2024-09-19T11:43:17.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.490+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~DBMEG8NHJY6X.0 size=1048576 2024-09-19T11:43:17.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.490+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~DBMEG8NHJY6X.1 size=1048576 2024-09-19T11:43:17.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.494+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~DBMEG8NHJY6X.2 size=531118 2024-09-19T11:43:17.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.494+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=DBMEG8NHJY6X tag=PI6YIT16LC85 type=write size=3676846 2024-09-19T11:43:17.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.498+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=VKOETSBPNJ3P type=del 2024-09-19T11:43:17.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.502+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~5RS5Q79C142B.0 size=1048576 2024-09-19T11:43:17.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.506+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~5RS5Q79C142B.1 size=1048576 2024-09-19T11:43:17.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.506+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~5RS5Q79C142B.2 size=12974 2024-09-19T11:43:17.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.506+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=5RS5Q79C142B tag=0M1PR1R76X5Q type=write size=3158702 2024-09-19T11:43:17.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.510+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~RSKZ9C9GWDPG.0 size=1048576 2024-09-19T11:43:17.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.514+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~RSKZ9C9GWDPG.1 size=131152 2024-09-19T11:43:17.521 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.518+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=RSKZ9C9GWDPG tag=Q9GAQEPBXJTT type=write size=2228304 2024-09-19T11:43:17.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.522+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~BS973WAAYT44.0 size=1048576 2024-09-19T11:43:17.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.526+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~BS973WAAYT44.1 size=1048576 2024-09-19T11:43:17.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.526+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~BS973WAAYT44.2 size=335821 2024-09-19T11:43:17.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.526+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=BS973WAAYT44 tag=VHUNUV25GG1H type=write size=3481549 2024-09-19T11:43:17.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.530+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=MW2KNBHP410K type=del 2024-09-19T11:43:17.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.538+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~TBHI4NMQ2HQY.0 size=1048576 2024-09-19T11:43:17.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.538+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~TBHI4NMQ2HQY.1 size=1048576 2024-09-19T11:43:17.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.542+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~TBHI4NMQ2HQY.2 size=938687 2024-09-19T11:43:17.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.542+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=TBHI4NMQ2HQY tag=OTY7C2Z0JTL6 type=write size=4084415 2024-09-19T11:43:17.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.546+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=5390B6WUOVP0 type=del 2024-09-19T11:43:17.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.550+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=HQ1R8M7Q4RJG type=del size=3402664 2024-09-19T11:43:17.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.554+0000 7f3d831968c0 1 < suggested update operation key=UI7EVZ1SGD8R tag=4FLNUQMQKN8D type=del size=1228888 2024-09-19T11:43:17.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.558+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=OOL9PUCV1KWA type=del size=3204163 2024-09-19T11:43:17.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.562+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~GDRJCT3BD3ZU.0 size=1048576 2024-09-19T11:43:17.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.566+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~GDRJCT3BD3ZU.1 size=1048576 2024-09-19T11:43:17.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.566+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~GDRJCT3BD3ZU.2 size=860533 2024-09-19T11:43:17.578 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.574+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=GDRJCT3BD3ZU tag=Z2I7SRK22MCG type=write size=4006261 2024-09-19T11:43:17.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.578+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~2PI751E5YC18.0 size=1048576 2024-09-19T11:43:17.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.582+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~2PI751E5YC18.1 size=1048576 2024-09-19T11:43:17.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.582+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~2PI751E5YC18.2 size=2955 2024-09-19T11:43:17.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.582+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=2PI751E5YC18 tag=VJBMS2CMHE3W type=write size=3148683 2024-09-19T11:43:17.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.586+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~ZW0KZQIQU4IR.0 size=229999 2024-09-19T11:43:17.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.594+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=ZW0KZQIQU4IR tag=GSYGHLPJOO6T type=write size=1278575 2024-09-19T11:43:17.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.594+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=C6HWRHDBC5VS type=write size=803017 2024-09-19T11:43:17.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.606+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~BJG4IJQ9UJ6Q.0 size=1048576 2024-09-19T11:43:17.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.606+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~BJG4IJQ9UJ6Q.1 size=485698 2024-09-19T11:43:17.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.614+0000 7f3d831968c0 1 < completed multipart upload key=QPG75T46BH38 upload=BJG4IJQ9UJ6Q tag=51D8FRJKPR8A type=write size=2582850 2024-09-19T11:43:17.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.614+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=MIXSPQJ03EZK type=write size=70598 2024-09-19T11:43:17.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.618+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=JSBE1HJ7HGW6 type=del 2024-09-19T11:43:17.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.622+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=7ZGJUQ6JUX0J type=del size=2680887 2024-09-19T11:43:17.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.626+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~3CSRP6XT6JN2.0 size=1048576 2024-09-19T11:43:17.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.630+0000 7f3d831968c0 1 < completed part key=_multipart_6NLQ0BK8AJUO.2~3CSRP6XT6JN2.1 size=212414 2024-09-19T11:43:17.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.634+0000 7f3d831968c0 1 < completed multipart upload key=6NLQ0BK8AJUO upload=3CSRP6XT6JN2 tag=BE81X9GQZ27P type=write size=2309566 2024-09-19T11:43:17.643 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.638+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~04DEM0NG21YL.0 size=1048576 2024-09-19T11:43:17.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.642+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~04DEM0NG21YL.1 size=622157 2024-09-19T11:43:17.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.642+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=04DEM0NG21YL tag=PZ8RU7KU70XK type=write size=2719309 2024-09-19T11:43:17.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.646+0000 7f3d831968c0 1 < suggested remove operation key=3GD7UZCI3WX4 tag=WSQKJ0R0ULPJ type=del 2024-09-19T11:43:17.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.650+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~NVVH29XGZIKA.0 size=533560 2024-09-19T11:43:17.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.650+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=NVVH29XGZIKA tag=48UGBAER21N3 type=write size=1582136 2024-09-19T11:43:17.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.654+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=47UONN28IPF9 type=del 2024-09-19T11:43:17.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.658+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~5YCFUTUBL4B2.0 size=1048576 2024-09-19T11:43:17.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.662+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~5YCFUTUBL4B2.1 size=410349 2024-09-19T11:43:17.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.662+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=5YCFUTUBL4B2 tag=ECN8NKUWLVJA type=write size=2507501 2024-09-19T11:43:17.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.666+0000 7f3d831968c0 1 < suggested update operation key=CULXGFLZ0HI6 tag=OSDMPFYR4KL4 type=del size=2764208 2024-09-19T11:43:17.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.670+0000 7f3d831968c0 1 > prepared part key=_multipart_G4P6HIOM1G2E.2~X72L4JXRLWE7.0 size=368547 2024-09-19T11:43:17.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.670+0000 7f3d831968c0 1 > prepared multipart upload key=G4P6HIOM1G2E upload=X72L4JXRLWE7 tag=2AKE18QIKC5H type=write size=1417123 2024-09-19T11:43:17.678 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.674+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~PNTW7RVJ6Z9J.0 size=1048576 2024-09-19T11:43:17.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.678+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~PNTW7RVJ6Z9J.1 size=1048576 2024-09-19T11:43:17.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.678+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~PNTW7RVJ6Z9J.2 size=553627 2024-09-19T11:43:17.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.682+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=PNTW7RVJ6Z9J tag=93KB191CBJQT type=write size=3699355 2024-09-19T11:43:17.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.686+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=67GP5P43RL6Z type=del size=3044401 2024-09-19T11:43:17.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.690+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=M9MV4FBOATVV type=del 2024-09-19T11:43:17.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.690+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=87XQV8R1OF18 type=del size=1252949 2024-09-19T11:43:17.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.694+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~DBMEG8NHJY6X.0 size=1048576 2024-09-19T11:43:17.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.698+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~DBMEG8NHJY6X.1 size=1048576 2024-09-19T11:43:17.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.698+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~DBMEG8NHJY6X.2 size=531118 2024-09-19T11:43:17.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.702+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=DBMEG8NHJY6X tag=PI6YIT16LC85 type=write size=3676846 2024-09-19T11:43:17.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.706+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=NNB56QB3VI6H type=del size=1311812 2024-09-19T11:43:17.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.710+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~5RS5Q79C142B.0 size=1048576 2024-09-19T11:43:17.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.710+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~5RS5Q79C142B.1 size=1048576 2024-09-19T11:43:17.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.710+0000 7f3d831968c0 1 < canceled part key=_multipart_8FGIZJIY58C7.2~5RS5Q79C142B.2 size=12974 2024-09-19T11:43:17.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.714+0000 7f3d831968c0 1 < canceled multipart upload key=8FGIZJIY58C7 upload=5RS5Q79C142B tag=0M1PR1R76X5Q type=write size=3158702 2024-09-19T11:43:17.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.718+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=YCIIMW2CRMDW type=del size=2898006 2024-09-19T11:43:17.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.722+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~BS973WAAYT44.0 size=1048576 2024-09-19T11:43:17.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.722+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~BS973WAAYT44.1 size=1048576 2024-09-19T11:43:17.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.726+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~BS973WAAYT44.2 size=335821 2024-09-19T11:43:17.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.730+0000 7f3d831968c0 1 < completed multipart upload key=76JFMPOUJZXW upload=BS973WAAYT44 tag=VHUNUV25GG1H type=write size=3481549 2024-09-19T11:43:17.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.734+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=80NQ2EFGCX7S type=del size=194404 2024-09-19T11:43:17.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.738+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~TBHI4NMQ2HQY.0 size=1048576 2024-09-19T11:43:17.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.738+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~TBHI4NMQ2HQY.1 size=1048576 2024-09-19T11:43:17.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.742+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~TBHI4NMQ2HQY.2 size=938687 2024-09-19T11:43:17.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.746+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=TBHI4NMQ2HQY tag=OTY7C2Z0JTL6 type=write size=4084415 2024-09-19T11:43:17.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.750+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=4SJ5DID2B2C6 type=del size=3892968 2024-09-19T11:43:17.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.750+0000 7f3d831968c0 1 < canceled operation key=3QWBQYLI0SJR tag=HQ1R8M7Q4RJG type=del size=3402664 2024-09-19T11:43:17.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.758+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~882QWI7514GH.0 size=208095 2024-09-19T11:43:17.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.758+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=882QWI7514GH tag=0PFFIIEW9VU2 type=write size=1256671 2024-09-19T11:43:17.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.758+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=OOL9PUCV1KWA type=del 2024-09-19T11:43:17.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.766+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~YQV6JDZ3VRKH.0 size=1048576 2024-09-19T11:43:17.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.766+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~YQV6JDZ3VRKH.1 size=292803 2024-09-19T11:43:17.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.766+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=YQV6JDZ3VRKH tag=GBSFEDJ1I9RO type=write size=2389955 2024-09-19T11:43:17.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.770+0000 7f3d831968c0 1 < canceled part key=_multipart_0OOB2SNLVK8E.2~2PI751E5YC18.0 size=1048576 2024-09-19T11:43:17.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.770+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~2PI751E5YC18.1 size=1048576 2024-09-19T11:43:17.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.774+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~2PI751E5YC18.2 size=2955 2024-09-19T11:43:17.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.778+0000 7f3d831968c0 1 < canceled multipart upload key=0OOB2SNLVK8E upload=2PI751E5YC18 tag=VJBMS2CMHE3W type=write size=3148683 2024-09-19T11:43:17.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.782+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~1HHSHQNTIPVW.0 size=1048576 2024-09-19T11:43:17.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.786+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~1HHSHQNTIPVW.1 size=1048576 2024-09-19T11:43:17.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.790+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~1HHSHQNTIPVW.2 size=857041 2024-09-19T11:43:17.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.790+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=1HHSHQNTIPVW tag=IRVAMXFZ3E4J type=write size=4002769 2024-09-19T11:43:17.798 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.794+0000 7f3d831968c0 1 < suggested update operation key=CULXGFLZ0HI6 tag=C6HWRHDBC5VS type=write size=803017 2024-09-19T11:43:17.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.798+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=9ANPLTD14FX2 type=del size=600489 2024-09-19T11:43:17.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.798+0000 7f3d831968c0 1 < completed write operation key=FKLL38ZNCJ21 tag=MIXSPQJ03EZK type=write size=70598 2024-09-19T11:43:17.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.802+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=XX8I2AW415JL type=del size=2537582 2024-09-19T11:43:17.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.806+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=7ZGJUQ6JUX0J type=del 2024-09-19T11:43:17.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.810+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=M2OEFMBCUZZI type=del size=3178927 2024-09-19T11:43:17.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.810+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~04DEM0NG21YL.0 size=1048576 2024-09-19T11:43:17.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.814+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~04DEM0NG21YL.1 size=622157 2024-09-19T11:43:17.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.818+0000 7f3d831968c0 1 < completed multipart upload key=EVFF0F0760OS upload=04DEM0NG21YL tag=PZ8RU7KU70XK type=write size=2719309 2024-09-19T11:43:17.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.822+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~GUQ9RUDHVBNI.0 size=1048576 2024-09-19T11:43:17.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.826+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~GUQ9RUDHVBNI.1 size=1048576 2024-09-19T11:43:17.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.826+0000 7f3d831968c0 1 > prepared part key=_multipart_3K8P37C015G3.2~GUQ9RUDHVBNI.2 size=741181 2024-09-19T11:43:17.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.826+0000 7f3d831968c0 1 > prepared multipart upload key=3K8P37C015G3 upload=GUQ9RUDHVBNI tag=RGZCVZN8ADWW type=write size=3886909 2024-09-19T11:43:17.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.830+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~NVVH29XGZIKA.0 size=533560 2024-09-19T11:43:17.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.834+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=NVVH29XGZIKA tag=48UGBAER21N3 type=write size=1582136 2024-09-19T11:43:17.840 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.838+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=X1U96RS94QJC type=del size=4055078 2024-09-19T11:43:17.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.838+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~5YCFUTUBL4B2.0 size=1048576 2024-09-19T11:43:17.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.842+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~5YCFUTUBL4B2.1 size=410349 2024-09-19T11:43:17.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.846+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=5YCFUTUBL4B2 tag=ECN8NKUWLVJA type=write size=2507501 2024-09-19T11:43:17.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.850+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=2I0RZZ7GE7CD type=del size=193142 2024-09-19T11:43:17.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.850+0000 7f3d831968c0 1 < completed part key=_multipart_G4P6HIOM1G2E.2~X72L4JXRLWE7.0 size=368547 2024-09-19T11:43:17.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.854+0000 7f3d831968c0 1 < completed multipart upload key=G4P6HIOM1G2E upload=X72L4JXRLWE7 tag=2AKE18QIKC5H type=write size=1417123 2024-09-19T11:43:17.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.858+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=X5L01326JVS6 type=del size=2767250 2024-09-19T11:43:17.868 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.866+0000 7f3d831968c0 1 < completed delete operation key=E8OFSMUZHR02 tag=67GP5P43RL6Z type=del 2024-09-19T11:43:17.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.866+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=TBA0CXXD61TT type=del size=1197958 2024-09-19T11:43:17.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.870+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=87XQV8R1OF18 type=del 2024-09-19T11:43:17.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.874+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=MFJHZF773M1U type=del size=1106271 2024-09-19T11:43:17.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.878+0000 7f3d831968c0 1 < suggested remove operation key=3QWBQYLI0SJR tag=NNB56QB3VI6H type=del 2024-09-19T11:43:17.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.882+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=GSA056P29UKH type=write size=587398 2024-09-19T11:43:17.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.886+0000 7f3d831968c0 1 < suggested update operation key=3GD7UZCI3WX4 tag=YCIIMW2CRMDW type=del size=2898006 2024-09-19T11:43:17.893 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.890+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=3YNYULZID2T0 type=del size=78910 2024-09-19T11:43:17.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.890+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=80NQ2EFGCX7S type=del 2024-09-19T11:43:17.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.898+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~X0MA0P7P6BZ6.0 size=1048576 2024-09-19T11:43:17.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.898+0000 7f3d831968c0 1 > prepared part key=_multipart_2VJRZVU7S8LB.2~X0MA0P7P6BZ6.1 size=551664 2024-09-19T11:43:17.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.898+0000 7f3d831968c0 1 > prepared multipart upload key=2VJRZVU7S8LB upload=X0MA0P7P6BZ6 tag=OQ0D3BYFC2IQ type=write size=2648816 2024-09-19T11:43:17.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.902+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=4SJ5DID2B2C6 type=del 2024-09-19T11:43:17.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.906+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=8CZI2LHDBE41 type=del size=1804429 2024-09-19T11:43:17.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.910+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~882QWI7514GH.0 size=208095 2024-09-19T11:43:17.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.914+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=882QWI7514GH tag=0PFFIIEW9VU2 type=write size=1256671 2024-09-19T11:43:17.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.918+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~5PEX3YENH6H1.0 size=1048576 2024-09-19T11:43:17.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.918+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~5PEX3YENH6H1.1 size=1048576 2024-09-19T11:43:17.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.922+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~5PEX3YENH6H1.2 size=1044847 2024-09-19T11:43:17.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.922+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=5PEX3YENH6H1 tag=PEKY7IMS6KQR type=write size=4190575 2024-09-19T11:43:17.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.926+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~YQV6JDZ3VRKH.0 size=1048576 2024-09-19T11:43:17.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.926+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~YQV6JDZ3VRKH.1 size=292803 2024-09-19T11:43:17.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.930+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=YQV6JDZ3VRKH tag=GBSFEDJ1I9RO type=write size=2389955 2024-09-19T11:43:17.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.938+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~XGDKT0MZ5U18.0 size=684643 2024-09-19T11:43:17.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.938+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=XGDKT0MZ5U18 tag=6902LAWOL2YQ type=write size=1733219 2024-09-19T11:43:17.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.938+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~1HHSHQNTIPVW.0 size=1048576 2024-09-19T11:43:17.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.938+0000 7f3d831968c0 1 < canceled part key=_multipart_2VJRZVU7S8LB.2~1HHSHQNTIPVW.1 size=1048576 2024-09-19T11:43:17.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.942+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~1HHSHQNTIPVW.2 size=857041 2024-09-19T11:43:17.950 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.946+0000 7f3d831968c0 1 < canceled multipart upload key=2VJRZVU7S8LB upload=1HHSHQNTIPVW tag=IRVAMXFZ3E4J type=write size=4002769 2024-09-19T11:43:17.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.950+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~NK70J38F99XW.0 size=1048576 2024-09-19T11:43:17.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.954+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~NK70J38F99XW.1 size=701583 2024-09-19T11:43:17.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.954+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=NK70J38F99XW tag=1BX6Y40XOZ24 type=write size=2798735 2024-09-19T11:43:17.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.958+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=9ANPLTD14FX2 type=del 2024-09-19T11:43:17.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.958+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=GL51EHTD0F0A type=write size=637089 2024-09-19T11:43:17.966 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.962+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=XX8I2AW415JL type=del 2024-09-19T11:43:17.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.966+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=D0OPPDXTG6D8 type=del size=3712488 2024-09-19T11:43:17.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.970+0000 7f3d831968c0 1 < suggested remove operation key=3QWBQYLI0SJR tag=M2OEFMBCUZZI type=del 2024-09-19T11:43:17.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.974+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~1XZ3A0QML21V.0 size=1048576 2024-09-19T11:43:17.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.978+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~1XZ3A0QML21V.1 size=880121 2024-09-19T11:43:17.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.978+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=1XZ3A0QML21V tag=1IVJ2XLFKLN7 type=write size=2977273 2024-09-19T11:43:17.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.978+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~GUQ9RUDHVBNI.0 size=1048576 2024-09-19T11:43:17.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.982+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~GUQ9RUDHVBNI.1 size=1048576 2024-09-19T11:43:17.988 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.982+0000 7f3d831968c0 1 < completed part key=_multipart_3K8P37C015G3.2~GUQ9RUDHVBNI.2 size=741181 2024-09-19T11:43:17.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.990+0000 7f3d831968c0 1 < completed multipart upload key=3K8P37C015G3 upload=GUQ9RUDHVBNI tag=RGZCVZN8ADWW type=write size=3886909 2024-09-19T11:43:17.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.990+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=O3IE79U08XY4 type=del size=3644905 2024-09-19T11:43:17.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.994+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=X1U96RS94QJC type=del 2024-09-19T11:43:18.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.998+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=99EH9LGM2NW1 type=write size=720528 2024-09-19T11:43:18.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:17.998+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=2I0RZZ7GE7CD type=del 2024-09-19T11:43:18.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.002+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=4QXEM3D3UIFQ type=del size=3016915 2024-09-19T11:43:18.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.006+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=X5L01326JVS6 type=del 2024-09-19T11:43:18.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.010+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~JBUTZK1DHRFP.0 size=1048576 2024-09-19T11:43:18.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.014+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~JBUTZK1DHRFP.1 size=1048576 2024-09-19T11:43:18.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.014+0000 7f3d831968c0 1 > prepared part key=_multipart_3QWBQYLI0SJR.2~JBUTZK1DHRFP.2 size=171662 2024-09-19T11:43:18.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.014+0000 7f3d831968c0 1 > prepared multipart upload key=3QWBQYLI0SJR upload=JBUTZK1DHRFP tag=2Z3D4DHUIOYP type=write size=3317390 2024-09-19T11:43:18.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.022+0000 7f3d831968c0 1 < suggested update operation key=Y3LO4H9RI4X0 tag=TBA0CXXD61TT type=del size=1197958 2024-09-19T11:43:18.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.030+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~TDWPY5V93P0E.0 size=1048576 2024-09-19T11:43:18.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.030+0000 7f3d831968c0 1 > prepared part key=_multipart_4I8BY4YYTRT0.2~TDWPY5V93P0E.1 size=180273 2024-09-19T11:43:18.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.030+0000 7f3d831968c0 1 > prepared multipart upload key=4I8BY4YYTRT0 upload=TDWPY5V93P0E tag=I6ZJRUDC95HN type=write size=2277425 2024-09-19T11:43:18.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.034+0000 7f3d831968c0 1 < canceled operation key=EVFF0F0760OS tag=MFJHZF773M1U type=del size=1106271 2024-09-19T11:43:18.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.038+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=K3S96XM31UTS type=del size=3920457 2024-09-19T11:43:18.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.042+0000 7f3d831968c0 1 < completed write operation key=8104Z4OQ7UWQ tag=GSA056P29UKH type=write size=587398 2024-09-19T11:43:18.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.046+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=EW582GE7CR1Q type=del size=2034029 2024-09-19T11:43:18.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.050+0000 7f3d831968c0 1 < completed delete operation key=JV7EGEI6062Y tag=3YNYULZID2T0 type=del 2024-09-19T11:43:18.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.054+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=65N6IS0F21LB type=write size=847815 2024-09-19T11:43:18.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.054+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~X0MA0P7P6BZ6.0 size=1048576 2024-09-19T11:43:18.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.058+0000 7f3d831968c0 1 < completed part key=_multipart_2VJRZVU7S8LB.2~X0MA0P7P6BZ6.1 size=551664 2024-09-19T11:43:18.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.062+0000 7f3d831968c0 1 < completed multipart upload key=2VJRZVU7S8LB upload=X0MA0P7P6BZ6 tag=OQ0D3BYFC2IQ type=write size=2648816 2024-09-19T11:43:18.071 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.066+0000 7f3d831968c0 1 > prepared operation key=FZGRZ06MOHBI tag=2S9NY7DB5WA2 type=del size=2484780 2024-09-19T11:43:18.075 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.070+0000 7f3d831968c0 -1 < failed to complete operation key=3QWBQYLI0SJR tag=8CZI2LHDBE41 type=del size=1804429: (22) Invalid argument 2024-09-19T11:43:18.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.074+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=Y5D502Z22OTF type=write size=930751 2024-09-19T11:43:18.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.078+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~5PEX3YENH6H1.0 size=1048576 2024-09-19T11:43:18.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.082+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~5PEX3YENH6H1.1 size=1048576 2024-09-19T11:43:18.087 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.082+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~5PEX3YENH6H1.2 size=1044847 2024-09-19T11:43:18.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.090+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=5PEX3YENH6H1 tag=PEKY7IMS6KQR type=write size=4190575 2024-09-19T11:43:18.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.094+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=4GTBM4M2QS2D type=del size=544105 2024-09-19T11:43:18.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.094+0000 7f3d831968c0 1 < canceled part key=_multipart_00DYD22W0ZNB.2~XGDKT0MZ5U18.0 size=684643 2024-09-19T11:43:18.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.098+0000 7f3d831968c0 1 < canceled multipart upload key=00DYD22W0ZNB upload=XGDKT0MZ5U18 tag=6902LAWOL2YQ type=write size=1733219 2024-09-19T11:43:18.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.102+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=YJTPGJQY1HAE type=del size=1554052 2024-09-19T11:43:18.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.102+0000 7f3d831968c0 1 < canceled part key=_multipart_0OOB2SNLVK8E.2~NK70J38F99XW.0 size=1048576 2024-09-19T11:43:18.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.106+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~NK70J38F99XW.1 size=701583 2024-09-19T11:43:18.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.110+0000 7f3d831968c0 1 < canceled multipart upload key=0OOB2SNLVK8E upload=NK70J38F99XW tag=1BX6Y40XOZ24 type=write size=2798735 2024-09-19T11:43:18.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.114+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=LM3FH49LWCV7 type=write size=213389 2024-09-19T11:43:18.120 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.118+0000 7f3d831968c0 1 < completed write operation key=EVFF0F0760OS tag=GL51EHTD0F0A type=write size=637089 2024-09-19T11:43:18.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.122+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~UE6012ZUE3NF.0 size=494866 2024-09-19T11:43:18.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.122+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=UE6012ZUE3NF tag=VB7TPH1I60M0 type=write size=1543442 2024-09-19T11:43:18.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.126+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=D0OPPDXTG6D8 type=del 2024-09-19T11:43:18.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.126+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=8NBEWNUAAZI5 type=write size=118270 2024-09-19T11:43:18.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.130+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~1XZ3A0QML21V.0 size=1048576 2024-09-19T11:43:18.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.134+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~1XZ3A0QML21V.1 size=880121 2024-09-19T11:43:18.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.138+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=1XZ3A0QML21V tag=1IVJ2XLFKLN7 type=write size=2977273 2024-09-19T11:43:18.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.146+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=BVFTMY4PGPXC type=del size=894668 2024-09-19T11:43:18.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.146+0000 7f3d831968c0 1 < canceled operation key=KAPKNZJ2DE6A tag=O3IE79U08XY4 type=del size=3644905 2024-09-19T11:43:18.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.150+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=DPELUHC28QYK type=del size=1717045 2024-09-19T11:43:18.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.154+0000 7f3d831968c0 1 < completed write operation key=JV7EGEI6062Y tag=99EH9LGM2NW1 type=write size=720528 2024-09-19T11:43:18.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.158+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=DMQFPDUBPVXW type=del size=1588003 2024-09-19T11:43:18.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.158+0000 7f3d831968c0 1 < completed delete operation key=3K8P37C015G3 tag=4QXEM3D3UIFQ type=del 2024-09-19T11:43:18.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.162+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=SJ01ASMIVJG7 type=del size=3190546 2024-09-19T11:43:18.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.166+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~JBUTZK1DHRFP.0 size=1048576 2024-09-19T11:43:18.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.170+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~JBUTZK1DHRFP.1 size=1048576 2024-09-19T11:43:18.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.170+0000 7f3d831968c0 1 < completed part key=_multipart_3QWBQYLI0SJR.2~JBUTZK1DHRFP.2 size=171662 2024-09-19T11:43:18.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.178+0000 7f3d831968c0 1 < completed multipart upload key=3QWBQYLI0SJR upload=JBUTZK1DHRFP tag=2Z3D4DHUIOYP type=write size=3317390 2024-09-19T11:43:18.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.182+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=17AORSH6ZJQM type=del size=2575584 2024-09-19T11:43:18.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.182+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~TDWPY5V93P0E.0 size=1048576 2024-09-19T11:43:18.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.186+0000 7f3d831968c0 1 < completed part key=_multipart_4I8BY4YYTRT0.2~TDWPY5V93P0E.1 size=180273 2024-09-19T11:43:18.196 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.190+0000 7f3d831968c0 1 < completed multipart upload key=4I8BY4YYTRT0 upload=TDWPY5V93P0E tag=I6ZJRUDC95HN type=write size=2277425 2024-09-19T11:43:18.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.194+0000 7f3d831968c0 1 > prepared operation key=4V17CRW6EB65 tag=5ZK3FI99G1H5 type=del size=2483812 2024-09-19T11:43:18.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.198+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=K3S96XM31UTS type=del 2024-09-19T11:43:18.207 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.202+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~8LOEXE8YZMD3.0 size=1048576 2024-09-19T11:43:18.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.206+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~8LOEXE8YZMD3.1 size=1048576 2024-09-19T11:43:18.212 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.210+0000 7f3d831968c0 1 > prepared part key=_multipart_FZGRZ06MOHBI.2~8LOEXE8YZMD3.2 size=392843 2024-09-19T11:43:18.212 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.210+0000 7f3d831968c0 1 > prepared multipart upload key=FZGRZ06MOHBI upload=8LOEXE8YZMD3 tag=7YDDULZAZM72 type=write size=3538571 2024-09-19T11:43:18.216 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.210+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=EW582GE7CR1Q type=del 2024-09-19T11:43:18.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.214+0000 7f3d831968c0 1 > prepared operation key=FKLL38ZNCJ21 tag=PNGVFPFVHX22 type=write size=691789 2024-09-19T11:43:18.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.218+0000 7f3d831968c0 1 < completed write operation key=8104Z4OQ7UWQ tag=65N6IS0F21LB type=write size=847815 2024-09-19T11:43:18.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.222+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~N02I9EJWDPI1.0 size=1048576 2024-09-19T11:43:18.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.226+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~N02I9EJWDPI1.1 size=1048576 2024-09-19T11:43:18.233 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.230+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~N02I9EJWDPI1.2 size=752008 2024-09-19T11:43:18.233 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.230+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=N02I9EJWDPI1 tag=IUU2BKNPOI4T type=write size=3897736 2024-09-19T11:43:18.239 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.234+0000 7f3d831968c0 1 < suggested update operation key=FZGRZ06MOHBI tag=2S9NY7DB5WA2 type=del size=2484780 2024-09-19T11:43:18.242 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.238+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=51PN4UDUYZ75 type=del size=760637 2024-09-19T11:43:18.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.242+0000 7f3d831968c0 1 < completed write operation key=00DYD22W0ZNB tag=Y5D502Z22OTF type=write size=930751 2024-09-19T11:43:18.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.246+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~GNPMVBEJZ0MH.0 size=1048576 2024-09-19T11:43:18.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.250+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~GNPMVBEJZ0MH.1 size=1032963 2024-09-19T11:43:18.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.250+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=GNPMVBEJZ0MH tag=H8JSKBJZVIHZ type=write size=3130115 2024-09-19T11:43:18.260 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.258+0000 7f3d831968c0 1 < suggested update operation key=UI7EVZ1SGD8R tag=4GTBM4M2QS2D type=del size=544105 2024-09-19T11:43:18.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.262+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~TDSTOCW9POID.0 size=1048576 2024-09-19T11:43:18.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.266+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~TDSTOCW9POID.1 size=91386 2024-09-19T11:43:18.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.266+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=TDSTOCW9POID tag=53LG3F16NUQ6 type=write size=2188538 2024-09-19T11:43:18.272 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.270+0000 7f3d831968c0 1 < completed delete operation key=FKLL38ZNCJ21 tag=YJTPGJQY1HAE type=del 2024-09-19T11:43:18.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.270+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=Q305TT1JXCIX type=del size=2854096 2024-09-19T11:43:18.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.274+0000 7f3d831968c0 1 < completed write operation key=4I8BY4YYTRT0 tag=LM3FH49LWCV7 type=write size=213389 2024-09-19T11:43:18.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.278+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=0Q7ZZS2JRTVY type=write size=282341 2024-09-19T11:43:18.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.282+0000 7f3d831968c0 1 < completed part key=_multipart_UI7EVZ1SGD8R.2~UE6012ZUE3NF.0 size=494866 2024-09-19T11:43:18.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.286+0000 7f3d831968c0 1 < completed multipart upload key=UI7EVZ1SGD8R upload=UE6012ZUE3NF tag=VB7TPH1I60M0 type=write size=1543442 2024-09-19T11:43:18.292 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.286+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=AWYSTP3TM5QE type=write size=680855 2024-09-19T11:43:18.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.290+0000 7f3d831968c0 1 < completed write operation key=CULXGFLZ0HI6 tag=8NBEWNUAAZI5 type=write size=118270 2024-09-19T11:43:18.297 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.294+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=Z8T3Z3GSF2MH type=del size=3348625 2024-09-19T11:43:18.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.298+0000 7f3d831968c0 1 < canceled operation key=8104Z4OQ7UWQ tag=BVFTMY4PGPXC type=del size=894668 2024-09-19T11:43:18.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.298+0000 7f3d831968c0 1 > prepared operation key=E8OFSMUZHR02 tag=KWJ6FQWWNJUO type=write size=557330 2024-09-19T11:43:18.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.302+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=DPELUHC28QYK type=del 2024-09-19T11:43:18.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.310+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~RN8THJL7DIBG.0 size=1048576 2024-09-19T11:43:18.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.310+0000 7f3d831968c0 1 > prepared part key=_multipart_5RTONAWGYJNE.2~RN8THJL7DIBG.1 size=774364 2024-09-19T11:43:18.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.310+0000 7f3d831968c0 1 > prepared multipart upload key=5RTONAWGYJNE upload=RN8THJL7DIBG tag=PLDR2JBXMIZ7 type=write size=2871516 2024-09-19T11:43:18.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.314+0000 7f3d831968c0 1 < completed delete operation key=KAPKNZJ2DE6A tag=DMQFPDUBPVXW type=del 2024-09-19T11:43:18.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.322+0000 7f3d831968c0 1 > prepared part key=_multipart_8104Z4OQ7UWQ.2~0MYQMPHR1BCL.0 size=458541 2024-09-19T11:43:18.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.322+0000 7f3d831968c0 1 > prepared multipart upload key=8104Z4OQ7UWQ upload=0MYQMPHR1BCL tag=IE64QIMF88MZ type=write size=1507117 2024-09-19T11:43:18.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.322+0000 7f3d831968c0 -1 < failed to complete operation key=UI7EVZ1SGD8R tag=SJ01ASMIVJG7 type=del size=3190546: (22) Invalid argument 2024-09-19T11:43:18.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.326+0000 7f3d831968c0 1 > prepared operation key=0OOB2SNLVK8E tag=7HX6V9BR6MP9 type=del size=2338652 2024-09-19T11:43:18.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.330+0000 7f3d831968c0 1 < completed delete operation key=6NLQ0BK8AJUO tag=17AORSH6ZJQM type=del 2024-09-19T11:43:18.336 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.330+0000 7f3d831968c0 1 > prepared operation key=EVFF0F0760OS tag=0FDM4GCSKT39 type=write size=314164 2024-09-19T11:43:18.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.334+0000 7f3d831968c0 1 < completed delete operation key=4V17CRW6EB65 tag=5ZK3FI99G1H5 type=del 2024-09-19T11:43:18.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.338+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=49E2RFT5POE1 type=del size=2926002 2024-09-19T11:43:18.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.342+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~8LOEXE8YZMD3.0 size=1048576 2024-09-19T11:43:18.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.346+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~8LOEXE8YZMD3.1 size=1048576 2024-09-19T11:43:18.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.346+0000 7f3d831968c0 1 < completed part key=_multipart_FZGRZ06MOHBI.2~8LOEXE8YZMD3.2 size=392843 2024-09-19T11:43:18.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.354+0000 7f3d831968c0 1 < completed multipart upload key=FZGRZ06MOHBI upload=8LOEXE8YZMD3 tag=7YDDULZAZM72 type=write size=3538571 2024-09-19T11:43:18.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.358+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~PDUBC0XAW6GO.0 size=1048576 2024-09-19T11:43:18.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.362+0000 7f3d831968c0 1 > prepared part key=_multipart_KAPKNZJ2DE6A.2~PDUBC0XAW6GO.1 size=1035571 2024-09-19T11:43:18.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.362+0000 7f3d831968c0 1 > prepared multipart upload key=KAPKNZJ2DE6A upload=PDUBC0XAW6GO tag=UFGIA30IXTWU type=write size=3132723 2024-09-19T11:43:18.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.366+0000 7f3d831968c0 1 < completed write operation key=FKLL38ZNCJ21 tag=PNGVFPFVHX22 type=write size=691789 2024-09-19T11:43:18.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.370+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~M3PXR7MV7EZB.0 size=1048576 2024-09-19T11:43:18.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.374+0000 7f3d831968c0 1 > prepared part key=_multipart_I5XUMA2HKIR5.2~M3PXR7MV7EZB.1 size=282823 2024-09-19T11:43:18.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.374+0000 7f3d831968c0 1 > prepared multipart upload key=I5XUMA2HKIR5 upload=M3PXR7MV7EZB tag=ZHY1FWPTD5TJ type=write size=2379975 2024-09-19T11:43:18.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.378+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~N02I9EJWDPI1.0 size=1048576 2024-09-19T11:43:18.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.378+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~N02I9EJWDPI1.1 size=1048576 2024-09-19T11:43:18.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.382+0000 7f3d831968c0 1 < completed part key=_multipart_8FGIZJIY58C7.2~N02I9EJWDPI1.2 size=752008 2024-09-19T11:43:18.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.390+0000 7f3d831968c0 1 < completed multipart upload key=8FGIZJIY58C7 upload=N02I9EJWDPI1 tag=IUU2BKNPOI4T type=write size=3897736 2024-09-19T11:43:18.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.390+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=ITCT0W34QQ2J type=del size=2629201 2024-09-19T11:43:18.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.394+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=51PN4UDUYZ75 type=del 2024-09-19T11:43:18.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.398+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=2625N6JL65FJ type=write size=248765 2024-09-19T11:43:18.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.402+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~GNPMVBEJZ0MH.0 size=1048576 2024-09-19T11:43:18.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.406+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~GNPMVBEJZ0MH.1 size=1032963 2024-09-19T11:43:18.413 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.410+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=GNPMVBEJZ0MH tag=H8JSKBJZVIHZ type=write size=3130115 2024-09-19T11:43:18.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.410+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=Y2HZRN6YMCDP type=del size=565294 2024-09-19T11:43:18.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.414+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~TDSTOCW9POID.0 size=1048576 2024-09-19T11:43:18.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.418+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~TDSTOCW9POID.1 size=91386 2024-09-19T11:43:18.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.422+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=TDSTOCW9POID tag=53LG3F16NUQ6 type=write size=2188538 2024-09-19T11:43:18.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.426+0000 7f3d831968c0 1 > prepared operation key=76JFMPOUJZXW tag=3D3508D95JT0 type=del size=3202482 2024-09-19T11:43:18.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.430+0000 7f3d831968c0 1 < completed delete operation key=CULXGFLZ0HI6 tag=Q305TT1JXCIX type=del 2024-09-19T11:43:18.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.434+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~DS21KBKH7IY8.0 size=1048576 2024-09-19T11:43:18.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.438+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~DS21KBKH7IY8.1 size=1048576 2024-09-19T11:43:18.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.442+0000 7f3d831968c0 1 > prepared part key=_multipart_224HPC2Y95N6.2~DS21KBKH7IY8.2 size=641700 2024-09-19T11:43:18.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.442+0000 7f3d831968c0 1 > prepared multipart upload key=224HPC2Y95N6 upload=DS21KBKH7IY8 tag=4WQUVEEYIV3S type=write size=3787428 2024-09-19T11:43:18.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.442+0000 7f3d831968c0 1 < completed write operation key=76JFMPOUJZXW tag=0Q7ZZS2JRTVY type=write size=282341 2024-09-19T11:43:18.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.450+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~B30V5AMOY4GY.0 size=1048576 2024-09-19T11:43:18.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.450+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~B30V5AMOY4GY.1 size=1048576 2024-09-19T11:43:18.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.454+0000 7f3d831968c0 1 > prepared part key=_multipart_66N4QS1R70Z7.2~B30V5AMOY4GY.2 size=633500 2024-09-19T11:43:18.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.454+0000 7f3d831968c0 1 > prepared multipart upload key=66N4QS1R70Z7 upload=B30V5AMOY4GY tag=WTIE0KR7S4U5 type=write size=3779228 2024-09-19T11:43:18.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.458+0000 7f3d831968c0 1 < suggested update operation key=3GD7UZCI3WX4 tag=AWYSTP3TM5QE type=write size=680855 2024-09-19T11:43:18.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.462+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=KZCAX2J7KJ03 type=del size=1721951 2024-09-19T11:43:18.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.466+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=Z8T3Z3GSF2MH type=del 2024-09-19T11:43:18.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.470+0000 7f3d831968c0 1 > prepared operation key=3QWBQYLI0SJR tag=SAZF41FUOONC type=del size=3645449 2024-09-19T11:43:18.479 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.474+0000 7f3d831968c0 1 < suggested update operation key=E8OFSMUZHR02 tag=KWJ6FQWWNJUO type=write size=557330 2024-09-19T11:43:18.485 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.482+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~03NPIIRJM2O8.0 size=1048576 2024-09-19T11:43:18.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.486+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~03NPIIRJM2O8.1 size=1048576 2024-09-19T11:43:18.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.486+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~03NPIIRJM2O8.2 size=982349 2024-09-19T11:43:18.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.486+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=03NPIIRJM2O8 tag=4Q466K5A2R3O type=write size=4128077 2024-09-19T11:43:18.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.490+0000 7f3d831968c0 1 < completed part key=_multipart_5RTONAWGYJNE.2~RN8THJL7DIBG.0 size=1048576 2024-09-19T11:43:18.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.490+0000 7f3d831968c0 1 < canceled part key=_multipart_5RTONAWGYJNE.2~RN8THJL7DIBG.1 size=774364 2024-09-19T11:43:18.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.498+0000 7f3d831968c0 1 < canceled multipart upload key=5RTONAWGYJNE upload=RN8THJL7DIBG tag=PLDR2JBXMIZ7 type=write size=2871516 2024-09-19T11:43:18.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.498+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=XJ779GM658T0 type=del size=2176178 2024-09-19T11:43:18.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.502+0000 7f3d831968c0 1 < completed part key=_multipart_8104Z4OQ7UWQ.2~0MYQMPHR1BCL.0 size=458541 2024-09-19T11:43:18.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.510+0000 7f3d831968c0 1 < completed multipart upload key=8104Z4OQ7UWQ upload=0MYQMPHR1BCL tag=IE64QIMF88MZ type=write size=1507117 2024-09-19T11:43:18.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.514+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=P9J2ULMYJCW9 type=del size=3677554 2024-09-19T11:43:18.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.514+0000 7f3d831968c0 1 < completed delete operation key=0OOB2SNLVK8E tag=7HX6V9BR6MP9 type=del 2024-09-19T11:43:18.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.518+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=TNF2JFZ46HFZ type=del size=2527013 2024-09-19T11:43:18.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.526+0000 7f3d831968c0 1 < suggested remove operation key=EVFF0F0760OS tag=0FDM4GCSKT39 type=write 2024-09-19T11:43:18.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.530+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=CZ4P28Q0E92T type=del size=740608 2024-09-19T11:43:18.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.530+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=49E2RFT5POE1 type=del 2024-09-19T11:43:18.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.538+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~51IE3Y9F7VK4.0 size=1048576 2024-09-19T11:43:18.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.538+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~51IE3Y9F7VK4.1 size=1048576 2024-09-19T11:43:18.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.542+0000 7f3d831968c0 1 > prepared part key=_multipart_EVFF0F0760OS.2~51IE3Y9F7VK4.2 size=865331 2024-09-19T11:43:18.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.542+0000 7f3d831968c0 1 > prepared multipart upload key=EVFF0F0760OS upload=51IE3Y9F7VK4 tag=2W0LVUKI25GS type=write size=4011059 2024-09-19T11:43:18.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.546+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~PDUBC0XAW6GO.0 size=1048576 2024-09-19T11:43:18.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.550+0000 7f3d831968c0 1 < completed part key=_multipart_KAPKNZJ2DE6A.2~PDUBC0XAW6GO.1 size=1035571 2024-09-19T11:43:18.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.554+0000 7f3d831968c0 1 < completed multipart upload key=KAPKNZJ2DE6A upload=PDUBC0XAW6GO tag=UFGIA30IXTWU type=write size=3132723 2024-09-19T11:43:18.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.558+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=94ME2254024M type=del size=3736159 2024-09-19T11:43:18.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.562+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~M3PXR7MV7EZB.0 size=1048576 2024-09-19T11:43:18.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.562+0000 7f3d831968c0 1 < completed part key=_multipart_I5XUMA2HKIR5.2~M3PXR7MV7EZB.1 size=282823 2024-09-19T11:43:18.573 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.570+0000 7f3d831968c0 1 < completed multipart upload key=I5XUMA2HKIR5 upload=M3PXR7MV7EZB tag=ZHY1FWPTD5TJ type=write size=2379975 2024-09-19T11:43:18.577 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.574+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=PAGYMQ896HC3 type=del size=3897608 2024-09-19T11:43:18.580 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.578+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=ITCT0W34QQ2J type=del 2024-09-19T11:43:18.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.582+0000 7f3d831968c0 1 > prepared operation key=T9KJH2ZYCLVA tag=MT1QCW8IYVI1 type=del size=1218026 2024-09-19T11:43:18.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.586+0000 7f3d831968c0 1 < suggested remove operation key=00DYD22W0ZNB tag=2625N6JL65FJ type=write 2024-09-19T11:43:18.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.590+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=FV5TBY455KUS type=del size=2958778 2024-09-19T11:43:18.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.594+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=Y2HZRN6YMCDP type=del 2024-09-19T11:43:18.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.598+0000 7f3d831968c0 1 > prepared part key=_multipart_JV7EGEI6062Y.2~LPXSSZWARTFI.0 size=565549 2024-09-19T11:43:18.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.598+0000 7f3d831968c0 1 > prepared multipart upload key=JV7EGEI6062Y upload=LPXSSZWARTFI tag=FOSL3RDLW081 type=write size=1614125 2024-09-19T11:43:18.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.602+0000 7f3d831968c0 1 < completed delete operation key=76JFMPOUJZXW tag=3D3508D95JT0 type=del 2024-09-19T11:43:18.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.606+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=8JP9C30LIACF type=del size=599355 2024-09-19T11:43:18.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.610+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~DS21KBKH7IY8.0 size=1048576 2024-09-19T11:43:18.618 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.614+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~DS21KBKH7IY8.1 size=1048576 2024-09-19T11:43:18.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.618+0000 7f3d831968c0 1 < completed part key=_multipart_224HPC2Y95N6.2~DS21KBKH7IY8.2 size=641700 2024-09-19T11:43:18.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.622+0000 7f3d831968c0 1 < completed multipart upload key=224HPC2Y95N6 upload=DS21KBKH7IY8 tag=4WQUVEEYIV3S type=write size=3787428 2024-09-19T11:43:18.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.626+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=119L7KHVIEDH type=del size=1748463 2024-09-19T11:43:18.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.630+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~B30V5AMOY4GY.0 size=1048576 2024-09-19T11:43:18.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.634+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~B30V5AMOY4GY.1 size=1048576 2024-09-19T11:43:18.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.634+0000 7f3d831968c0 1 < completed part key=_multipart_66N4QS1R70Z7.2~B30V5AMOY4GY.2 size=633500 2024-09-19T11:43:18.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.642+0000 7f3d831968c0 1 < completed multipart upload key=66N4QS1R70Z7 upload=B30V5AMOY4GY tag=WTIE0KR7S4U5 type=write size=3779228 2024-09-19T11:43:18.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.642+0000 7f3d831968c0 1 > prepared operation key=UI7EVZ1SGD8R tag=FMJCYUTC6YZ1 type=del size=1636977 2024-09-19T11:43:18.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.646+0000 7f3d831968c0 -1 < failed to complete operation key=00DYD22W0ZNB tag=KZCAX2J7KJ03 type=del size=1721951: (22) Invalid argument 2024-09-19T11:43:18.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.654+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~AH2LSJWRVRRR.0 size=1048576 2024-09-19T11:43:18.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.658+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~AH2LSJWRVRRR.1 size=42773 2024-09-19T11:43:18.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.658+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=AH2LSJWRVRRR tag=31NDCWOCH3HN type=write size=2139925 2024-09-19T11:43:18.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.662+0000 7f3d831968c0 1 < suggested update operation key=3QWBQYLI0SJR tag=SAZF41FUOONC type=del size=3645449 2024-09-19T11:43:18.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.666+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=UGOWTKRTELAI type=del size=1073171 2024-09-19T11:43:18.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.670+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~03NPIIRJM2O8.0 size=1048576 2024-09-19T11:43:18.678 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.674+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~03NPIIRJM2O8.1 size=1048576 2024-09-19T11:43:18.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.678+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~03NPIIRJM2O8.2 size=982349 2024-09-19T11:43:18.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.682+0000 7f3d831968c0 1 < completed multipart upload key=FKLL38ZNCJ21 upload=03NPIIRJM2O8 tag=4Q466K5A2R3O type=write size=4128077 2024-09-19T11:43:18.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.686+0000 7f3d831968c0 1 > prepared operation key=QPG75T46BH38 tag=U0N3KLJNDFI3 type=del size=1765968 2024-09-19T11:43:18.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.690+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=XJ779GM658T0 type=del 2024-09-19T11:43:18.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.694+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=KNAIV0O3P5ON type=write size=54446 2024-09-19T11:43:18.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.698+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=P9J2ULMYJCW9 type=del 2024-09-19T11:43:18.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.702+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~ELZQ1AGR3R85.0 size=1048576 2024-09-19T11:43:18.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.702+0000 7f3d831968c0 1 > prepared part key=_multipart_JTPBGWC4T3Y5.2~ELZQ1AGR3R85.1 size=742574 2024-09-19T11:43:18.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.702+0000 7f3d831968c0 1 > prepared multipart upload key=JTPBGWC4T3Y5 upload=ELZQ1AGR3R85 tag=P1KV8DYUOQKO type=write size=2839726 2024-09-19T11:43:18.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.706+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=TNF2JFZ46HFZ type=del 2024-09-19T11:43:18.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.714+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~9I3BGJA7B4OF.0 size=1048576 2024-09-19T11:43:18.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.714+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~9I3BGJA7B4OF.1 size=1048576 2024-09-19T11:43:18.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.718+0000 7f3d831968c0 1 > prepared part key=_multipart_T9KJH2ZYCLVA.2~9I3BGJA7B4OF.2 size=600244 2024-09-19T11:43:18.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.718+0000 7f3d831968c0 1 > prepared multipart upload key=T9KJH2ZYCLVA upload=9I3BGJA7B4OF tag=QS10DVWQPIZP type=write size=3745972 2024-09-19T11:43:18.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.722+0000 7f3d831968c0 1 < suggested update operation key=CULXGFLZ0HI6 tag=CZ4P28Q0E92T type=del size=740608 2024-09-19T11:43:18.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.726+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=SLIU02EYCC93 type=del size=1930888 2024-09-19T11:43:18.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.730+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~51IE3Y9F7VK4.0 size=1048576 2024-09-19T11:43:18.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.730+0000 7f3d831968c0 1 < completed part key=_multipart_EVFF0F0760OS.2~51IE3Y9F7VK4.1 size=1048576 2024-09-19T11:43:18.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.730+0000 7f3d831968c0 1 < canceled part key=_multipart_EVFF0F0760OS.2~51IE3Y9F7VK4.2 size=865331 2024-09-19T11:43:18.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.738+0000 7f3d831968c0 1 < canceled multipart upload key=EVFF0F0760OS upload=51IE3Y9F7VK4 tag=2W0LVUKI25GS type=write size=4011059 2024-09-19T11:43:18.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.746+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~RKM0GOJHJB7X.0 size=1048576 2024-09-19T11:43:18.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.746+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~RKM0GOJHJB7X.1 size=1048576 2024-09-19T11:43:18.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.750+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~RKM0GOJHJB7X.2 size=328486 2024-09-19T11:43:18.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.750+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=RKM0GOJHJB7X tag=DRVW2YL1E9P4 type=write size=3474214 2024-09-19T11:43:18.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.754+0000 7f3d831968c0 1 < completed delete operation key=3GD7UZCI3WX4 tag=94ME2254024M type=del 2024-09-19T11:43:18.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.758+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~FM2DATAVPAS1.0 size=1048576 2024-09-19T11:43:18.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.762+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~FM2DATAVPAS1.1 size=1048576 2024-09-19T11:43:18.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.762+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~FM2DATAVPAS1.2 size=834547 2024-09-19T11:43:18.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.762+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=FM2DATAVPAS1 tag=2FU5OGF5S50P type=write size=3980275 2024-09-19T11:43:18.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.770+0000 7f3d831968c0 1 < suggested remove operation key=KAPKNZJ2DE6A tag=PAGYMQ896HC3 type=del 2024-09-19T11:43:18.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.774+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~PC9AF2TG1UMS.0 size=1048576 2024-09-19T11:43:18.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.774+0000 7f3d831968c0 1 > prepared part key=_multipart_E8OFSMUZHR02.2~PC9AF2TG1UMS.1 size=301543 2024-09-19T11:43:18.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.774+0000 7f3d831968c0 1 > prepared multipart upload key=E8OFSMUZHR02 upload=PC9AF2TG1UMS tag=T1NP200N7NR9 type=write size=2398695 2024-09-19T11:43:18.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.778+0000 7f3d831968c0 1 < canceled operation key=T9KJH2ZYCLVA tag=MT1QCW8IYVI1 type=del size=1218026 2024-09-19T11:43:18.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.782+0000 7f3d831968c0 1 > prepared part key=_multipart_0OOB2SNLVK8E.2~T2V0FAE6YU5G.0 size=790602 2024-09-19T11:43:18.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.782+0000 7f3d831968c0 1 > prepared multipart upload key=0OOB2SNLVK8E upload=T2V0FAE6YU5G tag=4LLJ7X47G2LG type=write size=1839178 2024-09-19T11:43:18.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.786+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=FV5TBY455KUS type=del 2024-09-19T11:43:18.796 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.790+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~MWNPGLYFNWNQ.0 size=1048576 2024-09-19T11:43:18.798 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.794+0000 7f3d831968c0 1 > prepared part key=_multipart_FKLL38ZNCJ21.2~MWNPGLYFNWNQ.1 size=107952 2024-09-19T11:43:18.798 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.794+0000 7f3d831968c0 1 > prepared multipart upload key=FKLL38ZNCJ21 upload=MWNPGLYFNWNQ tag=7FIRN860P9FK type=write size=2205104 2024-09-19T11:43:18.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.798+0000 7f3d831968c0 1 < completed part key=_multipart_JV7EGEI6062Y.2~LPXSSZWARTFI.0 size=565549 2024-09-19T11:43:18.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.802+0000 7f3d831968c0 1 < completed multipart upload key=JV7EGEI6062Y upload=LPXSSZWARTFI tag=FOSL3RDLW081 type=write size=1614125 2024-09-19T11:43:18.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.806+0000 7f3d831968c0 1 > prepared operation key=G4P6HIOM1G2E tag=YY84V26U1S2A type=del size=3993665 2024-09-19T11:43:18.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.806+0000 7f3d831968c0 1 < completed delete operation key=00DYD22W0ZNB tag=8JP9C30LIACF type=del 2024-09-19T11:43:18.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.810+0000 7f3d831968c0 1 > prepared operation key=KAPKNZJ2DE6A tag=E9WEOBCMO104 type=write size=473765 2024-09-19T11:43:18.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.814+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=119L7KHVIEDH type=del 2024-09-19T11:43:18.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.818+0000 7f3d831968c0 1 > prepared operation key=Y3LO4H9RI4X0 tag=8Z2WDYM4T6FI type=del size=1135943 2024-09-19T11:43:18.824 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.818+0000 7f3d831968c0 1 < completed delete operation key=UI7EVZ1SGD8R tag=FMJCYUTC6YZ1 type=del 2024-09-19T11:43:18.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.822+0000 7f3d831968c0 1 > prepared operation key=2VJRZVU7S8LB tag=MO81HLTN6B0Q type=del size=3436885 2024-09-19T11:43:18.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.826+0000 7f3d831968c0 1 < canceled part key=_multipart_4V17CRW6EB65.2~AH2LSJWRVRRR.0 size=1048576 2024-09-19T11:43:18.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.826+0000 7f3d831968c0 1 < completed part key=_multipart_4V17CRW6EB65.2~AH2LSJWRVRRR.1 size=42773 2024-09-19T11:43:18.836 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.830+0000 7f3d831968c0 1 < canceled multipart upload key=4V17CRW6EB65 upload=AH2LSJWRVRRR tag=31NDCWOCH3HN type=write size=2139925 2024-09-19T11:43:18.839 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.834+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=LZDZEZ3C6I1R type=write size=467351 2024-09-19T11:43:18.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.838+0000 7f3d831968c0 1 < canceled operation key=00DYD22W0ZNB tag=UGOWTKRTELAI type=del size=1073171 2024-09-19T11:43:18.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.842+0000 7f3d831968c0 1 > prepared operation key=66N4QS1R70Z7 tag=UJG9NXW48JE5 type=del size=2033432 2024-09-19T11:43:18.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.846+0000 7f3d831968c0 1 < suggested remove operation key=QPG75T46BH38 tag=U0N3KLJNDFI3 type=del 2024-09-19T11:43:18.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.854+0000 7f3d831968c0 1 > prepared part key=_multipart_76JFMPOUJZXW.2~V38ZAWP84H6E.0 size=760652 2024-09-19T11:43:18.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.854+0000 7f3d831968c0 1 > prepared multipart upload key=76JFMPOUJZXW upload=V38ZAWP84H6E tag=A3QODY6YW56H type=write size=1809228 2024-09-19T11:43:18.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.854+0000 7f3d831968c0 1 < completed write operation key=JTPBGWC4T3Y5 tag=KNAIV0O3P5ON type=write size=54446 2024-09-19T11:43:18.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.858+0000 7f3d831968c0 1 > prepared operation key=CULXGFLZ0HI6 tag=APBS9OVANKPS type=del size=4024217 2024-09-19T11:43:18.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.862+0000 7f3d831968c0 1 < completed part key=_multipart_JTPBGWC4T3Y5.2~ELZQ1AGR3R85.0 size=1048576 2024-09-19T11:43:18.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.862+0000 7f3d831968c0 1 < canceled part key=_multipart_JTPBGWC4T3Y5.2~ELZQ1AGR3R85.1 size=742574 2024-09-19T11:43:18.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.866+0000 7f3d831968c0 1 < canceled multipart upload key=JTPBGWC4T3Y5 upload=ELZQ1AGR3R85 tag=P1KV8DYUOQKO type=write size=2839726 2024-09-19T11:43:18.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.870+0000 7f3d831968c0 1 > prepared operation key=8104Z4OQ7UWQ tag=N7KTV2LKF2C3 type=del size=2726722 2024-09-19T11:43:18.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.874+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~9I3BGJA7B4OF.0 size=1048576 2024-09-19T11:43:18.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.874+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~9I3BGJA7B4OF.1 size=1048576 2024-09-19T11:43:18.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.878+0000 7f3d831968c0 1 < completed part key=_multipart_T9KJH2ZYCLVA.2~9I3BGJA7B4OF.2 size=600244 2024-09-19T11:43:18.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.882+0000 7f3d831968c0 1 < completed multipart upload key=T9KJH2ZYCLVA upload=9I3BGJA7B4OF tag=QS10DVWQPIZP type=write size=3745972 2024-09-19T11:43:18.894 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.886+0000 7f3d831968c0 1 > prepared part key=_multipart_00DYD22W0ZNB.2~7ONHUVFEZTJB.0 size=468237 2024-09-19T11:43:18.894 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.886+0000 7f3d831968c0 1 > prepared multipart upload key=00DYD22W0ZNB upload=7ONHUVFEZTJB tag=2JT0OP9F91OY type=write size=1516813 2024-09-19T11:43:18.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.894+0000 7f3d831968c0 1 < suggested update operation key=224HPC2Y95N6 tag=SLIU02EYCC93 type=del size=1930888 2024-09-19T11:43:18.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.898+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~E07IQ2R1KND7.0 size=1048576 2024-09-19T11:43:18.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.898+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~E07IQ2R1KND7.1 size=1048576 2024-09-19T11:43:18.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.902+0000 7f3d831968c0 1 > prepared part key=_multipart_3GD7UZCI3WX4.2~E07IQ2R1KND7.2 size=352100 2024-09-19T11:43:18.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.902+0000 7f3d831968c0 1 > prepared multipart upload key=3GD7UZCI3WX4 upload=E07IQ2R1KND7 tag=YM1JUGXDR33J type=write size=3497828 2024-09-19T11:43:18.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.906+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~RKM0GOJHJB7X.0 size=1048576 2024-09-19T11:43:18.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.906+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~RKM0GOJHJB7X.1 size=1048576 2024-09-19T11:43:18.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.910+0000 7f3d831968c0 1 < completed part key=_multipart_900RV3451AON.2~RKM0GOJHJB7X.2 size=328486 2024-09-19T11:43:18.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.914+0000 7f3d831968c0 1 < completed multipart upload key=900RV3451AON upload=RKM0GOJHJB7X tag=DRVW2YL1E9P4 type=write size=3474214 2024-09-19T11:43:18.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.918+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~G21K6K76O99Q.0 size=1048576 2024-09-19T11:43:18.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.918+0000 7f3d831968c0 1 > prepared part key=_multipart_PB62JE7I55GG.2~G21K6K76O99Q.1 size=232353 2024-09-19T11:43:18.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.918+0000 7f3d831968c0 1 > prepared multipart upload key=PB62JE7I55GG upload=G21K6K76O99Q tag=L1UPBXHFB1TQ type=write size=2329505 2024-09-19T11:43:18.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.922+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~FM2DATAVPAS1.0 size=1048576 2024-09-19T11:43:18.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.926+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~FM2DATAVPAS1.1 size=1048576 2024-09-19T11:43:18.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.926+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~FM2DATAVPAS1.2 size=834547 2024-09-19T11:43:18.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.930+0000 7f3d831968c0 1 < completed multipart upload key=3GD7UZCI3WX4 upload=FM2DATAVPAS1 tag=2FU5OGF5S50P type=write size=3980275 2024-09-19T11:43:18.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.938+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~MLPZCPSGSE89.0 size=1048576 2024-09-19T11:43:18.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.938+0000 7f3d831968c0 1 > prepared part key=_multipart_CULXGFLZ0HI6.2~MLPZCPSGSE89.1 size=345362 2024-09-19T11:43:18.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.938+0000 7f3d831968c0 1 > prepared multipart upload key=CULXGFLZ0HI6 upload=MLPZCPSGSE89 tag=7N99QC20GZAE type=write size=2442514 2024-09-19T11:43:18.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.942+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~PC9AF2TG1UMS.0 size=1048576 2024-09-19T11:43:18.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.942+0000 7f3d831968c0 1 < completed part key=_multipart_E8OFSMUZHR02.2~PC9AF2TG1UMS.1 size=301543 2024-09-19T11:43:18.951 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.946+0000 7f3d831968c0 1 < completed multipart upload key=E8OFSMUZHR02 upload=PC9AF2TG1UMS tag=T1NP200N7NR9 type=write size=2398695 2024-09-19T11:43:18.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.954+0000 7f3d831968c0 1 > prepared part key=_multipart_LINLTWYV88VU.2~YQLOXL7EIZY0.0 size=397981 2024-09-19T11:43:18.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.954+0000 7f3d831968c0 1 > prepared multipart upload key=LINLTWYV88VU upload=YQLOXL7EIZY0 tag=A6O8HGDJLU8I type=write size=1446557 2024-09-19T11:43:18.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.954+0000 7f3d831968c0 1 < completed part key=_multipart_0OOB2SNLVK8E.2~T2V0FAE6YU5G.0 size=790602 2024-09-19T11:43:18.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.958+0000 7f3d831968c0 1 < completed multipart upload key=0OOB2SNLVK8E upload=T2V0FAE6YU5G tag=4LLJ7X47G2LG type=write size=1839178 2024-09-19T11:43:18.966 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.962+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=QIPAZO3BQ8AE type=del size=2378265 2024-09-19T11:43:18.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.966+0000 7f3d831968c0 1 < completed part key=_multipart_FKLL38ZNCJ21.2~MWNPGLYFNWNQ.0 size=1048576 2024-09-19T11:43:18.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.966+0000 7f3d831968c0 1 < canceled part key=_multipart_FKLL38ZNCJ21.2~MWNPGLYFNWNQ.1 size=107952 2024-09-19T11:43:18.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.970+0000 7f3d831968c0 1 < canceled multipart upload key=FKLL38ZNCJ21 upload=MWNPGLYFNWNQ tag=7FIRN860P9FK type=write size=2205104 2024-09-19T11:43:18.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.970+0000 7f3d831968c0 1 > prepared operation key=JTPBGWC4T3Y5 tag=DOQ7WJKC2N6R type=del size=843044 2024-09-19T11:43:18.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.974+0000 7f3d831968c0 1 < completed delete operation key=G4P6HIOM1G2E tag=YY84V26U1S2A type=del 2024-09-19T11:43:18.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.978+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~P1Z173VTHSNV.0 size=1048576 2024-09-19T11:43:18.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.982+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~P1Z173VTHSNV.1 size=1048576 2024-09-19T11:43:18.988 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.986+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~P1Z173VTHSNV.2 size=314593 2024-09-19T11:43:18.988 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.986+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=P1Z173VTHSNV tag=3L023VHNNJBL type=write size=3460321 2024-09-19T11:43:18.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.986+0000 7f3d831968c0 1 < completed write operation key=KAPKNZJ2DE6A tag=E9WEOBCMO104 type=write size=473765 2024-09-19T11:43:18.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.990+0000 7f3d831968c0 1 > prepared operation key=I5XUMA2HKIR5 tag=RGOTZJSMNUKE type=del size=3846815 2024-09-19T11:43:18.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.994+0000 7f3d831968c0 1 < completed delete operation key=Y3LO4H9RI4X0 tag=8Z2WDYM4T6FI type=del 2024-09-19T11:43:19.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.998+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=BN78GV8ML5GQ type=del size=2468045 2024-09-19T11:43:19.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:18.998+0000 7f3d831968c0 1 < completed delete operation key=2VJRZVU7S8LB tag=MO81HLTN6B0Q type=del 2024-09-19T11:43:19.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.002+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=SEIPSJEMOX2O type=del size=3349684 2024-09-19T11:43:19.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.010+0000 7f3d831968c0 1 < completed write operation key=CULXGFLZ0HI6 tag=LZDZEZ3C6I1R type=write size=467351 2024-09-19T11:43:19.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.014+0000 7f3d831968c0 1 > prepared operation key=5RTONAWGYJNE tag=555C9IV34MVK type=del size=2044845 2024-09-19T11:43:19.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.018+0000 7f3d831968c0 1 < completed delete operation key=66N4QS1R70Z7 tag=UJG9NXW48JE5 type=del 2024-09-19T11:43:19.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.022+0000 7f3d831968c0 1 > prepared operation key=LINLTWYV88VU tag=R07E06PNHH7E type=del size=1383824 2024-09-19T11:43:19.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.022+0000 7f3d831968c0 1 < completed part key=_multipart_76JFMPOUJZXW.2~V38ZAWP84H6E.0 size=760652 2024-09-19T11:43:19.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.030+0000 7f3d831968c0 1 < completed multipart upload key=76JFMPOUJZXW upload=V38ZAWP84H6E tag=A3QODY6YW56H type=write size=1809228 2024-09-19T11:43:19.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.034+0000 7f3d831968c0 1 > prepared operation key=00DYD22W0ZNB tag=UGEV92HBI3N0 type=del size=2893053 2024-09-19T11:43:19.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.038+0000 7f3d831968c0 1 < suggested update operation key=CULXGFLZ0HI6 tag=APBS9OVANKPS type=del size=4024217 2024-09-19T11:43:19.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.042+0000 7f3d831968c0 1 > prepared part key=_multipart_4V17CRW6EB65.2~0FR20SK02NPX.0 size=569554 2024-09-19T11:43:19.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.042+0000 7f3d831968c0 1 > prepared multipart upload key=4V17CRW6EB65 upload=0FR20SK02NPX tag=51RCNADPWPE4 type=write size=1618130 2024-09-19T11:43:19.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.046+0000 7f3d831968c0 1 < completed delete operation key=8104Z4OQ7UWQ tag=N7KTV2LKF2C3 type=del 2024-09-19T11:43:19.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.054+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~973T3DV6O8H0.0 size=1048576 2024-09-19T11:43:19.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.054+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~973T3DV6O8H0.1 size=1048576 2024-09-19T11:43:19.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.058+0000 7f3d831968c0 1 > prepared part key=_multipart_UI7EVZ1SGD8R.2~973T3DV6O8H0.2 size=674254 2024-09-19T11:43:19.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.058+0000 7f3d831968c0 1 > prepared multipart upload key=UI7EVZ1SGD8R upload=973T3DV6O8H0 tag=I5VIL4ZX5WN7 type=write size=3819982 2024-09-19T11:43:19.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.062+0000 7f3d831968c0 1 < completed part key=_multipart_00DYD22W0ZNB.2~7ONHUVFEZTJB.0 size=468237 2024-09-19T11:43:19.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.066+0000 7f3d831968c0 1 < completed multipart upload key=00DYD22W0ZNB upload=7ONHUVFEZTJB tag=2JT0OP9F91OY type=write size=1516813 2024-09-19T11:43:19.075 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.070+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~PDX40XF9MVKS.0 size=1048576 2024-09-19T11:43:19.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.074+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~PDX40XF9MVKS.1 size=1048576 2024-09-19T11:43:19.080 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.074+0000 7f3d831968c0 1 > prepared part key=_multipart_8FGIZJIY58C7.2~PDX40XF9MVKS.2 size=532195 2024-09-19T11:43:19.080 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.074+0000 7f3d831968c0 1 > prepared multipart upload key=8FGIZJIY58C7 upload=PDX40XF9MVKS tag=DVXNL0SJXPF6 type=write size=3677923 2024-09-19T11:43:19.080 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.078+0000 7f3d831968c0 1 < canceled part key=_multipart_3GD7UZCI3WX4.2~E07IQ2R1KND7.0 size=1048576 2024-09-19T11:43:19.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.078+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~E07IQ2R1KND7.1 size=1048576 2024-09-19T11:43:19.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.082+0000 7f3d831968c0 1 < completed part key=_multipart_3GD7UZCI3WX4.2~E07IQ2R1KND7.2 size=352100 2024-09-19T11:43:19.091 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.086+0000 7f3d831968c0 1 < canceled multipart upload key=3GD7UZCI3WX4 upload=E07IQ2R1KND7 tag=YM1JUGXDR33J type=write size=3497828 2024-09-19T11:43:19.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.090+0000 7f3d831968c0 1 > prepared operation key=3GD7UZCI3WX4 tag=WS7LFDZ3CNZE type=write size=414938 2024-09-19T11:43:19.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.094+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~G21K6K76O99Q.0 size=1048576 2024-09-19T11:43:19.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.094+0000 7f3d831968c0 1 < completed part key=_multipart_PB62JE7I55GG.2~G21K6K76O99Q.1 size=232353 2024-09-19T11:43:19.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.102+0000 7f3d831968c0 1 < completed multipart upload key=PB62JE7I55GG upload=G21K6K76O99Q tag=L1UPBXHFB1TQ type=write size=2329505 2024-09-19T11:43:19.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.106+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~2PVYSE8T5JW9.0 size=1048576 2024-09-19T11:43:19.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.110+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~2PVYSE8T5JW9.1 size=962016 2024-09-19T11:43:19.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.110+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=2PVYSE8T5JW9 tag=9YEO8EPWXW7Z type=write size=3059168 2024-09-19T11:43:19.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.114+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~MLPZCPSGSE89.0 size=1048576 2024-09-19T11:43:19.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.114+0000 7f3d831968c0 1 < completed part key=_multipart_CULXGFLZ0HI6.2~MLPZCPSGSE89.1 size=345362 2024-09-19T11:43:19.125 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.122+0000 7f3d831968c0 1 < completed multipart upload key=CULXGFLZ0HI6 upload=MLPZCPSGSE89 tag=7N99QC20GZAE type=write size=2442514 2024-09-19T11:43:19.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.126+0000 7f3d831968c0 1 > prepared operation key=224HPC2Y95N6 tag=7246J5FOKPKR type=del size=2936241 2024-09-19T11:43:19.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.126+0000 7f3d831968c0 1 < completed part key=_multipart_LINLTWYV88VU.2~YQLOXL7EIZY0.0 size=397981 2024-09-19T11:43:19.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.134+0000 7f3d831968c0 1 < completed multipart upload key=LINLTWYV88VU upload=YQLOXL7EIZY0 tag=A6O8HGDJLU8I type=write size=1446557 2024-09-19T11:43:19.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.138+0000 7f3d831968c0 1 > prepared operation key=JV7EGEI6062Y tag=7R8C4X91B75W type=del size=3273947 2024-09-19T11:43:19.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.142+0000 7f3d831968c0 1 < completed delete operation key=224HPC2Y95N6 tag=QIPAZO3BQ8AE type=del 2024-09-19T11:43:19.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.146+0000 7f3d831968c0 1 > prepared operation key=6NLQ0BK8AJUO tag=3JGBMWQ9M95J type=write size=755261 2024-09-19T11:43:19.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.150+0000 7f3d831968c0 1 < completed delete operation key=JTPBGWC4T3Y5 tag=DOQ7WJKC2N6R type=del 2024-09-19T11:43:19.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.150+0000 7f3d831968c0 1 > prepared operation key=4I8BY4YYTRT0 tag=XW0RBMASGZFN type=del size=3626091 2024-09-19T11:43:19.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.154+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~P1Z173VTHSNV.0 size=1048576 2024-09-19T11:43:19.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.158+0000 7f3d831968c0 1 < completed part key=_multipart_QPG75T46BH38.2~P1Z173VTHSNV.1 size=1048576 2024-09-19T11:43:19.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.158+0000 7f3d831968c0 1 < canceled part key=_multipart_QPG75T46BH38.2~P1Z173VTHSNV.2 size=314593 2024-09-19T11:43:19.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.162+0000 7f3d831968c0 1 < canceled multipart upload key=QPG75T46BH38 upload=P1Z173VTHSNV tag=3L023VHNNJBL type=write size=3460321 2024-09-19T11:43:19.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.166+0000 7f3d831968c0 1 > prepared operation key=3K8P37C015G3 tag=AK2ZCLOXI65E type=del size=2435814 2024-09-19T11:43:19.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.170+0000 7f3d831968c0 1 < completed delete operation key=I5XUMA2HKIR5 tag=RGOTZJSMNUKE type=del 2024-09-19T11:43:19.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.174+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~IXFIDP2KJ5G1.0 size=1048576 2024-09-19T11:43:19.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.178+0000 7f3d831968c0 1 > prepared part key=_multipart_900RV3451AON.2~IXFIDP2KJ5G1.1 size=354617 2024-09-19T11:43:19.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.178+0000 7f3d831968c0 1 > prepared multipart upload key=900RV3451AON upload=IXFIDP2KJ5G1 tag=OOZ3KR2OTT79 type=write size=2451769 2024-09-19T11:43:19.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.186+0000 7f3d831968c0 1 < suggested remove operation key=LINLTWYV88VU tag=BN78GV8ML5GQ type=del 2024-09-19T11:43:19.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.190+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~3P9MXZMNZSIP.0 size=1048576 2024-09-19T11:43:19.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.194+0000 7f3d831968c0 1 > prepared part key=_multipart_QPG75T46BH38.2~3P9MXZMNZSIP.1 size=288310 2024-09-19T11:43:19.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:43:19.194+0000 7f3d831968c0 1 > prepared multipart upload key=QPG75T46BH38 upload=3P9MXZMNZSIP tag=B6840F3DKM48 type=write size=2385462 2024-09-19T11:43:19.199 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] cls_rgw_stats.simulate (22594 ms) 2024-09-19T11:43:19.199 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 1 test from cls_rgw_stats (22594 ms total) 2024-09-19T11:43:19.199 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:43:19.199 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:43:19.270 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 1 test from 1 test suite ran. (24546 ms total) 2024-09-19T11:43:19.271 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 1 test. 2024-09-19T11:43:19.281 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:43:19.281 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:43:19.338 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-19T11:43:19.339 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-19T11:43:19.339 DEBUG:teuthology.orchestra.run.smithi120:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-19T11:43:19.402 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-19T11:43:19.402 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-19T11:43:19.402 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:43:21.294 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 31 tests from CmpOmap 2024-09-19T11:43:21.294 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-19T11:43:21.323 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (30 ms) 2024-09-19T11:43:21.323 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-19T11:43:21.336 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (13 ms) 2024-09-19T11:43:21.337 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-19T11:43:21.342 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (5 ms) 2024-09-19T11:43:21.342 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-19T11:43:21.348 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (7 ms) 2024-09-19T11:43:21.348 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-19T11:43:21.364 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_vals_str (16 ms) 2024-09-19T11:43:21.365 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-19T11:43:21.376 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_vals_u64 (12 ms) 2024-09-19T11:43:21.377 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-19T11:43:21.383 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (7 ms) 2024-09-19T11:43:21.383 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-19T11:43:21.391 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (8 ms) 2024-09-19T11:43:21.391 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-19T11:43:21.401 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (10 ms) 2024-09-19T11:43:21.401 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-19T11:43:21.412 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (11 ms) 2024-09-19T11:43:21.412 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-19T11:43:21.414 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (2 ms) 2024-09-19T11:43:21.414 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-19T11:43:21.415 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-19T11:43:21.415 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-19T11:43:21.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (18 ms) 2024-09-19T11:43:21.433 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-19T11:43:21.453 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (20 ms) 2024-09-19T11:43:21.453 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-19T11:43:21.470 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (17 ms) 2024-09-19T11:43:21.470 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-19T11:43:21.487 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (17 ms) 2024-09-19T11:43:21.487 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-19T11:43:21.508 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_set_vals_str (21 ms) 2024-09-19T11:43:21.508 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-19T11:43:21.531 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (23 ms) 2024-09-19T11:43:21.531 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-19T11:43:21.539 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (8 ms) 2024-09-19T11:43:21.539 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-19T11:43:21.545 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (6 ms) 2024-09-19T11:43:21.545 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-19T11:43:21.548 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (3 ms) 2024-09-19T11:43:21.548 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-19T11:43:21.550 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-09-19T11:43:21.550 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-19T11:43:21.567 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (17 ms) 2024-09-19T11:43:21.567 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-19T11:43:21.583 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (16 ms) 2024-09-19T11:43:21.584 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-19T11:43:21.604 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (20 ms) 2024-09-19T11:43:21.604 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-19T11:43:21.624 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (20 ms) 2024-09-19T11:43:21.624 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-19T11:43:21.630 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (6 ms) 2024-09-19T11:43:21.630 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-19T11:43:21.636 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (6 ms) 2024-09-19T11:43:21.637 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-19T11:43:21.639 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-19T11:43:21.639 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-19T11:43:21.641 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-19T11:43:21.641 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-19T11:43:21.662 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (21 ms) 2024-09-19T11:43:21.662 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 31 tests from CmpOmap (369 ms total) 2024-09-19T11:43:21.663 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:43:21.663 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:43:22.306 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 31 tests from 1 test suite ran. (2903 ms total) 2024-09-19T11:43:22.306 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 31 tests. 2024-09-19T11:43:22.312 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:43:22.312 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:43:22.368 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-19T11:43:22.369 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-19T11:43:22.370 DEBUG:teuthology.orchestra.run.smithi120:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-19T11:43:22.436 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-19T11:43:22.436 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-19T11:43:22.436 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:43:22.436 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-19T11:43:22.436 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-19T11:43:25.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2913 ms) 2024-09-19T11:43:25.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-19T11:43:28.362 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3013 ms) 2024-09-19T11:43:28.362 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-19T11:43:31.423 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.Reserve (3060 ms) 2024-09-19T11:43:31.423 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-19T11:43:34.491 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3069 ms) 2024-09-19T11:43:34.492 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-19T11:43:38.552 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.Commit (4058 ms) 2024-09-19T11:43:38.552 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-19T11:43:42.604 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.Stats (4053 ms) 2024-09-19T11:43:42.604 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-19T11:43:46.662 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4060 ms) 2024-09-19T11:43:46.662 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-19T11:43:49.713 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.Abort (3051 ms) 2024-09-19T11:43:49.713 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-19T11:43:52.792 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.ReserveError (3073 ms) 2024-09-19T11:43:52.792 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-19T11:43:55.796 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.CommitError (3008 ms) 2024-09-19T11:43:55.796 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-19T11:43:58.847 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.AbortError (3053 ms) 2024-09-19T11:43:58.847 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-19T11:44:01.912 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3060 ms) 2024-09-19T11:44:01.912 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-19T11:44:04.958 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3048 ms) 2024-09-19T11:44:04.958 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-19T11:44:07.963 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3008 ms) 2024-09-19T11:44:07.963 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-19T11:44:11.028 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3065 ms) 2024-09-19T11:44:11.029 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-19T11:44:14.084 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3052 ms) 2024-09-19T11:44:14.084 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-19T11:44:17.124 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3045 ms) 2024-09-19T11:44:17.125 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-19T11:44:20.156 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.Cleanup (3031 ms) 2024-09-19T11:44:20.157 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-19T11:44:32.219 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.MultiProducer (12062 ms) 2024-09-19T11:44:32.219 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-19T11:44:37.286 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5069 ms) 2024-09-19T11:44:37.287 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-19T11:44:50.411 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13121 ms) 2024-09-19T11:44:50.412 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-19T11:44:56.459 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6050 ms) 2024-09-19T11:44:56.460 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-19T11:45:06.552 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (10095 ms) 2024-09-19T11:45:06.552 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-19T11:45:16.805 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10253 ms) 2024-09-19T11:45:16.806 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 24 tests from TestCls2PCQueue (114370 ms total) 2024-09-19T11:45:16.806 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:45:16.806 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:45:16.806 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 24 tests from 1 test suite ran. (114370 ms total) 2024-09-19T11:45:16.806 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 24 tests. 2024-09-19T11:45:16.812 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:45:16.812 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:45:16.868 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-19T11:45:16.869 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-19T11:45:16.869 DEBUG:teuthology.orchestra.run.smithi120:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-19T11:45:16.954 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:45:16.954 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:45:16.955 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-19T11:45:16.955 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:45:18.809 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from ClsAccount 2024-09-19T11:45:18.810 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] ClsAccount.add 2024-09-19T11:45:18.857 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] ClsAccount.add (48 ms) 2024-09-19T11:45:18.858 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] ClsAccount.get 2024-09-19T11:45:18.865 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] ClsAccount.get (8 ms) 2024-09-19T11:45:18.865 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] ClsAccount.rm 2024-09-19T11:45:18.875 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] ClsAccount.rm (10 ms) 2024-09-19T11:45:18.876 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] ClsAccount.list 2024-09-19T11:45:18.913 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] ClsAccount.list (38 ms) 2024-09-19T11:45:18.914 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from ClsAccount (104 ms total) 2024-09-19T11:45:18.914 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:45:18.914 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:45:19.843 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 4 tests from 1 test suite ran. (2888 ms total) 2024-09-19T11:45:19.843 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 4 tests. 2024-09-19T11:45:19.847 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:45:19.847 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:45:19.904 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-19T11:45:19.905 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-19T11:45:19.905 DEBUG:teuthology.orchestra.run.smithi120:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-19T11:45:19.980 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:45:19.980 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:45:19.981 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-19T11:45:19.981 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:45:21.872 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 6 tests from rgw_gc_log 2024-09-19T11:45:21.872 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-19T11:45:21.904 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] rgw_gc_log.init_existing_queue (33 ms) 2024-09-19T11:45:21.904 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-19T11:45:21.910 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] rgw_gc_log.init_existing_omap (6 ms) 2024-09-19T11:45:21.910 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-19T11:45:21.917 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (7 ms) 2024-09-19T11:45:21.917 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-19T11:45:21.919 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-19T11:45:21.919 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-19T11:45:21.923 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] rgw_gc_log.defer1_after_init (4 ms) 2024-09-19T11:45:21.923 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-19T11:45:21.926 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-09-19T11:45:21.926 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 6 tests from rgw_gc_log (55 ms total) 2024-09-19T11:45:21.926 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:45:21.927 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:45:22.881 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 6 tests from 1 test suite ran. (2900 ms total) 2024-09-19T11:45:22.884 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 6 tests. 2024-09-19T11:45:22.890 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:45:22.890 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:45:22.948 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-19T11:45:22.949 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-19T11:45:22.949 DEBUG:teuthology.orchestra.run.smithi120:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-19T11:45:23.022 INFO:tasks.workunit.client.0.smithi120.stdout:Running main() from gmock_main.cc 2024-09-19T11:45:23.022 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-19T11:45:23.022 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:45:23.022 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from TestRGWObj 2024-09-19T11:45:23.022 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestRGWObj.underscore 2024-09-19T11:45:23.022 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj 2024-09-19T11:45:23.022 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj 2024-09-19T11:45:23.022 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: _obj ns= i= 2024-09-19T11:45:23.023 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj 2024-09-19T11:45:23.023 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj 2024-09-19T11:45:23.023 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: _obj ns= i= 2024-09-19T11:45:23.023 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj 2024-09-19T11:45:23.023 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj 2024-09-19T11:45:23.023 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: _obj ns= i= 2024-09-19T11:45:23.023 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.023 INFO:tasks.workunit.client.0.smithi120.stdout: "obj1": { 2024-09-19T11:45:23.023 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.023 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.023 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.023 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.023 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.024 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.024 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.024 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.024 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.024 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.024 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.024 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.024 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.024 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.024 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.024 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.024 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.024 INFO:tasks.workunit.client.0.smithi120.stdout: "obj2": { 2024-09-19T11:45:23.025 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.025 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.025 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.025 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.025 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.025 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.025 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.025 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.025 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.025 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.025 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.025 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.025 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.025 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.026 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.026 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.026 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.026 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3": { 2024-09-19T11:45:23.026 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.026 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.026 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.026 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.026 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.026 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.026 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.026 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.026 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.026 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.027 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.027 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.027 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.027 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.027 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.027 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.027 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.027 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3-2": { 2024-09-19T11:45:23.027 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.027 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.027 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.027 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.027 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.027 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.028 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.028 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.028 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.028 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.028 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.028 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.028 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.028 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.028 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.028 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.028 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.028 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.028 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj 2024-09-19T11:45:23.028 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj 2024-09-19T11:45:23.029 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: _obj ns=ns i= 2024-09-19T11:45:23.029 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj 2024-09-19T11:45:23.029 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj 2024-09-19T11:45:23.029 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: _obj ns=ns i= 2024-09-19T11:45:23.029 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj 2024-09-19T11:45:23.029 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj 2024-09-19T11:45:23.029 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: _obj ns=ns i= 2024-09-19T11:45:23.029 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.029 INFO:tasks.workunit.client.0.smithi120.stdout: "obj1": { 2024-09-19T11:45:23.029 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.029 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.029 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.029 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.030 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.030 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.030 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.030 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.030 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.030 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.030 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.030 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.031 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.031 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.031 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.031 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.031 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.031 INFO:tasks.workunit.client.0.smithi120.stdout: "obj2": { 2024-09-19T11:45:23.031 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.031 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.031 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.031 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.031 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.031 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.031 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.031 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.032 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.032 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.032 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.032 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.032 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.032 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.032 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.032 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.032 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.032 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3": { 2024-09-19T11:45:23.032 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.032 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.032 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.033 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.033 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.033 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.033 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.033 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.033 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.033 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.033 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.033 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.033 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.033 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.033 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.033 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.034 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.034 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3-2": { 2024-09-19T11:45:23.034 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.034 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.034 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.034 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.034 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.034 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.034 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.034 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.034 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.034 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.034 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.035 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.035 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.035 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.035 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.035 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.035 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.035 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.035 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj[v1] 2024-09-19T11:45:23.035 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj[v1] 2024-09-19T11:45:23.035 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: _obj ns= i=v1 2024-09-19T11:45:23.035 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj[v1] 2024-09-19T11:45:23.035 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj[v1] 2024-09-19T11:45:23.035 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: _obj ns= i=v1 2024-09-19T11:45:23.035 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj[v1] 2024-09-19T11:45:23.036 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj[v1] 2024-09-19T11:45:23.036 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: _obj ns= i=v1 2024-09-19T11:45:23.036 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.036 INFO:tasks.workunit.client.0.smithi120.stdout: "obj1": { 2024-09-19T11:45:23.036 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.036 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.036 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.036 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.036 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.036 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.036 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.036 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.036 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.037 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.037 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.037 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.037 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.037 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "v1", 2024-09-19T11:45:23.037 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.037 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.037 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.037 INFO:tasks.workunit.client.0.smithi120.stdout: "obj2": { 2024-09-19T11:45:23.037 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.037 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.037 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.037 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.038 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.038 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.038 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.038 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.038 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.038 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.038 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.038 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.038 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.038 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "v1", 2024-09-19T11:45:23.038 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.038 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.038 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.039 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3": { 2024-09-19T11:45:23.039 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.039 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.039 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.039 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.039 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.039 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.039 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.039 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.039 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.039 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.039 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.039 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.040 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.040 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.040 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.040 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.040 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.040 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3-2": { 2024-09-19T11:45:23.040 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.040 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.040 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.040 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.040 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.040 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.040 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.041 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.041 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.041 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.041 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.041 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.041 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.041 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "v1", 2024-09-19T11:45:23.041 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.041 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.041 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.041 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.041 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj[v1] 2024-09-19T11:45:23.041 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj[v1] 2024-09-19T11:45:23.041 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: _obj ns=ns i=v1 2024-09-19T11:45:23.042 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj[v1] 2024-09-19T11:45:23.042 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj[v1] 2024-09-19T11:45:23.042 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: _obj ns=ns i=v1 2024-09-19T11:45:23.042 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj[v1] 2024-09-19T11:45:23.042 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: _obj[v1] 2024-09-19T11:45:23.042 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: _obj ns=ns i=v1 2024-09-19T11:45:23.042 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.042 INFO:tasks.workunit.client.0.smithi120.stdout: "obj1": { 2024-09-19T11:45:23.042 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.042 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.042 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.042 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.042 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.042 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.043 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.043 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.043 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.043 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.043 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.043 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.043 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.043 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "v1", 2024-09-19T11:45:23.043 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.043 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.043 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.043 INFO:tasks.workunit.client.0.smithi120.stdout: "obj2": { 2024-09-19T11:45:23.043 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.043 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.044 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.044 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.044 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.044 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.044 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.044 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.044 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.044 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.044 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.044 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.044 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.044 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "v1", 2024-09-19T11:45:23.044 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.044 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.045 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.045 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3": { 2024-09-19T11:45:23.045 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.045 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.045 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.045 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.045 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.045 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.045 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.045 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.045 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.045 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.045 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.045 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.046 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.046 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.046 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.046 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.046 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.046 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3-2": { 2024-09-19T11:45:23.046 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.046 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.046 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.046 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.046 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.046 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.046 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.046 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.046 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.047 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.047 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.047 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.047 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_obj", 2024-09-19T11:45:23.047 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "v1", 2024-09-19T11:45:23.047 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.047 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.047 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.047 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.047 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-19T11:45:23.047 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-19T11:45:23.047 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj 2024-09-19T11:45:23.047 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj 2024-09-19T11:45:23.048 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: obj ns= i= 2024-09-19T11:45:23.048 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj 2024-09-19T11:45:23.048 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj 2024-09-19T11:45:23.048 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: obj ns= i= 2024-09-19T11:45:23.048 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj 2024-09-19T11:45:23.048 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj 2024-09-19T11:45:23.048 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: obj ns= i= 2024-09-19T11:45:23.048 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.048 INFO:tasks.workunit.client.0.smithi120.stdout: "obj1": { 2024-09-19T11:45:23.048 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.048 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.048 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.048 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.048 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.049 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.049 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.049 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.049 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.049 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.049 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.049 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.049 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.049 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.049 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.049 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.049 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.049 INFO:tasks.workunit.client.0.smithi120.stdout: "obj2": { 2024-09-19T11:45:23.049 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.050 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.050 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.050 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.050 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.050 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.050 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.050 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.050 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.050 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.050 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.050 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.050 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.050 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.050 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.051 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.051 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.051 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3": { 2024-09-19T11:45:23.051 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.051 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.051 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.051 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.051 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.051 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.051 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.051 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.051 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.051 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.051 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.052 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.052 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.052 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.052 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.052 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.052 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.052 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3-2": { 2024-09-19T11:45:23.052 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.052 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.052 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.052 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.052 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.052 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.053 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.053 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.053 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.053 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.053 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.053 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.053 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.053 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.053 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.053 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.053 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.053 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.053 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj 2024-09-19T11:45:23.053 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj 2024-09-19T11:45:23.054 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: obj ns=ns i= 2024-09-19T11:45:23.054 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj 2024-09-19T11:45:23.054 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj 2024-09-19T11:45:23.054 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: obj ns=ns i= 2024-09-19T11:45:23.054 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj 2024-09-19T11:45:23.054 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj 2024-09-19T11:45:23.054 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: obj ns=ns i= 2024-09-19T11:45:23.054 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.054 INFO:tasks.workunit.client.0.smithi120.stdout: "obj1": { 2024-09-19T11:45:23.054 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.054 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.054 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.054 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.055 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.055 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.055 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.055 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.055 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.055 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.055 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.055 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.055 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.055 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.055 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.055 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.055 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.056 INFO:tasks.workunit.client.0.smithi120.stdout: "obj2": { 2024-09-19T11:45:23.056 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.056 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.056 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.056 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.056 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.056 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.056 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.056 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.056 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.056 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.056 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.056 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.056 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.057 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.057 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.057 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.057 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.057 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3": { 2024-09-19T11:45:23.057 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.057 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.057 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.057 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.057 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.057 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.057 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.057 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.058 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.058 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.058 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.058 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.058 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.058 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.058 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.058 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.058 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.058 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3-2": { 2024-09-19T11:45:23.058 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.058 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.058 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.058 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.059 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.059 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.059 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.059 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.059 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.059 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.059 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.059 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.059 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.059 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.059 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.059 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.059 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.059 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.060 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj[v1] 2024-09-19T11:45:23.060 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj[v1] 2024-09-19T11:45:23.060 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: obj ns= i=v1 2024-09-19T11:45:23.060 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj[v1] 2024-09-19T11:45:23.060 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj[v1] 2024-09-19T11:45:23.060 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: obj ns= i=v1 2024-09-19T11:45:23.060 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj[v1] 2024-09-19T11:45:23.060 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj[v1] 2024-09-19T11:45:23.060 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: obj ns= i=v1 2024-09-19T11:45:23.060 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.060 INFO:tasks.workunit.client.0.smithi120.stdout: "obj1": { 2024-09-19T11:45:23.060 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.060 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.061 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.061 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.061 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.061 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.061 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.061 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.061 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.061 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.061 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.061 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.061 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.061 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "v1", 2024-09-19T11:45:23.061 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.062 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.062 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.062 INFO:tasks.workunit.client.0.smithi120.stdout: "obj2": { 2024-09-19T11:45:23.062 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.062 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.062 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.062 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.062 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.062 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.062 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.062 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.062 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.062 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.062 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.062 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.063 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.063 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "v1", 2024-09-19T11:45:23.063 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.063 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.063 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.063 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3": { 2024-09-19T11:45:23.063 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.063 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.063 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.063 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.063 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.063 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.063 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.063 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.064 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.064 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.064 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.064 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.064 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.064 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.064 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.064 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.064 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.064 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3-2": { 2024-09-19T11:45:23.064 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.064 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.064 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.065 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.065 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.065 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.065 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.065 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.065 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.065 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.065 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.065 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.065 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.065 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "v1", 2024-09-19T11:45:23.065 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.065 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.065 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.066 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.066 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj[v1] 2024-09-19T11:45:23.066 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj[v1] 2024-09-19T11:45:23.066 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: obj ns=ns i=v1 2024-09-19T11:45:23.066 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj[v1] 2024-09-19T11:45:23.066 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj[v1] 2024-09-19T11:45:23.066 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: obj ns=ns i=v1 2024-09-19T11:45:23.066 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj[v1] 2024-09-19T11:45:23.066 INFO:tasks.workunit.client.0.smithi120.stdout:parsed: obj[v1] 2024-09-19T11:45:23.066 INFO:tasks.workunit.client.0.smithi120.stdout:stripped: obj ns=ns i=v1 2024-09-19T11:45:23.066 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.066 INFO:tasks.workunit.client.0.smithi120.stdout: "obj1": { 2024-09-19T11:45:23.066 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.066 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.067 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.067 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.067 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.067 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.067 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.067 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.067 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.067 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.067 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.067 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.067 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.067 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "v1", 2024-09-19T11:45:23.067 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.068 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.068 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.068 INFO:tasks.workunit.client.0.smithi120.stdout: "obj2": { 2024-09-19T11:45:23.068 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.068 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.068 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.068 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.068 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.068 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.068 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.068 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.068 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.068 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.069 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.069 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.069 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.069 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "v1", 2024-09-19T11:45:23.069 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.069 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.069 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.069 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3": { 2024-09-19T11:45:23.069 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.069 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.069 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.069 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.069 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.069 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.070 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.070 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.070 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.070 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.070 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.070 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.070 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.070 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.070 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.070 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.070 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.070 INFO:tasks.workunit.client.0.smithi120.stdout: "obj3-2": { 2024-09-19T11:45:23.070 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.071 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.071 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.071 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.071 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.071 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.071 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.071 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.071 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.071 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.071 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.071 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.071 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "obj", 2024-09-19T11:45:23.071 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "v1", 2024-09-19T11:45:23.072 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.072 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.072 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.072 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.072 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-19T11:45:23.072 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-19T11:45:23.072 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.072 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.072 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.072 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.072 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.072 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.072 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.072 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.073 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.073 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.073 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.073 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.073 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.073 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.073 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.073 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.073 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.073 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.073 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.073 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.073 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.073 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.074 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.074 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.074 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.074 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.074 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.074 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.074 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.074 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.074 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.074 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.074 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.074 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.074 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.074 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": "default-placement.data", 2024-09-19T11:45:23.075 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker_myobj", 2024-09-19T11:45:23.075 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.075 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.075 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.075 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.075 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.075 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.075 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.075 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.075 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.075 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.075 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.075 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.076 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.076 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.076 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.076 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.076 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.076 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.076 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.076 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.076 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.076 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.076 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.076 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.076 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.076 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.077 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.077 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.077 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.077 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.077 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.077 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.077 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.077 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.077 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.077 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.077 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.077 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.077 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.077 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.078 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.078 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.078 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.078 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.078 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.078 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.078 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.078 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.078 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.078 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.078 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.078 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.078 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.078 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.079 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.079 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.079 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.079 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.079 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.079 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker_myobj", 2024-09-19T11:45:23.079 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.079 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.079 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.079 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.079 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.079 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.080 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.080 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.080 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.080 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.080 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.080 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.080 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.080 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.080 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.080 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.080 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.080 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.080 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.080 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.080 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.081 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.081 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.081 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.081 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.081 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.081 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.081 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.081 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.081 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.081 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.081 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.081 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.081 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.082 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.082 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.082 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.082 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.082 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.082 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.082 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.082 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.082 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.082 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.082 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.082 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.082 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.083 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.083 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.083 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.083 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.083 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.083 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.083 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.083 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.083 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.083 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.083 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.083 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": "default-placement.data", 2024-09-19T11:45:23.083 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns_myobj", 2024-09-19T11:45:23.083 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.083 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.084 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.084 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.084 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.084 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.084 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.084 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.084 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.084 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.084 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.084 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.084 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.084 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.084 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.085 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.085 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.085 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.085 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.085 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.085 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.085 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.085 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.085 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.085 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.085 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.085 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.085 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.085 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.086 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.086 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.086 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.086 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.086 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.086 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.086 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.086 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.086 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.086 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.086 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.086 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.086 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.086 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.087 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.087 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.087 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.087 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.087 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.087 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.087 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.087 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.087 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.087 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.087 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.087 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.087 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.087 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.088 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.088 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.088 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns_myobj", 2024-09-19T11:45:23.088 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.088 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.088 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.088 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.088 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.088 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.088 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.088 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.088 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.088 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.088 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.089 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.089 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.089 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.089 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.089 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.089 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.089 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.089 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.089 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.089 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.089 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.089 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.092 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.092 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.092 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.092 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.092 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.092 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.092 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.092 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.092 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.093 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.093 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.093 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.093 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.093 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.093 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.093 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.093 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.093 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.093 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.093 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.093 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.093 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.093 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.094 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.094 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.094 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.094 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.094 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.094 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.094 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.094 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.094 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.094 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.094 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.094 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.094 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": "default-placement.data", 2024-09-19T11:45:23.094 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__:inst_myobj", 2024-09-19T11:45:23.095 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.095 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.095 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.095 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.095 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.095 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.095 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.095 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.095 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.095 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.095 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.095 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.095 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.095 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.096 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.096 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.096 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.096 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.096 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.096 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.096 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.096 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.096 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.096 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.096 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.096 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.096 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.097 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.097 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.097 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.097 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.097 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.097 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.097 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.097 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.097 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.097 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.097 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.097 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.097 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.097 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.098 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.098 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.098 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.098 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.098 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.098 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.098 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.098 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.098 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.098 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.098 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.098 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.098 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.098 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.099 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.099 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.099 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.099 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.099 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__:inst_myobj", 2024-09-19T11:45:23.099 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.099 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.099 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.099 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.099 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.099 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.099 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.099 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.099 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.099 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.100 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.100 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.100 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.100 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.100 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.100 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.100 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.100 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.100 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.100 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.100 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.100 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.100 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.100 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.101 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.101 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.101 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.101 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.101 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.101 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.101 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.101 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.101 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.101 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.101 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.101 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.101 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.101 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.102 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.102 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.102 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.102 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.102 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.102 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.102 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.102 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.102 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.102 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.102 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.102 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.102 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.102 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.103 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.103 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.103 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.103 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.103 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.103 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.103 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": "default-placement.data", 2024-09-19T11:45:23.103 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns:inst_myobj", 2024-09-19T11:45:23.103 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.103 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.103 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.103 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.103 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.103 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.104 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.104 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.104 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.104 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.104 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.104 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.104 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.104 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.104 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.104 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.104 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.104 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.104 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.105 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.105 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.105 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.105 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.105 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.105 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.105 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.105 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.105 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.105 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.105 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.105 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.105 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.105 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.106 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.106 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.106 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.106 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.106 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.106 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.106 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.106 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.106 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.106 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.106 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.106 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.106 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.106 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.107 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.107 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.107 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.107 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.107 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.107 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.107 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.107 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.107 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.107 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.107 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.107 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.107 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns:inst_myobj", 2024-09-19T11:45:23.107 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.108 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.108 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.108 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.108 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.108 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.108 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.108 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.108 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.108 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.108 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.108 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.108 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.108 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.109 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.109 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.109 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.109 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.109 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.109 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.109 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.109 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.109 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.109 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.109 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.109 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.109 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.110 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.110 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.110 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.110 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.110 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.110 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.110 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.110 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.110 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.110 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.110 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.110 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.110 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.110 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.111 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.111 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.111 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.111 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.111 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.111 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.111 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.111 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.111 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.111 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.111 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.111 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.111 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.111 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.112 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.112 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.112 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.112 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": "default-placement.data", 2024-09-19T11:45:23.112 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker___myobj", 2024-09-19T11:45:23.112 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj" 2024-09-19T11:45:23.112 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.112 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.112 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.112 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.112 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.112 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.112 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.113 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.113 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.113 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.113 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.113 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.113 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.113 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.113 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.113 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.113 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.113 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.113 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.113 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.113 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.114 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.114 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.114 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.114 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.114 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.114 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.114 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.114 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.114 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.114 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.114 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.114 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.114 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.114 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.115 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.115 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.115 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.115 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.115 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.115 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.115 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.115 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.115 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.115 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.115 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.115 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.115 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.116 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.116 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.116 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.116 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.116 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.116 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.116 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.116 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.116 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.116 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.116 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker___myobj", 2024-09-19T11:45:23.116 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj" 2024-09-19T11:45:23.116 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.117 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.117 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.117 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.117 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.117 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.117 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.117 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.117 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.117 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.117 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.117 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.117 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.117 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.117 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.118 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.118 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.118 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.118 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.118 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.118 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.118 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.118 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.118 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.118 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.118 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.118 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.118 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.118 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.119 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.119 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.119 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.119 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.119 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.119 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.119 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.119 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.119 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.119 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.119 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.119 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.119 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.120 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.120 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.120 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.120 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.120 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.120 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.120 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.120 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.120 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.120 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.120 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.120 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.120 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.121 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.121 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.121 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": "default-placement.data", 2024-09-19T11:45:23.121 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns__myobj", 2024-09-19T11:45:23.121 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.121 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.121 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.121 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.121 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.121 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.121 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.121 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.121 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.121 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.122 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.122 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.122 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.122 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.122 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.122 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.122 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.122 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.122 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.122 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.122 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.122 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.122 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.123 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.123 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.123 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.123 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.123 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.123 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.123 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.123 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.123 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.123 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.123 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.123 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.123 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.123 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.124 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.124 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.124 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.124 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.124 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.124 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.124 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.124 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.124 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.124 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.124 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.124 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.124 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.125 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.125 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.125 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.125 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.125 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.125 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.125 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.125 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.125 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.125 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns__myobj", 2024-09-19T11:45:23.125 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.125 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.125 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.125 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.125 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.126 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.126 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.126 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.126 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.126 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.126 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.126 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.126 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.126 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.126 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.126 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.126 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.126 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.126 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.126 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.127 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.127 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.127 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.127 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.127 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.127 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.127 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.127 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.127 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.127 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.127 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.127 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.127 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.127 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.128 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.128 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.128 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.128 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.128 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.128 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.128 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.128 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.128 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.128 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.128 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.128 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.128 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.129 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.129 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.129 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.129 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.129 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.129 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.129 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.129 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.129 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.129 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.129 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.129 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": "default-placement.data", 2024-09-19T11:45:23.129 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__:inst__myobj", 2024-09-19T11:45:23.129 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj" 2024-09-19T11:45:23.130 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.130 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.130 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.130 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.130 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.130 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.130 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.130 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.130 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.130 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.130 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.130 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.130 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.130 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.131 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.131 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.131 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.131 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.131 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.131 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.131 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.131 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.131 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.131 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.131 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.131 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.131 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.131 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.132 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.132 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.132 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.132 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.132 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.132 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.132 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.132 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.132 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.132 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.132 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.132 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.132 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.133 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.133 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.133 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.133 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.133 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.133 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.133 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.133 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.133 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.133 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.133 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.133 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.133 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.133 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.134 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.134 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.134 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.134 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__:inst__myobj", 2024-09-19T11:45:23.134 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj" 2024-09-19T11:45:23.134 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.134 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.134 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.134 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.134 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.134 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.134 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.134 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.134 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.135 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.135 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.135 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.135 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.135 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.135 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.135 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.135 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.135 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.135 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.135 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.135 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.135 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.135 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.135 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.136 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.136 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.136 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.136 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.136 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.136 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.136 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.136 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.136 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.136 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.136 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.136 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.137 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.137 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.137 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.137 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.137 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.137 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.137 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.137 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.137 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.137 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.137 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.137 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.137 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.137 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.138 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.138 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.138 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.138 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.138 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.138 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.138 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.138 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": "default-placement.data", 2024-09-19T11:45:23.138 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns:inst__myobj", 2024-09-19T11:45:23.138 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.138 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.138 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.138 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.139 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.139 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.139 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.139 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.139 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.139 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.139 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.139 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.139 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.139 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.139 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.139 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.139 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.140 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.140 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.140 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.140 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.140 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.140 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.140 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.140 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.140 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.140 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.140 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.140 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.140 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.140 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.141 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.141 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.141 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.141 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.141 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.141 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.141 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.141 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.141 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.141 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.141 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.141 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.141 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.141 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.141 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.142 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.142 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.142 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.142 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.142 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.142 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.142 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.142 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.142 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.142 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.142 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.142 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.142 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.142 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns:inst__myobj", 2024-09-19T11:45:23.142 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.143 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.143 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.143 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.143 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.143 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.143 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.143 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.143 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.143 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.143 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.143 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.143 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.143 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.143 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.144 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.144 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.144 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.144 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.144 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.144 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.144 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.144 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.144 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.144 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.144 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.144 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.144 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.144 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.145 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.145 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.145 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.145 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.145 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.145 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.145 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.145 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.145 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.145 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.145 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.145 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.145 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.145 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.146 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.146 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.146 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.146 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.146 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.146 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.146 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.146 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.146 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.146 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.146 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.146 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.146 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.146 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": "default-placement.data", 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker___myobj_", 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj_" 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.147 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.148 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.148 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.148 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.148 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.148 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.148 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.148 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.148 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.148 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.148 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.148 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.148 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.148 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.148 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.148 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.149 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.149 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.149 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.149 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.149 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.149 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.149 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.149 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.149 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.149 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.149 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.149 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.149 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.149 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.150 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.150 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.150 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.150 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.150 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.150 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.150 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.150 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.150 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.150 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.150 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.150 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.150 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.150 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker___myobj_", 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj_" 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.151 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.152 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.152 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.152 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.152 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.152 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.152 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.152 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.152 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.152 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.152 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.152 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.152 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.152 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.152 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.153 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.153 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.153 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.153 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.153 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.153 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.153 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.153 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.153 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.153 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.153 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.153 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.153 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.153 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.154 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.154 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.154 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.154 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.154 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.154 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.154 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.154 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.154 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.154 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.154 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.154 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.154 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.154 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.155 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.155 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.155 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.155 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.155 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": "default-placement.data", 2024-09-19T11:45:23.155 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns__myobj_", 2024-09-19T11:45:23.155 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.155 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.155 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.155 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.155 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.155 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.155 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.155 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.155 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.156 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.156 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.156 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.156 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.156 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.156 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.156 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.156 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.156 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.156 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.156 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.156 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.156 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.156 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.157 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.157 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.157 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.157 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.157 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.157 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.157 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.157 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.157 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.157 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.157 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.157 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.157 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.158 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.158 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.158 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.158 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.158 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.158 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.158 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.158 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.158 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.158 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.158 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.158 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.158 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.158 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.159 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.159 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.159 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.159 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.159 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.159 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.159 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.159 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.159 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.159 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns__myobj_", 2024-09-19T11:45:23.159 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.159 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.159 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.159 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.160 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.160 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.160 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.160 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.160 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.160 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.160 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.160 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.160 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.160 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.160 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.160 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.160 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.161 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.161 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.161 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.161 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.161 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.161 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.161 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.161 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.161 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.161 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.161 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.161 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.161 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.161 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.162 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.162 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.162 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.162 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.162 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.162 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.162 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.162 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.162 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.162 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.162 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.162 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.162 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.163 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.163 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.163 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.163 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.163 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.163 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.163 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.163 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.163 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.163 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.163 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.163 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.163 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.163 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.164 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": "default-placement.data", 2024-09-19T11:45:23.164 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__:inst__myobj_", 2024-09-19T11:45:23.164 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj_" 2024-09-19T11:45:23.164 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.164 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.164 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.164 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.164 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.164 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.164 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.164 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.164 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.164 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.165 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.165 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.165 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.165 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.165 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.165 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.165 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.165 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.165 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.165 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.165 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.165 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.165 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.165 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.166 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.166 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.166 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.166 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.166 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.166 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.166 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.166 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.166 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.166 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.166 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.166 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.166 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.166 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.167 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.167 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.167 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.167 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.167 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.167 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.167 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.167 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.167 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.167 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.167 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.167 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.167 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.167 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.168 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.168 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.168 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.168 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.168 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.168 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.168 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__:inst__myobj_", 2024-09-19T11:45:23.168 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj_" 2024-09-19T11:45:23.168 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.168 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.168 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.168 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.168 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.168 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.169 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.169 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.169 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.169 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.169 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.169 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.169 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.169 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.169 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.169 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.169 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.169 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.169 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.169 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.170 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.170 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.170 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.170 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.170 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.170 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.170 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.170 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.170 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.170 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.170 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.170 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.170 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.170 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.170 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.171 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.171 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.171 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.171 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.171 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.171 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.171 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.171 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.171 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.171 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.171 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.171 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.171 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.171 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.172 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.172 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.172 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.172 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.172 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.172 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.172 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.172 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.172 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": "default-placement.data", 2024-09-19T11:45:23.172 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-19T11:45:23.172 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.172 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.172 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.172 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.172 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.173 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.173 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "test", 2024-09-19T11:45:23.173 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.173 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.173 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.173 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.173 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": "", 2024-09-19T11:45:23.173 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.173 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": "" 2024-09-19T11:45:23.173 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.173 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.173 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.173 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.173 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.173 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.174 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.174 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.174 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.174 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.174 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.174 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.174 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.174 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.174 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.174 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.174 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.174 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.174 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.174 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.174 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.175 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.175 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.175 INFO:tasks.workunit.client.0.smithi120.stdout: "obj": { 2024-09-19T11:45:23.175 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.175 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.175 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.175 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.175 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.175 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.175 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.175 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.175 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.175 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.175 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.176 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.176 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.176 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.176 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.176 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.176 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.176 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.176 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.176 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.176 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.176 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-19T11:45:23.176 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.176 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.176 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.176 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.177 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.177 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.177 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.177 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.177 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.177 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.177 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.177 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.177 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.177 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.177 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.177 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.177 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.177 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.177 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.178 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.178 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.178 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.178 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.178 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-19T11:45:23.178 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-19T11:45:23.178 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.178 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.178 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.178 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker_myobj", 2024-09-19T11:45:23.178 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.178 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.178 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.178 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.178 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.179 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.179 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.179 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.179 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.179 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.179 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.179 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.179 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.179 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.179 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.179 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.179 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.179 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.179 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.180 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.180 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.180 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.180 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.180 INFO:tasks.workunit.client.0.smithi120.stdout:raw=.data-pool:marker_myobj 2024-09-19T11:45:23.180 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.180 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj2": { 2024-09-19T11:45:23.180 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.180 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker_myobj", 2024-09-19T11:45:23.180 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.180 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.180 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.180 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.180 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj2": { 2024-09-19T11:45:23.181 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.181 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.181 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.181 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.181 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.181 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.181 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.181 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.181 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.181 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.181 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.181 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.181 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.181 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.182 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.182 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.182 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.182 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.182 INFO:tasks.workunit.client.0.smithi120.stdout:raw2=.data-pool:marker_myobj 2024-09-19T11:45:23.182 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.182 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.182 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.182 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns_myobj", 2024-09-19T11:45:23.182 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.182 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.182 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.182 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.183 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.183 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.183 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.183 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.183 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.183 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.183 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.183 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.183 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.183 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.183 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.183 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.183 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.183 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.183 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.184 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.184 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.184 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.184 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.184 INFO:tasks.workunit.client.0.smithi120.stdout:raw=.data-pool:marker__ns_myobj 2024-09-19T11:45:23.184 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.184 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj2": { 2024-09-19T11:45:23.184 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.184 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns_myobj", 2024-09-19T11:45:23.184 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.184 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.184 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.184 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.184 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj2": { 2024-09-19T11:45:23.185 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.185 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.185 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.185 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.185 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.185 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.185 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.185 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.185 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.185 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.185 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.185 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.185 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.185 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.186 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.186 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.186 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.186 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.186 INFO:tasks.workunit.client.0.smithi120.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-19T11:45:23.186 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.186 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.186 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.186 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__:inst_myobj", 2024-09-19T11:45:23.186 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.186 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.186 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.186 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.186 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.187 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.187 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.187 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.187 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.187 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.187 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.187 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.187 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.187 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.187 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.187 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.187 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.187 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.187 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.188 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.188 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.188 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.188 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.188 INFO:tasks.workunit.client.0.smithi120.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-19T11:45:23.188 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.188 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj2": { 2024-09-19T11:45:23.188 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.188 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__:inst_myobj", 2024-09-19T11:45:23.188 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.188 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.188 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.188 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.188 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj2": { 2024-09-19T11:45:23.189 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.189 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.189 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.189 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.189 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.189 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.189 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.189 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.189 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.189 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.189 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.189 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.189 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.190 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.190 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.190 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.190 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.190 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.190 INFO:tasks.workunit.client.0.smithi120.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-19T11:45:23.190 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.190 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.190 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.190 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns:inst_myobj", 2024-09-19T11:45:23.190 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.190 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.190 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.190 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.190 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.191 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.191 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.191 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.191 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.191 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.191 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.191 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.191 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.191 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.191 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.191 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.191 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.191 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.191 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.191 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.192 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.192 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.192 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.192 INFO:tasks.workunit.client.0.smithi120.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-19T11:45:23.192 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.192 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj2": { 2024-09-19T11:45:23.192 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.192 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns:inst_myobj", 2024-09-19T11:45:23.192 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.192 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.192 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.192 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.192 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj2": { 2024-09-19T11:45:23.193 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.193 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.193 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.193 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.193 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.193 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.193 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.193 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.193 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.193 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.193 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.193 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.193 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "myobj", 2024-09-19T11:45:23.193 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.193 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.194 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.194 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.194 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.194 INFO:tasks.workunit.client.0.smithi120.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-19T11:45:23.194 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.194 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.194 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.194 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker___myobj", 2024-09-19T11:45:23.194 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj" 2024-09-19T11:45:23.194 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.194 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.194 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.194 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.194 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.194 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.195 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.196 INFO:tasks.workunit.client.0.smithi120.stdout:raw=.data-pool:marker___myobj 2024-09-19T11:45:23.196 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.196 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj2": { 2024-09-19T11:45:23.196 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.196 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker___myobj", 2024-09-19T11:45:23.196 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj" 2024-09-19T11:45:23.196 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.196 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.196 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.196 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj2": { 2024-09-19T11:45:23.196 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.196 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.196 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.197 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.197 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.197 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.197 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.197 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.197 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.197 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.197 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.197 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.197 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.197 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.197 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.197 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.198 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.198 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.198 INFO:tasks.workunit.client.0.smithi120.stdout:raw2=.data-pool:marker___myobj 2024-09-19T11:45:23.198 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.198 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.198 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.198 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns__myobj", 2024-09-19T11:45:23.198 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.198 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.198 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.198 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.198 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.198 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.198 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.199 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.199 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.199 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.199 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.199 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.199 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.199 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.199 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.199 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.199 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.199 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.199 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.199 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.199 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.200 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.200 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.200 INFO:tasks.workunit.client.0.smithi120.stdout:raw=.data-pool:marker__ns__myobj 2024-09-19T11:45:23.200 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.200 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj2": { 2024-09-19T11:45:23.200 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.200 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns__myobj", 2024-09-19T11:45:23.200 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.200 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.200 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.200 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.200 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj2": { 2024-09-19T11:45:23.200 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.200 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.201 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.201 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.201 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.201 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.201 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.201 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.201 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.201 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.201 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.201 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.201 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.201 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.201 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.201 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.202 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.202 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.202 INFO:tasks.workunit.client.0.smithi120.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-19T11:45:23.202 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.202 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.202 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.202 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__:inst__myobj", 2024-09-19T11:45:23.202 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj" 2024-09-19T11:45:23.202 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.202 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.202 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.202 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.202 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.203 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.203 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.203 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.203 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.203 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.203 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.203 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.203 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.203 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.203 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.203 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.203 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.203 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.203 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.203 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj2": { 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__:inst__myobj", 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj" 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj2": { 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.204 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.205 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.205 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.205 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.205 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.205 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.205 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.205 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.205 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.205 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.205 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.205 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.205 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.205 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.205 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.206 INFO:tasks.workunit.client.0.smithi120.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-19T11:45:23.206 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.206 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.206 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.206 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns:inst__myobj", 2024-09-19T11:45:23.206 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.206 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.206 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.206 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.206 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.206 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.206 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.206 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.206 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.207 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.207 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.207 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.207 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.207 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.207 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.207 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.207 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.207 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.207 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.207 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.207 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.207 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.207 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.208 INFO:tasks.workunit.client.0.smithi120.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-19T11:45:23.208 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.208 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj2": { 2024-09-19T11:45:23.208 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.208 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns:inst__myobj", 2024-09-19T11:45:23.208 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.208 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.208 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.208 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.208 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj2": { 2024-09-19T11:45:23.208 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.208 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.208 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.209 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.209 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.209 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.209 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.209 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.209 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.209 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.209 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.209 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.209 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj", 2024-09-19T11:45:23.209 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.209 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.209 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.209 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.210 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.210 INFO:tasks.workunit.client.0.smithi120.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-19T11:45:23.210 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.210 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.210 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.210 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker___myobj_", 2024-09-19T11:45:23.210 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj_" 2024-09-19T11:45:23.210 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.210 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.210 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.210 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.210 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.210 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.210 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.210 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.211 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.211 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.211 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.211 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.211 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.211 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.211 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.211 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.211 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.211 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.211 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.211 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.211 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.211 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.211 INFO:tasks.workunit.client.0.smithi120.stdout:raw=.data-pool:marker___myobj_ 2024-09-19T11:45:23.212 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.212 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj2": { 2024-09-19T11:45:23.212 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.212 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker___myobj_", 2024-09-19T11:45:23.212 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj_" 2024-09-19T11:45:23.212 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.212 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.212 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.212 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj2": { 2024-09-19T11:45:23.212 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.212 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.212 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.212 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.212 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.213 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.213 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.213 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.213 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.213 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.213 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.213 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.213 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.213 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.213 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.213 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.213 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.213 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.213 INFO:tasks.workunit.client.0.smithi120.stdout:raw2=.data-pool:marker___myobj_ 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns__myobj_", 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.214 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.215 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.215 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.215 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.215 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.215 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.215 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.215 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.215 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.215 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.215 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.215 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.215 INFO:tasks.workunit.client.0.smithi120.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-19T11:45:23.215 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.216 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj2": { 2024-09-19T11:45:23.216 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.216 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns__myobj_", 2024-09-19T11:45:23.216 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.216 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.216 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.216 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.216 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj2": { 2024-09-19T11:45:23.216 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.216 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.216 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.216 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.216 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.216 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.217 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.217 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.217 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.217 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.217 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.217 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.217 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.217 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "", 2024-09-19T11:45:23.217 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.217 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.217 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.217 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.217 INFO:tasks.workunit.client.0.smithi120.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-19T11:45:23.217 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.218 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.218 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.218 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__:inst__myobj_", 2024-09-19T11:45:23.218 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj_" 2024-09-19T11:45:23.218 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.218 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.218 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.218 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.218 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.218 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.218 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.218 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.218 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.218 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.219 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.219 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.219 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.219 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.219 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.219 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.219 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.219 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.219 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.219 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.219 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.219 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.219 INFO:tasks.workunit.client.0.smithi120.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-19T11:45:23.219 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.219 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj2": { 2024-09-19T11:45:23.220 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.220 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__:inst__myobj_", 2024-09-19T11:45:23.220 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "marker__myobj_" 2024-09-19T11:45:23.220 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.220 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.220 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.220 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj2": { 2024-09-19T11:45:23.220 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.220 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.220 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.220 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.220 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.220 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.220 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.221 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.221 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.221 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.221 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.221 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.221 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.221 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.221 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "" 2024-09-19T11:45:23.221 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.221 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.221 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.221 INFO:tasks.workunit.client.0.smithi120.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-19T11:45:23.221 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.221 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj": { 2024-09-19T11:45:23.222 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.222 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-19T11:45:23.222 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.222 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.222 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.222 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.222 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj": { 2024-09-19T11:45:23.222 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.222 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.222 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.222 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.222 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.222 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.222 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.223 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.223 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.223 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.223 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.223 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.223 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.223 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.223 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.223 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.223 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.223 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.223 INFO:tasks.workunit.client.0.smithi120.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-19T11:45:23.223 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.223 INFO:tasks.workunit.client.0.smithi120.stdout: "raw_obj2": { 2024-09-19T11:45:23.224 INFO:tasks.workunit.client.0.smithi120.stdout: "pool": ".data-pool", 2024-09-19T11:45:23.224 INFO:tasks.workunit.client.0.smithi120.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-19T11:45:23.224 INFO:tasks.workunit.client.0.smithi120.stdout: "loc": "" 2024-09-19T11:45:23.224 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.224 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.224 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.224 INFO:tasks.workunit.client.0.smithi120.stdout: "new_obj2": { 2024-09-19T11:45:23.224 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket": { 2024-09-19T11:45:23.224 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "ebtest", 2024-09-19T11:45:23.224 INFO:tasks.workunit.client.0.smithi120.stdout: "marker": "marker", 2024-09-19T11:45:23.224 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_id": "bucket-id", 2024-09-19T11:45:23.224 INFO:tasks.workunit.client.0.smithi120.stdout: "tenant": "", 2024-09-19T11:45:23.224 INFO:tasks.workunit.client.0.smithi120.stdout: "explicit_placement": { 2024-09-19T11:45:23.224 INFO:tasks.workunit.client.0.smithi120.stdout: "data_pool": ".data-pool", 2024-09-19T11:45:23.224 INFO:tasks.workunit.client.0.smithi120.stdout: "data_extra_pool": "", 2024-09-19T11:45:23.225 INFO:tasks.workunit.client.0.smithi120.stdout: "index_pool": ".index-pool" 2024-09-19T11:45:23.225 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.225 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.225 INFO:tasks.workunit.client.0.smithi120.stdout: "key": { 2024-09-19T11:45:23.225 INFO:tasks.workunit.client.0.smithi120.stdout: "name": "_myobj_", 2024-09-19T11:45:23.225 INFO:tasks.workunit.client.0.smithi120.stdout: "instance": "inst", 2024-09-19T11:45:23.225 INFO:tasks.workunit.client.0.smithi120.stdout: "ns": "ns" 2024-09-19T11:45:23.225 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.225 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.225 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.225 INFO:tasks.workunit.client.0.smithi120.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-19T11:45:23.225 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] TestRGWObj.old_to_raw (1 ms) 2024-09-19T11:45:23.225 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-19T11:45:23.225 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:45:23.226 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:45:23.226 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-19T11:45:23.226 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 4 tests. 2024-09-19T11:45:23.226 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:45:23.226 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:45:23.240 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-19T11:45:23.242 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-19T11:45:23.242 DEBUG:teuthology.orchestra.run.smithi120:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-19T11:45:23.376 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:45:23.376 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:45:23.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.420+0000 7fe8b8d129c0 20 rados->read ofs=0 len=0 2024-09-19T11:45:23.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.420+0000 7fe8b8d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:45:23.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.420+0000 7fe8b8d129c0 20 realm 2024-09-19T11:45:23.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.420+0000 7fe8b8d129c0 20 rados->read ofs=0 len=0 2024-09-19T11:45:23.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.420+0000 7fe8b8d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:45:23.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.420+0000 7fe8b8d129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:45:23.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.420+0000 7fe8b8d129c0 20 rados->read ofs=0 len=0 2024-09-19T11:45:23.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.420+0000 7fe8b8d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:45:23.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.420+0000 7fe8b8d129c0 20 rados->read ofs=0 len=0 2024-09-19T11:45:23.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.424+0000 7fe8b8d129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:45:23.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.424+0000 7fe8b8d129c0 20 rados->read ofs=0 len=0 2024-09-19T11:45:23.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.424+0000 7fe8b8d129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:45:23.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.424+0000 7fe8b8d129c0 20 searching for the correct realm 2024-09-19T11:45:23.428 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.428+0000 7fe8b7019640 0 -- 172.21.15.120:0/3076526353 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fe8ac10c310 msgr2=0x7fe8ac10bce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:45:23.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.436+0000 7fe8b6017640 0 -- 172.21.15.120:0/3076526353 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fe8a8008070 msgr2=0x7fe8a8080750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:45:23.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.652+0000 7fe8b8d129c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:45:23.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.652+0000 7fe8b8d129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:45:23.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.652+0000 7fe8b8d129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:45:23.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.652+0000 7fe8b8d129c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:45:23.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.652+0000 7fe8b8d129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:45:23.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.652+0000 7fe8b8d129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:45:23.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.652+0000 7fe8b8d129c0 20 rados->read ofs=0 len=0 2024-09-19T11:45:23.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:45:23.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 20 rados->read ofs=0 len=0 2024-09-19T11:45:23.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:45:23.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 20 rados->read ofs=0 len=0 2024-09-19T11:45:23.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:45:23.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 20 zone default found 2024-09-19T11:45:23.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 4 Realm: () 2024-09-19T11:45:23.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:45:23.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:45:23.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:45:23.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 20 zonegroup default 2024-09-19T11:45:23.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 20 rados->read ofs=0 len=0 2024-09-19T11:45:23.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:45:23.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 20 rados->read ofs=0 len=0 2024-09-19T11:45:23.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:45:23.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 20 rados->read ofs=0 len=0 2024-09-19T11:45:23.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:45:23.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 20 started sync module instance, tier type = 2024-09-19T11:45:23.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.656+0000 7fe8b8d129c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:45:23.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.680+0000 7fe8b8d129c0 20 add_watcher() i=0 2024-09-19T11:45:23.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.680+0000 7fe8b8d129c0 20 add_watcher() i=1 2024-09-19T11:45:23.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.680+0000 7fe8b8d129c0 20 add_watcher() i=2 2024-09-19T11:45:23.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.680+0000 7fe8b8d129c0 20 add_watcher() i=3 2024-09-19T11:45:23.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.680+0000 7fe8b8d129c0 20 add_watcher() i=4 2024-09-19T11:45:23.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.680+0000 7fe8b8d129c0 20 add_watcher() i=5 2024-09-19T11:45:23.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.680+0000 7fe8b8d129c0 20 add_watcher() i=6 2024-09-19T11:45:23.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.680+0000 7fe8b8d129c0 20 add_watcher() i=7 2024-09-19T11:45:23.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.680+0000 7fe8b8d129c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:45:23.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.684+0000 7fe76d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:45:23.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.684+0000 7fe8b8d129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:45:23.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.684+0000 7fe8b8d129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:45:23.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.684+0000 7fe8b8d129c0 5 note: GC not initialized 2024-09-19T11:45:23.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe6e7fff640 20 reqs_thread_entry: start 2024-09-19T11:45:23.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 20 init_complete bucket index max shards: 1 2024-09-19T11:45:23.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 20 Filter name: none 2024-09-19T11:45:23.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe6e5ffb640 20 reqs_thread_entry: start 2024-09-19T11:45:23.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-19T11:45:23.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 20 rados->read ofs=0 len=0 2024-09-19T11:45:23.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:45:23.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-19T11:45:23.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-19T11:45:23.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-19T11:45:23.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 20 rados->read ofs=0 len=0 2024-09-19T11:45:23.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:45:23.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-19T11:45:23.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-19T11:45:23.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 10 cache get: name=default.rgw.meta+users.keys+rzwqiRrDYm7uBmxhiO65Bxq67z8= : miss 2024-09-19T11:45:23.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 20 rados->read ofs=0 len=0 2024-09-19T11:45:23.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:45:23.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 10 cache put: name=default.rgw.meta+users.keys+rzwqiRrDYm7uBmxhiO65Bxq67z8= info.flags=0x0 2024-09-19T11:45:23.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 10 adding default.rgw.meta+users.keys+rzwqiRrDYm7uBmxhiO65Bxq67z8= to cache LRU end 2024-09-19T11:45:23.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 10 cache get: name=default.rgw.meta+users.keys+rzwqiRrDYm7uBmxhiO65Bxq67z8= : hit (negative entry) 2024-09-19T11:45:23.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.688+0000 7fe8b8d129c0 10 cache get: name=default.rgw.meta+users.keys+rzwqiRrDYm7uBmxhiO65Bxq67z8= : hit (negative entry) 2024-09-19T11:45:23.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.692+0000 7fe8b8d129c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-19T11:45:23.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.692+0000 7fe8b8d129c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-19T11:45:23.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.692+0000 7fe8b8d129c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-19T11:45:23.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.692+0000 7fe79a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725890 cookie 94189663285936 notifier 5336 bl.length()=697 2024-09-19T11:45:23.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.692+0000 7fe79a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-19T11:45:23.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.692+0000 7fe79a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-19T11:45:23.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.696+0000 7fe8b8d129c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-19T11:45:23.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.696+0000 7fe8b8d129c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-19T11:45:23.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.696+0000 7fe8b8d129c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-19T11:45:23.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.696+0000 7fe79a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725888 cookie 94189663282384 notifier 5336 bl.length()=194 2024-09-19T11:45:23.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.696+0000 7fe79a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-19T11:45:23.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.696+0000 7fe79a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-19T11:45:23.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.700+0000 7fe8b8d129c0 10 cache put: name=default.rgw.meta+users.keys+rzwqiRrDYm7uBmxhiO65Bxq67z8= info.flags=0x7 2024-09-19T11:45:23.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.700+0000 7fe8b8d129c0 10 moving default.rgw.meta+users.keys+rzwqiRrDYm7uBmxhiO65Bxq67z8= to cache LRU end 2024-09-19T11:45:23.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.700+0000 7fe8b8d129c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:rzwqiRrDYm7uBmxhiO65Bxq67z8=, ofs0, ns] 2024-09-19T11:45:23.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.700+0000 7fe799ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725893 cookie 94189663293600 notifier 5336 bl.length()=203 2024-09-19T11:45:23.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.700+0000 7fe799ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+rzwqiRrDYm7uBmxhiO65Bxq67z8= info.flags=0x7 2024-09-19T11:45:23.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.700+0000 7fe799ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+rzwqiRrDYm7uBmxhiO65Bxq67z8= to cache LRU end 2024-09-19T11:45:23.705 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:45:23.705 INFO:tasks.workunit.client.0.smithi120.stdout: "user_id": "ceph-test-librgw-file", 2024-09-19T11:45:23.705 INFO:tasks.workunit.client.0.smithi120.stdout: "display_name": "librgw test user", 2024-09-19T11:45:23.705 INFO:tasks.workunit.client.0.smithi120.stdout: "email": "librgw@example.com", 2024-09-19T11:45:23.705 INFO:tasks.workunit.client.0.smithi120.stdout: "suspended": 0, 2024-09-19T11:45:23.705 INFO:tasks.workunit.client.0.smithi120.stdout: "max_buckets": 1000, 2024-09-19T11:45:23.705 INFO:tasks.workunit.client.0.smithi120.stdout: "subusers": [], 2024-09-19T11:45:23.705 INFO:tasks.workunit.client.0.smithi120.stdout: "keys": [ 2024-09-19T11:45:23.706 INFO:tasks.workunit.client.0.smithi120.stdout: { 2024-09-19T11:45:23.706 INFO:tasks.workunit.client.0.smithi120.stdout: "user": "ceph-test-librgw-file", 2024-09-19T11:45:23.706 INFO:tasks.workunit.client.0.smithi120.stdout: "access_key": "rzwqiRrDYm7uBmxhiO65Bxq67z8=", 2024-09-19T11:45:23.706 INFO:tasks.workunit.client.0.smithi120.stdout: "secret_key": "UzxsChwRmR5V6e1/NCmtX3jN5QhqaJKBtjhkUBEJM21V7oZVjqVRow==", 2024-09-19T11:45:23.706 INFO:tasks.workunit.client.0.smithi120.stdout: "active": true, 2024-09-19T11:45:23.706 INFO:tasks.workunit.client.0.smithi120.stdout: "create_date": "2024-09-19T11:45:23.693078Z" 2024-09-19T11:45:23.706 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:45:23.706 INFO:tasks.workunit.client.0.smithi120.stdout: ], 2024-09-19T11:45:23.706 INFO:tasks.workunit.client.0.smithi120.stdout: "swift_keys": [], 2024-09-19T11:45:23.706 INFO:tasks.workunit.client.0.smithi120.stdout: "caps": [], 2024-09-19T11:45:23.706 INFO:tasks.workunit.client.0.smithi120.stdout: "op_mask": "read, write, delete", 2024-09-19T11:45:23.706 INFO:tasks.workunit.client.0.smithi120.stdout: "default_placement": "", 2024-09-19T11:45:23.706 INFO:tasks.workunit.client.0.smithi120.stdout: "default_storage_class": "", 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: "placement_tags": [], 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_quota": { 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: "enabled": false, 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: "check_on_raw": false, 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: "max_size": -1, 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: "max_size_kb": 0, 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: "max_objects": -1 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: "user_quota": { 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: "enabled": false, 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: "check_on_raw": false, 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: "max_size": -1, 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: "max_size_kb": 0, 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: "max_objects": -1 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:45:23.707 INFO:tasks.workunit.client.0.smithi120.stdout: "temp_url_keys": [], 2024-09-19T11:45:23.708 INFO:tasks.workunit.client.0.smithi120.stdout: "type": "rgw", 2024-09-19T11:45:23.708 INFO:tasks.workunit.client.0.smithi120.stdout: "mfa_ids": [], 2024-09-19T11:45:23.708 INFO:tasks.workunit.client.0.smithi120.stdout: "account_id": "", 2024-09-19T11:45:23.708 INFO:tasks.workunit.client.0.smithi120.stdout: "path": "/", 2024-09-19T11:45:23.708 INFO:tasks.workunit.client.0.smithi120.stdout: "create_date": "2024-09-19T11:45:23.693059Z", 2024-09-19T11:45:23.708 INFO:tasks.workunit.client.0.smithi120.stdout: "tags": [], 2024-09-19T11:45:23.708 INFO:tasks.workunit.client.0.smithi120.stdout: "group_ids": [] 2024-09-19T11:45:23.708 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:45:23.708 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:45:23.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.704+0000 7fe76d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:45:23.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.708+0000 7fe8b8d129c0 20 remove_watcher() i=0 2024-09-19T11:45:23.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.708+0000 7fe8b8d129c0 2 removed watcher, disabling cache 2024-09-19T11:45:23.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.708+0000 7fe8b8d129c0 20 remove_watcher() i=1 2024-09-19T11:45:23.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.712+0000 7fe8b8d129c0 20 remove_watcher() i=2 2024-09-19T11:45:23.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.712+0000 7fe8b8d129c0 20 remove_watcher() i=3 2024-09-19T11:45:23.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.716+0000 7fe8b8d129c0 20 remove_watcher() i=4 2024-09-19T11:45:23.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.716+0000 7fe8b8d129c0 20 remove_watcher() i=5 2024-09-19T11:45:23.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.720+0000 7fe8b8d129c0 20 remove_watcher() i=6 2024-09-19T11:45:23.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:23.720+0000 7fe8b8d129c0 20 remove_watcher() i=7 2024-09-19T11:45:23.736 INFO:tasks.workunit.client.0.smithi120.stdout:phase 1.1 2024-09-19T11:45:23.754 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-19T11:45:23.754 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:45:23.754 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 24 tests from LibRGW 2024-09-19T11:45:23.754 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.INIT 2024-09-19T11:45:23.766 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:45:23.767 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:45:24.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.INIT (590 ms) 2024-09-19T11:45:24.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-19T11:45:24.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-19T11:45:24.349 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T11:45:24.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-19T11:45:24.350 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-19T11:45:24.361 INFO:tasks.workunit.client.0.smithi120.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-19T11:45:24.369 INFO:tasks.workunit.client.0.smithi120.stdout:creating: nfsroot:foo/f1 2024-09-19T11:45:24.377 INFO:tasks.workunit.client.0.smithi120.stdout:creating: nfsroot:foo/f2 2024-09-19T11:45:24.384 INFO:tasks.workunit.client.0.smithi120.stdout:creating: nfsroot:foo/bar/f1 2024-09-19T11:45:24.391 INFO:tasks.workunit.client.0.smithi120.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-19T11:45:24.398 INFO:tasks.workunit.client.0.smithi120.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-19T11:45:24.405 INFO:tasks.workunit.client.0.smithi120.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-19T11:45:24.413 INFO:tasks.workunit.client.0.smithi120.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-19T11:45:24.421 INFO:tasks.workunit.client.0.smithi120.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-19T11:45:24.427 INFO:tasks.workunit.client.0.smithi120.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-19T11:45:24.434 INFO:tasks.workunit.client.0.smithi120.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-19T11:45:24.441 INFO:tasks.workunit.client.0.smithi120.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-19T11:45:24.449 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SETUP_HIER1 (103 ms) 2024-09-19T11:45:24.449 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-19T11:45:24.654 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SETUP_DIRS1 (205 ms) 2024-09-19T11:45:24.654 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SETATTR 2024-09-19T11:45:24.654 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-19T11:45:24.655 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-19T11:45:24.692 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (38 ms) 2024-09-19T11:45:24.692 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-19T11:45:24.778 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (86 ms) 2024-09-19T11:45:24.778 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-19T11:45:24.778 INFO:tasks.workunit.client.0.smithi120.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-19T11:45:24.793 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (15 ms) 2024-09-19T11:45:24.793 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-19T11:45:24.793 INFO:tasks.workunit.client.0.smithi120.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-19T11:45:24.810 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (17 ms) 2024-09-19T11:45:24.810 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-19T11:45:24.810 INFO:tasks.workunit.client.0.smithi120.stdout:scanning objects in /bdirs1/dir_0 2024-09-19T11:45:24.810 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T11:45:24.810 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T11:45:24.810 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T11:45:24.810 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T11:45:24.810 INFO:tasks.workunit.client.0.smithi120.stdout:scanning objects in /bdirs1/dir_1 2024-09-19T11:45:24.810 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T11:45:24.810 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T11:45:24.810 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T11:45:24.810 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T11:45:24.811 INFO:tasks.workunit.client.0.smithi120.stdout:scanning objects in /bdirs1/dir_2 2024-09-19T11:45:24.811 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T11:45:24.811 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T11:45:24.811 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T11:45:24.811 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T11:45:24.811 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-19T11:45:24.811 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-19T11:45:24.811 INFO:tasks.workunit.client.0.smithi120.stdout:read back objects in /bdirs1/dir_0 2024-09-19T11:45:24.811 INFO:tasks.workunit.client.0.smithi120.stdout:reading 0,256 dir_0/sfile_0 2024-09-19T11:45:24.814 INFO:tasks.workunit.client.0.smithi120.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T11:45:24.814 INFO:tasks.workunit.client.0.smithi120.stdout:reading 0,256 dir_0/sfile_1 2024-09-19T11:45:24.818 INFO:tasks.workunit.client.0.smithi120.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T11:45:24.818 INFO:tasks.workunit.client.0.smithi120.stdout:read back objects in /bdirs1/dir_1 2024-09-19T11:45:24.818 INFO:tasks.workunit.client.0.smithi120.stdout:reading 0,256 dir_1/sfile_0 2024-09-19T11:45:24.820 INFO:tasks.workunit.client.0.smithi120.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T11:45:24.821 INFO:tasks.workunit.client.0.smithi120.stdout:reading 0,256 dir_1/sfile_1 2024-09-19T11:45:24.825 INFO:tasks.workunit.client.0.smithi120.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T11:45:24.825 INFO:tasks.workunit.client.0.smithi120.stdout:read back objects in /bdirs1/dir_2 2024-09-19T11:45:24.825 INFO:tasks.workunit.client.0.smithi120.stdout:reading 0,256 dir_2/sfile_0 2024-09-19T11:45:24.828 INFO:tasks.workunit.client.0.smithi120.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T11:45:24.828 INFO:tasks.workunit.client.0.smithi120.stdout:reading 0,256 dir_2/sfile_1 2024-09-19T11:45:24.832 INFO:tasks.workunit.client.0.smithi120.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T11:45:24.832 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.READ_DIRS1 (22 ms) 2024-09-19T11:45:24.832 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-19T11:45:25.057 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.READF_SETUP1 (225 ms) 2024-09-19T11:45:25.057 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-19T11:45:25.057 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-19T11:45:25.057 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-19T11:45:25.057 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-19T11:45:25.057 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-19T11:45:25.057 INFO:tasks.workunit.client.0.smithi120.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T11:45:25.057 INFO:tasks.workunit.client.0.smithi120.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T11:45:25.057 INFO:tasks.workunit.client.0.smithi120.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T11:45:25.058 INFO:tasks.workunit.client.0.smithi120.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T11:45:25.058 INFO:tasks.workunit.client.0.smithi120.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T11:45:25.058 INFO:tasks.workunit.client.0.smithi120.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T11:45:25.058 INFO:tasks.workunit.client.0.smithi120.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T11:45:25.058 INFO:tasks.workunit.client.0.smithi120.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T11:45:25.058 INFO:tasks.workunit.client.0.smithi120.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T11:45:25.058 INFO:tasks.workunit.client.0.smithi120.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T11:45:25.058 INFO:tasks.workunit.client.0.smithi120.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T11:45:25.058 INFO:tasks.workunit.client.0.smithi120.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T11:45:25.058 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-19T11:45:25.058 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.HIER1 2024-09-19T11:45:25.071 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-19T11:45:25.072 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-19T11:45:25.077 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-19T11:45:25.081 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-19T11:45:25.086 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-19T11:45:25.087 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-19T11:45:25.087 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-19T11:45:25.088 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-19T11:45:25.089 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-19T11:45:25.090 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-19T11:45:25.091 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-19T11:45:25.095 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-19T11:45:25.095 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-19T11:45:25.095 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-19T11:45:25.095 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo (foo): DIR 2024-09-19T11:45:25.095 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot (nfsroot): DIR 2024-09-19T11:45:25.095 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.HIER1 (37 ms) 2024-09-19T11:45:25.095 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-19T11:45:25.095 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-19T11:45:25.095 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-19T11:45:25.095 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-19T11:45:25.095 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-19T11:45:25.095 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-19T11:45:25.095 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-19T11:45:25.096 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-19T11:45:25.096 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T11:45:25.096 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T11:45:25.096 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T11:45:25.096 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T11:45:25.096 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T11:45:25.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:25.092+0000 7f6cddf50a80 -1 shutting down 2024-09-19T11:45:25.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:25.096+0000 7f6bb7ca2640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57319, si_uid : 1000, si_addr0x3e80000dfe7, si_status0 2024-09-19T11:45:54.382 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SHUTDOWN (29287 ms) 2024-09-19T11:45:54.382 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 24 tests from LibRGW (30628 ms total) 2024-09-19T11:45:54.382 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:45:54.382 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:45:54.382 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 24 tests from 1 test suite ran. (30628 ms total) 2024-09-19T11:45:54.383 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 24 tests. 2024-09-19T11:45:54.395 INFO:tasks.workunit.client.0.smithi120.stdout:phase 1.2 2024-09-19T11:45:54.419 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-19T11:45:54.419 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:45:54.419 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 24 tests from LibRGW 2024-09-19T11:45:54.419 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.INIT 2024-09-19T11:45:54.429 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:45:54.429 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:45:54.989 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.INIT (570 ms) 2024-09-19T11:45:54.989 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-19T11:45:54.992 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-19T11:45:54.992 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T11:45:54.992 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-19T11:45:54.992 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-19T11:45:54.992 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-19T11:45:54.992 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-19T11:45:54.992 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-19T11:45:54.992 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SETATTR 2024-09-19T11:45:54.992 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-19T11:45:54.993 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-19T11:45:54.993 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-19T11:45:54.993 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-19T11:45:54.993 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-19T11:45:54.993 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-19T11:45:54.993 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-19T11:45:54.993 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-19T11:45:54.994 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-19T11:45:54.994 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-19T11:45:54.994 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-19T11:45:54.994 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-19T11:45:54.994 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-19T11:45:54.994 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-19T11:45:54.994 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-19T11:45:54.994 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-19T11:45:54.995 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-19T11:45:54.995 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-19T11:45:54.995 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-19T11:45:54.995 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-19T11:45:54.995 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-19T11:45:54.995 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.HIER1 2024-09-19T11:45:54.995 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-19T11:45:54.995 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-19T11:45:54.995 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-19T11:45:54.996 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-19T11:45:54.996 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-19T11:45:54.996 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-19T11:45:54.996 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-19T11:45:54.996 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-19T11:45:54.997 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-19T11:45:54.997 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T11:45:54.998 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T11:45:54.998 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T11:45:54.998 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T11:45:54.998 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T11:45:54.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:54.992+0000 7f714c852a80 -1 shutting down 2024-09-19T11:45:54.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:45:54.992+0000 7f70265a4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57966, si_uid : 1000, si_addr0x3e80000e26e, si_status0 2024-09-19T11:46:25.103 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SHUTDOWN (30112 ms) 2024-09-19T11:46:25.103 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 24 tests from LibRGW (30684 ms total) 2024-09-19T11:46:25.103 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:46:25.103 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:46:25.103 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 24 tests from 1 test suite ran. (30684 ms total) 2024-09-19T11:46:25.103 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 24 tests. 2024-09-19T11:46:25.114 INFO:tasks.workunit.client.0.smithi120.stdout:phase 1.3 2024-09-19T11:46:25.136 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-19T11:46:25.136 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:46:25.136 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 24 tests from LibRGW 2024-09-19T11:46:25.136 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.INIT 2024-09-19T11:46:25.148 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:46:25.148 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:46:25.914 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.INIT (779 ms) 2024-09-19T11:46:25.914 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-19T11:46:25.915 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-19T11:46:25.916 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T11:46:25.916 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-19T11:46:25.916 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-19T11:46:25.924 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SETUP_HIER1 (9 ms) 2024-09-19T11:46:25.924 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-19T11:46:26.052 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SETUP_DIRS1 (128 ms) 2024-09-19T11:46:26.052 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SETATTR 2024-09-19T11:46:26.052 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-19T11:46:26.052 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-19T11:46:26.053 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-19T11:46:26.053 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-19T11:46:26.053 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-19T11:46:26.053 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-19T11:46:26.053 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-19T11:46:26.053 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-19T11:46:26.053 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-19T11:46:26.053 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-19T11:46:26.053 INFO:tasks.workunit.client.0.smithi120.stdout:scanning objects in /bdirs1/dir_0 2024-09-19T11:46:26.053 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T11:46:26.053 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T11:46:26.053 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T11:46:26.053 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T11:46:26.054 INFO:tasks.workunit.client.0.smithi120.stdout:scanning objects in /bdirs1/dir_1 2024-09-19T11:46:26.054 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T11:46:26.054 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T11:46:26.054 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T11:46:26.054 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T11:46:26.054 INFO:tasks.workunit.client.0.smithi120.stdout:scanning objects in /bdirs1/dir_2 2024-09-19T11:46:26.054 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T11:46:26.054 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T11:46:26.054 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T11:46:26.054 INFO:tasks.workunit.client.0.smithi120.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T11:46:26.054 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-19T11:46:26.054 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-19T11:46:26.054 INFO:tasks.workunit.client.0.smithi120.stdout:read back objects in /bdirs1/dir_0 2024-09-19T11:46:26.055 INFO:tasks.workunit.client.0.smithi120.stdout:reading 0,256 dir_0/sfile_0 2024-09-19T11:46:26.055 INFO:tasks.workunit.client.0.smithi120.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T11:46:26.055 INFO:tasks.workunit.client.0.smithi120.stdout:reading 0,256 dir_0/sfile_1 2024-09-19T11:46:26.058 INFO:tasks.workunit.client.0.smithi120.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T11:46:26.058 INFO:tasks.workunit.client.0.smithi120.stdout:read back objects in /bdirs1/dir_1 2024-09-19T11:46:26.058 INFO:tasks.workunit.client.0.smithi120.stdout:reading 0,256 dir_1/sfile_0 2024-09-19T11:46:26.060 INFO:tasks.workunit.client.0.smithi120.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T11:46:26.060 INFO:tasks.workunit.client.0.smithi120.stdout:reading 0,256 dir_1/sfile_1 2024-09-19T11:46:26.062 INFO:tasks.workunit.client.0.smithi120.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T11:46:26.062 INFO:tasks.workunit.client.0.smithi120.stdout:read back objects in /bdirs1/dir_2 2024-09-19T11:46:26.063 INFO:tasks.workunit.client.0.smithi120.stdout:reading 0,256 dir_2/sfile_0 2024-09-19T11:46:26.065 INFO:tasks.workunit.client.0.smithi120.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T11:46:26.065 INFO:tasks.workunit.client.0.smithi120.stdout:reading 0,256 dir_2/sfile_1 2024-09-19T11:46:26.069 INFO:tasks.workunit.client.0.smithi120.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T11:46:26.069 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.READ_DIRS1 (16 ms) 2024-09-19T11:46:26.069 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-19T11:46:26.069 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-19T11:46:26.069 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-19T11:46:26.069 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-19T11:46:26.069 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-19T11:46:26.069 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-19T11:46:26.069 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-19T11:46:26.069 INFO:tasks.workunit.client.0.smithi120.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T11:46:26.069 INFO:tasks.workunit.client.0.smithi120.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T11:46:26.070 INFO:tasks.workunit.client.0.smithi120.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T11:46:26.070 INFO:tasks.workunit.client.0.smithi120.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T11:46:26.070 INFO:tasks.workunit.client.0.smithi120.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T11:46:26.070 INFO:tasks.workunit.client.0.smithi120.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T11:46:26.070 INFO:tasks.workunit.client.0.smithi120.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T11:46:26.070 INFO:tasks.workunit.client.0.smithi120.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T11:46:26.070 INFO:tasks.workunit.client.0.smithi120.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T11:46:26.070 INFO:tasks.workunit.client.0.smithi120.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T11:46:26.070 INFO:tasks.workunit.client.0.smithi120.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T11:46:26.070 INFO:tasks.workunit.client.0.smithi120.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T11:46:26.070 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-19T11:46:26.071 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.HIER1 2024-09-19T11:46:26.081 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-19T11:46:26.083 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-19T11:46:26.089 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-19T11:46:26.092 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-19T11:46:26.097 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-19T11:46:26.097 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-19T11:46:26.098 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-19T11:46:26.099 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-19T11:46:26.100 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-19T11:46:26.101 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-19T11:46:26.102 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-19T11:46:26.105 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-19T11:46:26.106 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-19T11:46:26.106 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-19T11:46:26.106 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot/foo (foo): DIR 2024-09-19T11:46:26.106 INFO:tasks.workunit.client.0.smithi120.stdout:/nfsroot (nfsroot): DIR 2024-09-19T11:46:26.106 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.HIER1 (37 ms) 2024-09-19T11:46:26.106 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-19T11:46:26.106 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-19T11:46:26.106 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-19T11:46:26.106 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-19T11:46:26.106 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-19T11:46:26.106 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-19T11:46:26.106 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-19T11:46:26.107 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-19T11:46:26.107 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T11:46:26.107 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T11:46:26.107 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T11:46:26.107 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T11:46:26.107 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T11:46:26.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:46:26.104+0000 7fb89d3d2a80 -1 shutting down 2024-09-19T11:46:26.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:46:26.108+0000 7fb777124640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58611, si_uid : 1000, si_addr0x3e80000e4f3, si_status0 2024-09-19T11:46:56.272 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SHUTDOWN (30166 ms) 2024-09-19T11:46:56.272 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 24 tests from LibRGW (31136 ms total) 2024-09-19T11:46:56.272 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:46:56.273 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:46:56.273 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 24 tests from 1 test suite ran. (31136 ms total) 2024-09-19T11:46:56.273 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 24 tests. 2024-09-19T11:46:56.281 INFO:tasks.workunit.client.0.smithi120.stdout:phase 2.1 2024-09-19T11:46:56.303 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-19T11:46:56.303 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:46:56.303 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 9 tests from LibRGW 2024-09-19T11:46:56.304 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.INIT 2024-09-19T11:46:56.314 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:46:56.315 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:46:56.898 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.INIT (595 ms) 2024-09-19T11:46:56.898 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T11:46:56.899 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-19T11:46:56.899 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T11:46:56.913 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CREATE_BUCKET (14 ms) 2024-09-19T11:46:56.913 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T11:46:56.913 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-19T11:46:56.914 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-19T11:46:56.927 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave0 2024-09-19T11:46:56.943 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave1 2024-09-19T11:46:56.958 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave2 2024-09-19T11:46:56.972 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave3 2024-09-19T11:46:56.990 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave4 2024-09-19T11:46:57.003 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave5 2024-09-19T11:46:57.019 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave6 2024-09-19T11:46:57.037 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave7 2024-09-19T11:46:57.049 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave8 2024-09-19T11:46:57.067 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave9 2024-09-19T11:46:57.067 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (154 ms) 2024-09-19T11:46:57.067 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-19T11:46:57.470 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (403 ms) 2024-09-19T11:46:57.470 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T11:46:57.470 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T11:46:57.470 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T11:46:57.471 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T11:46:57.471 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T11:46:57.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:46:57.467+0000 7fc4a0579a80 -1 shutting down 2024-09-19T11:46:57.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:46:57.471+0000 7fc37a2cb640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59256, si_uid : 1000, si_addr0x3e80000e778, si_status0 2024-09-19T11:47:27.031 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SHUTDOWN (29561 ms) 2024-09-19T11:47:27.032 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 9 tests from LibRGW (30728 ms total) 2024-09-19T11:47:27.032 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:47:27.032 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:47:27.032 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 9 tests from 1 test suite ran. (30728 ms total) 2024-09-19T11:47:27.032 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 9 tests. 2024-09-19T11:47:27.045 INFO:tasks.workunit.client.0.smithi120.stdout:phase 2.2 2024-09-19T11:47:27.069 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-19T11:47:27.069 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:47:27.069 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 9 tests from LibRGW 2024-09-19T11:47:27.069 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.INIT 2024-09-19T11:47:27.080 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:47:27.080 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:47:27.417 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.INIT (348 ms) 2024-09-19T11:47:27.418 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T11:47:27.419 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-19T11:47:27.419 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T11:47:27.419 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-19T11:47:27.419 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T11:47:27.452 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.DELETE_BUCKET (33 ms) 2024-09-19T11:47:27.452 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-19T11:47:27.465 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave0 2024-09-19T11:47:27.480 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave1 2024-09-19T11:47:27.493 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave2 2024-09-19T11:47:27.509 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave3 2024-09-19T11:47:27.526 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave4 2024-09-19T11:47:27.542 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave5 2024-09-19T11:47:27.559 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave6 2024-09-19T11:47:27.575 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave7 2024-09-19T11:47:27.589 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave8 2024-09-19T11:47:27.603 INFO:tasks.workunit.client.0.smithi120.stdout:created: sorrydave9 2024-09-19T11:47:27.603 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (151 ms) 2024-09-19T11:47:27.603 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-19T11:47:27.996 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (392 ms) 2024-09-19T11:47:27.996 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T11:47:27.996 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T11:47:27.996 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T11:47:27.996 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T11:47:27.996 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T11:47:27.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:47:27.995+0000 7f214c9d8a80 -1 shutting down 2024-09-19T11:47:27.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:47:27.999+0000 7f202672a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59901, si_uid : 1000, si_addr0x3e80000e9fd, si_status0 2024-09-19T11:47:57.671 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SHUTDOWN (29676 ms) 2024-09-19T11:47:57.671 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 9 tests from LibRGW (30602 ms total) 2024-09-19T11:47:57.672 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:47:57.672 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:47:57.672 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 9 tests from 1 test suite ran. (30602 ms total) 2024-09-19T11:47:57.672 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 9 tests. 2024-09-19T11:47:57.685 INFO:tasks.workunit.client.0.smithi120.stdout:phase 3.1 2024-09-19T11:47:58.027 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-19T11:47:58.027 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:47:58.027 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 13 tests from LibRGW 2024-09-19T11:47:58.027 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.INIT 2024-09-19T11:47:58.037 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:47:58.037 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:47:58.626 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.INIT (599 ms) 2024-09-19T11:47:58.626 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T11:47:58.627 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-19T11:47:58.627 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T11:47:58.640 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CREATE_BUCKET (13 ms) 2024-09-19T11:47:58.640 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-19T11:47:58.644 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-19T11:47:58.644 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-19T11:47:58.646 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-19T11:47:58.646 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.LARGE1 2024-09-19T11:47:58.717 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.LARGE1 (70 ms) 2024-09-19T11:47:58.717 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.LARGE2 2024-09-19T11:47:58.783 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.LARGE2 (66 ms) 2024-09-19T11:47:58.783 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-19T11:47:58.784 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-19T11:47:58.784 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-19T11:47:58.784 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-19T11:47:58.784 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T11:47:58.784 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-19T11:47:58.784 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T11:47:58.784 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T11:47:58.784 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T11:47:58.784 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T11:47:58.784 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T11:47:58.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:47:58.782+0000 7f2cf7366a80 -1 shutting down 2024-09-19T11:47:58.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:47:58.786+0000 7f2bd10b8640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60546, si_uid : 1000, si_addr0x3e80000ec82, si_status0 2024-09-19T11:48:28.838 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SHUTDOWN (30055 ms) 2024-09-19T11:48:28.838 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 13 tests from LibRGW (30811 ms total) 2024-09-19T11:48:28.839 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:48:28.839 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:48:28.839 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 13 tests from 1 test suite ran. (30811 ms total) 2024-09-19T11:48:28.839 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 13 tests. 2024-09-19T11:48:28.851 INFO:tasks.workunit.client.0.smithi120.stdout:phase 3.2 2024-09-19T11:48:29.201 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-19T11:48:29.201 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:48:29.201 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 13 tests from LibRGW 2024-09-19T11:48:29.201 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.INIT 2024-09-19T11:48:29.209 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:48:29.209 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:48:29.753 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.INIT (552 ms) 2024-09-19T11:48:29.756 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T11:48:29.756 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-19T11:48:29.757 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T11:48:29.757 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-19T11:48:29.757 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-19T11:48:29.760 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (7 ms) 2024-09-19T11:48:29.760 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-19T11:48:29.768 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (7 ms) 2024-09-19T11:48:29.768 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.LARGE1 2024-09-19T11:48:29.837 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.LARGE1 (69 ms) 2024-09-19T11:48:29.837 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.LARGE2 2024-09-19T11:48:29.837 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-19T11:48:29.837 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-19T11:48:29.837 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-19T11:48:29.837 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-19T11:48:29.847 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.DELETE_OBJECT (11 ms) 2024-09-19T11:48:29.847 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T11:48:29.876 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.DELETE_BUCKET (29 ms) 2024-09-19T11:48:29.876 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T11:48:29.877 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T11:48:29.877 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T11:48:29.877 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T11:48:29.877 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T11:48:29.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:48:29.878+0000 7feb3e7e9a80 -1 shutting down 2024-09-19T11:48:29.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:48:29.882+0000 7fea1853b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61192, si_uid : 1000, si_addr0x3e80000ef08, si_status0 2024-09-19T11:49:00.094 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SHUTDOWN (30218 ms) 2024-09-19T11:49:00.095 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 13 tests from LibRGW (30894 ms total) 2024-09-19T11:49:00.095 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:49:00.095 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:49:00.095 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 13 tests from 1 test suite ran. (30894 ms total) 2024-09-19T11:49:00.095 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 13 tests. 2024-09-19T11:49:00.112 INFO:tasks.workunit.client.0.smithi120.stdout:phase 4.1 2024-09-19T11:49:00.136 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-19T11:49:00.136 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:49:00.136 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 11 tests from LibRGW 2024-09-19T11:49:00.136 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.TVAR 2024-09-19T11:49:00.136 INFO:tasks.workunit.client.0.smithi120.stdout:read i1: 64001 2024-09-19T11:49:00.136 INFO:tasks.workunit.client.0.smithi120.stdout:read s1: blunderbuss 2024-09-19T11:49:00.136 INFO:tasks.workunit.client.0.smithi120.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-19T11:49:00.137 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.INIT 2024-09-19T11:49:00.151 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:49:00.151 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:49:00.914 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.INIT (778 ms) 2024-09-19T11:49:00.914 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T11:49:00.915 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-19T11:49:00.915 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-19T11:49:00.941 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (26 ms) 2024-09-19T11:49:00.941 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-19T11:49:02.226 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_0 2024-09-19T11:49:02.226 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_1 2024-09-19T11:49:02.226 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_2 2024-09-19T11:49:02.226 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_3 2024-09-19T11:49:02.226 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_4 2024-09-19T11:49:02.226 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_5 2024-09-19T11:49:02.226 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_6 2024-09-19T11:49:02.226 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_7 2024-09-19T11:49:02.226 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_8 2024-09-19T11:49:02.226 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_9 2024-09-19T11:49:02.226 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_10 2024-09-19T11:49:02.227 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_11 2024-09-19T11:49:02.227 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_12 2024-09-19T11:49:02.227 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_13 2024-09-19T11:49:02.227 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_14 2024-09-19T11:49:02.227 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_15 2024-09-19T11:49:02.227 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_16 2024-09-19T11:49:02.227 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_17 2024-09-19T11:49:02.227 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_18 2024-09-19T11:49:02.227 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_19 2024-09-19T11:49:02.227 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_20 2024-09-19T11:49:02.227 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_21 2024-09-19T11:49:02.227 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_22 2024-09-19T11:49:02.227 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_23 2024-09-19T11:49:02.228 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_24 2024-09-19T11:49:02.228 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_25 2024-09-19T11:49:02.228 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_26 2024-09-19T11:49:02.228 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_27 2024-09-19T11:49:02.228 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_28 2024-09-19T11:49:02.228 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_29 2024-09-19T11:49:02.228 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_30 2024-09-19T11:49:02.228 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_31 2024-09-19T11:49:02.228 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_32 2024-09-19T11:49:02.228 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_33 2024-09-19T11:49:02.228 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_34 2024-09-19T11:49:02.228 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_35 2024-09-19T11:49:02.228 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_36 2024-09-19T11:49:02.229 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_37 2024-09-19T11:49:02.229 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_38 2024-09-19T11:49:02.229 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_39 2024-09-19T11:49:02.229 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_40 2024-09-19T11:49:02.229 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_41 2024-09-19T11:49:02.229 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_42 2024-09-19T11:49:02.229 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_43 2024-09-19T11:49:02.229 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_44 2024-09-19T11:49:02.229 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_45 2024-09-19T11:49:02.229 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_46 2024-09-19T11:49:02.229 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_47 2024-09-19T11:49:02.229 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_48 2024-09-19T11:49:02.229 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_49 2024-09-19T11:49:02.229 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_50 2024-09-19T11:49:02.230 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_51 2024-09-19T11:49:02.230 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_52 2024-09-19T11:49:02.230 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_53 2024-09-19T11:49:02.230 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_54 2024-09-19T11:49:02.230 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_55 2024-09-19T11:49:02.230 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_56 2024-09-19T11:49:02.230 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_57 2024-09-19T11:49:02.230 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_58 2024-09-19T11:49:02.230 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_59 2024-09-19T11:49:02.230 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_60 2024-09-19T11:49:02.230 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_61 2024-09-19T11:49:02.230 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_62 2024-09-19T11:49:02.230 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_63 2024-09-19T11:49:02.230 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_64 2024-09-19T11:49:02.231 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_65 2024-09-19T11:49:02.231 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_66 2024-09-19T11:49:02.231 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_67 2024-09-19T11:49:02.231 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_68 2024-09-19T11:49:02.231 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_69 2024-09-19T11:49:02.231 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_70 2024-09-19T11:49:02.231 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_71 2024-09-19T11:49:02.231 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_72 2024-09-19T11:49:02.231 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_73 2024-09-19T11:49:02.231 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_74 2024-09-19T11:49:02.231 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_75 2024-09-19T11:49:02.231 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_76 2024-09-19T11:49:02.231 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_77 2024-09-19T11:49:02.232 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_78 2024-09-19T11:49:02.232 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_79 2024-09-19T11:49:02.232 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_80 2024-09-19T11:49:02.232 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_81 2024-09-19T11:49:02.232 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_82 2024-09-19T11:49:02.232 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_83 2024-09-19T11:49:02.232 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_84 2024-09-19T11:49:02.232 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_85 2024-09-19T11:49:02.232 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_86 2024-09-19T11:49:02.232 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_87 2024-09-19T11:49:02.232 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_88 2024-09-19T11:49:02.232 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_89 2024-09-19T11:49:02.232 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_90 2024-09-19T11:49:02.233 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_91 2024-09-19T11:49:02.233 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_92 2024-09-19T11:49:02.233 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_93 2024-09-19T11:49:02.233 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_94 2024-09-19T11:49:02.233 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_95 2024-09-19T11:49:02.233 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_96 2024-09-19T11:49:02.233 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_97 2024-09-19T11:49:02.233 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_98 2024-09-19T11:49:02.233 INFO:tasks.workunit.client.0.smithi120.stdout:created: dmarker:f_99 2024-09-19T11:49:02.233 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1284 ms) 2024-09-19T11:49:02.233 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-19T11:49:02.234 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-19T11:49:02.234 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-19T11:49:02.234 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-19T11:49:02.234 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-19T11:49:02.234 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-19T11:49:02.234 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-19T11:49:02.234 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-19T11:49:02.234 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-19T11:49:02.235 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-19T11:49:02.235 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-19T11:49:02.235 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-19T11:49:02.235 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-19T11:49:02.235 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-19T11:49:02.235 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-19T11:49:02.235 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-19T11:49:02.235 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-19T11:49:02.235 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-19T11:49:02.235 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-19T11:49:02.235 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-19T11:49:02.235 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-19T11:49:02.235 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-19T11:49:02.236 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-19T11:49:02.236 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-19T11:49:02.236 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-19T11:49:02.236 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-19T11:49:02.236 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-19T11:49:02.236 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-19T11:49:02.236 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-19T11:49:02.236 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-19T11:49:02.236 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-19T11:49:02.236 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-19T11:49:02.236 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-19T11:49:02.236 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-19T11:49:02.236 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-19T11:49:02.237 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-19T11:49:02.237 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-19T11:49:02.237 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-19T11:49:02.237 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-19T11:49:02.237 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-19T11:49:02.237 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-19T11:49:02.237 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-19T11:49:02.237 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-19T11:49:02.237 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-19T11:49:02.237 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-19T11:49:02.237 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-19T11:49:02.237 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-19T11:49:02.237 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-19T11:49:02.238 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-19T11:49:02.238 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-19T11:49:02.238 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-19T11:49:02.238 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-19T11:49:02.238 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-19T11:49:02.238 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-19T11:49:02.238 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-19T11:49:02.238 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-19T11:49:02.238 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-19T11:49:02.238 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-19T11:49:02.238 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-19T11:49:02.238 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-19T11:49:02.238 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-19T11:49:02.238 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-19T11:49:02.239 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-19T11:49:02.239 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-19T11:49:02.239 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-19T11:49:02.239 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-19T11:49:02.239 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-19T11:49:02.239 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-19T11:49:02.239 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-19T11:49:02.239 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-19T11:49:02.239 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-19T11:49:02.239 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-19T11:49:02.239 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-19T11:49:02.239 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-19T11:49:02.239 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-19T11:49:02.239 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-19T11:49:02.240 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-19T11:49:02.240 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-19T11:49:02.240 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-19T11:49:02.240 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-19T11:49:02.240 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-19T11:49:02.240 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-19T11:49:02.240 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-19T11:49:02.240 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-19T11:49:02.240 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-19T11:49:02.240 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-19T11:49:02.240 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-19T11:49:02.240 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-19T11:49:02.240 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-19T11:49:02.241 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-19T11:49:02.241 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-19T11:49:02.241 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-19T11:49:02.241 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-19T11:49:02.241 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-19T11:49:02.241 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-19T11:49:02.241 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-19T11:49:02.241 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-19T11:49:02.241 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-19T11:49:02.242 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-19T11:49:02.242 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-19T11:49:02.242 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-19T11:49:02.242 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-19T11:49:02.242 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-19T11:49:02.242 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_READDIR (6 ms) 2024-09-19T11:49:02.242 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-19T11:49:02.243 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-19T11:49:02.243 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-19T11:49:02.243 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-19T11:49:02.243 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-19T11:49:02.243 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-19T11:49:02.243 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-19T11:49:02.244 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-19T11:49:02.244 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-19T11:49:02.244 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-19T11:49:02.244 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-19T11:49:02.244 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-19T11:49:02.244 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-19T11:49:02.244 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-19T11:49:02.244 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-19T11:49:02.244 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-19T11:49:02.244 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-19T11:49:02.244 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-19T11:49:02.244 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-19T11:49:02.245 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-19T11:49:02.245 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-19T11:49:02.245 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-19T11:49:02.245 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-19T11:49:02.245 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-19T11:49:02.245 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-19T11:49:02.245 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-19T11:49:02.245 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-19T11:49:02.245 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-19T11:49:02.245 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-19T11:49:02.245 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-19T11:49:02.245 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-19T11:49:02.245 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-19T11:49:02.246 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-19T11:49:02.246 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-19T11:49:02.246 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-19T11:49:02.246 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-19T11:49:02.246 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-19T11:49:02.246 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-19T11:49:02.246 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-19T11:49:02.246 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-19T11:49:02.246 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-19T11:49:02.246 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-19T11:49:02.246 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-19T11:49:02.246 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-19T11:49:02.246 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-19T11:49:02.246 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-19T11:49:02.247 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-19T11:49:02.247 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-19T11:49:02.247 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-19T11:49:02.247 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-19T11:49:02.247 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-19T11:49:02.247 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-19T11:49:02.247 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-19T11:49:02.247 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-19T11:49:02.247 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-19T11:49:02.247 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-19T11:49:02.247 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-19T11:49:02.248 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-19T11:49:02.248 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-19T11:49:02.248 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-19T11:49:02.248 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-19T11:49:02.248 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-19T11:49:02.248 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-19T11:49:02.248 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-19T11:49:02.248 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-19T11:49:02.248 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-19T11:49:02.249 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-19T11:49:02.249 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-19T11:49:02.249 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-19T11:49:02.249 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-19T11:49:02.249 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-19T11:49:02.249 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-19T11:49:02.249 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-19T11:49:02.249 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-19T11:49:02.249 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-19T11:49:02.249 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-19T11:49:02.249 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-19T11:49:02.249 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-19T11:49:02.249 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-19T11:49:02.249 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-19T11:49:02.250 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-19T11:49:02.250 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-19T11:49:02.250 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-19T11:49:02.250 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-19T11:49:02.250 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-19T11:49:02.250 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-19T11:49:02.250 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-19T11:49:02.250 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-19T11:49:02.250 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-19T11:49:02.250 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-19T11:49:02.250 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-19T11:49:02.250 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-19T11:49:02.250 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-19T11:49:02.250 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-19T11:49:02.250 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-19T11:49:02.251 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-19T11:49:02.251 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-19T11:49:02.251 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-19T11:49:02.251 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-19T11:49:02.251 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-19T11:49:02.251 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-19T11:49:02.251 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-09-19T11:49:02.251 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-19T11:49:02.251 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-19T11:49:02.251 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T11:49:02.251 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T11:49:02.251 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T11:49:02.251 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T11:49:02.251 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T11:49:02.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:49:02.237+0000 7f158669ca80 -1 shutting down 2024-09-19T11:49:02.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:49:02.241+0000 7f14603ee640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61837, si_uid : 1000, si_addr0x3e80000f18d, si_status0 2024-09-19T11:49:31.057 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SHUTDOWN (28822 ms) 2024-09-19T11:49:31.058 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 11 tests from LibRGW (30921 ms total) 2024-09-19T11:49:31.058 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:49:31.058 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:49:31.058 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 11 tests from 1 test suite ran. (30921 ms total) 2024-09-19T11:49:31.058 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 11 tests. 2024-09-19T11:49:31.072 INFO:tasks.workunit.client.0.smithi120.stdout:phase 4.2 2024-09-19T11:49:31.095 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-19T11:49:31.163 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:49:31.163 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 11 tests from LibRGW 2024-09-19T11:49:31.163 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.TVAR 2024-09-19T11:49:31.163 INFO:tasks.workunit.client.0.smithi120.stdout:read i1: 64001 2024-09-19T11:49:31.163 INFO:tasks.workunit.client.0.smithi120.stdout:read s1: blunderbuss 2024-09-19T11:49:31.163 INFO:tasks.workunit.client.0.smithi120.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-19T11:49:31.163 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.INIT 2024-09-19T11:49:31.164 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:49:31.164 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:49:31.649 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.INIT (554 ms) 2024-09-19T11:49:31.649 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T11:49:31.650 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-19T11:49:31.650 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-19T11:49:31.667 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (17 ms) 2024-09-19T11:49:31.667 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-19T11:49:31.667 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-19T11:49:31.667 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-19T11:49:31.668 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-19T11:49:31.668 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-19T11:49:31.671 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-19T11:49:31.671 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-19T11:49:31.671 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-19T11:49:31.671 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-19T11:49:31.671 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-19T11:49:31.671 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-19T11:49:31.671 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-19T11:49:31.671 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-19T11:49:31.672 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-19T11:49:31.672 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-19T11:49:31.672 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-19T11:49:31.672 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-19T11:49:31.672 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-19T11:49:31.672 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-19T11:49:31.672 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-19T11:49:31.672 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-19T11:49:31.672 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-19T11:49:31.672 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-19T11:49:31.672 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-19T11:49:31.672 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-19T11:49:31.672 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-19T11:49:31.673 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-19T11:49:31.673 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-19T11:49:31.673 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-19T11:49:31.673 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-19T11:49:31.673 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-19T11:49:31.673 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-19T11:49:31.673 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-19T11:49:31.673 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-19T11:49:31.673 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-19T11:49:31.673 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-19T11:49:31.673 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-19T11:49:31.673 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-19T11:49:31.674 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-19T11:49:31.674 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-19T11:49:31.674 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-19T11:49:31.674 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-19T11:49:31.674 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-19T11:49:31.674 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-19T11:49:31.674 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-19T11:49:31.674 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-19T11:49:31.674 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-19T11:49:31.674 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-19T11:49:31.674 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-19T11:49:31.674 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-19T11:49:31.674 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-19T11:49:31.675 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-19T11:49:31.675 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-19T11:49:31.675 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-19T11:49:31.675 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-19T11:49:31.675 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-19T11:49:31.675 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-19T11:49:31.675 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-19T11:49:31.675 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-19T11:49:31.675 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-19T11:49:31.675 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-19T11:49:31.675 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-19T11:49:31.675 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-19T11:49:31.675 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-19T11:49:31.675 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-19T11:49:31.675 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-19T11:49:31.676 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-19T11:49:31.676 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-19T11:49:31.676 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-19T11:49:31.676 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-19T11:49:31.676 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-19T11:49:31.676 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-19T11:49:31.676 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-19T11:49:31.676 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-19T11:49:31.676 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-19T11:49:31.676 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-19T11:49:31.676 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-19T11:49:31.676 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-19T11:49:31.676 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-19T11:49:31.676 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-19T11:49:31.677 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-19T11:49:31.677 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-19T11:49:31.677 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-19T11:49:31.677 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-19T11:49:31.677 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-19T11:49:31.677 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-19T11:49:31.677 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-19T11:49:31.677 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-19T11:49:31.678 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-19T11:49:31.678 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-19T11:49:31.678 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-19T11:49:31.678 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-19T11:49:31.678 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-19T11:49:31.678 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-19T11:49:31.678 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-19T11:49:31.678 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-19T11:49:31.679 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-19T11:49:31.679 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-19T11:49:31.679 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-19T11:49:31.679 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-19T11:49:31.679 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-19T11:49:31.679 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-19T11:49:31.679 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-19T11:49:31.679 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-19T11:49:31.679 INFO:tasks.workunit.client.0.smithi120.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-19T11:49:31.679 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-09-19T11:49:31.679 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-19T11:49:31.679 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-19T11:49:31.680 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T11:49:31.680 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T11:49:31.680 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T11:49:31.680 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T11:49:31.680 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T11:49:31.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:49:31.673+0000 7f5e7d697a80 -1 shutting down 2024-09-19T11:49:31.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:49:31.677+0000 7f5d573e9640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62482, si_uid : 1000, si_addr0x3e80000f412, si_status0 2024-09-19T11:50:01.695 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SHUTDOWN (30024 ms) 2024-09-19T11:50:01.695 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 11 tests from LibRGW (30600 ms total) 2024-09-19T11:50:01.695 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:50:01.695 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:50:01.696 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 11 tests from 1 test suite ran. (30600 ms total) 2024-09-19T11:50:01.696 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 11 tests. 2024-09-19T11:50:01.708 INFO:tasks.workunit.client.0.smithi120.stdout:phase 5.1 2024-09-19T11:50:01.741 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-19T11:50:01.742 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:50:01.742 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 19 tests from LibRGW 2024-09-19T11:50:01.742 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.INIT 2024-09-19T11:50:01.753 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:50:01.753 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:50:02.289 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.INIT (548 ms) 2024-09-19T11:50:02.289 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T11:50:02.291 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-19T11:50:02.291 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T11:50:02.305 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CREATE_BUCKET (14 ms) 2024-09-19T11:50:02.305 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-19T11:50:02.310 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-19T11:50:02.310 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-19T11:50:02.310 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-19T11:50:02.310 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-19T11:50:02.312 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-19T11:50:02.313 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-19T11:50:02.313 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-19T11:50:02.313 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-19T11:50:02.321 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.PUT_OBJECT (9 ms) 2024-09-19T11:50:02.321 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-19T11:50:02.324 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-19T11:50:02.324 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-19T11:50:02.324 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-19T11:50:02.324 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-19T11:50:02.324 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-19T11:50:02.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.WRITEV 2024-09-19T11:50:02.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-19T11:50:02.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.READV 2024-09-19T11:50:02.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-19T11:50:02.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-19T11:50:02.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-19T11:50:02.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-19T11:50:02.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-19T11:50:02.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T11:50:02.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-19T11:50:02.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T11:50:02.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T11:50:02.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T11:50:02.325 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T11:50:02.326 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T11:50:02.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:50:02.324+0000 7f1e2596aa80 -1 shutting down 2024-09-19T11:50:02.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:50:02.328+0000 7f1cff6bc640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63127, si_uid : 1000, si_addr0x3e80000f697, si_status0 2024-09-19T11:50:32.374 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SHUTDOWN (30049 ms) 2024-09-19T11:50:32.374 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 19 tests from LibRGW (30631 ms total) 2024-09-19T11:50:32.374 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:50:32.374 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:50:32.374 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 19 tests from 1 test suite ran. (30632 ms total) 2024-09-19T11:50:32.374 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 19 tests. 2024-09-19T11:50:32.386 INFO:tasks.workunit.client.0.smithi120.stdout:phase 5.2 2024-09-19T11:50:32.420 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-19T11:50:32.420 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:50:32.420 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 19 tests from LibRGW 2024-09-19T11:50:32.420 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.INIT 2024-09-19T11:50:32.429 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:50:32.429 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:50:33.016 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.INIT (592 ms) 2024-09-19T11:50:33.016 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T11:50:33.016 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-19T11:50:33.016 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T11:50:33.016 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-19T11:50:33.016 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-19T11:50:33.025 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (10 ms) 2024-09-19T11:50:33.025 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-19T11:50:33.025 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-19T11:50:33.025 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-19T11:50:33.025 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-19T11:50:33.025 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-19T11:50:33.025 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-19T11:50:33.026 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-19T11:50:33.026 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-19T11:50:33.026 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-19T11:50:33.026 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-19T11:50:33.026 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-19T11:50:33.026 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-19T11:50:33.026 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-19T11:50:33.026 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-19T11:50:33.026 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.WRITEV 2024-09-19T11:50:33.026 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-19T11:50:33.026 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.READV 2024-09-19T11:50:33.026 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-19T11:50:33.026 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-19T11:50:33.026 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-19T11:50:33.027 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-19T11:50:33.034 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.DELETE_OBJECT (10 ms) 2024-09-19T11:50:33.034 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T11:50:33.064 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.DELETE_BUCKET (30 ms) 2024-09-19T11:50:33.065 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T11:50:33.065 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T11:50:33.065 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T11:50:33.065 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T11:50:33.065 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T11:50:33.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:50:33.068+0000 7f64a9440a80 -1 shutting down 2024-09-19T11:50:33.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:50:33.068+0000 7f6383192640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63772, si_uid : 1000, si_addr0x3e80000f91c, si_status0 2024-09-19T11:51:03.105 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SHUTDOWN (30040 ms) 2024-09-19T11:51:03.106 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 19 tests from LibRGW (30684 ms total) 2024-09-19T11:51:03.106 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:51:03.106 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:51:03.106 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 19 tests from 1 test suite ran. (30684 ms total) 2024-09-19T11:51:03.106 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 19 tests. 2024-09-19T11:51:03.118 INFO:tasks.workunit.client.0.smithi120.stdout:phase 6.1 2024-09-19T11:51:03.143 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-19T11:51:03.143 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment set-up. 2024-09-19T11:51:03.143 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 10 tests from LibRGW 2024-09-19T11:51:03.143 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.INIT 2024-09-19T11:51:03.152 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:51:03.152 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:51:03.732 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.INIT (588 ms) 2024-09-19T11:51:03.732 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T11:51:03.738 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-19T11:51:03.738 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-19T11:51:03.762 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CREATE_BUCKETS (29 ms) 2024-09-19T11:51:03.762 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-19T11:51:03.773 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (11 ms) 2024-09-19T11:51:03.773 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-19T11:51:03.823 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.TOPDIR_RENAME (50 ms) 2024-09-19T11:51:03.823 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-19T11:51:03.885 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SUBDIR_RENAME (62 ms) 2024-09-19T11:51:03.885 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-19T11:51:03.944 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (58 ms) 2024-09-19T11:51:03.944 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T11:51:03.944 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.CLEANUP (1 ms) 2024-09-19T11:51:03.944 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T11:51:03.944 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T11:51:03.944 INFO:tasks.workunit.client.0.smithi120.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T11:51:03.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:03.943+0000 7f7d0aee3a80 -1 shutting down 2024-09-19T11:51:03.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:03.947+0000 7f7be4c35640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64417, si_uid : 1000, si_addr0x3e80000fba1, si_status0 2024-09-19T11:51:34.068 INFO:tasks.workunit.client.0.smithi120.stdout:[ OK ] LibRGW.SHUTDOWN (30123 ms) 2024-09-19T11:51:34.068 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] 10 tests from LibRGW (30924 ms total) 2024-09-19T11:51:34.068 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:51:34.069 INFO:tasks.workunit.client.0.smithi120.stdout:[----------] Global test environment tear-down 2024-09-19T11:51:34.069 INFO:tasks.workunit.client.0.smithi120.stdout:[==========] 10 tests from 1 test suite ran. (30924 ms total) 2024-09-19T11:51:34.069 INFO:tasks.workunit.client.0.smithi120.stdout:[ PASSED ] 10 tests. 2024-09-19T11:51:34.082 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:51:34.083 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:51:34.098 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-19T11:51:34.100 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-19T11:51:34.100 DEBUG:teuthology.orchestra.run.smithi120:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-19T11:51:34.149 INFO:tasks.workunit.client.0.smithi120.stderr:+ [ -z ] 2024-09-19T11:51:34.149 INFO:tasks.workunit.client.0.smithi120.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-19T11:51:34.149 INFO:tasks.workunit.client.0.smithi120.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-19T11:51:34.149 INFO:tasks.workunit.client.0.smithi120.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-19T11:51:34.190 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:51:34.191 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:51:34.235 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.235+0000 7fc173d819c0 20 rados->read ofs=0 len=0 2024-09-19T11:51:34.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.239+0000 7fc173d819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:51:34.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.239+0000 7fc173d819c0 20 realm 2024-09-19T11:51:34.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.239+0000 7fc173d819c0 20 rados->read ofs=0 len=0 2024-09-19T11:51:34.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.239+0000 7fc173d819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:51:34.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.239+0000 7fc173d819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:51:34.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.239+0000 7fc173d819c0 20 rados->read ofs=0 len=0 2024-09-19T11:51:34.237 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.239+0000 7fc173d819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:51:34.238 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.239+0000 7fc173d819c0 20 rados->read ofs=0 len=0 2024-09-19T11:51:34.239 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.239+0000 7fc173d819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:51:34.239 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.239+0000 7fc173d819c0 20 rados->read ofs=0 len=0 2024-09-19T11:51:34.240 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.243+0000 7fc173d819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:51:34.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.243+0000 7fc173d819c0 20 searching for the correct realm 2024-09-19T11:51:34.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.243+0000 7fc172088640 0 -- 172.21.15.120:0/792080595 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fc15c036940 msgr2=0x7fc15c0463f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:51:34.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.251+0000 7fc171086640 0 -- 172.21.15.120:0/792080595 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fc16c08b1e0 msgr2=0x7fc16c06ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:51:34.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.467+0000 7fc173d819c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:51:34.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.467+0000 7fc173d819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:51:34.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.467+0000 7fc173d819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:51:34.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.467+0000 7fc173d819c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:51:34.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.467+0000 7fc173d819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:51:34.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.467+0000 7fc173d819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:51:34.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 20 rados->read ofs=0 len=0 2024-09-19T11:51:34.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:51:34.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 20 rados->read ofs=0 len=0 2024-09-19T11:51:34.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:51:34.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 20 rados->read ofs=0 len=0 2024-09-19T11:51:34.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:51:34.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 20 zone default found 2024-09-19T11:51:34.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 4 Realm: () 2024-09-19T11:51:34.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:51:34.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:51:34.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:51:34.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 20 zonegroup default 2024-09-19T11:51:34.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 20 rados->read ofs=0 len=0 2024-09-19T11:51:34.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:51:34.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 20 rados->read ofs=0 len=0 2024-09-19T11:51:34.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:51:34.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.471+0000 7fc173d819c0 20 rados->read ofs=0 len=0 2024-09-19T11:51:34.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.475+0000 7fc173d819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:51:34.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.475+0000 7fc173d819c0 20 started sync module instance, tier type = 2024-09-19T11:51:34.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.475+0000 7fc173d819c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:51:34.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.499+0000 7fc173d819c0 20 add_watcher() i=0 2024-09-19T11:51:34.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.499+0000 7fc173d819c0 20 add_watcher() i=1 2024-09-19T11:51:34.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.499+0000 7fc173d819c0 20 add_watcher() i=2 2024-09-19T11:51:34.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.499+0000 7fc173d819c0 20 add_watcher() i=3 2024-09-19T11:51:34.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.499+0000 7fc173d819c0 20 add_watcher() i=4 2024-09-19T11:51:34.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.499+0000 7fc173d819c0 20 add_watcher() i=5 2024-09-19T11:51:34.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.499+0000 7fc173d819c0 20 add_watcher() i=6 2024-09-19T11:51:34.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.499+0000 7fc173d819c0 20 add_watcher() i=7 2024-09-19T11:51:34.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.499+0000 7fc173d819c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:51:34.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.503+0000 7fc0237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:51:34.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:51:34.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:51:34.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 5 note: GC not initialized 2024-09-19T11:51:34.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc0227fc640 20 reqs_thread_entry: start 2024-09-19T11:51:34.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 20 init_complete bucket index max shards: 1 2024-09-19T11:51:34.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 20 Filter name: none 2024-09-19T11:51:34.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fbf93fff640 20 reqs_thread_entry: start 2024-09-19T11:51:34.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-19T11:51:34.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 20 rados->read ofs=0 len=0 2024-09-19T11:51:34.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:51:34.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-19T11:51:34.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-19T11:51:34.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-19T11:51:34.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 20 rados->read ofs=0 len=0 2024-09-19T11:51:34.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:51:34.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-19T11:51:34.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-19T11:51:34.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-19T11:51:34.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 20 rados->read ofs=0 len=0 2024-09-19T11:51:34.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:51:34.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-19T11:51:34.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-19T11:51:34.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-19T11:51:34.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.507+0000 7fc173d819c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-19T11:51:34.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.511+0000 7fc173d819c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-19T11:51:34.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.511+0000 7fc173d819c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-19T11:51:34.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.511+0000 7fc173d819c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-19T11:51:34.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.511+0000 7fc0557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725892 cookie 93835718814448 notifier 5883 bl.length()=677 2024-09-19T11:51:34.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.511+0000 7fc0557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-19T11:51:34.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.511+0000 7fc0557fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-19T11:51:34.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.515+0000 7fc173d819c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-19T11:51:34.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.515+0000 7fc173d819c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-19T11:51:34.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.515+0000 7fc173d819c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-19T11:51:34.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.515+0000 7fc0557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725894 cookie 93835718800768 notifier 5883 bl.length()=187 2024-09-19T11:51:34.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.515+0000 7fc0557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-19T11:51:34.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.515+0000 7fc0557fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-19T11:51:34.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.519+0000 7fc173d819c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-19T11:51:34.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.519+0000 7fc173d819c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-19T11:51:34.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.519+0000 7fc173d819c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-19T11:51:34.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.519+0000 7fc054ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725895 cookie 93835718800768 notifier 5883 bl.length()=197 2024-09-19T11:51:34.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.519+0000 7fc054ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-19T11:51:34.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.519+0000 7fc054ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-19T11:51:34.518 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:51:34.519 INFO:tasks.workunit.client.0.smithi120.stdout: "user_id": "ceph-test-maven", 2024-09-19T11:51:34.519 INFO:tasks.workunit.client.0.smithi120.stdout: "display_name": "maven test user", 2024-09-19T11:51:34.519 INFO:tasks.workunit.client.0.smithi120.stdout: "email": "sigv4@example.com", 2024-09-19T11:51:34.519 INFO:tasks.workunit.client.0.smithi120.stdout: "suspended": 0, 2024-09-19T11:51:34.519 INFO:tasks.workunit.client.0.smithi120.stdout: "max_buckets": 1000, 2024-09-19T11:51:34.519 INFO:tasks.workunit.client.0.smithi120.stdout: "subusers": [], 2024-09-19T11:51:34.519 INFO:tasks.workunit.client.0.smithi120.stdout: "keys": [ 2024-09-19T11:51:34.519 INFO:tasks.workunit.client.0.smithi120.stdout: { 2024-09-19T11:51:34.519 INFO:tasks.workunit.client.0.smithi120.stdout: "user": "ceph-test-maven", 2024-09-19T11:51:34.519 INFO:tasks.workunit.client.0.smithi120.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-19T11:51:34.519 INFO:tasks.workunit.client.0.smithi120.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-19T11:51:34.519 INFO:tasks.workunit.client.0.smithi120.stdout: "active": true, 2024-09-19T11:51:34.520 INFO:tasks.workunit.client.0.smithi120.stdout: "create_date": "2024-09-19T11:51:34.513400Z" 2024-09-19T11:51:34.520 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:51:34.520 INFO:tasks.workunit.client.0.smithi120.stdout: ], 2024-09-19T11:51:34.520 INFO:tasks.workunit.client.0.smithi120.stdout: "swift_keys": [], 2024-09-19T11:51:34.520 INFO:tasks.workunit.client.0.smithi120.stdout: "caps": [], 2024-09-19T11:51:34.520 INFO:tasks.workunit.client.0.smithi120.stdout: "op_mask": "read, write, delete", 2024-09-19T11:51:34.520 INFO:tasks.workunit.client.0.smithi120.stdout: "default_placement": "", 2024-09-19T11:51:34.520 INFO:tasks.workunit.client.0.smithi120.stdout: "default_storage_class": "", 2024-09-19T11:51:34.520 INFO:tasks.workunit.client.0.smithi120.stdout: "placement_tags": [], 2024-09-19T11:51:34.520 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_quota": { 2024-09-19T11:51:34.520 INFO:tasks.workunit.client.0.smithi120.stdout: "enabled": false, 2024-09-19T11:51:34.520 INFO:tasks.workunit.client.0.smithi120.stdout: "check_on_raw": false, 2024-09-19T11:51:34.520 INFO:tasks.workunit.client.0.smithi120.stdout: "max_size": -1, 2024-09-19T11:51:34.520 INFO:tasks.workunit.client.0.smithi120.stdout: "max_size_kb": 0, 2024-09-19T11:51:34.521 INFO:tasks.workunit.client.0.smithi120.stdout: "max_objects": -1 2024-09-19T11:51:34.521 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:51:34.521 INFO:tasks.workunit.client.0.smithi120.stdout: "user_quota": { 2024-09-19T11:51:34.521 INFO:tasks.workunit.client.0.smithi120.stdout: "enabled": false, 2024-09-19T11:51:34.521 INFO:tasks.workunit.client.0.smithi120.stdout: "check_on_raw": false, 2024-09-19T11:51:34.521 INFO:tasks.workunit.client.0.smithi120.stdout: "max_size": -1, 2024-09-19T11:51:34.521 INFO:tasks.workunit.client.0.smithi120.stdout: "max_size_kb": 0, 2024-09-19T11:51:34.521 INFO:tasks.workunit.client.0.smithi120.stdout: "max_objects": -1 2024-09-19T11:51:34.521 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:51:34.521 INFO:tasks.workunit.client.0.smithi120.stdout: "temp_url_keys": [], 2024-09-19T11:51:34.521 INFO:tasks.workunit.client.0.smithi120.stdout: "type": "rgw", 2024-09-19T11:51:34.521 INFO:tasks.workunit.client.0.smithi120.stdout: "mfa_ids": [], 2024-09-19T11:51:34.521 INFO:tasks.workunit.client.0.smithi120.stdout: "account_id": "", 2024-09-19T11:51:34.521 INFO:tasks.workunit.client.0.smithi120.stdout: "path": "/", 2024-09-19T11:51:34.522 INFO:tasks.workunit.client.0.smithi120.stdout: "create_date": "2024-09-19T11:51:34.513364Z", 2024-09-19T11:51:34.522 INFO:tasks.workunit.client.0.smithi120.stdout: "tags": [], 2024-09-19T11:51:34.522 INFO:tasks.workunit.client.0.smithi120.stdout: "group_ids": [] 2024-09-19T11:51:34.522 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:51:34.522 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:51:34.522 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.519+0000 7fc0237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:51:34.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.527+0000 7fc173d819c0 20 remove_watcher() i=0 2024-09-19T11:51:34.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.527+0000 7fc173d819c0 2 removed watcher, disabling cache 2024-09-19T11:51:34.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.527+0000 7fc173d819c0 20 remove_watcher() i=1 2024-09-19T11:51:34.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.531+0000 7fc173d819c0 20 remove_watcher() i=2 2024-09-19T11:51:34.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.531+0000 7fc173d819c0 20 remove_watcher() i=3 2024-09-19T11:51:34.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.535+0000 7fc173d819c0 20 remove_watcher() i=4 2024-09-19T11:51:34.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.535+0000 7fc173d819c0 20 remove_watcher() i=5 2024-09-19T11:51:34.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.539+0000 7fc173d819c0 20 remove_watcher() i=6 2024-09-19T11:51:34.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:51:34.539+0000 7fc173d819c0 20 remove_watcher() i=7 2024-09-19T11:51:34.553 INFO:tasks.workunit.client.0.smithi120.stderr:+ [ -z ] 2024-09-19T11:51:34.553 INFO:tasks.workunit.client.0.smithi120.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-19T11:51:34.553 INFO:tasks.workunit.client.0.smithi120.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-19T11:51:34.553 INFO:tasks.workunit.client.0.smithi120.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi120.front.sepia.ceph.com:80 2024-09-19T11:51:34.554 INFO:tasks.workunit.client.0.smithi120.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-19T11:51:34.554 INFO:tasks.workunit.client.0.smithi120.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-19T11:51:34.554 INFO:tasks.workunit.client.0.smithi120.stderr:+ ./mvnw clean package 2024-09-19T11:51:34.560 INFO:tasks.workunit.client.0.smithi120.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-19T11:51:38.984 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Scanning for projects... 2024-09-19T11:51:39.122 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-19T11:51:39.242 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 46 kB/s) 2024-09-19T11:51:39.266 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-19T11:51:39.305 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.1 MB/s) 2024-09-19T11:51:39.321 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-19T11:51:39.343 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.3 MB/s) 2024-09-19T11:51:39.379 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:51:39.380 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-19T11:51:39.380 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Building jcksum 1.0 2024-09-19T11:51:39.380 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] from pom.xml 2024-09-19T11:51:39.380 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-19T11:51:39.383 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-19T11:51:39.400 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 312 kB/s) 2024-09-19T11:51:39.406 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-19T11:51:39.422 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-19T11:51:39.425 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-19T11:51:39.440 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 3.0 MB/s) 2024-09-19T11:51:39.446 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-19T11:51:39.461 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.4 MB/s) 2024-09-19T11:51:39.472 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-19T11:51:39.488 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-19T11:51:39.495 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-19T11:51:39.509 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-19T11:51:39.512 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-19T11:51:39.527 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-19T11:51:39.529 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-19T11:51:39.548 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.0 MB/s) 2024-09-19T11:51:39.552 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-19T11:51:39.568 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.3 MB/s) 2024-09-19T11:51:39.576 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-19T11:51:39.593 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.8 MB/s) 2024-09-19T11:51:39.605 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-19T11:51:39.622 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 577 kB/s) 2024-09-19T11:51:39.635 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-19T11:51:39.654 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.3 MB/s) 2024-09-19T11:51:39.672 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-19T11:51:39.689 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 313 kB/s) 2024-09-19T11:51:39.693 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-19T11:51:39.709 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.4 MB/s) 2024-09-19T11:51:39.716 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-19T11:51:39.735 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.8 MB/s) 2024-09-19T11:51:39.743 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-19T11:51:39.760 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.4 MB/s) 2024-09-19T11:51:39.771 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-19T11:51:39.787 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 331 kB/s) 2024-09-19T11:51:39.794 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-19T11:51:39.813 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.5 MB/s) 2024-09-19T11:51:39.825 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-19T11:51:39.841 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 398 kB/s) 2024-09-19T11:51:39.845 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-19T11:51:39.861 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 619 kB/s) 2024-09-19T11:51:39.865 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-19T11:51:39.882 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.7 MB/s) 2024-09-19T11:51:39.888 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-19T11:51:39.904 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.3 MB/s) 2024-09-19T11:51:39.913 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-19T11:51:39.930 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.6 MB/s) 2024-09-19T11:51:39.955 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-19T11:51:39.973 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 338 kB/s) 2024-09-19T11:51:39.976 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-19T11:51:39.993 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.3 MB/s) 2024-09-19T11:51:40.000 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-19T11:51:40.018 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-09-19T11:51:40.033 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-19T11:51:40.050 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 236 kB/s) 2024-09-19T11:51:40.054 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-19T11:51:40.070 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 97 kB/s) 2024-09-19T11:51:40.073 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-19T11:51:40.091 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 124 kB/s) 2024-09-19T11:51:40.099 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-19T11:51:40.116 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 214 kB/s) 2024-09-19T11:51:40.124 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-19T11:51:40.142 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 179 kB/s) 2024-09-19T11:51:40.150 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-19T11:51:40.166 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 645 kB/s) 2024-09-19T11:51:40.174 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-19T11:51:40.190 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 105 kB/s) 2024-09-19T11:51:40.196 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-19T11:51:40.213 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 225 kB/s) 2024-09-19T11:51:40.220 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-19T11:51:40.236 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 307 kB/s) 2024-09-19T11:51:40.243 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-19T11:51:40.258 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-19T11:51:40.262 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-19T11:51:40.277 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 256 kB/s) 2024-09-19T11:51:40.280 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-19T11:51:40.295 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 920 kB/s) 2024-09-19T11:51:40.301 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-19T11:51:40.317 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 230 kB/s) 2024-09-19T11:51:40.324 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-19T11:51:40.341 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 136 kB/s) 2024-09-19T11:51:40.348 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-19T11:51:40.365 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 171 kB/s) 2024-09-19T11:51:40.374 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-19T11:51:40.391 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 436 kB/s) 2024-09-19T11:51:40.399 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-19T11:51:40.416 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 321 kB/s) 2024-09-19T11:51:40.426 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-19T11:51:40.442 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 218 kB/s) 2024-09-19T11:51:40.451 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-19T11:51:40.470 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 231 kB/s) 2024-09-19T11:51:40.475 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-19T11:51:40.494 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 127 kB/s) 2024-09-19T11:51:40.502 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-19T11:51:40.523 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 307 kB/s) 2024-09-19T11:51:40.533 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-19T11:51:40.550 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 357 kB/s) 2024-09-19T11:51:40.560 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-19T11:51:40.578 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 165 kB/s) 2024-09-19T11:51:40.588 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-19T11:51:40.608 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 174 kB/s) 2024-09-19T11:51:40.616 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-19T11:51:40.633 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 240 kB/s) 2024-09-19T11:51:40.636 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-19T11:51:40.653 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-09-19T11:51:40.660 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-19T11:51:40.677 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 413 kB/s) 2024-09-19T11:51:40.680 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-19T11:51:40.697 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 964 kB/s) 2024-09-19T11:51:40.702 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-19T11:51:40.722 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.7 MB/s) 2024-09-19T11:51:40.729 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-19T11:51:40.745 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.1 MB/s) 2024-09-19T11:51:40.753 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-19T11:51:40.770 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 292 kB/s) 2024-09-19T11:51:40.774 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-19T11:51:40.790 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 775 kB/s) 2024-09-19T11:51:40.799 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-19T11:51:40.816 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 822 kB/s) 2024-09-19T11:51:40.820 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-19T11:51:40.840 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.4 MB/s) 2024-09-19T11:51:40.865 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-19T11:51:40.882 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 922 kB/s) 2024-09-19T11:51:40.892 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-19T11:51:40.909 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 908 kB/s) 2024-09-19T11:51:40.914 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-19T11:51:40.934 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 3.8 MB/s) 2024-09-19T11:51:40.945 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-19T11:51:40.962 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.0 MB/s) 2024-09-19T11:51:40.971 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-19T11:51:40.988 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-09-19T11:51:40.994 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-19T11:51:41.015 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.7 MB/s) 2024-09-19T11:51:41.029 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-19T11:51:41.046 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 226 kB/s) 2024-09-19T11:51:41.051 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-19T11:51:41.067 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 812 kB/s) 2024-09-19T11:51:41.075 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-19T11:51:41.092 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 178 kB/s) 2024-09-19T11:51:41.098 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-19T11:51:41.115 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 187 kB/s) 2024-09-19T11:51:41.121 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-19T11:51:41.137 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 127 kB/s) 2024-09-19T11:51:41.143 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-19T11:51:41.160 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 157 kB/s) 2024-09-19T11:51:41.165 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-19T11:51:41.183 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 85 kB/s) 2024-09-19T11:51:41.189 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-19T11:51:41.206 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 177 kB/s) 2024-09-19T11:51:41.213 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-19T11:51:41.230 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 188 kB/s) 2024-09-19T11:51:41.236 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-19T11:51:41.252 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 189 kB/s) 2024-09-19T11:51:41.260 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-19T11:51:41.277 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 60 kB/s) 2024-09-19T11:51:41.286 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-19T11:51:41.302 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 60 kB/s) 2024-09-19T11:51:41.309 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-19T11:51:41.326 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 170 kB/s) 2024-09-19T11:51:41.332 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-19T11:51:41.349 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 178 kB/s) 2024-09-19T11:51:41.355 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-19T11:51:41.372 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-19T11:51:41.378 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-19T11:51:41.395 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-19T11:51:41.401 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-19T11:51:41.418 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 168 kB/s) 2024-09-19T11:51:41.465 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-19T11:51:41.602 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 24 MB/s) 2024-09-19T11:51:41.613 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-19T11:51:41.613 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-19T11:51:41.614 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-19T11:51:41.614 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-19T11:51:41.614 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-19T11:51:41.630 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 877 kB/s) 2024-09-19T11:51:41.630 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-19T11:51:41.646 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 486 kB/s) 2024-09-19T11:51:41.646 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-19T11:51:41.675 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/782 kB Progress (1): 32/782 kB Progress (1): 49/782 kB Progress (1): 65/782 kB Progress (1): 81/782 kB Progress (1): 98/782 kB Progress (1): 114/782 kB Progress (1): 130/782 kB Progress (1): 147/782 kB Progress (1): 163/782 kB Progress (2): 163/782 kB | 1.4/35 kB Progress (3): 163/782 kB | 1.4/35 kB | 1.4/49 kB Progress (3): 163/782 kB | 2.8/35 kB | 1.4/49 kB Progress (3): 163/782 kB | 2.8/35 kB | 2.8/49 kB Progress (3): 180/782 kB | 2.8/35 kB | 2.8/49 kB Progress (3): 180/782 kB | 2.8/35 kB | 4.1/49 kB Progress (3): 180/782 kB | 2.8/35 kB | 5.5/49 kB Progress (3): 180/782 kB | 4.1/35 kB | 5.5/49 kB Progress (4): 180/782 kB | 4.1/35 kB | 5.5/49 kB | 16/98 kB Progress (4): 180/782 kB | 5.5/35 kB | 5.5/49 kB | 16/98 kB Progress (4): 180/782 kB | 5.5/35 kB | 6.9/49 kB | 16/98 kB Progress (5): 180/782 kB | 5.5/35 kB | 6.9/49 kB | 16/98 kB | 16/71 kB Progress (5): 196/782 kB | 5.5/35 kB | 6.9/49 kB | 16/98 kB | 16/71 kB Progress (5): 196/782 kB | 5.5/35 kB | 8.3/49 kB | 16/98 kB | 16/71 kB Progress (5): 196/782 kB | 6.9/35 kB | 8.3/49 kB | 16/98 kB | 16/71 kB Progress (5): 196/782 kB | 6.9/35 kB | 9.7/49 kB | 16/98 kB | 16/71 kB Progress (5): 196/782 kB | 8.3/35 kB | 9.7/49 kB | 16/98 kB | 16/71 kB Progress (5): 196/782 kB | 8.3/35 kB | 11/49 kB | 16/98 kB | 16/71 kB Progress (5): 212/782 kB | 8.3/35 kB | 11/49 kB | 16/98 kB | 16/71 kB Progress (5): 212/782 kB | 8.3/35 kB | 12/49 kB | 16/98 kB | 16/71 kB Progress (5): 212/782 kB | 9.7/35 kB | 12/49 kB | 16/98 kB | 16/71 kB Progress (5): 212/782 kB | 9.7/35 kB | 14/49 kB | 16/98 kB | 16/71 kB Progress (5): 212/782 kB | 11/35 kB | 14/49 kB | 16/98 kB | 16/71 kB Progress (5): 229/782 kB | 11/35 kB | 14/49 kB | 16/98 kB | 16/71 kB Progress (5): 229/782 kB | 12/35 kB | 14/49 kB | 16/98 kB | 16/71 kB Progress (5): 229/782 kB | 12/35 kB | 15/49 kB | 16/98 kB | 16/71 kB Progress (5): 229/782 kB | 14/35 kB | 15/49 kB | 16/98 kB | 16/71 kB Progress (5): 229/782 kB | 14/35 kB | 17/49 kB | 16/98 kB | 16/71 kB Progress (5): 229/782 kB | 15/35 kB | 17/49 kB | 16/98 kB | 16/71 kB Progress (5): 245/782 kB | 15/35 kB | 17/49 kB | 16/98 kB | 16/71 kB Progress (5): 245/782 kB | 17/35 kB | 17/49 kB | 16/98 kB | 16/71 kB Progress (5): 245/782 kB | 17/35 kB | 18/49 kB | 16/98 kB | 16/71 kB Progress (5): 245/782 kB | 18/35 kB | 18/49 kB | 16/98 kB | 16/71 kB Progress (5): 245/782 kB | 18/35 kB | 19/49 kB | 16/98 kB | 16/71 kB Progress (5): 262/782 kB | 18/35 kB | 19/49 kB | 16/98 kB | 16/71 kB Progress (5): 262/782 kB | 19/35 kB | 19/49 kB | 16/98 kB | 16/71 kB Progress (5): 262/782 kB | 19/35 kB | 21/49 kB | 16/98 kB | 16/71 kB Progress (5): 262/782 kB | 21/35 kB | 21/49 kB | 16/98 kB | 16/71 kB Progress (5): 278/782 kB | 21/35 kB | 21/49 kB | 16/98 kB | 16/71 kB Progress (5): 278/782 kB | 21/35 kB | 21/49 kB | 16/98 kB | 33/71 kB Progress (5): 294/782 kB | 21/35 kB | 21/49 kB | 16/98 kB | 33/71 kB Progress (5): 294/782 kB | 21/35 kB | 22/49 kB | 16/98 kB | 33/71 kB Progress (5): 294/782 kB | 21/35 kB | 22/49 kB | 33/98 kB | 33/71 kB Progress (5): 294/782 kB | 22/35 kB | 22/49 kB | 33/98 kB | 33/71 kB Progress (5): 311/782 kB | 22/35 kB | 22/49 kB | 33/98 kB | 33/71 kB Progress (5): 311/782 kB | 23/35 kB | 22/49 kB | 33/98 kB | 33/71 kB Progress (5): 311/782 kB | 23/35 kB | 23/49 kB | 33/98 kB | 33/71 kB Progress (5): 311/782 kB | 25/35 kB | 23/49 kB | 33/98 kB | 33/71 kB Progress (5): 311/782 kB | 25/35 kB | 25/49 kB | 33/98 kB | 33/71 kB Progress (5): 327/782 kB | 25/35 kB | 25/49 kB | 33/98 kB | 33/71 kB Progress (5): 327/782 kB | 25/35 kB | 26/49 kB | 33/98 kB | 33/71 kB Progress (5): 327/782 kB | 26/35 kB | 26/49 kB | 33/98 kB | 33/71 kB Progress (5): 327/782 kB | 26/35 kB | 28/49 kB | 33/98 kB | 33/71 kB Progress (5): 343/782 kB | 26/35 kB | 28/49 kB | 33/98 kB | 33/71 kB Progress (5): 343/782 kB | 28/35 kB | 28/49 kB | 33/98 kB | 33/71 kB Progress (5): 343/782 kB | 28/35 kB | 29/49 kB | 33/98 kB | 33/71 kB Progress (5): 343/782 kB | 29/35 kB | 29/49 kB | 33/98 kB | 33/71 kB Progress (5): 343/782 kB | 29/35 kB | 30/49 kB | 33/98 kB | 33/71 kB Progress (5): 360/782 kB | 29/35 kB | 30/49 kB | 33/98 kB | 33/71 kB Progress (5): 360/782 kB | 29/35 kB | 32/49 kB | 33/98 kB | 33/71 kB Progress (5): 360/782 kB | 30/35 kB | 32/49 kB | 33/98 kB | 33/71 kB Progress (5): 360/782 kB | 30/35 kB | 33/49 kB | 33/98 kB | 33/71 kB Progress (5): 376/782 kB | 30/35 kB | 33/49 kB | 33/98 kB | 33/71 kB Progress (5): 376/782 kB | 32/35 kB | 33/49 kB | 33/98 kB | 33/71 kB Progress (5): 376/782 kB | 32/35 kB | 34/49 kB | 33/98 kB | 33/71 kB Progress (5): 376/782 kB | 33/35 kB | 34/49 kB | 33/98 kB | 33/71 kB Progress (5): 393/782 kB | 33/35 kB | 34/49 kB | 33/98 kB | 33/71 kB Progress (5): 393/782 kB | 34/35 kB | 34/49 kB | 33/98 kB | 33/71 kB Progress (5): 393/782 kB | 34/35 kB | 36/49 kB | 33/98 kB | 33/71 kB Progress (5): 402/782 kB | 34/35 kB | 36/49 kB | 33/98 kB | 33/71 kB Progress (5): 402/782 kB | 35 kB | 36/49 kB | 33/98 kB | 33/71 kB Progress (5): 402/782 kB | 35 kB | 37/49 kB | 33/98 kB | 33/71 kB Progress (5): 418/782 kB | 35 kB | 37/49 kB | 33/98 kB | 33/71 kB Progress (5): 418/782 kB | 35 kB | 39/49 kB | 33/98 kB | 33/71 kB Progress (5): 435/782 kB | 35 kB | 39/49 kB | 33/98 kB | 33/71 kB Progress (5): 451/782 kB | 35 kB | 39/49 kB | 33/98 kB | 33/71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 567 kB/s) 2024-09-19T11:51:41.675 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (4): 468/782 kB | 39/49 kB | 33/98 kB | 33/71 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-19T11:51:41.679 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (4): 484/782 kB | 39/49 kB | 33/98 kB | 33/71 kB Progress (4): 500/782 kB | 39/49 kB | 33/98 kB | 33/71 kB Progress (4): 517/782 kB | 39/49 kB | 33/98 kB | 33/71 kB Progress (4): 533/782 kB | 39/49 kB | 33/98 kB | 33/71 kB Progress (4): 549/782 kB | 39/49 kB | 33/98 kB | 33/71 kB Progress (4): 566/782 kB | 39/49 kB | 33/98 kB | 33/71 kB Progress (4): 582/782 kB | 39/49 kB | 33/98 kB | 33/71 kB Progress (4): 599/782 kB | 39/49 kB | 33/98 kB | 33/71 kB Progress (4): 615/782 kB | 39/49 kB | 33/98 kB | 33/71 kB Progress (4): 615/782 kB | 40/49 kB | 33/98 kB | 33/71 kB Progress (4): 615/782 kB | 41/49 kB | 33/98 kB | 33/71 kB Progress (4): 631/782 kB | 41/49 kB | 33/98 kB | 33/71 kB Progress (4): 631/782 kB | 43/49 kB | 33/98 kB | 33/71 kB Progress (4): 631/782 kB | 44/49 kB | 33/98 kB | 33/71 kB Progress (4): 631/782 kB | 46/49 kB | 33/98 kB | 33/71 kB Progress (4): 631/782 kB | 47/49 kB | 33/98 kB | 33/71 kB Progress (4): 648/782 kB | 47/49 kB | 33/98 kB | 33/71 kB Progress (4): 664/782 kB | 47/49 kB | 33/98 kB | 33/71 kB Progress (4): 664/782 kB | 48/49 kB | 33/98 kB | 33/71 kB Progress (4): 664/782 kB | 49 kB | 33/98 kB | 33/71 kB Progress (4): 681/782 kB | 49 kB | 33/98 kB | 33/71 kB Progress (4): 681/782 kB | 49 kB | 33/98 kB | 49/71 kB Progress (4): 681/782 kB | 49 kB | 49/98 kB | 49/71 kB Progress (4): 697/782 kB | 49 kB | 49/98 kB | 49/71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 735 kB/s) 2024-09-19T11:51:41.679 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-19T11:51:41.682 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (3): 713/782 kB | 49/98 kB | 49/71 kB Progress (3): 730/782 kB | 49/98 kB | 49/71 kB Progress (3): 746/782 kB | 49/98 kB | 49/71 kB Progress (3): 762/782 kB | 49/98 kB | 49/71 kB Progress (3): 779/782 kB | 49/98 kB | 49/71 kB Progress (3): 782 kB | 49/98 kB | 49/71 kB Progress (3): 782 kB | 49/98 kB | 66/71 kB Progress (3): 782 kB | 66/98 kB | 66/71 kB Progress (3): 782 kB | 66/98 kB | 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 11 MB/s) 2024-09-19T11:51:41.682 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-19T11:51:41.682 INFO:tasks.workunit.client.0.smithi120.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 993 kB/s) 2024-09-19T11:51:41.682 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-19T11:51:41.685 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 82/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.2 MB/s) 2024-09-19T11:51:41.685 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-19T11:51:41.691 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.4/11 kB Progress (1): 2.8/11 kB Progress (1): 4.1/11 kB Progress (1): 5.5/11 kB Progress (1): 6.9/11 kB Progress (1): 8.3/11 kB Progress (1): 9.7/11 kB Progress (1): 11/11 kB Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 148 kB/s) 2024-09-19T11:51:41.691 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-19T11:51:41.699 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/205 kB Progress (1): 33/205 kB Progress (1): 49/205 kB Progress (2): 49/205 kB | 16/30 kB Progress (2): 49/205 kB | 30 kB Progress (3): 49/205 kB | 30 kB | 16/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 355 kB/s) 2024-09-19T11:51:41.699 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 66/205 kB | 16/81 kB Progress (2): 66/205 kB | 33/81 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-19T11:51:41.700 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 66/205 kB | 49/81 kB Progress (2): 66/205 kB | 66/81 kB Progress (2): 66/205 kB | 81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 934 kB/s) 2024-09-19T11:51:41.700 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-19T11:51:41.707 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 66/205 kB | 16/798 kB Progress (2): 66/205 kB | 33/798 kB Progress (2): 66/205 kB | 49/798 kB Progress (2): 66/205 kB | 66/798 kB Progress (2): 66/205 kB | 82/798 kB Progress (2): 66/205 kB | 98/798 kB Progress (2): 66/205 kB | 115/798 kB Progress (3): 66/205 kB | 115/798 kB | 1.4/13 kB Progress (3): 82/205 kB | 115/798 kB | 1.4/13 kB Progress (3): 82/205 kB | 115/798 kB | 2.8/13 kB Progress (3): 82/205 kB | 115/798 kB | 4.1/13 kB Progress (3): 82/205 kB | 115/798 kB | 5.5/13 kB Progress (3): 82/205 kB | 115/798 kB | 6.9/13 kB Progress (3): 98/205 kB | 115/798 kB | 6.9/13 kB Progress (3): 98/205 kB | 115/798 kB | 8.3/13 kB Progress (3): 98/205 kB | 115/798 kB | 9.7/13 kB Progress (3): 98/205 kB | 131/798 kB | 9.7/13 kB Progress (3): 98/205 kB | 131/798 kB | 11/13 kB Progress (3): 98/205 kB | 131/798 kB | 12/13 kB Progress (3): 98/205 kB | 131/798 kB | 13 kB Progress (3): 115/205 kB | 131/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 141 kB/s) 2024-09-19T11:51:41.707 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-19T11:51:41.712 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 131/205 kB | 131/798 kB Progress (2): 147/205 kB | 131/798 kB Progress (2): 164/205 kB | 131/798 kB Progress (2): 180/205 kB | 131/798 kB Progress (2): 197/205 kB | 131/798 kB Progress (2): 205 kB | 131/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.1 MB/s) 2024-09-19T11:51:41.712 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-19T11:51:41.718 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 147/798 kB Progress (2): 147/798 kB | 16/182 kB Progress (2): 164/798 kB | 16/182 kB Progress (2): 164/798 kB | 33/182 kB Progress (2): 180/798 kB | 33/182 kB Progress (3): 180/798 kB | 33/182 kB | 16/151 kB Progress (3): 180/798 kB | 49/182 kB | 16/151 kB Progress (3): 197/798 kB | 49/182 kB | 16/151 kB Progress (3): 197/798 kB | 49/182 kB | 33/151 kB Progress (3): 213/798 kB | 49/182 kB | 33/151 kB Progress (3): 213/798 kB | 49/182 kB | 49/151 kB Progress (3): 213/798 kB | 66/182 kB | 49/151 kB Progress (3): 213/798 kB | 66/182 kB | 66/151 kB Progress (3): 229/798 kB | 66/182 kB | 66/151 kB Progress (3): 229/798 kB | 66/182 kB | 82/151 kB Progress (3): 246/798 kB | 66/182 kB | 82/151 kB Progress (3): 246/798 kB | 66/182 kB | 98/151 kB Progress (3): 246/798 kB | 82/182 kB | 98/151 kB Progress (3): 256/798 kB | 82/182 kB | 98/151 kB Progress (3): 256/798 kB | 82/182 kB | 115/151 kB Progress (3): 256/798 kB | 82/182 kB | 131/151 kB Progress (3): 272/798 kB | 82/182 kB | 131/151 kB Progress (3): 272/798 kB | 82/182 kB | 147/151 kB Progress (3): 272/798 kB | 82/182 kB | 151 kB Progress (3): 272/798 kB | 98/182 kB | 151 kB Progress (3): 289/798 kB | 98/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.4 MB/s) 2024-09-19T11:51:41.718 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 305/798 kB | 98/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-19T11:51:41.724 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 321/798 kB | 98/182 kB Progress (2): 338/798 kB | 98/182 kB Progress (2): 354/798 kB | 98/182 kB Progress (2): 370/798 kB | 98/182 kB Progress (2): 387/798 kB | 98/182 kB Progress (2): 403/798 kB | 98/182 kB Progress (2): 420/798 kB | 98/182 kB Progress (3): 420/798 kB | 98/182 kB | 16/27 kB Progress (3): 420/798 kB | 98/182 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 248 kB/s) 2024-09-19T11:51:41.725 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-19T11:51:41.729 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 420/798 kB | 115/182 kB Progress (2): 420/798 kB | 131/182 kB Progress (2): 436/798 kB | 131/182 kB Progress (2): 452/798 kB | 131/182 kB Progress (2): 452/798 kB | 147/182 kB Progress (2): 469/798 kB | 147/182 kB Progress (2): 485/798 kB | 147/182 kB Progress (2): 485/798 kB | 164/182 kB Progress (3): 485/798 kB | 164/182 kB | 16/30 kB Progress (3): 485/798 kB | 164/182 kB | 30 kB Progress (3): 502/798 kB | 164/182 kB | 30 kB Progress (3): 518/798 kB | 164/182 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 268 kB/s) 2024-09-19T11:51:41.729 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 518/798 kB | 180/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-19T11:51:41.729 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 518/798 kB | 182 kB Progress (2): 534/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.6 MB/s) 2024-09-19T11:51:41.729 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 551/798 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-19T11:51:41.736 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 567/798 kB Progress (1): 583/798 kB Progress (1): 600/798 kB Progress (1): 616/798 kB Progress (1): 633/798 kB Progress (1): 649/798 kB Progress (1): 665/798 kB Progress (1): 682/798 kB Progress (1): 698/798 kB Progress (2): 698/798 kB | 16/385 kB Progress (2): 715/798 kB | 16/385 kB Progress (2): 715/798 kB | 33/385 kB Progress (2): 731/798 kB | 33/385 kB Progress (2): 731/798 kB | 49/385 kB Progress (2): 731/798 kB | 66/385 kB Progress (2): 747/798 kB | 66/385 kB Progress (2): 747/798 kB | 82/385 kB Progress (2): 764/798 kB | 82/385 kB Progress (2): 764/798 kB | 98/385 kB Progress (2): 764/798 kB | 115/385 kB Progress (2): 780/798 kB | 115/385 kB Progress (2): 780/798 kB | 131/385 kB Progress (2): 796/798 kB | 131/385 kB Progress (2): 796/798 kB | 147/385 kB Progress (2): 798 kB | 147/385 kB Progress (2): 798 kB | 164/385 kB Progress (2): 798 kB | 180/385 kB Progress (2): 798 kB | 197/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.5 MB/s) 2024-09-19T11:51:41.736 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-19T11:51:41.739 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 213/385 kB Progress (1): 229/385 kB Progress (1): 246/385 kB Progress (1): 262/385 kB Progress (1): 279/385 kB Progress (1): 295/385 kB Progress (1): 311/385 kB Progress (1): 328/385 kB Progress (1): 344/385 kB Progress (1): 360/385 kB Progress (1): 377/385 kB Progress (1): 385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.1 MB/s) 2024-09-19T11:51:41.739 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-19T11:51:41.740 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 105 kB/s) 2024-09-19T11:51:41.740 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-19T11:51:41.744 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/75 kB Progress (1): 33/75 kB Progress (2): 33/75 kB | 16/780 kB Progress (2): 49/75 kB | 16/780 kB Progress (2): 66/75 kB | 16/780 kB Progress (2): 66/75 kB | 33/780 kB Progress (2): 75 kB | 33/780 kB Progress (2): 75 kB | 49/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 578 kB/s) 2024-09-19T11:51:41.744 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-19T11:51:41.761 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 65/780 kB Progress (1): 81/780 kB Progress (1): 98/780 kB Progress (1): 114/780 kB Progress (1): 130/780 kB Progress (1): 147/780 kB Progress (1): 163/780 kB Progress (1): 179/780 kB Progress (1): 196/780 kB Progress (1): 212/780 kB Progress (1): 229/780 kB Progress (1): 245/780 kB Progress (1): 261/780 kB Progress (1): 278/780 kB Progress (1): 294/780 kB Progress (2): 294/780 kB | 16/329 kB Progress (2): 294/780 kB | 33/329 kB Progress (2): 294/780 kB | 49/329 kB Progress (2): 294/780 kB | 64/329 kB Progress (2): 294/780 kB | 80/329 kB Progress (2): 294/780 kB | 97/329 kB Progress (3): 294/780 kB | 97/329 kB | 16/501 kB Progress (3): 294/780 kB | 97/329 kB | 33/501 kB Progress (3): 294/780 kB | 113/329 kB | 33/501 kB Progress (3): 294/780 kB | 113/329 kB | 49/501 kB Progress (3): 294/780 kB | 113/329 kB | 64/501 kB Progress (3): 294/780 kB | 129/329 kB | 64/501 kB Progress (3): 294/780 kB | 129/329 kB | 81/501 kB Progress (3): 294/780 kB | 146/329 kB | 81/501 kB Progress (3): 294/780 kB | 146/329 kB | 97/501 kB Progress (3): 294/780 kB | 146/329 kB | 113/501 kB Progress (3): 294/780 kB | 162/329 kB | 113/501 kB Progress (3): 311/780 kB | 162/329 kB | 113/501 kB Progress (3): 311/780 kB | 162/329 kB | 130/501 kB Progress (3): 327/780 kB | 162/329 kB | 130/501 kB Progress (3): 327/780 kB | 178/329 kB | 130/501 kB Progress (3): 327/780 kB | 178/329 kB | 146/501 kB Progress (3): 343/780 kB | 178/329 kB | 146/501 kB Progress (3): 343/780 kB | 195/329 kB | 146/501 kB Progress (3): 343/780 kB | 195/329 kB | 163/501 kB Progress (3): 360/780 kB | 195/329 kB | 163/501 kB Progress (3): 360/780 kB | 195/329 kB | 179/501 kB Progress (3): 360/780 kB | 211/329 kB | 179/501 kB Progress (3): 376/780 kB | 211/329 kB | 179/501 kB Progress (3): 376/780 kB | 211/329 kB | 195/501 kB Progress (4): 376/780 kB | 211/329 kB | 195/501 kB | 16/354 kB Progress (4): 376/780 kB | 228/329 kB | 195/501 kB | 16/354 kB Progress (4): 392/780 kB | 228/329 kB | 195/501 kB | 16/354 kB Progress (4): 392/780 kB | 228/329 kB | 212/501 kB | 16/354 kB Progress (4): 392/780 kB | 244/329 kB | 212/501 kB | 16/354 kB Progress (4): 409/780 kB | 244/329 kB | 212/501 kB | 16/354 kB Progress (4): 409/780 kB | 244/329 kB | 228/501 kB | 16/354 kB Progress (4): 409/780 kB | 260/329 kB | 228/501 kB | 16/354 kB Progress (4): 409/780 kB | 260/329 kB | 228/501 kB | 33/354 kB Progress (4): 425/780 kB | 260/329 kB | 228/501 kB | 33/354 kB Progress (4): 425/780 kB | 260/329 kB | 245/501 kB | 33/354 kB Progress (4): 425/780 kB | 277/329 kB | 245/501 kB | 33/354 kB Progress (4): 425/780 kB | 277/329 kB | 261/501 kB | 33/354 kB Progress (4): 442/780 kB | 277/329 kB | 261/501 kB | 33/354 kB Progress (4): 442/780 kB | 293/329 kB | 261/501 kB | 33/354 kB Progress (4): 442/780 kB | 293/329 kB | 277/501 kB | 33/354 kB Progress (4): 458/780 kB | 293/329 kB | 277/501 kB | 33/354 kB Progress (4): 458/780 kB | 310/329 kB | 277/501 kB | 33/354 kB Progress (4): 458/780 kB | 310/329 kB | 294/501 kB | 33/354 kB Progress (4): 474/780 kB | 310/329 kB | 294/501 kB | 33/354 kB Progress (5): 474/780 kB | 310/329 kB | 294/501 kB | 33/354 kB | 16/41 kB Progress (5): 474/780 kB | 326/329 kB | 294/501 kB | 33/354 kB | 16/41 kB Progress (5): 474/780 kB | 326/329 kB | 310/501 kB | 33/354 kB | 16/41 kB Progress (5): 474/780 kB | 329 kB | 310/501 kB | 33/354 kB | 16/41 kB Progress (5): 474/780 kB | 329 kB | 326/501 kB | 33/354 kB | 16/41 kB Progress (5): 474/780 kB | 329 kB | 326/501 kB | 49/354 kB | 16/41 kB Progress (5): 491/780 kB | 329 kB | 326/501 kB | 49/354 kB | 16/41 kB Progress (5): 491/780 kB | 329 kB | 326/501 kB | 49/354 kB | 33/41 kB Progress (5): 491/780 kB | 329 kB | 343/501 kB | 49/354 kB | 33/41 kB Progress (5): 491/780 kB | 329 kB | 343/501 kB | 49/354 kB | 41 kB Progress (5): 507/780 kB | 329 kB | 343/501 kB | 49/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.3 MB/s) 2024-09-19T11:51:41.761 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (4): 507/780 kB | 359/501 kB | 49/354 kB | 41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-19T11:51:41.761 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (4): 507/780 kB | 359/501 kB | 66/354 kB | 41 kB Progress (4): 524/780 kB | 359/501 kB | 66/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 284 kB/s) 2024-09-19T11:51:41.762 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (3): 524/780 kB | 376/501 kB | 66/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-19T11:51:41.764 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (3): 540/780 kB | 376/501 kB | 66/354 kB Progress (3): 540/780 kB | 392/501 kB | 66/354 kB Progress (3): 556/780 kB | 392/501 kB | 66/354 kB Progress (3): 556/780 kB | 408/501 kB | 66/354 kB Progress (3): 556/780 kB | 425/501 kB | 66/354 kB Progress (3): 573/780 kB | 425/501 kB | 66/354 kB Progress (3): 573/780 kB | 441/501 kB | 66/354 kB Progress (3): 589/780 kB | 441/501 kB | 66/354 kB Progress (3): 589/780 kB | 458/501 kB | 66/354 kB Progress (3): 589/780 kB | 474/501 kB | 66/354 kB Progress (3): 605/780 kB | 474/501 kB | 66/354 kB Progress (3): 605/780 kB | 490/501 kB | 66/354 kB Progress (3): 605/780 kB | 501 kB | 66/354 kB Progress (3): 622/780 kB | 501 kB | 66/354 kB Progress (3): 638/780 kB | 501 kB | 66/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.4 MB/s) 2024-09-19T11:51:41.764 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-19T11:51:41.766 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 655/780 kB | 66/354 kB Progress (2): 671/780 kB | 66/354 kB Progress (2): 687/780 kB | 66/354 kB Progress (2): 704/780 kB | 66/354 kB Progress (2): 720/780 kB | 66/354 kB Progress (2): 737/780 kB | 66/354 kB Progress (2): 753/780 kB | 66/354 kB Progress (2): 769/780 kB | 66/354 kB Progress (2): 780 kB | 66/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.2 MB/s) 2024-09-19T11:51:41.766 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-19T11:51:41.775 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 82/354 kB Progress (1): 98/354 kB Progress (1): 115/354 kB Progress (1): 131/354 kB Progress (1): 147/354 kB Progress (1): 164/354 kB Progress (1): 180/354 kB Progress (1): 197/354 kB Progress (1): 213/354 kB Progress (2): 213/354 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 40 kB/s) 2024-09-19T11:51:41.775 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-19T11:51:41.782 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 213/354 kB | 16/586 kB Progress (2): 213/354 kB | 33/586 kB Progress (2): 213/354 kB | 49/586 kB Progress (2): 213/354 kB | 66/586 kB Progress (2): 213/354 kB | 82/586 kB Progress (2): 213/354 kB | 98/586 kB Progress (2): 213/354 kB | 115/586 kB Progress (3): 213/354 kB | 115/586 kB | 16/211 kB Progress (3): 213/354 kB | 131/586 kB | 16/211 kB Progress (3): 213/354 kB | 131/586 kB | 33/211 kB Progress (3): 213/354 kB | 147/586 kB | 33/211 kB Progress (3): 213/354 kB | 147/586 kB | 49/211 kB Progress (3): 229/354 kB | 147/586 kB | 49/211 kB Progress (3): 229/354 kB | 164/586 kB | 49/211 kB Progress (3): 229/354 kB | 164/586 kB | 66/211 kB Progress (3): 246/354 kB | 164/586 kB | 66/211 kB Progress (3): 246/354 kB | 180/586 kB | 66/211 kB Progress (3): 246/354 kB | 180/586 kB | 82/211 kB Progress (4): 246/354 kB | 180/586 kB | 82/211 kB | 14 kB Progress (4): 256/354 kB | 180/586 kB | 82/211 kB | 14 kB Progress (4): 256/354 kB | 197/586 kB | 82/211 kB | 14 kB Progress (4): 256/354 kB | 197/586 kB | 98/211 kB | 14 kB Progress (4): 272/354 kB | 197/586 kB | 98/211 kB | 14 kB Progress (4): 272/354 kB | 213/586 kB | 98/211 kB | 14 kB Progress (4): 272/354 kB | 213/586 kB | 115/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 87 kB/s) 2024-09-19T11:51:41.782 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (3): 289/354 kB | 213/586 kB | 115/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-19T11:51:41.785 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (3): 289/354 kB | 229/586 kB | 115/211 kB Progress (3): 289/354 kB | 229/586 kB | 131/211 kB Progress (3): 289/354 kB | 246/586 kB | 131/211 kB Progress (3): 289/354 kB | 246/586 kB | 147/211 kB Progress (3): 289/354 kB | 256/586 kB | 147/211 kB Progress (3): 289/354 kB | 256/586 kB | 164/211 kB Progress (3): 289/354 kB | 272/586 kB | 164/211 kB Progress (3): 305/354 kB | 272/586 kB | 164/211 kB Progress (3): 305/354 kB | 272/586 kB | 180/211 kB Progress (3): 305/354 kB | 289/586 kB | 180/211 kB Progress (3): 321/354 kB | 289/586 kB | 180/211 kB Progress (3): 321/354 kB | 289/586 kB | 197/211 kB Progress (3): 321/354 kB | 305/586 kB | 197/211 kB Progress (3): 321/354 kB | 305/586 kB | 211 kB Progress (3): 338/354 kB | 305/586 kB | 211 kB Progress (3): 338/354 kB | 321/586 kB | 211 kB Progress (3): 354 kB | 321/586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.3 MB/s) 2024-09-19T11:51:41.785 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 354 kB | 338/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-19T11:51:41.785 INFO:tasks.workunit.client.0.smithi120.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.1 MB/s) 2024-09-19T11:51:41.785 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 354/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-19T11:51:41.789 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 370/586 kB Progress (1): 387/586 kB Progress (1): 403/586 kB Progress (1): 420/586 kB Progress (1): 436/586 kB Progress (1): 452/586 kB Progress (1): 469/586 kB Progress (1): 485/586 kB Progress (1): 502/586 kB Progress (1): 518/586 kB Progress (1): 534/586 kB Progress (1): 551/586 kB Progress (1): 567/586 kB Progress (1): 583/586 kB Progress (1): 586 kB Progress (2): 586 kB | 16/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.4 MB/s) 2024-09-19T11:51:41.790 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-19T11:51:41.792 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 33/106 kB Progress (1): 49/106 kB Progress (1): 66/106 kB Progress (1): 82/106 kB Progress (1): 98/106 kB Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 604 kB/s) 2024-09-19T11:51:41.792 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-19T11:51:41.796 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 38 kB/s) 2024-09-19T11:51:41.796 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-19T11:51:41.806 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/245 kB Progress (2): 16/245 kB | 16/205 kB Progress (2): 33/245 kB | 16/205 kB Progress (2): 33/245 kB | 33/205 kB Progress (2): 49/245 kB | 33/205 kB Progress (2): 49/245 kB | 49/205 kB Progress (2): 66/245 kB | 49/205 kB Progress (2): 66/245 kB | 66/205 kB Progress (2): 82/245 kB | 66/205 kB Progress (2): 82/245 kB | 82/205 kB Progress (2): 98/245 kB | 82/205 kB Progress (2): 98/245 kB | 98/205 kB Progress (2): 115/245 kB | 98/205 kB Progress (2): 115/245 kB | 115/205 kB Progress (2): 131/245 kB | 115/205 kB Progress (2): 131/245 kB | 131/205 kB Progress (2): 147/245 kB | 131/205 kB Progress (2): 147/245 kB | 147/205 kB Progress (2): 164/245 kB | 147/205 kB Progress (2): 164/245 kB | 164/205 kB Progress (3): 164/245 kB | 164/205 kB | 15 kB Progress (3): 180/245 kB | 164/205 kB | 15 kB Progress (3): 180/245 kB | 180/205 kB | 15 kB Progress (3): 197/245 kB | 180/205 kB | 15 kB Progress (3): 197/245 kB | 197/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 81 kB/s) 2024-09-19T11:51:41.806 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-19T11:51:41.806 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 213/245 kB | 197/205 kB Progress (2): 213/245 kB | 205 kB Progress (2): 229/245 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.1 MB/s) 2024-09-19T11:51:41.806 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 245 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-19T11:51:41.807 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 245 kB | 16/16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.3 MB/s) 2024-09-19T11:51:41.807 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-19T11:51:41.807 INFO:tasks.workunit.client.0.smithi120.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 86 kB/s) 2024-09-19T11:51:41.807 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-19T11:51:41.811 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 33 kB/s) 2024-09-19T11:51:41.821 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Progress (2): 23 kB | 16/24 kB Progress (2): 23 kB | 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 110 kB/s) 2024-09-19T11:51:41.822 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 24 kB | 16/17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 118 kB/s) 2024-09-19T11:51:41.822 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 17 kB Progress (2): 17 kB | 16/184 kB Progress (2): 17 kB | 33/184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 85 kB/s) 2024-09-19T11:51:41.825 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 37/184 kB Progress (1): 53/184 kB Progress (1): 69/184 kB Progress (1): 86/184 kB Progress (1): 102/184 kB Progress (1): 118/184 kB Progress (1): 135/184 kB Progress (1): 151/184 kB Progress (1): 168/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 884 kB/s) 2024-09-19T11:51:41.854 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:51:41.855 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-19T11:51:41.863 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-19T11:51:41.880 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 343 kB/s) 2024-09-19T11:51:41.883 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-19T11:51:41.899 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 318 kB/s) 2024-09-19T11:51:41.902 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-19T11:51:41.917 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-19T11:51:41.921 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-19T11:51:41.937 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 891 kB/s) 2024-09-19T11:51:41.944 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-19T11:51:41.963 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 48/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 97/153 kB Progress (1): 114/153 kB Progress (1): 130/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 8.1 MB/s) 2024-09-19T11:51:41.963 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-19T11:51:41.984 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 63/215 kB Progress (1): 79/215 kB Progress (1): 96/215 kB Progress (1): 112/215 kB Progress (1): 128/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 177/215 kB Progress (1): 194/215 kB Progress (1): 210/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 10 MB/s) 2024-09-19T11:51:42.076 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:51:42.076 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-19T11:51:42.082 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-19T11:51:42.098 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 166 kB/s) 2024-09-19T11:51:42.100 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-19T11:51:42.116 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.4 MB/s) 2024-09-19T11:51:42.121 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-19T11:51:42.137 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 548 kB/s) 2024-09-19T11:51:42.141 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-19T11:51:42.157 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.6 MB/s) 2024-09-19T11:51:42.161 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-19T11:51:42.176 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-19T11:51:42.179 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-19T11:51:42.194 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 215 kB/s) 2024-09-19T11:51:42.199 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-19T11:51:42.214 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-19T11:51:42.217 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-19T11:51:42.232 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 171 kB/s) 2024-09-19T11:51:42.236 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-19T11:51:42.252 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 881 kB/s) 2024-09-19T11:51:42.257 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-19T11:51:42.273 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 200 kB/s) 2024-09-19T11:51:42.276 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-19T11:51:42.293 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 492 kB/s) 2024-09-19T11:51:42.297 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-19T11:51:42.314 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 465 kB/s) 2024-09-19T11:51:42.319 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-19T11:51:42.335 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 501 kB/s) 2024-09-19T11:51:42.341 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-19T11:51:42.357 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.2 MB/s) 2024-09-19T11:51:42.368 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-19T11:51:42.384 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 319 kB/s) 2024-09-19T11:51:42.390 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-19T11:51:42.409 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.6 MB/s) 2024-09-19T11:51:42.420 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-19T11:51:42.436 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 319 kB/s) 2024-09-19T11:51:42.445 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-19T11:51:42.464 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.5 MB/s) 2024-09-19T11:51:42.465 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-19T11:51:42.465 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-19T11:51:42.465 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-19T11:51:42.466 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-19T11:51:42.466 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-19T11:51:42.482 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 8.5 kB Progress (2): 8.5 kB | 16/55 kB Progress (3): 8.5 kB | 16/55 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 530 kB/s) 2024-09-19T11:51:42.482 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-19T11:51:42.484 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (3): 16/55 kB | 16/41 kB | 16/269 kB Progress (3): 33/55 kB | 16/41 kB | 16/269 kB Progress (3): 33/55 kB | 33/41 kB | 16/269 kB Progress (3): 33/55 kB | 33/41 kB | 33/269 kB Progress (3): 33/55 kB | 41 kB | 33/269 kB Progress (3): 49/55 kB | 41 kB | 33/269 kB Progress (3): 49/55 kB | 41 kB | 49/269 kB Progress (3): 55 kB | 41 kB | 49/269 kB Progress (3): 55 kB | 41 kB | 66/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.3 MB/s) 2024-09-19T11:51:42.484 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-19T11:51:42.484 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 55 kB | 82/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.7 MB/s) 2024-09-19T11:51:42.487 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 98/269 kB Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (2): 164/269 kB | 2.5 kB Progress (2): 180/269 kB | 2.5 kB Progress (2): 197/269 kB | 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 114 kB/s) 2024-09-19T11:51:42.489 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 262/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 11 MB/s) 2024-09-19T11:51:42.502 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/327 kB Progress (1): 32/327 kB Progress (1): 49/327 kB Progress (1): 65/327 kB Progress (1): 79/327 kB Progress (1): 95/327 kB Progress (1): 112/327 kB Progress (1): 128/327 kB Progress (1): 144/327 kB Progress (1): 161/327 kB Progress (1): 177/327 kB Progress (1): 193/327 kB Progress (2): 193/327 kB | 16/587 kB Progress (2): 210/327 kB | 16/587 kB Progress (2): 226/327 kB | 16/587 kB Progress (2): 226/327 kB | 33/587 kB Progress (2): 243/327 kB | 33/587 kB Progress (2): 243/327 kB | 49/587 kB Progress (2): 259/327 kB | 49/587 kB Progress (2): 275/327 kB | 49/587 kB Progress (2): 275/327 kB | 63/587 kB Progress (2): 292/327 kB | 63/587 kB Progress (2): 292/327 kB | 79/587 kB Progress (2): 308/327 kB | 79/587 kB Progress (2): 325/327 kB | 79/587 kB Progress (2): 325/327 kB | 95/587 kB Progress (2): 327 kB | 95/587 kB Progress (2): 327 kB | 112/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.3 MB/s) 2024-09-19T11:51:42.518 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 128/587 kB Progress (1): 145/587 kB Progress (1): 161/587 kB Progress (1): 177/587 kB Progress (1): 194/587 kB Progress (1): 210/587 kB Progress (1): 226/587 kB Progress (1): 243/587 kB Progress (1): 259/587 kB Progress (1): 276/587 kB Progress (1): 292/587 kB Progress (1): 308/587 kB Progress (1): 325/587 kB Progress (1): 341/587 kB Progress (1): 357/587 kB Progress (1): 374/587 kB Progress (1): 390/587 kB Progress (1): 407/587 kB Progress (1): 423/587 kB Progress (1): 439/587 kB Progress (1): 456/587 kB Progress (1): 472/587 kB Progress (1): 489/587 kB Progress (1): 505/587 kB Progress (1): 521/587 kB Progress (1): 538/587 kB Progress (1): 554/587 kB Progress (1): 570/587 kB Progress (1): 587/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 11 MB/s) 2024-09-19T11:51:42.563 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-19T11:51:42.564 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:51:42.564 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-19T11:51:42.570 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-19T11:51:42.585 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-19T11:51:42.587 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-19T11:51:42.603 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 397 kB/s) 2024-09-19T11:51:42.605 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-19T11:51:42.620 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.0 MB/s) 2024-09-19T11:51:42.624 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-19T11:51:42.638 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 932 kB/s) 2024-09-19T11:51:42.642 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-19T11:51:42.657 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-19T11:51:42.659 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-19T11:51:42.674 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 283 kB/s) 2024-09-19T11:51:42.677 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-19T11:51:42.692 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-19T11:51:42.696 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-19T11:51:42.711 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-19T11:51:42.713 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-19T11:51:42.728 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-19T11:51:42.731 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-19T11:51:42.746 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-19T11:51:42.749 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-19T11:51:42.764 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-19T11:51:42.767 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-19T11:51:42.783 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-19T11:51:42.786 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-19T11:51:42.801 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 411 kB/s) 2024-09-19T11:51:42.805 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-19T11:51:42.819 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-19T11:51:42.824 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-19T11:51:42.837 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-09-19T11:51:42.839 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-19T11:51:42.854 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-19T11:51:42.858 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-19T11:51:42.872 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 352 kB/s) 2024-09-19T11:51:42.876 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-19T11:51:42.892 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 71 kB/s) 2024-09-19T11:51:42.896 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-19T11:51:42.911 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 51 kB/s) 2024-09-19T11:51:42.913 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-19T11:51:42.929 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 377 kB/s) 2024-09-19T11:51:42.933 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-19T11:51:42.949 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.6 MB/s) 2024-09-19T11:51:42.956 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-19T11:51:42.972 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 75 kB/s) 2024-09-19T11:51:42.975 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-19T11:51:42.991 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 83 kB/s) 2024-09-19T11:51:43.004 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-19T11:51:43.020 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 846 kB/s) 2024-09-19T11:51:43.020 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-19T11:51:43.021 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-19T11:51:43.021 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-19T11:51:43.021 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-19T11:51:43.021 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-19T11:51:43.037 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/122 kB Progress (2): 16/122 kB | 16/55 kB Progress (3): 16/122 kB | 16/55 kB | 4.2 kB Progress (3): 33/122 kB | 16/55 kB | 4.2 kB Progress (3): 33/122 kB | 33/55 kB | 4.2 kB Progress (3): 49/122 kB | 33/55 kB | 4.2 kB Progress (4): 49/122 kB | 33/55 kB | 4.2 kB | 16/27 kB Progress (4): 66/122 kB | 33/55 kB | 4.2 kB | 16/27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 263 kB/s) 2024-09-19T11:51:43.038 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-19T11:51:43.038 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (3): 66/122 kB | 33/55 kB | 27 kB Progress (3): 82/122 kB | 33/55 kB | 27 kB Progress (3): 82/122 kB | 49/55 kB | 27 kB Progress (4): 82/122 kB | 49/55 kB | 27 kB | 16/334 kB Progress (4): 98/122 kB | 49/55 kB | 27 kB | 16/334 kB Progress (4): 98/122 kB | 55 kB | 27 kB | 16/334 kB Progress (4): 115/122 kB | 55 kB | 27 kB | 16/334 kB Progress (4): 122 kB | 55 kB | 27 kB | 16/334 kB Progress (4): 122 kB | 55 kB | 27 kB | 33/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.7 MB/s) 2024-09-19T11:51:43.038 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-19T11:51:43.038 INFO:tasks.workunit.client.0.smithi120.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.2 MB/s) 2024-09-19T11:51:43.038 INFO:tasks.workunit.client.0.smithi120.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.2 MB/s) 2024-09-19T11:51:43.038 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-19T11:51:43.044 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 49/334 kB Progress (1): 64/334 kB Progress (1): 80/334 kB Progress (1): 97/334 kB Progress (1): 113/334 kB Progress (1): 129/334 kB Progress (1): 146/334 kB Progress (1): 162/334 kB Progress (1): 179/334 kB Progress (1): 195/334 kB Progress (1): 211/334 kB Progress (1): 228/334 kB Progress (1): 244/334 kB Progress (1): 261/334 kB Progress (1): 277/334 kB Progress (1): 293/334 kB Progress (1): 310/334 kB Progress (1): 326/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 15 MB/s) 2024-09-19T11:51:43.052 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (2): 49/267 kB | 4.7 kB Progress (2): 62/267 kB | 4.7 kB Progress (3): 62/267 kB | 4.7 kB | 16/23 kB Progress (3): 79/267 kB | 4.7 kB | 16/23 kB Progress (3): 79/267 kB | 4.7 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 155 kB/s) 2024-09-19T11:51:43.053 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 95/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 760 kB/s) 2024-09-19T11:51:43.056 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 111/267 kB Progress (1): 128/267 kB Progress (1): 144/267 kB Progress (1): 161/267 kB Progress (1): 177/267 kB Progress (1): 193/267 kB Progress (1): 210/267 kB Progress (1): 226/267 kB Progress (1): 242/267 kB Progress (1): 259/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.4 MB/s) 2024-09-19T11:51:43.468 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-19T11:51:43.471 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-19T11:51:44.736 INFO:tasks.workunit.client.0.smithi120.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-19T11:51:44.737 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:51:44.737 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-19T11:51:44.741 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-19T11:51:44.741 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:51:44.741 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-19T11:51:44.748 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-19T11:51:44.748 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-19T11:51:44.979 INFO:tasks.workunit.client.0.smithi120.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-19T11:51:44.979 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:51:44.979 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-19T11:51:44.985 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-19T11:51:45.000 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-19T11:51:45.005 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-19T11:51:45.020 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-19T11:51:45.024 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-19T11:51:45.039 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-19T11:51:45.044 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-19T11:51:45.058 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 290 kB/s) 2024-09-19T11:51:45.062 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-19T11:51:45.076 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 236 kB/s) 2024-09-19T11:51:45.080 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-19T11:51:45.094 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-19T11:51:45.099 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-19T11:51:45.113 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-19T11:51:45.117 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-19T11:51:45.131 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-19T11:51:45.133 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-19T11:51:45.147 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-09-19T11:51:45.150 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-19T11:51:45.164 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-19T11:51:45.166 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-19T11:51:45.180 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-19T11:51:45.183 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-19T11:51:45.197 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-19T11:51:45.199 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-19T11:51:45.214 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-19T11:51:45.216 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-19T11:51:45.230 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-19T11:51:45.232 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-19T11:51:45.246 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-19T11:51:45.250 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-19T11:51:45.263 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-19T11:51:45.265 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-19T11:51:45.279 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.0 MB/s) 2024-09-19T11:51:45.282 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-19T11:51:45.295 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-19T11:51:45.298 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-19T11:51:45.313 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 145 kB/s) 2024-09-19T11:51:45.316 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-19T11:51:45.330 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-19T11:51:45.333 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-19T11:51:45.347 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 118 kB/s) 2024-09-19T11:51:45.348 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-19T11:51:45.361 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-19T11:51:45.363 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-19T11:51:45.380 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-19T11:51:45.380 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-19T11:51:45.394 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-19T11:51:45.396 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-19T11:51:45.410 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-19T11:51:45.414 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-19T11:51:45.427 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-19T11:51:45.429 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-19T11:51:45.443 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-19T11:51:45.444 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-19T11:51:45.458 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-19T11:51:45.460 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-19T11:51:45.474 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 148 kB/s) 2024-09-19T11:51:45.476 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-19T11:51:45.490 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-19T11:51:45.493 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-19T11:51:45.507 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-19T11:51:45.509 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-19T11:51:45.523 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-19T11:51:45.525 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-19T11:51:45.539 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.0 MB/s) 2024-09-19T11:51:45.542 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-19T11:51:45.556 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-19T11:51:45.557 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-19T11:51:45.571 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-19T11:51:45.573 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-19T11:51:45.587 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-19T11:51:45.589 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-19T11:51:45.603 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.3 MB/s) 2024-09-19T11:51:45.606 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-19T11:51:45.621 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-19T11:51:45.622 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-19T11:51:45.638 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 925 kB/s) 2024-09-19T11:51:45.640 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-19T11:51:45.654 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-19T11:51:45.656 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-19T11:51:45.669 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 370 kB/s) 2024-09-19T11:51:45.671 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-19T11:51:45.686 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-19T11:51:45.689 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-19T11:51:45.704 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 200 kB/s) 2024-09-19T11:51:45.708 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-19T11:51:45.721 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 283 kB/s) 2024-09-19T11:51:45.728 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-19T11:51:45.743 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 137 kB/s) 2024-09-19T11:51:45.748 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-19T11:51:45.763 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 232 kB/s) 2024-09-19T11:51:45.770 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-19T11:51:45.786 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 684 kB/s) 2024-09-19T11:51:45.790 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-19T11:51:45.806 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 842 kB/s) 2024-09-19T11:51:45.810 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-19T11:51:45.826 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-19T11:51:45.832 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-19T11:51:45.847 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 24 kB/s) 2024-09-19T11:51:45.851 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-19T11:51:45.867 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 381 kB/s) 2024-09-19T11:51:45.870 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-19T11:51:45.886 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 458 kB/s) 2024-09-19T11:51:45.892 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-19T11:51:45.904 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 322 kB/s) 2024-09-19T11:51:45.909 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-19T11:51:45.925 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 457 kB/s) 2024-09-19T11:51:45.931 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-19T11:51:45.947 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-19T11:51:45.951 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-19T11:51:45.974 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 3.4 MB/s) 2024-09-19T11:51:45.981 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-19T11:51:45.998 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-19T11:51:46.004 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-19T11:51:46.020 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 353 kB/s) 2024-09-19T11:51:46.025 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-19T11:51:46.040 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 285 kB/s) 2024-09-19T11:51:46.044 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-19T11:51:46.059 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 213 kB/s) 2024-09-19T11:51:46.062 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-19T11:51:46.079 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.6 MB/s) 2024-09-19T11:51:46.085 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-19T11:51:46.100 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 148 kB/s) 2024-09-19T11:51:46.113 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-19T11:51:46.141 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 164/308 kB Progress (1): 180/308 kB Progress (1): 197/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 246/308 kB Progress (1): 262/308 kB Progress (1): 279/308 kB Progress (1): 295/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 11 MB/s) 2024-09-19T11:51:46.142 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-19T11:51:46.142 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-19T11:51:46.143 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-19T11:51:46.143 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-19T11:51:46.143 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-19T11:51:46.161 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (1): 66/171 kB Progress (2): 66/171 kB | 14 kB Progress (2): 82/171 kB | 14 kB Progress (3): 82/171 kB | 14 kB | 16/26 kB Progress (3): 98/171 kB | 14 kB | 16/26 kB Progress (4): 98/171 kB | 14 kB | 16/26 kB | 16/118 kB Progress (5): 98/171 kB | 14 kB | 16/26 kB | 16/118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 755 kB/s) 2024-09-19T11:51:46.161 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (4): 98/171 kB | 26 kB | 16/118 kB | 8.2 kB Progress (4): 115/171 kB | 26 kB | 16/118 kB | 8.2 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-19T11:51:46.161 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (4): 115/171 kB | 26 kB | 33/118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 454 kB/s) 2024-09-19T11:51:46.161 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-19T11:51:46.162 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (3): 131/171 kB | 26 kB | 33/118 kB Progress (3): 131/171 kB | 26 kB | 49/118 kB Progress (3): 147/171 kB | 26 kB | 49/118 kB Progress (3): 147/171 kB | 26 kB | 64/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.4 MB/s) 2024-09-19T11:51:46.162 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-19T11:51:46.163 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 164/171 kB | 64/118 kB Progress (2): 164/171 kB | 81/118 kB Progress (2): 171 kB | 81/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 8.5 MB/s) 2024-09-19T11:51:46.163 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 97/118 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-19T11:51:46.164 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 113/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.6 MB/s) 2024-09-19T11:51:46.164 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-19T11:51:46.179 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (1): 49/146 kB Progress (1): 59/146 kB Progress (2): 59/146 kB | 16/61 kB Progress (2): 75/146 kB | 16/61 kB Progress (3): 75/146 kB | 16/61 kB | 16/136 kB Progress (3): 75/146 kB | 33/61 kB | 16/136 kB Progress (3): 92/146 kB | 33/61 kB | 16/136 kB Progress (3): 92/146 kB | 33/61 kB | 33/136 kB Progress (3): 92/146 kB | 49/61 kB | 33/136 kB Progress (3): 108/146 kB | 49/61 kB | 33/136 kB Progress (3): 108/146 kB | 49/61 kB | 49/136 kB Progress (3): 108/146 kB | 61 kB | 49/136 kB Progress (3): 124/146 kB | 61 kB | 49/136 kB Progress (3): 124/146 kB | 61 kB | 66/136 kB Progress (3): 124/146 kB | 61 kB | 82/136 kB Progress (3): 141/146 kB | 61 kB | 82/136 kB Progress (4): 141/146 kB | 61 kB | 82/136 kB | 16/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.8 MB/s) 2024-09-19T11:51:46.179 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (3): 146 kB | 82/136 kB | 16/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-19T11:51:46.179 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (3): 146 kB | 98/136 kB | 16/501 kB Progress (3): 146 kB | 98/136 kB | 32/501 kB Progress (4): 146 kB | 98/136 kB | 32/501 kB | 16/58 kB Progress (4): 146 kB | 115/136 kB | 32/501 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.2 MB/s) 2024-09-19T11:51:46.179 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-19T11:51:46.180 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (3): 115/136 kB | 32/501 kB | 33/58 kB Progress (3): 115/136 kB | 49/501 kB | 33/58 kB Progress (3): 131/136 kB | 49/501 kB | 33/58 kB Progress (3): 136 kB | 49/501 kB | 33/58 kB Progress (3): 136 kB | 49/501 kB | 49/58 kB Progress (3): 136 kB | 65/501 kB | 49/58 kB Progress (3): 136 kB | 65/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.9 MB/s) 2024-09-19T11:51:46.180 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 81/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.6 MB/s) 2024-09-19T11:51:46.188 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 98/501 kB Progress (1): 114/501 kB Progress (1): 130/501 kB Progress (1): 147/501 kB Progress (1): 163/501 kB Progress (1): 180/501 kB Progress (1): 196/501 kB Progress (1): 212/501 kB Progress (1): 229/501 kB Progress (1): 245/501 kB Progress (1): 262/501 kB Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 311/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 393/501 kB Progress (1): 402/501 kB Progress (1): 418/501 kB Progress (1): 435/501 kB Progress (1): 451/501 kB Progress (1): 468/501 kB Progress (1): 484/501 kB Progress (1): 500/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 11 MB/s) 2024-09-19T11:51:46.194 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.4 MB/s) 2024-09-19T11:51:46.249 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 23 MB/s) 2024-09-19T11:51:46.343 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:51:46.344 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-19T11:51:46.347 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-19T11:51:46.361 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-19T11:51:46.363 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-19T11:51:46.377 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-19T11:51:46.379 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-19T11:51:46.393 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.2 MB/s) 2024-09-19T11:51:46.396 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-19T11:51:46.411 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-19T11:51:46.414 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-19T11:51:46.428 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-19T11:51:46.431 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-19T11:51:46.446 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 261 kB/s) 2024-09-19T11:51:46.450 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-19T11:51:46.465 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 401 kB/s) 2024-09-19T11:51:46.468 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-19T11:51:46.483 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 417 kB/s) 2024-09-19T11:51:46.487 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-19T11:51:46.505 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.3 MB/s) 2024-09-19T11:51:46.521 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-19T11:51:46.537 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 909 kB/s) 2024-09-19T11:51:46.541 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-19T11:51:46.556 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 136 kB/s) 2024-09-19T11:51:46.560 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-19T11:51:46.574 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-19T11:51:46.577 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-19T11:51:46.592 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-19T11:51:46.601 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-19T11:51:46.616 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.4 MB/s) 2024-09-19T11:51:46.617 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-19T11:51:46.617 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-19T11:51:46.617 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-19T11:51:46.618 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-19T11:51:46.618 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-19T11:51:46.635 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/211 kB Progress (2): 16/211 kB | 16/79 kB Progress (3): 16/211 kB | 16/79 kB | 16/26 kB Progress (4): 16/211 kB | 16/79 kB | 16/26 kB | 16/58 kB Progress (4): 33/211 kB | 16/79 kB | 16/26 kB | 16/58 kB Progress (4): 33/211 kB | 33/79 kB | 16/26 kB | 16/58 kB Progress (5): 33/211 kB | 33/79 kB | 16/26 kB | 16/58 kB | 0/1.0 MB Progress (5): 33/211 kB | 33/79 kB | 26 kB | 16/58 kB | 0/1.0 MB Progress (5): 33/211 kB | 33/79 kB | 26 kB | 33/58 kB | 0/1.0 MB Progress (5): 33/211 kB | 49/79 kB | 26 kB | 33/58 kB | 0/1.0 MB Progress (5): 49/211 kB | 49/79 kB | 26 kB | 33/58 kB | 0/1.0 MB Progress (5): 49/211 kB | 49/79 kB | 26 kB | 33/58 kB | 0/1.0 MB Progress (5): 49/211 kB | 66/79 kB | 26 kB | 33/58 kB | 0/1.0 MB Progress (5): 49/211 kB | 66/79 kB | 26 kB | 49/58 kB | 0/1.0 MB Progress (5): 63/211 kB | 66/79 kB | 26 kB | 49/58 kB | 0/1.0 MB Progress (5): 63/211 kB | 79 kB | 26 kB | 49/58 kB | 0/1.0 MB Progress (5): 63/211 kB | 79 kB | 26 kB | 49/58 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.6 MB/s) 2024-09-19T11:51:46.636 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (4): 63/211 kB | 79 kB | 58 kB | 0/1.0 MB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-19T11:51:46.636 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (4): 80/211 kB | 79 kB | 58 kB | 0/1.0 MB Progress (4): 80/211 kB | 79 kB | 58 kB | 0.1/1.0 MB Progress (4): 96/211 kB | 79 kB | 58 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-19T11:51:46.636 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (3): 96/211 kB | 79 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.7 MB/s) 2024-09-19T11:51:46.636 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-19T11:51:46.637 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 112/211 kB | 0.1/1.0 MB Progress (2): 112/211 kB | 0.1/1.0 MB Progress (2): 129/211 kB | 0.1/1.0 MB Progress (2): 129/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 162/211 kB | 0.1/1.0 MB Progress (2): 162/211 kB | 0.1/1.0 MB Progress (2): 178/211 kB | 0.1/1.0 MB Progress (2): 178/211 kB | 0.2/1.0 MB Progress (2): 194/211 kB | 0.2/1.0 MB Progress (2): 194/211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-19T11:51:46.650 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (2): 0.8/1.0 MB | 16/116 kB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (3): 0.9/1.0 MB | 16/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 33/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 33/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 33/116 kB | 33/267 kB Progress (3): 0.9/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 0.9/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 0.9/1.0 MB | 49/116 kB | 49/267 kB Progress (3): 0.9/1.0 MB | 66/116 kB | 49/267 kB Progress (3): 0.9/1.0 MB | 66/116 kB | 49/267 kB Progress (3): 0.9/1.0 MB | 82/116 kB | 49/267 kB Progress (3): 0.9/1.0 MB | 82/116 kB | 65/267 kB Progress (3): 0.9/1.0 MB | 82/116 kB | 65/267 kB Progress (3): 0.9/1.0 MB | 98/116 kB | 65/267 kB Progress (3): 0.9/1.0 MB | 98/116 kB | 82/267 kB Progress (3): 0.9/1.0 MB | 98/116 kB | 82/267 kB Progress (3): 0.9/1.0 MB | 115/116 kB | 82/267 kB Progress (3): 0.9/1.0 MB | 115/116 kB | 98/267 kB Progress (3): 0.9/1.0 MB | 116 kB | 98/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 98/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 114/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 114/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.6 MB/s) 2024-09-19T11:51:46.652 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 1.0/1.0 MB | 131/267 kB Progress (2): 1.0/1.0 MB | 131/267 kB Progress (2): 1.0/1.0 MB | 147/267 kB Progress (2): 1.0/1.0 MB | 147/267 kB Progress (2): 1.0/1.0 MB | 147/267 kB Progress (2): 1.0/1.0 MB | 164/267 kB Progress (2): 1.0 MB | 164/267 kB Progress (2): 1.0 MB | 180/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 29 MB/s) 2024-09-19T11:51:46.654 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 196/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.4 MB/s) 2024-09-19T11:51:46.813 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-19T11:51:46.841 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T11:51:46.841 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] BUILD SUCCESS 2024-09-19T11:51:46.841 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T11:51:46.842 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Total time: 7.903 s 2024-09-19T11:51:46.842 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Finished at: 2024-09-19T11:51:46Z 2024-09-19T11:51:46.842 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T11:51:46.870 INFO:tasks.workunit.client.0.smithi120.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-19T11:51:46.877 INFO:tasks.workunit.client.0.smithi120.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-19T11:51:48.063 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Scanning for projects... 2024-09-19T11:51:48.166 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:51:48.166 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-19T11:51:48.166 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Building jcksum 1.0 2024-09-19T11:51:48.166 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] from pom.xml 2024-09-19T11:51:48.166 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-19T11:51:48.536 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:51:48.536 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-19T11:51:48.674 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-19T11:51:48.675 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:51:48.675 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-19T11:51:48.771 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-19T11:51:48.771 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:51:48.771 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-19T11:51:48.773 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-19T11:51:48.773 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:51:48.773 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-19T11:51:48.778 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-19T11:51:48.778 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:51:48.778 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-19T11:51:48.978 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-19T11:51:49.228 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-19T11:51:49.456 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 20 kB/s) 2024-09-19T11:51:49.467 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-19T11:51:49.486 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 137 kB/s) 2024-09-19T11:51:49.494 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-19T11:51:49.513 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 148 kB/s) 2024-09-19T11:51:49.519 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-19T11:51:49.537 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 168 kB/s) 2024-09-19T11:51:49.541 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-19T11:51:49.558 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 188 kB/s) 2024-09-19T11:51:49.562 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-19T11:51:49.579 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 99 kB/s) 2024-09-19T11:51:49.582 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-19T11:51:49.600 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 157 kB/s) 2024-09-19T11:51:49.608 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-19T11:51:49.633 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-09-19T11:51:49.636 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-19T11:51:49.636 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-19T11:51:49.636 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-19T11:51:49.636 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-19T11:51:49.637 INFO:tasks.workunit.client.0.smithi120.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-19T11:51:49.696 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 63/169 kB Progress (1): 80/169 kB Progress (1): 96/169 kB Progress (1): 112/169 kB Progress (1): 129/169 kB Progress (2): 129/169 kB | 1.4/18 kB Progress (2): 145/169 kB | 1.4/18 kB Progress (2): 145/169 kB | 2.8/18 kB Progress (2): 145/169 kB | 4.1/18 kB Progress (2): 145/169 kB | 5.5/18 kB Progress (2): 162/169 kB | 5.5/18 kB Progress (3): 162/169 kB | 5.5/18 kB | 1.4/7.7 kB Progress (3): 162/169 kB | 6.9/18 kB | 1.4/7.7 kB Progress (3): 162/169 kB | 6.9/18 kB | 2.8/7.7 kB Progress (3): 162/169 kB | 8.3/18 kB | 2.8/7.7 kB Progress (3): 162/169 kB | 8.3/18 kB | 4.1/7.7 kB Progress (3): 169 kB | 8.3/18 kB | 4.1/7.7 kB Progress (3): 169 kB | 8.3/18 kB | 5.5/7.7 kB Progress (3): 169 kB | 8.3/18 kB | 6.9/7.7 kB Progress (4): 169 kB | 8.3/18 kB | 6.9/7.7 kB | 16/103 kB Progress (5): 169 kB | 8.3/18 kB | 6.9/7.7 kB | 16/103 kB | 1.4/189 kB Progress (5): 169 kB | 8.3/18 kB | 7.7 kB | 16/103 kB | 1.4/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 2.7 MB/s) 2024-09-19T11:51:49.697 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (4): 9.7/18 kB | 7.7 kB | 16/103 kB | 1.4/189 kB Progress (4): 9.7/18 kB | 7.7 kB | 33/103 kB | 1.4/189 kB Progress (4): 9.7/18 kB | 7.7 kB | 33/103 kB | 2.8/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 121 kB/s) 2024-09-19T11:51:49.703 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (3): 11/18 kB | 33/103 kB | 2.8/189 kB Progress (3): 11/18 kB | 33/103 kB | 4.1/189 kB Progress (3): 12/18 kB | 33/103 kB | 4.1/189 kB Progress (3): 12/18 kB | 33/103 kB | 5.5/189 kB Progress (3): 14/18 kB | 33/103 kB | 5.5/189 kB Progress (3): 14/18 kB | 33/103 kB | 6.9/189 kB Progress (3): 15/18 kB | 33/103 kB | 6.9/189 kB Progress (3): 15/18 kB | 33/103 kB | 8.3/189 kB Progress (3): 17/18 kB | 33/103 kB | 8.3/189 kB Progress (3): 17/18 kB | 33/103 kB | 9.7/189 kB Progress (3): 18 kB | 33/103 kB | 9.7/189 kB Progress (3): 18 kB | 33/103 kB | 11/189 kB Progress (3): 18 kB | 33/103 kB | 12/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 251 kB/s) 2024-09-19T11:51:49.718 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (2): 33/103 kB | 14/189 kB Progress (2): 33/103 kB | 15/189 kB Progress (2): 33/103 kB | 17/189 kB Progress (2): 33/103 kB | 18/189 kB Progress (2): 33/103 kB | 19/189 kB Progress (2): 49/103 kB | 19/189 kB Progress (2): 49/103 kB | 21/189 kB Progress (2): 49/103 kB | 22/189 kB Progress (2): 49/103 kB | 23/189 kB Progress (2): 49/103 kB | 25/189 kB Progress (2): 49/103 kB | 26/189 kB Progress (2): 66/103 kB | 26/189 kB Progress (2): 66/103 kB | 28/189 kB Progress (2): 66/103 kB | 29/189 kB Progress (2): 66/103 kB | 30/189 kB Progress (2): 66/103 kB | 32/189 kB Progress (2): 66/103 kB | 33/189 kB Progress (2): 66/103 kB | 34/189 kB Progress (2): 82/103 kB | 34/189 kB Progress (2): 82/103 kB | 36/189 kB Progress (2): 82/103 kB | 37/189 kB Progress (2): 82/103 kB | 39/189 kB Progress (2): 82/103 kB | 40/189 kB Progress (2): 82/103 kB | 41/189 kB Progress (2): 82/103 kB | 43/189 kB Progress (2): 82/103 kB | 44/189 kB Progress (2): 82/103 kB | 46/189 kB Progress (2): 82/103 kB | 47/189 kB Progress (2): 82/103 kB | 48/189 kB Progress (2): 82/103 kB | 50/189 kB Progress (2): 82/103 kB | 51/189 kB Progress (2): 82/103 kB | 52/189 kB Progress (2): 82/103 kB | 54/189 kB Progress (2): 82/103 kB | 55/189 kB Progress (2): 82/103 kB | 57/189 kB Progress (2): 82/103 kB | 58/189 kB Progress (2): 82/103 kB | 59/189 kB Progress (2): 98/103 kB | 59/189 kB Progress (2): 98/103 kB | 61/189 kB Progress (2): 103 kB | 61/189 kB Progress (2): 103 kB | 62/189 kB Progress (2): 103 kB | 63/189 kB Progress (2): 103 kB | 63/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-19T11:51:49.736 INFO:tasks.workunit.client.0.smithi120.stdout:Progress (1): 80/189 kB Progress (1): 96/189 kB Progress (1): 113/189 kB Progress (1): 129/189 kB Progress (1): 145/189 kB Progress (1): 162/189 kB Progress (1): 178/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.9 MB/s) 2024-09-19T11:51:49.755 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:51:49.755 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] ------------------------------------------------------- 2024-09-19T11:51:49.755 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] T E S T S 2024-09-19T11:51:49.755 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] ------------------------------------------------------- 2024-09-19T11:51:50.378 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-19T11:51:50.432 INFO:tasks.workunit.client.0.smithi120.stdout:PutObjects.java: starting test run: 2024-09-19T11:51:50.432 INFO:tasks.workunit.client.0.smithi120.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-19T11:51:50.432 INFO:tasks.workunit.client.0.smithi120.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-19T11:51:50.432 INFO:tasks.workunit.client.0.smithi120.stdout: EndpointUrl=http://smithi120.front.sepia.ceph.com:80 2024-09-19T11:51:50.528 INFO:tasks.workunit.client.0.smithi120.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-19T11:51:50.628 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: Environment Variables Read 2024-09-19T11:51:50.930 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: S3 Client Initialized 2024-09-19T11:51:50.930 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: Generating File 2024-09-19T11:51:50.930 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: File Generated 2024-09-19T11:51:50.930 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: Generating File 2024-09-19T11:51:50.930 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: File Generated 2024-09-19T11:51:50.930 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: Generating File 2024-09-19T11:51:50.930 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: File Generated 2024-09-19T11:51:50.930 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: Generating File 2024-09-19T11:51:50.931 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: File Generated 2024-09-19T11:51:50.931 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: Generating File 2024-09-19T11:51:50.931 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: File Generated 2024-09-19T11:51:50.931 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: Generating File 2024-09-19T11:51:50.931 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: File Generated 2024-09-19T11:51:50.931 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: Generated Big Files 2024-09-19T11:51:51.182 INFO:tasks.workunit.client.0.smithi120.stdout:HeadBucketResponse() 2024-09-19T11:51:51.182 INFO:tasks.workunit.client.0.smithi120.stdout:sheik is ready 2024-09-19T11:51:51.182 INFO:tasks.workunit.client.0.smithi120.stdout:DEBUG: Test Bucket Created 2024-09-19T11:51:51.229 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-19T11:51:51.412 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-19T11:51:51.430 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-19T11:51:51.530 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-19T11:51:51.630 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-19T11:51:51.731 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-19T11:51:51.831 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-19T11:51:51.931 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-19T11:51:52.031 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-19T11:51:52.131 INFO:tasks.workunit.client.0.smithi120.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-19T11:51:54.036 INFO:tasks.workunit.client.0.smithi120.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-19T11:51:54.838 INFO:tasks.workunit.client.0.smithi120.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-19T11:51:58.291 INFO:tasks.workunit.client.0.smithi120.stdout:arg: file-0b 2024-09-19T11:51:58.292 INFO:tasks.workunit.client.0.smithi120.stdout:arg: file-8b 2024-09-19T11:51:58.294 INFO:tasks.workunit.client.0.smithi120.stdout:arg: file-200b 2024-09-19T11:51:58.295 INFO:tasks.workunit.client.0.smithi120.stdout:arg: file-21983b 2024-09-19T11:51:58.296 INFO:tasks.workunit.client.0.smithi120.stdout:arg: file-5519b 2024-09-19T11:51:58.297 INFO:tasks.workunit.client.0.smithi120.stdout:arg: file-204329b 2024-09-19T11:51:58.298 INFO:tasks.workunit.client.0.smithi120.stdout:arg: file-256k 2024-09-19T11:51:58.300 INFO:tasks.workunit.client.0.smithi120.stdout:arg: file-1m 2024-09-19T11:51:58.301 INFO:tasks.workunit.client.0.smithi120.stdout:arg: file-1038757b 2024-09-19T11:51:58.345 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileCksum called with file-0b 2024-09-19T11:51:58.346 INFO:tasks.workunit.client.0.smithi120.stdout:PutObjectResponse 2024-09-19T11:51:58.418 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileCksum called with file-8b 2024-09-19T11:51:58.418 INFO:tasks.workunit.client.0.smithi120.stdout:PutObjectResponse 2024-09-19T11:51:58.446 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileCksum called with file-200b 2024-09-19T11:51:58.498 INFO:tasks.workunit.client.0.smithi120.stdout:PutObjectResponse 2024-09-19T11:51:58.546 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileCksum called with file-21983b 2024-09-19T11:51:58.546 INFO:tasks.workunit.client.0.smithi120.stdout:PutObjectResponse 2024-09-19T11:51:58.646 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileCksum called with file-5519b 2024-09-19T11:51:58.646 INFO:tasks.workunit.client.0.smithi120.stdout:PutObjectResponse 2024-09-19T11:51:58.729 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileCksum called with file-204329b 2024-09-19T11:51:58.730 INFO:tasks.workunit.client.0.smithi120.stdout:PutObjectResponse 2024-09-19T11:51:58.746 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileCksum called with file-256k 2024-09-19T11:51:58.806 INFO:tasks.workunit.client.0.smithi120.stdout:PutObjectResponse 2024-09-19T11:51:58.847 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileCksum called with file-1m 2024-09-19T11:51:58.916 INFO:tasks.workunit.client.0.smithi120.stdout:PutObjectResponse 2024-09-19T11:51:58.947 INFO:tasks.workunit.client.0.smithi120.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-19T11:51:59.022 INFO:tasks.workunit.client.0.smithi120.stdout:PutObjectResponse 2024-09-19T11:51:59.047 INFO:tasks.workunit.client.0.smithi120.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-19T11:51:59.549 INFO:tasks.workunit.client.0.smithi120.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-19T11:52:00.049 INFO:tasks.workunit.client.0.smithi120.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-19T11:52:05.884 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.46 s -- in io.ceph.jcksum.PutObjects 2024-09-19T11:52:05.926 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:52:05.926 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Results: 2024-09-19T11:52:05.926 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:52:05.927 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-19T11:52:05.927 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] 2024-09-19T11:52:05.929 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T11:52:05.929 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] BUILD SUCCESS 2024-09-19T11:52:05.929 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T11:52:05.930 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Total time: 17.887 s 2024-09-19T11:52:05.930 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] Finished at: 2024-09-19T11:52:05Z 2024-09-19T11:52:05.930 INFO:tasks.workunit.client.0.smithi120.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T11:52:05.974 INFO:tasks.workunit.client.0.smithi120.stderr:+ exit 2024-09-19T11:52:05.975 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:52:05.975 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:52:06.029 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-19T11:52:06.030 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T11:52:06.409 DEBUG:teuthology.parallel:result is None 2024-09-19T11:52:06.409 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T11:52:06.421 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T11:52:06.421 DEBUG:teuthology.orchestra.run.smithi120:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T11:52:06.468 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T11:52:06.469 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T11:52:06.479 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:52:06.479 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T11:52:06.480 DEBUG:teuthology.orchestra.run.smithi120:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T11:52:06.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:52:06.518 INFO:teuthology.orchestra.run.smithi120.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T11:52:06.519 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T11:52:06.565 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T11:52:06.565 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T11:52:06.614 INFO:tasks.workunit:timeout=3h 2024-09-19T11:52:06.614 INFO:tasks.workunit:cleanup=True 2024-09-19T11:52:06.614 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:52:06.663 INFO:tasks.workunit.client.0.smithi120.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T11:53:04.819 INFO:tasks.workunit.client.0.smithi120.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T11:53:04.820 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:53:04.820 INFO:tasks.workunit.client.0.smithi120.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T11:53:04.820 INFO:tasks.workunit.client.0.smithi120.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T11:53:04.820 INFO:tasks.workunit.client.0.smithi120.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T11:53:04.820 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:53:04.820 INFO:tasks.workunit.client.0.smithi120.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T11:53:04.820 INFO:tasks.workunit.client.0.smithi120.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T11:53:04.820 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:53:04.820 INFO:tasks.workunit.client.0.smithi120.stderr: git switch -c 2024-09-19T11:53:04.820 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:53:04.821 INFO:tasks.workunit.client.0.smithi120.stderr:Or undo this operation with: 2024-09-19T11:53:04.821 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:53:04.821 INFO:tasks.workunit.client.0.smithi120.stderr: git switch - 2024-09-19T11:53:04.821 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:53:04.821 INFO:tasks.workunit.client.0.smithi120.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T11:53:04.821 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:53:04.821 INFO:tasks.workunit.client.0.smithi120.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T11:53:04.827 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T11:53:04.873 INFO:tasks.workunit.client.0.smithi120.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T11:53:04.877 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T11:53:04.877 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T11:53:04.926 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T11:53:04.979 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T11:53:05.020 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T11:53:05.021 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T11:53:05.021 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T11:53:05.062 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T11:53:05.065 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:53:05.065 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T11:53:05.117 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-19T11:53:05.118 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-19T11:53:05.118 DEBUG:teuthology.orchestra.run.smithi120:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-19T11:53:05.171 INFO:tasks.workunit.client.0.smithi120.stdout:INFO: fully qualified domain name: smithi120.front.sepia.ceph.com 2024-09-19T11:53:05.171 INFO:tasks.workunit.client.0.smithi120.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-19T11:53:05.171 INFO:tasks.workunit.client.0.smithi120.stdout:== TESTING VERSIONED BUCKET == 2024-09-19T11:53:08.442 INFO:tasks.workunit.client.0.smithi120.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-19T11:53:08.646 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting pip 2024-09-19T11:53:08.652 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-19T11:53:08.687 INFO:tasks.workunit.client.0.smithi120.stdout:Installing collected packages: pip 2024-09-19T11:53:08.687 INFO:tasks.workunit.client.0.smithi120.stdout: Attempting uninstall: pip 2024-09-19T11:53:08.687 INFO:tasks.workunit.client.0.smithi120.stdout: Found existing installation: pip 22.0.2 2024-09-19T11:53:08.939 INFO:tasks.workunit.client.0.smithi120.stdout: Uninstalling pip-22.0.2: 2024-09-19T11:53:08.945 INFO:tasks.workunit.client.0.smithi120.stdout: Successfully uninstalled pip-22.0.2 2024-09-19T11:53:09.675 INFO:tasks.workunit.client.0.smithi120.stdout:Successfully installed pip-24.2 2024-09-19T11:53:10.717 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting boto3 2024-09-19T11:53:10.718 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached boto3-1.35.22-py3-none-any.whl.metadata (6.6 kB) 2024-09-19T11:53:11.220 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting botocore<1.36.0,>=1.35.22 (from boto3) 2024-09-19T11:53:11.222 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached botocore-1.35.22-py3-none-any.whl.metadata (5.7 kB) 2024-09-19T11:53:11.267 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-19T11:53:11.268 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-19T11:53:11.315 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-19T11:53:11.316 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-19T11:53:11.371 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T11:53:11.373 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-19T11:53:11.469 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T11:53:11.470 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-19T11:53:11.615 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T11:53:11.616 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-19T11:53:11.620 INFO:tasks.workunit.client.0.smithi120.stdout:Using cached boto3-1.35.22-py3-none-any.whl (139 kB) 2024-09-19T11:53:11.621 INFO:tasks.workunit.client.0.smithi120.stdout:Using cached botocore-1.35.22-py3-none-any.whl (12.6 MB) 2024-09-19T11:53:11.631 INFO:tasks.workunit.client.0.smithi120.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-19T11:53:11.632 INFO:tasks.workunit.client.0.smithi120.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-19T11:53:11.633 INFO:tasks.workunit.client.0.smithi120.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-19T11:53:11.635 INFO:tasks.workunit.client.0.smithi120.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-19T11:53:11.636 INFO:tasks.workunit.client.0.smithi120.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T11:53:11.705 INFO:tasks.workunit.client.0.smithi120.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-19T11:53:12.828 INFO:tasks.workunit.client.0.smithi120.stdout:Successfully installed boto3-1.35.22 botocore-1.35.22 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-19T11:53:13.418 INFO:tasks.workunit.client.0.smithi120.stdout:INFO: creating user 2024-09-19T11:53:13.792 INFO:tasks.workunit.client.0.smithi120.stdout:{ 2024-09-19T11:53:13.792 INFO:tasks.workunit.client.0.smithi120.stdout: "user_id": "testid", 2024-09-19T11:53:13.792 INFO:tasks.workunit.client.0.smithi120.stdout: "display_name": "M. Tester", 2024-09-19T11:53:13.792 INFO:tasks.workunit.client.0.smithi120.stdout: "email": "tester@ceph.com", 2024-09-19T11:53:13.792 INFO:tasks.workunit.client.0.smithi120.stdout: "suspended": 0, 2024-09-19T11:53:13.792 INFO:tasks.workunit.client.0.smithi120.stdout: "max_buckets": 1000, 2024-09-19T11:53:13.792 INFO:tasks.workunit.client.0.smithi120.stdout: "subusers": [], 2024-09-19T11:53:13.792 INFO:tasks.workunit.client.0.smithi120.stdout: "keys": [ 2024-09-19T11:53:13.792 INFO:tasks.workunit.client.0.smithi120.stdout: { 2024-09-19T11:53:13.793 INFO:tasks.workunit.client.0.smithi120.stdout: "user": "testid", 2024-09-19T11:53:13.793 INFO:tasks.workunit.client.0.smithi120.stdout: "access_key": "0555b35654ad1656d804", 2024-09-19T11:53:13.793 INFO:tasks.workunit.client.0.smithi120.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-19T11:53:13.793 INFO:tasks.workunit.client.0.smithi120.stdout: "active": true, 2024-09-19T11:53:13.793 INFO:tasks.workunit.client.0.smithi120.stdout: "create_date": "2024-09-19T11:53:13.785723Z" 2024-09-19T11:53:13.793 INFO:tasks.workunit.client.0.smithi120.stdout: } 2024-09-19T11:53:13.793 INFO:tasks.workunit.client.0.smithi120.stdout: ], 2024-09-19T11:53:13.793 INFO:tasks.workunit.client.0.smithi120.stdout: "swift_keys": [], 2024-09-19T11:53:13.793 INFO:tasks.workunit.client.0.smithi120.stdout: "caps": [], 2024-09-19T11:53:13.793 INFO:tasks.workunit.client.0.smithi120.stdout: "op_mask": "read, write, delete", 2024-09-19T11:53:13.793 INFO:tasks.workunit.client.0.smithi120.stdout: "default_placement": "", 2024-09-19T11:53:13.793 INFO:tasks.workunit.client.0.smithi120.stdout: "default_storage_class": "", 2024-09-19T11:53:13.793 INFO:tasks.workunit.client.0.smithi120.stdout: "placement_tags": [], 2024-09-19T11:53:13.793 INFO:tasks.workunit.client.0.smithi120.stdout: "bucket_quota": { 2024-09-19T11:53:13.793 INFO:tasks.workunit.client.0.smithi120.stdout: "enabled": false, 2024-09-19T11:53:13.794 INFO:tasks.workunit.client.0.smithi120.stdout: "check_on_raw": false, 2024-09-19T11:53:13.794 INFO:tasks.workunit.client.0.smithi120.stdout: "max_size": -1, 2024-09-19T11:53:13.794 INFO:tasks.workunit.client.0.smithi120.stdout: "max_size_kb": 0, 2024-09-19T11:53:13.794 INFO:tasks.workunit.client.0.smithi120.stdout: "max_objects": -1 2024-09-19T11:53:13.794 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:53:13.794 INFO:tasks.workunit.client.0.smithi120.stdout: "user_quota": { 2024-09-19T11:53:13.794 INFO:tasks.workunit.client.0.smithi120.stdout: "enabled": false, 2024-09-19T11:53:13.794 INFO:tasks.workunit.client.0.smithi120.stdout: "check_on_raw": false, 2024-09-19T11:53:13.794 INFO:tasks.workunit.client.0.smithi120.stdout: "max_size": -1, 2024-09-19T11:53:13.794 INFO:tasks.workunit.client.0.smithi120.stdout: "max_size_kb": 0, 2024-09-19T11:53:13.794 INFO:tasks.workunit.client.0.smithi120.stdout: "max_objects": -1 2024-09-19T11:53:13.794 INFO:tasks.workunit.client.0.smithi120.stdout: }, 2024-09-19T11:53:13.794 INFO:tasks.workunit.client.0.smithi120.stdout: "temp_url_keys": [], 2024-09-19T11:53:13.794 INFO:tasks.workunit.client.0.smithi120.stdout: "type": "rgw", 2024-09-19T11:53:13.794 INFO:tasks.workunit.client.0.smithi120.stdout: "mfa_ids": [], 2024-09-19T11:53:13.795 INFO:tasks.workunit.client.0.smithi120.stdout: "account_id": "", 2024-09-19T11:53:13.795 INFO:tasks.workunit.client.0.smithi120.stdout: "path": "/", 2024-09-19T11:53:13.795 INFO:tasks.workunit.client.0.smithi120.stdout: "create_date": "2024-09-19T11:53:13.785680Z", 2024-09-19T11:53:13.795 INFO:tasks.workunit.client.0.smithi120.stdout: "tags": [], 2024-09-19T11:53:13.795 INFO:tasks.workunit.client.0.smithi120.stdout: "group_ids": [] 2024-09-19T11:53:13.795 INFO:tasks.workunit.client.0.smithi120.stdout:} 2024-09-19T11:53:13.795 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T11:53:14.102 INFO:tasks.workunit.client.0.smithi120.stderr:5+0 records in 2024-09-19T11:53:14.102 INFO:tasks.workunit.client.0.smithi120.stderr:5+0 records out 2024-09-19T11:53:14.102 INFO:tasks.workunit.client.0.smithi120.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0210092 s, 250 MB/s 2024-09-19T11:53:16.191 INFO:tasks.workunit.client.0.smithi120.stdout:bucket nams is reupload-bkt-120627 2024-09-19T11:53:16.191 INFO:tasks.workunit.client.0.smithi120.stdout:endpoint is http://smithi120.front.sepia.ceph.com:80 2024-09-19T11:53:16.191 INFO:tasks.workunit.client.0.smithi120.stdout:start UploadId=2~TkJhOhEECh8qKs2w0SOdrXAKo3ixAbV 2024-09-19T11:53:16.191 INFO:tasks.workunit.client.0.smithi120.stdout:phase 1 uploaded part {'ETag': '"784941b9ed5abe2bcbb9c3873f1b4ef0"', 'PartNumber': 1} 2024-09-19T11:53:16.191 INFO:tasks.workunit.client.0.smithi120.stdout:phase 1 uploaded part {'ETag': '"784941b9ed5abe2bcbb9c3873f1b4ef0"', 'PartNumber': 2} 2024-09-19T11:53:16.192 INFO:tasks.workunit.client.0.smithi120.stdout:phase 2 uploaded part {'ETag': '"784941b9ed5abe2bcbb9c3873f1b4ef0"', 'PartNumber': 1} 2024-09-19T11:53:16.192 INFO:tasks.workunit.client.0.smithi120.stdout:phase 2 uploaded part {'ETag': '"784941b9ed5abe2bcbb9c3873f1b4ef0"', 'PartNumber': 1} 2024-09-19T11:53:16.192 INFO:tasks.workunit.client.0.smithi120.stdout:phase 2 uploaded part {'ETag': '"784941b9ed5abe2bcbb9c3873f1b4ef0"', 'PartNumber': 1} 2024-09-19T11:53:16.192 INFO:tasks.workunit.client.0.smithi120.stdout:phase 2 uploaded part {'ETag': '"784941b9ed5abe2bcbb9c3873f1b4ef0"', 'PartNumber': 1} 2024-09-19T11:53:16.192 INFO:tasks.workunit.client.0.smithi120.stdout:phase 2 uploaded part {'ETag': '"784941b9ed5abe2bcbb9c3873f1b4ef0"', 'PartNumber': 1} 2024-09-19T11:53:16.192 INFO:tasks.workunit.client.0.smithi120.stdout:phase 2 uploaded part {'ETag': '"784941b9ed5abe2bcbb9c3873f1b4ef0"', 'PartNumber': 1} 2024-09-19T11:53:16.192 INFO:tasks.workunit.client.0.smithi120.stdout:phase 2 uploaded part {'ETag': '"784941b9ed5abe2bcbb9c3873f1b4ef0"', 'PartNumber': 1} 2024-09-19T11:53:16.192 INFO:tasks.workunit.client.0.smithi120.stdout:phase 2 uploaded part {'ETag': '"784941b9ed5abe2bcbb9c3873f1b4ef0"', 'PartNumber': 1} 2024-09-19T11:53:16.192 INFO:tasks.workunit.client.0.smithi120.stdout:phase 2 uploaded part {'ETag': '"784941b9ed5abe2bcbb9c3873f1b4ef0"', 'PartNumber': 1} 2024-09-19T11:53:16.192 INFO:tasks.workunit.client.0.smithi120.stdout:phase 2 uploaded part {'ETag': '"784941b9ed5abe2bcbb9c3873f1b4ef0"', 'PartNumber': 1} 2024-09-19T11:53:16.192 INFO:tasks.workunit.client.0.smithi120.stdout:phase 2 uploaded part {'ETag': '"784941b9ed5abe2bcbb9c3873f1b4ef0"', 'PartNumber': 1} 2024-09-19T11:53:16.192 INFO:tasks.workunit.client.0.smithi120.stdout:aborting multipart upload, parts=[{'ETag': '"784941b9ed5abe2bcbb9c3873f1b4ef0"', 'PartNumber': 1}, {'ETag': '"784941b9ed5abe2bcbb9c3873f1b4ef0"', 'PartNumber': 2}] 2024-09-19T11:53:17.956 INFO:tasks.workunit.client.0.smithi120.stdout:radosgw-admin bucket radoslist: 2024-09-19T11:53:18.043 INFO:tasks.workunit.client.0.smithi120.stdout:rados ls: 2024-09-19T11:53:18.054 INFO:tasks.workunit.client.0.smithi120.stdout:== PASSED == 2024-09-19T11:53:18.054 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T11:53:18.054 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T11:53:18.107 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-19T11:53:18.107 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T11:53:18.496 DEBUG:teuthology.parallel:result is None 2024-09-19T11:53:18.496 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T11:53:18.508 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T11:53:18.508 DEBUG:teuthology.orchestra.run.smithi120:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T11:53:18.557 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T11:53:18.558 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-19T11:53:18.572 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-19T11:53:18.572 INFO:tasks.ragweed:Downloading ragweed... 2024-09-19T11:53:18.572 INFO:tasks.ragweed:Using branch 'wip-yuval-test' for ragweed 2024-09-19T11:53:18.573 DEBUG:teuthology.orchestra.run.smithi120:> git clone -b wip-yuval-test https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-19T11:53:18.605 INFO:teuthology.orchestra.run.smithi120.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-19T11:53:18.662 INFO:teuthology.orchestra.run.smithi120.stderr:fatal: Remote branch wip-yuval-test not found in upstream origin 2024-09-19T11:53:18.663 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-19T11:53:18.664 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-19T11:53:18.665 DEBUG:teuthology.orchestra.run.smithi120:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-19T11:53:18.714 INFO:teuthology.orchestra.run.smithi120.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-19T11:53:18.886 INFO:tasks.ragweed:Creating rgw users... 2024-09-19T11:53:18.886 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-19T11:53:18.886 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key XJMUSSNEUPCRYOSECKAB --secret ZUK7PqpmYZCpv8wH0zIlCbuzLGMY8AFEi+uElhFMQOR3XHMtm9Zzxw== --email ragweed.client.0+test@test.test --system false 2024-09-19T11:53:18.980 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:53:18.980 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:53:19.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.024+0000 7f6c45f969c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.024+0000 7f6c45f969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.024+0000 7f6c45f969c0 20 realm 2024-09-19T11:53:19.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.024+0000 7f6c45f969c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.024+0000 7f6c45f969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.024+0000 7f6c45f969c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:53:19.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.024+0000 7f6c45f969c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.024+0000 7f6c45f969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.024+0000 7f6c45f969c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.028+0000 7f6c45f969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:53:19.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.028+0000 7f6c45f969c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.028+0000 7f6c45f969c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:53:19.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.028+0000 7f6c45f969c0 20 searching for the correct realm 2024-09-19T11:53:19.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.032+0000 7f6c4429d640 0 -- 172.21.15.120:0/2684594713 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f6c2c072050 msgr2=0x7f6c2c01ba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:53:19.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.040+0000 7f6c3bfff640 0 -- 172.21.15.120:0/2684594713 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f6c340c5ba0 msgr2=0x7f6c340b8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:53:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.256+0000 7f6c45f969c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:53:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.256+0000 7f6c45f969c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:53:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.256+0000 7f6c45f969c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:53:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.256+0000 7f6c45f969c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:53:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.256+0000 7f6c45f969c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:53:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.256+0000 7f6c45f969c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:53:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.256+0000 7f6c45f969c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.260+0000 7f6c45f969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.260+0000 7f6c45f969c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.260+0000 7f6c45f969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:53:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.260+0000 7f6c45f969c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.260+0000 7f6c45f969c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:53:19.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.260+0000 7f6c45f969c0 20 zone default found 2024-09-19T11:53:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.260+0000 7f6c45f969c0 4 Realm: () 2024-09-19T11:53:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.260+0000 7f6c45f969c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:53:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.260+0000 7f6c45f969c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:53:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.260+0000 7f6c45f969c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:53:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.260+0000 7f6c45f969c0 20 zonegroup default 2024-09-19T11:53:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.260+0000 7f6c45f969c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.260+0000 7f6c45f969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.260+0000 7f6c45f969c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.264+0000 7f6c45f969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.264+0000 7f6c45f969c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.264+0000 7f6c45f969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.264+0000 7f6c45f969c0 20 started sync module instance, tier type = 2024-09-19T11:53:19.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.264+0000 7f6c45f969c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:53:19.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.288+0000 7f6c45f969c0 20 add_watcher() i=0 2024-09-19T11:53:19.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.288+0000 7f6c45f969c0 20 add_watcher() i=1 2024-09-19T11:53:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.288+0000 7f6c45f969c0 20 add_watcher() i=2 2024-09-19T11:53:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.288+0000 7f6c45f969c0 20 add_watcher() i=3 2024-09-19T11:53:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.288+0000 7f6c45f969c0 20 add_watcher() i=4 2024-09-19T11:53:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.288+0000 7f6c45f969c0 20 add_watcher() i=5 2024-09-19T11:53:19.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.288+0000 7f6c45f969c0 20 add_watcher() i=6 2024-09-19T11:53:19.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.288+0000 7f6c45f969c0 20 add_watcher() i=7 2024-09-19T11:53:19.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.288+0000 7f6c45f969c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:53:19.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.292+0000 7f6af9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:53:19.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.292+0000 7f6c45f969c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:53:19.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.292+0000 7f6c45f969c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:53:19.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.292+0000 7f6c45f969c0 5 note: GC not initialized 2024-09-19T11:53:19.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.292+0000 7f6af8fe1640 20 reqs_thread_entry: start 2024-09-19T11:53:19.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.292+0000 7f6c45f969c0 20 init_complete bucket index max shards: 1 2024-09-19T11:53:19.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.292+0000 7f6c45f969c0 20 Filter name: none 2024-09-19T11:53:19.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.292+0000 7f6a727fc640 20 reqs_thread_entry: start 2024-09-19T11:53:19.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.292+0000 7f6c45f969c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-19T11:53:19.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.292+0000 7f6c45f969c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.296+0000 7f6c45f969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.296+0000 7f6c45f969c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-19T11:53:19.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.296+0000 7f6c45f969c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-19T11:53:19.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.296+0000 7f6c45f969c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-19T11:53:19.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.296+0000 7f6c45f969c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.296+0000 7f6c45f969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.296+0000 7f6c45f969c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-19T11:53:19.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.296+0000 7f6c45f969c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-19T11:53:19.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.296+0000 7f6c45f969c0 10 cache get: name=default.rgw.meta+users.keys+XJMUSSNEUPCRYOSECKAB : miss 2024-09-19T11:53:19.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.296+0000 7f6c45f969c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.296+0000 7f6c45f969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.296+0000 7f6c45f969c0 10 cache put: name=default.rgw.meta+users.keys+XJMUSSNEUPCRYOSECKAB info.flags=0x0 2024-09-19T11:53:19.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.296+0000 7f6c45f969c0 10 adding default.rgw.meta+users.keys+XJMUSSNEUPCRYOSECKAB to cache LRU end 2024-09-19T11:53:19.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.296+0000 7f6c45f969c0 10 cache get: name=default.rgw.meta+users.keys+XJMUSSNEUPCRYOSECKAB : hit (negative entry) 2024-09-19T11:53:19.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.296+0000 7f6c45f969c0 10 cache get: name=default.rgw.meta+users.keys+XJMUSSNEUPCRYOSECKAB : hit (negative entry) 2024-09-19T11:53:19.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.300+0000 7f6c45f969c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-19T11:53:19.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.300+0000 7f6c45f969c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-19T11:53:19.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.300+0000 7f6c45f969c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-19T11:53:19.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.300+0000 7f6b22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627841 cookie 93943227066112 notifier 5648 bl.length()=675 2024-09-19T11:53:19.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.300+0000 7f6b22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-19T11:53:19.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.300+0000 7f6b22ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-19T11:53:19.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.304+0000 7f6c45f969c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-19T11:53:19.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.304+0000 7f6c45f969c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-19T11:53:19.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.304+0000 7f6c45f969c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-19T11:53:19.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.304+0000 7f6b227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627784 cookie 93943227054368 notifier 5648 bl.length()=202 2024-09-19T11:53:19.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.304+0000 7f6b227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-19T11:53:19.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.304+0000 7f6b227fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-19T11:53:19.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.312+0000 7f6c45f969c0 10 cache put: name=default.rgw.meta+users.keys+XJMUSSNEUPCRYOSECKAB info.flags=0x7 2024-09-19T11:53:19.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.312+0000 7f6c45f969c0 10 moving default.rgw.meta+users.keys+XJMUSSNEUPCRYOSECKAB to cache LRU end 2024-09-19T11:53:19.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.312+0000 7f6c45f969c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:XJMUSSNEUPCRYOSECKAB, ofs0, ns] 2024-09-19T11:53:19.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.312+0000 7f6b227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627809 cookie 93943227070912 notifier 5648 bl.length()=190 2024-09-19T11:53:19.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.312+0000 7f6b227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XJMUSSNEUPCRYOSECKAB info.flags=0x7 2024-09-19T11:53:19.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.312+0000 7f6b227fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XJMUSSNEUPCRYOSECKAB to cache LRU end 2024-09-19T11:53:19.310 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T11:53:19.310 INFO:teuthology.orchestra.run.smithi120.stdout: "user_id": "ragweed.client.0", 2024-09-19T11:53:19.310 INFO:teuthology.orchestra.run.smithi120.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-19T11:53:19.310 INFO:teuthology.orchestra.run.smithi120.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-19T11:53:19.310 INFO:teuthology.orchestra.run.smithi120.stdout: "suspended": 0, 2024-09-19T11:53:19.310 INFO:teuthology.orchestra.run.smithi120.stdout: "max_buckets": 1000, 2024-09-19T11:53:19.310 INFO:teuthology.orchestra.run.smithi120.stdout: "subusers": [], 2024-09-19T11:53:19.310 INFO:teuthology.orchestra.run.smithi120.stdout: "keys": [ 2024-09-19T11:53:19.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T11:53:19.311 INFO:teuthology.orchestra.run.smithi120.stdout: "user": "ragweed.client.0", 2024-09-19T11:53:19.311 INFO:teuthology.orchestra.run.smithi120.stdout: "access_key": "XJMUSSNEUPCRYOSECKAB", 2024-09-19T11:53:19.311 INFO:teuthology.orchestra.run.smithi120.stdout: "secret_key": "ZUK7PqpmYZCpv8wH0zIlCbuzLGMY8AFEi+uElhFMQOR3XHMtm9Zzxw==", 2024-09-19T11:53:19.311 INFO:teuthology.orchestra.run.smithi120.stdout: "active": true, 2024-09-19T11:53:19.311 INFO:teuthology.orchestra.run.smithi120.stdout: "create_date": "2024-09-19T11:53:19.300847Z" 2024-09-19T11:53:19.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T11:53:19.311 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T11:53:19.311 INFO:teuthology.orchestra.run.smithi120.stdout: "swift_keys": [], 2024-09-19T11:53:19.311 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": [], 2024-09-19T11:53:19.311 INFO:teuthology.orchestra.run.smithi120.stdout: "op_mask": "read, write, delete", 2024-09-19T11:53:19.311 INFO:teuthology.orchestra.run.smithi120.stdout: "default_placement": "", 2024-09-19T11:53:19.312 INFO:teuthology.orchestra.run.smithi120.stdout: "default_storage_class": "", 2024-09-19T11:53:19.312 INFO:teuthology.orchestra.run.smithi120.stdout: "placement_tags": [], 2024-09-19T11:53:19.312 INFO:teuthology.orchestra.run.smithi120.stdout: "bucket_quota": { 2024-09-19T11:53:19.312 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": false, 2024-09-19T11:53:19.312 INFO:teuthology.orchestra.run.smithi120.stdout: "check_on_raw": false, 2024-09-19T11:53:19.312 INFO:teuthology.orchestra.run.smithi120.stdout: "max_size": -1, 2024-09-19T11:53:19.312 INFO:teuthology.orchestra.run.smithi120.stdout: "max_size_kb": 0, 2024-09-19T11:53:19.312 INFO:teuthology.orchestra.run.smithi120.stdout: "max_objects": -1 2024-09-19T11:53:19.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T11:53:19.312 INFO:teuthology.orchestra.run.smithi120.stdout: "user_quota": { 2024-09-19T11:53:19.312 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": false, 2024-09-19T11:53:19.312 INFO:teuthology.orchestra.run.smithi120.stdout: "check_on_raw": false, 2024-09-19T11:53:19.312 INFO:teuthology.orchestra.run.smithi120.stdout: "max_size": -1, 2024-09-19T11:53:19.312 INFO:teuthology.orchestra.run.smithi120.stdout: "max_size_kb": 0, 2024-09-19T11:53:19.313 INFO:teuthology.orchestra.run.smithi120.stdout: "max_objects": -1 2024-09-19T11:53:19.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T11:53:19.313 INFO:teuthology.orchestra.run.smithi120.stdout: "temp_url_keys": [], 2024-09-19T11:53:19.313 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "rgw", 2024-09-19T11:53:19.313 INFO:teuthology.orchestra.run.smithi120.stdout: "mfa_ids": [], 2024-09-19T11:53:19.313 INFO:teuthology.orchestra.run.smithi120.stdout: "account_id": "", 2024-09-19T11:53:19.313 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/", 2024-09-19T11:53:19.313 INFO:teuthology.orchestra.run.smithi120.stdout: "create_date": "2024-09-19T11:53:19.300819Z", 2024-09-19T11:53:19.313 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T11:53:19.313 INFO:teuthology.orchestra.run.smithi120.stdout: "group_ids": [] 2024-09-19T11:53:19.313 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T11:53:19.313 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:53:19.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.312+0000 7f6af9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:53:19.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.316+0000 7f6c45f969c0 20 remove_watcher() i=0 2024-09-19T11:53:19.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.316+0000 7f6c45f969c0 2 removed watcher, disabling cache 2024-09-19T11:53:19.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.320+0000 7f6c45f969c0 20 remove_watcher() i=1 2024-09-19T11:53:19.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.320+0000 7f6c45f969c0 20 remove_watcher() i=2 2024-09-19T11:53:19.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.324+0000 7f6c45f969c0 20 remove_watcher() i=3 2024-09-19T11:53:19.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.324+0000 7f6c45f969c0 20 remove_watcher() i=4 2024-09-19T11:53:19.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.328+0000 7f6c45f969c0 20 remove_watcher() i=5 2024-09-19T11:53:19.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.328+0000 7f6c45f969c0 20 remove_watcher() i=6 2024-09-19T11:53:19.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.332+0000 7f6c45f969c0 20 remove_watcher() i=7 2024-09-19T11:53:19.345 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-19T11:53:19.345 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key WUREONVYFUCFTORGPYST --secret cz/k3i947rrNkq+yh9lIbPI/B7mYuucpLtsYKmoFvTPbor2/wsotKw== --email sysuser.client.0+test@test.test --system true 2024-09-19T11:53:19.387 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:53:19.387 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:53:19.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.432+0000 7f1ea879b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.432+0000 7f1ea879b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.432+0000 7f1ea879b9c0 20 realm 2024-09-19T11:53:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.432+0000 7f1ea879b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.432+0000 7f1ea879b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.432+0000 7f1ea879b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:53:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.432+0000 7f1ea879b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.432+0000 7f1ea879b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.432+0000 7f1ea879b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.436+0000 7f1ea879b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:53:19.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.436+0000 7f1ea879b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.436+0000 7f1ea879b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:53:19.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.436+0000 7f1ea879b9c0 20 searching for the correct realm 2024-09-19T11:53:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.440+0000 7f1ea62a1640 0 -- 172.21.15.120:0/2322011174 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f1ea00258f0 msgr2=0x7f1ea00703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:53:19.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.656+0000 7f1ea62a1640 0 -- 172.21.15.120:0/2322011174 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f1ea00258f0 msgr2=0x7f1ea00703a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:53:19.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.668+0000 7f1ea879b9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:53:19.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.668+0000 7f1ea879b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:53:19.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.668+0000 7f1ea879b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:53:19.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.668+0000 7f1ea879b9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:53:19.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.668+0000 7f1ea879b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:53:19.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.668+0000 7f1ea879b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:53:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.668+0000 7f1ea879b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.668+0000 7f1ea879b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.668+0000 7f1ea879b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.668+0000 7f1ea879b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:53:19.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.668+0000 7f1ea879b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.672+0000 7f1ea879b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:53:19.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.672+0000 7f1ea879b9c0 20 zone default found 2024-09-19T11:53:19.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.672+0000 7f1ea879b9c0 4 Realm: () 2024-09-19T11:53:19.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.672+0000 7f1ea879b9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:53:19.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.672+0000 7f1ea879b9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:53:19.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.672+0000 7f1ea879b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:53:19.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.672+0000 7f1ea879b9c0 20 zonegroup default 2024-09-19T11:53:19.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.672+0000 7f1ea879b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.672+0000 7f1ea879b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.672+0000 7f1ea879b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.672+0000 7f1ea879b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.672+0000 7f1ea879b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.672+0000 7f1ea879b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.672+0000 7f1ea879b9c0 20 started sync module instance, tier type = 2024-09-19T11:53:19.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.672+0000 7f1ea879b9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:53:19.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.696+0000 7f1ea879b9c0 20 add_watcher() i=0 2024-09-19T11:53:19.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.696+0000 7f1ea879b9c0 20 add_watcher() i=1 2024-09-19T11:53:19.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.696+0000 7f1ea879b9c0 20 add_watcher() i=2 2024-09-19T11:53:19.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.696+0000 7f1ea879b9c0 20 add_watcher() i=3 2024-09-19T11:53:19.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.696+0000 7f1ea879b9c0 20 add_watcher() i=4 2024-09-19T11:53:19.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.696+0000 7f1ea879b9c0 20 add_watcher() i=5 2024-09-19T11:53:19.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.696+0000 7f1ea879b9c0 20 add_watcher() i=6 2024-09-19T11:53:19.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.696+0000 7f1ea879b9c0 20 add_watcher() i=7 2024-09-19T11:53:19.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.696+0000 7f1ea879b9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:53:19.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1d5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:53:19.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:53:19.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:53:19.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 5 note: GC not initialized 2024-09-19T11:53:19.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1d577fe640 20 reqs_thread_entry: start 2024-09-19T11:53:19.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:53:19.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 20 Filter name: none 2024-09-19T11:53:19.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1d557fa640 20 reqs_thread_entry: start 2024-09-19T11:53:19.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-19T11:53:19.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-19T11:53:19.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-19T11:53:19.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-19T11:53:19.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-19T11:53:19.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-19T11:53:19.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 10 cache get: name=default.rgw.meta+users.keys+WUREONVYFUCFTORGPYST : miss 2024-09-19T11:53:19.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.700+0000 7f1ea879b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:19.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.704+0000 7f1ea879b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:19.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.704+0000 7f1ea879b9c0 10 cache put: name=default.rgw.meta+users.keys+WUREONVYFUCFTORGPYST info.flags=0x0 2024-09-19T11:53:19.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.704+0000 7f1ea879b9c0 10 adding default.rgw.meta+users.keys+WUREONVYFUCFTORGPYST to cache LRU end 2024-09-19T11:53:19.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.704+0000 7f1ea879b9c0 10 cache get: name=default.rgw.meta+users.keys+WUREONVYFUCFTORGPYST : hit (negative entry) 2024-09-19T11:53:19.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.704+0000 7f1ea879b9c0 10 cache get: name=default.rgw.meta+users.keys+WUREONVYFUCFTORGPYST : hit (negative entry) 2024-09-19T11:53:19.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.704+0000 7f1ea879b9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-19T11:53:19.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.704+0000 7f1ea879b9c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-19T11:53:19.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.704+0000 7f1ea879b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-19T11:53:19.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.708+0000 7f1d89ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627785 cookie 94486420065424 notifier 6021 bl.length()=675 2024-09-19T11:53:19.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.708+0000 7f1d89ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-19T11:53:19.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.708+0000 7f1d89ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-19T11:53:19.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.708+0000 7f1ea879b9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-19T11:53:19.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.708+0000 7f1ea879b9c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-19T11:53:19.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.708+0000 7f1ea879b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-19T11:53:19.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.712+0000 7f1d89ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627842 cookie 94486420062656 notifier 6021 bl.length()=202 2024-09-19T11:53:19.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.712+0000 7f1d89ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-19T11:53:19.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.712+0000 7f1d89ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-19T11:53:19.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.716+0000 7f1ea879b9c0 10 cache put: name=default.rgw.meta+users.keys+WUREONVYFUCFTORGPYST info.flags=0x7 2024-09-19T11:53:19.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.716+0000 7f1ea879b9c0 10 moving default.rgw.meta+users.keys+WUREONVYFUCFTORGPYST to cache LRU end 2024-09-19T11:53:19.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.716+0000 7f1ea879b9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:WUREONVYFUCFTORGPYST, ofs0, ns] 2024-09-19T11:53:19.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.716+0000 7f1d897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627782 cookie 94486420068160 notifier 6021 bl.length()=190 2024-09-19T11:53:19.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.716+0000 7f1d897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WUREONVYFUCFTORGPYST info.flags=0x7 2024-09-19T11:53:19.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.716+0000 7f1d897fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WUREONVYFUCFTORGPYST to cache LRU end 2024-09-19T11:53:19.714 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T11:53:19.714 INFO:teuthology.orchestra.run.smithi120.stdout: "user_id": "sysuser.client.0", 2024-09-19T11:53:19.714 INFO:teuthology.orchestra.run.smithi120.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-19T11:53:19.714 INFO:teuthology.orchestra.run.smithi120.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-19T11:53:19.714 INFO:teuthology.orchestra.run.smithi120.stdout: "suspended": 0, 2024-09-19T11:53:19.714 INFO:teuthology.orchestra.run.smithi120.stdout: "max_buckets": 1000, 2024-09-19T11:53:19.714 INFO:teuthology.orchestra.run.smithi120.stdout: "subusers": [], 2024-09-19T11:53:19.714 INFO:teuthology.orchestra.run.smithi120.stdout: "keys": [ 2024-09-19T11:53:19.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T11:53:19.714 INFO:teuthology.orchestra.run.smithi120.stdout: "user": "sysuser.client.0", 2024-09-19T11:53:19.715 INFO:teuthology.orchestra.run.smithi120.stdout: "access_key": "WUREONVYFUCFTORGPYST", 2024-09-19T11:53:19.715 INFO:teuthology.orchestra.run.smithi120.stdout: "secret_key": "cz/k3i947rrNkq+yh9lIbPI/B7mYuucpLtsYKmoFvTPbor2/wsotKw==", 2024-09-19T11:53:19.715 INFO:teuthology.orchestra.run.smithi120.stdout: "active": true, 2024-09-19T11:53:19.715 INFO:teuthology.orchestra.run.smithi120.stdout: "create_date": "2024-09-19T11:53:19.706996Z" 2024-09-19T11:53:19.715 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T11:53:19.715 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T11:53:19.715 INFO:teuthology.orchestra.run.smithi120.stdout: "swift_keys": [], 2024-09-19T11:53:19.715 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": [], 2024-09-19T11:53:19.715 INFO:teuthology.orchestra.run.smithi120.stdout: "op_mask": "read, write, delete", 2024-09-19T11:53:19.715 INFO:teuthology.orchestra.run.smithi120.stdout: "system": true, 2024-09-19T11:53:19.715 INFO:teuthology.orchestra.run.smithi120.stdout: "default_placement": "", 2024-09-19T11:53:19.715 INFO:teuthology.orchestra.run.smithi120.stdout: "default_storage_class": "", 2024-09-19T11:53:19.715 INFO:teuthology.orchestra.run.smithi120.stdout: "placement_tags": [], 2024-09-19T11:53:19.716 INFO:teuthology.orchestra.run.smithi120.stdout: "bucket_quota": { 2024-09-19T11:53:19.716 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": false, 2024-09-19T11:53:19.716 INFO:teuthology.orchestra.run.smithi120.stdout: "check_on_raw": false, 2024-09-19T11:53:19.716 INFO:teuthology.orchestra.run.smithi120.stdout: "max_size": -1, 2024-09-19T11:53:19.716 INFO:teuthology.orchestra.run.smithi120.stdout: "max_size_kb": 0, 2024-09-19T11:53:19.716 INFO:teuthology.orchestra.run.smithi120.stdout: "max_objects": -1 2024-09-19T11:53:19.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T11:53:19.716 INFO:teuthology.orchestra.run.smithi120.stdout: "user_quota": { 2024-09-19T11:53:19.716 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": false, 2024-09-19T11:53:19.716 INFO:teuthology.orchestra.run.smithi120.stdout: "check_on_raw": false, 2024-09-19T11:53:19.716 INFO:teuthology.orchestra.run.smithi120.stdout: "max_size": -1, 2024-09-19T11:53:19.716 INFO:teuthology.orchestra.run.smithi120.stdout: "max_size_kb": 0, 2024-09-19T11:53:19.716 INFO:teuthology.orchestra.run.smithi120.stdout: "max_objects": -1 2024-09-19T11:53:19.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T11:53:19.717 INFO:teuthology.orchestra.run.smithi120.stdout: "temp_url_keys": [], 2024-09-19T11:53:19.717 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "rgw", 2024-09-19T11:53:19.717 INFO:teuthology.orchestra.run.smithi120.stdout: "mfa_ids": [], 2024-09-19T11:53:19.717 INFO:teuthology.orchestra.run.smithi120.stdout: "account_id": "", 2024-09-19T11:53:19.717 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/", 2024-09-19T11:53:19.717 INFO:teuthology.orchestra.run.smithi120.stdout: "create_date": "2024-09-19T11:53:19.706969Z", 2024-09-19T11:53:19.717 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T11:53:19.717 INFO:teuthology.orchestra.run.smithi120.stdout: "group_ids": [] 2024-09-19T11:53:19.717 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T11:53:19.717 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:53:19.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.716+0000 7f1d5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:53:19.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.720+0000 7f1ea879b9c0 20 remove_watcher() i=0 2024-09-19T11:53:19.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.720+0000 7f1ea879b9c0 2 removed watcher, disabling cache 2024-09-19T11:53:19.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.724+0000 7f1ea879b9c0 20 remove_watcher() i=1 2024-09-19T11:53:19.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.724+0000 7f1ea879b9c0 20 remove_watcher() i=2 2024-09-19T11:53:19.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.728+0000 7f1ea879b9c0 20 remove_watcher() i=3 2024-09-19T11:53:19.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.728+0000 7f1ea879b9c0 20 remove_watcher() i=4 2024-09-19T11:53:19.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.732+0000 7f1ea879b9c0 20 remove_watcher() i=5 2024-09-19T11:53:19.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.732+0000 7f1ea879b9c0 20 remove_watcher() i=6 2024-09-19T11:53:19.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:19.732+0000 7f1ea879b9c0 20 remove_watcher() i=7 2024-09-19T11:53:19.747 INFO:tasks.ragweed:Configuring ragweed... 2024-09-19T11:53:19.748 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:53:19.748 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-19T11:53:19.793 INFO:tasks.ragweed:Configuring boto... 2024-09-19T11:53:19.793 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:53:19.794 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-19T11:53:19.841 DEBUG:teuthology.orchestra.run.smithi120:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-19T11:53:20.027 INFO:teuthology.orchestra.run.smithi120.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-19T11:53:20.202 INFO:teuthology.orchestra.run.smithi120.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-19T11:53:20.778 INFO:teuthology.orchestra.run.smithi120.stdout:py installdeps: -rrequirements.txt 2024-09-19T11:53:23.769 INFO:teuthology.orchestra.run.smithi120.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-19T11:53:28.027 INFO:teuthology.orchestra.run.smithi120.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=f963b3ef586f398bdd5fa18f87beeba065cc9564372d081193d372b19e3a7127,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-19T11:53:28.027 INFO:teuthology.orchestra.run.smithi120.stdout:py run-test-pre: PYTHONHASHSEED='1526974630' 2024-09-19T11:53:28.027 INFO:teuthology.orchestra.run.smithi120.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-19T11:53:28.198 INFO:teuthology.orchestra.run.smithi120.stdout:============================= test session starts ============================== 2024-09-19T11:53:28.198 INFO:teuthology.orchestra.run.smithi120.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-19T11:53:28.198 INFO:teuthology.orchestra.run.smithi120.stdout:cachedir: .tox/py/.pytest_cache 2024-09-19T11:53:28.198 INFO:teuthology.orchestra.run.smithi120.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-19T11:53:28.358 INFO:teuthology.orchestra.run.smithi120.stdout:collecting ... collected 9 items 2024-09-19T11:53:28.358 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:53:29.182 INFO:teuthology.orchestra.run.smithi120.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-19T11:53:30.173 INFO:teuthology.orchestra.run.smithi120.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-19T11:53:31.009 INFO:teuthology.orchestra.run.smithi120.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-19T11:53:31.947 INFO:teuthology.orchestra.run.smithi120.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-19T11:53:32.951 INFO:teuthology.orchestra.run.smithi120.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-19T11:53:39.513 INFO:teuthology.orchestra.run.smithi120.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-19T11:53:41.585 INFO:teuthology.orchestra.run.smithi120.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-19T11:53:43.437 INFO:teuthology.orchestra.run.smithi120.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-19T11:53:47.272 INFO:teuthology.orchestra.run.smithi120.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-19T11:53:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:53:47.272 INFO:teuthology.orchestra.run.smithi120.stdout:=============================== warnings summary =============================== 2024-09-19T11:53:47.272 INFO:teuthology.orchestra.run.smithi120.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-19T11:53:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-19T11:53:47.272 INFO:teuthology.orchestra.run.smithi120.stdout: import imp 2024-09-19T11:53:47.273 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T11:53:47.273 INFO:teuthology.orchestra.run.smithi120.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-19T11:53:47.273 INFO:teuthology.orchestra.run.smithi120.stdout:======================== 9 passed, 1 warning in 19.07s ========================= 2024-09-19T11:53:47.316 INFO:teuthology.orchestra.run.smithi120.stdout:___________________________________ summary ____________________________________ 2024-09-19T11:53:47.316 INFO:teuthology.orchestra.run.smithi120.stdout: py: commands succeeded 2024-09-19T11:53:47.316 INFO:teuthology.orchestra.run.smithi120.stdout: congratulations :) 2024-09-19T11:53:47.340 INFO:tasks.ragweed:Cleaning up boto... 2024-09-19T11:53:47.340 DEBUG:teuthology.orchestra.run.smithi120:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-19T11:53:47.346 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-19T11:53:47.423 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:53:47.423 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:53:47.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.467+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:47.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.467+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:47.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.467+0000 7f155dc4a9c0 20 realm 2024-09-19T11:53:47.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.467+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:47.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.467+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:47.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.467+0000 7f155dc4a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:53:47.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.467+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:47.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.467+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:47.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.467+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:47.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.471+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:53:47.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.471+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:47.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.471+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:53:47.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.471+0000 7f155dc4a9c0 20 searching for the correct realm 2024-09-19T11:53:47.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.475+0000 7f155bf51640 0 -- 172.21.15.120:0/1807287438 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f1550037070 msgr2=0x7f1550047400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:53:47.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.691+0000 7f155af4f640 0 -- 172.21.15.120:0/1807287438 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f154c067400 msgr2=0x7f154c066dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:53:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.907+0000 7f155dc4a9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:53:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.907+0000 7f155dc4a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:53:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.907+0000 7f155dc4a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:53:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.907+0000 7f155dc4a9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:53:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.907+0000 7f155dc4a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:53:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.907+0000 7f155dc4a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:53:47.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.907+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:47.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.907+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:47.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.907+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:47.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.911+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:53:47.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.911+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:47.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.911+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:53:47.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.911+0000 7f155dc4a9c0 20 zone default found 2024-09-19T11:53:47.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.911+0000 7f155dc4a9c0 4 Realm: () 2024-09-19T11:53:47.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.911+0000 7f155dc4a9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:53:47.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.911+0000 7f155dc4a9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:53:47.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.911+0000 7f155dc4a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:53:47.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.911+0000 7f155dc4a9c0 20 zonegroup default 2024-09-19T11:53:47.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.911+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:47.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.911+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:47.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.911+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:47.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.911+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:47.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.911+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:47.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.915+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:47.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.915+0000 7f155dc4a9c0 20 started sync module instance, tier type = 2024-09-19T11:53:47.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.915+0000 7f155dc4a9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:53:47.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.939+0000 7f155dc4a9c0 20 add_watcher() i=0 2024-09-19T11:53:47.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.939+0000 7f155dc4a9c0 20 add_watcher() i=1 2024-09-19T11:53:47.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.939+0000 7f155dc4a9c0 20 add_watcher() i=2 2024-09-19T11:53:47.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.939+0000 7f155dc4a9c0 20 add_watcher() i=3 2024-09-19T11:53:47.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.939+0000 7f155dc4a9c0 20 add_watcher() i=4 2024-09-19T11:53:47.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.939+0000 7f155dc4a9c0 20 add_watcher() i=5 2024-09-19T11:53:47.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.939+0000 7f155dc4a9c0 20 add_watcher() i=6 2024-09-19T11:53:47.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.943+0000 7f155dc4a9c0 20 add_watcher() i=7 2024-09-19T11:53:47.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.943+0000 7f155dc4a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:53:47.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.947+0000 7f1411fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:53:47.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.947+0000 7f155dc4a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:53:47.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:47.947+0000 7f155dc4a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:53:48.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.043+0000 7f1410fe1640 20 reqs_thread_entry: start 2024-09-19T11:53:48.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.043+0000 7f155dc4a9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:53:48.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.043+0000 7f155dc4a9c0 20 Filter name: none 2024-09-19T11:53:48.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.043+0000 7f138a7fc640 20 reqs_thread_entry: start 2024-09-19T11:53:48.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.043+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-19T11:53:48.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.043+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.047+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-19T11:53:48.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.047+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-19T11:53:48.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.047+0000 7f155dc4a9c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-19T11:53:48.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.047+0000 7f155dc4a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:53:48.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.047+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5 : miss 2024-09-19T11:53:48.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.047+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.047+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-19T11:53:48.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.047+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5 info.flags=0x17 2024-09-19T11:53:48.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5 to cache LRU end 2024-09-19T11:53:48.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:53:48.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T11:53:48.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5 2024-09-19T11:53:48.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-19T11:53:48.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-19T11:53:48.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-19T11:53:48.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-19T11:53:48.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-19T11:53:48.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-19T11:53:48.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-19T11:53:48.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-19T11:53:48.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-19T11:53:48.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346356d0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x5556346ca3a8 s->prefetch_data=0 2024-09-19T11:53:48.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 10 manifest: total_size = 5240 2024-09-19T11:53:48.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12298013352394532029 2024-09-19T11:53:48.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346356d0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x5556346ca3a8 s->prefetch_data=0 2024-09-19T11:53:48.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346ca3a8 2024-09-19T11:53:48.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.051+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5.0 2024-09-19T11:53:48.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.055+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.055+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5240 stripe_ofs=5240 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.055+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12298013352394532029 2024-09-19T11:53:48.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.055+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.055+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.yPjvx_--69IaV2bLLO577e0IB3lOMCN_0 2024-09-19T11:53:48.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.055+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T11:53:48.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.055+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.059+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12298013352394532029 2024-09-19T11:53:48.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.059+0000 7f143effd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-19T11:53:48.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.063+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346356d0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x5556346ca3a8 s->prefetch_data=0 2024-09-19T11:53:48.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.063+0000 7f155dc4a9c0 10 manifest: total_size = 7658 2024-09-19T11:53:48.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.063+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17211878138900459972 2024-09-19T11:53:48.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.063+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346356d0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x5556346ca3a8 s->prefetch_data=0 2024-09-19T11:53:48.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.063+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346ca3a8 2024-09-19T11:53:48.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.063+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5.0 2024-09-19T11:53:48.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.067+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.067+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=7658 stripe_ofs=7658 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.067+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17211878138900459972 2024-09-19T11:53:48.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.067+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.067+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.z4y_Q7QQ7WIh2X4y5xNPsluL3pf31tZ_0 2024-09-19T11:53:48.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.067+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T11:53:48.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.067+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.067+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17211878138900459972 2024-09-19T11:53:48.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.071+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-19T11:53:48.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.071+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346356d0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x5556346c9e98 s->prefetch_data=0 2024-09-19T11:53:48.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.075+0000 7f155dc4a9c0 10 manifest: total_size = 12811 2024-09-19T11:53:48.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.075+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8236562369693953881 2024-09-19T11:53:48.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.075+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346356d0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x5556346c9e98 s->prefetch_data=0 2024-09-19T11:53:48.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.075+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346c9e98 2024-09-19T11:53:48.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.075+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5.0 2024-09-19T11:53:48.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.079+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.079+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=12811 stripe_ofs=12811 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.079+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8236562369693953881 2024-09-19T11:53:48.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.079+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.079+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.Jsd6hyDAaECy6Q3WlBGpjDQyLffhPei_0 2024-09-19T11:53:48.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.079+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-19T11:53:48.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.079+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.079+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8236562369693953881 2024-09-19T11:53:48.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.079+0000 7f143effd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-19T11:53:48.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.079+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cdf70 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x5556346c9e98 s->prefetch_data=0 2024-09-19T11:53:48.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.083+0000 7f155dc4a9c0 10 manifest: total_size = 7504 2024-09-19T11:53:48.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.083+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16994008310156519805 2024-09-19T11:53:48.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.083+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cdf70 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x5556346c9e98 s->prefetch_data=0 2024-09-19T11:53:48.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.083+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346c9e98 2024-09-19T11:53:48.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.083+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5.0 2024-09-19T11:53:48.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.087+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.087+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=7504 stripe_ofs=7504 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.087+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16994008310156519805 2024-09-19T11:53:48.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.087+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.087+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.2gZi6wpaz1jNjbzIWQ3099J6SFdlGaJ_0 2024-09-19T11:53:48.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.087+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T11:53:48.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.087+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.087+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16994008310156519805 2024-09-19T11:53:48.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.087+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-19T11:53:48.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.091+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346356d0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x5556346c9e98 s->prefetch_data=0 2024-09-19T11:53:48.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.091+0000 7f155dc4a9c0 10 manifest: total_size = 7536 2024-09-19T11:53:48.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.091+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1307120017790267215 2024-09-19T11:53:48.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.091+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346356d0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x5556346c9e98 s->prefetch_data=0 2024-09-19T11:53:48.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.091+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346c9e98 2024-09-19T11:53:48.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.091+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5.0 2024-09-19T11:53:48.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.095+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.095+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=7536 stripe_ofs=7536 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.095+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1307120017790267215 2024-09-19T11:53:48.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.095+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.095+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.FoWJYzMFQzOcEipL6teuTGaCLTpRLBa_0 2024-09-19T11:53:48.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.095+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-19T11:53:48.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.095+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.095+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1307120017790267215 2024-09-19T11:53:48.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.095+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346356d0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x5556346c9e98 s->prefetch_data=0 2024-09-19T11:53:48.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.095+0000 7f143effd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-19T11:53:48.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.099+0000 7f155dc4a9c0 10 manifest: total_size = 7742 2024-09-19T11:53:48.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.099+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3956694997909108924 2024-09-19T11:53:48.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.099+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346356d0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x5556346c9e98 s->prefetch_data=0 2024-09-19T11:53:48.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.099+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346c9e98 2024-09-19T11:53:48.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.099+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5.0 2024-09-19T11:53:48.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.103+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.103+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=7742 stripe_ofs=7742 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.103+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3956694997909108924 2024-09-19T11:53:48.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.103+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.103+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.n51e8Xxo99g7b8OmWbi6hWBs0Ux5TAx_0 2024-09-19T11:53:48.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.103+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-19T11:53:48.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.103+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.103+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3956694997909108924 2024-09-19T11:53:48.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.103+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-19T11:53:48.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.107+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346d12e0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x5556346c9e98 s->prefetch_data=0 2024-09-19T11:53:48.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.107+0000 7f155dc4a9c0 10 manifest: total_size = 14186 2024-09-19T11:53:48.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.107+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.855828761173446132 2024-09-19T11:53:48.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.107+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346d12e0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x5556346c9e98 s->prefetch_data=0 2024-09-19T11:53:48.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.107+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346c9e98 2024-09-19T11:53:48.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.107+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5.0 2024-09-19T11:53:48.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.111+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.111+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=14186 stripe_ofs=14186 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.111+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.855828761173446132 2024-09-19T11:53:48.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.111+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.111+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.sP035ckI2ECP7wb7SEMn7srrsG-scRF_0 2024-09-19T11:53:48.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.111+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-19T11:53:48.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.111+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.111+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.855828761173446132 2024-09-19T11:53:48.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.111+0000 7f143effd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-19T11:53:48.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.111+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346c61f0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x5556346c9e98 s->prefetch_data=0 2024-09-19T11:53:48.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.115+0000 7f155dc4a9c0 10 manifest: total_size = 7735 2024-09-19T11:53:48.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.115+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15616635576727637812 2024-09-19T11:53:48.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.115+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346c61f0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x5556346c9e98 s->prefetch_data=0 2024-09-19T11:53:48.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.115+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346c9e98 2024-09-19T11:53:48.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.115+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5.0 2024-09-19T11:53:48.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.119+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.119+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=7735 stripe_ofs=7735 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.119+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15616635576727637812 2024-09-19T11:53:48.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.119+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.119+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.nXPAsrRB6EObHtIXkxohvZAZLAnRMjL_0 2024-09-19T11:53:48.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.119+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T11:53:48.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.119+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.119+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15616635576727637812 2024-09-19T11:53:48.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.119+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-19T11:53:48.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.119+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346d4400 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x5556346c9e98 s->prefetch_data=0 2024-09-19T11:53:48.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.119+0000 7f155dc4a9c0 10 manifest: total_size = 5372 2024-09-19T11:53:48.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.119+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7434898766899608403 2024-09-19T11:53:48.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.119+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346d4400 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x5556346c9e98 s->prefetch_data=0 2024-09-19T11:53:48.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.119+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346c9e98 2024-09-19T11:53:48.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.119+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5.0 2024-09-19T11:53:48.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.123+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.123+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5372 stripe_ofs=5372 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.123+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7434898766899608403 2024-09-19T11:53:48.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.123+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.123+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.8_XPaKs7N26lVL2XIFV9jXscDJHJ688_0 2024-09-19T11:53:48.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.123+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-19T11:53:48.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.123+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.123+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7434898766899608403 2024-09-19T11:53:48.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.127+0000 7f143effd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-19T11:53:48.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.127+0000 7f155dc4a9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T11:53:48.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.127+0000 7f155dc4a9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-19T11:53:48.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.127+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:53:48.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.127+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:53:48.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.127+0000 7f155dc4a9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:53:48.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.127+0000 7f155dc4a9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:53:48.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.127+0000 7f155dc4a9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5])"; uploads.size()=0; is_truncated=0 2024-09-19T11:53:48.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.131+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-19T11:53:48.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.131+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.131+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-19T11:53:48.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.131+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-19T11:53:48.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.131+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-19T11:53:48.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.135+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-19T11:53:48.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.135+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-19T11:53:48.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.135+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 93828734871440 notifier 5693 bl.length()=162 2024-09-19T11:53:48.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.139+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5 from cache 2024-09-19T11:53:48.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.139+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5, ofs0, ns] 2024-09-19T11:53:48.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.139+0000 7f143effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431564 cookie 93828734885280 notifier 5693 bl.length()=219 2024-09-19T11:53:48.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.139+0000 7f155dc4a9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5 : miss 2024-09-19T11:53:48.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.139+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.139+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:48.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.139+0000 7f155dc4a9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5 info.flags=0x0 2024-09-19T11:53:48.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.139+0000 7f155dc4a9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5 to cache LRU end 2024-09-19T11:53:48.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.143+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12 : miss 2024-09-19T11:53:48.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.143+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.143+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-19T11:53:48.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.143+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12 info.flags=0x17 2024-09-19T11:53:48.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.143+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12 to cache LRU end 2024-09-19T11:53:48.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.143+0000 7f155dc4a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:53:48.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.143+0000 7f155dc4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T11:53:48.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.143+0000 7f155dc4a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12 2024-09-19T11:53:48.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.147+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo 2024-09-19T11:53:48.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.147+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346c6170 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x5556346c9d18 s->prefetch_data=0 2024-09-19T11:53:48.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.147+0000 7f155dc4a9c0 10 manifest: total_size = 886297 2024-09-19T11:53:48.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.147+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5105768412023401813 2024-09-19T11:53:48.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.147+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346c6170 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x5556346c9d18 s->prefetch_data=0 2024-09-19T11:53:48.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.147+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346c9d18 2024-09-19T11:53:48.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.147+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12.0 2024-09-19T11:53:48.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-19T11:53:48.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-19T11:53:48.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-19T11:53:48.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-19T11:53:48.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-19T11:53:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-19T11:53:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-19T11:53:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-19T11:53:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-19T11:53:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-19T11:53:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-19T11:53:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-19T11:53:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5105768412023401813 2024-09-19T11:53:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12__multipart_foo.2~_xe-mtA55tufKPxwu9otRa5bkyOiRSr.1 2024-09-19T11:53:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-19T11:53:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12__multipart_foo.2~_xe-mtA55tufKPxwu9otRa5bkyOiRSr.2 2024-09-19T11:53:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-19T11:53:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12__multipart_foo.2~_xe-mtA55tufKPxwu9otRa5bkyOiRSr.3 2024-09-19T11:53:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-19T11:53:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12__multipart_foo.2~_xe-mtA55tufKPxwu9otRa5bkyOiRSr.4 2024-09-19T11:53:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-19T11:53:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.151+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5105768412023401813 2024-09-19T11:53:48.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.155+0000 7f155dc4a9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T11:53:48.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.155+0000 7f155dc4a9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-19T11:53:48.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.155+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo 2024-09-19T11:53:48.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.155+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:53:48.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.155+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:53:48.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.155+0000 7f155dc4a9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:53:48.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.155+0000 7f155dc4a9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:53:48.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.155+0000 7f155dc4a9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12])"; uploads.size()=0; is_truncated=0 2024-09-19T11:53:48.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.159+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-19T11:53:48.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.159+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.159+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-19T11:53:48.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.159+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-19T11:53:48.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.159+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-19T11:53:48.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.163+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-19T11:53:48.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.163+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-19T11:53:48.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.163+0000 7f143effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431605 cookie 93828734878880 notifier 5693 bl.length()=191 2024-09-19T11:53:48.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.167+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12 from cache 2024-09-19T11:53:48.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.167+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12, ofs0, ns] 2024-09-19T11:53:48.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.167+0000 7f143effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431565 cookie 93828734885280 notifier 5693 bl.length()=249 2024-09-19T11:53:48.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.167+0000 7f155dc4a9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12 : miss 2024-09-19T11:53:48.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.167+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.167+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:48.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.167+0000 7f155dc4a9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12 info.flags=0x0 2024-09-19T11:53:48.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.167+0000 7f155dc4a9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12 to cache LRU end 2024-09-19T11:53:48.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.171+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13 : miss 2024-09-19T11:53:48.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.171+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.175+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-19T11:53:48.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.175+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13 info.flags=0x17 2024-09-19T11:53:48.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.175+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13 to cache LRU end 2024-09-19T11:53:48.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.175+0000 7f155dc4a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:53:48.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.175+0000 7f155dc4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T11:53:48.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.175+0000 7f155dc4a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13 2024-09-19T11:53:48.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.175+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo 2024-09-19T11:53:48.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.175+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cc7e0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x5556346cca48 s->prefetch_data=0 2024-09-19T11:53:48.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.175+0000 7f155dc4a9c0 10 manifest: total_size = 18874368 2024-09-19T11:53:48.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.175+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7176774585479327363 2024-09-19T11:53:48.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.175+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cc7e0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x5556346cca48 s->prefetch_data=0 2024-09-19T11:53:48.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.175+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cca48 2024-09-19T11:53:48.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.175+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13.0 2024-09-19T11:53:48.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T11:53:48.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-19T11:53:48.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-19T11:53:48.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-19T11:53:48.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-19T11:53:48.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-19T11:53:48.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-19T11:53:48.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7176774585479327363 2024-09-19T11:53:48.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13__multipart_foo.2~xRXyI8JTTc8lq3u3huscJdAuinNhrR0.1 2024-09-19T11:53:48.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-19T11:53:48.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13__multipart_foo.2~xRXyI8JTTc8lq3u3huscJdAuinNhrR0.2 2024-09-19T11:53:48.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-19T11:53:48.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13__multipart_foo.2~xRXyI8JTTc8lq3u3huscJdAuinNhrR0.3 2024-09-19T11:53:48.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-19T11:53:48.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13__multipart_foo.2~xRXyI8JTTc8lq3u3huscJdAuinNhrR0.4 2024-09-19T11:53:48.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-19T11:53:48.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7176774585479327363 2024-09-19T11:53:48.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.183+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo 2024-09-19T11:53:48.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.187+0000 7f155dc4a9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T11:53:48.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.187+0000 7f155dc4a9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-19T11:53:48.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.187+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:53:48.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.187+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:53:48.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.187+0000 7f155dc4a9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:53:48.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.187+0000 7f155dc4a9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:53:48.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.187+0000 7f155dc4a9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13])"; uploads.size()=0; is_truncated=0 2024-09-19T11:53:48.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.191+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-19T11:53:48.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.191+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.191+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-19T11:53:48.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.191+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-19T11:53:48.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.191+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-19T11:53:48.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.195+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-19T11:53:48.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.195+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-19T11:53:48.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.195+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431566 cookie 93828734882432 notifier 5693 bl.length()=198 2024-09-19T11:53:48.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.199+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13 from cache 2024-09-19T11:53:48.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.199+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13, ofs0, ns] 2024-09-19T11:53:48.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.199+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431625 cookie 93828734871440 notifier 5693 bl.length()=256 2024-09-19T11:53:48.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.203+0000 7f155dc4a9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13 : miss 2024-09-19T11:53:48.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.203+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.203+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:48.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.203+0000 7f155dc4a9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13 info.flags=0x0 2024-09-19T11:53:48.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.203+0000 7f155dc4a9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13 to cache LRU end 2024-09-19T11:53:48.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.211+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11 : miss 2024-09-19T11:53:48.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.211+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.211+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-19T11:53:48.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.211+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11 info.flags=0x17 2024-09-19T11:53:48.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.211+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11 to cache LRU end 2024-09-19T11:53:48.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.211+0000 7f155dc4a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:53:48.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.211+0000 7f155dc4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T11:53:48.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.211+0000 7f155dc4a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11 2024-09-19T11:53:48.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.211+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo[gJp0DG1t4p2Xq5s9CzuU15XVNR6dNcK] 2024-09-19T11:53:48.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.211+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11.0 2024-09-19T11:53:48.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.211+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cc120 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.211+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to jfpdj58o01czaiffj7nhjz76nt2wk41l 2024-09-19T11:53:48.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.211+0000 7f155dc4a9c0 20 get_obj_state_impl: setting s->olh_tag to gf26ig83ct3lzrgktb4w8rnmj1k6jscn 2024-09-19T11:53:48.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.211+0000 7f155dc4a9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gf26ig83ct3lzrgktb4w8rnmj1k6jscn 2024-09-19T11:53:48.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.215+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11.0 2024-09-19T11:53:48.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.219+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11.0 2024-09-19T11:53:48.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.219+0000 7f155dc4a9c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-19T11:53:48.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.219+0000 7f155dc4a9c0 20 olh_log_entry: epoch=3 op=3 key=foo[gJp0DG1t4p2Xq5s9CzuU15XVNR6dNcK] 2024-09-19T11:53:48.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.219+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cc120 obj=test-client.0-r-test-multipart-index-versioning.1:_:gJp0DG1t4p2Xq5s9CzuU15XVNR6dNcK_foo state=0x5556346e0948 s->prefetch_data=0 2024-09-19T11:53:48.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.219+0000 7f155dc4a9c0 10 manifest: total_size = 26080 2024-09-19T11:53:48.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.219+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3547212482714100033 2024-09-19T11:53:48.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.219+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cc120 obj=test-client.0-r-test-multipart-index-versioning.1:_:gJp0DG1t4p2Xq5s9CzuU15XVNR6dNcK_foo state=0x5556346e0948 s->prefetch_data=0 2024-09-19T11:53:48.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.219+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346e0948 2024-09-19T11:53:48.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.219+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11.0 2024-09-19T11:53:48.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-09-19T11:53:48.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2024-09-19T11:53:48.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7670 2024-09-19T11:53:48.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2024-09-19T11:53:48.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6299127 part_ofs=7671 rule->part_size=7670 2024-09-19T11:53:48.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=15341 stripe_ofs=15341 part_ofs=15341 rule->part_size=7672 2024-09-19T11:53:48.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-19T11:53:48.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6306797 part_ofs=15341 rule->part_size=7672 2024-09-19T11:53:48.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=23013 stripe_ofs=23013 part_ofs=23013 rule->part_size=3067 2024-09-19T11:53:48.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-19T11:53:48.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6314469 part_ofs=23013 rule->part_size=3067 2024-09-19T11:53:48.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=26080 stripe_ofs=26080 part_ofs=26080 rule->part_size=3067 2024-09-19T11:53:48.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3547212482714100033 2024-09-19T11:53:48.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11__multipart_foo.2~WIWcT5jjK_roEX87kQddpqpufxQHpZL.1 2024-09-19T11:53:48.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-19T11:53:48.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11__multipart_foo.2~WIWcT5jjK_roEX87kQddpqpufxQHpZL.2 2024-09-19T11:53:48.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-19T11:53:48.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11__multipart_foo.2~WIWcT5jjK_roEX87kQddpqpufxQHpZL.3 2024-09-19T11:53:48.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-19T11:53:48.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11__multipart_foo.2~WIWcT5jjK_roEX87kQddpqpufxQHpZL.4 2024-09-19T11:53:48.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-19T11:53:48.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.227 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3547212482714100033 2024-09-19T11:53:48.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.227+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo[gJp0DG1t4p2Xq5s9CzuU15XVNR6dNcK] 2024-09-19T11:53:48.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.231+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cc120 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.235+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11.0 2024-09-19T11:53:48.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.239+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11.0 2024-09-19T11:53:48.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.239+0000 7f155dc4a9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T11:53:48.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.239+0000 7f155dc4a9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-19T11:53:48.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.239+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:53:48.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.239+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:53:48.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.239+0000 7f155dc4a9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:53:48.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.239+0000 7f155dc4a9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:53:48.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.239+0000 7f155dc4a9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11])"; uploads.size()=0; is_truncated=0 2024-09-19T11:53:48.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.243+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-19T11:53:48.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.243+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.243+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-19T11:53:48.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.243+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-19T11:53:48.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.243+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-19T11:53:48.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.247+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-19T11:53:48.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.247+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-19T11:53:48.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.247+0000 7f143effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431567 cookie 93828734882432 notifier 5693 bl.length()=193 2024-09-19T11:53:48.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.251+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11 from cache 2024-09-19T11:53:48.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.251+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11, ofs0, ns] 2024-09-19T11:53:48.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.251+0000 7f143effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431593 cookie 93828734887984 notifier 5693 bl.length()=251 2024-09-19T11:53:48.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.255+0000 7f155dc4a9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11 : miss 2024-09-19T11:53:48.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.255+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.255+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:48.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.255+0000 7f155dc4a9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11 info.flags=0x0 2024-09-19T11:53:48.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.255+0000 7f155dc4a9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11 to cache LRU end 2024-09-19T11:53:48.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.259+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10 : miss 2024-09-19T11:53:48.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.259+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.263+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=449 2024-09-19T11:53:48.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.263+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10 info.flags=0x17 2024-09-19T11:53:48.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.263+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10 to cache LRU end 2024-09-19T11:53:48.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.263+0000 7f155dc4a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:53:48.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.263+0000 7f155dc4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T11:53:48.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.263+0000 7f155dc4a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10 2024-09-19T11:53:48.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.263+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo 2024-09-19T11:53:48.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.263+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cc490 obj=test-client.0-r-test-multipart-simple.1:foo state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.263+0000 7f155dc4a9c0 10 manifest: total_size = 18874368 2024-09-19T11:53:48.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.263+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3960075691907460840 2024-09-19T11:53:48.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.263+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cc490 obj=test-client.0-r-test-multipart-simple.1:foo state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.263+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.263+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10.0 2024-09-19T11:53:48.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T11:53:48.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-19T11:53:48.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-19T11:53:48.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-19T11:53:48.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-19T11:53:48.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-19T11:53:48.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-19T11:53:48.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3960075691907460840 2024-09-19T11:53:48.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10__multipart_foo.2~QtC77vYnYB_1UBIY23nmLo8YRSQS5VT.1 2024-09-19T11:53:48.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-19T11:53:48.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10__multipart_foo.2~QtC77vYnYB_1UBIY23nmLo8YRSQS5VT.2 2024-09-19T11:53:48.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-19T11:53:48.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10__multipart_foo.2~QtC77vYnYB_1UBIY23nmLo8YRSQS5VT.3 2024-09-19T11:53:48.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-19T11:53:48.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10__multipart_foo.2~QtC77vYnYB_1UBIY23nmLo8YRSQS5VT.4 2024-09-19T11:53:48.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-19T11:53:48.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3960075691907460840 2024-09-19T11:53:48.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.271+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo 2024-09-19T11:53:48.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.275+0000 7f155dc4a9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T11:53:48.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.275+0000 7f155dc4a9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-19T11:53:48.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.275+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:53:48.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.275+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:53:48.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.275+0000 7f155dc4a9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:53:48.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.275+0000 7f155dc4a9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:53:48.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.275+0000 7f155dc4a9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10])"; uploads.size()=0; is_truncated=0 2024-09-19T11:53:48.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.279+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-19T11:53:48.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.279+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.279+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=227 2024-09-19T11:53:48.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.279+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-19T11:53:48.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.279+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-19T11:53:48.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.283+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-19T11:53:48.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.283+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-19T11:53:48.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.283+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431626 cookie 93828734883488 notifier 5693 bl.length()=183 2024-09-19T11:53:48.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.287+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10 from cache 2024-09-19T11:53:48.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.287+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10, ofs0, ns] 2024-09-19T11:53:48.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.287+0000 7f143effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431627 cookie 93828734883488 notifier 5693 bl.length()=241 2024-09-19T11:53:48.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.291+0000 7f155dc4a9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10 : miss 2024-09-19T11:53:48.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.291+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.291+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:48.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.291+0000 7f155dc4a9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10 info.flags=0x0 2024-09-19T11:53:48.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.291+0000 7f155dc4a9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10 to cache LRU end 2024-09-19T11:53:48.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.295+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16 : miss 2024-09-19T11:53:48.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.295+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-19T11:53:48.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16 info.flags=0x17 2024-09-19T11:53:48.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16 to cache LRU end 2024-09-19T11:53:48.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:53:48.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T11:53:48.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16 2024-09-19T11:53:48.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-19T11:53:48.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-19T11:53:48.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-19T11:53:48.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-19T11:53:48.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-19T11:53:48.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-19T11:53:48.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-19T11:53:48.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-19T11:53:48.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-19T11:53:48.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-19T11:53:48.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-19T11:53:48.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-19T11:53:48.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 20 get_obj_state: octx=0x555634699b20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 10 manifest: total_size = 5242880 2024-09-19T11:53:48.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10776783807071268820 2024-09-19T11:53:48.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 20 get_obj_state: octx=0x555634699b20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.299+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16.0 2024-09-19T11:53:48.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.307+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.307+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.307+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10776783807071268820 2024-09-19T11:53:48.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.307+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.307+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.sCLAP6VMHBMougbWQGLiCwC3am6Dx9w_0 2024-09-19T11:53:48.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.307+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-19T11:53:48.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.307+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.307+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10776783807071268820 2024-09-19T11:53:48.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.311+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-19T11:53:48.310 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.311+0000 7f155dc4a9c0 20 get_obj_state: octx=0x555634699b20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.311+0000 7f155dc4a9c0 10 manifest: total_size = 5242880 2024-09-19T11:53:48.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.311+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8752321149676208315 2024-09-19T11:53:48.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.311+0000 7f155dc4a9c0 20 get_obj_state: octx=0x555634699b20 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.311+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.311+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16.0 2024-09-19T11:53:48.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.319+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.319+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.319+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8752321149676208315 2024-09-19T11:53:48.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.319+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.319+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.sCLAP6VMHBMougbWQGLiCwC3am6Dx9w_0 2024-09-19T11:53:48.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.319+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-19T11:53:48.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.319+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.319+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8752321149676208315 2024-09-19T11:53:48.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.323+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-19T11:53:48.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.323+0000 7f155dc4a9c0 20 get_obj_state: octx=0x555634541ab0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.323+0000 7f155dc4a9c0 10 manifest: total_size = 5242880 2024-09-19T11:53:48.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.323+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to _ragrJiQN_ltiGJDiriHZ7y5Jl8hpdhu 2024-09-19T11:53:48.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.323+0000 7f155dc4a9c0 20 get_obj_state: octx=0x555634541ab0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.323+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.323+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16.0 2024-09-19T11:53:48.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.327+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.327+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.327+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _ragrJiQN_ltiGJDiriHZ7y5Jl8hpdhu 2024-09-19T11:53:48.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.327+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.327+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.iKwXgcZ1iTxpFOVJTOGID5vzrgSKr4A_0 2024-09-19T11:53:48.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.327+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-19T11:53:48.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.327+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.327+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _ragrJiQN_ltiGJDiriHZ7y5Jl8hpdhu 2024-09-19T11:53:48.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.331+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-19T11:53:48.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.331+0000 7f155dc4a9c0 20 get_obj_state: octx=0x555634541ab0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.331+0000 7f155dc4a9c0 10 manifest: total_size = 5242880 2024-09-19T11:53:48.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.331+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to _23ai2yN19tr2cHIWJx0JxUIct5ghR_e 2024-09-19T11:53:48.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.331+0000 7f155dc4a9c0 20 get_obj_state: octx=0x555634541ab0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.331+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.331+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16.0 2024-09-19T11:53:48.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.339+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.339+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.339+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _23ai2yN19tr2cHIWJx0JxUIct5ghR_e 2024-09-19T11:53:48.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.339+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.339+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.LwPmFQxrMqR7velArccMGHK2bkx_LjY_0 2024-09-19T11:53:48.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.339+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-19T11:53:48.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.339+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.339 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.339+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _23ai2yN19tr2cHIWJx0JxUIct5ghR_e 2024-09-19T11:53:48.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.343+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-19T11:53:48.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.343+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.343+0000 7f155dc4a9c0 10 manifest: total_size = 5242880 2024-09-19T11:53:48.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.343+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1712527367405413526 2024-09-19T11:53:48.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.343+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.343+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.343+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16.0 2024-09-19T11:53:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.351+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.351+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.351+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1712527367405413526 2024-09-19T11:53:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.351+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.351+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.HjZmBj6lWS6WujM-K3HdexKBGbheY5C_0 2024-09-19T11:53:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.351+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-19T11:53:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.351+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.351+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1712527367405413526 2024-09-19T11:53:48.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.351+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f154c0942b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.351+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-19T11:53:48.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.355+0000 7f155dc4a9c0 10 manifest: total_size = 5242880 2024-09-19T11:53:48.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.355+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to _aj8mg77Mx0slP_n8IOowL6zy4lDMR5x 2024-09-19T11:53:48.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.355+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f154c0942b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.355+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.355+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16.0 2024-09-19T11:53:48.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.359+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.359+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.359+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _aj8mg77Mx0slP_n8IOowL6zy4lDMR5x 2024-09-19T11:53:48.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.359+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.359+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.--vdrXYNKGXb_Gr4RWQx8g0VtZth4K0_0 2024-09-19T11:53:48.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.359+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-19T11:53:48.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.359+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.359+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _aj8mg77Mx0slP_n8IOowL6zy4lDMR5x 2024-09-19T11:53:48.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.363+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346e8ce0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.363+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-19T11:53:48.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.363+0000 7f155dc4a9c0 10 manifest: total_size = 5242880 2024-09-19T11:53:48.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.363+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.432478025209677256 2024-09-19T11:53:48.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.363+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346e8ce0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.363+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.363+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16.0 2024-09-19T11:53:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.371+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.371+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.371+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.432478025209677256 2024-09-19T11:53:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.371+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.371+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.HjZmBj6lWS6WujM-K3HdexKBGbheY5C_0 2024-09-19T11:53:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.371+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-19T11:53:48.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.371+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.371+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.432478025209677256 2024-09-19T11:53:48.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.375+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-19T11:53:48.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.375+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.375+0000 7f155dc4a9c0 10 manifest: total_size = 5242880 2024-09-19T11:53:48.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.375+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to _qmKG9AyrWaD7zjlxQ8yUUzolBIMBe9j 2024-09-19T11:53:48.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.375+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.375+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.375+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16.0 2024-09-19T11:53:48.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.383+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.383+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.383+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _qmKG9AyrWaD7zjlxQ8yUUzolBIMBe9j 2024-09-19T11:53:48.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.383+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.383+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.hcF2YRdzi_EjbFKluzqniUBMzOc6jZN_0 2024-09-19T11:53:48.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.383+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-19T11:53:48.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.383+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.383+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _qmKG9AyrWaD7zjlxQ8yUUzolBIMBe9j 2024-09-19T11:53:48.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.387+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-19T11:53:48.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.387+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.387+0000 7f155dc4a9c0 10 manifest: total_size = 2046 2024-09-19T11:53:48.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.387+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5597613352814739239 2024-09-19T11:53:48.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.387+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.387+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.387+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16.0 2024-09-19T11:53:48.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.391+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.391+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=2046 stripe_ofs=2046 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.391+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5597613352814739239 2024-09-19T11:53:48.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.391+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.391+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.7gRvL7cqoLzqUy3hEo2_WrXsYZ11nkv_0 2024-09-19T11:53:48.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.391+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-19T11:53:48.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.391+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.391+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5597613352814739239 2024-09-19T11:53:48.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.395+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.395+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-19T11:53:48.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.395+0000 7f155dc4a9c0 10 manifest: total_size = 2046 2024-09-19T11:53:48.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.395+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to _AoT2aBkxOEmXmbm1MH_9zPvPJK2Qg-V 2024-09-19T11:53:48.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.395+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.395+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.395+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16.0 2024-09-19T11:53:48.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.403+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.403+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=2046 stripe_ofs=2046 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.403+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _AoT2aBkxOEmXmbm1MH_9zPvPJK2Qg-V 2024-09-19T11:53:48.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.403+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.403+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.FGiRIswP3n63kY7mZy8RjSpZ4AuTcEP_0 2024-09-19T11:53:48.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.403+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-19T11:53:48.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.403+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.403+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _AoT2aBkxOEmXmbm1MH_9zPvPJK2Qg-V 2024-09-19T11:53:48.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.407+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-19T11:53:48.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.407+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f154c0942b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.407+0000 7f155dc4a9c0 10 manifest: total_size = 2046 2024-09-19T11:53:48.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.407+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to _4XBjDffPZnwR0K8-3xHC4arcXXDzHQc 2024-09-19T11:53:48.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.407+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f154c0942b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.407+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.407+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16.0 2024-09-19T11:53:48.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.415+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.415+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=2046 stripe_ofs=2046 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.415+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _4XBjDffPZnwR0K8-3xHC4arcXXDzHQc 2024-09-19T11:53:48.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.415+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.415+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.KnhJrUUsuKrSV-0OlMYyIdXoHP4lG9d_0 2024-09-19T11:53:48.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.415+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-19T11:53:48.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.415+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.415+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _4XBjDffPZnwR0K8-3xHC4arcXXDzHQc 2024-09-19T11:53:48.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.415+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.415+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-19T11:53:48.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.419+0000 7f155dc4a9c0 10 manifest: total_size = 2046 2024-09-19T11:53:48.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.419+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16256782547976312700 2024-09-19T11:53:48.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.419+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.419+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.419+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16.0 2024-09-19T11:53:48.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.423+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.423+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=2046 stripe_ofs=2046 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.423+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16256782547976312700 2024-09-19T11:53:48.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.423+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.423+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.7gRvL7cqoLzqUy3hEo2_WrXsYZ11nkv_0 2024-09-19T11:53:48.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.423+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-19T11:53:48.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.423+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.423+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16256782547976312700 2024-09-19T11:53:48.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.427+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-19T11:53:48.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.427+0000 7f155dc4a9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T11:53:48.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.427+0000 7f155dc4a9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-19T11:53:48.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.427+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:53:48.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.427+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:53:48.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.427+0000 7f155dc4a9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:53:48.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.427+0000 7f155dc4a9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:53:48.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.427+0000 7f155dc4a9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16])"; uploads.size()=0; is_truncated=0 2024-09-19T11:53:48.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.431+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-19T11:53:48.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.431+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.435+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-19T11:53:48.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.435+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-19T11:53:48.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.435+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-19T11:53:48.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.435+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-19T11:53:48.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.435+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-19T11:53:48.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.435+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431568 cookie 93828734882432 notifier 5693 bl.length()=189 2024-09-19T11:53:48.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.439+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16 from cache 2024-09-19T11:53:48.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.439+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16, ofs0, ns] 2024-09-19T11:53:48.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.439+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 93828734887984 notifier 5693 bl.length()=247 2024-09-19T11:53:48.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.443+0000 7f155dc4a9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16 : miss 2024-09-19T11:53:48.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.443+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.447+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:48.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.447+0000 7f155dc4a9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16 info.flags=0x0 2024-09-19T11:53:48.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.447+0000 7f155dc4a9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16 to cache LRU end 2024-09-19T11:53:48.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17 : miss 2024-09-19T11:53:48.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-19T11:53:48.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17 info.flags=0x17 2024-09-19T11:53:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17 to cache LRU end 2024-09-19T11:53:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:53:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T11:53:48.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17 2024-09-19T11:53:48.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-19T11:53:48.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-19T11:53:48.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-19T11:53:48.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-19T11:53:48.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-19T11:53:48.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-19T11:53:48.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-19T11:53:48.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-19T11:53:48.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-19T11:53:48.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-19T11:53:48.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-19T11:53:48.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-19T11:53:48.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.451+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346e3070 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.455+0000 7f155dc4a9c0 10 manifest: total_size = 11534336 2024-09-19T11:53:48.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.455+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.675613783052332244 2024-09-19T11:53:48.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.455+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346e3070 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.455+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.455+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17.0 2024-09-19T11:53:48.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T11:53:48.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T11:53:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T11:53:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.675613783052332244 2024-09-19T11:53:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-FROZEN.2~9jza5Jxf8exQnHeolZvL9SOhVSsi8ym.1 2024-09-19T11:53:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 366 2024-09-19T11:53:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-FROZEN.2~9jza5Jxf8exQnHeolZvL9SOhVSsi8ym.2 2024-09-19T11:53:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-19T11:53:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-FROZEN.2~9jza5Jxf8exQnHeolZvL9SOhVSsi8ym.3 2024-09-19T11:53:48.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-19T11:53:48.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.459+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.675613783052332244 2024-09-19T11:53:48.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.463+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-19T11:53:48.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.463+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f154c0942b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.463+0000 7f155dc4a9c0 10 manifest: total_size = 11534336 2024-09-19T11:53:48.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.463+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10882590046286815382 2024-09-19T11:53:48.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.463+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f154c0942b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.463+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.463+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17.0 2024-09-19T11:53:48.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T11:53:48.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T11:53:48.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T11:53:48.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10882590046286815382 2024-09-19T11:53:48.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-FROZEN.2~9jza5Jxf8exQnHeolZvL9SOhVSsi8ym.1 2024-09-19T11:53:48.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-19T11:53:48.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-FROZEN.2~9jza5Jxf8exQnHeolZvL9SOhVSsi8ym.2 2024-09-19T11:53:48.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-19T11:53:48.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-FROZEN.2~9jza5Jxf8exQnHeolZvL9SOhVSsi8ym.3 2024-09-19T11:53:48.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-19T11:53:48.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.467+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10882590046286815382 2024-09-19T11:53:48.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.471+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-19T11:53:48.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.471+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cd310 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.475+0000 7f155dc4a9c0 10 manifest: total_size = 11534336 2024-09-19T11:53:48.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.475+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to _DvsO34dhc9OJ_m_Ndb8vrPel7XarTZd 2024-09-19T11:53:48.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.475+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cd310 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.475+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.475+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17.0 2024-09-19T11:53:48.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.479+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.479+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.479+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.479+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.479+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _DvsO34dhc9OJ_m_Ndb8vrPel7XarTZd 2024-09-19T11:53:48.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.479+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.479+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.PyBcx8G81s7PMPlETejnvo0J2yoCaaH_0 2024-09-19T11:53:48.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.479+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-19T11:53:48.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.479+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.PyBcx8G81s7PMPlETejnvo0J2yoCaaH_1 2024-09-19T11:53:48.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.479+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-19T11:53:48.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.479+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.479+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _DvsO34dhc9OJ_m_Ndb8vrPel7XarTZd 2024-09-19T11:53:48.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.483+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-19T11:53:48.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.483+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f15540aa750 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.487+0000 7f155dc4a9c0 10 manifest: total_size = 11534336 2024-09-19T11:53:48.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.487+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to _-0me1qKuYxgu8_n9D-IsyGObFt2GCX5 2024-09-19T11:53:48.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.487+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f15540aa750 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.487+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.487+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17.0 2024-09-19T11:53:48.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.491+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.491+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.491+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.491+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.491+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _-0me1qKuYxgu8_n9D-IsyGObFt2GCX5 2024-09-19T11:53:48.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.491+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.491+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.FinKlMOz_A3O7W04bo2TNtGeqlCYYqq_0 2024-09-19T11:53:48.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.491+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-19T11:53:48.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.491+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.FinKlMOz_A3O7W04bo2TNtGeqlCYYqq_1 2024-09-19T11:53:48.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.491+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-19T11:53:48.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.491+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.491+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _-0me1qKuYxgu8_n9D-IsyGObFt2GCX5 2024-09-19T11:53:48.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.495+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-19T11:53:48.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.495+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f15540aa750 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.495+0000 7f155dc4a9c0 10 manifest: total_size = 11534336 2024-09-19T11:53:48.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.495+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7990499832876230746 2024-09-19T11:53:48.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.495+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f15540aa750 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.495+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.495+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17.0 2024-09-19T11:53:48.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T11:53:48.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T11:53:48.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T11:53:48.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7990499832876230746 2024-09-19T11:53:48.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-LUKEWARM.2~HMaHS1yrkg-dPeOgovydO5e43SdsNSD.1 2024-09-19T11:53:48.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-19T11:53:48.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-LUKEWARM.2~HMaHS1yrkg-dPeOgovydO5e43SdsNSD.2 2024-09-19T11:53:48.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-19T11:53:48.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-LUKEWARM.2~HMaHS1yrkg-dPeOgovydO5e43SdsNSD.3 2024-09-19T11:53:48.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-19T11:53:48.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7990499832876230746 2024-09-19T11:53:48.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f155dc4a9c0 20 get_obj_state: octx=0x55563469c330 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.503+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-19T11:53:48.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.507+0000 7f155dc4a9c0 10 manifest: total_size = 11534336 2024-09-19T11:53:48.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.507+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to _DwsAK_aOIJYoJ76l_qc_dFHB2ngJQkr 2024-09-19T11:53:48.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.507+0000 7f155dc4a9c0 20 get_obj_state: octx=0x55563469c330 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.507+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.507+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17.0 2024-09-19T11:53:48.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.511+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.511+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.511+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.511+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.511+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _DwsAK_aOIJYoJ76l_qc_dFHB2ngJQkr 2024-09-19T11:53:48.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.511+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.511+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.KG55moEV7uHKaHgQPwUu0zp8TJfhyPl_0 2024-09-19T11:53:48.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.511+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-19T11:53:48.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.511+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.KG55moEV7uHKaHgQPwUu0zp8TJfhyPl_1 2024-09-19T11:53:48.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.511+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-19T11:53:48.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.511+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.511+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _DwsAK_aOIJYoJ76l_qc_dFHB2ngJQkr 2024-09-19T11:53:48.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.515+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-19T11:53:48.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.515+0000 7f155dc4a9c0 20 get_obj_state: octx=0x55563469c330 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.515+0000 7f155dc4a9c0 10 manifest: total_size = 11534336 2024-09-19T11:53:48.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.515+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11139671296259530201 2024-09-19T11:53:48.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.515+0000 7f155dc4a9c0 20 get_obj_state: octx=0x55563469c330 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.515+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.515+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17.0 2024-09-19T11:53:48.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T11:53:48.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T11:53:48.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T11:53:48.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11139671296259530201 2024-09-19T11:53:48.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-LUKEWARM.2~HMaHS1yrkg-dPeOgovydO5e43SdsNSD.1 2024-09-19T11:53:48.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-19T11:53:48.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-LUKEWARM.2~HMaHS1yrkg-dPeOgovydO5e43SdsNSD.2 2024-09-19T11:53:48.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-19T11:53:48.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-LUKEWARM.2~HMaHS1yrkg-dPeOgovydO5e43SdsNSD.3 2024-09-19T11:53:48.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-19T11:53:48.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.523+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11139671296259530201 2024-09-19T11:53:48.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.527+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-19T11:53:48.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.527+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cf020 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.527+0000 7f155dc4a9c0 10 manifest: total_size = 11534336 2024-09-19T11:53:48.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.527+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to _y8symLAxYaV7jdYcM4gOn6ofNT2y62b 2024-09-19T11:53:48.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.527+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cf020 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.527+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.527+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17.0 2024-09-19T11:53:48.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.531+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.531+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.531+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.531+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.531+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _y8symLAxYaV7jdYcM4gOn6ofNT2y62b 2024-09-19T11:53:48.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.531+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.531+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.JGgCgkX3X4n5cZfVsi8chEq1kUXd9a7_0 2024-09-19T11:53:48.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.531+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-19T11:53:48.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.531+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.JGgCgkX3X4n5cZfVsi8chEq1kUXd9a7_1 2024-09-19T11:53:48.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.531+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-19T11:53:48.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.531+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.531+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _y8symLAxYaV7jdYcM4gOn6ofNT2y62b 2024-09-19T11:53:48.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.535+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-19T11:53:48.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.535+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f154c08cb80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.535+0000 7f155dc4a9c0 10 manifest: total_size = 11534336 2024-09-19T11:53:48.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.535+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.154871758333595144 2024-09-19T11:53:48.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.535+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f154c08cb80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.535+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.535+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17.0 2024-09-19T11:53:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T11:53:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T11:53:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T11:53:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.154871758333595144 2024-09-19T11:53:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-STANDARD.2~XuLcG68F642Z3TfjR-MH_5k6ZdGj8Av.1 2024-09-19T11:53:48.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 363 2024-09-19T11:53:48.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-STANDARD.2~XuLcG68F642Z3TfjR-MH_5k6ZdGj8Av.2 2024-09-19T11:53:48.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-19T11:53:48.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-STANDARD.2~XuLcG68F642Z3TfjR-MH_5k6ZdGj8Av.3 2024-09-19T11:53:48.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-19T11:53:48.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.543+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.154871758333595144 2024-09-19T11:53:48.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.547+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f15540aa750 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.547+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-19T11:53:48.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.547+0000 7f155dc4a9c0 10 manifest: total_size = 11534336 2024-09-19T11:53:48.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.547+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to _miNxIV6Ep8u551wIVyMq0ORQd3-1mvD 2024-09-19T11:53:48.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.547+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f15540aa750 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.547+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.547+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17.0 2024-09-19T11:53:48.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.551+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.551+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.551+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.551+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.551+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _miNxIV6Ep8u551wIVyMq0ORQd3-1mvD 2024-09-19T11:53:48.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.551+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.551+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.HDYaWnfoTA37C9kBxfsH2vYknDt_6wl_0 2024-09-19T11:53:48.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.551+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-19T11:53:48.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.551+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.HDYaWnfoTA37C9kBxfsH2vYknDt_6wl_1 2024-09-19T11:53:48.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.551+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-19T11:53:48.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.551+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.551+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _miNxIV6Ep8u551wIVyMq0ORQd3-1mvD 2024-09-19T11:53:48.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.555+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-19T11:53:48.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.555+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cd310 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.555+0000 7f155dc4a9c0 10 manifest: total_size = 11534336 2024-09-19T11:53:48.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.555+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to _6e4PodiyzudaZP6EX6GFZbL6TEKGPqi 2024-09-19T11:53:48.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.555+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cd310 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.555+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.555+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17.0 2024-09-19T11:53:48.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.563+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.563+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.563+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.563+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.563+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _6e4PodiyzudaZP6EX6GFZbL6TEKGPqi 2024-09-19T11:53:48.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.563+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.563+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.EXsOzV3UFrqZrdwsym1HpzK0oEMEq4a_0 2024-09-19T11:53:48.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.563+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-19T11:53:48.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.563+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.EXsOzV3UFrqZrdwsym1HpzK0oEMEq4a_1 2024-09-19T11:53:48.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.563+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-19T11:53:48.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.563+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.563+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _6e4PodiyzudaZP6EX6GFZbL6TEKGPqi 2024-09-19T11:53:48.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.567+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-19T11:53:48.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.567+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f154c08cb80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.567+0000 7f155dc4a9c0 10 manifest: total_size = 11534336 2024-09-19T11:53:48.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.567+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17762274316618845519 2024-09-19T11:53:48.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.567+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f154c08cb80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.567+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.567+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17.0 2024-09-19T11:53:48.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T11:53:48.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T11:53:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T11:53:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17762274316618845519 2024-09-19T11:53:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-STANDARD.2~XuLcG68F642Z3TfjR-MH_5k6ZdGj8Av.1 2024-09-19T11:53:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-19T11:53:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-STANDARD.2~XuLcG68F642Z3TfjR-MH_5k6ZdGj8Av.2 2024-09-19T11:53:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-19T11:53:48.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-STANDARD.2~XuLcG68F642Z3TfjR-MH_5k6ZdGj8Av.3 2024-09-19T11:53:48.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-19T11:53:48.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.571+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17762274316618845519 2024-09-19T11:53:48.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.575+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-19T11:53:48.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.575+0000 7f155dc4a9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T11:53:48.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.575+0000 7f155dc4a9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-19T11:53:48.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.575+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:53:48.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.575+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:53:48.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.575+0000 7f155dc4a9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:53:48.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.575+0000 7f155dc4a9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:53:48.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.575+0000 7f155dc4a9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17])"; uploads.size()=0; is_truncated=0 2024-09-19T11:53:48.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.579+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-19T11:53:48.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.579+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.579+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-19T11:53:48.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.579+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-19T11:53:48.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.579+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-19T11:53:48.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.583+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-19T11:53:48.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.583+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-19T11:53:48.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.583+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431566 cookie 93828734885280 notifier 5693 bl.length()=199 2024-09-19T11:53:48.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.587+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17 from cache 2024-09-19T11:53:48.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.587+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17, ofs0, ns] 2024-09-19T11:53:48.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.587+0000 7f143effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431606 cookie 93828734878880 notifier 5693 bl.length()=257 2024-09-19T11:53:48.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.591+0000 7f155dc4a9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17 : miss 2024-09-19T11:53:48.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.591+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.591+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:48.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.591+0000 7f155dc4a9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17 info.flags=0x0 2024-09-19T11:53:48.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.591+0000 7f155dc4a9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17 to cache LRU end 2024-09-19T11:53:48.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.599+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15 : miss 2024-09-19T11:53:48.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.599+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.599+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-19T11:53:48.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.599+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15 info.flags=0x17 2024-09-19T11:53:48.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.599+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15 to cache LRU end 2024-09-19T11:53:48.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.599+0000 7f155dc4a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:53:48.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.599+0000 7f155dc4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T11:53:48.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.599+0000 7f155dc4a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15 2024-09-19T11:53:48.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.599+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-19T11:53:48.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.599+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-19T11:53:48.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.599+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-19T11:53:48.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.599+0000 7f155dc4a9c0 20 get_obj_state: octx=0x555634676e30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.603+0000 7f155dc4a9c0 10 manifest: total_size = 11534336 2024-09-19T11:53:48.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.603+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1352402708417602848 2024-09-19T11:53:48.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.603+0000 7f155dc4a9c0 20 get_obj_state: octx=0x555634676e30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.603+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.603+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15.0 2024-09-19T11:53:48.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T11:53:48.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T11:53:48.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T11:53:48.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1352402708417602848 2024-09-19T11:53:48.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-FROZEN.2~tWV1KYcW1lmhFoxy9X6py72XiZ_oDBO.1 2024-09-19T11:53:48.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-19T11:53:48.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-FROZEN.2~tWV1KYcW1lmhFoxy9X6py72XiZ_oDBO.2 2024-09-19T11:53:48.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-19T11:53:48.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-FROZEN.2~tWV1KYcW1lmhFoxy9X6py72XiZ_oDBO.3 2024-09-19T11:53:48.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-19T11:53:48.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.607+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1352402708417602848 2024-09-19T11:53:48.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.611+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-19T11:53:48.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.611+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346d4990 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.611+0000 7f155dc4a9c0 10 manifest: total_size = 11534336 2024-09-19T11:53:48.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.611+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16284991007965918423 2024-09-19T11:53:48.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.611+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346d4990 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.611+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.611+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15.0 2024-09-19T11:53:48.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T11:53:48.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T11:53:48.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T11:53:48.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T11:53:48.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T11:53:48.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T11:53:48.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16284991007965918423 2024-09-19T11:53:48.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-LUKEWARM.2~5_Efmd7Aj1aHUgAEiFbmB51mtJ_7yO0.1 2024-09-19T11:53:48.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-19T11:53:48.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-LUKEWARM.2~5_Efmd7Aj1aHUgAEiFbmB51mtJ_7yO0.2 2024-09-19T11:53:48.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-19T11:53:48.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-LUKEWARM.2~5_Efmd7Aj1aHUgAEiFbmB51mtJ_7yO0.3 2024-09-19T11:53:48.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-19T11:53:48.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.619+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16284991007965918423 2024-09-19T11:53:48.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.623+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-19T11:53:48.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.623+0000 7f155dc4a9c0 20 get_obj_state: octx=0x55563469c330 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.623+0000 7f155dc4a9c0 10 manifest: total_size = 541681 2024-09-19T11:53:48.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.623+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8624146391120803045 2024-09-19T11:53:48.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.623+0000 7f155dc4a9c0 20 get_obj_state: octx=0x55563469c330 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.623+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.623+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15.0 2024-09-19T11:53:48.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-19T11:53:48.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-19T11:53:48.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-19T11:53:48.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-19T11:53:48.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-19T11:53:48.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-19T11:53:48.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-19T11:53:48.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-09-19T11:53:48.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-19T11:53:48.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8624146391120803045 2024-09-19T11:53:48.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-STANDARD.2~AEJljSd5RHWia_kvtOGI-3qkdS53q0b.1 2024-09-19T11:53:48.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-19T11:53:48.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-STANDARD.2~AEJljSd5RHWia_kvtOGI-3qkdS53q0b.2 2024-09-19T11:53:48.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-19T11:53:48.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-STANDARD.2~AEJljSd5RHWia_kvtOGI-3qkdS53q0b.3 2024-09-19T11:53:48.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-19T11:53:48.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.631+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8624146391120803045 2024-09-19T11:53:48.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.635+0000 7f155dc4a9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T11:53:48.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.635+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-19T11:53:48.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.635+0000 7f155dc4a9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-19T11:53:48.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.635+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:53:48.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.635+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:53:48.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.635+0000 7f155dc4a9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:53:48.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.635+0000 7f155dc4a9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:53:48.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.635+0000 7f155dc4a9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15])"; uploads.size()=0; is_truncated=0 2024-09-19T11:53:48.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.639+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-19T11:53:48.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.639+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.639+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-19T11:53:48.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.639+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-19T11:53:48.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.639+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-19T11:53:48.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.643+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-19T11:53:48.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.643+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-19T11:53:48.644 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.643+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431595 cookie 93828734890560 notifier 5693 bl.length()=194 2024-09-19T11:53:48.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.647+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15 from cache 2024-09-19T11:53:48.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.647+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15, ofs0, ns] 2024-09-19T11:53:48.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.651+0000 7f143effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431607 cookie 93828734878880 notifier 5693 bl.length()=252 2024-09-19T11:53:48.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.655+0000 7f155dc4a9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15 : miss 2024-09-19T11:53:48.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.655+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.655+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:48.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.655+0000 7f155dc4a9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15 info.flags=0x0 2024-09-19T11:53:48.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.655+0000 7f155dc4a9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15 to cache LRU end 2024-09-19T11:53:48.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.659+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14 : miss 2024-09-19T11:53:48.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.659+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.659+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-19T11:53:48.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.659+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14 info.flags=0x17 2024-09-19T11:53:48.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.659+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14 to cache LRU end 2024-09-19T11:53:48.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.659+0000 7f155dc4a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:53:48.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.659+0000 7f155dc4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T11:53:48.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.659+0000 7f155dc4a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14 2024-09-19T11:53:48.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.663+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-19T11:53:48.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.663+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-19T11:53:48.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.663+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-19T11:53:48.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.663+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cac00 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.663+0000 7f155dc4a9c0 10 manifest: total_size = 10485760 2024-09-19T11:53:48.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.663+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3278760952287216094 2024-09-19T11:53:48.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.663+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cac00 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.663+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.663+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14.0 2024-09-19T11:53:48.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.667+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.667+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.667+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.667+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.667+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3278760952287216094 2024-09-19T11:53:48.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.667+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.667+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14__shadow_.Z5CHCofhSAf0X9-uUaL8J4Cp04YxKoj_0 2024-09-19T11:53:48.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.667+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-19T11:53:48.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.667+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14__shadow_.Z5CHCofhSAf0X9-uUaL8J4Cp04YxKoj_1 2024-09-19T11:53:48.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.667+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-19T11:53:48.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.667+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.667+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3278760952287216094 2024-09-19T11:53:48.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.671+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f154c05e050 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.671+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-19T11:53:48.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.675+0000 7f155dc4a9c0 10 manifest: total_size = 10485760 2024-09-19T11:53:48.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.675+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3698351116454983719 2024-09-19T11:53:48.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.675+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f154c05e050 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.675+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.675+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14.0 2024-09-19T11:53:48.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.679+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.679+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.679+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.679+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.679+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3698351116454983719 2024-09-19T11:53:48.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.679+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.679+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14__shadow_.MWCEPCrT8G4Agi1dv34ZvCMaaJhjhMl_0 2024-09-19T11:53:48.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.679+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-19T11:53:48.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.679+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14__shadow_.MWCEPCrT8G4Agi1dv34ZvCMaaJhjhMl_1 2024-09-19T11:53:48.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.679+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-19T11:53:48.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.679+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.679+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3698351116454983719 2024-09-19T11:53:48.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.683+0000 7f143effd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-19T11:53:48.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.683+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f154c08cb80 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.683+0000 7f155dc4a9c0 10 manifest: total_size = 10485760 2024-09-19T11:53:48.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.687+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3753043501227799044 2024-09-19T11:53:48.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.687+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f154c08cb80 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.687+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.687+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14.0 2024-09-19T11:53:48.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.691+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.691+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.691+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.691+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.691+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3753043501227799044 2024-09-19T11:53:48.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.691+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.691+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14__shadow_.un1yzyEsIKhTxJSNgr1_eKHidJja6Jm_0 2024-09-19T11:53:48.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.691+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-19T11:53:48.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.691+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14__shadow_.un1yzyEsIKhTxJSNgr1_eKHidJja6Jm_1 2024-09-19T11:53:48.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.691+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 560 2024-09-19T11:53:48.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.691+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.691+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3753043501227799044 2024-09-19T11:53:48.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.695+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-19T11:53:48.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.695+0000 7f155dc4a9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T11:53:48.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.695+0000 7f155dc4a9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-19T11:53:48.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.695+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:53:48.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.695+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:53:48.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.695+0000 7f155dc4a9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:53:48.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.695+0000 7f155dc4a9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:53:48.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.695+0000 7f155dc4a9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14])"; uploads.size()=0; is_truncated=0 2024-09-19T11:53:48.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.699+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-19T11:53:48.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.699+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.703+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-19T11:53:48.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.703+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-19T11:53:48.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.703+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-19T11:53:48.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.703+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-19T11:53:48.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.703+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-19T11:53:48.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.707+0000 7f143effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431569 cookie 93828734882432 notifier 5693 bl.length()=184 2024-09-19T11:53:48.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.711+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14 from cache 2024-09-19T11:53:48.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.711+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14, ofs0, ns] 2024-09-19T11:53:48.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.711+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431628 cookie 93828734871440 notifier 5693 bl.length()=242 2024-09-19T11:53:48.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.715+0000 7f155dc4a9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14 : miss 2024-09-19T11:53:48.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.715+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.715+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:48.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.715+0000 7f155dc4a9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14 info.flags=0x0 2024-09-19T11:53:48.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.715+0000 7f155dc4a9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14 to cache LRU end 2024-09-19T11:53:48.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.719+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7 : miss 2024-09-19T11:53:48.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.719+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.719+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-19T11:53:48.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.719+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7 info.flags=0x17 2024-09-19T11:53:48.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.719+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7 to cache LRU end 2024-09-19T11:53:48.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.719+0000 7f155dc4a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:53:48.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.719+0000 7f155dc4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T11:53:48.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.719+0000 7f155dc4a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7 2024-09-19T11:53:48.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.723+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got __ 2024-09-19T11:53:48.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.723+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-19T11:53:48.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.723+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got ___ 2024-09-19T11:53:48.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.723+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got obj 2024-09-19T11:53:48.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.723+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cf290 obj=test-client.0-r-test-small-obj-data.1:__ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.723+0000 7f155dc4a9c0 10 manifest: total_size = 0 2024-09-19T11:53:48.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.723+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1001916922676149181 2024-09-19T11:53:48.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.723+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cf290 obj=test-client.0-r-test-small-obj-data.1:__ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.723+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.723+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7.0 2024-09-19T11:53:48.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.731+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cf290 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.731+0000 7f155dc4a9c0 10 manifest: total_size = 0 2024-09-19T11:53:48.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.731+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16959833584950519795 2024-09-19T11:53:48.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.731+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cf290 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.731+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.731+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7.0 2024-09-19T11:53:48.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.735+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=__ 2024-09-19T11:53:48.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.739+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cf290 obj=test-client.0-r-test-small-obj-data.1:___ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.739+0000 7f155dc4a9c0 10 manifest: total_size = 0 2024-09-19T11:53:48.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.739+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8938320669377883177 2024-09-19T11:53:48.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.739+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cf290 obj=test-client.0-r-test-small-obj-data.1:___ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.739+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.739+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7.0 2024-09-19T11:53:48.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.739+0000 7f143effd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-19T11:53:48.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.747+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cf290 obj=test-client.0-r-test-small-obj-data.1:obj state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.747+0000 7f155dc4a9c0 10 manifest: total_size = 0 2024-09-19T11:53:48.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.747+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15780575220149593644 2024-09-19T11:53:48.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.747+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346cf290 obj=test-client.0-r-test-small-obj-data.1:obj state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.747+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.747+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7.0 2024-09-19T11:53:48.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.747+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=___ 2024-09-19T11:53:48.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.751+0000 7f155dc4a9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T11:53:48.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.751+0000 7f155dc4a9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-19T11:53:48.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.755+0000 7f143effd640 20 handle_completion(): completion ok for obj=obj 2024-09-19T11:53:48.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.755+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:53:48.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.755+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:53:48.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.755+0000 7f155dc4a9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:53:48.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.755+0000 7f155dc4a9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:53:48.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.755+0000 7f155dc4a9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7])"; uploads.size()=0; is_truncated=0 2024-09-19T11:53:48.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.759+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-19T11:53:48.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.759+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.763+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-19T11:53:48.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.763+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-19T11:53:48.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.763+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-19T11:53:48.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.763+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-19T11:53:48.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.763+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-19T11:53:48.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.763+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431608 cookie 93828734878880 notifier 5693 bl.length()=181 2024-09-19T11:53:48.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.767+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7 from cache 2024-09-19T11:53:48.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.767+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7, ofs0, ns] 2024-09-19T11:53:48.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.771+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431596 cookie 93828734887984 notifier 5693 bl.length()=238 2024-09-19T11:53:48.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.775+0000 7f155dc4a9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7 : miss 2024-09-19T11:53:48.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.775+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.775+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:48.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.775+0000 7f155dc4a9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7 info.flags=0x0 2024-09-19T11:53:48.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.775+0000 7f155dc4a9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7 to cache LRU end 2024-09-19T11:53:48.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.779+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8 : miss 2024-09-19T11:53:48.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.779+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.779+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-19T11:53:48.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.779+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8 info.flags=0x17 2024-09-19T11:53:48.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.779+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8 to cache LRU end 2024-09-19T11:53:48.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.779+0000 7f155dc4a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:53:48.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.779+0000 7f155dc4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T11:53:48.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.779+0000 7f155dc4a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8 2024-09-19T11:53:48.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.779+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got __ 2024-09-19T11:53:48.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.779+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-19T11:53:48.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.779+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got ___ 2024-09-19T11:53:48.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.779+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got obj 2024-09-19T11:53:48.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.779+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.783+0000 7f155dc4a9c0 10 manifest: total_size = 24595 2024-09-19T11:53:48.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.783+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13906377838126137650 2024-09-19T11:53:48.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.783+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.783+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.783+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8.0 2024-09-19T11:53:48.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.787+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.787+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.787+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13906377838126137650 2024-09-19T11:53:48.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.787+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.787+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8__shadow_.Ry1sGTWPfA2BHjkeAuEkEDB5OaPgvhV_0 2024-09-19T11:53:48.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.787+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T11:53:48.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.787+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.787+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13906377838126137650 2024-09-19T11:53:48.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.791+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=__ 2024-09-19T11:53:48.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.791+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.791+0000 7f155dc4a9c0 10 manifest: total_size = 527 2024-09-19T11:53:48.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.791+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9733746796976124546 2024-09-19T11:53:48.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.791+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.791+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.791+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8.0 2024-09-19T11:53:48.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.799+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.799+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.799+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9733746796976124546 2024-09-19T11:53:48.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.799+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.799+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8__shadow_.L7qI776uDoJfz_9849sIpaifEN5pUuW_0 2024-09-19T11:53:48.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.799+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-19T11:53:48.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.799+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.799+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9733746796976124546 2024-09-19T11:53:48.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.803+0000 7f143effd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-19T11:53:48.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.803+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.803+0000 7f155dc4a9c0 10 manifest: total_size = 527 2024-09-19T11:53:48.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.803+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14031975559630283965 2024-09-19T11:53:48.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.803+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.803+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.803+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8.0 2024-09-19T11:53:48.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.811+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.811+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.811+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14031975559630283965 2024-09-19T11:53:48.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.811+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.811+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8__shadow_.f-QlHMN1-NWJXpvAuTJW0gmg359pRor_0 2024-09-19T11:53:48.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.811+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T11:53:48.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.811+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.811+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14031975559630283965 2024-09-19T11:53:48.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.811+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=___ 2024-09-19T11:53:48.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.815+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.815+0000 7f155dc4a9c0 10 manifest: total_size = 38 2024-09-19T11:53:48.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.815+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7858973728063681064 2024-09-19T11:53:48.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.815+0000 7f155dc4a9c0 20 get_obj_state: octx=0x7f155003d0b0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.815+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.815+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8.0 2024-09-19T11:53:48.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.819+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.819+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.819+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7858973728063681064 2024-09-19T11:53:48.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.819+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.819+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8__shadow_.rOgMAZs_yQQ8MPTIr5aju2o7n-MilnB_0 2024-09-19T11:53:48.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.819+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-19T11:53:48.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.819+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.819+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7858973728063681064 2024-09-19T11:53:48.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.823+0000 7f143effd640 20 handle_completion(): completion ok for obj=obj 2024-09-19T11:53:48.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.823+0000 7f155dc4a9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T11:53:48.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.823+0000 7f155dc4a9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-19T11:53:48.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.827+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:53:48.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.827+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:53:48.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.827+0000 7f155dc4a9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:53:48.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.827+0000 7f155dc4a9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:53:48.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.827+0000 7f155dc4a9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8])"; uploads.size()=0; is_truncated=0 2024-09-19T11:53:48.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.827+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-19T11:53:48.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.827+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.831+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-19T11:53:48.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.831+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-19T11:53:48.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.831+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-19T11:53:48.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.831+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-19T11:53:48.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.831+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-19T11:53:48.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.831+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431609 cookie 93828734878880 notifier 5693 bl.length()=181 2024-09-19T11:53:48.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.835+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8 from cache 2024-09-19T11:53:48.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.835+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8, ofs0, ns] 2024-09-19T11:53:48.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.835+0000 7f143effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431597 cookie 93828734887984 notifier 5693 bl.length()=238 2024-09-19T11:53:48.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.839+0000 7f155dc4a9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8 : miss 2024-09-19T11:53:48.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.839+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.839+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:48.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.839+0000 7f155dc4a9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8 info.flags=0x0 2024-09-19T11:53:48.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.839+0000 7f155dc4a9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8 to cache LRU end 2024-09-19T11:53:48.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.847+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9 : miss 2024-09-19T11:53:48.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.847+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.847+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-19T11:53:48.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.847+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9 info.flags=0x17 2024-09-19T11:53:48.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.847+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9 to cache LRU end 2024-09-19T11:53:48.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.847+0000 7f155dc4a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:53:48.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.847+0000 7f155dc4a9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T11:53:48.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.847+0000 7f155dc4a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9 2024-09-19T11:53:48.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.847+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got __ 2024-09-19T11:53:48.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.847+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-19T11:53:48.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.847+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got ___ 2024-09-19T11:53:48.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.847+0000 7f155dc4a9c0 10 cls_bucket_list_unordered: got obj 2024-09-19T11:53:48.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.847+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346ca540 obj=test-client.0-r-test-small-obj-data.3:__ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.851+0000 7f155dc4a9c0 10 manifest: total_size = 1048576 2024-09-19T11:53:48.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.851+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15586398448222481202 2024-09-19T11:53:48.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.851+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346ca540 obj=test-client.0-r-test-small-obj-data.3:__ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.851+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.851+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9.0 2024-09-19T11:53:48.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.855+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.855+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.855+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15586398448222481202 2024-09-19T11:53:48.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.855+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.855+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9__shadow_.SAW3nvCph_BD5avQ3Vys_CvzizdP_xS_0 2024-09-19T11:53:48.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.855+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T11:53:48.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.855+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.855+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15586398448222481202 2024-09-19T11:53:48.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.859+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346ca540 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.859+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=__ 2024-09-19T11:53:48.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.859+0000 7f155dc4a9c0 10 manifest: total_size = 4134 2024-09-19T11:53:48.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.859+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9894666824978412235 2024-09-19T11:53:48.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.859+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346ca540 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.859+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.859+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9.0 2024-09-19T11:53:48.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.867+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.867+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.867+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9894666824978412235 2024-09-19T11:53:48.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.867+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.867+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9__shadow_.c1-GcVxBAZkaPbKiJ-PgnTH9RTVte9P_0 2024-09-19T11:53:48.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.867+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-19T11:53:48.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.867+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.867+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9894666824978412235 2024-09-19T11:53:48.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.871+0000 7f143effd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-19T11:53:48.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.871+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346ca540 obj=test-client.0-r-test-small-obj-data.3:___ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.871+0000 7f155dc4a9c0 10 manifest: total_size = 49187 2024-09-19T11:53:48.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.871+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7186688755398756256 2024-09-19T11:53:48.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.871+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346ca540 obj=test-client.0-r-test-small-obj-data.3:___ state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.871+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.871+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9.0 2024-09-19T11:53:48.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.879+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.879+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.879+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7186688755398756256 2024-09-19T11:53:48.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.879+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.879+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9__shadow_.JdiDWS_0FgUuy89NYTyCph6SiZT3zpT_0 2024-09-19T11:53:48.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.879+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-19T11:53:48.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.879+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.879+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7186688755398756256 2024-09-19T11:53:48.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.883+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346ca540 obj=test-client.0-r-test-small-obj-data.3:obj state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.883+0000 7f143e7fc640 20 handle_completion(): completion ok for obj=___ 2024-09-19T11:53:48.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.887+0000 7f155dc4a9c0 10 manifest: total_size = 4134 2024-09-19T11:53:48.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.887+0000 7f155dc4a9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14856024576150551902 2024-09-19T11:53:48.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.887+0000 7f155dc4a9c0 20 get_obj_state: octx=0x5556346ca540 obj=test-client.0-r-test-small-obj-data.3:obj state=0x5556346cc998 s->prefetch_data=0 2024-09-19T11:53:48.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.887+0000 7f155dc4a9c0 20 prepare_atomic_modification: state is not atomic. state=0x5556346cc998 2024-09-19T11:53:48.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.887+0000 7f155dc4a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9.0 2024-09-19T11:53:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.891+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T11:53:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.891+0000 7f155dc4a9c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-19T11:53:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.891+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14856024576150551902 2024-09-19T11:53:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.891+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T11:53:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.891+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9__shadow_.SUgfTJy5t0uTc6f_RuGu6uWlysswMF1_0 2024-09-19T11:53:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.891+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T11:53:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.891+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T11:53:48.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.891+0000 7f155dc4a9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14856024576150551902 2024-09-19T11:53:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.895+0000 7f155dc4a9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T11:53:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.895+0000 7f155dc4a9c0 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-19T11:53:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.895+0000 7f143effd640 20 handle_completion(): completion ok for obj=obj 2024-09-19T11:53:48.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.895+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:53:48.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.895+0000 7f155dc4a9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:53:48.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.895+0000 7f155dc4a9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:53:48.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.895+0000 7f155dc4a9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:53:48.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.895+0000 7f155dc4a9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9])"; uploads.size()=0; is_truncated=0 2024-09-19T11:53:48.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.899+0000 7f155dc4a9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-19T11:53:48.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.899+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.903+0000 7f155dc4a9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-19T11:53:48.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.903+0000 7f155dc4a9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-19T11:53:48.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.903+0000 7f155dc4a9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-19T11:53:48.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.903+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-19T11:53:48.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.903+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-19T11:53:48.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.903+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431610 cookie 93828734878880 notifier 5693 bl.length()=181 2024-09-19T11:53:48.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.907+0000 7f155dc4a9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9 from cache 2024-09-19T11:53:48.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.907+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9, ofs0, ns] 2024-09-19T11:53:48.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.911+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431598 cookie 93828734887984 notifier 5693 bl.length()=238 2024-09-19T11:53:48.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.915+0000 7f155dc4a9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9 : miss 2024-09-19T11:53:48.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.915+0000 7f155dc4a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:48.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.915+0000 7f155dc4a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:48.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.915+0000 7f155dc4a9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9 info.flags=0x0 2024-09-19T11:53:48.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.915+0000 7f155dc4a9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9 to cache LRU end 2024-09-19T11:53:48.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.919+0000 7f155dc4a9c0 10 removing key index: XJMUSSNEUPCRYOSECKAB 2024-09-19T11:53:48.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.923+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:XJMUSSNEUPCRYOSECKAB, ofs0, ns] 2024-09-19T11:53:48.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.923+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431599 cookie 93828734887984 notifier 5693 bl.length()=170 2024-09-19T11:53:48.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.927+0000 7f155dc4a9c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-19T11:53:48.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.927+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-19T11:53:48.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.927+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431570 cookie 93828734882432 notifier 5693 bl.length()=182 2024-09-19T11:53:48.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.931+0000 7f155dc4a9c0 10 removing user buckets index 2024-09-19T11:53:48.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.931+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-19T11:53:48.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.935+0000 7f143effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431600 cookie 93828734890560 notifier 5693 bl.length()=173 2024-09-19T11:53:48.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.935+0000 7f155dc4a9c0 10 removing user index: ragweed.client.0 2024-09-19T11:53:48.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.939+0000 7f155dc4a9c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-19T11:53:48.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.939+0000 7f155dc4a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-19T11:53:48.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.939+0000 7f143e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431629 cookie 93828734883488 notifier 5693 bl.length()=165 2024-09-19T11:53:48.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.943+0000 7f1411fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:53:48.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.947+0000 7f155dc4a9c0 20 remove_watcher() i=0 2024-09-19T11:53:48.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.947+0000 7f155dc4a9c0 2 removed watcher, disabling cache 2024-09-19T11:53:48.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.951+0000 7f155dc4a9c0 20 remove_watcher() i=1 2024-09-19T11:53:48.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.951+0000 7f155dc4a9c0 20 remove_watcher() i=2 2024-09-19T11:53:48.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.955+0000 7f155dc4a9c0 20 remove_watcher() i=3 2024-09-19T11:53:48.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.959+0000 7f155dc4a9c0 20 remove_watcher() i=4 2024-09-19T11:53:48.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.959+0000 7f155dc4a9c0 20 remove_watcher() i=5 2024-09-19T11:53:48.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.963+0000 7f155dc4a9c0 20 remove_watcher() i=6 2024-09-19T11:53:48.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:48.963+0000 7f155dc4a9c0 20 remove_watcher() i=7 2024-09-19T11:53:48.985 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-19T11:53:49.064 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:53:49.064 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:53:49.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.315+0000 7f090d3b19c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:49.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.315+0000 7f090d3b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:49.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.315+0000 7f090d3b19c0 20 realm 2024-09-19T11:53:49.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.315+0000 7f090d3b19c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:49.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.315+0000 7f090d3b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:49.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.315+0000 7f090d3b19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:53:49.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.315+0000 7f090d3b19c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:49.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.315+0000 7f090d3b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:49.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.315+0000 7f090d3b19c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:49.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.319+0000 7f090d3b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:53:49.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.319+0000 7f090d3b19c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:49.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.319+0000 7f090d3b19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:53:49.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.319+0000 7f090d3b19c0 20 searching for the correct realm 2024-09-19T11:53:49.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.323+0000 7f090b6b8640 0 -- 172.21.15.120:0/373291574 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f08f40ea060 msgr2=0x7f08f40eab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:53:49.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.535+0000 7f090a6b6640 0 -- 172.21.15.120:0/373291574 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f090405d680 msgr2=0x7f0904078860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:53:49.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:53:49.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:53:49.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:53:49.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:53:49.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:53:49.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:53:49.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:49.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:49.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:49.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:53:49.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:49.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:53:49.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 zone default found 2024-09-19T11:53:49.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 4 Realm: () 2024-09-19T11:53:49.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:53:49.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:53:49.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:53:49.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 zonegroup default 2024-09-19T11:53:49.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:49.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:49.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.759+0000 7f090d3b19c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:49.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.763+0000 7f090d3b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:49.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.763+0000 7f090d3b19c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:49.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.763+0000 7f090d3b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:53:49.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.763+0000 7f090d3b19c0 20 started sync module instance, tier type = 2024-09-19T11:53:49.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.763+0000 7f090d3b19c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:53:49.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.787+0000 7f090d3b19c0 20 add_watcher() i=0 2024-09-19T11:53:49.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.787+0000 7f090d3b19c0 20 add_watcher() i=1 2024-09-19T11:53:49.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.787+0000 7f090d3b19c0 20 add_watcher() i=2 2024-09-19T11:53:49.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.787+0000 7f090d3b19c0 20 add_watcher() i=3 2024-09-19T11:53:49.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.787+0000 7f090d3b19c0 20 add_watcher() i=4 2024-09-19T11:53:49.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.787+0000 7f090d3b19c0 20 add_watcher() i=5 2024-09-19T11:53:49.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.787+0000 7f090d3b19c0 20 add_watcher() i=6 2024-09-19T11:53:49.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.791+0000 7f090d3b19c0 20 add_watcher() i=7 2024-09-19T11:53:49.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.791+0000 7f090d3b19c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:53:49.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.795+0000 7f07c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:53:49.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.795+0000 7f090d3b19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:53:49.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.795+0000 7f090d3b19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:53:49.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.883+0000 7f07c0fe1640 20 reqs_thread_entry: start 2024-09-19T11:53:49.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.883+0000 7f090d3b19c0 20 init_complete bucket index max shards: 1 2024-09-19T11:53:49.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.883+0000 7f090d3b19c0 20 Filter name: none 2024-09-19T11:53:49.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.883+0000 7f07b9ffb640 20 reqs_thread_entry: start 2024-09-19T11:53:49.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.883+0000 7f090d3b19c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-19T11:53:49.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.883+0000 7f090d3b19c0 20 rados->read ofs=0 len=0 2024-09-19T11:53:49.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.887+0000 7f090d3b19c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-19T11:53:49.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.887+0000 7f090d3b19c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-19T11:53:49.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.887+0000 7f090d3b19c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-19T11:53:49.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.887+0000 7f090d3b19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:53:49.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.887+0000 7f090d3b19c0 10 removing key index: WUREONVYFUCFTORGPYST 2024-09-19T11:53:49.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.891+0000 7f090d3b19c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:WUREONVYFUCFTORGPYST, ofs0, ns] 2024-09-19T11:53:49.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.891+0000 7f07ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431567 cookie 94857013812400 notifier 5711 bl.length()=170 2024-09-19T11:53:49.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.891+0000 7f090d3b19c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-19T11:53:49.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.891+0000 7f090d3b19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-19T11:53:49.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.895+0000 7f07edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431630 cookie 94857013813760 notifier 5711 bl.length()=182 2024-09-19T11:53:49.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.895+0000 7f090d3b19c0 10 removing user buckets index 2024-09-19T11:53:49.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.895+0000 7f090d3b19c0 10 removing user index: sysuser.client.0 2024-09-19T11:53:49.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.899+0000 7f090d3b19c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-19T11:53:49.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.899+0000 7f090d3b19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-19T11:53:49.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.899+0000 7f07edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431571 cookie 94857013806464 notifier 5711 bl.length()=165 2024-09-19T11:53:49.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.903+0000 7f07c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:53:49.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.907+0000 7f090d3b19c0 20 remove_watcher() i=0 2024-09-19T11:53:49.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.907+0000 7f090d3b19c0 2 removed watcher, disabling cache 2024-09-19T11:53:49.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.911+0000 7f090d3b19c0 20 remove_watcher() i=1 2024-09-19T11:53:49.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.911+0000 7f090d3b19c0 20 remove_watcher() i=2 2024-09-19T11:53:49.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.915+0000 7f090d3b19c0 20 remove_watcher() i=3 2024-09-19T11:53:49.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.915+0000 7f090d3b19c0 20 remove_watcher() i=4 2024-09-19T11:53:49.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.919+0000 7f090d3b19c0 20 remove_watcher() i=5 2024-09-19T11:53:49.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.919+0000 7f090d3b19c0 20 remove_watcher() i=6 2024-09-19T11:53:49.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T11:53:49.923+0000 7f090d3b19c0 20 remove_watcher() i=7 2024-09-19T11:53:49.938 INFO:tasks.ragweed:Removing ragweed... 2024-09-19T11:53:49.938 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-19T11:53:50.025 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T11:53:50.036 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:53:50.037 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T11:53:50.037 DEBUG:teuthology.orchestra.run.smithi120:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T11:53:50.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:53:50.078 INFO:teuthology.orchestra.run.smithi120.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T11:53:50.079 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T11:53:50.125 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T11:53:50.125 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T11:53:50.174 INFO:tasks.workunit:timeout=3h 2024-09-19T11:53:50.174 INFO:tasks.workunit:cleanup=True 2024-09-19T11:53:50.174 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:53:50.223 INFO:tasks.workunit.client.0.smithi120.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T11:54:47.396 INFO:tasks.workunit.client.0.smithi120.stderr:Updating files: 99% (12689/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-19T11:54:48.076 INFO:tasks.workunit.client.0.smithi120.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T11:54:48.076 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:54:48.076 INFO:tasks.workunit.client.0.smithi120.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T11:54:48.077 INFO:tasks.workunit.client.0.smithi120.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T11:54:48.077 INFO:tasks.workunit.client.0.smithi120.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T11:54:48.077 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:54:48.077 INFO:tasks.workunit.client.0.smithi120.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T11:54:48.077 INFO:tasks.workunit.client.0.smithi120.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T11:54:48.077 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:54:48.077 INFO:tasks.workunit.client.0.smithi120.stderr: git switch -c 2024-09-19T11:54:48.077 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:54:48.077 INFO:tasks.workunit.client.0.smithi120.stderr:Or undo this operation with: 2024-09-19T11:54:48.077 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:54:48.077 INFO:tasks.workunit.client.0.smithi120.stderr: git switch - 2024-09-19T11:54:48.077 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:54:48.077 INFO:tasks.workunit.client.0.smithi120.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T11:54:48.077 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:54:48.078 INFO:tasks.workunit.client.0.smithi120.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T11:54:48.085 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T11:54:48.139 INFO:tasks.workunit.client.0.smithi120.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T11:54:48.141 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T11:54:48.141 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T11:54:48.201 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T11:54:48.257 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T11:54:48.303 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T11:54:48.305 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T11:54:48.305 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T11:54:48.349 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T11:54:48.352 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T11:54:48.352 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T11:54:48.403 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-19T11:54:48.405 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-19T11:54:48.405 DEBUG:teuthology.orchestra.run.smithi120:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-19T11:54:48.460 INFO:tasks.workunit.client.0.smithi120.stderr:+ ulimit -c 0 2024-09-19T11:54:48.460 INFO:tasks.workunit.client.0.smithi120.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-19T11:54:48.461 INFO:tasks.workunit.client.0.smithi120.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T11:54:48.461 INFO:tasks.workunit.client.0.smithi120.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T11:54:51.349 INFO:tasks.workunit.client.0.smithi120.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-19T11:54:51.350 INFO:tasks.workunit.client.0.smithi120.stderr:++ deactivate nondestructive 2024-09-19T11:54:51.350 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n '' ']' 2024-09-19T11:54:51.350 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n '' ']' 2024-09-19T11:54:51.350 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T11:54:51.350 INFO:tasks.workunit.client.0.smithi120.stderr:++ hash -r 2024-09-19T11:54:51.350 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n '' ']' 2024-09-19T11:54:51.350 INFO:tasks.workunit.client.0.smithi120.stderr:++ unset VIRTUAL_ENV 2024-09-19T11:54:51.350 INFO:tasks.workunit.client.0.smithi120.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-19T11:54:51.350 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-19T11:54:51.350 INFO:tasks.workunit.client.0.smithi120.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T11:54:51.350 INFO:tasks.workunit.client.0.smithi120.stderr:++ export VIRTUAL_ENV 2024-09-19T11:54:51.350 INFO:tasks.workunit.client.0.smithi120.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T11:54:51.351 INFO:tasks.workunit.client.0.smithi120.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T11:54:51.351 INFO:tasks.workunit.client.0.smithi120.stderr:++ export PATH 2024-09-19T11:54:51.351 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n '' ']' 2024-09-19T11:54:51.351 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -z '' ']' 2024-09-19T11:54:51.351 INFO:tasks.workunit.client.0.smithi120.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-19T11:54:51.351 INFO:tasks.workunit.client.0.smithi120.stderr:++ PS1='(rgw) ' 2024-09-19T11:54:51.351 INFO:tasks.workunit.client.0.smithi120.stderr:++ export PS1 2024-09-19T11:54:51.351 INFO:tasks.workunit.client.0.smithi120.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-19T11:54:51.351 INFO:tasks.workunit.client.0.smithi120.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-19T11:54:51.351 INFO:tasks.workunit.client.0.smithi120.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T11:54:51.351 INFO:tasks.workunit.client.0.smithi120.stderr:++ hash -r 2024-09-19T11:54:51.351 INFO:tasks.workunit.client.0.smithi120.stderr:+ pip install pip --upgrade 2024-09-19T11:54:51.715 INFO:tasks.workunit.client.0.smithi120.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-19T11:54:51.920 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting pip 2024-09-19T11:54:51.926 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-19T11:54:51.963 INFO:tasks.workunit.client.0.smithi120.stdout:Installing collected packages: pip 2024-09-19T11:54:51.963 INFO:tasks.workunit.client.0.smithi120.stdout: Attempting uninstall: pip 2024-09-19T11:54:51.963 INFO:tasks.workunit.client.0.smithi120.stdout: Found existing installation: pip 22.0.2 2024-09-19T11:54:52.250 INFO:tasks.workunit.client.0.smithi120.stdout: Uninstalling pip-22.0.2: 2024-09-19T11:54:52.257 INFO:tasks.workunit.client.0.smithi120.stdout: Successfully uninstalled pip-22.0.2 2024-09-19T11:54:53.011 INFO:tasks.workunit.client.0.smithi120.stdout:Successfully installed pip-24.2 2024-09-19T11:54:53.070 INFO:tasks.workunit.client.0.smithi120.stderr:+ pip install boto3 2024-09-19T11:54:54.055 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting boto3 2024-09-19T11:54:54.056 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached boto3-1.35.22-py3-none-any.whl.metadata (6.6 kB) 2024-09-19T11:54:54.612 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting botocore<1.36.0,>=1.35.22 (from boto3) 2024-09-19T11:54:54.613 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached botocore-1.35.22-py3-none-any.whl.metadata (5.7 kB) 2024-09-19T11:54:54.660 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-19T11:54:54.661 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-19T11:54:54.709 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-19T11:54:54.710 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-19T11:54:54.758 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T11:54:54.759 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-19T11:54:54.856 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T11:54:54.858 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-19T11:54:55.105 INFO:tasks.workunit.client.0.smithi120.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T11:54:55.106 INFO:tasks.workunit.client.0.smithi120.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-19T11:54:55.109 INFO:tasks.workunit.client.0.smithi120.stdout:Using cached boto3-1.35.22-py3-none-any.whl (139 kB) 2024-09-19T11:54:55.111 INFO:tasks.workunit.client.0.smithi120.stdout:Using cached botocore-1.35.22-py3-none-any.whl (12.6 MB) 2024-09-19T11:54:55.120 INFO:tasks.workunit.client.0.smithi120.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-19T11:54:55.122 INFO:tasks.workunit.client.0.smithi120.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-19T11:54:55.123 INFO:tasks.workunit.client.0.smithi120.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-19T11:54:55.124 INFO:tasks.workunit.client.0.smithi120.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-19T11:54:55.125 INFO:tasks.workunit.client.0.smithi120.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T11:54:55.193 INFO:tasks.workunit.client.0.smithi120.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-19T11:54:56.227 INFO:tasks.workunit.client.0.smithi120.stdout:Successfully installed boto3-1.35.22 botocore-1.35.22 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-19T11:54:56.432 INFO:tasks.workunit.client.0.smithi120.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-19T11:54:56.557 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-19T11:54:56.596 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:54:56.596 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:54:56.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.638+0000 7f99549149c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:56.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.638+0000 7f99549149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:56.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.638+0000 7f99549149c0 20 realm 2024-09-19T11:54:56.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.638+0000 7f99549149c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:56.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.638+0000 7f99549149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:56.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.638+0000 7f99549149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:54:56.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.638+0000 7f99549149c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:56.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.638+0000 7f99549149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:56.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.638+0000 7f99549149c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:56.641 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.642+0000 7f99549149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:54:56.641 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.642+0000 7f99549149c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:56.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.642+0000 7f99549149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:54:56.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.642+0000 7f99549149c0 20 searching for the correct realm 2024-09-19T11:54:56.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.642+0000 7f9951c19640 0 -- 172.21.15.120:0/3170228306 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7f99440ff300 msgr2=0x7f99440fdd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:54:56.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.854+0000 7f9952c1b640 0 -- 172.21.15.120:0/3170228306 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f9948008050 msgr2=0x7f994805d010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:54:56.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.870+0000 7f99549149c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:54:56.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.870+0000 7f99549149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:54:56.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.870+0000 7f99549149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:54:56.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.870+0000 7f99549149c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:54:56.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.870+0000 7f99549149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:54:56.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.870+0000 7f99549149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:54:56.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.870+0000 7f99549149c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:56.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:56.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:56.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:54:56.874 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:56.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:54:56.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 20 zone default found 2024-09-19T11:54:56.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 4 Realm: () 2024-09-19T11:54:56.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:54:56.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:54:56.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:54:56.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 20 zonegroup default 2024-09-19T11:54:56.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:56.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:56.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:56.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:56.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.874+0000 7f99549149c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:56.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.878+0000 7f99549149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:56.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.878+0000 7f99549149c0 20 started sync module instance, tier type = 2024-09-19T11:54:56.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.878+0000 7f99549149c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:54:56.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.898+0000 7f99549149c0 20 add_watcher() i=0 2024-09-19T11:54:56.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.898+0000 7f99549149c0 20 add_watcher() i=1 2024-09-19T11:54:56.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.898+0000 7f99549149c0 20 add_watcher() i=2 2024-09-19T11:54:56.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.898+0000 7f99549149c0 20 add_watcher() i=3 2024-09-19T11:54:56.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.898+0000 7f99549149c0 20 add_watcher() i=4 2024-09-19T11:54:56.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.898+0000 7f99549149c0 20 add_watcher() i=5 2024-09-19T11:54:56.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.898+0000 7f99549149c0 20 add_watcher() i=6 2024-09-19T11:54:56.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.898+0000 7f99549149c0 20 add_watcher() i=7 2024-09-19T11:54:56.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.898+0000 7f99549149c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:54:56.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.902+0000 7f9808fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:54:56.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:54:56.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:54:56.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 5 note: GC not initialized 2024-09-19T11:54:56.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f97837fe640 20 reqs_thread_entry: start 2024-09-19T11:54:56.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 20 init_complete bucket index max shards: 1 2024-09-19T11:54:56.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 20 Filter name: none 2024-09-19T11:54:56.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f97817fa640 20 reqs_thread_entry: start 2024-09-19T11:54:56.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-19T11:54:56.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:56.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:56.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-19T11:54:56.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-19T11:54:56.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-19T11:54:56.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:56.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 20 rados_obj.operate() r=0 bl.length=22 2024-09-19T11:54:56.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-19T11:54:56.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-19T11:54:56.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-19T11:54:56.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.906+0000 7f99549149c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:56.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.910+0000 7f99549149c0 20 rados_obj.operate() r=0 bl.length=420 2024-09-19T11:54:56.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.910+0000 7f99549149c0 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-19T11:54:56.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.910+0000 7f99549149c0 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-19T11:54:56.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.910+0000 7f99549149c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:54:56.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.910+0000 7f99549149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-19T11:54:56.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.910+0000 7f99549149c0 20 get_user_info_from_index found 0 xattrs 2024-09-19T11:54:56.910 INFO:tasks.workunit.client.0.smithi120.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-19T11:54:56.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.910+0000 7f9808fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:54:56.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.914+0000 7f99549149c0 20 remove_watcher() i=0 2024-09-19T11:54:56.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.914+0000 7f99549149c0 2 removed watcher, disabling cache 2024-09-19T11:54:56.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.918+0000 7f99549149c0 20 remove_watcher() i=1 2024-09-19T11:54:56.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.918+0000 7f99549149c0 20 remove_watcher() i=2 2024-09-19T11:54:56.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.922+0000 7f99549149c0 20 remove_watcher() i=3 2024-09-19T11:54:56.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.926+0000 7f99549149c0 20 remove_watcher() i=4 2024-09-19T11:54:56.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.926+0000 7f99549149c0 20 remove_watcher() i=5 2024-09-19T11:54:56.927 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.926+0000 7f99549149c0 20 remove_watcher() i=6 2024-09-19T11:54:56.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:56.930+0000 7f99549149c0 20 remove_watcher() i=7 2024-09-19T11:54:57.201 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard add 2024-09-19T11:54:57.201 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:54:57.201 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T11:54:57.232 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:54:57.232 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:54:57.276 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.278+0000 7f708ec409c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.282+0000 7f708ec409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:57.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.282+0000 7f708ec409c0 20 realm 2024-09-19T11:54:57.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.282+0000 7f708ec409c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.282+0000 7f708ec409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:57.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.282+0000 7f708ec409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:54:57.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.282+0000 7f708ec409c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.282+0000 7f708ec409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:57.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.282+0000 7f708ec409c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.282+0000 7f708ec409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:54:57.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.282+0000 7f708ec409c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.282+0000 7f708ec409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:54:57.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.282+0000 7f708ec409c0 20 searching for the correct realm 2024-09-19T11:54:57.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.282+0000 7f708cf47640 0 -- 172.21.15.120:0/2694629489 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f70800e03f0 msgr2=0x7f70800e0810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:54:57.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.294+0000 7f708bf45640 0 -- 172.21.15.120:0/2694629489 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f707c05bca0 msgr2=0x7f707c07ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:54:57.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.510+0000 7f708ec409c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:54:57.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.510+0000 7f708ec409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:54:57.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.510+0000 7f708ec409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:54:57.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.510+0000 7f708ec409c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:54:57.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.510+0000 7f708ec409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:54:57.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.510+0000 7f708ec409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:54:57.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.510+0000 7f708ec409c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.510+0000 7f708ec409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:57.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.510+0000 7f708ec409c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.510+0000 7f708ec409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:54:57.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.510+0000 7f708ec409c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.514+0000 7f708ec409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:54:57.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.514+0000 7f708ec409c0 20 zone default found 2024-09-19T11:54:57.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.514+0000 7f708ec409c0 4 Realm: () 2024-09-19T11:54:57.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.514+0000 7f708ec409c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:54:57.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.514+0000 7f708ec409c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:54:57.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.514+0000 7f708ec409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:54:57.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.514+0000 7f708ec409c0 20 zonegroup default 2024-09-19T11:54:57.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.514+0000 7f708ec409c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.514+0000 7f708ec409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:57.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.514+0000 7f708ec409c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.514+0000 7f708ec409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:57.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.514+0000 7f708ec409c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.514+0000 7f708ec409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:57.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.514+0000 7f708ec409c0 20 started sync module instance, tier type = 2024-09-19T11:54:57.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.514+0000 7f708ec409c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:54:57.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.538+0000 7f708ec409c0 20 add_watcher() i=0 2024-09-19T11:54:57.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.538+0000 7f708ec409c0 20 add_watcher() i=1 2024-09-19T11:54:57.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.538+0000 7f708ec409c0 20 add_watcher() i=2 2024-09-19T11:54:57.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.538+0000 7f708ec409c0 20 add_watcher() i=3 2024-09-19T11:54:57.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.538+0000 7f708ec409c0 20 add_watcher() i=4 2024-09-19T11:54:57.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.538+0000 7f708ec409c0 20 add_watcher() i=5 2024-09-19T11:54:57.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.538+0000 7f708ec409c0 20 add_watcher() i=6 2024-09-19T11:54:57.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.538+0000 7f708ec409c0 20 add_watcher() i=7 2024-09-19T11:54:57.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.538+0000 7f708ec409c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:54:57.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.542+0000 7f6f427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:54:57.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.542+0000 7f708ec409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:54:57.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.542+0000 7f708ec409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:54:57.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.542+0000 7f708ec409c0 5 note: GC not initialized 2024-09-19T11:54:57.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.542+0000 7f6f417e2640 20 reqs_thread_entry: start 2024-09-19T11:54:57.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.542+0000 7f708ec409c0 20 init_complete bucket index max shards: 1 2024-09-19T11:54:57.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.542+0000 7f708ec409c0 20 Filter name: none 2024-09-19T11:54:57.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.546+0000 7f6eb2ffd640 20 reqs_thread_entry: start 2024-09-19T11:54:57.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.546+0000 7f708ec409c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.546+0000 7f708ec409c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T11:54:57.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.546+0000 7f708ec409c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.546+0000 7f708ec409c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T11:54:57.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.546+0000 7f708ec409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:54:57.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.546+0000 7f708ec409c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.545 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.550+0000 7f708ec409c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T11:54:57.545 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.550+0000 7f708ec409c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.550+0000 7f708ec409c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T11:54:57.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.550+0000 7f708ec409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:54:57.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.550+0000 7f6f427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:54:57.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.558+0000 7f708ec409c0 20 remove_watcher() i=0 2024-09-19T11:54:57.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.558+0000 7f708ec409c0 2 removed watcher, disabling cache 2024-09-19T11:54:57.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.558+0000 7f708ec409c0 20 remove_watcher() i=1 2024-09-19T11:54:57.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.562+0000 7f708ec409c0 20 remove_watcher() i=2 2024-09-19T11:54:57.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.562+0000 7f708ec409c0 20 remove_watcher() i=3 2024-09-19T11:54:57.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.566+0000 7f708ec409c0 20 remove_watcher() i=4 2024-09-19T11:54:57.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.566+0000 7f708ec409c0 20 remove_watcher() i=5 2024-09-19T11:54:57.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.570+0000 7f708ec409c0 20 remove_watcher() i=6 2024-09-19T11:54:57.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.570+0000 7f708ec409c0 20 remove_watcher() i=7 2024-09-19T11:54:57.582 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:54:57.582 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:54:57.582 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: a-bucket id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-19T11:54:57.582 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:54:57.582 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-09-19T11:54:57.615 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:54:57.616 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:54:57.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.662+0000 7fb63722c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.662+0000 7fb63722c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:57.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.662+0000 7fb63722c9c0 20 realm 2024-09-19T11:54:57.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.662+0000 7fb63722c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.662+0000 7fb63722c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:57.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.662+0000 7fb63722c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:54:57.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.662+0000 7fb63722c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.666+0000 7fb63722c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:57.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.666+0000 7fb63722c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.666+0000 7fb63722c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:54:57.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.666+0000 7fb63722c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:57.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.666+0000 7fb63722c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:54:57.664 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.666+0000 7fb63722c9c0 20 searching for the correct realm 2024-09-19T11:54:57.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.670+0000 7fb635533640 0 -- 172.21.15.120:0/1069695066 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fb620029040 msgr2=0x7fb62008ca90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:54:57.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:57.886+0000 7fb62ffff640 0 -- 172.21.15.120:0/1069695066 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fb628091b20 msgr2=0x7fb628091050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:54:58.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.102+0000 7fb63722c9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:54:58.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.102+0000 7fb63722c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:54:58.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.102+0000 7fb63722c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:54:58.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.102+0000 7fb63722c9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:54:58.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.102+0000 7fb63722c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:54:58.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.102+0000 7fb63722c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:54:58.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.102+0000 7fb63722c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.102+0000 7fb63722c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.102+0000 7fb63722c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:54:58.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:54:58.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 20 zone default found 2024-09-19T11:54:58.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 4 Realm: () 2024-09-19T11:54:58.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:54:58.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:54:58.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:54:58.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 20 zonegroup default 2024-09-19T11:54:58.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 20 started sync module instance, tier type = 2024-09-19T11:54:58.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.106+0000 7fb63722c9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:54:58.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.130+0000 7fb63722c9c0 20 add_watcher() i=0 2024-09-19T11:54:58.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.130+0000 7fb63722c9c0 20 add_watcher() i=1 2024-09-19T11:54:58.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.130+0000 7fb63722c9c0 20 add_watcher() i=2 2024-09-19T11:54:58.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.130+0000 7fb63722c9c0 20 add_watcher() i=3 2024-09-19T11:54:58.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.130+0000 7fb63722c9c0 20 add_watcher() i=4 2024-09-19T11:54:58.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.130+0000 7fb63722c9c0 20 add_watcher() i=5 2024-09-19T11:54:58.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.130+0000 7fb63722c9c0 20 add_watcher() i=6 2024-09-19T11:54:58.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.134+0000 7fb63722c9c0 20 add_watcher() i=7 2024-09-19T11:54:58.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.134+0000 7fb63722c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:54:58.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.138+0000 7fb4eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:54:58.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.138+0000 7fb63722c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:54:58.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.138+0000 7fb63722c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:54:58.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.138+0000 7fb63722c9c0 5 note: GC not initialized 2024-09-19T11:54:58.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.138+0000 7fb4e9fe3640 20 reqs_thread_entry: start 2024-09-19T11:54:58.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.138+0000 7fb63722c9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:54:58.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.138+0000 7fb63722c9c0 20 Filter name: none 2024-09-19T11:54:58.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.142+0000 7fb45b7fe640 20 reqs_thread_entry: start 2024-09-19T11:54:58.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.142+0000 7fb63722c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T11:54:58.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.142+0000 7fb63722c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.142+0000 7fb63722c9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T11:54:58.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.142+0000 7fb63722c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T11:54:58.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.142+0000 7fb63722c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T11:54:58.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.142+0000 7fb63722c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T11:54:58.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.142+0000 7fb63722c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.142+0000 7fb63722c9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T11:54:58.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.142+0000 7fb63722c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:54:58.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.142+0000 7fb63722c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:54:58.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.142+0000 7fb63722c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:54:58.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.142+0000 7fb63722c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:54:58.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.142+0000 7fb63722c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T11:54:58.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.146+0000 7fb4eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:54:58.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.154+0000 7fb63722c9c0 20 remove_watcher() i=0 2024-09-19T11:54:58.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.154+0000 7fb63722c9c0 2 removed watcher, disabling cache 2024-09-19T11:54:58.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.154+0000 7fb63722c9c0 20 remove_watcher() i=1 2024-09-19T11:54:58.153 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.158+0000 7fb63722c9c0 20 remove_watcher() i=2 2024-09-19T11:54:58.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.158+0000 7fb63722c9c0 20 remove_watcher() i=3 2024-09-19T11:54:58.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.162+0000 7fb63722c9c0 20 remove_watcher() i=4 2024-09-19T11:54:58.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.162+0000 7fb63722c9c0 20 remove_watcher() i=5 2024-09-19T11:54:58.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.162+0000 7fb63722c9c0 20 remove_watcher() i=6 2024-09-19T11:54:58.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.166+0000 7fb63722c9c0 20 remove_watcher() i=7 2024-09-19T11:54:58.180 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin reshard list 2024-09-19T11:54:58.209 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:54:58.209 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:54:58.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.258+0000 7f0d5aff49c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.258+0000 7f0d5aff49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.258+0000 7f0d5aff49c0 20 realm 2024-09-19T11:54:58.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.258+0000 7f0d5aff49c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.262+0000 7f0d5aff49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.262+0000 7f0d5aff49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:54:58.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.262+0000 7f0d5aff49c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.262+0000 7f0d5aff49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.262+0000 7f0d5aff49c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.262+0000 7f0d5aff49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:54:58.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.262+0000 7f0d5aff49c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.260 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.262+0000 7f0d5aff49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:54:58.260 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.262+0000 7f0d5aff49c0 20 searching for the correct realm 2024-09-19T11:54:58.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.266+0000 7f0d592fb640 0 -- 172.21.15.120:0/561665004 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f0d4c0f7910 msgr2=0x7f0d4c0e9400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:54:58.270 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.274+0000 7f0d582f9640 0 -- 172.21.15.120:0/561665004 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f0d48017070 msgr2=0x7f0d48066180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:54:58.487 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.490+0000 7f0d5aff49c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:54:58.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.490+0000 7f0d5aff49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:54:58.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.490+0000 7f0d5aff49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:54:58.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.490+0000 7f0d5aff49c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:54:58.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.490+0000 7f0d5aff49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:54:58.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.490+0000 7f0d5aff49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:54:58.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.490+0000 7f0d5aff49c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.490+0000 7f0d5aff49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.490+0000 7f0d5aff49c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:54:58.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:54:58.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 20 zone default found 2024-09-19T11:54:58.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 4 Realm: () 2024-09-19T11:54:58.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:54:58.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:54:58.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:54:58.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 20 zonegroup default 2024-09-19T11:54:58.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 20 started sync module instance, tier type = 2024-09-19T11:54:58.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.494+0000 7f0d5aff49c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:54:58.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.518+0000 7f0d5aff49c0 20 add_watcher() i=0 2024-09-19T11:54:58.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.518+0000 7f0d5aff49c0 20 add_watcher() i=1 2024-09-19T11:54:58.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.518+0000 7f0d5aff49c0 20 add_watcher() i=2 2024-09-19T11:54:58.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.518+0000 7f0d5aff49c0 20 add_watcher() i=3 2024-09-19T11:54:58.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.518+0000 7f0d5aff49c0 20 add_watcher() i=4 2024-09-19T11:54:58.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.518+0000 7f0d5aff49c0 20 add_watcher() i=5 2024-09-19T11:54:58.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.518+0000 7f0d5aff49c0 20 add_watcher() i=6 2024-09-19T11:54:58.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.518+0000 7f0d5aff49c0 20 add_watcher() i=7 2024-09-19T11:54:58.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.518+0000 7f0d5aff49c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:54:58.520 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.526+0000 7f0c0f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:54:58.521 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.526+0000 7f0d5aff49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:54:58.522 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.526+0000 7f0d5aff49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:54:58.522 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.526+0000 7f0d5aff49c0 5 note: GC not initialized 2024-09-19T11:54:58.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.526+0000 7f0c0e7e4640 20 reqs_thread_entry: start 2024-09-19T11:54:58.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.526+0000 7f0d5aff49c0 20 init_complete bucket index max shards: 1 2024-09-19T11:54:58.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.526+0000 7f0d5aff49c0 20 Filter name: none 2024-09-19T11:54:58.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.526+0000 7f0c077fe640 20 reqs_thread_entry: start 2024-09-19T11:54:58.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.538+0000 7f0c0f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:54:58.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.542+0000 7f0d5aff49c0 20 remove_watcher() i=0 2024-09-19T11:54:58.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.542+0000 7f0d5aff49c0 2 removed watcher, disabling cache 2024-09-19T11:54:58.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.546+0000 7f0d5aff49c0 20 remove_watcher() i=1 2024-09-19T11:54:58.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.546+0000 7f0d5aff49c0 20 remove_watcher() i=2 2024-09-19T11:54:58.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.550+0000 7f0d5aff49c0 20 remove_watcher() i=3 2024-09-19T11:54:58.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.554+0000 7f0d5aff49c0 20 remove_watcher() i=4 2024-09-19T11:54:58.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.554+0000 7f0d5aff49c0 20 remove_watcher() i=5 2024-09-19T11:54:58.551 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.554+0000 7f0d5aff49c0 20 remove_watcher() i=6 2024-09-19T11:54:58.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.558+0000 7f0d5aff49c0 20 remove_watcher() i=7 2024-09-19T11:54:58.569 INFO:tasks.workunit.client.0.smithi120.stderr:bucket name a-bucket 2024-09-19T11:54:58.570 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard process 2024-09-19T11:54:58.570 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:54:58.570 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin reshard process 2024-09-19T11:54:58.596 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:54:58.596 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:54:58.643 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.646+0000 7f823af889c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.646+0000 7f823af889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.646+0000 7f823af889c0 20 realm 2024-09-19T11:54:58.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.646+0000 7f823af889c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.646+0000 7f823af889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.646+0000 7f823af889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:54:58.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.646+0000 7f823af889c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.650+0000 7f823af889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.650+0000 7f823af889c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.646 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.650+0000 7f823af889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:54:58.646 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.650+0000 7f823af889c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.650+0000 7f823af889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:54:58.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.650+0000 7f823af889c0 20 searching for the correct realm 2024-09-19T11:54:58.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.654+0000 7f823828d640 0 -- 172.21.15.120:0/1049456617 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7f8220002350 msgr2=0x7f8228028930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:54:58.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.866+0000 7f823928f640 0 -- 172.21.15.120:0/1049456617 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f822c0b7020 msgr2=0x7f822c0f70c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:54:58.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:54:58.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:54:58.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:54:58.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:54:58.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:54:58.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:54:58.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:54:58.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:54:58.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 20 zone default found 2024-09-19T11:54:58.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 4 Realm: () 2024-09-19T11:54:58.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:54:58.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:54:58.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:54:58.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 20 zonegroup default 2024-09-19T11:54:58.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.886+0000 7f823af889c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.890+0000 7f823af889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.890+0000 7f823af889c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.890+0000 7f823af889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.890+0000 7f823af889c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.890+0000 7f823af889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:54:58.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.890+0000 7f823af889c0 20 started sync module instance, tier type = 2024-09-19T11:54:58.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.890+0000 7f823af889c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:54:58.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.914+0000 7f823af889c0 20 add_watcher() i=0 2024-09-19T11:54:58.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.914+0000 7f823af889c0 20 add_watcher() i=1 2024-09-19T11:54:58.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.914+0000 7f823af889c0 20 add_watcher() i=2 2024-09-19T11:54:58.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.914+0000 7f823af889c0 20 add_watcher() i=3 2024-09-19T11:54:58.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.914+0000 7f823af889c0 20 add_watcher() i=4 2024-09-19T11:54:58.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.914+0000 7f823af889c0 20 add_watcher() i=5 2024-09-19T11:54:58.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.914+0000 7f823af889c0 20 add_watcher() i=6 2024-09-19T11:54:58.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.918+0000 7f823af889c0 20 add_watcher() i=7 2024-09-19T11:54:58.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.918+0000 7f823af889c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:54:58.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.922+0000 7f80ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:54:58.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.922+0000 7f823af889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:54:58.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.922+0000 7f823af889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:54:58.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.922+0000 7f823af889c0 5 note: GC not initialized 2024-09-19T11:54:58.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.926+0000 7f80ee7e4640 20 reqs_thread_entry: start 2024-09-19T11:54:58.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.926+0000 7f823af889c0 20 init_complete bucket index max shards: 1 2024-09-19T11:54:58.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.926+0000 7f823af889c0 20 Filter name: none 2024-09-19T11:54:58.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.926+0000 7f80e7fff640 20 reqs_thread_entry: start 2024-09-19T11:54:58.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.926+0000 7f823af889c0 20 processing logshard = reshard.0000000000 2024-09-19T11:54:58.927 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.930+0000 7f823af889c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-19T11:54:58.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.930+0000 7f823af889c0 20 processing logshard = reshard.0000000001 2024-09-19T11:54:58.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.938+0000 7f823af889c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-19T11:54:58.933 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.938+0000 7f823af889c0 20 processing logshard = reshard.0000000002 2024-09-19T11:54:58.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.942+0000 7f823af889c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-19T11:54:58.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.942+0000 7f823af889c0 20 processing logshard = reshard.0000000003 2024-09-19T11:54:58.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.946+0000 7f823af889c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-19T11:54:58.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.946+0000 7f823af889c0 20 processing logshard = reshard.0000000004 2024-09-19T11:54:58.950 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.954+0000 7f823af889c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-19T11:54:58.950 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.954+0000 7f823af889c0 20 processing logshard = reshard.0000000005 2024-09-19T11:54:58.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.958+0000 7f823af889c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-19T11:54:58.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.958+0000 7f823af889c0 20 processing logshard = reshard.0000000006 2024-09-19T11:54:58.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.962+0000 7f823af889c0 20 process_entry resharding a-bucket 2024-09-19T11:54:58.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.962+0000 7f823af889c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T11:54:58.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.962+0000 7f823af889c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.966+0000 7f823af889c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T11:54:58.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.966+0000 7f823af889c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-19T11:54:58.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.966+0000 7f823af889c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T11:54:58.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.966+0000 7f823af889c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T11:54:58.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.966+0000 7f823af889c0 20 rados->read ofs=0 len=0 2024-09-19T11:54:58.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.966+0000 7f823af889c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T11:54:58.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.966+0000 7f823af889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:54:58.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.966+0000 7f823af889c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:54:58.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.966+0000 7f823af889c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:54:58.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.966+0000 7f823af889c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:54:58.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.966+0000 7f823af889c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T11:54:58.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.978+0000 7f823af889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:54:58.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.978+0000 7f823af889c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:54:58.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.978+0000 7f823af889c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:54:58.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.978+0000 7f823af889c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T11:54:58.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.978+0000 7f810ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366162 cookie 94516914137872 notifier 6162 bl.length()=911 2024-09-19T11:54:58.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.978+0000 7f810ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:54:58.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.978+0000 7f810ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:54:58.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.978+0000 7f810ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:54:58.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.978+0000 7f823af889c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T11:54:58.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.978+0000 7f823af889c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T11:54:58.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.978+0000 7f823af889c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T11:54:58.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.978+0000 7f823af889c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T11:54:58.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.982+0000 7f823af889c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.1.0 2024-09-19T11:54:58.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.982+0000 7f823af889c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.1.0 2024-09-19T11:54:58.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.982+0000 7f823af889c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.1.1 2024-09-19T11:54:58.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.982+0000 7f823af889c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.1.1 2024-09-19T11:54:58.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.982+0000 7f823af889c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.0 2024-09-19T11:54:58.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.982+0000 7f823af889c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : hit (requested=0x17, cached=0x17) 2024-09-19T11:54:58.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.982+0000 7f823af889c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T11:54:58.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.986+0000 7f823af889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:54:58.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.986+0000 7f823af889c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:54:58.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.986+0000 7f823af889c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:54:58.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.986+0000 7f823af889c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T11:54:58.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.986+0000 7f810f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366163 cookie 94516914137872 notifier 6162 bl.length()=911 2024-09-19T11:54:58.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.986+0000 7f810f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:54:58.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.986+0000 7f810f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:54:58.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.986+0000 7f810f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:54:58.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.990+0000 7f823af889c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T11:54:58.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.990+0000 7f823af889c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T11:54:58.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.990+0000 7f823af889c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T11:54:58.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.990+0000 7f823af889c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T11:54:58.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.990+0000 7f823af889c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.0 2024-09-19T11:54:58.988 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.990+0000 7f823af889c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : hit (requested=0x17, cached=0x17) 2024-09-19T11:54:58.988 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.990+0000 7f823af889c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T11:54:58.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.994+0000 7f823af889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:54:58.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.994+0000 7f823af889c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:54:58.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.994+0000 7f823af889c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:54:58.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.994+0000 7f823af889c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T11:54:58.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.994+0000 7f810f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366164 cookie 94516914137872 notifier 6162 bl.length()=879 2024-09-19T11:54:58.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.994+0000 7f810f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:54:58.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.994+0000 7f810f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:54:58.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.994+0000 7f810f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:54:58.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.998+0000 7f823af889c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T11:54:58.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.998+0000 7f823af889c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T11:54:58.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.998+0000 7f823af889c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T11:54:58.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.998+0000 7f823af889c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T11:54:58.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:58.998+0000 7f823af889c0 1 execute INFO: reshard of bucket "a-bucket" from 1 shards to 2 shards completed successfully 2024-09-19T11:54:58.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.002+0000 7f823af889c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-19T11:54:59.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.006+0000 7f823af889c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-19T11:54:59.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.006+0000 7f823af889c0 20 processing logshard = reshard.0000000007 2024-09-19T11:54:59.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.010+0000 7f823af889c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-19T11:54:59.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.010+0000 7f823af889c0 20 processing logshard = reshard.0000000008 2024-09-19T11:54:59.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.018+0000 7f823af889c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-19T11:54:59.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.018+0000 7f823af889c0 20 processing logshard = reshard.0000000009 2024-09-19T11:54:59.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.022+0000 7f823af889c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-19T11:54:59.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.022+0000 7f823af889c0 20 processing logshard = reshard.0000000010 2024-09-19T11:54:59.024 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.026+0000 7f823af889c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-19T11:54:59.024 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.026+0000 7f823af889c0 20 processing logshard = reshard.0000000011 2024-09-19T11:54:59.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.034+0000 7f823af889c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-19T11:54:59.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.034+0000 7f823af889c0 20 processing logshard = reshard.0000000012 2024-09-19T11:54:59.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.038+0000 7f823af889c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-19T11:54:59.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.038+0000 7f823af889c0 20 processing logshard = reshard.0000000013 2024-09-19T11:54:59.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.046+0000 7f823af889c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-19T11:54:59.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.046+0000 7f823af889c0 20 processing logshard = reshard.0000000014 2024-09-19T11:54:59.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.050+0000 7f823af889c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-19T11:54:59.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.050+0000 7f823af889c0 20 processing logshard = reshard.0000000015 2024-09-19T11:54:59.054 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.058+0000 7f823af889c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-19T11:54:59.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.058+0000 7f80ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:54:59.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.066+0000 7f823af889c0 20 remove_watcher() i=0 2024-09-19T11:54:59.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.066+0000 7f823af889c0 2 removed watcher, disabling cache 2024-09-19T11:54:59.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.066+0000 7f823af889c0 20 remove_watcher() i=1 2024-09-19T11:54:59.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.070+0000 7f823af889c0 20 remove_watcher() i=2 2024-09-19T11:54:59.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.074+0000 7f823af889c0 20 remove_watcher() i=3 2024-09-19T11:54:59.071 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.074+0000 7f823af889c0 20 remove_watcher() i=4 2024-09-19T11:54:59.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.078+0000 7f823af889c0 20 remove_watcher() i=5 2024-09-19T11:54:59.075 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.078+0000 7f823af889c0 20 remove_watcher() i=6 2024-09-19T11:54:59.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:54:59.082+0000 7f823af889c0 20 remove_watcher() i=7 2024-09-19T11:55:04.102 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T11:55:04.136 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:04.136 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:04.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.186+0000 7f32dfff29c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.186+0000 7f32dfff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:04.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.186+0000 7f32dfff29c0 20 realm 2024-09-19T11:55:04.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.186+0000 7f32dfff29c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.186+0000 7f32dfff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:04.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.186+0000 7f32dfff29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:04.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.186+0000 7f32dfff29c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.186+0000 7f32dfff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:04.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.186+0000 7f32dfff29c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.190+0000 7f32dfff29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:04.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.190+0000 7f32dfff29c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.190+0000 7f32dfff29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:04.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.190+0000 7f32dfff29c0 20 searching for the correct realm 2024-09-19T11:55:04.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.194+0000 7f32de2f9640 0 -- 172.21.15.120:0/3453207427 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f32d4008040 msgr2=0x7f32d4036a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:04.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.202+0000 7f32dd2f7640 0 -- 172.21.15.120:0/3453207427 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f32d00e6b60 msgr2=0x7f32d00ffed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:04.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.418+0000 7f32dfff29c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:04.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.418+0000 7f32dfff29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:04.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.418+0000 7f32dfff29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:04.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.418+0000 7f32dfff29c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:04.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.418+0000 7f32dfff29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:04.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.418+0000 7f32dfff29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:04.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.418+0000 7f32dfff29c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.418+0000 7f32dfff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:04.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.418+0000 7f32dfff29c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:04.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:04.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 20 zone default found 2024-09-19T11:55:04.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 4 Realm: () 2024-09-19T11:55:04.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:04.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:04.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:04.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 20 zonegroup default 2024-09-19T11:55:04.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:04.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:04.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:04.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 20 started sync module instance, tier type = 2024-09-19T11:55:04.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.422+0000 7f32dfff29c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:04.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.446+0000 7f32dfff29c0 20 add_watcher() i=0 2024-09-19T11:55:04.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.446+0000 7f32dfff29c0 20 add_watcher() i=1 2024-09-19T11:55:04.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.446+0000 7f32dfff29c0 20 add_watcher() i=2 2024-09-19T11:55:04.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.446+0000 7f32dfff29c0 20 add_watcher() i=3 2024-09-19T11:55:04.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.446+0000 7f32dfff29c0 20 add_watcher() i=4 2024-09-19T11:55:04.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.446+0000 7f32dfff29c0 20 add_watcher() i=5 2024-09-19T11:55:04.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.446+0000 7f32dfff29c0 20 add_watcher() i=6 2024-09-19T11:55:04.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.450+0000 7f32dfff29c0 20 add_watcher() i=7 2024-09-19T11:55:04.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.450+0000 7f32dfff29c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:04.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.454+0000 7f318f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:04.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.454+0000 7f32dfff29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:04.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.454+0000 7f32dfff29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:04.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.454+0000 7f32dfff29c0 5 note: GC not initialized 2024-09-19T11:55:04.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.458+0000 7f318e7fc640 20 reqs_thread_entry: start 2024-09-19T11:55:04.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.458+0000 7f32dfff29c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:04.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.458+0000 7f32dfff29c0 20 Filter name: none 2024-09-19T11:55:04.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.458+0000 7f30fffff640 20 reqs_thread_entry: start 2024-09-19T11:55:04.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.458+0000 7f32dfff29c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.458+0000 7f32dfff29c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T11:55:04.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.458+0000 7f32dfff29c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.458+0000 7f32dfff29c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T11:55:04.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.458+0000 7f32dfff29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:04.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.458+0000 7f32dfff29c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.462+0000 7f32dfff29c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T11:55:04.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.462+0000 7f32dfff29c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.462+0000 7f32dfff29c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T11:55:04.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.462+0000 7f32dfff29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:04.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.466+0000 7f318f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:04.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.470+0000 7f32dfff29c0 20 remove_watcher() i=0 2024-09-19T11:55:04.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.470+0000 7f32dfff29c0 2 removed watcher, disabling cache 2024-09-19T11:55:04.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.474+0000 7f32dfff29c0 20 remove_watcher() i=1 2024-09-19T11:55:04.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.474+0000 7f32dfff29c0 20 remove_watcher() i=2 2024-09-19T11:55:04.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.478+0000 7f32dfff29c0 20 remove_watcher() i=3 2024-09-19T11:55:04.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.478+0000 7f32dfff29c0 20 remove_watcher() i=4 2024-09-19T11:55:04.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.482+0000 7f32dfff29c0 20 remove_watcher() i=5 2024-09-19T11:55:04.478 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.482+0000 7f32dfff29c0 20 remove_watcher() i=6 2024-09-19T11:55:04.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.482+0000 7f32dfff29c0 20 remove_watcher() i=7 2024-09-19T11:55:04.504 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:04.504 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:04.504 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: a-bucket id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-19T11:55:04.504 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:04.504 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard add non empty bucket 2024-09-19T11:55:04.504 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:04.646 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T11:55:04.678 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:04.678 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:04.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.726+0000 7f997dce99c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.730+0000 7f997dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:04.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.730+0000 7f997dce99c0 20 realm 2024-09-19T11:55:04.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.730+0000 7f997dce99c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.730+0000 7f997dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:04.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.730+0000 7f997dce99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:04.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.730+0000 7f997dce99c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.730+0000 7f997dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:04.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.730+0000 7f997dce99c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.730+0000 7f997dce99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:04.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.730+0000 7f997dce99c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.734+0000 7f997dce99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:04.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.734+0000 7f997dce99c0 20 searching for the correct realm 2024-09-19T11:55:04.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.738+0000 7f997bff0640 0 -- 172.21.15.120:0/3618034337 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f99700fbbf0 msgr2=0x7f99700f7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:04.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.742+0000 7f997afee640 0 -- 172.21.15.120:0/3618034337 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f9974008050 msgr2=0x7f99740413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:04.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.958+0000 7f997dce99c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:04.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.958+0000 7f997dce99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:04.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.958+0000 7f997dce99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:04.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.958+0000 7f997dce99c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:04.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.958+0000 7f997dce99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:04.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.958+0000 7f997dce99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:04.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.958+0000 7f997dce99c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.958+0000 7f997dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:04.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.958+0000 7f997dce99c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.962+0000 7f997dce99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:04.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.962+0000 7f997dce99c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.962+0000 7f997dce99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:04.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.962+0000 7f997dce99c0 20 zone default found 2024-09-19T11:55:04.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.962+0000 7f997dce99c0 4 Realm: () 2024-09-19T11:55:04.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.962+0000 7f997dce99c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:04.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.962+0000 7f997dce99c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:04.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.962+0000 7f997dce99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:04.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.962+0000 7f997dce99c0 20 zonegroup default 2024-09-19T11:55:04.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.962+0000 7f997dce99c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.962+0000 7f997dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:04.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.962+0000 7f997dce99c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.962+0000 7f997dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:04.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.962+0000 7f997dce99c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.966+0000 7f997dce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:04.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.966+0000 7f997dce99c0 20 started sync module instance, tier type = 2024-09-19T11:55:04.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.966+0000 7f997dce99c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:04.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.986+0000 7f997dce99c0 20 add_watcher() i=0 2024-09-19T11:55:04.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.986+0000 7f997dce99c0 20 add_watcher() i=1 2024-09-19T11:55:04.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.986+0000 7f997dce99c0 20 add_watcher() i=2 2024-09-19T11:55:04.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.986+0000 7f997dce99c0 20 add_watcher() i=3 2024-09-19T11:55:04.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.986+0000 7f997dce99c0 20 add_watcher() i=4 2024-09-19T11:55:04.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.986+0000 7f997dce99c0 20 add_watcher() i=5 2024-09-19T11:55:04.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.986+0000 7f997dce99c0 20 add_watcher() i=6 2024-09-19T11:55:04.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.990+0000 7f997dce99c0 20 add_watcher() i=7 2024-09-19T11:55:04.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.990+0000 7f997dce99c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:04.988 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.990+0000 7f9831fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:04.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.994+0000 7f997dce99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:04.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.994+0000 7f997dce99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:04.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.994+0000 7f997dce99c0 5 note: GC not initialized 2024-09-19T11:55:04.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.994+0000 7f9830fe1640 20 reqs_thread_entry: start 2024-09-19T11:55:04.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.994+0000 7f997dce99c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:04.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.994+0000 7f997dce99c0 20 Filter name: none 2024-09-19T11:55:04.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.994+0000 7f97aa7fc640 20 reqs_thread_entry: start 2024-09-19T11:55:04.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.994+0000 7f997dce99c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.994+0000 7f997dce99c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T11:55:04.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.994+0000 7f997dce99c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.994+0000 7f997dce99c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T11:55:04.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.994+0000 7f997dce99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:04.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.994+0000 7f997dce99c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.998+0000 7f997dce99c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T11:55:04.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.998+0000 7f997dce99c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:04.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.998+0000 7f997dce99c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T11:55:04.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:04.998+0000 7f997dce99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:04.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.002+0000 7f9831fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:05.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.006+0000 7f997dce99c0 20 remove_watcher() i=0 2024-09-19T11:55:05.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.006+0000 7f997dce99c0 2 removed watcher, disabling cache 2024-09-19T11:55:05.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.010+0000 7f997dce99c0 20 remove_watcher() i=1 2024-09-19T11:55:05.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.010+0000 7f997dce99c0 20 remove_watcher() i=2 2024-09-19T11:55:05.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.014+0000 7f997dce99c0 20 remove_watcher() i=3 2024-09-19T11:55:05.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.014+0000 7f997dce99c0 20 remove_watcher() i=4 2024-09-19T11:55:05.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.018+0000 7f997dce99c0 20 remove_watcher() i=5 2024-09-19T11:55:05.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.018+0000 7f997dce99c0 20 remove_watcher() i=6 2024-09-19T11:55:05.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.018+0000 7f997dce99c0 20 remove_watcher() i=7 2024-09-19T11:55:05.030 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:05.030 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:05.030 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: a-bucket id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 num_objects: 8 size_kb: 1 num_shards: 2 2024-09-19T11:55:05.030 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:05.031 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-09-19T11:55:05.060 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:05.061 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:05.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.110+0000 7fdc5401c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.110+0000 7fdc5401c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:05.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.110+0000 7fdc5401c9c0 20 realm 2024-09-19T11:55:05.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.110+0000 7fdc5401c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.110+0000 7fdc5401c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:05.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.110+0000 7fdc5401c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:05.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.110+0000 7fdc5401c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.110+0000 7fdc5401c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:05.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.110+0000 7fdc5401c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.114+0000 7fdc5401c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:05.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.114+0000 7fdc5401c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.114+0000 7fdc5401c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:05.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.114+0000 7fdc5401c9c0 20 searching for the correct realm 2024-09-19T11:55:05.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.118+0000 7fdc52323640 0 -- 172.21.15.120:0/1821146123 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fdc3c078c20 msgr2=0x7fdc3c073870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:05.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.126+0000 7fdc51321640 0 -- 172.21.15.120:0/1821146123 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fdc4c0de040 msgr2=0x7fdc4c0df940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:05.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.342+0000 7fdc5401c9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:05.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.342+0000 7fdc5401c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:05.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.342+0000 7fdc5401c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:05.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.342+0000 7fdc5401c9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:05.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.342+0000 7fdc5401c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:05.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.342+0000 7fdc5401c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:05.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.342+0000 7fdc5401c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.342+0000 7fdc5401c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:05.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.342+0000 7fdc5401c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.346+0000 7fdc5401c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:05.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.346+0000 7fdc5401c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.346+0000 7fdc5401c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:05.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.346+0000 7fdc5401c9c0 20 zone default found 2024-09-19T11:55:05.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.346+0000 7fdc5401c9c0 4 Realm: () 2024-09-19T11:55:05.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.346+0000 7fdc5401c9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:05.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.346+0000 7fdc5401c9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:05.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.346+0000 7fdc5401c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:05.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.346+0000 7fdc5401c9c0 20 zonegroup default 2024-09-19T11:55:05.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.346+0000 7fdc5401c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.346+0000 7fdc5401c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:05.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.346+0000 7fdc5401c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.346+0000 7fdc5401c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:05.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.346+0000 7fdc5401c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.350+0000 7fdc5401c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:05.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.350+0000 7fdc5401c9c0 20 started sync module instance, tier type = 2024-09-19T11:55:05.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.350+0000 7fdc5401c9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:05.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.370+0000 7fdc5401c9c0 20 add_watcher() i=0 2024-09-19T11:55:05.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.370+0000 7fdc5401c9c0 20 add_watcher() i=1 2024-09-19T11:55:05.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.370+0000 7fdc5401c9c0 20 add_watcher() i=2 2024-09-19T11:55:05.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.370+0000 7fdc5401c9c0 20 add_watcher() i=3 2024-09-19T11:55:05.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.370+0000 7fdc5401c9c0 20 add_watcher() i=4 2024-09-19T11:55:05.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.370+0000 7fdc5401c9c0 20 add_watcher() i=5 2024-09-19T11:55:05.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.370+0000 7fdc5401c9c0 20 add_watcher() i=6 2024-09-19T11:55:05.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.374+0000 7fdc5401c9c0 20 add_watcher() i=7 2024-09-19T11:55:05.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.374+0000 7fdc5401c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:05.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.378+0000 7fdb07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:05.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.378+0000 7fdc5401c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:05.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.378+0000 7fdc5401c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:05.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.378+0000 7fdc5401c9c0 5 note: GC not initialized 2024-09-19T11:55:05.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.378+0000 7fdb06fe5640 20 reqs_thread_entry: start 2024-09-19T11:55:05.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.378+0000 7fdc5401c9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:05.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.378+0000 7fdc5401c9c0 20 Filter name: none 2024-09-19T11:55:05.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.378+0000 7fdb04fe1640 20 reqs_thread_entry: start 2024-09-19T11:55:05.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.378+0000 7fdc5401c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T11:55:05.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.378+0000 7fdc5401c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.382+0000 7fdc5401c9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T11:55:05.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.382+0000 7fdc5401c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T11:55:05.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.382+0000 7fdc5401c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T11:55:05.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.382+0000 7fdc5401c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T11:55:05.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.382+0000 7fdc5401c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.382+0000 7fdc5401c9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T11:55:05.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.382+0000 7fdc5401c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:55:05.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.382+0000 7fdc5401c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:55:05.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.382+0000 7fdc5401c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:05.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.382+0000 7fdc5401c9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:55:05.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.382+0000 7fdc5401c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T11:55:05.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.386+0000 7fdb07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:05.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.390+0000 7fdc5401c9c0 20 remove_watcher() i=0 2024-09-19T11:55:05.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.390+0000 7fdc5401c9c0 2 removed watcher, disabling cache 2024-09-19T11:55:05.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.394+0000 7fdc5401c9c0 20 remove_watcher() i=1 2024-09-19T11:55:05.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.394+0000 7fdc5401c9c0 20 remove_watcher() i=2 2024-09-19T11:55:05.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.398+0000 7fdc5401c9c0 20 remove_watcher() i=3 2024-09-19T11:55:05.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.398+0000 7fdc5401c9c0 20 remove_watcher() i=4 2024-09-19T11:55:05.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.402+0000 7fdc5401c9c0 20 remove_watcher() i=5 2024-09-19T11:55:05.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.402+0000 7fdc5401c9c0 20 remove_watcher() i=6 2024-09-19T11:55:05.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.406+0000 7fdc5401c9c0 20 remove_watcher() i=7 2024-09-19T11:55:05.417 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin reshard list 2024-09-19T11:55:05.443 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:05.443 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:05.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.490+0000 7f91c84d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.494+0000 7f91c84d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:05.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.494+0000 7f91c84d19c0 20 realm 2024-09-19T11:55:05.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.494+0000 7f91c84d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.494+0000 7f91c84d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:05.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.494+0000 7f91c84d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:05.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.494+0000 7f91c84d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.494+0000 7f91c84d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:05.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.494+0000 7f91c84d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.498+0000 7f91c84d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:05.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.498+0000 7f91c84d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.498+0000 7f91c84d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:05.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.498+0000 7f91c84d19c0 20 searching for the correct realm 2024-09-19T11:55:05.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.502+0000 7f91c5fd7640 0 -- 172.21.15.120:0/3588939240 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f91c00c8040 msgr2=0x7f91c010a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:05.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.718+0000 7f91c57d6640 0 -- 172.21.15.120:0/3588939240 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f91b8045950 msgr2=0x7f91b8021420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:55:05.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.934+0000 7f91c84d19c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:05.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.934+0000 7f91c84d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:05.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.934+0000 7f91c84d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:05.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.934+0000 7f91c84d19c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:05.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.934+0000 7f91c84d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:05.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.934+0000 7f91c84d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:05.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.934+0000 7f91c84d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.934+0000 7f91c84d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:05.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.934+0000 7f91c84d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.933 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:05.933 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:05.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 20 zone default found 2024-09-19T11:55:05.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 4 Realm: () 2024-09-19T11:55:05.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:05.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:05.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:05.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 20 zonegroup default 2024-09-19T11:55:05.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:05.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:05.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:05.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:05.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 20 started sync module instance, tier type = 2024-09-19T11:55:05.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.938+0000 7f91c84d19c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:05.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.962+0000 7f91c84d19c0 20 add_watcher() i=0 2024-09-19T11:55:05.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.962+0000 7f91c84d19c0 20 add_watcher() i=1 2024-09-19T11:55:05.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.962+0000 7f91c84d19c0 20 add_watcher() i=2 2024-09-19T11:55:05.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.962+0000 7f91c84d19c0 20 add_watcher() i=3 2024-09-19T11:55:05.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.962+0000 7f91c84d19c0 20 add_watcher() i=4 2024-09-19T11:55:05.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.962+0000 7f91c84d19c0 20 add_watcher() i=5 2024-09-19T11:55:05.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.962+0000 7f91c84d19c0 20 add_watcher() i=6 2024-09-19T11:55:05.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.966+0000 7f91c84d19c0 20 add_watcher() i=7 2024-09-19T11:55:05.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.966+0000 7f91c84d19c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:05.966 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.970+0000 7f90777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:05.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.970+0000 7f91c84d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:05.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.970+0000 7f91c84d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:05.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.970+0000 7f91c84d19c0 5 note: GC not initialized 2024-09-19T11:55:05.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.970+0000 7f90767fc640 20 reqs_thread_entry: start 2024-09-19T11:55:05.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.970+0000 7f91c84d19c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:05.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.970+0000 7f91c84d19c0 20 Filter name: none 2024-09-19T11:55:05.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.970+0000 7f8fe7fff640 20 reqs_thread_entry: start 2024-09-19T11:55:05.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.986+0000 7f90777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:05.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.990+0000 7f91c84d19c0 20 remove_watcher() i=0 2024-09-19T11:55:05.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.990+0000 7f91c84d19c0 2 removed watcher, disabling cache 2024-09-19T11:55:05.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.994+0000 7f91c84d19c0 20 remove_watcher() i=1 2024-09-19T11:55:05.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.994+0000 7f91c84d19c0 20 remove_watcher() i=2 2024-09-19T11:55:05.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.998+0000 7f91c84d19c0 20 remove_watcher() i=3 2024-09-19T11:55:05.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:05.998+0000 7f91c84d19c0 20 remove_watcher() i=4 2024-09-19T11:55:05.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.002+0000 7f91c84d19c0 20 remove_watcher() i=5 2024-09-19T11:55:05.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.002+0000 7f91c84d19c0 20 remove_watcher() i=6 2024-09-19T11:55:06.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.006+0000 7f91c84d19c0 20 remove_watcher() i=7 2024-09-19T11:55:06.016 INFO:tasks.workunit.client.0.smithi120.stderr:bucket name a-bucket 2024-09-19T11:55:06.016 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard process non empty bucket 2024-09-19T11:55:06.016 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:06.016 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin reshard process 2024-09-19T11:55:06.046 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:06.046 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:06.091 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.094+0000 7f561d1779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.098+0000 7f561d1779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:06.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.098+0000 7f561d1779c0 20 realm 2024-09-19T11:55:06.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.098+0000 7f561d1779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.098+0000 7f561d1779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:06.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.098+0000 7f561d1779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:06.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.098+0000 7f561d1779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.098+0000 7f561d1779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:06.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.098+0000 7f561d1779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.098+0000 7f561d1779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:06.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.098+0000 7f561d1779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.102+0000 7f561d1779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:06.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.102+0000 7f561d1779c0 20 searching for the correct realm 2024-09-19T11:55:06.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.106+0000 7f561b47e640 0 -- 172.21.15.120:0/1394544155 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f56040024f0 msgr2=0x7f5604042940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:06.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.110+0000 7f561a47c640 0 -- 172.21.15.120:0/1394544155 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f5614015bb0 msgr2=0x7f561404e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:06.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:06.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:06.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:06.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:06.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:06.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:06.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:06.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:06.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:06.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 zone default found 2024-09-19T11:55:06.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 4 Realm: () 2024-09-19T11:55:06.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:06.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:06.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:06.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 zonegroup default 2024-09-19T11:55:06.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:06.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.330+0000 7f561d1779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.334+0000 7f561d1779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:06.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.334+0000 7f561d1779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.334+0000 7f561d1779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:06.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.334+0000 7f561d1779c0 20 started sync module instance, tier type = 2024-09-19T11:55:06.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.334+0000 7f561d1779c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:06.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.358+0000 7f561d1779c0 20 add_watcher() i=0 2024-09-19T11:55:06.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.358+0000 7f561d1779c0 20 add_watcher() i=1 2024-09-19T11:55:06.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.358+0000 7f561d1779c0 20 add_watcher() i=2 2024-09-19T11:55:06.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.358+0000 7f561d1779c0 20 add_watcher() i=3 2024-09-19T11:55:06.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.358+0000 7f561d1779c0 20 add_watcher() i=4 2024-09-19T11:55:06.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.358+0000 7f561d1779c0 20 add_watcher() i=5 2024-09-19T11:55:06.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.358+0000 7f561d1779c0 20 add_watcher() i=6 2024-09-19T11:55:06.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.358+0000 7f561d1779c0 20 add_watcher() i=7 2024-09-19T11:55:06.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.358+0000 7f561d1779c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:06.359 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.362+0000 7f54d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:06.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.362+0000 7f561d1779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:06.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.362+0000 7f561d1779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:06.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.362+0000 7f561d1779c0 5 note: GC not initialized 2024-09-19T11:55:06.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.362+0000 7f544bfff640 20 reqs_thread_entry: start 2024-09-19T11:55:06.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.366+0000 7f561d1779c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:06.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.366+0000 7f561d1779c0 20 Filter name: none 2024-09-19T11:55:06.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.366+0000 7f5449ffb640 20 reqs_thread_entry: start 2024-09-19T11:55:06.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.366+0000 7f561d1779c0 20 processing logshard = reshard.0000000000 2024-09-19T11:55:06.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.370+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-19T11:55:06.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.370+0000 7f561d1779c0 20 processing logshard = reshard.0000000001 2024-09-19T11:55:06.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.374+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-19T11:55:06.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.374+0000 7f561d1779c0 20 processing logshard = reshard.0000000002 2024-09-19T11:55:06.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.378+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-19T11:55:06.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.378+0000 7f561d1779c0 20 processing logshard = reshard.0000000003 2024-09-19T11:55:06.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.386+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-19T11:55:06.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.386+0000 7f561d1779c0 20 processing logshard = reshard.0000000004 2024-09-19T11:55:06.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.390+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-19T11:55:06.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.390+0000 7f561d1779c0 20 processing logshard = reshard.0000000005 2024-09-19T11:55:06.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.398+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-19T11:55:06.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.398+0000 7f561d1779c0 20 processing logshard = reshard.0000000006 2024-09-19T11:55:06.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.398+0000 7f561d1779c0 20 process_entry resharding a-bucket 2024-09-19T11:55:06.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.398+0000 7f561d1779c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T11:55:06.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.398+0000 7f561d1779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.398+0000 7f561d1779c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T11:55:06.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.398+0000 7f561d1779c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-19T11:55:06.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.398+0000 7f561d1779c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T11:55:06.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.398+0000 7f561d1779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T11:55:06.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.398+0000 7f561d1779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.402+0000 7f561d1779c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T11:55:06.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.402+0000 7f561d1779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:55:06.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.402+0000 7f561d1779c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:55:06.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.402+0000 7f561d1779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:06.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.402+0000 7f561d1779c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:55:06.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.402+0000 7f561d1779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T11:55:06.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.410+0000 7f561d1779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:55:06.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.410+0000 7f561d1779c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:55:06.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.410+0000 7f561d1779c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:55:06.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.410+0000 7f561d1779c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T11:55:06.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.410+0000 7f54fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 94036409422768 notifier 6249 bl.length()=911 2024-09-19T11:55:06.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.410+0000 7f54fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:55:06.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.410+0000 7f54fdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:55:06.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.410+0000 7f54fdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:55:06.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.414+0000 7f561d1779c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T11:55:06.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.414+0000 7f561d1779c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T11:55:06.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.414+0000 7f561d1779c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T11:55:06.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.414+0000 7f561d1779c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T11:55:06.413 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.418+0000 7f561d1779c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T11:55:06.413 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.418+0000 7f561d1779c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T11:55:06.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.418+0000 7f561d1779c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T11:55:06.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.418+0000 7f561d1779c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T11:55:06.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.418+0000 7f561d1779c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T11:55:06.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.418+0000 7f561d1779c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T11:55:06.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.418+0000 7f561d1779c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.1.0 2024-09-19T11:55:06.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.418+0000 7f561d1779c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.1.0 2024-09-19T11:55:06.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.418+0000 7f561d1779c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.1.1 2024-09-19T11:55:06.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.418+0000 7f561d1779c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.1.1 2024-09-19T11:55:06.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.422+0000 7f561d1779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : hit (requested=0x17, cached=0x17) 2024-09-19T11:55:06.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.422+0000 7f561d1779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T11:55:06.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.426+0000 7f561d1779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:55:06.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.426+0000 7f561d1779c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:55:06.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.426+0000 7f561d1779c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:55:06.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.426+0000 7f561d1779c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T11:55:06.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.426+0000 7f54fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366166 cookie 94036409422768 notifier 6249 bl.length()=911 2024-09-19T11:55:06.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.426+0000 7f54fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:55:06.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.426+0000 7f54fdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:55:06.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.426+0000 7f54fdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:55:06.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.426+0000 7f561d1779c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T11:55:06.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.426+0000 7f561d1779c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T11:55:06.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.426+0000 7f561d1779c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T11:55:06.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.426+0000 7f561d1779c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T11:55:06.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.430+0000 7f561d1779c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.1.0 2024-09-19T11:55:06.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.430+0000 7f561d1779c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.1.0 2024-09-19T11:55:06.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.430+0000 7f561d1779c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.1.1 2024-09-19T11:55:06.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.430+0000 7f561d1779c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.1.1 2024-09-19T11:55:06.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.430+0000 7f561d1779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : hit (requested=0x17, cached=0x17) 2024-09-19T11:55:06.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.430+0000 7f561d1779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T11:55:06.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.434+0000 7f561d1779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:55:06.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.434+0000 7f561d1779c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:55:06.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.434+0000 7f561d1779c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:55:06.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.434+0000 7f561d1779c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T11:55:06.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.434+0000 7f54fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366167 cookie 94036409422768 notifier 6249 bl.length()=879 2024-09-19T11:55:06.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.434+0000 7f54fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T11:55:06.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.434+0000 7f54fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T11:55:06.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.434+0000 7f54fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:55:06.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.434+0000 7f561d1779c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T11:55:06.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.434+0000 7f561d1779c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T11:55:06.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.434+0000 7f561d1779c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T11:55:06.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.434+0000 7f561d1779c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T11:55:06.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.438+0000 7f561d1779c0 1 execute INFO: reshard of bucket "a-bucket" from 2 shards to 3 shards completed successfully 2024-09-19T11:55:06.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.438+0000 7f561d1779c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-19T11:55:06.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.442+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-19T11:55:06.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.442+0000 7f561d1779c0 20 processing logshard = reshard.0000000007 2024-09-19T11:55:06.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.450+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-19T11:55:06.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.450+0000 7f561d1779c0 20 processing logshard = reshard.0000000008 2024-09-19T11:55:06.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.454+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-19T11:55:06.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.454+0000 7f561d1779c0 20 processing logshard = reshard.0000000009 2024-09-19T11:55:06.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.462+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-19T11:55:06.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.462+0000 7f561d1779c0 20 processing logshard = reshard.0000000010 2024-09-19T11:55:06.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.466+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-19T11:55:06.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.466+0000 7f561d1779c0 20 processing logshard = reshard.0000000011 2024-09-19T11:55:06.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.474+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-19T11:55:06.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.474+0000 7f561d1779c0 20 processing logshard = reshard.0000000012 2024-09-19T11:55:06.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.478+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-19T11:55:06.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.478+0000 7f561d1779c0 20 processing logshard = reshard.0000000013 2024-09-19T11:55:06.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.482+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-19T11:55:06.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.482+0000 7f561d1779c0 20 processing logshard = reshard.0000000014 2024-09-19T11:55:06.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.486+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-19T11:55:06.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.486+0000 7f561d1779c0 20 processing logshard = reshard.0000000015 2024-09-19T11:55:06.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.494+0000 7f561d1779c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-19T11:55:06.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.498+0000 7f54d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:06.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.502+0000 7f561d1779c0 20 remove_watcher() i=0 2024-09-19T11:55:06.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.502+0000 7f561d1779c0 2 removed watcher, disabling cache 2024-09-19T11:55:06.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.502+0000 7f561d1779c0 20 remove_watcher() i=1 2024-09-19T11:55:06.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.506+0000 7f561d1779c0 20 remove_watcher() i=2 2024-09-19T11:55:06.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.510+0000 7f561d1779c0 20 remove_watcher() i=3 2024-09-19T11:55:06.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.510+0000 7f561d1779c0 20 remove_watcher() i=4 2024-09-19T11:55:06.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.514+0000 7f561d1779c0 20 remove_watcher() i=5 2024-09-19T11:55:06.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.514+0000 7f561d1779c0 20 remove_watcher() i=6 2024-09-19T11:55:06.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.518+0000 7f561d1779c0 20 remove_watcher() i=7 2024-09-19T11:55:06.532 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T11:55:06.562 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:06.562 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:06.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.610+0000 7f04784599c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.614+0000 7f04784599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:06.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.614+0000 7f04784599c0 20 realm 2024-09-19T11:55:06.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.614+0000 7f04784599c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.614+0000 7f04784599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:06.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.614+0000 7f04784599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:06.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.614+0000 7f04784599c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.614+0000 7f04784599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:06.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.614+0000 7f04784599c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.614+0000 7f04784599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:06.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.614+0000 7f04784599c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.614+0000 7f04784599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:06.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.614+0000 7f04784599c0 20 searching for the correct realm 2024-09-19T11:55:06.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.618+0000 7f0476760640 0 -- 172.21.15.120:0/3591818822 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f046c1072e0 msgr2=0x7f046c0fcb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:55:06.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.626+0000 7f047575e640 0 -- 172.21.15.120:0/3591818822 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f046803f410 msgr2=0x7f046803f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:06.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:06.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:06.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:06.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:06.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:06.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:06.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:06.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:06.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:06.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 zone default found 2024-09-19T11:55:06.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 4 Realm: () 2024-09-19T11:55:06.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:06.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:06.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:06.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 zonegroup default 2024-09-19T11:55:06.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:06.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.846+0000 7f04784599c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.850+0000 7f04784599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:06.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.850+0000 7f04784599c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.850+0000 7f04784599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:06.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.850+0000 7f04784599c0 20 started sync module instance, tier type = 2024-09-19T11:55:06.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.850+0000 7f04784599c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:06.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.874+0000 7f04784599c0 20 add_watcher() i=0 2024-09-19T11:55:06.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.874+0000 7f04784599c0 20 add_watcher() i=1 2024-09-19T11:55:06.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.874+0000 7f04784599c0 20 add_watcher() i=2 2024-09-19T11:55:06.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.874+0000 7f04784599c0 20 add_watcher() i=3 2024-09-19T11:55:06.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.874+0000 7f04784599c0 20 add_watcher() i=4 2024-09-19T11:55:06.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.874+0000 7f04784599c0 20 add_watcher() i=5 2024-09-19T11:55:06.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.874+0000 7f04784599c0 20 add_watcher() i=6 2024-09-19T11:55:06.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.878+0000 7f04784599c0 20 add_watcher() i=7 2024-09-19T11:55:06.872 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.878+0000 7f04784599c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:06.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.882+0000 7f03277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:06.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.882+0000 7f04784599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:06.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.882+0000 7f04784599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:06.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.882+0000 7f04784599c0 5 note: GC not initialized 2024-09-19T11:55:06.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.882+0000 7f03267fc640 20 reqs_thread_entry: start 2024-09-19T11:55:06.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.882+0000 7f04784599c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:06.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.882+0000 7f04784599c0 20 Filter name: none 2024-09-19T11:55:06.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.882+0000 7f0297fff640 20 reqs_thread_entry: start 2024-09-19T11:55:06.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.882+0000 7f04784599c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.882+0000 7f04784599c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T11:55:06.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.882+0000 7f04784599c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.886+0000 7f04784599c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T11:55:06.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.886+0000 7f04784599c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:06.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.886+0000 7f04784599c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.886+0000 7f04784599c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T11:55:06.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.886+0000 7f04784599c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:06.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.886+0000 7f04784599c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T11:55:06.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.886+0000 7f04784599c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:06.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.890+0000 7f03277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:06.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.894+0000 7f04784599c0 20 remove_watcher() i=0 2024-09-19T11:55:06.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.894+0000 7f04784599c0 2 removed watcher, disabling cache 2024-09-19T11:55:06.893 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.898+0000 7f04784599c0 20 remove_watcher() i=1 2024-09-19T11:55:06.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.898+0000 7f04784599c0 20 remove_watcher() i=2 2024-09-19T11:55:06.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.902+0000 7f04784599c0 20 remove_watcher() i=3 2024-09-19T11:55:06.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.906+0000 7f04784599c0 20 remove_watcher() i=4 2024-09-19T11:55:06.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.906+0000 7f04784599c0 20 remove_watcher() i=5 2024-09-19T11:55:06.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.906+0000 7f04784599c0 20 remove_watcher() i=6 2024-09-19T11:55:06.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:06.910+0000 7f04784599c0 20 remove_watcher() i=7 2024-09-19T11:55:06.925 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:06.925 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:06.925 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: a-bucket id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-19T11:55:06.925 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:06.925 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-19T11:55:06.925 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:07.416 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-19T11:55:07.449 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:07.449 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:07.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.498+0000 7f2d624cc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:07.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.502+0000 7f2d624cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:07.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.502+0000 7f2d624cc9c0 20 realm 2024-09-19T11:55:07.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.502+0000 7f2d624cc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:07.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.502+0000 7f2d624cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:07.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.502+0000 7f2d624cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:07.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.502+0000 7f2d624cc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:07.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.502+0000 7f2d624cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:07.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.502+0000 7f2d624cc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:07.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.502+0000 7f2d624cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:07.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.502+0000 7f2d624cc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:07.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.506+0000 7f2d624cc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:07.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.506+0000 7f2d624cc9c0 20 searching for the correct realm 2024-09-19T11:55:07.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.506+0000 7f2d607d3640 0 -- 172.21.15.120:0/2934257647 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f2d54039070 msgr2=0x7f2d5403b950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:07.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.722+0000 7f2d5f7d1640 0 -- 172.21.15.120:0/2934257647 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f2d50100250 msgr2=0x7f2d50121200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:07.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.938+0000 7f2d624cc9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:07.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.938+0000 7f2d624cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:07.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.938+0000 7f2d624cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:07.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.938+0000 7f2d624cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:07.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.938+0000 7f2d624cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:07.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.938+0000 7f2d624cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:07.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.938+0000 7f2d624cc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:07.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.942+0000 7f2d624cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:07.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.942+0000 7f2d624cc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:07.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.942+0000 7f2d624cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:07.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.942+0000 7f2d624cc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:07.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.942+0000 7f2d624cc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:07.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.942+0000 7f2d624cc9c0 20 zone default found 2024-09-19T11:55:07.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.942+0000 7f2d624cc9c0 4 Realm: () 2024-09-19T11:55:07.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.942+0000 7f2d624cc9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:07.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.942+0000 7f2d624cc9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:07.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.942+0000 7f2d624cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:07.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.942+0000 7f2d624cc9c0 20 zonegroup default 2024-09-19T11:55:07.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.942+0000 7f2d624cc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:07.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.942+0000 7f2d624cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:07.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.942+0000 7f2d624cc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:07.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.946+0000 7f2d624cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:07.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.946+0000 7f2d624cc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:07.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.946+0000 7f2d624cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:07.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.946+0000 7f2d624cc9c0 20 started sync module instance, tier type = 2024-09-19T11:55:07.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.946+0000 7f2d624cc9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:07.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.970+0000 7f2d624cc9c0 20 add_watcher() i=0 2024-09-19T11:55:07.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.970+0000 7f2d624cc9c0 20 add_watcher() i=1 2024-09-19T11:55:07.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.970+0000 7f2d624cc9c0 20 add_watcher() i=2 2024-09-19T11:55:07.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.970+0000 7f2d624cc9c0 20 add_watcher() i=3 2024-09-19T11:55:07.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.970+0000 7f2d624cc9c0 20 add_watcher() i=4 2024-09-19T11:55:07.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.970+0000 7f2d624cc9c0 20 add_watcher() i=5 2024-09-19T11:55:07.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.970+0000 7f2d624cc9c0 20 add_watcher() i=6 2024-09-19T11:55:07.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.970+0000 7f2d624cc9c0 20 add_watcher() i=7 2024-09-19T11:55:07.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.970+0000 7f2d624cc9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:07.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.974+0000 7f2c15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:07.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.974+0000 7f2d624cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:07.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.974+0000 7f2d624cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:07.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.974+0000 7f2d624cc9c0 5 note: GC not initialized 2024-09-19T11:55:07.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.978+0000 7f2c14fe1640 20 reqs_thread_entry: start 2024-09-19T11:55:07.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.978+0000 7f2d624cc9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:07.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.978+0000 7f2d624cc9c0 20 Filter name: none 2024-09-19T11:55:07.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.978+0000 7f2b8e7fc640 20 reqs_thread_entry: start 2024-09-19T11:55:07.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.978+0000 7f2d624cc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:07.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.978+0000 7f2d624cc9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:55:07.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.978+0000 7f2d624cc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:07.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.978+0000 7f2d624cc9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:55:07.976 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.978+0000 7f2d624cc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:07.976 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.978+0000 7f2d624cc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:07.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.978+0000 7f2d624cc9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:55:07.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.978+0000 7f2d624cc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:07.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.982+0000 7f2d624cc9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:55:07.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.982+0000 7f2d624cc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:07.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.982+0000 7f2c15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:07.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.986+0000 7f2d624cc9c0 20 remove_watcher() i=0 2024-09-19T11:55:07.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.986+0000 7f2d624cc9c0 2 removed watcher, disabling cache 2024-09-19T11:55:07.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.990+0000 7f2d624cc9c0 20 remove_watcher() i=1 2024-09-19T11:55:07.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.994+0000 7f2d624cc9c0 20 remove_watcher() i=2 2024-09-19T11:55:07.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.994+0000 7f2d624cc9c0 20 remove_watcher() i=3 2024-09-19T11:55:07.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.998+0000 7f2d624cc9c0 20 remove_watcher() i=4 2024-09-19T11:55:07.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:07.998+0000 7f2d624cc9c0 20 remove_watcher() i=5 2024-09-19T11:55:07.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.002+0000 7f2d624cc9c0 20 remove_watcher() i=6 2024-09-19T11:55:07.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.002+0000 7f2d624cc9c0 20 remove_watcher() i=7 2024-09-19T11:55:08.019 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:08.019 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:08.019 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-init-index id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:55:08.019 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:08.019 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-19T11:55:08.055 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:08.056 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:08.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.106+0000 7f792bd639c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.106+0000 7f792bd639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.106+0000 7f792bd639c0 20 realm 2024-09-19T11:55:08.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.106+0000 7f792bd639c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.106+0000 7f792bd639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.106+0000 7f792bd639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:08.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.106+0000 7f792bd639c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.106+0000 7f792bd639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.106+0000 7f792bd639c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.110+0000 7f792bd639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:08.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.110+0000 7f792bd639c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.110+0000 7f792bd639c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:08.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.110+0000 7f792bd639c0 20 searching for the correct realm 2024-09-19T11:55:08.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.318+0000 7f7929068640 0 -- 172.21.15.120:0/1243350888 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7f791c01f060 msgr2=0x7f791c06de00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:08.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.330+0000 7f7929068640 0 -- 172.21.15.120:0/1243350888 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7f77f4082280 msgr2=0x7f77f40846b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:08.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.346+0000 7f792bd639c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:08.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.346+0000 7f792bd639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:08.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.346+0000 7f792bd639c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:08.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.346+0000 7f792bd639c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:08.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.346+0000 7f792bd639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:08.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.346+0000 7f792bd639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:08.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.346+0000 7f792bd639c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.346+0000 7f792bd639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.346+0000 7f792bd639c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.346+0000 7f792bd639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:08.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.346+0000 7f792bd639c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.350+0000 7f792bd639c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:08.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.350+0000 7f792bd639c0 20 zone default found 2024-09-19T11:55:08.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.350+0000 7f792bd639c0 4 Realm: () 2024-09-19T11:55:08.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.350+0000 7f792bd639c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:08.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.350+0000 7f792bd639c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:08.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.350+0000 7f792bd639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:08.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.350+0000 7f792bd639c0 20 zonegroup default 2024-09-19T11:55:08.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.350+0000 7f792bd639c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.350+0000 7f792bd639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.350+0000 7f792bd639c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.350+0000 7f792bd639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.350+0000 7f792bd639c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.350+0000 7f792bd639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.350+0000 7f792bd639c0 20 started sync module instance, tier type = 2024-09-19T11:55:08.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.350+0000 7f792bd639c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:08.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.374+0000 7f792bd639c0 20 add_watcher() i=0 2024-09-19T11:55:08.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.374+0000 7f792bd639c0 20 add_watcher() i=1 2024-09-19T11:55:08.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.374+0000 7f792bd639c0 20 add_watcher() i=2 2024-09-19T11:55:08.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.374+0000 7f792bd639c0 20 add_watcher() i=3 2024-09-19T11:55:08.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.374+0000 7f792bd639c0 20 add_watcher() i=4 2024-09-19T11:55:08.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.374+0000 7f792bd639c0 20 add_watcher() i=5 2024-09-19T11:55:08.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.374+0000 7f792bd639c0 20 add_watcher() i=6 2024-09-19T11:55:08.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.378+0000 7f792bd639c0 20 add_watcher() i=7 2024-09-19T11:55:08.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.378+0000 7f792bd639c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:08.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.382+0000 7f77db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:08.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.382+0000 7f792bd639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:08.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.382+0000 7f792bd639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:08.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.382+0000 7f792bd639c0 5 note: GC not initialized 2024-09-19T11:55:08.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.382+0000 7f77da7fc640 20 reqs_thread_entry: start 2024-09-19T11:55:08.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.382+0000 7f792bd639c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:08.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.386+0000 7f792bd639c0 20 Filter name: none 2024-09-19T11:55:08.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.386+0000 7f774bfff640 20 reqs_thread_entry: start 2024-09-19T11:55:08.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.386+0000 7f792bd639c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-19T11:55:08.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.386+0000 7f792bd639c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.386+0000 7f792bd639c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:55:08.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.386+0000 7f792bd639c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-19T11:55:08.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.386+0000 7f792bd639c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-19T11:55:08.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.386+0000 7f792bd639c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 : miss 2024-09-19T11:55:08.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.386+0000 7f792bd639c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.386+0000 7f792bd639c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:55:08.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.386+0000 7f792bd639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 info.flags=0x17 2024-09-19T11:55:08.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.386+0000 7f792bd639c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 to cache LRU end 2024-09-19T11:55:08.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.386+0000 7f792bd639c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:08.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.386+0000 7f792bd639c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:08.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.386+0000 7f792bd639c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 2024-09-19T11:55:08.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.390+0000 7f792bd639c0 -1 Injecting error=-5 at location=init_index 2024-09-19T11:55:08.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.390+0000 7f792bd639c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-19T11:55:08.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.394+0000 7f77db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:08.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.398+0000 7f792bd639c0 20 remove_watcher() i=0 2024-09-19T11:55:08.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.398+0000 7f792bd639c0 2 removed watcher, disabling cache 2024-09-19T11:55:08.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.402+0000 7f792bd639c0 20 remove_watcher() i=1 2024-09-19T11:55:08.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.402+0000 7f792bd639c0 20 remove_watcher() i=2 2024-09-19T11:55:08.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.406+0000 7f792bd639c0 20 remove_watcher() i=3 2024-09-19T11:55:08.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.406+0000 7f792bd639c0 20 remove_watcher() i=4 2024-09-19T11:55:08.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.410+0000 7f792bd639c0 20 remove_watcher() i=5 2024-09-19T11:55:08.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.410+0000 7f792bd639c0 20 remove_watcher() i=6 2024-09-19T11:55:08.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.414+0000 7f792bd639c0 20 remove_watcher() i=7 2024-09-19T11:55:08.433 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-19T11:55:08.466 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:08.466 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:08.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.514+0000 7f74472689c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.518+0000 7f74472689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.518+0000 7f74472689c0 20 realm 2024-09-19T11:55:08.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.518+0000 7f74472689c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.518+0000 7f74472689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.518+0000 7f74472689c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:08.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.518+0000 7f74472689c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.518+0000 7f74472689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.518+0000 7f74472689c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.522+0000 7f74472689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:08.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.522+0000 7f74472689c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.522+0000 7f74472689c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:08.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.522+0000 7f74472689c0 20 searching for the correct realm 2024-09-19T11:55:08.521 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.526+0000 7f744556f640 0 -- 172.21.15.120:0/2822359561 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f7438109c20 msgr2=0x7f743810ce30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:08.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.534+0000 7f744456d640 0 -- 172.21.15.120:0/2822359561 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f7434022400 msgr2=0x7f7434022880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:08.748 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.750+0000 7f74472689c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:08.748 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.750+0000 7f74472689c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:08.748 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.750+0000 7f74472689c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:08.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.750+0000 7f74472689c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:08.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.750+0000 7f74472689c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:08.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.750+0000 7f74472689c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:08.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.750+0000 7f74472689c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:08.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:08.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 20 zone default found 2024-09-19T11:55:08.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 4 Realm: () 2024-09-19T11:55:08.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:08.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:08.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:08.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 20 zonegroup default 2024-09-19T11:55:08.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.754+0000 7f74472689c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.758+0000 7f74472689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.758+0000 7f74472689c0 20 started sync module instance, tier type = 2024-09-19T11:55:08.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.758+0000 7f74472689c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:08.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.778+0000 7f74472689c0 20 add_watcher() i=0 2024-09-19T11:55:08.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.778+0000 7f74472689c0 20 add_watcher() i=1 2024-09-19T11:55:08.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.778+0000 7f74472689c0 20 add_watcher() i=2 2024-09-19T11:55:08.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.778+0000 7f74472689c0 20 add_watcher() i=3 2024-09-19T11:55:08.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.778+0000 7f74472689c0 20 add_watcher() i=4 2024-09-19T11:55:08.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.778+0000 7f74472689c0 20 add_watcher() i=5 2024-09-19T11:55:08.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.782+0000 7f74472689c0 20 add_watcher() i=6 2024-09-19T11:55:08.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.782+0000 7f74472689c0 20 add_watcher() i=7 2024-09-19T11:55:08.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.782+0000 7f74472689c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:08.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.786+0000 7f72fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:08.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.786+0000 7f74472689c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:08.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.786+0000 7f74472689c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:08.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.786+0000 7f74472689c0 5 note: GC not initialized 2024-09-19T11:55:08.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.786+0000 7f72f9fe3640 20 reqs_thread_entry: start 2024-09-19T11:55:08.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.786+0000 7f74472689c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:08.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.786+0000 7f74472689c0 20 Filter name: none 2024-09-19T11:55:08.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.786+0000 7f726b7fe640 20 reqs_thread_entry: start 2024-09-19T11:55:08.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.790+0000 7f74472689c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.790+0000 7f74472689c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:55:08.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.790+0000 7f74472689c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.790+0000 7f74472689c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:55:08.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.790+0000 7f74472689c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:08.787 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.790+0000 7f74472689c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.787 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.790+0000 7f74472689c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:55:08.787 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.790+0000 7f74472689c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.790+0000 7f74472689c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:55:08.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.790+0000 7f74472689c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:08.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.794+0000 7f72fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:08.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.798+0000 7f74472689c0 20 remove_watcher() i=0 2024-09-19T11:55:08.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.798+0000 7f74472689c0 2 removed watcher, disabling cache 2024-09-19T11:55:08.798 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.802+0000 7f74472689c0 20 remove_watcher() i=1 2024-09-19T11:55:08.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.802+0000 7f74472689c0 20 remove_watcher() i=2 2024-09-19T11:55:08.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.806+0000 7f74472689c0 20 remove_watcher() i=3 2024-09-19T11:55:08.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.810+0000 7f74472689c0 20 remove_watcher() i=4 2024-09-19T11:55:08.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.810+0000 7f74472689c0 20 remove_watcher() i=5 2024-09-19T11:55:08.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.810+0000 7f74472689c0 20 remove_watcher() i=6 2024-09-19T11:55:08.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.814+0000 7f74472689c0 20 remove_watcher() i=7 2024-09-19T11:55:08.826 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:08.827 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:08.827 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-init-index id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:55:08.827 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:08.885 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:55:08.920 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:08.920 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:08.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.970+0000 7f924fbf49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.970+0000 7f924fbf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.970+0000 7f924fbf49c0 20 realm 2024-09-19T11:55:08.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.970+0000 7f924fbf49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.970+0000 7f924fbf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.970+0000 7f924fbf49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:08.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.970+0000 7f924fbf49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.970+0000 7f924fbf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:08.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.970+0000 7f924fbf49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.974+0000 7f924fbf49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:08.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.974+0000 7f924fbf49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:08.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.974+0000 7f924fbf49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:08.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.974+0000 7f924fbf49c0 20 searching for the correct realm 2024-09-19T11:55:08.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:08.978+0000 7f924d6fa640 0 -- 172.21.15.120:0/2547027102 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f92480e6070 msgr2=0x7f92480d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:55:09.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.194+0000 7f924cef9640 0 -- 172.21.15.120:0/2547027102 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f9240044920 msgr2=0x7f92400253f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:09.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.410+0000 7f924fbf49c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:09.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.410+0000 7f924fbf49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:09.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.410+0000 7f924fbf49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:09.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.410+0000 7f924fbf49c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:09.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.410+0000 7f924fbf49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:09.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.410+0000 7f924fbf49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:09.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.410+0000 7f924fbf49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:09.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.410+0000 7f924fbf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:09.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.410+0000 7f924fbf49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:09.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.410+0000 7f924fbf49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:09.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.410+0000 7f924fbf49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:09.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.414+0000 7f924fbf49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:09.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.414+0000 7f924fbf49c0 20 zone default found 2024-09-19T11:55:09.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.414+0000 7f924fbf49c0 4 Realm: () 2024-09-19T11:55:09.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.414+0000 7f924fbf49c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:09.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.414+0000 7f924fbf49c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:09.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.414+0000 7f924fbf49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:09.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.414+0000 7f924fbf49c0 20 zonegroup default 2024-09-19T11:55:09.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.414+0000 7f924fbf49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:09.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.414+0000 7f924fbf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:09.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.414+0000 7f924fbf49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:09.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.414+0000 7f924fbf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:09.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.414+0000 7f924fbf49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:09.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.414+0000 7f924fbf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:09.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.414+0000 7f924fbf49c0 20 started sync module instance, tier type = 2024-09-19T11:55:09.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.414+0000 7f924fbf49c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:09.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.442+0000 7f924fbf49c0 20 add_watcher() i=0 2024-09-19T11:55:09.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.442+0000 7f924fbf49c0 20 add_watcher() i=1 2024-09-19T11:55:09.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.442+0000 7f924fbf49c0 20 add_watcher() i=2 2024-09-19T11:55:09.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.442+0000 7f924fbf49c0 20 add_watcher() i=3 2024-09-19T11:55:09.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.442+0000 7f924fbf49c0 20 add_watcher() i=4 2024-09-19T11:55:09.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.442+0000 7f924fbf49c0 20 add_watcher() i=5 2024-09-19T11:55:09.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.442+0000 7f924fbf49c0 20 add_watcher() i=6 2024-09-19T11:55:09.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.442+0000 7f924fbf49c0 20 add_watcher() i=7 2024-09-19T11:55:09.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.442+0000 7f924fbf49c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:09.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.446+0000 7f91037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:09.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.446+0000 7f924fbf49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:09.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.446+0000 7f924fbf49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:09.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 5 note: GC not initialized 2024-09-19T11:55:09.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f91027e4640 20 reqs_thread_entry: start 2024-09-19T11:55:09.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:09.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 20 Filter name: none 2024-09-19T11:55:09.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f9073fff640 20 reqs_thread_entry: start 2024-09-19T11:55:09.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-19T11:55:09.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:09.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:55:09.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-19T11:55:09.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-19T11:55:09.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 : miss 2024-09-19T11:55:09.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:09.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:55:09.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 info.flags=0x17 2024-09-19T11:55:09.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 to cache LRU end 2024-09-19T11:55:09.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:09.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:09.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.450+0000 7f924fbf49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 2024-09-19T11:55:09.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.458+0000 7f924fbf49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 info.flags=0x17 2024-09-19T11:55:09.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.458+0000 7f924fbf49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 to cache LRU end 2024-09-19T11:55:09.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.458+0000 7f924fbf49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:09.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.458+0000 7f924fbf49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20, ofs0, ns] 2024-09-19T11:55:09.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.458+0000 7f9130ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366194 cookie 93936229681984 notifier 5963 bl.length()=995 2024-09-19T11:55:09.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.458+0000 7f9130ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 info.flags=0x17 2024-09-19T11:55:09.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.458+0000 7f9130ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 to cache LRU end 2024-09-19T11:55:09.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.458+0000 7f9130ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:09.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.458+0000 7f924fbf49c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20]): orig_sources= new_sources= 2024-09-19T11:55:09.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.458+0000 7f924fbf49c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20]): potential sources added=[] removed=[] 2024-09-19T11:55:09.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.458+0000 7f924fbf49c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20]): orig_dests= new_dests= 2024-09-19T11:55:09.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.458+0000 7f924fbf49c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20]): potential dests added=[] removed=[] 2024-09-19T11:55:09.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.466+0000 7f924fbf49c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20.1.0 2024-09-19T11:55:09.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.466+0000 7f924fbf49c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20.1.0 2024-09-19T11:55:09.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.466+0000 7f924fbf49c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20.1.1 2024-09-19T11:55:09.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.466+0000 7f924fbf49c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20.1.1 2024-09-19T11:55:09.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.466+0000 7f924fbf49c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20.0 2024-09-19T11:55:09.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.470+0000 7f924fbf49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 : hit (requested=0x17, cached=0x17) 2024-09-19T11:55:09.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.470+0000 7f924fbf49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 2024-09-19T11:55:09.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.474+0000 7f924fbf49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 info.flags=0x17 2024-09-19T11:55:09.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.474+0000 7f924fbf49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 to cache LRU end 2024-09-19T11:55:09.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.474+0000 7f924fbf49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:09.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.474+0000 7f924fbf49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20, ofs0, ns] 2024-09-19T11:55:09.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.474+0000 7f911ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366195 cookie 93936229681984 notifier 5963 bl.length()=995 2024-09-19T11:55:09.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.474+0000 7f911ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 info.flags=0x17 2024-09-19T11:55:09.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.474+0000 7f911ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 to cache LRU end 2024-09-19T11:55:09.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.474+0000 7f911ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:09.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.474+0000 7f924fbf49c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20]): orig_sources= new_sources= 2024-09-19T11:55:09.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.474+0000 7f924fbf49c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20]): potential sources added=[] removed=[] 2024-09-19T11:55:09.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.474+0000 7f924fbf49c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20]): orig_dests= new_dests= 2024-09-19T11:55:09.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.474+0000 7f924fbf49c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20]): potential dests added=[] removed=[] 2024-09-19T11:55:09.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.474+0000 7f924fbf49c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20.0 2024-09-19T11:55:09.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.478+0000 7f924fbf49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 : hit (requested=0x17, cached=0x17) 2024-09-19T11:55:09.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.478+0000 7f924fbf49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 2024-09-19T11:55:09.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.478+0000 7f924fbf49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 info.flags=0x17 2024-09-19T11:55:09.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.478+0000 7f924fbf49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 to cache LRU end 2024-09-19T11:55:09.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.478+0000 7f924fbf49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:09.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.478+0000 7f924fbf49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20, ofs0, ns] 2024-09-19T11:55:09.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.478+0000 7f9130ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366196 cookie 93936229681984 notifier 5963 bl.length()=963 2024-09-19T11:55:09.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.478+0000 7f9130ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 info.flags=0x17 2024-09-19T11:55:09.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.478+0000 7f9130ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 to cache LRU end 2024-09-19T11:55:09.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.478+0000 7f9130ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:09.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.478+0000 7f924fbf49c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20]): orig_sources= new_sources= 2024-09-19T11:55:09.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.478+0000 7f924fbf49c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20]): potential sources added=[] removed=[] 2024-09-19T11:55:09.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.478+0000 7f924fbf49c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20]): orig_dests= new_dests= 2024-09-19T11:55:09.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.478+0000 7f924fbf49c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20]): potential dests added=[] removed=[] 2024-09-19T11:55:09.478 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.482+0000 7f924fbf49c0 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-19T11:55:09.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.486+0000 7f91037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:09.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.490+0000 7f924fbf49c0 20 remove_watcher() i=0 2024-09-19T11:55:09.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.490+0000 7f924fbf49c0 2 removed watcher, disabling cache 2024-09-19T11:55:09.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.494+0000 7f924fbf49c0 20 remove_watcher() i=1 2024-09-19T11:55:09.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.498+0000 7f924fbf49c0 20 remove_watcher() i=2 2024-09-19T11:55:09.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.498+0000 7f924fbf49c0 20 remove_watcher() i=3 2024-09-19T11:55:09.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.502+0000 7f924fbf49c0 20 remove_watcher() i=4 2024-09-19T11:55:09.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.502+0000 7f924fbf49c0 20 remove_watcher() i=5 2024-09-19T11:55:09.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.506+0000 7f924fbf49c0 20 remove_watcher() i=6 2024-09-19T11:55:09.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.506+0000 7f924fbf49c0 20 remove_watcher() i=7 2024-09-19T11:55:09.520 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-19T11:55:09.551 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:09.551 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:09.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.598+0000 7f67ad0d49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:09.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.806+0000 7f67ad0d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:09.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.806+0000 7f67ad0d49c0 20 realm 2024-09-19T11:55:09.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.806+0000 7f67ad0d49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:09.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.806+0000 7f67ad0d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:09.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.806+0000 7f67ad0d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:09.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.806+0000 7f67ad0d49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:09.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.806+0000 7f67ad0d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:09.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.806+0000 7f67ad0d49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:09.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.810+0000 7f67ad0d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:09.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.810+0000 7f67ad0d49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:09.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.814+0000 7f67ad0d49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:09.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.814+0000 7f67ad0d49c0 20 searching for the correct realm 2024-09-19T11:55:09.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:09.814+0000 7f67aa3d9640 0 -- 172.21.15.120:0/2587405925 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7f679c01c400 msgr2=0x7f679c01c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:55:10.023 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.026+0000 7f67ab3db640 0 -- 172.21.15.120:0/2587405925 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f67a0010040 msgr2=0x7f67a001e7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:10.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:10.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:10.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:10.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:10.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:10.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:10.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:10.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:10.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:10.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 zone default found 2024-09-19T11:55:10.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 4 Realm: () 2024-09-19T11:55:10.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:10.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:10.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:10.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 zonegroup default 2024-09-19T11:55:10.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:10.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.046+0000 7f67ad0d49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.050+0000 7f67ad0d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:10.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.050+0000 7f67ad0d49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.050+0000 7f67ad0d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:10.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.050+0000 7f67ad0d49c0 20 started sync module instance, tier type = 2024-09-19T11:55:10.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.050+0000 7f67ad0d49c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:10.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.074+0000 7f67ad0d49c0 20 add_watcher() i=0 2024-09-19T11:55:10.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.074+0000 7f67ad0d49c0 20 add_watcher() i=1 2024-09-19T11:55:10.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.074+0000 7f67ad0d49c0 20 add_watcher() i=2 2024-09-19T11:55:10.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.074+0000 7f67ad0d49c0 20 add_watcher() i=3 2024-09-19T11:55:10.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.074+0000 7f67ad0d49c0 20 add_watcher() i=4 2024-09-19T11:55:10.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.074+0000 7f67ad0d49c0 20 add_watcher() i=5 2024-09-19T11:55:10.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.074+0000 7f67ad0d49c0 20 add_watcher() i=6 2024-09-19T11:55:10.076 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.078+0000 7f67ad0d49c0 20 add_watcher() i=7 2024-09-19T11:55:10.076 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.078+0000 7f67ad0d49c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:10.080 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.082+0000 7f66617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:10.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.086+0000 7f67ad0d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:10.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.086+0000 7f67ad0d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:10.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.086+0000 7f67ad0d49c0 5 note: GC not initialized 2024-09-19T11:55:10.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.086+0000 7f65dbfff640 20 reqs_thread_entry: start 2024-09-19T11:55:10.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.086+0000 7f67ad0d49c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:10.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.086+0000 7f67ad0d49c0 20 Filter name: none 2024-09-19T11:55:10.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.086+0000 7f65d9ffb640 20 reqs_thread_entry: start 2024-09-19T11:55:10.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.086+0000 7f67ad0d49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.086+0000 7f67ad0d49c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:55:10.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.086+0000 7f67ad0d49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.084 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.086+0000 7f67ad0d49c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:55:10.084 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.086+0000 7f67ad0d49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:10.084 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.086+0000 7f67ad0d49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.090+0000 7f67ad0d49c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:55:10.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.090+0000 7f67ad0d49c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.090+0000 7f67ad0d49c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:55:10.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.090+0000 7f67ad0d49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:10.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.094+0000 7f66617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:10.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.098+0000 7f67ad0d49c0 20 remove_watcher() i=0 2024-09-19T11:55:10.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.098+0000 7f67ad0d49c0 2 removed watcher, disabling cache 2024-09-19T11:55:10.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.098+0000 7f67ad0d49c0 20 remove_watcher() i=1 2024-09-19T11:55:10.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.106+0000 7f67ad0d49c0 20 remove_watcher() i=2 2024-09-19T11:55:10.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.106+0000 7f67ad0d49c0 20 remove_watcher() i=3 2024-09-19T11:55:10.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.110+0000 7f67ad0d49c0 20 remove_watcher() i=4 2024-09-19T11:55:10.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.110+0000 7f67ad0d49c0 20 remove_watcher() i=5 2024-09-19T11:55:10.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.110+0000 7f67ad0d49c0 20 remove_watcher() i=6 2024-09-19T11:55:10.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.114+0000 7f67ad0d49c0 20 remove_watcher() i=7 2024-09-19T11:55:10.130 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:10.130 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:10.130 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-init-index id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T11:55:10.130 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:10.218 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-19T11:55:10.219 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:10.677 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-19T11:55:10.710 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:10.711 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:10.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.762+0000 7faef491d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.762+0000 7faef491d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:10.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.762+0000 7faef491d9c0 20 realm 2024-09-19T11:55:10.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.762+0000 7faef491d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.762+0000 7faef491d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:10.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.762+0000 7faef491d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:10.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.762+0000 7faef491d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.762+0000 7faef491d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:10.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.762+0000 7faef491d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.766+0000 7faef491d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:10.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.766+0000 7faef491d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.766+0000 7faef491d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:10.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.766+0000 7faef491d9c0 20 searching for the correct realm 2024-09-19T11:55:10.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.770+0000 7faef2c24640 0 -- 172.21.15.120:0/4101023620 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7faedc01f060 msgr2=0x7faedc066030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:10.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.778+0000 7faef1c22640 0 -- 172.21.15.120:0/4101023620 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7faee40d0400 msgr2=0x7faee40d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:10.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.994+0000 7faef491d9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:10.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.994+0000 7faef491d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:10.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.994+0000 7faef491d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:10.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.994+0000 7faef491d9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:10.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.994+0000 7faef491d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:10.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.994+0000 7faef491d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:10.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.994+0000 7faef491d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.994+0000 7faef491d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:10.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.994+0000 7faef491d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:10.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:10.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 20 zone default found 2024-09-19T11:55:10.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 4 Realm: () 2024-09-19T11:55:10.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:10.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:10.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:10.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 20 zonegroup default 2024-09-19T11:55:10.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:10.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:10.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:10.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:10.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 20 started sync module instance, tier type = 2024-09-19T11:55:10.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:10.998+0000 7faef491d9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:11.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.022+0000 7faef491d9c0 20 add_watcher() i=0 2024-09-19T11:55:11.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.022+0000 7faef491d9c0 20 add_watcher() i=1 2024-09-19T11:55:11.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.022+0000 7faef491d9c0 20 add_watcher() i=2 2024-09-19T11:55:11.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.022+0000 7faef491d9c0 20 add_watcher() i=3 2024-09-19T11:55:11.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.022+0000 7faef491d9c0 20 add_watcher() i=4 2024-09-19T11:55:11.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.022+0000 7faef491d9c0 20 add_watcher() i=5 2024-09-19T11:55:11.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.022+0000 7faef491d9c0 20 add_watcher() i=6 2024-09-19T11:55:11.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.026+0000 7faef491d9c0 20 add_watcher() i=7 2024-09-19T11:55:11.022 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.026+0000 7faef491d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:11.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.030+0000 7fada8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:11.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.030+0000 7faef491d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:11.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.030+0000 7faef491d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:11.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.030+0000 7faef491d9c0 5 note: GC not initialized 2024-09-19T11:55:11.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.030+0000 7fad237fe640 20 reqs_thread_entry: start 2024-09-19T11:55:11.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.030+0000 7faef491d9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:11.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.030+0000 7faef491d9c0 20 Filter name: none 2024-09-19T11:55:11.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.030+0000 7fad217fa640 20 reqs_thread_entry: start 2024-09-19T11:55:11.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.030+0000 7faef491d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.034+0000 7faef491d9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:55:11.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.034+0000 7faef491d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.034+0000 7faef491d9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:55:11.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.034+0000 7faef491d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:11.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.034+0000 7faef491d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.038+0000 7faef491d9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:55:11.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.038+0000 7faef491d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.038+0000 7faef491d9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:55:11.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.038+0000 7faef491d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:11.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.042+0000 7fada8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:11.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.046+0000 7faef491d9c0 20 remove_watcher() i=0 2024-09-19T11:55:11.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.046+0000 7faef491d9c0 2 removed watcher, disabling cache 2024-09-19T11:55:11.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.050+0000 7faef491d9c0 20 remove_watcher() i=1 2024-09-19T11:55:11.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.050+0000 7faef491d9c0 20 remove_watcher() i=2 2024-09-19T11:55:11.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.054+0000 7faef491d9c0 20 remove_watcher() i=3 2024-09-19T11:55:11.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.054+0000 7faef491d9c0 20 remove_watcher() i=4 2024-09-19T11:55:11.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.058+0000 7faef491d9c0 20 remove_watcher() i=5 2024-09-19T11:55:11.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.058+0000 7faef491d9c0 20 remove_watcher() i=6 2024-09-19T11:55:11.057 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.062+0000 7faef491d9c0 20 remove_watcher() i=7 2024-09-19T11:55:11.074 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:11.074 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:11.074 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-init-index id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:55:11.074 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:11.074 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-19T11:55:11.109 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:11.109 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:11.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.158+0000 7fa3472609c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.162+0000 7fa3472609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:11.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.162+0000 7fa3472609c0 20 realm 2024-09-19T11:55:11.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.162+0000 7fa3472609c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.162+0000 7fa3472609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:11.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.162+0000 7fa3472609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:11.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.162+0000 7fa3472609c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.162+0000 7fa3472609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:11.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.162+0000 7fa3472609c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.162+0000 7fa3472609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:11.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.162+0000 7fa3472609c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.162+0000 7fa3472609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:11.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.162+0000 7fa3472609c0 20 searching for the correct realm 2024-09-19T11:55:11.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.166+0000 7fa344565640 0 -- 172.21.15.120:0/20117880 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7fa32c070160 msgr2=0x7fa32c06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:11.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.382+0000 7fa345567640 0 -- 172.21.15.120:0/20117880 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fa3340c2070 msgr2=0x7fa3340eaab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:11.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.398+0000 7fa3472609c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:11.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.398+0000 7fa3472609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:11.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.398+0000 7fa3472609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:11.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.398+0000 7fa3472609c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:11.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.398+0000 7fa3472609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:11.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.398+0000 7fa3472609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:11.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.398+0000 7fa3472609c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.398+0000 7fa3472609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:11.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.398+0000 7fa3472609c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.398+0000 7fa3472609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:11.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.398+0000 7fa3472609c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.402+0000 7fa3472609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:11.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.402+0000 7fa3472609c0 20 zone default found 2024-09-19T11:55:11.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.402+0000 7fa3472609c0 4 Realm: () 2024-09-19T11:55:11.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.402+0000 7fa3472609c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:11.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.402+0000 7fa3472609c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:11.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.402+0000 7fa3472609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:11.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.402+0000 7fa3472609c0 20 zonegroup default 2024-09-19T11:55:11.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.402+0000 7fa3472609c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.402+0000 7fa3472609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:11.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.402+0000 7fa3472609c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.402+0000 7fa3472609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:11.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.402+0000 7fa3472609c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.402+0000 7fa3472609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:11.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.402+0000 7fa3472609c0 20 started sync module instance, tier type = 2024-09-19T11:55:11.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.402+0000 7fa3472609c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:11.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.426+0000 7fa3472609c0 20 add_watcher() i=0 2024-09-19T11:55:11.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.426+0000 7fa3472609c0 20 add_watcher() i=1 2024-09-19T11:55:11.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.426+0000 7fa3472609c0 20 add_watcher() i=2 2024-09-19T11:55:11.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.426+0000 7fa3472609c0 20 add_watcher() i=3 2024-09-19T11:55:11.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.426+0000 7fa3472609c0 20 add_watcher() i=4 2024-09-19T11:55:11.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.426+0000 7fa3472609c0 20 add_watcher() i=5 2024-09-19T11:55:11.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.426+0000 7fa3472609c0 20 add_watcher() i=6 2024-09-19T11:55:11.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.426+0000 7fa3472609c0 20 add_watcher() i=7 2024-09-19T11:55:11.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.426+0000 7fa3472609c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:11.428 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.430+0000 7fa1fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:11.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.434+0000 7fa3472609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:11.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.434+0000 7fa3472609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:11.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.434+0000 7fa3472609c0 5 note: GC not initialized 2024-09-19T11:55:11.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.434+0000 7fa1f97e2640 20 reqs_thread_entry: start 2024-09-19T11:55:11.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.434+0000 7fa3472609c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:11.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.434+0000 7fa3472609c0 20 Filter name: none 2024-09-19T11:55:11.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.434+0000 7fa1f27fc640 20 reqs_thread_entry: start 2024-09-19T11:55:11.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.434+0000 7fa3472609c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-19T11:55:11.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.434+0000 7fa3472609c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.434+0000 7fa3472609c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:55:11.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.434+0000 7fa3472609c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-19T11:55:11.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.434+0000 7fa3472609c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-19T11:55:11.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.434+0000 7fa3472609c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 : miss 2024-09-19T11:55:11.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.434+0000 7fa3472609c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.438+0000 7fa3472609c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:55:11.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.438+0000 7fa3472609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 info.flags=0x17 2024-09-19T11:55:11.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.438+0000 7fa3472609c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 to cache LRU end 2024-09-19T11:55:11.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.438+0000 7fa3472609c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:11.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.438+0000 7fa3472609c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:11.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.438+0000 7fa3472609c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 2024-09-19T11:55:11.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.438+0000 7fa3472609c0 -1 Injecting error=-95 at location=init_index 2024-09-19T11:55:11.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.438+0000 7fa3472609c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-19T11:55:11.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.446+0000 7fa3472609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 info.flags=0x17 2024-09-19T11:55:11.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.446+0000 7fa3472609c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 to cache LRU end 2024-09-19T11:55:11.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.446+0000 7fa3472609c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:11.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.446+0000 7fa3472609c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21, ofs0, ns] 2024-09-19T11:55:11.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.446+0000 7fa222ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366199 cookie 94574905107376 notifier 6011 bl.length()=995 2024-09-19T11:55:11.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.446+0000 7fa222ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 info.flags=0x17 2024-09-19T11:55:11.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.446+0000 7fa222ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 to cache LRU end 2024-09-19T11:55:11.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.446+0000 7fa222ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:11.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.446+0000 7fa3472609c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21]): orig_sources= new_sources= 2024-09-19T11:55:11.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.446+0000 7fa3472609c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21]): potential sources added=[] removed=[] 2024-09-19T11:55:11.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.446+0000 7fa3472609c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21]): orig_dests= new_dests= 2024-09-19T11:55:11.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.446+0000 7fa3472609c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21]): potential dests added=[] removed=[] 2024-09-19T11:55:11.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.450+0000 7fa3472609c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21.1.0 2024-09-19T11:55:11.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.450+0000 7fa3472609c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21.1.0 2024-09-19T11:55:11.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.450+0000 7fa3472609c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21.1.1 2024-09-19T11:55:11.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.450+0000 7fa3472609c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21.1.1 2024-09-19T11:55:11.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.450+0000 7fa3472609c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21.0 2024-09-19T11:55:11.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.454+0000 7fa3472609c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 : hit (requested=0x17, cached=0x17) 2024-09-19T11:55:11.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.454+0000 7fa3472609c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 2024-09-19T11:55:11.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.458+0000 7fa3472609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 info.flags=0x17 2024-09-19T11:55:11.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.458+0000 7fa3472609c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 to cache LRU end 2024-09-19T11:55:11.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.458+0000 7fa3472609c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:11.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.458+0000 7fa3472609c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21, ofs0, ns] 2024-09-19T11:55:11.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.458+0000 7fa2227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366200 cookie 94574905107376 notifier 6011 bl.length()=963 2024-09-19T11:55:11.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.458+0000 7fa2227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 info.flags=0x17 2024-09-19T11:55:11.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.458+0000 7fa2227fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 to cache LRU end 2024-09-19T11:55:11.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.458+0000 7fa2227fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:11.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.458+0000 7fa3472609c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21]): orig_sources= new_sources= 2024-09-19T11:55:11.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.458+0000 7fa3472609c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21]): potential sources added=[] removed=[] 2024-09-19T11:55:11.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.458+0000 7fa3472609c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21]): orig_dests= new_dests= 2024-09-19T11:55:11.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.458+0000 7fa3472609c0 20 handle_bi_update(): bucket=:error-at-init-index[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21]): potential dests added=[] removed=[] 2024-09-19T11:55:11.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.462+0000 7fa3472609c0 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-19T11:55:11.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.466+0000 7fa1fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:11.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.470+0000 7fa3472609c0 20 remove_watcher() i=0 2024-09-19T11:55:11.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.470+0000 7fa3472609c0 2 removed watcher, disabling cache 2024-09-19T11:55:11.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.474+0000 7fa3472609c0 20 remove_watcher() i=1 2024-09-19T11:55:11.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.478+0000 7fa3472609c0 20 remove_watcher() i=2 2024-09-19T11:55:11.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.478+0000 7fa3472609c0 20 remove_watcher() i=3 2024-09-19T11:55:11.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.482+0000 7fa3472609c0 20 remove_watcher() i=4 2024-09-19T11:55:11.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.482+0000 7fa3472609c0 20 remove_watcher() i=5 2024-09-19T11:55:11.479 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.482+0000 7fa3472609c0 20 remove_watcher() i=6 2024-09-19T11:55:11.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.486+0000 7fa3472609c0 20 remove_watcher() i=7 2024-09-19T11:55:11.496 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-19T11:55:11.522 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:11.522 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:11.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.570+0000 7fa76409b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.574+0000 7fa76409b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:11.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.574+0000 7fa76409b9c0 20 realm 2024-09-19T11:55:11.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.574+0000 7fa76409b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.574+0000 7fa76409b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:11.570 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.574+0000 7fa76409b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:11.570 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.574+0000 7fa76409b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.570 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.574+0000 7fa76409b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:11.570 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.574+0000 7fa76409b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.574+0000 7fa76409b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:11.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.574+0000 7fa76409b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.573 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.578+0000 7fa76409b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:11.573 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.578+0000 7fa76409b9c0 20 searching for the correct realm 2024-09-19T11:55:11.576 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.582+0000 7fa7623a2640 0 -- 172.21.15.120:0/4285934146 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fa758033060 msgr2=0x7fa75806dc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:11.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.586+0000 7fa7613a0640 0 -- 172.21.15.120:0/4285934146 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fa754067e10 msgr2=0x7fa754074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:55:11.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.802+0000 7fa76409b9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:11.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.802+0000 7fa76409b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:11.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.802+0000 7fa76409b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:11.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.802+0000 7fa76409b9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:11.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.802+0000 7fa76409b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:11.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.802+0000 7fa76409b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:11.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.802+0000 7fa76409b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:11.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:11.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:11.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 20 zone default found 2024-09-19T11:55:11.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 4 Realm: () 2024-09-19T11:55:11.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:11.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:11.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:11.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 20 zonegroup default 2024-09-19T11:55:11.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:11.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:11.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:11.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 20 started sync module instance, tier type = 2024-09-19T11:55:11.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.806+0000 7fa76409b9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:11.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.830+0000 7fa76409b9c0 20 add_watcher() i=0 2024-09-19T11:55:11.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.830+0000 7fa76409b9c0 20 add_watcher() i=1 2024-09-19T11:55:11.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.830+0000 7fa76409b9c0 20 add_watcher() i=2 2024-09-19T11:55:11.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.830+0000 7fa76409b9c0 20 add_watcher() i=3 2024-09-19T11:55:11.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.830+0000 7fa76409b9c0 20 add_watcher() i=4 2024-09-19T11:55:11.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.830+0000 7fa76409b9c0 20 add_watcher() i=5 2024-09-19T11:55:11.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.830+0000 7fa76409b9c0 20 add_watcher() i=6 2024-09-19T11:55:11.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.830+0000 7fa76409b9c0 20 add_watcher() i=7 2024-09-19T11:55:11.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.830+0000 7fa76409b9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:11.832 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.834+0000 7fa6137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:11.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.838+0000 7fa76409b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:11.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.838+0000 7fa76409b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:11.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.838+0000 7fa76409b9c0 5 note: GC not initialized 2024-09-19T11:55:11.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.838+0000 7fa6127fc640 20 reqs_thread_entry: start 2024-09-19T11:55:11.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.838+0000 7fa76409b9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:11.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.838+0000 7fa76409b9c0 20 Filter name: none 2024-09-19T11:55:11.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.838+0000 7fa583fff640 20 reqs_thread_entry: start 2024-09-19T11:55:11.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.838+0000 7fa76409b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.838+0000 7fa76409b9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:55:11.836 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.838+0000 7fa76409b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.842+0000 7fa76409b9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:55:11.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.842+0000 7fa76409b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:11.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.842+0000 7fa76409b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.842+0000 7fa76409b9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:55:11.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.842+0000 7fa76409b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:11.839 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.842+0000 7fa76409b9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:55:11.839 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.842+0000 7fa76409b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:11.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.846+0000 7fa6137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:11.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.850+0000 7fa76409b9c0 20 remove_watcher() i=0 2024-09-19T11:55:11.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.850+0000 7fa76409b9c0 2 removed watcher, disabling cache 2024-09-19T11:55:11.849 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.854+0000 7fa76409b9c0 20 remove_watcher() i=1 2024-09-19T11:55:11.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.854+0000 7fa76409b9c0 20 remove_watcher() i=2 2024-09-19T11:55:11.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.858+0000 7fa76409b9c0 20 remove_watcher() i=3 2024-09-19T11:55:11.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.858+0000 7fa76409b9c0 20 remove_watcher() i=4 2024-09-19T11:55:11.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.862+0000 7fa76409b9c0 20 remove_watcher() i=5 2024-09-19T11:55:11.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.862+0000 7fa76409b9c0 20 remove_watcher() i=6 2024-09-19T11:55:11.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:11.866+0000 7fa76409b9c0 20 remove_watcher() i=7 2024-09-19T11:55:11.878 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:11.878 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:11.878 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-init-index id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-19T11:55:11.878 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:11.946 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with abort at init_index 2024-09-19T11:55:11.946 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:12.435 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-19T11:55:12.466 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:12.466 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:12.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.518+0000 7f2a4c6679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.518+0000 7f2a4c6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:12.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.518+0000 7f2a4c6679c0 20 realm 2024-09-19T11:55:12.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.518+0000 7f2a4c6679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.518+0000 7f2a4c6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:12.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.518+0000 7f2a4c6679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:12.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.518+0000 7f2a4c6679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.518+0000 7f2a4c6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:12.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.518+0000 7f2a4c6679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.522+0000 7f2a4c6679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:12.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.522+0000 7f2a4c6679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.522+0000 7f2a4c6679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:12.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.522+0000 7f2a4c6679c0 20 searching for the correct realm 2024-09-19T11:55:12.520 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.526+0000 7f2a4996c640 0 -- 172.21.15.120:0/3755360879 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7f2a34002350 msgr2=0x7f2a3c05d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:12.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.742+0000 7f2a4a96e640 0 -- 172.21.15.120:0/3755360879 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f2a40137bd0 msgr2=0x7f2a400f1a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:12.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:12.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:12.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:12.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:12.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:12.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:12.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:12.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:12.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:12.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 20 zone default found 2024-09-19T11:55:12.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 4 Realm: () 2024-09-19T11:55:12.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:12.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:12.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:12.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 20 zonegroup default 2024-09-19T11:55:12.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.758+0000 7f2a4c6679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.762+0000 7f2a4c6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:12.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.762+0000 7f2a4c6679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.762+0000 7f2a4c6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:12.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.762+0000 7f2a4c6679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.762+0000 7f2a4c6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:12.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.762+0000 7f2a4c6679c0 20 started sync module instance, tier type = 2024-09-19T11:55:12.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.762+0000 7f2a4c6679c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:12.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.786+0000 7f2a4c6679c0 20 add_watcher() i=0 2024-09-19T11:55:12.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.786+0000 7f2a4c6679c0 20 add_watcher() i=1 2024-09-19T11:55:12.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.786+0000 7f2a4c6679c0 20 add_watcher() i=2 2024-09-19T11:55:12.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.786+0000 7f2a4c6679c0 20 add_watcher() i=3 2024-09-19T11:55:12.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.786+0000 7f2a4c6679c0 20 add_watcher() i=4 2024-09-19T11:55:12.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.786+0000 7f2a4c6679c0 20 add_watcher() i=5 2024-09-19T11:55:12.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.786+0000 7f2a4c6679c0 20 add_watcher() i=6 2024-09-19T11:55:12.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.786+0000 7f2a4c6679c0 20 add_watcher() i=7 2024-09-19T11:55:12.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.786+0000 7f2a4c6679c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:12.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.790+0000 7f2900fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:12.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.794+0000 7f2a4c6679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:12.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.794+0000 7f2a4c6679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:12.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.794+0000 7f2a4c6679c0 5 note: GC not initialized 2024-09-19T11:55:12.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.794+0000 7f287b7fe640 20 reqs_thread_entry: start 2024-09-19T11:55:12.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.794+0000 7f2a4c6679c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:12.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.794+0000 7f2a4c6679c0 20 Filter name: none 2024-09-19T11:55:12.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.794+0000 7f28797fa640 20 reqs_thread_entry: start 2024-09-19T11:55:12.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.794+0000 7f2a4c6679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.794+0000 7f2a4c6679c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T11:55:12.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.794+0000 7f2a4c6679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.798+0000 7f2a4c6679c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T11:55:12.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.798+0000 7f2a4c6679c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:12.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.798+0000 7f2a4c6679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.798+0000 7f2a4c6679c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T11:55:12.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.798+0000 7f2a4c6679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.798+0000 7f2a4c6679c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T11:55:12.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.798+0000 7f2a4c6679c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:12.796 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.798+0000 7f2900fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:12.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.806+0000 7f2a4c6679c0 20 remove_watcher() i=0 2024-09-19T11:55:12.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.806+0000 7f2a4c6679c0 2 removed watcher, disabling cache 2024-09-19T11:55:12.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.806+0000 7f2a4c6679c0 20 remove_watcher() i=1 2024-09-19T11:55:12.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.810+0000 7f2a4c6679c0 20 remove_watcher() i=2 2024-09-19T11:55:12.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.810+0000 7f2a4c6679c0 20 remove_watcher() i=3 2024-09-19T11:55:12.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.814+0000 7f2a4c6679c0 20 remove_watcher() i=4 2024-09-19T11:55:12.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.814+0000 7f2a4c6679c0 20 remove_watcher() i=5 2024-09-19T11:55:12.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.818+0000 7f2a4c6679c0 20 remove_watcher() i=6 2024-09-19T11:55:12.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.818+0000 7f2a4c6679c0 20 remove_watcher() i=7 2024-09-19T11:55:12.831 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:12.831 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:12.831 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-init-indext id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:55:12.831 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:12.831 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-19T11:55:12.864 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:12.864 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:12.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:12.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 realm 2024-09-19T11:55:12.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:12.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.914+0000 7f0cac4529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:12.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:12.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.918+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:12.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.918+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:12.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.918+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:12.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.918+0000 7f0cac4529c0 20 searching for the correct realm 2024-09-19T11:55:12.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.922+0000 7f0caa759640 0 -- 172.21.15.120:0/3320961430 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f0ca0029040 msgr2=0x7f0ca0028920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:12.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:12.930+0000 7f0ca9757640 0 -- 172.21.15.120:0/3320961430 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f0c9c0c3410 msgr2=0x7f0c9c0c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:55:13.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:13.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:13.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:13.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:13.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:13.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:13.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:13.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:13.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 zone default found 2024-09-19T11:55:13.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 4 Realm: () 2024-09-19T11:55:13.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:13.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:13.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:13.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 zonegroup default 2024-09-19T11:55:13.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.154+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.154+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.154+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.154+0000 7f0cac4529c0 20 started sync module instance, tier type = 2024-09-19T11:55:13.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.154+0000 7f0cac4529c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:13.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=0 2024-09-19T11:55:13.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=1 2024-09-19T11:55:13.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=2 2024-09-19T11:55:13.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=3 2024-09-19T11:55:13.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=4 2024-09-19T11:55:13.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=5 2024-09-19T11:55:13.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=6 2024-09-19T11:55:13.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=7 2024-09-19T11:55:13.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.178+0000 7f0cac4529c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:13.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.182+0000 7f0b5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:13.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.182+0000 7f0cac4529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:13.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.182+0000 7f0cac4529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:13.180 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 note: GC not initialized 2024-09-19T11:55:13.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0b5a7fc640 20 reqs_thread_entry: start 2024-09-19T11:55:13.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:13.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 Filter name: none 2024-09-19T11:55:13.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0acffff640 20 reqs_thread_entry: start 2024-09-19T11:55:13.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-19T11:55:13.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T11:55:13.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-19T11:55:13.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-19T11:55:13.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 : miss 2024-09-19T11:55:13.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T11:55:13.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 info.flags=0x17 2024-09-19T11:55:13.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 to cache LRU end 2024-09-19T11:55:13.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:13.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:13.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 2024-09-19T11:55:13.186 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0cac4529c0 time 2024-09-19T11:55:13.190947+0000 2024-09-19T11:55:13.186 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:55:13.189 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:13.189 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0cafd2c2eb] 2024-09-19T11:55:13.189 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0cafd2c49f] 2024-09-19T11:55:13.189 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650b5413271] 2024-09-19T11:55:13.189 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x140fa02) [0x5650b5e63a02] 2024-09-19T11:55:13.190 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5650b54230dd] 2024-09-19T11:55:13.190 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:55:13.190 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0caeb92d90] 2024-09-19T11:55:13.190 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:55:13.190 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:55:13.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.190+0000 7f0cac4529c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0cac4529c0 time 2024-09-19T11:55:13.190947+0000 2024-09-19T11:55:13.191 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:55:13.191 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.191 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:13.191 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0cafd2c2eb] 2024-09-19T11:55:13.191 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0cafd2c49f] 2024-09-19T11:55:13.191 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650b5413271] 2024-09-19T11:55:13.191 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x140fa02) [0x5650b5e63a02] 2024-09-19T11:55:13.191 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5650b54230dd] 2024-09-19T11:55:13.191 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:55:13.191 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0caeb92d90] 2024-09-19T11:55:13.191 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:55:13.191 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:55:13.191 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.191 INFO:tasks.workunit.client.0.smithi120.stderr:*** Caught signal (Aborted) ** 2024-09-19T11:55:13.192 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f0cac4529c0 thread_name:radosgw-admin 2024-09-19T11:55:13.240 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:13.240 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0caebab520] 2024-09-19T11:55:13.240 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:55:13.240 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:55:13.240 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:55:13.240 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0cafd2c345] 2024-09-19T11:55:13.240 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0cafd2c49f] 2024-09-19T11:55:13.240 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650b5413271] 2024-09-19T11:55:13.241 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x140fa02) [0x5650b5e63a02] 2024-09-19T11:55:13.241 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5650b54230dd] 2024-09-19T11:55:13.241 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:55:13.241 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0caeb92d90] 2024-09-19T11:55:13.241 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:55:13.241 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:55:13.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.194+0000 7f0cac4529c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:55:13.241 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f0cac4529c0 thread_name:radosgw-admin 2024-09-19T11:55:13.241 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.241 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:13.241 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0caebab520] 2024-09-19T11:55:13.241 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:55:13.241 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:55:13.242 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:55:13.242 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0cafd2c345] 2024-09-19T11:55:13.242 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0cafd2c49f] 2024-09-19T11:55:13.242 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650b5413271] 2024-09-19T11:55:13.242 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x140fa02) [0x5650b5e63a02] 2024-09-19T11:55:13.242 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5650b54230dd] 2024-09-19T11:55:13.242 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:55:13.242 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0caeb92d90] 2024-09-19T11:55:13.242 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:55:13.242 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:55:13.242 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:55:13.242 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.242 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:55:13.242 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.243 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.243 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:55:12.890+0000 7f0ca9f58640 10 monclient(hunting): get_auth_request con 0x5650b7e36cf0 auth_method 0 2024-09-19T11:55:13.243 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:55:12.890+0000 7f0ca9f58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.243 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:55:12.890+0000 7f0ca9f58640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.243 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:55:12.890+0000 7f0ca9f58640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.243 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.243 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.243 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.243 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:55:12.890+0000 7f0ca9f58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.243 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:55:12.890+0000 7f0ca9f58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.243 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:55:12.890+0000 7f0ca9f58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.243 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient(hunting): handle_auth_done global_id 6444 payload 274 2024-09-19T11:55:13.244 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient: _finish_hunting 0 2024-09-19T11:55:13.244 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:55:12.890+0000 7f0caa759640 1 monclient: found mon.noname-a 2024-09-19T11:55:13.244 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.244 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:55:12.890+0000 7f0ca9757640 10 monclient: get_auth_request con 0x5650b7e65e30 auth_method 0 2024-09-19T11:55:13.244 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.244 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:13.244 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: dump: 2024-09-19T11:55:13.244 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.244 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.244 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.244 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.244 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.244 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.245 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.245 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.245 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.245 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.245 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: _finish_auth 0 2024-09-19T11:55:13.245 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: _check_auth_tickets 2024-09-19T11:55:13.245 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:13.245 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.245 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:13.245 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: dump: 2024-09-19T11:55:13.245 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.245 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.246 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.246 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.246 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.246 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.246 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.246 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.246 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.246 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.246 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 monclient: authenticate success, global_id 6444 2024-09-19T11:55:13.246 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 10 monclient: get_monmap_and_config success 2024-09-19T11:55:13.246 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 4 set_mon_vals no callback set 2024-09-19T11:55:13.246 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 10 monclient: shutdown 2024-09-19T11:55:13.247 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) unregister_commands rotate-key 2024-09-19T11:55:13.247 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 10 monclient: build_initial_monmap 2024-09-19T11:55:13.247 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:13.247 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 10 monclient: monmap: 2024-09-19T11:55:13.247 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:13.247 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:13.247 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:13.247 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:13.247 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:13.247 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.247 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:13.247 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:13.248 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:13.248 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.248 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding auth protocol: cephx 2024-09-19T11:55:13.248 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding auth protocol: cephx 2024-09-19T11:55:13.248 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding auth protocol: cephx 2024-09-19T11:55:13.248 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: secure 2024-09-19T11:55:13.248 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: crc 2024-09-19T11:55:13.248 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: secure 2024-09-19T11:55:13.248 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: crc 2024-09-19T11:55:13.249 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: secure 2024-09-19T11:55:13.249 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: crc 2024-09-19T11:55:13.249 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: crc 2024-09-19T11:55:13.249 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: secure 2024-09-19T11:55:13.249 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: crc 2024-09-19T11:55:13.249 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: secure 2024-09-19T11:55:13.249 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: crc 2024-09-19T11:55:13.249 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: secure 2024-09-19T11:55:13.249 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.249 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 1 librados: starting msgr at 2024-09-19T11:55:13.250 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 1 librados: starting objecter 2024-09-19T11:55:13.250 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command objecter_requests hook 0x5650b7dcd430 2024-09-19T11:55:13.250 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 1 librados: setting wanted keys 2024-09-19T11:55:13.250 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 1 librados: calling monclient init 2024-09-19T11:55:13.250 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 10 monclient: init 2024-09-19T11:55:13.250 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding auth protocol: cephx 2024-09-19T11:55:13.250 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding auth protocol: cephx 2024-09-19T11:55:13.250 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding auth protocol: cephx 2024-09-19T11:55:13.250 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: secure 2024-09-19T11:55:13.250 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: crc 2024-09-19T11:55:13.250 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: secure 2024-09-19T11:55:13.250 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: crc 2024-09-19T11:55:13.250 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: secure 2024-09-19T11:55:13.251 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: crc 2024-09-19T11:55:13.251 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: crc 2024-09-19T11:55:13.251 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: secure 2024-09-19T11:55:13.251 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: crc 2024-09-19T11:55:13.251 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: secure 2024-09-19T11:55:13.251 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: crc 2024-09-19T11:55:13.251 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: secure 2024-09-19T11:55:13.251 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.251 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.251 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command rotate-key hook 0x5650b7faa4c8 2024-09-19T11:55:13.251 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:13.251 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T11:55:13.251 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-c con 0x5650b7e36cf0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:13.251 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-b con 0x5650b7e65e30 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:13.252 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-a con 0x5650b7ef3120 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:13.252 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.252 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.252 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.252 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:13.252 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): authenticate will time out at 2207.208567s 2024-09-19T11:55:13.252 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:55:12.894+0000 7f0ca9f58640 10 monclient(hunting): get_auth_request con 0x5650b7e36cf0 auth_method 0 2024-09-19T11:55:13.252 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:55:12.894+0000 7f0ca9f58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.252 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:55:12.894+0000 7f0ca9f58640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.252 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:55:12.894+0000 7f0ca9f58640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.252 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): get_auth_request con 0x5650b7ef3120 auth_method 0 2024-09-19T11:55:13.252 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.253 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.253 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.253 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.253 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.253 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.253 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:55:12.894+0000 7f0ca9f58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.254 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:55:12.894+0000 7f0ca9f58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.254 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:55:12.894+0000 7f0ca9f58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.254 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): handle_auth_done global_id 6447 payload 824 2024-09-19T11:55:13.254 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient: _finish_hunting 0 2024-09-19T11:55:13.254 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:55:12.894+0000 7f0caa759640 1 monclient: found mon.noname-a 2024-09-19T11:55:13.254 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.254 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.254 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:13.255 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: dump: 2024-09-19T11:55:13.255 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.255 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.255 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.255 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.255 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.255 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.255 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.255 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.255 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.255 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.255 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: _finish_auth 0 2024-09-19T11:55:13.255 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: _check_auth_tickets 2024-09-19T11:55:13.255 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:13.255 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.256 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:13.256 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: dump: 2024-09-19T11:55:13.256 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.256 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.256 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.256 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.256 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.256 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.256 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.256 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.256 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.257 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.257 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:55:12.894+0000 7f0b97e07640 4 set_mon_vals no callback set 2024-09-19T11:55:13.257 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 5 monclient: authenticate success, global_id 6447 2024-09-19T11:55:13.257 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient: _renew_subs 2024-09-19T11:55:13.257 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.257 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient: _renew_subs 2024-09-19T11:55:13.257 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.257 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 1 librados: init done 2024-09-19T11:55:13.257 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:55:12.894+0000 7f0b96604640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:55:13.257 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:55:12.894+0000 7f0b96604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:13.257 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:55:12.894+0000 7f0b96604640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:13.257 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:55:12.898+0000 7f0ca9f58640 10 monclient: get_auth_request con 0x7f0b90071be0 auth_method 0 2024-09-19T11:55:13.257 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:55:12.898+0000 7f0ca9757640 10 monclient: get_auth_request con 0x5650b7fd24c0 auth_method 0 2024-09-19T11:55:13.258 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:55:12.898+0000 7f0ca9f58640 10 monclient: get_auth_request con 0x5650b7ff5210 auth_method 0 2024-09-19T11:55:13.258 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:55:12.898+0000 7f0ca9757640 10 monclient: get_auth_request con 0x5650b7ff9600 auth_method 0 2024-09-19T11:55:13.258 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient: get_auth_request con 0x5650b7ff8a70 auth_method 0 2024-09-19T11:55:13.258 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient: build_initial_monmap 2024-09-19T11:55:13.258 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:13.258 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient: monmap: 2024-09-19T11:55:13.258 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:13.258 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:13.258 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:13.258 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:13.258 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:13.259 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.259 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:13.259 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:13.259 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:13.259 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.259 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding auth protocol: cephx 2024-09-19T11:55:13.259 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding auth protocol: cephx 2024-09-19T11:55:13.259 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding auth protocol: cephx 2024-09-19T11:55:13.259 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: secure 2024-09-19T11:55:13.259 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: crc 2024-09-19T11:55:13.259 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: secure 2024-09-19T11:55:13.259 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: crc 2024-09-19T11:55:13.260 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: secure 2024-09-19T11:55:13.260 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: crc 2024-09-19T11:55:13.260 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: crc 2024-09-19T11:55:13.260 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: secure 2024-09-19T11:55:13.260 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: crc 2024-09-19T11:55:13.260 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: secure 2024-09-19T11:55:13.260 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: crc 2024-09-19T11:55:13.260 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: secure 2024-09-19T11:55:13.260 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.260 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command objecter_requests cmddesc objecter_requests hook 0x5650b8005100 EEXIST 2024-09-19T11:55:13.261 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient: init 2024-09-19T11:55:13.261 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding auth protocol: cephx 2024-09-19T11:55:13.261 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding auth protocol: cephx 2024-09-19T11:55:13.261 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding auth protocol: cephx 2024-09-19T11:55:13.261 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: secure 2024-09-19T11:55:13.261 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: crc 2024-09-19T11:55:13.261 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: secure 2024-09-19T11:55:13.262 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: crc 2024-09-19T11:55:13.262 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: secure 2024-09-19T11:55:13.262 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: crc 2024-09-19T11:55:13.262 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: crc 2024-09-19T11:55:13.262 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: secure 2024-09-19T11:55:13.262 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: crc 2024-09-19T11:55:13.262 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: secure 2024-09-19T11:55:13.262 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: crc 2024-09-19T11:55:13.263 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: secure 2024-09-19T11:55:13.263 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.263 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.263 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command rotate-key cmddesc rotate-key hook 0x5650b8000760 EEXIST 2024-09-19T11:55:13.263 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:13.263 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T11:55:13.263 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-a con 0x5650b80292b0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:13.263 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-c con 0x5650b8028be0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:13.264 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-b con 0x5650b80275c0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:13.264 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.264 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.264 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.264 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:13.264 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): authenticate will time out at 2207.219148s 2024-09-19T11:55:13.265 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): get_auth_request con 0x5650b8028be0 auth_method 0 2024-09-19T11:55:13.265 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.265 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.265 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.265 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:55:12.902+0000 7f0ca9757640 10 monclient(hunting): get_auth_request con 0x5650b80292b0 auth_method 0 2024-09-19T11:55:13.265 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:55:12.902+0000 7f0ca9757640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.265 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:55:12.902+0000 7f0ca9757640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.266 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:55:12.902+0000 7f0ca9757640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.266 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.266 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.266 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.266 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:55:12.902+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.266 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:55:12.902+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.267 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:55:12.902+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.267 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): handle_auth_done global_id 6050 payload 824 2024-09-19T11:55:13.267 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient: _finish_hunting 0 2024-09-19T11:55:13.267 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:55:12.902+0000 7f0caa759640 1 monclient: found mon.noname-c 2024-09-19T11:55:13.267 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:55:13.267 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:55:12.902+0000 7f0ca9f58640 10 monclient: get_auth_request con 0x5650b80275c0 auth_method 0 2024-09-19T11:55:13.267 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.267 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:55:13.268 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: dump: 2024-09-19T11:55:13.268 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.268 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.268 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.268 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.268 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.268 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.268 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.268 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.268 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.269 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.269 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: _finish_auth 0 2024-09-19T11:55:13.269 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: _check_auth_tickets 2024-09-19T11:55:13.269 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:13.269 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.269 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:55:13.269 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: dump: 2024-09-19T11:55:13.269 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.269 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.269 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.269 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.270 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.270 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.270 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.270 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.270 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.270 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.270 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 monclient: authenticate success, global_id 6050 2024-09-19T11:55:13.270 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:55:12.902+0000 7f0caaf5a640 4 set_mon_vals no callback set 2024-09-19T11:55:13.270 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: _renew_subs 2024-09-19T11:55:13.270 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:55:13.270 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: _renew_subs 2024-09-19T11:55:13.270 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:55:13.270 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:55:12.906+0000 7f0b8f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:55:13.270 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:55:12.906+0000 7f0b8f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:13.271 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:55:12.906+0000 7f0b8f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:13.271 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: get_monmap_and_config 2024-09-19T11:55:13.271 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: build_initial_monmap 2024-09-19T11:55:13.271 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:13.271 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: monmap: 2024-09-19T11:55:13.271 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:13.271 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:13.271 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:13.271 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:13.271 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:13.271 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.271 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:13.271 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:13.271 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:13.272 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.272 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding auth protocol: cephx 2024-09-19T11:55:13.272 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding auth protocol: cephx 2024-09-19T11:55:13.272 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding auth protocol: cephx 2024-09-19T11:55:13.272 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: secure 2024-09-19T11:55:13.272 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: crc 2024-09-19T11:55:13.272 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: secure 2024-09-19T11:55:13.272 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: crc 2024-09-19T11:55:13.272 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: secure 2024-09-19T11:55:13.272 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: crc 2024-09-19T11:55:13.272 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: crc 2024-09-19T11:55:13.272 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: secure 2024-09-19T11:55:13.272 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: crc 2024-09-19T11:55:13.272 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: secure 2024-09-19T11:55:13.273 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: crc 2024-09-19T11:55:13.273 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: secure 2024-09-19T11:55:13.273 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient: get_auth_request con 0x7f0b84071b20 auth_method 0 2024-09-19T11:55:13.273 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.273 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: init 2024-09-19T11:55:13.273 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding auth protocol: cephx 2024-09-19T11:55:13.273 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding auth protocol: cephx 2024-09-19T11:55:13.273 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding auth protocol: cephx 2024-09-19T11:55:13.273 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: secure 2024-09-19T11:55:13.273 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: crc 2024-09-19T11:55:13.273 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: secure 2024-09-19T11:55:13.273 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: crc 2024-09-19T11:55:13.274 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: secure 2024-09-19T11:55:13.274 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: crc 2024-09-19T11:55:13.274 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: crc 2024-09-19T11:55:13.274 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: secure 2024-09-19T11:55:13.274 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: crc 2024-09-19T11:55:13.274 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: secure 2024-09-19T11:55:13.274 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: crc 2024-09-19T11:55:13.274 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: secure 2024-09-19T11:55:13.274 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.274 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.274 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command rotate-key cmddesc rotate-key hook 0x7ffd5d488118 EEXIST 2024-09-19T11:55:13.274 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:13.274 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T11:55:13.275 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-c con 0x5650b807c930 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:13.275 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-a con 0x5650b806d460 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:13.275 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-b con 0x5650b8077d50 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:13.275 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.275 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.275 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.275 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:13.275 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): authenticate will time out at 2207.223323s 2024-09-19T11:55:13.275 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): get_auth_request con 0x5650b806d460 auth_method 0 2024-09-19T11:55:13.275 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.275 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.275 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.275 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient(hunting): get_auth_request con 0x5650b807c930 auth_method 0 2024-09-19T11:55:13.275 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.275 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.276 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.276 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.276 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.276 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.276 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.276 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.276 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.276 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): handle_auth_done global_id 6453 payload 274 2024-09-19T11:55:13.276 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient: _finish_hunting 0 2024-09-19T11:55:13.276 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:55:12.906+0000 7f0caa759640 1 monclient: found mon.noname-a 2024-09-19T11:55:13.276 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.276 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:55:12.906+0000 7f0ca9f58640 10 monclient: get_auth_request con 0x5650b8077d50 auth_method 0 2024-09-19T11:55:13.276 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.277 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:13.277 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: dump: 2024-09-19T11:55:13.277 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.277 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.277 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.277 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.278 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.278 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.278 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.278 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.278 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.278 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.278 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: _finish_auth 0 2024-09-19T11:55:13.278 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: _check_auth_tickets 2024-09-19T11:55:13.278 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:13.279 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 monclient: authenticate success, global_id 6453 2024-09-19T11:55:13.279 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: get_monmap_and_config success 2024-09-19T11:55:13.279 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 4 set_mon_vals no callback set 2024-09-19T11:55:13.279 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.279 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:13.279 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: dump: 2024-09-19T11:55:13.279 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.279 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.279 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.279 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.279 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.279 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.279 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.280 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.280 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.280 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.280 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: shutdown 2024-09-19T11:55:13.280 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: build_initial_monmap 2024-09-19T11:55:13.280 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:13.280 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: monmap: 2024-09-19T11:55:13.280 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:13.280 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:13.280 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:13.280 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:13.280 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:13.280 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.281 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:13.281 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:13.281 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:13.281 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.281 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding auth protocol: cephx 2024-09-19T11:55:13.281 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding auth protocol: cephx 2024-09-19T11:55:13.281 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding auth protocol: cephx 2024-09-19T11:55:13.281 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: secure 2024-09-19T11:55:13.281 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: crc 2024-09-19T11:55:13.281 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: secure 2024-09-19T11:55:13.281 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: crc 2024-09-19T11:55:13.281 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: secure 2024-09-19T11:55:13.281 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: crc 2024-09-19T11:55:13.282 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: crc 2024-09-19T11:55:13.282 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: secure 2024-09-19T11:55:13.282 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: crc 2024-09-19T11:55:13.282 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: secure 2024-09-19T11:55:13.282 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: crc 2024-09-19T11:55:13.282 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: secure 2024-09-19T11:55:13.282 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.282 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 1 librados: starting msgr at 2024-09-19T11:55:13.282 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 1 librados: starting objecter 2024-09-19T11:55:13.282 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command objecter_requests cmddesc objecter_requests hook 0x5650b804e5c0 EEXIST 2024-09-19T11:55:13.282 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 1 librados: setting wanted keys 2024-09-19T11:55:13.282 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 1 librados: calling monclient init 2024-09-19T11:55:13.282 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: init 2024-09-19T11:55:13.282 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding auth protocol: cephx 2024-09-19T11:55:13.283 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding auth protocol: cephx 2024-09-19T11:55:13.283 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding auth protocol: cephx 2024-09-19T11:55:13.283 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: secure 2024-09-19T11:55:13.283 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: crc 2024-09-19T11:55:13.283 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: secure 2024-09-19T11:55:13.283 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: crc 2024-09-19T11:55:13.283 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: secure 2024-09-19T11:55:13.283 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: crc 2024-09-19T11:55:13.283 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: crc 2024-09-19T11:55:13.283 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: secure 2024-09-19T11:55:13.283 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: crc 2024-09-19T11:55:13.283 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: secure 2024-09-19T11:55:13.283 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: crc 2024-09-19T11:55:13.284 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: secure 2024-09-19T11:55:13.284 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.284 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.284 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command rotate-key cmddesc rotate-key hook 0x5650b802b218 EEXIST 2024-09-19T11:55:13.284 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:13.284 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T11:55:13.284 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-c con 0x5650b806d460 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:13.284 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-a con 0x5650b8077d50 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:13.284 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-b con 0x5650b807c930 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:13.284 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.284 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.284 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.284 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:13.285 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): authenticate will time out at 2207.225976s 2024-09-19T11:55:13.285 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): get_auth_request con 0x5650b8077d50 auth_method 0 2024-09-19T11:55:13.285 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.285 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.285 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.285 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:55:12.910+0000 7f0ca9757640 10 monclient(hunting): get_auth_request con 0x5650b806d460 auth_method 0 2024-09-19T11:55:13.285 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:55:12.910+0000 7f0ca9757640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.285 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:55:12.910+0000 7f0ca9757640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.285 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:55:12.910+0000 7f0ca9757640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.286 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.286 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.286 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.286 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:55:12.910+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.286 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:55:12.910+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.286 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:55:12.910+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.286 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:55:12.910+0000 7f0ca9f58640 10 monclient(hunting): get_auth_request con 0x5650b807c930 auth_method 0 2024-09-19T11:55:13.286 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:55:12.910+0000 7f0ca9f58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.286 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:55:12.910+0000 7f0ca9f58640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.286 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:55:12.910+0000 7f0ca9f58640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.286 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): handle_auth_done global_id 6456 payload 824 2024-09-19T11:55:13.286 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient: _finish_hunting 0 2024-09-19T11:55:13.286 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:55:12.910+0000 7f0caa759640 1 monclient: found mon.noname-a 2024-09-19T11:55:13.287 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.287 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.287 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:13.287 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: dump: 2024-09-19T11:55:13.287 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.287 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.287 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.287 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.287 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.287 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.287 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.287 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.287 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.288 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.288 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: _finish_auth 0 2024-09-19T11:55:13.288 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: _check_auth_tickets 2024-09-19T11:55:13.288 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:13.288 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.288 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:13.288 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: dump: 2024-09-19T11:55:13.288 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.288 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.288 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.288 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.288 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.289 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.289 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.289 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.289 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.289 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.289 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 4 set_mon_vals no callback set 2024-09-19T11:55:13.289 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 monclient: authenticate success, global_id 6456 2024-09-19T11:55:13.289 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: _renew_subs 2024-09-19T11:55:13.289 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.289 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: _renew_subs 2024-09-19T11:55:13.289 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.289 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 1 librados: init done 2024-09-19T11:55:13.289 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command cr dump hook 0x5650b804c8e8 2024-09-19T11:55:13.289 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.290 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:55:12.914+0000 7f0b7b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:55:13.290 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:55:12.914+0000 7f0b7b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:13.290 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:55:12.914+0000 7f0b7b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:13.290 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:55:12.914+0000 7f0ca9757640 10 monclient: get_auth_request con 0x7f0b74071be0 auth_method 0 2024-09-19T11:55:13.290 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:55:12.914+0000 7f0ca9f58640 10 monclient: get_auth_request con 0x5650b8095820 auth_method 0 2024-09-19T11:55:13.290 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.290 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 realm 2024-09-19T11:55:13.290 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.290 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.290 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:13.290 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.290 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.290 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.291 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:55:12.914+0000 7f0ca9757640 10 monclient: get_auth_request con 0x5650b8099b30 auth_method 0 2024-09-19T11:55:13.291 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:55:12.918+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:13.291 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:55:12.918+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.291 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:55:12.918+0000 7f0caa759640 10 monclient: get_auth_request con 0x5650b809d2a0 auth_method 0 2024-09-19T11:55:13.291 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:55:12.918+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:13.291 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:55:12.918+0000 7f0cac4529c0 20 searching for the correct realm 2024-09-19T11:55:13.291 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:55:12.918+0000 7f0ca9f58640 10 monclient: get_auth_request con 0x5650b80a2020 auth_method 0 2024-09-19T11:55:13.291 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:55:12.918+0000 7f0ca9757640 10 monclient: get_auth_request con 0x7f0c9c0d4040 auth_method 0 2024-09-19T11:55:13.291 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:55:12.922+0000 7f0caa759640 10 monclient: get_auth_request con 0x7f0ca0029040 auth_method 0 2024-09-19T11:55:13.291 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:55:12.922+0000 7f0caa759640 0 -- 172.21.15.120:0/3320961430 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f0ca0029040 msgr2=0x7f0ca0028920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:13.291 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:55:12.922+0000 7f0b7b7fe640 1 client.6456.objecter ms_handle_reset 0x7f0ca0029040 session 0x7f0ca0030040 osd.2 2024-09-19T11:55:13.291 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:55:12.922+0000 7f0b7b7fe640 10 monclient: _renew_subs 2024-09-19T11:55:13.291 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:55:12.922+0000 7f0b7b7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.291 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:55:12.922+0000 7f0caa759640 10 monclient: get_auth_request con 0x7f0b74082280 auth_method 0 2024-09-19T11:55:13.292 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:55:12.922+0000 7f0ca9f58640 10 monclient: get_auth_request con 0x7f0ca40a4050 auth_method 0 2024-09-19T11:55:13.292 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:55:12.930+0000 7f0ca9757640 10 monclient: get_auth_request con 0x7f0c9c0c3410 auth_method 0 2024-09-19T11:55:13.292 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:55:12.930+0000 7f0ca9757640 0 -- 172.21.15.120:0/3320961430 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f0c9c0c3410 msgr2=0x7f0c9c0c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:55:13.292 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:55:13.134+0000 7f0ca9757640 10 monclient: get_auth_request con 0x7f0c9c0c3410 auth_method 0 2024-09-19T11:55:13.292 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:13.292 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:13.292 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:13.292 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:13.292 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:13.292 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:13.292 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.292 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.292 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.293 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:13.293 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.293 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:13.293 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 zone default found 2024-09-19T11:55:13.293 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 4 Realm: () 2024-09-19T11:55:13.293 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:13.293 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:13.293 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:13.293 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 zonegroup default 2024-09-19T11:55:13.293 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.293 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.293 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.293 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:55:13.154+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.293 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:55:13.154+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.294 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:55:13.154+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.294 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:55:13.154+0000 7f0cac4529c0 20 started sync module instance, tier type = 2024-09-19T11:55:13.294 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:55:13.154+0000 7f0cac4529c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:13.294 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=0 2024-09-19T11:55:13.294 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=1 2024-09-19T11:55:13.294 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=2 2024-09-19T11:55:13.294 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=3 2024-09-19T11:55:13.294 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=4 2024-09-19T11:55:13.294 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=5 2024-09-19T11:55:13.294 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=6 2024-09-19T11:55:13.294 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=7 2024-09-19T11:55:13.294 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:13.294 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding auth protocol: cephx 2024-09-19T11:55:13.295 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding auth protocol: cephx 2024-09-19T11:55:13.295 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding auth protocol: cephx 2024-09-19T11:55:13.295 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: secure 2024-09-19T11:55:13.295 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: crc 2024-09-19T11:55:13.295 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: secure 2024-09-19T11:55:13.295 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: crc 2024-09-19T11:55:13.295 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: secure 2024-09-19T11:55:13.295 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: crc 2024-09-19T11:55:13.295 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: crc 2024-09-19T11:55:13.295 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: secure 2024-09-19T11:55:13.295 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: crc 2024-09-19T11:55:13.295 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: secure 2024-09-19T11:55:13.295 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: crc 2024-09-19T11:55:13.295 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: secure 2024-09-19T11:55:13.296 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:55:13.182+0000 7f0b5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:13.296 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.296 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:13.296 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:13.296 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command cache list hook 0x5650b80641f0 2024-09-19T11:55:13.296 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command cache inspect hook 0x5650b80641f0 2024-09-19T11:55:13.296 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command cache erase hook 0x5650b80641f0 2024-09-19T11:55:13.296 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command cache zap hook 0x5650b80641f0 2024-09-19T11:55:13.296 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 note: GC not initialized 2024-09-19T11:55:13.296 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:55:13.186+0000 7f0b5a7fc640 20 reqs_thread_entry: start 2024-09-19T11:55:13.296 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command sync trace show hook 0x7f0ca0004980 2024-09-19T11:55:13.296 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command sync trace history hook 0x7f0ca0004980 2024-09-19T11:55:13.296 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command sync trace active hook 0x7f0ca0004980 2024-09-19T11:55:13.297 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command sync trace active_short hook 0x7f0ca0004980 2024-09-19T11:55:13.297 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:13.297 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 Filter name: none 2024-09-19T11:55:13.297 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:55:13.186+0000 7f0acffff640 20 reqs_thread_entry: start 2024-09-19T11:55:13.297 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-19T11:55:13.297 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.297 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T11:55:13.297 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-19T11:55:13.297 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-19T11:55:13.297 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 : miss 2024-09-19T11:55:13.297 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.297 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T11:55:13.297 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 info.flags=0x17 2024-09-19T11:55:13.298 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 to cache LRU end 2024-09-19T11:55:13.298 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:13.298 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:13.298 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 2024-09-19T11:55:13.298 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:55:13.190+0000 7f0cac4529c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0cac4529c0 time 2024-09-19T11:55:13.190947+0000 2024-09-19T11:55:13.298 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:55:13.298 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.298 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:13.298 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0cafd2c2eb] 2024-09-19T11:55:13.298 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0cafd2c49f] 2024-09-19T11:55:13.298 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650b5413271] 2024-09-19T11:55:13.298 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x140fa02) [0x5650b5e63a02] 2024-09-19T11:55:13.298 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5650b54230dd] 2024-09-19T11:55:13.298 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:55:13.299 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0caeb92d90] 2024-09-19T11:55:13.299 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:55:13.299 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:55:13.299 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.299 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:55:13.194+0000 7f0cac4529c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:55:13.299 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f0cac4529c0 thread_name:radosgw-admin 2024-09-19T11:55:13.299 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.299 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:13.299 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0caebab520] 2024-09-19T11:55:13.299 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:55:13.299 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:55:13.299 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:55:13.299 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0cafd2c345] 2024-09-19T11:55:13.300 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0cafd2c49f] 2024-09-19T11:55:13.300 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650b5413271] 2024-09-19T11:55:13.300 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x140fa02) [0x5650b5e63a02] 2024-09-19T11:55:13.300 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5650b54230dd] 2024-09-19T11:55:13.300 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:55:13.300 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0caeb92d90] 2024-09-19T11:55:13.300 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:55:13.300 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:55:13.300 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:55:13.300 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.300 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:55:13.300 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:55:13.300 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:55:13.301 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:55:13.301 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:55:13.301 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:55:13.301 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:55:13.301 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:55:13.301 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:55:13.301 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:55:13.301 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:55:13.301 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:55:13.301 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:55:13.301 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:55:13.301 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:55:13.301 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:55:13.301 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:55:13.302 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:55:13.302 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:55:13.302 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:55:13.302 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:55:13.302 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:55:13.302 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:55:13.302 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:55:13.302 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:55:13.302 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:55:13.302 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:55:13.302 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:55:13.302 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:55:13.302 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:55:13.302 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:55:13.303 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:55:13.303 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:55:13.303 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:55:13.303 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:55:13.303 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:55:13.303 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:55:13.303 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:55:13.303 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:55:13.303 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:55:13.303 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:55:13.303 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:55:13.303 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:55:13.303 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:55:13.303 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:55:13.304 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:55:13.304 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:55:13.304 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:55:13.304 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:55:13.304 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:55:13.304 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:55:13.304 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:55:13.304 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:55:13.304 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:55:13.304 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:55:13.304 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:55:13.304 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:55:13.304 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:55:13.304 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:55:13.305 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:55:13.305 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:55:13.305 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:55:13.305 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:55:13.305 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:55:13.305 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:55:13.305 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:55:13.305 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:55:13.305 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:55:13.305 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:55:13.305 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:55:13.305 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:55:13.305 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:55:13.305 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:55:13.306 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:55:13.306 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:55:13.306 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:55:13.306 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:55:13.306 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:55:13.306 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:55:13.306 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:55:13.306 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:55:13.306 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:55:13.306 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:55:13.307 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:55:13.307 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:55:13.307 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:55:13.307 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:55:13.307 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:55:13.307 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:55:13.307 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:55:13.307 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:55:13.307 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:55:13.307 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:55:13.307 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:55:13.307 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0acffff640 / http_manager 2024-09-19T11:55:13.307 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0b5a7fc640 / http_manager 2024-09-19T11:55:13.307 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0b5b7fe640 / rgw_dt_lg_renew 2024-09-19T11:55:13.308 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0b7b7fe640 / ms_dispatch 2024-09-19T11:55:13.308 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0b8d7fa640 / io_context_pool 2024-09-19T11:55:13.308 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0b8f7fe640 / ms_dispatch 2024-09-19T11:55:13.308 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0b96604640 / ms_dispatch 2024-09-19T11:55:13.308 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0b97e07640 / io_context_pool 2024-09-19T11:55:13.308 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0ca9757640 / msgr-worker-2 2024-09-19T11:55:13.308 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0ca9f58640 / msgr-worker-1 2024-09-19T11:55:13.308 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0caa759640 / msgr-worker-0 2024-09-19T11:55:13.308 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0caaf5a640 / io_context_pool 2024-09-19T11:55:13.308 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0cac4529c0 / radosgw-admin 2024-09-19T11:55:13.308 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:55:13.308 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:55:13.308 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/log/ceph/ceph-client.admin.83310.log 2024-09-19T11:55:13.309 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:55:13.309 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:55:13.309 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.309 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.309 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:55:12.890+0000 7f0ca9f58640 10 monclient(hunting): get_auth_request con 0x5650b7e36cf0 auth_method 0 2024-09-19T11:55:13.309 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:55:12.890+0000 7f0ca9f58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.309 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:55:12.890+0000 7f0ca9f58640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.309 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:55:12.890+0000 7f0ca9f58640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.309 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.309 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.309 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.309 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:55:12.890+0000 7f0ca9f58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.309 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:55:12.890+0000 7f0ca9f58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.309 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:55:12.890+0000 7f0ca9f58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.310 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient(hunting): handle_auth_done global_id 6444 payload 274 2024-09-19T11:55:13.310 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient: _finish_hunting 0 2024-09-19T11:55:13.310 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:55:12.890+0000 7f0caa759640 1 monclient: found mon.noname-a 2024-09-19T11:55:13.310 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:55:12.890+0000 7f0caa759640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.310 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:55:12.890+0000 7f0ca9757640 10 monclient: get_auth_request con 0x5650b7e65e30 auth_method 0 2024-09-19T11:55:13.310 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.310 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:13.310 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: dump: 2024-09-19T11:55:13.310 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.310 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.310 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.310 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.310 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.310 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.311 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.311 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.311 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.311 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.311 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: _finish_auth 0 2024-09-19T11:55:13.311 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: _check_auth_tickets 2024-09-19T11:55:13.311 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:13.311 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.311 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:13.311 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:55:12.890+0000 7f0b97e07640 10 monclient: dump: 2024-09-19T11:55:13.311 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.311 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.311 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.311 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.312 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.312 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.312 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.312 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.312 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.312 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.312 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 monclient: authenticate success, global_id 6444 2024-09-19T11:55:13.312 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 10 monclient: get_monmap_and_config success 2024-09-19T11:55:13.312 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 4 set_mon_vals no callback set 2024-09-19T11:55:13.312 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 10 monclient: shutdown 2024-09-19T11:55:13.312 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) unregister_commands rotate-key 2024-09-19T11:55:13.312 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 10 monclient: build_initial_monmap 2024-09-19T11:55:13.312 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:13.312 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 10 monclient: monmap: 2024-09-19T11:55:13.313 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:13.313 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:13.313 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:13.313 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:13.313 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:13.313 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.313 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:13.313 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:13.313 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:13.313 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.313 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding auth protocol: cephx 2024-09-19T11:55:13.313 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding auth protocol: cephx 2024-09-19T11:55:13.313 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding auth protocol: cephx 2024-09-19T11:55:13.313 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: secure 2024-09-19T11:55:13.314 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: crc 2024-09-19T11:55:13.314 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: secure 2024-09-19T11:55:13.314 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: crc 2024-09-19T11:55:13.314 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: secure 2024-09-19T11:55:13.314 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: crc 2024-09-19T11:55:13.314 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: crc 2024-09-19T11:55:13.314 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: secure 2024-09-19T11:55:13.314 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: crc 2024-09-19T11:55:13.314 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: secure 2024-09-19T11:55:13.314 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: crc 2024-09-19T11:55:13.314 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7fdb670) adding con mode: secure 2024-09-19T11:55:13.314 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.314 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 1 librados: starting msgr at 2024-09-19T11:55:13.314 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 1 librados: starting objecter 2024-09-19T11:55:13.314 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command objecter_requests hook 0x5650b7dcd430 2024-09-19T11:55:13.315 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 1 librados: setting wanted keys 2024-09-19T11:55:13.315 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 1 librados: calling monclient init 2024-09-19T11:55:13.315 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 10 monclient: init 2024-09-19T11:55:13.315 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding auth protocol: cephx 2024-09-19T11:55:13.315 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding auth protocol: cephx 2024-09-19T11:55:13.315 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding auth protocol: cephx 2024-09-19T11:55:13.315 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: secure 2024-09-19T11:55:13.315 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: crc 2024-09-19T11:55:13.315 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: secure 2024-09-19T11:55:13.315 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: crc 2024-09-19T11:55:13.315 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: secure 2024-09-19T11:55:13.315 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: crc 2024-09-19T11:55:13.315 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: crc 2024-09-19T11:55:13.315 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: secure 2024-09-19T11:55:13.316 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:55:12.890+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: crc 2024-09-19T11:55:13.316 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: secure 2024-09-19T11:55:13.316 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: crc 2024-09-19T11:55:13.316 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 5 AuthRegistry(0x5650b7faa380) adding con mode: secure 2024-09-19T11:55:13.316 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.316 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.316 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command rotate-key hook 0x5650b7faa4c8 2024-09-19T11:55:13.316 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:13.316 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T11:55:13.316 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-c con 0x5650b7e36cf0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:13.316 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-b con 0x5650b7e65e30 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:13.316 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-a con 0x5650b7ef3120 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:13.316 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.317 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.317 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.317 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:13.317 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient(hunting): authenticate will time out at 2207.208567s 2024-09-19T11:55:13.317 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:55:12.894+0000 7f0ca9f58640 10 monclient(hunting): get_auth_request con 0x5650b7e36cf0 auth_method 0 2024-09-19T11:55:13.317 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:55:12.894+0000 7f0ca9f58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.317 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:55:12.894+0000 7f0ca9f58640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.317 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:55:12.894+0000 7f0ca9f58640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.317 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): get_auth_request con 0x5650b7ef3120 auth_method 0 2024-09-19T11:55:13.317 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.317 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.317 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.317 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.317 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.318 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.318 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:55:12.894+0000 7f0ca9f58640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.318 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:55:12.894+0000 7f0ca9f58640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.318 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:55:12.894+0000 7f0ca9f58640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.318 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient(hunting): handle_auth_done global_id 6447 payload 824 2024-09-19T11:55:13.318 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient: _finish_hunting 0 2024-09-19T11:55:13.318 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:55:12.894+0000 7f0caa759640 1 monclient: found mon.noname-a 2024-09-19T11:55:13.318 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:55:12.894+0000 7f0caa759640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.318 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.318 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:13.318 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: dump: 2024-09-19T11:55:13.318 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.318 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.318 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.318 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.319 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.319 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.319 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.319 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.319 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.319 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.319 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: _finish_auth 0 2024-09-19T11:55:13.319 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: _check_auth_tickets 2024-09-19T11:55:13.319 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:13.319 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.319 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:13.319 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:55:12.894+0000 7f0b96604640 10 monclient: dump: 2024-09-19T11:55:13.319 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.319 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.319 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.320 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.320 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.320 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.320 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.320 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.320 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.320 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.320 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:55:12.894+0000 7f0b97e07640 4 set_mon_vals no callback set 2024-09-19T11:55:13.320 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 5 monclient: authenticate success, global_id 6447 2024-09-19T11:55:13.320 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient: _renew_subs 2024-09-19T11:55:13.320 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.320 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient: _renew_subs 2024-09-19T11:55:13.321 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.321 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:55:12.894+0000 7f0cac4529c0 1 librados: init done 2024-09-19T11:55:13.321 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:55:12.894+0000 7f0b96604640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:55:13.321 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:55:12.894+0000 7f0b96604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:13.321 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:55:12.894+0000 7f0b96604640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:13.321 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:55:12.898+0000 7f0ca9f58640 10 monclient: get_auth_request con 0x7f0b90071be0 auth_method 0 2024-09-19T11:55:13.321 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:55:12.898+0000 7f0ca9757640 10 monclient: get_auth_request con 0x5650b7fd24c0 auth_method 0 2024-09-19T11:55:13.321 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:55:12.898+0000 7f0ca9f58640 10 monclient: get_auth_request con 0x5650b7ff5210 auth_method 0 2024-09-19T11:55:13.321 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:55:12.898+0000 7f0ca9757640 10 monclient: get_auth_request con 0x5650b7ff9600 auth_method 0 2024-09-19T11:55:13.321 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient: get_auth_request con 0x5650b7ff8a70 auth_method 0 2024-09-19T11:55:13.321 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient: build_initial_monmap 2024-09-19T11:55:13.321 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:13.321 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient: monmap: 2024-09-19T11:55:13.321 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:13.322 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:13.322 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:13.322 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:13.322 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:13.322 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.322 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:13.322 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:13.322 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:13.322 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.322 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding auth protocol: cephx 2024-09-19T11:55:13.322 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding auth protocol: cephx 2024-09-19T11:55:13.322 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding auth protocol: cephx 2024-09-19T11:55:13.322 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: secure 2024-09-19T11:55:13.323 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: crc 2024-09-19T11:55:13.323 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: secure 2024-09-19T11:55:13.323 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: crc 2024-09-19T11:55:13.323 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: secure 2024-09-19T11:55:13.323 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: crc 2024-09-19T11:55:13.323 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: crc 2024-09-19T11:55:13.323 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: secure 2024-09-19T11:55:13.323 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: crc 2024-09-19T11:55:13.323 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: secure 2024-09-19T11:55:13.323 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: crc 2024-09-19T11:55:13.323 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b80016d0) adding con mode: secure 2024-09-19T11:55:13.323 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.323 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command objecter_requests cmddesc objecter_requests hook 0x5650b8005100 EEXIST 2024-09-19T11:55:13.324 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient: init 2024-09-19T11:55:13.324 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding auth protocol: cephx 2024-09-19T11:55:13.324 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding auth protocol: cephx 2024-09-19T11:55:13.324 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding auth protocol: cephx 2024-09-19T11:55:13.324 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: secure 2024-09-19T11:55:13.324 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: crc 2024-09-19T11:55:13.324 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: secure 2024-09-19T11:55:13.324 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: crc 2024-09-19T11:55:13.324 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: secure 2024-09-19T11:55:13.324 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: crc 2024-09-19T11:55:13.324 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: crc 2024-09-19T11:55:13.324 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: secure 2024-09-19T11:55:13.324 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: crc 2024-09-19T11:55:13.324 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: secure 2024-09-19T11:55:13.325 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: crc 2024-09-19T11:55:13.325 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8000618) adding con mode: secure 2024-09-19T11:55:13.325 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.325 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.325 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command rotate-key cmddesc rotate-key hook 0x5650b8000760 EEXIST 2024-09-19T11:55:13.325 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:13.325 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T11:55:13.325 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-a con 0x5650b80292b0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:13.325 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-c con 0x5650b8028be0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:13.325 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-b con 0x5650b80275c0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:13.325 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.325 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.325 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.326 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:13.326 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 10 monclient(hunting): authenticate will time out at 2207.219148s 2024-09-19T11:55:13.326 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): get_auth_request con 0x5650b8028be0 auth_method 0 2024-09-19T11:55:13.326 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.326 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.326 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.326 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:55:12.902+0000 7f0ca9757640 10 monclient(hunting): get_auth_request con 0x5650b80292b0 auth_method 0 2024-09-19T11:55:13.326 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:55:12.902+0000 7f0ca9757640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.326 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:55:12.902+0000 7f0ca9757640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.326 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:55:12.902+0000 7f0ca9757640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.326 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.326 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.326 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.326 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:55:12.902+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.327 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:55:12.902+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.327 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:55:12.902+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.327 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient(hunting): handle_auth_done global_id 6050 payload 824 2024-09-19T11:55:13.327 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient: _finish_hunting 0 2024-09-19T11:55:13.327 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:55:12.902+0000 7f0caa759640 1 monclient: found mon.noname-c 2024-09-19T11:55:13.327 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:55:12.902+0000 7f0caa759640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:55:13.327 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:55:12.902+0000 7f0ca9f58640 10 monclient: get_auth_request con 0x5650b80275c0 auth_method 0 2024-09-19T11:55:13.327 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.327 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:55:13.327 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: dump: 2024-09-19T11:55:13.327 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.327 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.327 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.328 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.328 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.328 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.328 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.328 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.328 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.328 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.328 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: _finish_auth 0 2024-09-19T11:55:13.328 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: _check_auth_tickets 2024-09-19T11:55:13.328 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:13.328 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.328 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:55:13.328 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:55:12.902+0000 7f0b8f7fe640 10 monclient: dump: 2024-09-19T11:55:13.328 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.329 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.329 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.329 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.329 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.329 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.329 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.329 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.329 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.329 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.329 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:55:12.902+0000 7f0cac4529c0 5 monclient: authenticate success, global_id 6050 2024-09-19T11:55:13.329 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:55:12.902+0000 7f0caaf5a640 4 set_mon_vals no callback set 2024-09-19T11:55:13.329 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: _renew_subs 2024-09-19T11:55:13.329 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:55:13.330 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: _renew_subs 2024-09-19T11:55:13.330 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:55:13.330 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:55:12.906+0000 7f0b8f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:55:13.330 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:55:12.906+0000 7f0b8f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:13.330 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:55:12.906+0000 7f0b8f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:13.330 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: get_monmap_and_config 2024-09-19T11:55:13.330 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: build_initial_monmap 2024-09-19T11:55:13.330 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:13.330 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: monmap: 2024-09-19T11:55:13.330 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:13.330 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:13.330 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:13.330 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:13.331 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:13.331 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.331 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:13.331 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:13.331 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:13.331 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.331 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding auth protocol: cephx 2024-09-19T11:55:13.331 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding auth protocol: cephx 2024-09-19T11:55:13.331 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding auth protocol: cephx 2024-09-19T11:55:13.331 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: secure 2024-09-19T11:55:13.331 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: crc 2024-09-19T11:55:13.331 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: secure 2024-09-19T11:55:13.331 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: crc 2024-09-19T11:55:13.331 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: secure 2024-09-19T11:55:13.332 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: crc 2024-09-19T11:55:13.332 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: crc 2024-09-19T11:55:13.332 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: secure 2024-09-19T11:55:13.332 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: crc 2024-09-19T11:55:13.332 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: secure 2024-09-19T11:55:13.332 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: crc 2024-09-19T11:55:13.332 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x5650b8048530) adding con mode: secure 2024-09-19T11:55:13.332 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient: get_auth_request con 0x7f0b84071b20 auth_method 0 2024-09-19T11:55:13.332 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.332 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: init 2024-09-19T11:55:13.332 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding auth protocol: cephx 2024-09-19T11:55:13.332 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding auth protocol: cephx 2024-09-19T11:55:13.332 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding auth protocol: cephx 2024-09-19T11:55:13.332 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: secure 2024-09-19T11:55:13.333 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: crc 2024-09-19T11:55:13.333 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: secure 2024-09-19T11:55:13.333 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: crc 2024-09-19T11:55:13.333 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: secure 2024-09-19T11:55:13.333 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: crc 2024-09-19T11:55:13.333 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: crc 2024-09-19T11:55:13.333 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: secure 2024-09-19T11:55:13.333 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: crc 2024-09-19T11:55:13.333 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: secure 2024-09-19T11:55:13.333 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: crc 2024-09-19T11:55:13.333 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d487fd0) adding con mode: secure 2024-09-19T11:55:13.333 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.333 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.333 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command rotate-key cmddesc rotate-key hook 0x7ffd5d488118 EEXIST 2024-09-19T11:55:13.334 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:13.334 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T11:55:13.334 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-c con 0x5650b807c930 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:13.334 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-a con 0x5650b806d460 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:13.334 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-b con 0x5650b8077d50 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:13.334 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.334 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.334 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.334 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:13.334 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:55:12.906+0000 7f0cac4529c0 10 monclient(hunting): authenticate will time out at 2207.223323s 2024-09-19T11:55:13.334 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): get_auth_request con 0x5650b806d460 auth_method 0 2024-09-19T11:55:13.334 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.334 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.334 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.335 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient(hunting): get_auth_request con 0x5650b807c930 auth_method 0 2024-09-19T11:55:13.335 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.335 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.335 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.335 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.335 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.335 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.335 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.335 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.335 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:55:12.906+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.335 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient(hunting): handle_auth_done global_id 6453 payload 274 2024-09-19T11:55:13.335 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient: _finish_hunting 0 2024-09-19T11:55:13.335 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:55:12.906+0000 7f0caa759640 1 monclient: found mon.noname-a 2024-09-19T11:55:13.336 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:55:12.906+0000 7f0caa759640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.336 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:55:12.906+0000 7f0ca9f58640 10 monclient: get_auth_request con 0x5650b8077d50 auth_method 0 2024-09-19T11:55:13.336 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.336 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:13.336 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: dump: 2024-09-19T11:55:13.336 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.336 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.336 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.336 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.336 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.336 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.336 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.336 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.336 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.337 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.337 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: _finish_auth 0 2024-09-19T11:55:13.337 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: _check_auth_tickets 2024-09-19T11:55:13.337 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:13.337 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 monclient: authenticate success, global_id 6453 2024-09-19T11:55:13.337 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: get_monmap_and_config success 2024-09-19T11:55:13.337 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 4 set_mon_vals no callback set 2024-09-19T11:55:13.337 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.337 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:13.337 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 10 monclient: dump: 2024-09-19T11:55:13.337 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.337 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.337 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.338 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.338 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.338 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.338 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.338 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.338 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.338 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.338 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: shutdown 2024-09-19T11:55:13.338 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: build_initial_monmap 2024-09-19T11:55:13.338 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:13.338 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: monmap: 2024-09-19T11:55:13.338 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:13.338 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:13.338 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:13.339 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:13.339 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:13.339 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.339 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:13.339 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:13.339 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:13.339 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.339 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding auth protocol: cephx 2024-09-19T11:55:13.339 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding auth protocol: cephx 2024-09-19T11:55:13.339 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding auth protocol: cephx 2024-09-19T11:55:13.339 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: secure 2024-09-19T11:55:13.339 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: crc 2024-09-19T11:55:13.339 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: secure 2024-09-19T11:55:13.340 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: crc 2024-09-19T11:55:13.340 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: secure 2024-09-19T11:55:13.340 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: crc 2024-09-19T11:55:13.340 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: crc 2024-09-19T11:55:13.340 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: secure 2024-09-19T11:55:13.340 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: crc 2024-09-19T11:55:13.340 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: secure 2024-09-19T11:55:13.340 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: crc 2024-09-19T11:55:13.340 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b806d910) adding con mode: secure 2024-09-19T11:55:13.340 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.340 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 1 librados: starting msgr at 2024-09-19T11:55:13.340 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 1 librados: starting objecter 2024-09-19T11:55:13.340 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command objecter_requests cmddesc objecter_requests hook 0x5650b804e5c0 EEXIST 2024-09-19T11:55:13.340 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 1 librados: setting wanted keys 2024-09-19T11:55:13.341 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 1 librados: calling monclient init 2024-09-19T11:55:13.341 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: init 2024-09-19T11:55:13.341 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding auth protocol: cephx 2024-09-19T11:55:13.341 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding auth protocol: cephx 2024-09-19T11:55:13.341 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding auth protocol: cephx 2024-09-19T11:55:13.341 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: secure 2024-09-19T11:55:13.341 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: crc 2024-09-19T11:55:13.341 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: secure 2024-09-19T11:55:13.341 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: crc 2024-09-19T11:55:13.341 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: secure 2024-09-19T11:55:13.341 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: crc 2024-09-19T11:55:13.341 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: crc 2024-09-19T11:55:13.341 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: secure 2024-09-19T11:55:13.341 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: crc 2024-09-19T11:55:13.342 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: secure 2024-09-19T11:55:13.342 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: crc 2024-09-19T11:55:13.342 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 AuthRegistry(0x5650b802b0d0) adding con mode: secure 2024-09-19T11:55:13.342 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.342 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.342 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command rotate-key cmddesc rotate-key hook 0x5650b802b218 EEXIST 2024-09-19T11:55:13.342 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:13.342 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T11:55:13.342 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-c con 0x5650b806d460 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:13.342 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-a con 0x5650b8077d50 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:13.342 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): picked mon.noname-b con 0x5650b807c930 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:13.342 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.342 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.342 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:13.343 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:13.343 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient(hunting): authenticate will time out at 2207.225976s 2024-09-19T11:55:13.343 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): get_auth_request con 0x5650b8077d50 auth_method 0 2024-09-19T11:55:13.343 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.343 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.343 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.343 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:55:12.910+0000 7f0ca9757640 10 monclient(hunting): get_auth_request con 0x5650b806d460 auth_method 0 2024-09-19T11:55:13.343 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:55:12.910+0000 7f0ca9757640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.343 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:55:12.910+0000 7f0ca9757640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.343 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:55:12.910+0000 7f0ca9757640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.343 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.343 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.343 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.344 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:55:12.910+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:13.344 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:55:12.910+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:13.344 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:55:12.910+0000 7f0ca9757640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:13.344 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:55:12.910+0000 7f0ca9f58640 10 monclient(hunting): get_auth_request con 0x5650b807c930 auth_method 0 2024-09-19T11:55:13.344 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:55:12.910+0000 7f0ca9f58640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:13.344 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:55:12.910+0000 7f0ca9f58640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:13.344 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:55:12.910+0000 7f0ca9f58640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:13.344 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient(hunting): handle_auth_done global_id 6456 payload 824 2024-09-19T11:55:13.344 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient: _finish_hunting 0 2024-09-19T11:55:13.344 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:55:12.910+0000 7f0caa759640 1 monclient: found mon.noname-a 2024-09-19T11:55:13.344 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:55:12.910+0000 7f0caa759640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.344 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.344 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:13.345 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: dump: 2024-09-19T11:55:13.345 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.345 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.345 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.345 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.345 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.345 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.345 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.345 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.345 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.345 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.345 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: _finish_auth 0 2024-09-19T11:55:13.345 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: _check_auth_tickets 2024-09-19T11:55:13.345 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:13.346 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:13.346 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:13.346 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:55:12.910+0000 7f0b7b7fe640 10 monclient: dump: 2024-09-19T11:55:13.346 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:13.346 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:13.346 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.346 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:13.346 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:13.346 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:13.346 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:13.346 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:13.346 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:13.346 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.347 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:55:12.910+0000 7f0b8d7fa640 4 set_mon_vals no callback set 2024-09-19T11:55:13.347 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 monclient: authenticate success, global_id 6456 2024-09-19T11:55:13.347 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: _renew_subs 2024-09-19T11:55:13.347 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.347 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: _renew_subs 2024-09-19T11:55:13.347 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.347 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 1 librados: init done 2024-09-19T11:55:13.347 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:55:12.910+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command cr dump hook 0x5650b804c8e8 2024-09-19T11:55:13.347 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.347 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:55:12.914+0000 7f0b7b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:55:13.347 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:55:12.914+0000 7f0b7b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:13.347 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:55:12.914+0000 7f0b7b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:13.347 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:55:12.914+0000 7f0ca9757640 10 monclient: get_auth_request con 0x7f0b74071be0 auth_method 0 2024-09-19T11:55:13.347 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:55:12.914+0000 7f0ca9f58640 10 monclient: get_auth_request con 0x5650b8095820 auth_method 0 2024-09-19T11:55:13.348 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.348 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 realm 2024-09-19T11:55:13.348 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.348 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.348 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:13.348 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.348 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.348 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:55:12.914+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.348 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:55:12.914+0000 7f0ca9757640 10 monclient: get_auth_request con 0x5650b8099b30 auth_method 0 2024-09-19T11:55:13.348 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:55:12.918+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:13.348 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:55:12.918+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.349 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:55:12.918+0000 7f0caa759640 10 monclient: get_auth_request con 0x5650b809d2a0 auth_method 0 2024-09-19T11:55:13.349 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:55:12.918+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:13.349 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:55:12.918+0000 7f0cac4529c0 20 searching for the correct realm 2024-09-19T11:55:13.349 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:55:12.918+0000 7f0ca9f58640 10 monclient: get_auth_request con 0x5650b80a2020 auth_method 0 2024-09-19T11:55:13.349 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:55:12.918+0000 7f0ca9757640 10 monclient: get_auth_request con 0x7f0c9c0d4040 auth_method 0 2024-09-19T11:55:13.349 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:55:12.922+0000 7f0caa759640 10 monclient: get_auth_request con 0x7f0ca0029040 auth_method 0 2024-09-19T11:55:13.349 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:55:12.922+0000 7f0caa759640 0 -- 172.21.15.120:0/3320961430 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f0ca0029040 msgr2=0x7f0ca0028920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:13.349 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:55:12.922+0000 7f0b7b7fe640 1 client.6456.objecter ms_handle_reset 0x7f0ca0029040 session 0x7f0ca0030040 osd.2 2024-09-19T11:55:13.349 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:55:12.922+0000 7f0b7b7fe640 10 monclient: _renew_subs 2024-09-19T11:55:13.349 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:55:12.922+0000 7f0b7b7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:13.349 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:55:12.922+0000 7f0caa759640 10 monclient: get_auth_request con 0x7f0b74082280 auth_method 0 2024-09-19T11:55:13.349 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:55:12.922+0000 7f0ca9f58640 10 monclient: get_auth_request con 0x7f0ca40a4050 auth_method 0 2024-09-19T11:55:13.349 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:55:12.930+0000 7f0ca9757640 10 monclient: get_auth_request con 0x7f0c9c0c3410 auth_method 0 2024-09-19T11:55:13.350 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:55:12.930+0000 7f0ca9757640 0 -- 172.21.15.120:0/3320961430 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f0c9c0c3410 msgr2=0x7f0c9c0c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:55:13.350 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:55:13.134+0000 7f0ca9757640 10 monclient: get_auth_request con 0x7f0c9c0c3410 auth_method 0 2024-09-19T11:55:13.350 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:13.350 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:13.350 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:13.350 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:13.350 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:13.350 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:13.350 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.350 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.350 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.350 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:13.350 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.350 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:13.351 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 zone default found 2024-09-19T11:55:13.351 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 4 Realm: () 2024-09-19T11:55:13.351 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:13.351 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:13.351 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:13.351 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 zonegroup default 2024-09-19T11:55:13.351 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.351 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.351 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:55:13.150+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.351 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:55:13.154+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.351 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:55:13.154+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.351 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:55:13.154+0000 7f0cac4529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.351 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:55:13.154+0000 7f0cac4529c0 20 started sync module instance, tier type = 2024-09-19T11:55:13.351 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:55:13.154+0000 7f0cac4529c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:13.352 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=0 2024-09-19T11:55:13.352 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=1 2024-09-19T11:55:13.352 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=2 2024-09-19T11:55:13.352 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=3 2024-09-19T11:55:13.352 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=4 2024-09-19T11:55:13.352 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=5 2024-09-19T11:55:13.352 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=6 2024-09-19T11:55:13.352 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 20 add_watcher() i=7 2024-09-19T11:55:13.352 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:55:13.178+0000 7f0cac4529c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:13.352 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding auth protocol: cephx 2024-09-19T11:55:13.352 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding auth protocol: cephx 2024-09-19T11:55:13.352 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding auth protocol: cephx 2024-09-19T11:55:13.353 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: secure 2024-09-19T11:55:13.353 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: crc 2024-09-19T11:55:13.353 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: secure 2024-09-19T11:55:13.353 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: crc 2024-09-19T11:55:13.353 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: secure 2024-09-19T11:55:13.353 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: crc 2024-09-19T11:55:13.353 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: crc 2024-09-19T11:55:13.353 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: secure 2024-09-19T11:55:13.353 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: crc 2024-09-19T11:55:13.353 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: secure 2024-09-19T11:55:13.353 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: crc 2024-09-19T11:55:13.353 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 AuthRegistry(0x7ffd5d4884a0) adding con mode: secure 2024-09-19T11:55:13.353 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:55:13.182+0000 7f0b5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:13.354 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:13.354 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:13.354 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:13.354 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command cache list hook 0x5650b80641f0 2024-09-19T11:55:13.354 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command cache inspect hook 0x5650b80641f0 2024-09-19T11:55:13.354 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command cache erase hook 0x5650b80641f0 2024-09-19T11:55:13.354 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command cache zap hook 0x5650b80641f0 2024-09-19T11:55:13.354 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:55:13.182+0000 7f0cac4529c0 5 note: GC not initialized 2024-09-19T11:55:13.354 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:55:13.186+0000 7f0b5a7fc640 20 reqs_thread_entry: start 2024-09-19T11:55:13.354 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command sync trace show hook 0x7f0ca0004980 2024-09-19T11:55:13.354 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command sync trace history hook 0x7f0ca0004980 2024-09-19T11:55:13.354 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command sync trace active hook 0x7f0ca0004980 2024-09-19T11:55:13.354 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 5 asok(0x5650b7d9cd90) register_command sync trace active_short hook 0x7f0ca0004980 2024-09-19T11:55:13.354 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:13.355 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 Filter name: none 2024-09-19T11:55:13.355 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:55:13.186+0000 7f0acffff640 20 reqs_thread_entry: start 2024-09-19T11:55:13.355 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-19T11:55:13.355 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.355 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T11:55:13.355 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-19T11:55:13.355 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-19T11:55:13.355 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 : miss 2024-09-19T11:55:13.355 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.355 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T11:55:13.355 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 info.flags=0x17 2024-09-19T11:55:13.355 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 to cache LRU end 2024-09-19T11:55:13.355 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:13.356 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:13.356 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:55:13.186+0000 7f0cac4529c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 2024-09-19T11:55:13.356 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:55:13.190+0000 7f0cac4529c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0cac4529c0 time 2024-09-19T11:55:13.190947+0000 2024-09-19T11:55:13.356 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:55:13.356 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.356 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:13.356 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0cafd2c2eb] 2024-09-19T11:55:13.356 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0cafd2c49f] 2024-09-19T11:55:13.356 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650b5413271] 2024-09-19T11:55:13.356 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x140fa02) [0x5650b5e63a02] 2024-09-19T11:55:13.356 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5650b54230dd] 2024-09-19T11:55:13.356 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:55:13.356 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0caeb92d90] 2024-09-19T11:55:13.356 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:55:13.357 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:55:13.357 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.357 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:55:13.194+0000 7f0cac4529c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:55:13.357 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f0cac4529c0 thread_name:radosgw-admin 2024-09-19T11:55:13.357 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.357 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:13.357 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0caebab520] 2024-09-19T11:55:13.357 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:55:13.357 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:55:13.357 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:55:13.357 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0cafd2c345] 2024-09-19T11:55:13.357 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0cafd2c49f] 2024-09-19T11:55:13.357 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5650b5413271] 2024-09-19T11:55:13.358 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x140fa02) [0x5650b5e63a02] 2024-09-19T11:55:13.358 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5650b54230dd] 2024-09-19T11:55:13.358 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:55:13.358 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0caeb92d90] 2024-09-19T11:55:13.358 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:55:13.358 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:55:13.358 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:55:13.358 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.358 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:55:13.358 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:55:13.358 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:55:13.358 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:55:13.358 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:55:13.359 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:55:13.359 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:55:13.359 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:55:13.359 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:55:13.359 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:55:13.359 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:55:13.359 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:55:13.359 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:55:13.359 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:55:13.359 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:55:13.359 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:55:13.359 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:55:13.359 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:55:13.360 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:55:13.360 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:55:13.360 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:55:13.360 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:55:13.360 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:55:13.360 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:55:13.360 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:55:13.360 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:55:13.360 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:55:13.360 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:55:13.360 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:55:13.360 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:55:13.360 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:55:13.361 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:55:13.361 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:55:13.361 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:55:13.361 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:55:13.361 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:55:13.361 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:55:13.361 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:55:13.361 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:55:13.361 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:55:13.361 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:55:13.361 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:55:13.361 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:55:13.361 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:55:13.362 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:55:13.362 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:55:13.362 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:55:13.362 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:55:13.362 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:55:13.362 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:55:13.362 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:55:13.362 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:55:13.362 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:55:13.363 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:55:13.363 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:55:13.363 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:55:13.363 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:55:13.363 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:55:13.363 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:55:13.363 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:55:13.363 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:55:13.363 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:55:13.363 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:55:13.363 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:55:13.363 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:55:13.363 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:55:13.363 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:55:13.363 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:55:13.364 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:55:13.364 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:55:13.364 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:55:13.364 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:55:13.364 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:55:13.364 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:55:13.364 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:55:13.364 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:55:13.364 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:55:13.364 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:55:13.364 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:55:13.364 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:55:13.364 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:55:13.364 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:55:13.365 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:55:13.365 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:55:13.365 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:55:13.365 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:55:13.365 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:55:13.365 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:55:13.365 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:55:13.365 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:55:13.365 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:55:13.365 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:55:13.365 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:55:13.365 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:55:13.365 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0acffff640 / http_manager 2024-09-19T11:55:13.365 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0b5a7fc640 / http_manager 2024-09-19T11:55:13.366 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0b5b7fe640 / rgw_dt_lg_renew 2024-09-19T11:55:13.366 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0b7b7fe640 / ms_dispatch 2024-09-19T11:55:13.366 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0b8d7fa640 / io_context_pool 2024-09-19T11:55:13.366 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0b8f7fe640 / ms_dispatch 2024-09-19T11:55:13.366 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0b96604640 / ms_dispatch 2024-09-19T11:55:13.366 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0b97e07640 / io_context_pool 2024-09-19T11:55:13.366 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0ca9757640 / msgr-worker-2 2024-09-19T11:55:13.366 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0ca9f58640 / msgr-worker-1 2024-09-19T11:55:13.366 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0caa759640 / msgr-worker-0 2024-09-19T11:55:13.366 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0caaf5a640 / io_context_pool 2024-09-19T11:55:13.366 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0cac4529c0 / radosgw-admin 2024-09-19T11:55:13.366 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:55:13.366 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:55:13.366 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/lib/ceph/crash/2024-09-19T11:55:13.197793Z_7449ea6e-9e03-44e5-bb71-484701bd69d2/log 2024-09-19T11:55:13.367 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:55:13.367 INFO:tasks.workunit.client.0.smithi120.stderr:Aborted 2024-09-19T11:55:13.367 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-19T11:55:13.367 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:13.367 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:13.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.282+0000 7f22c34939c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.286+0000 7f22c34939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.286+0000 7f22c34939c0 20 realm 2024-09-19T11:55:13.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.286+0000 7f22c34939c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.286+0000 7f22c34939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.286+0000 7f22c34939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:13.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.286+0000 7f22c34939c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.286+0000 7f22c34939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.286+0000 7f22c34939c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.286+0000 7f22c34939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:13.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.286+0000 7f22c34939c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.290+0000 7f22c34939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:13.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.290+0000 7f22c34939c0 20 searching for the correct realm 2024-09-19T11:55:13.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.294+0000 7f22c179a640 0 -- 172.21.15.120:0/4131136058 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f22b406ec20 msgr2=0x7f22b40790d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:13.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.298+0000 7f22c0798640 0 -- 172.21.15.120:0/4131136058 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7f22b0018040 msgr2=0x7f22b0030420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:55:13.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:13.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:13.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:13.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:13.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:13.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:13.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:13.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:13.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 20 zone default found 2024-09-19T11:55:13.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 4 Realm: () 2024-09-19T11:55:13.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:13.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:13.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:13.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 20 zonegroup default 2024-09-19T11:55:13.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.310+0000 7f22c34939c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.314+0000 7f22c34939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.314+0000 7f22c34939c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.314+0000 7f22c34939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.314+0000 7f22c34939c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.314+0000 7f22c34939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.314+0000 7f22c34939c0 20 started sync module instance, tier type = 2024-09-19T11:55:13.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.314+0000 7f22c34939c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:13.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.326+0000 7f22c34939c0 20 add_watcher() i=0 2024-09-19T11:55:13.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.326+0000 7f22c34939c0 20 add_watcher() i=1 2024-09-19T11:55:13.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.326+0000 7f22c34939c0 20 add_watcher() i=2 2024-09-19T11:55:13.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.326+0000 7f22c34939c0 20 add_watcher() i=3 2024-09-19T11:55:13.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.326+0000 7f22c34939c0 20 add_watcher() i=4 2024-09-19T11:55:13.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.326+0000 7f22c34939c0 20 add_watcher() i=5 2024-09-19T11:55:13.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.326+0000 7f22c34939c0 20 add_watcher() i=6 2024-09-19T11:55:13.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.330+0000 7f22c34939c0 20 add_watcher() i=7 2024-09-19T11:55:13.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.330+0000 7f22c34939c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:13.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.330+0000 7f21777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:13.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f22c34939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:13.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f22c34939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:13.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f22c34939c0 5 note: GC not initialized 2024-09-19T11:55:13.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f21767e4640 20 reqs_thread_entry: start 2024-09-19T11:55:13.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f22c34939c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:13.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f22c34939c0 20 Filter name: none 2024-09-19T11:55:13.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f216f7fe640 20 reqs_thread_entry: start 2024-09-19T11:55:13.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f22c34939c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f22c34939c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T11:55:13.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f22c34939c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f22c34939c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T11:55:13.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f22c34939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:13.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f22c34939c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f22c34939c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T11:55:13.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f22c34939c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.334+0000 7f22c34939c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T11:55:13.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.338+0000 7f22c34939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:13.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.338+0000 7f21777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:13.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.342+0000 7f22c34939c0 20 remove_watcher() i=0 2024-09-19T11:55:13.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.342+0000 7f22c34939c0 2 removed watcher, disabling cache 2024-09-19T11:55:13.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.346+0000 7f22c34939c0 20 remove_watcher() i=1 2024-09-19T11:55:13.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.346+0000 7f22c34939c0 20 remove_watcher() i=2 2024-09-19T11:55:13.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.350+0000 7f22c34939c0 20 remove_watcher() i=3 2024-09-19T11:55:13.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.350+0000 7f22c34939c0 20 remove_watcher() i=4 2024-09-19T11:55:13.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.354+0000 7f22c34939c0 20 remove_watcher() i=5 2024-09-19T11:55:13.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.354+0000 7f22c34939c0 20 remove_watcher() i=6 2024-09-19T11:55:13.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.354+0000 7f22c34939c0 20 remove_watcher() i=7 2024-09-19T11:55:13.378 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.378 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:13.378 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-init-indext id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:55:13.378 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:13.422 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:55:13.456 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:13.456 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:13.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.506+0000 7f4fa90679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.510+0000 7f4fa90679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.510+0000 7f4fa90679c0 20 realm 2024-09-19T11:55:13.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.510+0000 7f4fa90679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.510+0000 7f4fa90679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.510+0000 7f4fa90679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:13.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.510+0000 7f4fa90679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.510+0000 7f4fa90679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.510+0000 7f4fa90679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.510+0000 7f4fa90679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:13.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.510+0000 7f4fa90679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.514+0000 7f4fa90679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:13.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.514+0000 7f4fa90679c0 20 searching for the correct realm 2024-09-19T11:55:13.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.514+0000 7f4fa736e640 0 -- 172.21.15.120:0/404855785 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f4f9c01a040 msgr2=0x7f4f9c068720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:13.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.522+0000 7f4fa636c640 0 -- 172.21.15.120:0/404855785 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f4f98124be0 msgr2=0x7f4f980d2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:13.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.738+0000 7f4fa90679c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:13.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.738+0000 7f4fa90679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:13.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.738+0000 7f4fa90679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:13.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.738+0000 7f4fa90679c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:13.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.738+0000 7f4fa90679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:13.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.738+0000 7f4fa90679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:13.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.738+0000 7f4fa90679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.738+0000 7f4fa90679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.738+0000 7f4fa90679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.738+0000 7f4fa90679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:13.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.738+0000 7f4fa90679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.742+0000 7f4fa90679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:13.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.742+0000 7f4fa90679c0 20 zone default found 2024-09-19T11:55:13.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.742+0000 7f4fa90679c0 4 Realm: () 2024-09-19T11:55:13.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.742+0000 7f4fa90679c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:13.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.742+0000 7f4fa90679c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:13.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.742+0000 7f4fa90679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:13.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.742+0000 7f4fa90679c0 20 zonegroup default 2024-09-19T11:55:13.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.742+0000 7f4fa90679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.742+0000 7f4fa90679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.742+0000 7f4fa90679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.742+0000 7f4fa90679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.742+0000 7f4fa90679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.742+0000 7f4fa90679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:13.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.742+0000 7f4fa90679c0 20 started sync module instance, tier type = 2024-09-19T11:55:13.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.742+0000 7f4fa90679c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:13.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.766+0000 7f4fa90679c0 20 add_watcher() i=0 2024-09-19T11:55:13.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.766+0000 7f4fa90679c0 20 add_watcher() i=1 2024-09-19T11:55:13.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.766+0000 7f4fa90679c0 20 add_watcher() i=2 2024-09-19T11:55:13.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.766+0000 7f4fa90679c0 20 add_watcher() i=3 2024-09-19T11:55:13.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.766+0000 7f4fa90679c0 20 add_watcher() i=4 2024-09-19T11:55:13.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.766+0000 7f4fa90679c0 20 add_watcher() i=5 2024-09-19T11:55:13.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.766+0000 7f4fa90679c0 20 add_watcher() i=6 2024-09-19T11:55:13.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.766+0000 7f4fa90679c0 20 add_watcher() i=7 2024-09-19T11:55:13.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.766+0000 7f4fa90679c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:13.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.770+0000 7f4e5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:13.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.770+0000 7f4fa90679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:13.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.770+0000 7f4fa90679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:13.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.770+0000 7f4fa90679c0 5 note: GC not initialized 2024-09-19T11:55:13.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.770+0000 7f4e5cfe1640 20 reqs_thread_entry: start 2024-09-19T11:55:13.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.770+0000 7f4fa90679c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:13.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.770+0000 7f4fa90679c0 20 Filter name: none 2024-09-19T11:55:13.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.770+0000 7f4e55ffb640 20 reqs_thread_entry: start 2024-09-19T11:55:13.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.774+0000 7f4fa90679c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-19T11:55:13.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.774+0000 7f4fa90679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.774+0000 7f4fa90679c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T11:55:13.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.774+0000 7f4fa90679c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-19T11:55:13.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.774+0000 7f4fa90679c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-19T11:55:13.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.774+0000 7f4fa90679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 : miss 2024-09-19T11:55:13.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.774+0000 7f4fa90679c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:13.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.774+0000 7f4fa90679c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T11:55:13.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.774+0000 7f4fa90679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 info.flags=0x17 2024-09-19T11:55:13.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.774+0000 7f4fa90679c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 to cache LRU end 2024-09-19T11:55:13.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.774+0000 7f4fa90679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:13.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.774+0000 7f4fa90679c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:13.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.774+0000 7f4fa90679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 2024-09-19T11:55:13.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.774+0000 7f4fa90679c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 to be held by another RGW process; skipping for now 2024-09-19T11:55:13.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.778+0000 7f4e5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:13.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.782+0000 7f4fa90679c0 20 remove_watcher() i=0 2024-09-19T11:55:13.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.782+0000 7f4fa90679c0 2 removed watcher, disabling cache 2024-09-19T11:55:13.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.786+0000 7f4fa90679c0 20 remove_watcher() i=1 2024-09-19T11:55:13.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.786+0000 7f4fa90679c0 20 remove_watcher() i=2 2024-09-19T11:55:13.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.790+0000 7f4fa90679c0 20 remove_watcher() i=3 2024-09-19T11:55:13.787 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.790+0000 7f4fa90679c0 20 remove_watcher() i=4 2024-09-19T11:55:13.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.794+0000 7f4fa90679c0 20 remove_watcher() i=5 2024-09-19T11:55:13.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.794+0000 7f4fa90679c0 20 remove_watcher() i=6 2024-09-19T11:55:13.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:13.794+0000 7f4fa90679c0 20 remove_watcher() i=7 2024-09-19T11:55:13.809 INFO:tasks.workunit.client.0.smithi120.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T11:55:43.822 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:55:43.858 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:43.858 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:43.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:43.905+0000 7fb2c63089c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:43.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:43.905+0000 7fb2c63089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:43.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:43.905+0000 7fb2c63089c0 20 realm 2024-09-19T11:55:43.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:43.905+0000 7fb2c63089c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:43.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:43.909+0000 7fb2c63089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:43.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:43.909+0000 7fb2c63089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:43.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:43.909+0000 7fb2c63089c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:43.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:43.909+0000 7fb2c63089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:43.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:43.909+0000 7fb2c63089c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:43.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:43.909+0000 7fb2c63089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:43.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:43.909+0000 7fb2c63089c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:43.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:43.909+0000 7fb2c63089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:43.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:43.909+0000 7fb2c63089c0 20 searching for the correct realm 2024-09-19T11:55:43.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:43.913+0000 7fb2c460f640 0 -- 172.21.15.120:0/148223031 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fb2b8017030 msgr2=0x7fb2b8041400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:43.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:43.921+0000 7fb2c360d640 0 -- 172.21.15.120:0/148223031 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fb2b40e4040 msgr2=0x7fb2b40d4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:44.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.137+0000 7fb2c63089c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:44.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.137+0000 7fb2c63089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:44.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.137+0000 7fb2c63089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:44.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.137+0000 7fb2c63089c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:44.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.137+0000 7fb2c63089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:44.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.137+0000 7fb2c63089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:44.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.137+0000 7fb2c63089c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:44.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:44.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:44.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 20 zone default found 2024-09-19T11:55:44.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 4 Realm: () 2024-09-19T11:55:44.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:44.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:44.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:44.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 20 zonegroup default 2024-09-19T11:55:44.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:44.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:44.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.141+0000 7fb2c63089c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.145+0000 7fb2c63089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:44.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.145+0000 7fb2c63089c0 20 started sync module instance, tier type = 2024-09-19T11:55:44.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.145+0000 7fb2c63089c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:44.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.165+0000 7fb2c63089c0 20 add_watcher() i=0 2024-09-19T11:55:44.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.165+0000 7fb2c63089c0 20 add_watcher() i=1 2024-09-19T11:55:44.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.165+0000 7fb2c63089c0 20 add_watcher() i=2 2024-09-19T11:55:44.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.165+0000 7fb2c63089c0 20 add_watcher() i=3 2024-09-19T11:55:44.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.165+0000 7fb2c63089c0 20 add_watcher() i=4 2024-09-19T11:55:44.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.165+0000 7fb2c63089c0 20 add_watcher() i=5 2024-09-19T11:55:44.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.165+0000 7fb2c63089c0 20 add_watcher() i=6 2024-09-19T11:55:44.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.169+0000 7fb2c63089c0 20 add_watcher() i=7 2024-09-19T11:55:44.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.169+0000 7fb2c63089c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:44.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.173+0000 7fb17a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:44.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.173+0000 7fb2c63089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:44.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.173+0000 7fb2c63089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:44.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.173+0000 7fb2c63089c0 5 note: GC not initialized 2024-09-19T11:55:44.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.173+0000 7fb1797e2640 20 reqs_thread_entry: start 2024-09-19T11:55:44.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb2c63089c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:44.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb2c63089c0 20 Filter name: none 2024-09-19T11:55:44.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb1727fc640 20 reqs_thread_entry: start 2024-09-19T11:55:44.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb2c63089c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-19T11:55:44.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb2c63089c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb2c63089c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T11:55:44.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb2c63089c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-19T11:55:44.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb2c63089c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-19T11:55:44.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb2c63089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 : miss 2024-09-19T11:55:44.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb2c63089c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb2c63089c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T11:55:44.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb2c63089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 info.flags=0x17 2024-09-19T11:55:44.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb2c63089c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 to cache LRU end 2024-09-19T11:55:44.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb2c63089c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:44.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb2c63089c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:44.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.177+0000 7fb2c63089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 2024-09-19T11:55:44.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.185+0000 7fb2c63089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 info.flags=0x17 2024-09-19T11:55:44.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.185+0000 7fb2c63089c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 to cache LRU end 2024-09-19T11:55:44.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.185+0000 7fb2c63089c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:44.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.185+0000 7fb2c63089c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22, ofs0, ns] 2024-09-19T11:55:44.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.185+0000 7fb1a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366203 cookie 94668466376096 notifier 6510 bl.length()=997 2024-09-19T11:55:44.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.185+0000 7fb1a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 info.flags=0x17 2024-09-19T11:55:44.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.185+0000 7fb1a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 to cache LRU end 2024-09-19T11:55:44.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.185+0000 7fb1a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:44.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.189+0000 7fb2c63089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22]): orig_sources= new_sources= 2024-09-19T11:55:44.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.189+0000 7fb2c63089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22]): potential sources added=[] removed=[] 2024-09-19T11:55:44.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.189+0000 7fb2c63089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22]): orig_dests= new_dests= 2024-09-19T11:55:44.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.189+0000 7fb2c63089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22]): potential dests added=[] removed=[] 2024-09-19T11:55:44.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.189+0000 7fb2c63089c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22.1.0 2024-09-19T11:55:44.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.189+0000 7fb2c63089c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22.1.0 2024-09-19T11:55:44.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.189+0000 7fb2c63089c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22.1.1 2024-09-19T11:55:44.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.189+0000 7fb2c63089c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22.1.1 2024-09-19T11:55:44.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.189+0000 7fb2c63089c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22.0 2024-09-19T11:55:44.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.197+0000 7fb2c63089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 : hit (requested=0x17, cached=0x17) 2024-09-19T11:55:44.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.197+0000 7fb2c63089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 2024-09-19T11:55:44.196 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.201+0000 7fb2c63089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 info.flags=0x17 2024-09-19T11:55:44.196 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.201+0000 7fb2c63089c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 to cache LRU end 2024-09-19T11:55:44.197 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.201+0000 7fb2c63089c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:44.197 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.201+0000 7fb2c63089c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22, ofs0, ns] 2024-09-19T11:55:44.197 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.201+0000 7fb1a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366204 cookie 94668466376096 notifier 6510 bl.length()=997 2024-09-19T11:55:44.197 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.201+0000 7fb1a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 info.flags=0x17 2024-09-19T11:55:44.197 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.201+0000 7fb1a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 to cache LRU end 2024-09-19T11:55:44.197 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.201+0000 7fb1a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:44.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.201+0000 7fb2c63089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22]): orig_sources= new_sources= 2024-09-19T11:55:44.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.201+0000 7fb2c63089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22]): potential sources added=[] removed=[] 2024-09-19T11:55:44.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.201+0000 7fb2c63089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22]): orig_dests= new_dests= 2024-09-19T11:55:44.198 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.201+0000 7fb2c63089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22]): potential dests added=[] removed=[] 2024-09-19T11:55:44.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.201+0000 7fb2c63089c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22.0 2024-09-19T11:55:44.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.201+0000 7fb2c63089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 : hit (requested=0x17, cached=0x17) 2024-09-19T11:55:44.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.201+0000 7fb2c63089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 2024-09-19T11:55:44.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.205+0000 7fb2c63089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 info.flags=0x17 2024-09-19T11:55:44.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.205+0000 7fb2c63089c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 to cache LRU end 2024-09-19T11:55:44.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.205+0000 7fb2c63089c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:44.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.205+0000 7fb2c63089c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22, ofs0, ns] 2024-09-19T11:55:44.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.205+0000 7fb1a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366205 cookie 94668466376096 notifier 6510 bl.length()=965 2024-09-19T11:55:44.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.205+0000 7fb1a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 info.flags=0x17 2024-09-19T11:55:44.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.205+0000 7fb1a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 to cache LRU end 2024-09-19T11:55:44.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.205+0000 7fb1a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:44.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.209+0000 7fb2c63089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22]): orig_sources= new_sources= 2024-09-19T11:55:44.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.209+0000 7fb2c63089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22]): potential sources added=[] removed=[] 2024-09-19T11:55:44.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.209+0000 7fb2c63089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22]): orig_dests= new_dests= 2024-09-19T11:55:44.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.209+0000 7fb2c63089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22]): potential dests added=[] removed=[] 2024-09-19T11:55:44.206 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.209+0000 7fb2c63089c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 1 shards to 2 shards completed successfully 2024-09-19T11:55:44.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.213+0000 7fb17a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:44.215 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.217+0000 7fb2c63089c0 20 remove_watcher() i=0 2024-09-19T11:55:44.215 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.217+0000 7fb2c63089c0 2 removed watcher, disabling cache 2024-09-19T11:55:44.218 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.221+0000 7fb2c63089c0 20 remove_watcher() i=1 2024-09-19T11:55:44.220 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.221+0000 7fb2c63089c0 20 remove_watcher() i=2 2024-09-19T11:55:44.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.225+0000 7fb2c63089c0 20 remove_watcher() i=3 2024-09-19T11:55:44.225 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.229+0000 7fb2c63089c0 20 remove_watcher() i=4 2024-09-19T11:55:44.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.229+0000 7fb2c63089c0 20 remove_watcher() i=5 2024-09-19T11:55:44.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.229+0000 7fb2c63089c0 20 remove_watcher() i=6 2024-09-19T11:55:44.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.233+0000 7fb2c63089c0 20 remove_watcher() i=7 2024-09-19T11:55:44.246 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-19T11:55:44.274 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:44.274 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:44.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.321+0000 7f8b2a4559c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.321+0000 7f8b2a4559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:44.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.321+0000 7f8b2a4559c0 20 realm 2024-09-19T11:55:44.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.321+0000 7f8b2a4559c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.325+0000 7f8b2a4559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:44.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.325+0000 7f8b2a4559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:44.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.325+0000 7f8b2a4559c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.325+0000 7f8b2a4559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:44.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.325+0000 7f8b2a4559c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.325+0000 7f8b2a4559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:44.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.325+0000 7f8b2a4559c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.325+0000 7f8b2a4559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:44.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.325+0000 7f8b2a4559c0 20 searching for the correct realm 2024-09-19T11:55:44.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.329+0000 7f8b2875c640 0 -- 172.21.15.120:0/3465898118 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f8b10034420 msgr2=0x7f8b10034840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:44.545 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.545+0000 7f8b2775a640 0 -- 172.21.15.120:0/3465898118 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f8b18067040 msgr2=0x7f8b18072ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:44.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.761+0000 7f8b2a4559c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:44.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.761+0000 7f8b2a4559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:44.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.761+0000 7f8b2a4559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:44.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.761+0000 7f8b2a4559c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:44.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.761+0000 7f8b2a4559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:44.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.761+0000 7f8b2a4559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:44.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.765+0000 7f8b2a4559c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.765+0000 7f8b2a4559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:44.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.765+0000 7f8b2a4559c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.765+0000 7f8b2a4559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:44.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.765+0000 7f8b2a4559c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.765+0000 7f8b2a4559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:44.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.765+0000 7f8b2a4559c0 20 zone default found 2024-09-19T11:55:44.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.765+0000 7f8b2a4559c0 4 Realm: () 2024-09-19T11:55:44.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.765+0000 7f8b2a4559c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:44.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.765+0000 7f8b2a4559c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:44.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.765+0000 7f8b2a4559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:44.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.765+0000 7f8b2a4559c0 20 zonegroup default 2024-09-19T11:55:44.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.765+0000 7f8b2a4559c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.765+0000 7f8b2a4559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:44.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.765+0000 7f8b2a4559c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.769+0000 7f8b2a4559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:44.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.769+0000 7f8b2a4559c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.769+0000 7f8b2a4559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:44.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.769+0000 7f8b2a4559c0 20 started sync module instance, tier type = 2024-09-19T11:55:44.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.769+0000 7f8b2a4559c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:44.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.793+0000 7f8b2a4559c0 20 add_watcher() i=0 2024-09-19T11:55:44.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.793+0000 7f8b2a4559c0 20 add_watcher() i=1 2024-09-19T11:55:44.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.793+0000 7f8b2a4559c0 20 add_watcher() i=2 2024-09-19T11:55:44.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.793+0000 7f8b2a4559c0 20 add_watcher() i=3 2024-09-19T11:55:44.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.793+0000 7f8b2a4559c0 20 add_watcher() i=4 2024-09-19T11:55:44.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.793+0000 7f8b2a4559c0 20 add_watcher() i=5 2024-09-19T11:55:44.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.793+0000 7f8b2a4559c0 20 add_watcher() i=6 2024-09-19T11:55:44.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.797+0000 7f8b2a4559c0 20 add_watcher() i=7 2024-09-19T11:55:44.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.797+0000 7f8b2a4559c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:44.797 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.801+0000 7f89ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:44.798 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.801+0000 7f8b2a4559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:44.798 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.801+0000 7f8b2a4559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:44.798 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.801+0000 7f8b2a4559c0 5 note: GC not initialized 2024-09-19T11:55:44.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.801+0000 7f89dcfe1640 20 reqs_thread_entry: start 2024-09-19T11:55:44.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.801+0000 7f8b2a4559c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:44.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.801+0000 7f8b2a4559c0 20 Filter name: none 2024-09-19T11:55:44.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.801+0000 7f89567fc640 20 reqs_thread_entry: start 2024-09-19T11:55:44.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.801+0000 7f8b2a4559c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.801+0000 7f8b2a4559c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T11:55:44.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.801+0000 7f8b2a4559c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.805+0000 7f8b2a4559c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T11:55:44.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.805+0000 7f8b2a4559c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:44.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.805+0000 7f8b2a4559c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.805+0000 7f8b2a4559c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-19T11:55:44.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.805+0000 7f8b2a4559c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:44.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.805+0000 7f8b2a4559c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-19T11:55:44.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.805+0000 7f8b2a4559c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:44.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.809+0000 7f89ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:44.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.813+0000 7f8b2a4559c0 20 remove_watcher() i=0 2024-09-19T11:55:44.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.813+0000 7f8b2a4559c0 2 removed watcher, disabling cache 2024-09-19T11:55:44.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.817+0000 7f8b2a4559c0 20 remove_watcher() i=1 2024-09-19T11:55:44.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.817+0000 7f8b2a4559c0 20 remove_watcher() i=2 2024-09-19T11:55:44.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.821+0000 7f8b2a4559c0 20 remove_watcher() i=3 2024-09-19T11:55:44.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.821+0000 7f8b2a4559c0 20 remove_watcher() i=4 2024-09-19T11:55:44.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.825+0000 7f8b2a4559c0 20 remove_watcher() i=5 2024-09-19T11:55:44.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.825+0000 7f8b2a4559c0 20 remove_watcher() i=6 2024-09-19T11:55:44.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:44.825+0000 7f8b2a4559c0 20 remove_watcher() i=7 2024-09-19T11:55:44.838 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:44.838 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:44.838 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-init-indext id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T11:55:44.838 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:44.918 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-19T11:55:44.918 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:45.406 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-19T11:55:45.438 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:45.438 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:45.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.493+0000 7f0ab7f389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.493+0000 7f0ab7f389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:45.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.493+0000 7f0ab7f389c0 20 realm 2024-09-19T11:55:45.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.493+0000 7f0ab7f389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.493+0000 7f0ab7f389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:45.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.493+0000 7f0ab7f389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:45.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.493+0000 7f0ab7f389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.493+0000 7f0ab7f389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:45.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.493+0000 7f0ab7f389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.497+0000 7f0ab7f389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:45.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.497+0000 7f0ab7f389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.497+0000 7f0ab7f389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:45.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.497+0000 7f0ab7f389c0 20 searching for the correct realm 2024-09-19T11:55:45.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.501+0000 7f0ab623f640 0 -- 172.21.15.120:0/3964517163 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f0aac037060 msgr2=0x7f0aac07c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:45.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.509+0000 7f0ab523d640 0 -- 172.21.15.120:0/3964517163 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f0aa8093280 msgr2=0x7f0aa8066120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:45.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.725+0000 7f0ab7f389c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:45.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.725+0000 7f0ab7f389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:45.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.725+0000 7f0ab7f389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:45.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.725+0000 7f0ab7f389c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:45.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.725+0000 7f0ab7f389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:45.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.725+0000 7f0ab7f389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:45.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.725+0000 7f0ab7f389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.725+0000 7f0ab7f389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:45.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.725+0000 7f0ab7f389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:45.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:45.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 20 zone default found 2024-09-19T11:55:45.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 4 Realm: () 2024-09-19T11:55:45.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:45.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:45.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:45.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 20 zonegroup default 2024-09-19T11:55:45.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:45.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:45.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:45.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 20 started sync module instance, tier type = 2024-09-19T11:55:45.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.729+0000 7f0ab7f389c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:45.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.753+0000 7f0ab7f389c0 20 add_watcher() i=0 2024-09-19T11:55:45.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.753+0000 7f0ab7f389c0 20 add_watcher() i=1 2024-09-19T11:55:45.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.753+0000 7f0ab7f389c0 20 add_watcher() i=2 2024-09-19T11:55:45.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.753+0000 7f0ab7f389c0 20 add_watcher() i=3 2024-09-19T11:55:45.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.753+0000 7f0ab7f389c0 20 add_watcher() i=4 2024-09-19T11:55:45.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.753+0000 7f0ab7f389c0 20 add_watcher() i=5 2024-09-19T11:55:45.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.753+0000 7f0ab7f389c0 20 add_watcher() i=6 2024-09-19T11:55:45.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.753+0000 7f0ab7f389c0 20 add_watcher() i=7 2024-09-19T11:55:45.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.753+0000 7f0ab7f389c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:45.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.757+0000 7f095f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:45.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.761+0000 7f0ab7f389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:45.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.761+0000 7f0ab7f389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:45.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.761+0000 7f0ab7f389c0 5 note: GC not initialized 2024-09-19T11:55:45.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.761+0000 7f095e7fc640 20 reqs_thread_entry: start 2024-09-19T11:55:45.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.761+0000 7f0ab7f389c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:45.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.761+0000 7f0ab7f389c0 20 Filter name: none 2024-09-19T11:55:45.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.761+0000 7f08dbfff640 20 reqs_thread_entry: start 2024-09-19T11:55:45.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.761+0000 7f0ab7f389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.761+0000 7f0ab7f389c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:45.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.761+0000 7f0ab7f389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.765+0000 7f0ab7f389c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:45.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.765+0000 7f0ab7f389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:45.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.765+0000 7f0ab7f389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.765+0000 7f0ab7f389c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:45.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.765+0000 7f0ab7f389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.765+0000 7f0ab7f389c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:45.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.765+0000 7f0ab7f389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:45.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.769+0000 7f095f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:45.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.773+0000 7f0ab7f389c0 20 remove_watcher() i=0 2024-09-19T11:55:45.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.773+0000 7f0ab7f389c0 2 removed watcher, disabling cache 2024-09-19T11:55:45.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.777+0000 7f0ab7f389c0 20 remove_watcher() i=1 2024-09-19T11:55:45.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.777+0000 7f0ab7f389c0 20 remove_watcher() i=2 2024-09-19T11:55:45.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.781+0000 7f0ab7f389c0 20 remove_watcher() i=3 2024-09-19T11:55:45.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.781+0000 7f0ab7f389c0 20 remove_watcher() i=4 2024-09-19T11:55:45.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.785+0000 7f0ab7f389c0 20 remove_watcher() i=5 2024-09-19T11:55:45.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.785+0000 7f0ab7f389c0 20 remove_watcher() i=6 2024-09-19T11:55:45.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.785+0000 7f0ab7f389c0 20 remove_watcher() i=7 2024-09-19T11:55:45.798 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:45.798 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:45.798 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-set-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:55:45.798 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:45.798 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-19T11:55:45.834 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:45.834 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:45.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.881+0000 7fb5bfaa39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.881+0000 7fb5bfaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:45.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.881+0000 7fb5bfaa39c0 20 realm 2024-09-19T11:55:45.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.881+0000 7fb5bfaa39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.881+0000 7fb5bfaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:45.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.881+0000 7fb5bfaa39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:45.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.881+0000 7fb5bfaa39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.881+0000 7fb5bfaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:45.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.881+0000 7fb5bfaa39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.885+0000 7fb5bfaa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:45.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.885+0000 7fb5bfaa39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:45.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.885+0000 7fb5bfaa39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:45.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.885+0000 7fb5bfaa39c0 20 searching for the correct realm 2024-09-19T11:55:45.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:45.889+0000 7fb5bd5a9640 0 -- 172.21.15.120:0/3077364125 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fb5b0008050 msgr2=0x7fb5b0023ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:55:46.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.105+0000 7fb5bd5a9640 0 -- 172.21.15.120:0/3077364125 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fb5b0008050 msgr2=0x7fb5b0023ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:46.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:46.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:46.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:46.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:46.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:46.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:46.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:46.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:46.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 20 zone default found 2024-09-19T11:55:46.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 4 Realm: () 2024-09-19T11:55:46.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:46.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:46.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:46.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 20 zonegroup default 2024-09-19T11:55:46.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.117+0000 7fb5bfaa39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.121+0000 7fb5bfaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.121+0000 7fb5bfaa39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.121+0000 7fb5bfaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.121+0000 7fb5bfaa39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.121+0000 7fb5bfaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.121+0000 7fb5bfaa39c0 20 started sync module instance, tier type = 2024-09-19T11:55:46.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.121+0000 7fb5bfaa39c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:46.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.141+0000 7fb5bfaa39c0 20 add_watcher() i=0 2024-09-19T11:55:46.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.141+0000 7fb5bfaa39c0 20 add_watcher() i=1 2024-09-19T11:55:46.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.141+0000 7fb5bfaa39c0 20 add_watcher() i=2 2024-09-19T11:55:46.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.141+0000 7fb5bfaa39c0 20 add_watcher() i=3 2024-09-19T11:55:46.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.141+0000 7fb5bfaa39c0 20 add_watcher() i=4 2024-09-19T11:55:46.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.141+0000 7fb5bfaa39c0 20 add_watcher() i=5 2024-09-19T11:55:46.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.141+0000 7fb5bfaa39c0 20 add_watcher() i=6 2024-09-19T11:55:46.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.145+0000 7fb5bfaa39c0 20 add_watcher() i=7 2024-09-19T11:55:46.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.145+0000 7fb5bfaa39c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:46.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.149+0000 7fb473fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:46.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.149+0000 7fb5bfaa39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:46.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.149+0000 7fb5bfaa39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:46.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.149+0000 7fb5bfaa39c0 5 note: GC not initialized 2024-09-19T11:55:46.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.149+0000 7fb472fe5640 20 reqs_thread_entry: start 2024-09-19T11:55:46.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.149+0000 7fb5bfaa39c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:46.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.149+0000 7fb5bfaa39c0 20 Filter name: none 2024-09-19T11:55:46.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.149+0000 7fb470fe1640 20 reqs_thread_entry: start 2024-09-19T11:55:46.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.149+0000 7fb5bfaa39c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-19T11:55:46.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.149+0000 7fb5bfaa39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.149+0000 7fb5bfaa39c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:46.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.149+0000 7fb5bfaa39c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-19T11:55:46.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.149+0000 7fb5bfaa39c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-19T11:55:46.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.149+0000 7fb5bfaa39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 : miss 2024-09-19T11:55:46.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.149+0000 7fb5bfaa39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.153+0000 7fb5bfaa39c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:46.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.153+0000 7fb5bfaa39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 info.flags=0x17 2024-09-19T11:55:46.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.153+0000 7fb5bfaa39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 to cache LRU end 2024-09-19T11:55:46.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.153+0000 7fb5bfaa39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:46.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.153+0000 7fb5bfaa39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:46.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.153+0000 7fb5bfaa39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 2024-09-19T11:55:46.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.157+0000 7fb5bfaa39c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-19T11:55:46.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.157+0000 7fb5bfaa39c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-19T11:55:46.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.165+0000 7fb473fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:46.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.169+0000 7fb5bfaa39c0 20 remove_watcher() i=0 2024-09-19T11:55:46.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.169+0000 7fb5bfaa39c0 2 removed watcher, disabling cache 2024-09-19T11:55:46.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.169+0000 7fb5bfaa39c0 20 remove_watcher() i=1 2024-09-19T11:55:46.169 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.173+0000 7fb5bfaa39c0 20 remove_watcher() i=2 2024-09-19T11:55:46.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.173+0000 7fb5bfaa39c0 20 remove_watcher() i=3 2024-09-19T11:55:46.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.177+0000 7fb5bfaa39c0 20 remove_watcher() i=4 2024-09-19T11:55:46.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.177+0000 7fb5bfaa39c0 20 remove_watcher() i=5 2024-09-19T11:55:46.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.181+0000 7fb5bfaa39c0 20 remove_watcher() i=6 2024-09-19T11:55:46.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.181+0000 7fb5bfaa39c0 20 remove_watcher() i=7 2024-09-19T11:55:46.194 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-19T11:55:46.221 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:46.222 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:46.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.269+0000 7f7eb3a389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.269+0000 7f7eb3a389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.269+0000 7f7eb3a389c0 20 realm 2024-09-19T11:55:46.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.269+0000 7f7eb3a389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.273+0000 7f7eb3a389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.273+0000 7f7eb3a389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:46.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.273+0000 7f7eb3a389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.273+0000 7f7eb3a389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.273+0000 7f7eb3a389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.270 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.273+0000 7f7eb3a389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:46.270 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.273+0000 7f7eb3a389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.272 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.273+0000 7f7eb3a389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:46.272 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.273+0000 7f7eb3a389c0 20 searching for the correct realm 2024-09-19T11:55:46.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.277+0000 7f7eb153e640 0 -- 172.21.15.120:0/650976050 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f7eac110070 msgr2=0x7f7eac0f7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:55:46.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.493+0000 7f7eb153e640 0 -- 172.21.15.120:0/650976050 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f7eac110070 msgr2=0x7f7eac0f7f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:46.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:46.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:46.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:46.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:46.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:46.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:46.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:46.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:46.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 20 zone default found 2024-09-19T11:55:46.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 4 Realm: () 2024-09-19T11:55:46.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:46.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:46.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:46.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 20 zonegroup default 2024-09-19T11:55:46.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.505+0000 7f7eb3a389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.509+0000 7f7eb3a389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.509+0000 7f7eb3a389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.509+0000 7f7eb3a389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.509+0000 7f7eb3a389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.509+0000 7f7eb3a389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.509+0000 7f7eb3a389c0 20 started sync module instance, tier type = 2024-09-19T11:55:46.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.509+0000 7f7eb3a389c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:46.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.533+0000 7f7eb3a389c0 20 add_watcher() i=0 2024-09-19T11:55:46.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.533+0000 7f7eb3a389c0 20 add_watcher() i=1 2024-09-19T11:55:46.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.533+0000 7f7eb3a389c0 20 add_watcher() i=2 2024-09-19T11:55:46.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.533+0000 7f7eb3a389c0 20 add_watcher() i=3 2024-09-19T11:55:46.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.533+0000 7f7eb3a389c0 20 add_watcher() i=4 2024-09-19T11:55:46.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.533+0000 7f7eb3a389c0 20 add_watcher() i=5 2024-09-19T11:55:46.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.533+0000 7f7eb3a389c0 20 add_watcher() i=6 2024-09-19T11:55:46.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.533+0000 7f7eb3a389c0 20 add_watcher() i=7 2024-09-19T11:55:46.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.533+0000 7f7eb3a389c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:46.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.537+0000 7f7d67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:46.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.537+0000 7f7eb3a389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:46.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.537+0000 7f7eb3a389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:46.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.537+0000 7f7eb3a389c0 5 note: GC not initialized 2024-09-19T11:55:46.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.541+0000 7f7d66fe5640 20 reqs_thread_entry: start 2024-09-19T11:55:46.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.541+0000 7f7eb3a389c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:46.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.541+0000 7f7eb3a389c0 20 Filter name: none 2024-09-19T11:55:46.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.541+0000 7f7d64fe1640 20 reqs_thread_entry: start 2024-09-19T11:55:46.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.541+0000 7f7eb3a389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.541+0000 7f7eb3a389c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:46.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.541+0000 7f7eb3a389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.541+0000 7f7eb3a389c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:46.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.541+0000 7f7eb3a389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:46.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.541+0000 7f7eb3a389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.541+0000 7f7eb3a389c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:46.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.541+0000 7f7eb3a389c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.545+0000 7f7eb3a389c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:46.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.545+0000 7f7eb3a389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:46.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.545+0000 7f7d67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:46.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.549+0000 7f7eb3a389c0 20 remove_watcher() i=0 2024-09-19T11:55:46.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.549+0000 7f7eb3a389c0 2 removed watcher, disabling cache 2024-09-19T11:55:46.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.553+0000 7f7eb3a389c0 20 remove_watcher() i=1 2024-09-19T11:55:46.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.553+0000 7f7eb3a389c0 20 remove_watcher() i=2 2024-09-19T11:55:46.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.557+0000 7f7eb3a389c0 20 remove_watcher() i=3 2024-09-19T11:55:46.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.561+0000 7f7eb3a389c0 20 remove_watcher() i=4 2024-09-19T11:55:46.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.561+0000 7f7eb3a389c0 20 remove_watcher() i=5 2024-09-19T11:55:46.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.561+0000 7f7eb3a389c0 20 remove_watcher() i=6 2024-09-19T11:55:46.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.565+0000 7f7eb3a389c0 20 remove_watcher() i=7 2024-09-19T11:55:46.577 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:46.577 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:46.577 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-set-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:55:46.577 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:46.633 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:55:46.670 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:46.670 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:46.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.721+0000 7fe0622ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.721+0000 7fe0622ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.721+0000 7fe0622ae9c0 20 realm 2024-09-19T11:55:46.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.721+0000 7fe0622ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.721+0000 7fe0622ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.721+0000 7fe0622ae9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:46.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.721+0000 7fe0622ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.721+0000 7fe0622ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.721+0000 7fe0622ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.725+0000 7fe0622ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:46.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.725+0000 7fe0622ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.729+0000 7fe0622ae9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:46.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.729+0000 7fe0622ae9c0 20 searching for the correct realm 2024-09-19T11:55:46.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.729+0000 7fe05f5b3640 0 -- 172.21.15.120:0/466889184 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7fe050008050 msgr2=0x7fe050066450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:55:46.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.941+0000 7fe0605b5640 0 -- 172.21.15.120:0/466889184 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fe0540fd040 msgr2=0x7fe0540ffcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:46.958 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:46.958 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:46.958 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:46.958 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:46.958 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:46.958 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:46.958 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:46.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:46.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 20 zone default found 2024-09-19T11:55:46.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 4 Realm: () 2024-09-19T11:55:46.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:46.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:46.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:46.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 20 zonegroup default 2024-09-19T11:55:46.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.961+0000 7fe0622ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.965+0000 7fe0622ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.965+0000 7fe0622ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.965+0000 7fe0622ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.965+0000 7fe0622ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.965+0000 7fe0622ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:46.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.965+0000 7fe0622ae9c0 20 started sync module instance, tier type = 2024-09-19T11:55:46.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.965+0000 7fe0622ae9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:46.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.989+0000 7fe0622ae9c0 20 add_watcher() i=0 2024-09-19T11:55:46.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.989+0000 7fe0622ae9c0 20 add_watcher() i=1 2024-09-19T11:55:46.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.989+0000 7fe0622ae9c0 20 add_watcher() i=2 2024-09-19T11:55:46.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.989+0000 7fe0622ae9c0 20 add_watcher() i=3 2024-09-19T11:55:46.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.989+0000 7fe0622ae9c0 20 add_watcher() i=4 2024-09-19T11:55:46.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.989+0000 7fe0622ae9c0 20 add_watcher() i=5 2024-09-19T11:55:46.988 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.989+0000 7fe0622ae9c0 20 add_watcher() i=6 2024-09-19T11:55:46.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.993+0000 7fe0622ae9c0 20 add_watcher() i=7 2024-09-19T11:55:46.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.993+0000 7fe0622ae9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:46.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.997+0000 7fdf15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:46.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.997+0000 7fe0622ae9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:46.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.997+0000 7fe0622ae9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:46.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.997+0000 7fe0622ae9c0 5 note: GC not initialized 2024-09-19T11:55:46.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.997+0000 7fdf14fe1640 20 reqs_thread_entry: start 2024-09-19T11:55:46.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.997+0000 7fe0622ae9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:46.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.997+0000 7fe0622ae9c0 20 Filter name: none 2024-09-19T11:55:46.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:46.997+0000 7fde8e7fc640 20 reqs_thread_entry: start 2024-09-19T11:55:46.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.001+0000 7fe0622ae9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-19T11:55:46.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.001+0000 7fe0622ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.001+0000 7fe0622ae9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:46.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.001+0000 7fe0622ae9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-19T11:55:46.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.001+0000 7fe0622ae9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-19T11:55:46.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.001+0000 7fe0622ae9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 : miss 2024-09-19T11:55:46.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.001+0000 7fe0622ae9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:46.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.001+0000 7fe0622ae9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:46.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.001+0000 7fe0622ae9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 info.flags=0x17 2024-09-19T11:55:46.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.001+0000 7fe0622ae9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 to cache LRU end 2024-09-19T11:55:46.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.001+0000 7fe0622ae9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:46.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.001+0000 7fe0622ae9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:46.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.001+0000 7fe0622ae9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 2024-09-19T11:55:47.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.013+0000 7fe0622ae9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 info.flags=0x17 2024-09-19T11:55:47.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.013+0000 7fe0622ae9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 to cache LRU end 2024-09-19T11:55:47.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.013+0000 7fe0622ae9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:47.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.013+0000 7fe0622ae9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23, ofs0, ns] 2024-09-19T11:55:47.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.013+0000 7fdf3effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 94687291457840 notifier 6606 bl.length()=1009 2024-09-19T11:55:47.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.017+0000 7fdf3effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 info.flags=0x17 2024-09-19T11:55:47.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.017+0000 7fdf3effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 to cache LRU end 2024-09-19T11:55:47.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.017+0000 7fdf3effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:47.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.017+0000 7fe0622ae9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23]): orig_sources= new_sources= 2024-09-19T11:55:47.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.017+0000 7fe0622ae9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23]): potential sources added=[] removed=[] 2024-09-19T11:55:47.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.017+0000 7fe0622ae9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23]): orig_dests= new_dests= 2024-09-19T11:55:47.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.017+0000 7fe0622ae9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23]): potential dests added=[] removed=[] 2024-09-19T11:55:47.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.021+0000 7fe0622ae9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23.1.0 2024-09-19T11:55:47.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.021+0000 7fe0622ae9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23.1.0 2024-09-19T11:55:47.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.021+0000 7fe0622ae9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23.1.1 2024-09-19T11:55:47.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.021+0000 7fe0622ae9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23.1.1 2024-09-19T11:55:47.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.021+0000 7fe0622ae9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23.0 2024-09-19T11:55:47.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.025+0000 7fe0622ae9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 : hit (requested=0x17, cached=0x17) 2024-09-19T11:55:47.022 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.025+0000 7fe0622ae9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 2024-09-19T11:55:47.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.029+0000 7fe0622ae9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 info.flags=0x17 2024-09-19T11:55:47.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.029+0000 7fe0622ae9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 to cache LRU end 2024-09-19T11:55:47.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.029+0000 7fe0622ae9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:47.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.029+0000 7fe0622ae9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23, ofs0, ns] 2024-09-19T11:55:47.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.029+0000 7fdf3effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366171 cookie 94687291457840 notifier 6606 bl.length()=1009 2024-09-19T11:55:47.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.029+0000 7fdf3effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 info.flags=0x17 2024-09-19T11:55:47.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.029+0000 7fdf3effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 to cache LRU end 2024-09-19T11:55:47.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.029+0000 7fdf3effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:47.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.029+0000 7fe0622ae9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23]): orig_sources= new_sources= 2024-09-19T11:55:47.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.029+0000 7fe0622ae9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23]): potential sources added=[] removed=[] 2024-09-19T11:55:47.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.029+0000 7fe0622ae9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23]): orig_dests= new_dests= 2024-09-19T11:55:47.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.029+0000 7fe0622ae9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23]): potential dests added=[] removed=[] 2024-09-19T11:55:47.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.033+0000 7fe0622ae9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23.0 2024-09-19T11:55:47.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.033+0000 7fe0622ae9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 : hit (requested=0x17, cached=0x17) 2024-09-19T11:55:47.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.033+0000 7fe0622ae9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 2024-09-19T11:55:47.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.037+0000 7fe0622ae9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 info.flags=0x17 2024-09-19T11:55:47.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.037+0000 7fe0622ae9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 to cache LRU end 2024-09-19T11:55:47.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.037+0000 7fe0622ae9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:47.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.037+0000 7fe0622ae9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23, ofs0, ns] 2024-09-19T11:55:47.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.037+0000 7fdf3e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366172 cookie 94687291457840 notifier 6606 bl.length()=977 2024-09-19T11:55:47.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.037+0000 7fdf3e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 info.flags=0x17 2024-09-19T11:55:47.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.037+0000 7fdf3e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 to cache LRU end 2024-09-19T11:55:47.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.037+0000 7fdf3e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:47.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.037+0000 7fe0622ae9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23]): orig_sources= new_sources= 2024-09-19T11:55:47.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.037+0000 7fe0622ae9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23]): potential sources added=[] removed=[] 2024-09-19T11:55:47.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.037+0000 7fe0622ae9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23]): orig_dests= new_dests= 2024-09-19T11:55:47.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.037+0000 7fe0622ae9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23]): potential dests added=[] removed=[] 2024-09-19T11:55:47.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.041+0000 7fe0622ae9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-19T11:55:47.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.045+0000 7fdf15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:47.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.049+0000 7fe0622ae9c0 20 remove_watcher() i=0 2024-09-19T11:55:47.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.049+0000 7fe0622ae9c0 2 removed watcher, disabling cache 2024-09-19T11:55:47.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.053+0000 7fe0622ae9c0 20 remove_watcher() i=1 2024-09-19T11:55:47.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.053+0000 7fe0622ae9c0 20 remove_watcher() i=2 2024-09-19T11:55:47.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.057+0000 7fe0622ae9c0 20 remove_watcher() i=3 2024-09-19T11:55:47.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.057+0000 7fe0622ae9c0 20 remove_watcher() i=4 2024-09-19T11:55:47.057 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.061+0000 7fe0622ae9c0 20 remove_watcher() i=5 2024-09-19T11:55:47.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.061+0000 7fe0622ae9c0 20 remove_watcher() i=6 2024-09-19T11:55:47.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.065+0000 7fe0622ae9c0 20 remove_watcher() i=7 2024-09-19T11:55:47.077 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-19T11:55:47.110 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:47.110 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:47.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.161+0000 7f888b56d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:47.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.161+0000 7f888b56d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:47.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.161+0000 7f888b56d9c0 20 realm 2024-09-19T11:55:47.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.161+0000 7f888b56d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:47.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.161+0000 7f888b56d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:47.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.161+0000 7f888b56d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:47.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.161+0000 7f888b56d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:47.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.161+0000 7f888b56d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:47.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.161+0000 7f888b56d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:47.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.165+0000 7f888b56d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:47.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.165+0000 7f888b56d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:47.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.165+0000 7f888b56d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:47.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.165+0000 7f888b56d9c0 20 searching for the correct realm 2024-09-19T11:55:47.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.169+0000 7f8889874640 0 -- 172.21.15.120:0/3985742722 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f8880049040 msgr2=0x7f888006c330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:47.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.381+0000 7f8888872640 0 -- 172.21.15.120:0/3985742722 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f887c0c5920 msgr2=0x7f887c0e4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:47.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.597+0000 7f888b56d9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:47.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.597+0000 7f888b56d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:47.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.597+0000 7f888b56d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:47.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.597+0000 7f888b56d9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:47.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.597+0000 7f888b56d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:47.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.597+0000 7f888b56d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:47.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.597+0000 7f888b56d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:47.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.597+0000 7f888b56d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:47.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.597+0000 7f888b56d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:47.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:47.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:47.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:47.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 20 zone default found 2024-09-19T11:55:47.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 4 Realm: () 2024-09-19T11:55:47.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:47.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:47.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:47.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 20 zonegroup default 2024-09-19T11:55:47.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:47.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:47.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:47.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:47.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:47.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:47.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 20 started sync module instance, tier type = 2024-09-19T11:55:47.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.601+0000 7f888b56d9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:47.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.621+0000 7f888b56d9c0 20 add_watcher() i=0 2024-09-19T11:55:47.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.621+0000 7f888b56d9c0 20 add_watcher() i=1 2024-09-19T11:55:47.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.621+0000 7f888b56d9c0 20 add_watcher() i=2 2024-09-19T11:55:47.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.621+0000 7f888b56d9c0 20 add_watcher() i=3 2024-09-19T11:55:47.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.621+0000 7f888b56d9c0 20 add_watcher() i=4 2024-09-19T11:55:47.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.621+0000 7f888b56d9c0 20 add_watcher() i=5 2024-09-19T11:55:47.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.621+0000 7f888b56d9c0 20 add_watcher() i=6 2024-09-19T11:55:47.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.625+0000 7f888b56d9c0 20 add_watcher() i=7 2024-09-19T11:55:47.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.625+0000 7f888b56d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:47.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.629+0000 7f873f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:47.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.629+0000 7f888b56d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:47.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.629+0000 7f888b56d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:47.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.629+0000 7f888b56d9c0 5 note: GC not initialized 2024-09-19T11:55:47.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.629+0000 7f873e7e4640 20 reqs_thread_entry: start 2024-09-19T11:55:47.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.629+0000 7f888b56d9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:47.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.629+0000 7f888b56d9c0 20 Filter name: none 2024-09-19T11:55:47.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.629+0000 7f86affff640 20 reqs_thread_entry: start 2024-09-19T11:55:47.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.629+0000 7f888b56d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:47.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.633+0000 7f888b56d9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:47.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.633+0000 7f888b56d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:47.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.633+0000 7f888b56d9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:47.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.633+0000 7f888b56d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:47.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.633+0000 7f888b56d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:47.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.633+0000 7f888b56d9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:47.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.633+0000 7f888b56d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:47.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.633+0000 7f888b56d9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:47.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.633+0000 7f888b56d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:47.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.637+0000 7f873f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:47.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.641+0000 7f888b56d9c0 20 remove_watcher() i=0 2024-09-19T11:55:47.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.641+0000 7f888b56d9c0 2 removed watcher, disabling cache 2024-09-19T11:55:47.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.645+0000 7f888b56d9c0 20 remove_watcher() i=1 2024-09-19T11:55:47.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.649+0000 7f888b56d9c0 20 remove_watcher() i=2 2024-09-19T11:55:47.646 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.649+0000 7f888b56d9c0 20 remove_watcher() i=3 2024-09-19T11:55:47.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.653+0000 7f888b56d9c0 20 remove_watcher() i=4 2024-09-19T11:55:47.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.653+0000 7f888b56d9c0 20 remove_watcher() i=5 2024-09-19T11:55:47.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.653+0000 7f888b56d9c0 20 remove_watcher() i=6 2024-09-19T11:55:47.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:47.657+0000 7f888b56d9c0 20 remove_watcher() i=7 2024-09-19T11:55:47.669 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:47.669 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:47.670 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-set-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T11:55:47.670 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:47.748 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-19T11:55:47.748 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:48.209 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-19T11:55:48.242 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:48.242 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:48.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.293+0000 7f1277cbd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.293+0000 7f1277cbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:48.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.293+0000 7f1277cbd9c0 20 realm 2024-09-19T11:55:48.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.293+0000 7f1277cbd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.293+0000 7f1277cbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:48.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.293+0000 7f1277cbd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:48.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.293+0000 7f1277cbd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.292 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.293+0000 7f1277cbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:48.292 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.293+0000 7f1277cbd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.297+0000 7f1277cbd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:48.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.297+0000 7f1277cbd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.297+0000 7f1277cbd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:48.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.297+0000 7f1277cbd9c0 20 searching for the correct realm 2024-09-19T11:55:48.298 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.301+0000 7f12757c3640 0 -- 172.21.15.120:0/2205697386 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f127002b070 msgr2=0x7f1270044ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:48.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.517+0000 7f12757c3640 0 -- 172.21.15.120:0/2205697386 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f127002b070 msgr2=0x7f1270044ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:48.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.529+0000 7f1277cbd9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:48.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.529+0000 7f1277cbd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:48.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.529+0000 7f1277cbd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:48.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.529+0000 7f1277cbd9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:48.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.529+0000 7f1277cbd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:48.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.529+0000 7f1277cbd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:48.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.529+0000 7f1277cbd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.529+0000 7f1277cbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:48.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.529+0000 7f1277cbd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:48.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:48.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 20 zone default found 2024-09-19T11:55:48.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 4 Realm: () 2024-09-19T11:55:48.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:48.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:48.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:48.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 20 zonegroup default 2024-09-19T11:55:48.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:48.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:48.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:48.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 20 started sync module instance, tier type = 2024-09-19T11:55:48.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.533+0000 7f1277cbd9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:48.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.557+0000 7f1277cbd9c0 20 add_watcher() i=0 2024-09-19T11:55:48.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.557+0000 7f1277cbd9c0 20 add_watcher() i=1 2024-09-19T11:55:48.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.557+0000 7f1277cbd9c0 20 add_watcher() i=2 2024-09-19T11:55:48.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.557+0000 7f1277cbd9c0 20 add_watcher() i=3 2024-09-19T11:55:48.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.557+0000 7f1277cbd9c0 20 add_watcher() i=4 2024-09-19T11:55:48.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.557+0000 7f1277cbd9c0 20 add_watcher() i=5 2024-09-19T11:55:48.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.557+0000 7f1277cbd9c0 20 add_watcher() i=6 2024-09-19T11:55:48.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.557+0000 7f1277cbd9c0 20 add_watcher() i=7 2024-09-19T11:55:48.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.557+0000 7f1277cbd9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:48.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.561+0000 7f112b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:48.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.561+0000 7f1277cbd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:48.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.561+0000 7f1277cbd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:48.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.561+0000 7f1277cbd9c0 5 note: GC not initialized 2024-09-19T11:55:48.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.565+0000 7f112a7e4640 20 reqs_thread_entry: start 2024-09-19T11:55:48.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.565+0000 7f1277cbd9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:48.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.565+0000 7f1277cbd9c0 20 Filter name: none 2024-09-19T11:55:48.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.565+0000 7f109bfff640 20 reqs_thread_entry: start 2024-09-19T11:55:48.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.565+0000 7f1277cbd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.565+0000 7f1277cbd9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:48.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.565+0000 7f1277cbd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.565+0000 7f1277cbd9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:48.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.565+0000 7f1277cbd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:48.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.565+0000 7f1277cbd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.565+0000 7f1277cbd9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:48.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.565+0000 7f1277cbd9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.569+0000 7f1277cbd9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:48.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.569+0000 7f1277cbd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:48.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.569+0000 7f112b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:48.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.573+0000 7f1277cbd9c0 20 remove_watcher() i=0 2024-09-19T11:55:48.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.573+0000 7f1277cbd9c0 2 removed watcher, disabling cache 2024-09-19T11:55:48.573 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.577+0000 7f1277cbd9c0 20 remove_watcher() i=1 2024-09-19T11:55:48.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.577+0000 7f1277cbd9c0 20 remove_watcher() i=2 2024-09-19T11:55:48.577 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.581+0000 7f1277cbd9c0 20 remove_watcher() i=3 2024-09-19T11:55:48.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.581+0000 7f1277cbd9c0 20 remove_watcher() i=4 2024-09-19T11:55:48.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.585+0000 7f1277cbd9c0 20 remove_watcher() i=5 2024-09-19T11:55:48.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.585+0000 7f1277cbd9c0 20 remove_watcher() i=6 2024-09-19T11:55:48.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.585+0000 7f1277cbd9c0 20 remove_watcher() i=7 2024-09-19T11:55:48.598 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:48.599 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:48.599 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-set-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:55:48.599 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:48.599 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-19T11:55:48.635 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:48.635 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:48.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.681+0000 7f3552cd39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.685+0000 7f3552cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:48.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.685+0000 7f3552cd39c0 20 realm 2024-09-19T11:55:48.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.685+0000 7f3552cd39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.685+0000 7f3552cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:48.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.685+0000 7f3552cd39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:48.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.685+0000 7f3552cd39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.685+0000 7f3552cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:48.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.685+0000 7f3552cd39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.685+0000 7f3552cd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:48.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.685+0000 7f3552cd39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.689+0000 7f3552cd39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:48.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.689+0000 7f3552cd39c0 20 searching for the correct realm 2024-09-19T11:55:48.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.693+0000 7f35507d9640 0 -- 172.21.15.120:0/3983220443 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f3548017020 msgr2=0x7f3548018920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:48.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.909+0000 7f35507d9640 0 -- 172.21.15.120:0/3983220443 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f3548017020 msgr2=0x7f3548018920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:48.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:48.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:48.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:48.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:48.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:48.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:48.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:48.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:48.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:48.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 20 zone default found 2024-09-19T11:55:48.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 4 Realm: () 2024-09-19T11:55:48.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:48.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:48.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:48.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 20 zonegroup default 2024-09-19T11:55:48.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.921+0000 7f3552cd39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.925+0000 7f3552cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:48.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.925+0000 7f3552cd39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.925+0000 7f3552cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:48.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.925+0000 7f3552cd39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.925+0000 7f3552cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:48.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.925+0000 7f3552cd39c0 20 started sync module instance, tier type = 2024-09-19T11:55:48.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.925+0000 7f3552cd39c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:48.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.945+0000 7f3552cd39c0 20 add_watcher() i=0 2024-09-19T11:55:48.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.945+0000 7f3552cd39c0 20 add_watcher() i=1 2024-09-19T11:55:48.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.945+0000 7f3552cd39c0 20 add_watcher() i=2 2024-09-19T11:55:48.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.945+0000 7f3552cd39c0 20 add_watcher() i=3 2024-09-19T11:55:48.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.945+0000 7f3552cd39c0 20 add_watcher() i=4 2024-09-19T11:55:48.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.945+0000 7f3552cd39c0 20 add_watcher() i=5 2024-09-19T11:55:48.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.945+0000 7f3552cd39c0 20 add_watcher() i=6 2024-09-19T11:55:48.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.949+0000 7f3552cd39c0 20 add_watcher() i=7 2024-09-19T11:55:48.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.949+0000 7f3552cd39c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:48.950 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.953+0000 7f3406fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:48.951 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.953+0000 7f3552cd39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:48.951 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.953+0000 7f3552cd39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:48.951 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.953+0000 7f3552cd39c0 5 note: GC not initialized 2024-09-19T11:55:48.952 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.953+0000 7f3405fdb640 20 reqs_thread_entry: start 2024-09-19T11:55:48.952 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.953+0000 7f3552cd39c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:48.952 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.953+0000 7f3552cd39c0 20 Filter name: none 2024-09-19T11:55:48.952 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.953+0000 7f33777fe640 20 reqs_thread_entry: start 2024-09-19T11:55:48.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.953+0000 7f3552cd39c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-19T11:55:48.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.953+0000 7f3552cd39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.957+0000 7f3552cd39c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:48.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.957+0000 7f3552cd39c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-19T11:55:48.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.957+0000 7f3552cd39c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-19T11:55:48.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.957+0000 7f3552cd39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 : miss 2024-09-19T11:55:48.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.957+0000 7f3552cd39c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:48.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.957+0000 7f3552cd39c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:48.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.957+0000 7f3552cd39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 info.flags=0x17 2024-09-19T11:55:48.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.957+0000 7f3552cd39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 to cache LRU end 2024-09-19T11:55:48.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.957+0000 7f3552cd39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:48.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.957+0000 7f3552cd39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:48.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.957+0000 7f3552cd39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 2024-09-19T11:55:48.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.965+0000 7f3552cd39c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-19T11:55:48.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.965+0000 7f3552cd39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 info.flags=0x17 2024-09-19T11:55:48.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.965+0000 7f3552cd39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 to cache LRU end 2024-09-19T11:55:48.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.965+0000 7f3552cd39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:48.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.965+0000 7f3552cd39c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24, ofs0, ns] 2024-09-19T11:55:48.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.969+0000 7f34277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94662453717952 notifier 6239 bl.length()=1009 2024-09-19T11:55:48.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.969+0000 7f34277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 info.flags=0x17 2024-09-19T11:55:48.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.969+0000 7f34277fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 to cache LRU end 2024-09-19T11:55:48.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.969+0000 7f34277fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:48.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.969+0000 7f3552cd39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24]): orig_sources= new_sources= 2024-09-19T11:55:48.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.969+0000 7f3552cd39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24]): potential sources added=[] removed=[] 2024-09-19T11:55:48.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.969+0000 7f3552cd39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24]): orig_dests= new_dests= 2024-09-19T11:55:48.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.969+0000 7f3552cd39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24]): potential dests added=[] removed=[] 2024-09-19T11:55:48.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.973+0000 7f3552cd39c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24.1.0 2024-09-19T11:55:48.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.973+0000 7f3552cd39c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24.1.0 2024-09-19T11:55:48.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.973+0000 7f3552cd39c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24.1.1 2024-09-19T11:55:48.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.973+0000 7f3552cd39c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24.1.1 2024-09-19T11:55:48.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.973+0000 7f3552cd39c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24.0 2024-09-19T11:55:48.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.981+0000 7f3552cd39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 : hit (requested=0x17, cached=0x17) 2024-09-19T11:55:48.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.981+0000 7f3552cd39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 2024-09-19T11:55:48.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.985+0000 7f3552cd39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 info.flags=0x17 2024-09-19T11:55:48.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.985+0000 7f3552cd39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 to cache LRU end 2024-09-19T11:55:48.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.985+0000 7f3552cd39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:48.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.985+0000 7f3552cd39c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24, ofs0, ns] 2024-09-19T11:55:48.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.985+0000 7f34277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366178 cookie 94662453717952 notifier 6239 bl.length()=1009 2024-09-19T11:55:48.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.985+0000 7f34277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 info.flags=0x17 2024-09-19T11:55:48.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.985+0000 7f34277fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 to cache LRU end 2024-09-19T11:55:48.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.985+0000 7f34277fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:48.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.985+0000 7f3552cd39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24]): orig_sources= new_sources= 2024-09-19T11:55:48.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.985+0000 7f3552cd39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24]): potential sources added=[] removed=[] 2024-09-19T11:55:48.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.985+0000 7f3552cd39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24]): orig_dests= new_dests= 2024-09-19T11:55:48.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.985+0000 7f3552cd39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24]): potential dests added=[] removed=[] 2024-09-19T11:55:48.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.989+0000 7f3552cd39c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24.0 2024-09-19T11:55:48.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.989+0000 7f3552cd39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 : hit (requested=0x17, cached=0x17) 2024-09-19T11:55:48.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.989+0000 7f3552cd39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 2024-09-19T11:55:48.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.993+0000 7f3552cd39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 info.flags=0x17 2024-09-19T11:55:48.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.993+0000 7f3552cd39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 to cache LRU end 2024-09-19T11:55:48.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.993+0000 7f3552cd39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:48.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.993+0000 7f3552cd39c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24, ofs0, ns] 2024-09-19T11:55:48.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.993+0000 7f3426ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366179 cookie 94662453717952 notifier 6239 bl.length()=977 2024-09-19T11:55:48.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.993+0000 7f3426ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 info.flags=0x17 2024-09-19T11:55:48.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.993+0000 7f3426ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 to cache LRU end 2024-09-19T11:55:48.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.993+0000 7f3426ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:48.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.993+0000 7f3552cd39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24]): orig_sources= new_sources= 2024-09-19T11:55:48.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.993+0000 7f3552cd39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24]): potential sources added=[] removed=[] 2024-09-19T11:55:48.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.993+0000 7f3552cd39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24]): orig_dests= new_dests= 2024-09-19T11:55:48.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.993+0000 7f3552cd39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24]): potential dests added=[] removed=[] 2024-09-19T11:55:48.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:48.997+0000 7f3552cd39c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-19T11:55:48.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.001+0000 7f3406fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:49.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.005+0000 7f3552cd39c0 20 remove_watcher() i=0 2024-09-19T11:55:49.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.005+0000 7f3552cd39c0 2 removed watcher, disabling cache 2024-09-19T11:55:49.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.009+0000 7f3552cd39c0 20 remove_watcher() i=1 2024-09-19T11:55:49.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.013+0000 7f3552cd39c0 20 remove_watcher() i=2 2024-09-19T11:55:49.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.013+0000 7f3552cd39c0 20 remove_watcher() i=3 2024-09-19T11:55:49.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.017+0000 7f3552cd39c0 20 remove_watcher() i=4 2024-09-19T11:55:49.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.017+0000 7f3552cd39c0 20 remove_watcher() i=5 2024-09-19T11:55:49.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.021+0000 7f3552cd39c0 20 remove_watcher() i=6 2024-09-19T11:55:49.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.021+0000 7f3552cd39c0 20 remove_watcher() i=7 2024-09-19T11:55:49.039 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-19T11:55:49.070 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:49.071 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:49.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.121+0000 7ff7ca82c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:49.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.121+0000 7ff7ca82c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:49.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.121+0000 7ff7ca82c9c0 20 realm 2024-09-19T11:55:49.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.121+0000 7ff7ca82c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:49.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.121+0000 7ff7ca82c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:49.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.121+0000 7ff7ca82c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:49.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.121+0000 7ff7ca82c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:49.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.121+0000 7ff7ca82c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:49.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.121+0000 7ff7ca82c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:49.121 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.125+0000 7ff7ca82c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:49.121 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.125+0000 7ff7ca82c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:49.123 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.125+0000 7ff7ca82c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:49.123 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.125+0000 7ff7ca82c9c0 20 searching for the correct realm 2024-09-19T11:55:49.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.129+0000 7ff7c8b33640 0 -- 172.21.15.120:0/4215501677 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7ff7b0070c20 msgr2=0x7ff7b0067bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:49.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.137+0000 7ff7c7b31640 0 -- 172.21.15.120:0/4215501677 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7ff7c0068c20 msgr2=0x7ff7c0023040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:49.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.353+0000 7ff7ca82c9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:49.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.353+0000 7ff7ca82c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:49.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.353+0000 7ff7ca82c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:49.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.353+0000 7ff7ca82c9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:49.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.353+0000 7ff7ca82c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:49.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.353+0000 7ff7ca82c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:49.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.353+0000 7ff7ca82c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:49.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.353+0000 7ff7ca82c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:49.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.353+0000 7ff7ca82c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:49.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.357+0000 7ff7ca82c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:49.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.357+0000 7ff7ca82c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:49.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.357+0000 7ff7ca82c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:49.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.357+0000 7ff7ca82c9c0 20 zone default found 2024-09-19T11:55:49.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.357+0000 7ff7ca82c9c0 4 Realm: () 2024-09-19T11:55:49.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.357+0000 7ff7ca82c9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:49.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.357+0000 7ff7ca82c9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:49.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.357+0000 7ff7ca82c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:49.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.357+0000 7ff7ca82c9c0 20 zonegroup default 2024-09-19T11:55:49.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.357+0000 7ff7ca82c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:49.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.357+0000 7ff7ca82c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:49.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.357+0000 7ff7ca82c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:49.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.357+0000 7ff7ca82c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:49.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.357+0000 7ff7ca82c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:49.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.361+0000 7ff7ca82c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:49.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.361+0000 7ff7ca82c9c0 20 started sync module instance, tier type = 2024-09-19T11:55:49.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.361+0000 7ff7ca82c9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:49.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.385+0000 7ff7ca82c9c0 20 add_watcher() i=0 2024-09-19T11:55:49.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.385+0000 7ff7ca82c9c0 20 add_watcher() i=1 2024-09-19T11:55:49.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.385+0000 7ff7ca82c9c0 20 add_watcher() i=2 2024-09-19T11:55:49.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.385+0000 7ff7ca82c9c0 20 add_watcher() i=3 2024-09-19T11:55:49.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.385+0000 7ff7ca82c9c0 20 add_watcher() i=4 2024-09-19T11:55:49.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.385+0000 7ff7ca82c9c0 20 add_watcher() i=5 2024-09-19T11:55:49.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.385+0000 7ff7ca82c9c0 20 add_watcher() i=6 2024-09-19T11:55:49.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.385+0000 7ff7ca82c9c0 20 add_watcher() i=7 2024-09-19T11:55:49.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.385+0000 7ff7ca82c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:49.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.393+0000 7ff67efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:49.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.393+0000 7ff7ca82c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:49.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.393+0000 7ff7ca82c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:49.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.393+0000 7ff7ca82c9c0 5 note: GC not initialized 2024-09-19T11:55:49.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.393+0000 7ff67dfdb640 20 reqs_thread_entry: start 2024-09-19T11:55:49.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.393+0000 7ff7ca82c9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:49.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.393+0000 7ff7ca82c9c0 20 Filter name: none 2024-09-19T11:55:49.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.393+0000 7ff5ef7fe640 20 reqs_thread_entry: start 2024-09-19T11:55:49.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.393+0000 7ff7ca82c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:49.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.397+0000 7ff7ca82c9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:49.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.397+0000 7ff7ca82c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:49.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.397+0000 7ff7ca82c9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:49.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.397+0000 7ff7ca82c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:49.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.397+0000 7ff7ca82c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:49.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.397+0000 7ff7ca82c9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:49.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.397+0000 7ff7ca82c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:49.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.401+0000 7ff7ca82c9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:49.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.401+0000 7ff7ca82c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:49.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.401+0000 7ff67efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:49.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.405+0000 7ff7ca82c9c0 20 remove_watcher() i=0 2024-09-19T11:55:49.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.405+0000 7ff7ca82c9c0 2 removed watcher, disabling cache 2024-09-19T11:55:49.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.409+0000 7ff7ca82c9c0 20 remove_watcher() i=1 2024-09-19T11:55:49.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.409+0000 7ff7ca82c9c0 20 remove_watcher() i=2 2024-09-19T11:55:49.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.413+0000 7ff7ca82c9c0 20 remove_watcher() i=3 2024-09-19T11:55:49.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.413+0000 7ff7ca82c9c0 20 remove_watcher() i=4 2024-09-19T11:55:49.413 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.417+0000 7ff7ca82c9c0 20 remove_watcher() i=5 2024-09-19T11:55:49.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.417+0000 7ff7ca82c9c0 20 remove_watcher() i=6 2024-09-19T11:55:49.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:49.421+0000 7ff7ca82c9c0 20 remove_watcher() i=7 2024-09-19T11:55:49.433 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:49.433 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:49.433 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-set-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-19T11:55:49.433 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:49.525 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-19T11:55:49.525 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.013 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-19T11:55:50.045 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:50.045 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:50.091 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.093+0000 7f8d5ed209c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.092 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.097+0000 7f8d5ed209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.092 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.097+0000 7f8d5ed209c0 20 realm 2024-09-19T11:55:50.092 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.097+0000 7f8d5ed209c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.097+0000 7f8d5ed209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.097+0000 7f8d5ed209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:50.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.097+0000 7f8d5ed209c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.097+0000 7f8d5ed209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.097+0000 7f8d5ed209c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.097+0000 7f8d5ed209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:50.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.097+0000 7f8d5ed209c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.101+0000 7f8d5ed209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:50.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.101+0000 7f8d5ed209c0 20 searching for the correct realm 2024-09-19T11:55:50.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.305+0000 7f8d5c025640 0 -- 172.21.15.120:0/871383713 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7f8d4c0e03d0 msgr2=0x7f8d4c009ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:50.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.317+0000 7f8d5c025640 0 -- 172.21.15.120:0/871383713 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7f8c28082280 msgr2=0x7f8c280846b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:50.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:50.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:50.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:50.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:50.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:50.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:50.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:50.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:50.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 20 zone default found 2024-09-19T11:55:50.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 4 Realm: () 2024-09-19T11:55:50.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:50.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:50.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:50.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 20 zonegroup default 2024-09-19T11:55:50.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.333+0000 7f8d5ed209c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.337+0000 7f8d5ed209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.334 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.337+0000 7f8d5ed209c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.334 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.337+0000 7f8d5ed209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.334 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.337+0000 7f8d5ed209c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.334 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.337+0000 7f8d5ed209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.334 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.337+0000 7f8d5ed209c0 20 started sync module instance, tier type = 2024-09-19T11:55:50.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.337+0000 7f8d5ed209c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:50.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.361+0000 7f8d5ed209c0 20 add_watcher() i=0 2024-09-19T11:55:50.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.361+0000 7f8d5ed209c0 20 add_watcher() i=1 2024-09-19T11:55:50.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.361+0000 7f8d5ed209c0 20 add_watcher() i=2 2024-09-19T11:55:50.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.361+0000 7f8d5ed209c0 20 add_watcher() i=3 2024-09-19T11:55:50.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.361+0000 7f8d5ed209c0 20 add_watcher() i=4 2024-09-19T11:55:50.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.361+0000 7f8d5ed209c0 20 add_watcher() i=5 2024-09-19T11:55:50.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.361+0000 7f8d5ed209c0 20 add_watcher() i=6 2024-09-19T11:55:50.359 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.361+0000 7f8d5ed209c0 20 add_watcher() i=7 2024-09-19T11:55:50.359 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.361+0000 7f8d5ed209c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:50.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.365+0000 7f8c12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:50.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.369+0000 7f8d5ed209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:50.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.369+0000 7f8d5ed209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:50.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.369+0000 7f8d5ed209c0 5 note: GC not initialized 2024-09-19T11:55:50.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.369+0000 7f8c11fe3640 20 reqs_thread_entry: start 2024-09-19T11:55:50.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.369+0000 7f8d5ed209c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:50.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.369+0000 7f8d5ed209c0 20 Filter name: none 2024-09-19T11:55:50.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.369+0000 7f8b837fe640 20 reqs_thread_entry: start 2024-09-19T11:55:50.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.369+0000 7f8d5ed209c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.369+0000 7f8d5ed209c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:50.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.369+0000 7f8d5ed209c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.369+0000 7f8d5ed209c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:50.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.369+0000 7f8d5ed209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:50.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.369+0000 7f8d5ed209c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.373+0000 7f8d5ed209c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:50.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.373+0000 7f8d5ed209c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.373+0000 7f8d5ed209c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:50.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.373+0000 7f8d5ed209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:50.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.373+0000 7f8c12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:50.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.377+0000 7f8d5ed209c0 20 remove_watcher() i=0 2024-09-19T11:55:50.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.377+0000 7f8d5ed209c0 2 removed watcher, disabling cache 2024-09-19T11:55:50.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.381+0000 7f8d5ed209c0 20 remove_watcher() i=1 2024-09-19T11:55:50.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.381+0000 7f8d5ed209c0 20 remove_watcher() i=2 2024-09-19T11:55:50.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.385+0000 7f8d5ed209c0 20 remove_watcher() i=3 2024-09-19T11:55:50.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.389+0000 7f8d5ed209c0 20 remove_watcher() i=4 2024-09-19T11:55:50.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.389+0000 7f8d5ed209c0 20 remove_watcher() i=5 2024-09-19T11:55:50.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.389+0000 7f8d5ed209c0 20 remove_watcher() i=6 2024-09-19T11:55:50.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.393+0000 7f8d5ed209c0 20 remove_watcher() i=7 2024-09-19T11:55:50.405 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.405 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:50.405 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-set-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:55:50.405 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.405 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-19T11:55:50.443 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:50.443 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:50.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.489+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 realm 2024-09-19T11:55:50.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.493+0000 7ff52a0779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:50.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:50.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.497+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:50.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.497+0000 7ff52a0779c0 20 searching for the correct realm 2024-09-19T11:55:50.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.501+0000 7ff527b7d640 0 -- 172.21.15.120:0/1205192878 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff520008030 msgr2=0x7ff52005ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:50.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.717+0000 7ff527b7d640 0 -- 172.21.15.120:0/1205192878 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff520008030 msgr2=0x7ff52005ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:50.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:50.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:50.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:50.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:50.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:50.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:50.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:50.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:50.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 zone default found 2024-09-19T11:55:50.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 4 Realm: () 2024-09-19T11:55:50.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:50.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:50.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:50.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 zonegroup default 2024-09-19T11:55:50.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 started sync module instance, tier type = 2024-09-19T11:55:50.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:50.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=0 2024-09-19T11:55:50.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=1 2024-09-19T11:55:50.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=2 2024-09-19T11:55:50.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=3 2024-09-19T11:55:50.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=4 2024-09-19T11:55:50.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=5 2024-09-19T11:55:50.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=6 2024-09-19T11:55:50.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=7 2024-09-19T11:55:50.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.757+0000 7ff52a0779c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:50.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.761+0000 7ff3ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:50.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:50.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:50.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 note: GC not initialized 2024-09-19T11:55:50.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.765+0000 7ff3dcfe1640 20 reqs_thread_entry: start 2024-09-19T11:55:50.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:50.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 Filter name: none 2024-09-19T11:55:50.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.765+0000 7ff3567fc640 20 reqs_thread_entry: start 2024-09-19T11:55:50.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.765+0000 7ff52a0779c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-19T11:55:50.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:50.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.765+0000 7ff52a0779c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-19T11:55:50.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.765+0000 7ff52a0779c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-19T11:55:50.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.765+0000 7ff52a0779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 : miss 2024-09-19T11:55:50.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.769+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:50.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.769+0000 7ff52a0779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 info.flags=0x17 2024-09-19T11:55:50.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.769+0000 7ff52a0779c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 to cache LRU end 2024-09-19T11:55:50.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.769+0000 7ff52a0779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:50.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.769+0000 7ff52a0779c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:50.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.769+0000 7ff52a0779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 2024-09-19T11:55:50.770 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff52a0779c0 time 2024-09-19T11:55:50.776487+0000 2024-09-19T11:55:50.770 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:55:50.774 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:50.774 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff52d9512eb] 2024-09-19T11:55:50.774 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff52d95149f] 2024-09-19T11:55:50.774 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558228bba271] 2024-09-19T11:55:50.774 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x140fb48) [0x55822960ab48] 2024-09-19T11:55:50.774 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558228bca0dd] 2024-09-19T11:55:50.774 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:55:50.774 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff52c7b7d90] 2024-09-19T11:55:50.774 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:55:50.774 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:55:50.774 INFO:tasks.workunit.client.0.smithi120.stderr:*** Caught signal (Aborted) ** 2024-09-19T11:55:50.774 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7ff52a0779c0 thread_name:radosgw-admin 2024-09-19T11:55:50.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.777+0000 7ff52a0779c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff52a0779c0 time 2024-09-19T11:55:50.776487+0000 2024-09-19T11:55:50.775 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:55:50.775 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.775 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:50.775 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff52d9512eb] 2024-09-19T11:55:50.775 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff52d95149f] 2024-09-19T11:55:50.775 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558228bba271] 2024-09-19T11:55:50.775 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x140fb48) [0x55822960ab48] 2024-09-19T11:55:50.775 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558228bca0dd] 2024-09-19T11:55:50.775 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:55:50.775 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff52c7b7d90] 2024-09-19T11:55:50.776 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:55:50.776 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:55:50.776 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.777 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:50.777 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff52c7d0520] 2024-09-19T11:55:50.777 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:55:50.777 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:55:50.778 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:55:50.778 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff52d951345] 2024-09-19T11:55:50.778 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff52d95149f] 2024-09-19T11:55:50.778 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558228bba271] 2024-09-19T11:55:50.778 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x140fb48) [0x55822960ab48] 2024-09-19T11:55:50.778 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558228bca0dd] 2024-09-19T11:55:50.778 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:55:50.778 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff52c7b7d90] 2024-09-19T11:55:50.778 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:55:50.778 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:55:50.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.781+0000 7ff52a0779c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:55:50.778 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7ff52a0779c0 thread_name:radosgw-admin 2024-09-19T11:55:50.778 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.779 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:50.779 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff52c7d0520] 2024-09-19T11:55:50.779 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:55:50.779 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:55:50.779 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:55:50.779 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff52d951345] 2024-09-19T11:55:50.779 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff52d95149f] 2024-09-19T11:55:50.779 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558228bba271] 2024-09-19T11:55:50.779 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x140fb48) [0x55822960ab48] 2024-09-19T11:55:50.779 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558228bca0dd] 2024-09-19T11:55:50.779 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:55:50.779 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff52c7b7d90] 2024-09-19T11:55:50.779 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:55:50.779 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:55:50.779 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:55:50.780 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.780 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:55:50.844 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.844 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.844 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.844 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.844 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.844 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.844 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.845 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): get_auth_request con 0x55822aa09590 auth_method 0 2024-09-19T11:55:50.845 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.845 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.845 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.845 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): handle_auth_done global_id 6702 payload 274 2024-09-19T11:55:50.845 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient: _finish_hunting 0 2024-09-19T11:55:50.845 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:55:50.469+0000 7ff527b7d640 1 monclient: found mon.noname-a 2024-09-19T11:55:50.845 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.846 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.846 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:50.846 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: dump: 2024-09-19T11:55:50.846 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.846 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.846 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.846 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.846 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.846 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.847 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.847 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.847 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.847 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.847 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: _finish_auth 0 2024-09-19T11:55:50.847 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: _check_auth_tickets 2024-09-19T11:55:50.847 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:50.847 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.847 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:50.847 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: dump: 2024-09-19T11:55:50.848 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.848 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.848 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.848 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.848 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.848 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.848 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.848 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.848 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.848 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.848 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 monclient: authenticate success, global_id 6702 2024-09-19T11:55:50.848 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient: get_monmap_and_config success 2024-09-19T11:55:50.849 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 4 set_mon_vals no callback set 2024-09-19T11:55:50.849 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient: shutdown 2024-09-19T11:55:50.849 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 asok(0x55822a943d90) unregister_commands rotate-key 2024-09-19T11:55:50.849 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient: build_initial_monmap 2024-09-19T11:55:50.849 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:50.849 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient: monmap: 2024-09-19T11:55:50.849 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:50.849 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:50.849 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:50.849 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:50.849 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:50.849 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.849 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:50.850 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:50.850 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:50.850 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.850 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding auth protocol: cephx 2024-09-19T11:55:50.850 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding auth protocol: cephx 2024-09-19T11:55:50.850 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding auth protocol: cephx 2024-09-19T11:55:50.850 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: secure 2024-09-19T11:55:50.850 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: crc 2024-09-19T11:55:50.850 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: secure 2024-09-19T11:55:50.850 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: crc 2024-09-19T11:55:50.850 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: secure 2024-09-19T11:55:50.850 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: crc 2024-09-19T11:55:50.850 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: crc 2024-09-19T11:55:50.851 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: secure 2024-09-19T11:55:50.851 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: crc 2024-09-19T11:55:50.851 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: secure 2024-09-19T11:55:50.851 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: crc 2024-09-19T11:55:50.851 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: secure 2024-09-19T11:55:50.851 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.851 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 1 librados: starting msgr at 2024-09-19T11:55:50.851 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 1 librados: starting objecter 2024-09-19T11:55:50.851 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command objecter_requests hook 0x55822ab52bd0 2024-09-19T11:55:50.851 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 1 librados: setting wanted keys 2024-09-19T11:55:50.851 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 1 librados: calling monclient init 2024-09-19T11:55:50.852 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient: init 2024-09-19T11:55:50.852 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding auth protocol: cephx 2024-09-19T11:55:50.852 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding auth protocol: cephx 2024-09-19T11:55:50.852 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding auth protocol: cephx 2024-09-19T11:55:50.852 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: secure 2024-09-19T11:55:50.852 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: crc 2024-09-19T11:55:50.852 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: secure 2024-09-19T11:55:50.852 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: crc 2024-09-19T11:55:50.852 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: secure 2024-09-19T11:55:50.852 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: crc 2024-09-19T11:55:50.852 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: crc 2024-09-19T11:55:50.852 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: secure 2024-09-19T11:55:50.853 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: crc 2024-09-19T11:55:50.853 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: secure 2024-09-19T11:55:50.853 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: crc 2024-09-19T11:55:50.853 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: secure 2024-09-19T11:55:50.853 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.853 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.853 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command rotate-key hook 0x55822ab4f208 2024-09-19T11:55:50.853 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:50.853 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T11:55:50.853 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-b con 0x55822a9dcce0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:50.853 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-c con 0x55822aa09590 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:50.853 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-a con 0x55822aa94bd0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:50.853 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.854 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.854 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.854 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:50.854 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): authenticate will time out at 2244.787075s 2024-09-19T11:55:50.854 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): get_auth_request con 0x55822aa09590 auth_method 0 2024-09-19T11:55:50.854 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.854 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.854 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.854 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): get_auth_request con 0x55822aa94bd0 auth_method 0 2024-09-19T11:55:50.854 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.854 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.854 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.854 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.855 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.855 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.855 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.855 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.855 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.855 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): get_auth_request con 0x55822a9dcce0 auth_method 0 2024-09-19T11:55:50.855 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.855 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.855 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.855 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): handle_auth_done global_id 6705 payload 824 2024-09-19T11:55:50.855 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient: _finish_hunting 0 2024-09-19T11:55:50.855 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:55:50.469+0000 7ff52837e640 1 monclient: found mon.noname-a 2024-09-19T11:55:50.855 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.855 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.855 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:50.856 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: dump: 2024-09-19T11:55:50.856 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.856 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.856 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.856 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.856 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.856 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.856 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.856 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.856 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.856 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.856 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: _finish_auth 0 2024-09-19T11:55:50.856 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: _check_auth_tickets 2024-09-19T11:55:50.857 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:50.857 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.857 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:50.857 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: dump: 2024-09-19T11:55:50.857 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.857 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.857 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.857 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.857 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.857 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.857 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.857 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.857 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.858 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.858 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:55:50.473+0000 7ff52a0779c0 5 monclient: authenticate success, global_id 6705 2024-09-19T11:55:50.858 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:55:50.469+0000 7ff415e0b640 4 set_mon_vals no callback set 2024-09-19T11:55:50.859 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:55:50.473+0000 7ff52a0779c0 10 monclient: _renew_subs 2024-09-19T11:55:50.859 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:55:50.473+0000 7ff52a0779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.859 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:55:50.473+0000 7ff52a0779c0 10 monclient: _renew_subs 2024-09-19T11:55:50.859 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:55:50.473+0000 7ff52a0779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.859 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:55:50.473+0000 7ff52a0779c0 1 librados: init done 2024-09-19T11:55:50.859 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:55:50.473+0000 7ff40ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:55:50.859 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:55:50.473+0000 7ff40ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:50.859 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:55:50.473+0000 7ff40ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:50.859 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:55:50.473+0000 7ff527b7d640 10 monclient: get_auth_request con 0x7ff410071be0 auth_method 0 2024-09-19T11:55:50.859 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:55:50.473+0000 7ff52737c640 10 monclient: get_auth_request con 0x55822ab97360 auth_method 0 2024-09-19T11:55:50.859 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:55:50.473+0000 7ff527b7d640 10 monclient: get_auth_request con 0x55822ab9a540 auth_method 0 2024-09-19T11:55:50.860 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:55:50.477+0000 7ff52737c640 10 monclient: get_auth_request con 0x55822ab9e730 auth_method 0 2024-09-19T11:55:50.860 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:55:50.477+0000 7ff52837e640 10 monclient: get_auth_request con 0x55822ab9ddf0 auth_method 0 2024-09-19T11:55:50.860 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: build_initial_monmap 2024-09-19T11:55:50.860 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:50.860 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: monmap: 2024-09-19T11:55:50.860 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:50.860 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:50.860 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:50.860 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:50.860 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:50.860 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.860 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:50.860 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:50.860 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:50.861 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.861 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding auth protocol: cephx 2024-09-19T11:55:50.861 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding auth protocol: cephx 2024-09-19T11:55:50.861 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding auth protocol: cephx 2024-09-19T11:55:50.861 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: secure 2024-09-19T11:55:50.861 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: crc 2024-09-19T11:55:50.861 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: secure 2024-09-19T11:55:50.861 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: crc 2024-09-19T11:55:50.861 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: secure 2024-09-19T11:55:50.861 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: crc 2024-09-19T11:55:50.861 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: crc 2024-09-19T11:55:50.861 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: secure 2024-09-19T11:55:50.861 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: crc 2024-09-19T11:55:50.861 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: secure 2024-09-19T11:55:50.862 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: crc 2024-09-19T11:55:50.862 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: secure 2024-09-19T11:55:50.862 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.862 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command objecter_requests cmddesc objecter_requests hook 0x55822abaa080 EEXIST 2024-09-19T11:55:50.862 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: init 2024-09-19T11:55:50.862 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding auth protocol: cephx 2024-09-19T11:55:50.862 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding auth protocol: cephx 2024-09-19T11:55:50.862 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding auth protocol: cephx 2024-09-19T11:55:50.862 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: secure 2024-09-19T11:55:50.862 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: crc 2024-09-19T11:55:50.862 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: secure 2024-09-19T11:55:50.862 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: crc 2024-09-19T11:55:50.862 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: secure 2024-09-19T11:55:50.862 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: crc 2024-09-19T11:55:50.863 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: crc 2024-09-19T11:55:50.863 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: secure 2024-09-19T11:55:50.863 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: crc 2024-09-19T11:55:50.863 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: secure 2024-09-19T11:55:50.863 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: crc 2024-09-19T11:55:50.863 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: secure 2024-09-19T11:55:50.863 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.863 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.863 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command rotate-key cmddesc rotate-key hook 0x55822aba56e0 EEXIST 2024-09-19T11:55:50.863 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:50.863 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T11:55:50.863 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-b con 0x55822abce230 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:50.863 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-c con 0x55822abcdb60 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:50.863 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-a con 0x55822abcc540 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:50.864 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.864 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.864 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.864 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:50.864 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): authenticate will time out at 2244.797758s 2024-09-19T11:55:50.864 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): get_auth_request con 0x55822abcc540 auth_method 0 2024-09-19T11:55:50.864 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.864 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.864 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.864 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:55:50.481+0000 7ff52837e640 10 monclient(hunting): get_auth_request con 0x55822abcdb60 auth_method 0 2024-09-19T11:55:50.864 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:55:50.481+0000 7ff52837e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.864 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:55:50.481+0000 7ff52837e640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.864 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:55:50.481+0000 7ff52837e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.865 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.865 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.865 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.865 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:55:50.481+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.865 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:55:50.481+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.865 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:55:50.481+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.865 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:55:50.481+0000 7ff52737c640 10 monclient(hunting): get_auth_request con 0x55822abce230 auth_method 0 2024-09-19T11:55:50.865 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:55:50.481+0000 7ff52737c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.865 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:55:50.481+0000 7ff52737c640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.865 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:55:50.481+0000 7ff52737c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.865 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): handle_auth_done global_id 6708 payload 824 2024-09-19T11:55:50.865 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient: _finish_hunting 0 2024-09-19T11:55:50.865 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:55:50.481+0000 7ff527b7d640 1 monclient: found mon.noname-a 2024-09-19T11:55:50.865 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.866 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.866 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:50.866 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: dump: 2024-09-19T11:55:50.866 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.866 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.866 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.866 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.866 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.866 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.866 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.866 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.866 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.866 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.866 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: _finish_auth 0 2024-09-19T11:55:50.866 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: _check_auth_tickets 2024-09-19T11:55:50.867 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:50.867 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.867 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:50.867 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: dump: 2024-09-19T11:55:50.867 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.867 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.867 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.867 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.867 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.867 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.867 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.867 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.867 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.867 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.868 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:55:50.481+0000 7ff528b7f640 4 set_mon_vals no callback set 2024-09-19T11:55:50.868 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 monclient: authenticate success, global_id 6708 2024-09-19T11:55:50.868 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: _renew_subs 2024-09-19T11:55:50.868 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.868 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: _renew_subs 2024-09-19T11:55:50.868 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.868 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:55:50.485+0000 7ff40d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:55:50.868 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:55:50.485+0000 7ff40d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:50.868 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:55:50.485+0000 7ff40d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:50.868 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: get_monmap_and_config 2024-09-19T11:55:50.868 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: build_initial_monmap 2024-09-19T11:55:50.868 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:50.868 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: monmap: 2024-09-19T11:55:50.869 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:50.869 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:50.869 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:50.869 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:50.869 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:50.869 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.869 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:50.869 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:50.869 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:50.869 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.869 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding auth protocol: cephx 2024-09-19T11:55:50.869 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding auth protocol: cephx 2024-09-19T11:55:50.869 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding auth protocol: cephx 2024-09-19T11:55:50.869 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: secure 2024-09-19T11:55:50.869 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: crc 2024-09-19T11:55:50.870 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: secure 2024-09-19T11:55:50.870 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: crc 2024-09-19T11:55:50.870 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: secure 2024-09-19T11:55:50.870 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: crc 2024-09-19T11:55:50.870 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: crc 2024-09-19T11:55:50.870 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: secure 2024-09-19T11:55:50.870 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: crc 2024-09-19T11:55:50.870 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: secure 2024-09-19T11:55:50.870 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: crc 2024-09-19T11:55:50.870 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: secure 2024-09-19T11:55:50.870 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient: get_auth_request con 0x7ff400071b20 auth_method 0 2024-09-19T11:55:50.870 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.870 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: init 2024-09-19T11:55:50.870 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding auth protocol: cephx 2024-09-19T11:55:50.871 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding auth protocol: cephx 2024-09-19T11:55:50.871 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding auth protocol: cephx 2024-09-19T11:55:50.871 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: secure 2024-09-19T11:55:50.871 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: crc 2024-09-19T11:55:50.871 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: secure 2024-09-19T11:55:50.871 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: crc 2024-09-19T11:55:50.871 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: secure 2024-09-19T11:55:50.871 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: crc 2024-09-19T11:55:50.871 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: crc 2024-09-19T11:55:50.871 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: secure 2024-09-19T11:55:50.871 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: crc 2024-09-19T11:55:50.871 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: secure 2024-09-19T11:55:50.871 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: crc 2024-09-19T11:55:50.872 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: secure 2024-09-19T11:55:50.872 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.872 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.872 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command rotate-key cmddesc rotate-key hook 0x7ffca9301f88 EEXIST 2024-09-19T11:55:50.872 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:50.872 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T11:55:50.872 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-a con 0x55822abf1aa0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:50.872 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-c con 0x55822ac1c040 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:50.872 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-b con 0x55822ac1d2d0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:50.872 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.872 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.872 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.872 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:50.873 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): authenticate will time out at 2244.802385s 2024-09-19T11:55:50.873 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): get_auth_request con 0x55822abf1aa0 auth_method 0 2024-09-19T11:55:50.873 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.873 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.873 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.873 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:55:50.485+0000 7ff52837e640 10 monclient(hunting): get_auth_request con 0x55822ac1c040 auth_method 0 2024-09-19T11:55:50.873 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:55:50.485+0000 7ff52837e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.873 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:55:50.485+0000 7ff52837e640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.873 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:55:50.485+0000 7ff52837e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.873 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.874 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.874 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.874 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:55:50.485+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.874 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:55:50.485+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.874 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:55:50.485+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.874 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): handle_auth_done global_id 6711 payload 274 2024-09-19T11:55:50.874 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient: _finish_hunting 0 2024-09-19T11:55:50.874 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:55:50.485+0000 7ff52737c640 1 monclient: found mon.noname-a 2024-09-19T11:55:50.874 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.874 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.874 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:50.874 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: dump: 2024-09-19T11:55:50.874 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.874 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.875 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.875 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.875 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.875 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.875 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.875 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.875 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.875 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.875 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: _finish_auth 0 2024-09-19T11:55:50.875 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: _check_auth_tickets 2024-09-19T11:55:50.875 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:50.875 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.875 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:50.875 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: dump: 2024-09-19T11:55:50.876 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.876 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.876 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.876 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.876 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.876 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.876 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.876 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.876 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.876 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.876 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 monclient: authenticate success, global_id 6711 2024-09-19T11:55:50.877 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: get_monmap_and_config success 2024-09-19T11:55:50.877 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 4 set_mon_vals no callback set 2024-09-19T11:55:50.877 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: shutdown 2024-09-19T11:55:50.877 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: build_initial_monmap 2024-09-19T11:55:50.877 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:50.877 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: monmap: 2024-09-19T11:55:50.877 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:50.877 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:50.877 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:50.877 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:50.877 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:50.877 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.878 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:50.878 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:50.878 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:50.878 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.878 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding auth protocol: cephx 2024-09-19T11:55:50.878 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding auth protocol: cephx 2024-09-19T11:55:50.878 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding auth protocol: cephx 2024-09-19T11:55:50.878 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: secure 2024-09-19T11:55:50.878 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: crc 2024-09-19T11:55:50.878 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: secure 2024-09-19T11:55:50.878 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: crc 2024-09-19T11:55:50.878 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: secure 2024-09-19T11:55:50.878 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: crc 2024-09-19T11:55:50.878 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: crc 2024-09-19T11:55:50.879 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: secure 2024-09-19T11:55:50.879 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: crc 2024-09-19T11:55:50.879 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: secure 2024-09-19T11:55:50.879 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: crc 2024-09-19T11:55:50.879 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: secure 2024-09-19T11:55:50.879 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.879 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 1 librados: starting msgr at 2024-09-19T11:55:50.879 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 1 librados: starting objecter 2024-09-19T11:55:50.879 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command objecter_requests cmddesc objecter_requests hook 0x55822ac14e70 EEXIST 2024-09-19T11:55:50.879 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 1 librados: setting wanted keys 2024-09-19T11:55:50.879 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 1 librados: calling monclient init 2024-09-19T11:55:50.879 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: init 2024-09-19T11:55:50.879 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding auth protocol: cephx 2024-09-19T11:55:50.879 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding auth protocol: cephx 2024-09-19T11:55:50.879 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding auth protocol: cephx 2024-09-19T11:55:50.880 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: secure 2024-09-19T11:55:50.880 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: crc 2024-09-19T11:55:50.880 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: secure 2024-09-19T11:55:50.880 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: crc 2024-09-19T11:55:50.880 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: secure 2024-09-19T11:55:50.880 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: crc 2024-09-19T11:55:50.880 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: crc 2024-09-19T11:55:50.880 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: secure 2024-09-19T11:55:50.880 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: crc 2024-09-19T11:55:50.880 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: secure 2024-09-19T11:55:50.880 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: crc 2024-09-19T11:55:50.880 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: secure 2024-09-19T11:55:50.880 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.881 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.881 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command rotate-key cmddesc rotate-key hook 0x55822abd0198 EEXIST 2024-09-19T11:55:50.881 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:50.881 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T11:55:50.881 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-c con 0x55822abf1aa0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:50.881 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-b con 0x55822ac1c040 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:50.881 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-a con 0x55822ac1d2d0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:50.881 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.881 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.881 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.881 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:50.881 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): authenticate will time out at 2244.805052s 2024-09-19T11:55:50.881 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:55:50.489+0000 7ff52737c640 10 monclient(hunting): get_auth_request con 0x55822abf1aa0 auth_method 0 2024-09-19T11:55:50.882 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:55:50.489+0000 7ff52737c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.882 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:55:50.489+0000 7ff52737c640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.882 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:55:50.489+0000 7ff52737c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.882 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): get_auth_request con 0x55822ac1d2d0 auth_method 0 2024-09-19T11:55:50.882 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.882 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.882 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.882 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:55:50.489+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.882 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:55:50.489+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.882 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:55:50.489+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.882 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.882 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.882 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.883 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): handle_auth_done global_id 6714 payload 824 2024-09-19T11:55:50.883 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient: _finish_hunting 0 2024-09-19T11:55:50.883 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:55:50.489+0000 7ff527b7d640 1 monclient: found mon.noname-a 2024-09-19T11:55:50.883 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.883 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.883 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:50.883 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: dump: 2024-09-19T11:55:50.883 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.883 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.883 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.883 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.883 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.883 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.883 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.883 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.884 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.884 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.884 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: _finish_auth 0 2024-09-19T11:55:50.884 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: _check_auth_tickets 2024-09-19T11:55:50.884 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:50.884 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.884 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:50.884 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: dump: 2024-09-19T11:55:50.884 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.884 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.884 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.884 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.884 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.885 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.885 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.885 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.885 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.885 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.885 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 monclient: authenticate success, global_id 6714 2024-09-19T11:55:50.885 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: _renew_subs 2024-09-19T11:55:50.885 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:55:50.489+0000 7ff406ffd640 4 set_mon_vals no callback set 2024-09-19T11:55:50.885 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.885 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: _renew_subs 2024-09-19T11:55:50.885 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.885 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 1 librados: init done 2024-09-19T11:55:50.885 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command cr dump hook 0x55822ac199a8 2024-09-19T11:55:50.885 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.886 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:55:50.493+0000 7ff4057fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:55:50.886 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:55:50.493+0000 7ff4057fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:50.886 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:55:50.493+0000 7ff4057fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:50.886 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:55:50.493+0000 7ff52737c640 10 monclient: get_auth_request con 0x7ff3f0071be0 auth_method 0 2024-09-19T11:55:50.886 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:55:50.493+0000 7ff52837e640 10 monclient: get_auth_request con 0x55822ac3b510 auth_method 0 2024-09-19T11:55:50.886 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.886 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 realm 2024-09-19T11:55:50.886 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.886 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.886 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:50.886 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.887 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.887 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.887 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:55:50.493+0000 7ff52737c640 10 monclient: get_auth_request con 0x55822ac3f760 auth_method 0 2024-09-19T11:55:50.887 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:50.887 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.887 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:55:50.497+0000 7ff52837e640 10 monclient: get_auth_request con 0x55822ac43010 auth_method 0 2024-09-19T11:55:50.888 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:55:50.497+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:50.888 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:55:50.497+0000 7ff52a0779c0 20 searching for the correct realm 2024-09-19T11:55:50.888 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:55:50.497+0000 7ff527b7d640 10 monclient: get_auth_request con 0x55822ac47d30 auth_method 0 2024-09-19T11:55:50.888 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:55:50.497+0000 7ff52737c640 10 monclient: get_auth_request con 0x7ff5180bc040 auth_method 0 2024-09-19T11:55:50.888 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:55:50.501+0000 7ff52837e640 10 monclient: get_auth_request con 0x7ff51c03d070 auth_method 0 2024-09-19T11:55:50.888 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:55:50.501+0000 7ff527b7d640 10 monclient: get_auth_request con 0x7ff520008030 auth_method 0 2024-09-19T11:55:50.888 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:55:50.501+0000 7ff527b7d640 0 -- 172.21.15.120:0/1205192878 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff520008030 msgr2=0x7ff52005ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:50.889 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:55:50.705+0000 7ff527b7d640 10 monclient: get_auth_request con 0x7ff520008030 auth_method 0 2024-09-19T11:55:50.889 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:55:50.717+0000 7ff52737c640 10 monclient: get_auth_request con 0x7ff5180fae50 auth_method 0 2024-09-19T11:55:50.889 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:55:50.717+0000 7ff527b7d640 0 -- 172.21.15.120:0/1205192878 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff520008030 msgr2=0x7ff52005ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:50.889 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:55:50.717+0000 7ff4057fa640 1 client.6714.objecter ms_handle_reset 0x7ff520008030 session 0x7ff520091900 osd.4 2024-09-19T11:55:50.889 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:55:50.717+0000 7ff4057fa640 10 monclient: _renew_subs 2024-09-19T11:55:50.889 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:55:50.717+0000 7ff4057fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.889 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:55:50.717+0000 7ff527b7d640 10 monclient: get_auth_request con 0x7ff3f0082280 auth_method 0 2024-09-19T11:55:50.890 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:50.890 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:50.890 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:50.890 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:50.890 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:50.890 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:50.891 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.891 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.891 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.891 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:50.891 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.891 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:50.892 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 zone default found 2024-09-19T11:55:50.892 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 4 Realm: () 2024-09-19T11:55:50.892 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:50.892 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:50.892 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:50.892 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 zonegroup default 2024-09-19T11:55:50.892 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.893 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.896 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.896 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.897 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.897 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.897 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 started sync module instance, tier type = 2024-09-19T11:55:50.897 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:50.897 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=0 2024-09-19T11:55:50.897 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=1 2024-09-19T11:55:50.897 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=2 2024-09-19T11:55:50.897 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=3 2024-09-19T11:55:50.897 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=4 2024-09-19T11:55:50.897 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=5 2024-09-19T11:55:50.897 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=6 2024-09-19T11:55:50.897 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=7 2024-09-19T11:55:50.898 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:50.898 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding auth protocol: cephx 2024-09-19T11:55:50.898 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding auth protocol: cephx 2024-09-19T11:55:50.898 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding auth protocol: cephx 2024-09-19T11:55:50.898 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: secure 2024-09-19T11:55:50.898 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: crc 2024-09-19T11:55:50.899 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: secure 2024-09-19T11:55:50.899 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: crc 2024-09-19T11:55:50.899 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:55:50.761+0000 7ff3ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:50.899 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: secure 2024-09-19T11:55:50.899 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: crc 2024-09-19T11:55:50.899 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: crc 2024-09-19T11:55:50.899 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: secure 2024-09-19T11:55:50.900 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: crc 2024-09-19T11:55:50.900 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: secure 2024-09-19T11:55:50.900 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: crc 2024-09-19T11:55:50.900 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: secure 2024-09-19T11:55:50.900 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.900 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:50.901 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:50.901 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command cache list hook 0x55822ac1b5b0 2024-09-19T11:55:50.901 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command cache inspect hook 0x55822ac1b5b0 2024-09-19T11:55:50.901 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command cache erase hook 0x55822ac1b5b0 2024-09-19T11:55:50.901 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command cache zap hook 0x55822ac1b5b0 2024-09-19T11:55:50.901 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 note: GC not initialized 2024-09-19T11:55:50.902 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:55:50.765+0000 7ff3dcfe1640 20 reqs_thread_entry: start 2024-09-19T11:55:50.902 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command sync trace show hook 0x7ff51c01c050 2024-09-19T11:55:50.902 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command sync trace history hook 0x7ff51c01c050 2024-09-19T11:55:50.902 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command sync trace active hook 0x7ff51c01c050 2024-09-19T11:55:50.902 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command sync trace active_short hook 0x7ff51c01c050 2024-09-19T11:55:50.902 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:50.903 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 Filter name: none 2024-09-19T11:55:50.903 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:55:50.765+0000 7ff3567fc640 20 reqs_thread_entry: start 2024-09-19T11:55:50.903 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-19T11:55:50.903 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.903 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:50.903 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-19T11:55:50.903 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-19T11:55:50.904 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 : miss 2024-09-19T11:55:50.904 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.904 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:55:50.769+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:50.904 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:55:50.769+0000 7ff52a0779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 info.flags=0x17 2024-09-19T11:55:50.904 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:55:50.769+0000 7ff52a0779c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 to cache LRU end 2024-09-19T11:55:50.905 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:55:50.769+0000 7ff52a0779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:50.905 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:55:50.769+0000 7ff52a0779c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:50.905 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:55:50.769+0000 7ff52a0779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 2024-09-19T11:55:50.905 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:55:50.777+0000 7ff52a0779c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff52a0779c0 time 2024-09-19T11:55:50.776487+0000 2024-09-19T11:55:50.905 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:55:50.905 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.906 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:50.906 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff52d9512eb] 2024-09-19T11:55:50.906 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff52d95149f] 2024-09-19T11:55:50.906 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558228bba271] 2024-09-19T11:55:50.906 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x140fb48) [0x55822960ab48] 2024-09-19T11:55:50.906 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558228bca0dd] 2024-09-19T11:55:50.907 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:55:50.907 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff52c7b7d90] 2024-09-19T11:55:50.907 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:55:50.907 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:55:50.907 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.907 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:55:50.781+0000 7ff52a0779c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:55:50.908 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7ff52a0779c0 thread_name:radosgw-admin 2024-09-19T11:55:50.908 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.908 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:50.908 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff52c7d0520] 2024-09-19T11:55:50.908 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:55:50.908 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:55:50.909 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:55:50.909 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff52d951345] 2024-09-19T11:55:50.909 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff52d95149f] 2024-09-19T11:55:50.909 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558228bba271] 2024-09-19T11:55:50.909 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x140fb48) [0x55822960ab48] 2024-09-19T11:55:50.909 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558228bca0dd] 2024-09-19T11:55:50.910 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:55:50.910 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff52c7b7d90] 2024-09-19T11:55:50.910 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:55:50.910 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:55:50.910 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:55:50.910 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.911 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:55:50.911 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:55:50.911 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:55:50.911 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:55:50.911 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:55:50.911 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:55:50.912 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:55:50.912 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:55:50.912 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:55:50.912 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:55:50.912 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:55:50.913 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:55:50.913 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:55:50.913 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:55:50.913 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:55:50.913 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:55:50.913 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:55:50.914 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:55:50.914 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:55:50.914 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:55:50.914 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:55:50.914 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:55:50.914 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:55:50.915 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:55:50.915 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:55:50.915 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:55:50.915 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:55:50.915 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:55:50.915 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:55:50.916 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:55:50.916 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:55:50.916 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:55:50.916 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:55:50.916 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:55:50.916 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:55:50.917 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:55:50.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:55:50.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:55:50.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:55:50.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:55:50.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:55:50.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:55:50.918 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:55:50.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:55:50.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:55:50.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:55:50.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:55:50.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:55:50.919 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:55:50.919 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:55:50.919 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:55:50.919 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:55:50.919 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:55:50.919 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:55:50.920 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:55:50.920 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:55:50.920 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:55:50.920 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:55:50.920 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:55:50.920 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:55:50.921 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:55:50.921 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:55:50.921 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:55:50.921 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:55:50.921 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:55:50.921 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:55:50.922 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:55:50.922 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:55:50.922 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:55:50.922 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:55:50.922 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:55:50.922 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:55:50.922 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:55:50.923 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:55:50.923 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:55:50.923 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:55:50.923 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:55:50.923 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:55:50.923 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:55:50.924 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:55:50.924 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:55:50.924 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:55:50.924 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:55:50.924 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:55:50.925 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:55:50.925 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:55:50.925 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:55:50.925 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:55:50.925 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:55:50.925 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:55:50.925 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:55:50.926 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:55:50.926 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:55:50.926 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:55:50.926 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff3567fc640 / http_manager 2024-09-19T11:55:50.926 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff3dcfe1640 / http_manager 2024-09-19T11:55:50.926 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff3ddfe3640 / rgw_dt_lg_renew 2024-09-19T11:55:50.926 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4057fa640 / ms_dispatch 2024-09-19T11:55:50.927 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff406ffd640 / io_context_pool 2024-09-19T11:55:50.927 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff40d7fa640 / ms_dispatch 2024-09-19T11:55:50.927 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff40ffff640 / ms_dispatch 2024-09-19T11:55:50.927 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff415e0b640 / io_context_pool 2024-09-19T11:55:50.927 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff52737c640 / msgr-worker-2 2024-09-19T11:55:50.927 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff527b7d640 / msgr-worker-1 2024-09-19T11:55:50.927 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff52837e640 / msgr-worker-0 2024-09-19T11:55:50.927 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff528b7f640 / io_context_pool 2024-09-19T11:55:50.928 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff52a0779c0 / radosgw-admin 2024-09-19T11:55:50.928 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:55:50.928 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:55:50.928 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/log/ceph/ceph-client.admin.91570.log 2024-09-19T11:55:50.928 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:55:50.928 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:55:50.928 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.928 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.929 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.929 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.929 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.929 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.929 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.929 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): get_auth_request con 0x55822aa09590 auth_method 0 2024-09-19T11:55:50.929 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.929 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.929 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.929 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): handle_auth_done global_id 6702 payload 274 2024-09-19T11:55:50.929 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient: _finish_hunting 0 2024-09-19T11:55:50.929 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:55:50.469+0000 7ff527b7d640 1 monclient: found mon.noname-a 2024-09-19T11:55:50.929 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.929 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.930 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:50.930 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: dump: 2024-09-19T11:55:50.930 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.930 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.930 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.930 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.930 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.930 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.930 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.930 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.930 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.930 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.930 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: _finish_auth 0 2024-09-19T11:55:50.931 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: _check_auth_tickets 2024-09-19T11:55:50.931 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:50.931 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.931 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:50.931 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:55:50.469+0000 7ff415e0b640 10 monclient: dump: 2024-09-19T11:55:50.931 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.931 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.931 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.931 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.931 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.931 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.931 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.931 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.932 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.932 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.932 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 monclient: authenticate success, global_id 6702 2024-09-19T11:55:50.932 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient: get_monmap_and_config success 2024-09-19T11:55:50.932 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 4 set_mon_vals no callback set 2024-09-19T11:55:50.932 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient: shutdown 2024-09-19T11:55:50.932 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 asok(0x55822a943d90) unregister_commands rotate-key 2024-09-19T11:55:50.932 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient: build_initial_monmap 2024-09-19T11:55:50.932 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:50.932 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient: monmap: 2024-09-19T11:55:50.932 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:50.933 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:50.933 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:50.933 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:50.933 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:50.933 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.933 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:50.933 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:50.933 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:50.933 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.933 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding auth protocol: cephx 2024-09-19T11:55:50.933 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding auth protocol: cephx 2024-09-19T11:55:50.933 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding auth protocol: cephx 2024-09-19T11:55:50.933 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: secure 2024-09-19T11:55:50.933 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: crc 2024-09-19T11:55:50.934 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: secure 2024-09-19T11:55:50.934 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: crc 2024-09-19T11:55:50.934 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: secure 2024-09-19T11:55:50.934 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: crc 2024-09-19T11:55:50.934 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: crc 2024-09-19T11:55:50.934 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: secure 2024-09-19T11:55:50.934 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: crc 2024-09-19T11:55:50.934 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: secure 2024-09-19T11:55:50.934 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: crc 2024-09-19T11:55:50.934 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab55960) adding con mode: secure 2024-09-19T11:55:50.934 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.934 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 1 librados: starting msgr at 2024-09-19T11:55:50.935 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 1 librados: starting objecter 2024-09-19T11:55:50.935 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command objecter_requests hook 0x55822ab52bd0 2024-09-19T11:55:50.935 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 1 librados: setting wanted keys 2024-09-19T11:55:50.935 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 1 librados: calling monclient init 2024-09-19T11:55:50.935 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient: init 2024-09-19T11:55:50.935 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding auth protocol: cephx 2024-09-19T11:55:50.935 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding auth protocol: cephx 2024-09-19T11:55:50.935 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding auth protocol: cephx 2024-09-19T11:55:50.935 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: secure 2024-09-19T11:55:50.935 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: crc 2024-09-19T11:55:50.935 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: secure 2024-09-19T11:55:50.936 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: crc 2024-09-19T11:55:50.936 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: secure 2024-09-19T11:55:50.936 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: crc 2024-09-19T11:55:50.936 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: crc 2024-09-19T11:55:50.936 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: secure 2024-09-19T11:55:50.936 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: crc 2024-09-19T11:55:50.936 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: secure 2024-09-19T11:55:50.936 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: crc 2024-09-19T11:55:50.936 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 AuthRegistry(0x55822ab4f0c0) adding con mode: secure 2024-09-19T11:55:50.936 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.937 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.937 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command rotate-key hook 0x55822ab4f208 2024-09-19T11:55:50.937 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:50.937 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T11:55:50.937 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-b con 0x55822a9dcce0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:50.937 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-c con 0x55822aa09590 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:50.937 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-a con 0x55822aa94bd0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:50.937 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.937 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.937 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.937 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:50.937 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:55:50.469+0000 7ff52a0779c0 10 monclient(hunting): authenticate will time out at 2244.787075s 2024-09-19T11:55:50.937 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): get_auth_request con 0x55822aa09590 auth_method 0 2024-09-19T11:55:50.938 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.938 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.938 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.938 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): get_auth_request con 0x55822aa94bd0 auth_method 0 2024-09-19T11:55:50.938 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.938 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.938 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.938 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.938 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.938 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.938 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.938 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.938 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:55:50.469+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.939 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): get_auth_request con 0x55822a9dcce0 auth_method 0 2024-09-19T11:55:50.939 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.939 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.939 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:55:50.469+0000 7ff527b7d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.939 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient(hunting): handle_auth_done global_id 6705 payload 824 2024-09-19T11:55:50.939 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient: _finish_hunting 0 2024-09-19T11:55:50.939 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:55:50.469+0000 7ff52837e640 1 monclient: found mon.noname-a 2024-09-19T11:55:50.939 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:55:50.469+0000 7ff52837e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.939 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.939 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:50.939 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: dump: 2024-09-19T11:55:50.940 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.940 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.940 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.940 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.940 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.940 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.940 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.940 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.940 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.941 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.941 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: _finish_auth 0 2024-09-19T11:55:50.941 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: _check_auth_tickets 2024-09-19T11:55:50.941 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:50.941 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.941 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:50.941 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:55:50.469+0000 7ff40ffff640 10 monclient: dump: 2024-09-19T11:55:50.941 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.941 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.941 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.941 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.941 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.941 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.941 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.942 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.942 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.942 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.942 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:55:50.473+0000 7ff52a0779c0 5 monclient: authenticate success, global_id 6705 2024-09-19T11:55:50.942 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:55:50.469+0000 7ff415e0b640 4 set_mon_vals no callback set 2024-09-19T11:55:50.942 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:55:50.473+0000 7ff52a0779c0 10 monclient: _renew_subs 2024-09-19T11:55:50.942 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:55:50.473+0000 7ff52a0779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.942 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:55:50.473+0000 7ff52a0779c0 10 monclient: _renew_subs 2024-09-19T11:55:50.942 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:55:50.473+0000 7ff52a0779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.942 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:55:50.473+0000 7ff52a0779c0 1 librados: init done 2024-09-19T11:55:50.942 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:55:50.473+0000 7ff40ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:55:50.942 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:55:50.473+0000 7ff40ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:50.942 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:55:50.473+0000 7ff40ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:50.942 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:55:50.473+0000 7ff527b7d640 10 monclient: get_auth_request con 0x7ff410071be0 auth_method 0 2024-09-19T11:55:50.943 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:55:50.473+0000 7ff52737c640 10 monclient: get_auth_request con 0x55822ab97360 auth_method 0 2024-09-19T11:55:50.943 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:55:50.473+0000 7ff527b7d640 10 monclient: get_auth_request con 0x55822ab9a540 auth_method 0 2024-09-19T11:55:50.943 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:55:50.477+0000 7ff52737c640 10 monclient: get_auth_request con 0x55822ab9e730 auth_method 0 2024-09-19T11:55:50.943 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:55:50.477+0000 7ff52837e640 10 monclient: get_auth_request con 0x55822ab9ddf0 auth_method 0 2024-09-19T11:55:50.943 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: build_initial_monmap 2024-09-19T11:55:50.943 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:50.943 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: monmap: 2024-09-19T11:55:50.943 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:50.943 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:50.943 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:50.943 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:50.943 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:50.943 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.943 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:50.943 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:50.944 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:50.944 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.944 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding auth protocol: cephx 2024-09-19T11:55:50.944 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding auth protocol: cephx 2024-09-19T11:55:50.944 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding auth protocol: cephx 2024-09-19T11:55:50.944 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: secure 2024-09-19T11:55:50.944 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: crc 2024-09-19T11:55:50.944 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: secure 2024-09-19T11:55:50.944 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: crc 2024-09-19T11:55:50.944 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: secure 2024-09-19T11:55:50.944 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: crc 2024-09-19T11:55:50.944 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: crc 2024-09-19T11:55:50.944 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: secure 2024-09-19T11:55:50.944 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: crc 2024-09-19T11:55:50.944 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: secure 2024-09-19T11:55:50.945 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: crc 2024-09-19T11:55:50.945 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba6650) adding con mode: secure 2024-09-19T11:55:50.945 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.945 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command objecter_requests cmddesc objecter_requests hook 0x55822abaa080 EEXIST 2024-09-19T11:55:50.945 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: init 2024-09-19T11:55:50.945 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding auth protocol: cephx 2024-09-19T11:55:50.945 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding auth protocol: cephx 2024-09-19T11:55:50.945 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding auth protocol: cephx 2024-09-19T11:55:50.945 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: secure 2024-09-19T11:55:50.945 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: crc 2024-09-19T11:55:50.945 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: secure 2024-09-19T11:55:50.945 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: crc 2024-09-19T11:55:50.945 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: secure 2024-09-19T11:55:50.945 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: crc 2024-09-19T11:55:50.946 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: crc 2024-09-19T11:55:50.946 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: secure 2024-09-19T11:55:50.946 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: crc 2024-09-19T11:55:50.946 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: secure 2024-09-19T11:55:50.946 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: crc 2024-09-19T11:55:50.946 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 AuthRegistry(0x55822aba5598) adding con mode: secure 2024-09-19T11:55:50.946 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.946 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.946 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command rotate-key cmddesc rotate-key hook 0x55822aba56e0 EEXIST 2024-09-19T11:55:50.946 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:50.946 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T11:55:50.946 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-b con 0x55822abce230 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:50.946 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-c con 0x55822abcdb60 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:50.946 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-a con 0x55822abcc540 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:50.947 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.947 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.947 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.947 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:50.947 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient(hunting): authenticate will time out at 2244.797758s 2024-09-19T11:55:50.947 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): get_auth_request con 0x55822abcc540 auth_method 0 2024-09-19T11:55:50.947 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.947 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.947 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.947 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:55:50.481+0000 7ff52837e640 10 monclient(hunting): get_auth_request con 0x55822abcdb60 auth_method 0 2024-09-19T11:55:50.947 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:55:50.481+0000 7ff52837e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.947 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:55:50.481+0000 7ff52837e640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.947 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:55:50.481+0000 7ff52837e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.947 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.947 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.948 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.948 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:55:50.481+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.948 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:55:50.481+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.948 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:55:50.481+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.948 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:55:50.481+0000 7ff52737c640 10 monclient(hunting): get_auth_request con 0x55822abce230 auth_method 0 2024-09-19T11:55:50.948 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:55:50.481+0000 7ff52737c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.948 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:55:50.481+0000 7ff52737c640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.948 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:55:50.481+0000 7ff52737c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.948 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient(hunting): handle_auth_done global_id 6708 payload 824 2024-09-19T11:55:50.948 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient: _finish_hunting 0 2024-09-19T11:55:50.948 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:55:50.481+0000 7ff527b7d640 1 monclient: found mon.noname-a 2024-09-19T11:55:50.948 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:55:50.481+0000 7ff527b7d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.948 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.948 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:50.949 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: dump: 2024-09-19T11:55:50.949 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.949 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.949 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.949 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.949 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.949 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.949 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.949 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.949 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.949 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.949 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: _finish_auth 0 2024-09-19T11:55:50.949 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: _check_auth_tickets 2024-09-19T11:55:50.949 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:50.950 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.950 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:50.950 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:55:50.481+0000 7ff40d7fa640 10 monclient: dump: 2024-09-19T11:55:50.950 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.950 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.950 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.950 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.950 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.950 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.950 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.950 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.950 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.950 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.950 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:55:50.481+0000 7ff528b7f640 4 set_mon_vals no callback set 2024-09-19T11:55:50.950 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 5 monclient: authenticate success, global_id 6708 2024-09-19T11:55:50.951 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: _renew_subs 2024-09-19T11:55:50.951 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.951 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: _renew_subs 2024-09-19T11:55:50.951 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:55:50.481+0000 7ff52a0779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.951 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:55:50.485+0000 7ff40d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:55:50.951 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:55:50.485+0000 7ff40d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:50.951 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:55:50.485+0000 7ff40d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:50.951 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: get_monmap_and_config 2024-09-19T11:55:50.951 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: build_initial_monmap 2024-09-19T11:55:50.951 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:50.951 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: monmap: 2024-09-19T11:55:50.951 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:50.951 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:50.951 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:50.951 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:50.952 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:50.952 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.952 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:50.952 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:50.952 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:50.952 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.952 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding auth protocol: cephx 2024-09-19T11:55:50.952 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding auth protocol: cephx 2024-09-19T11:55:50.952 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding auth protocol: cephx 2024-09-19T11:55:50.952 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: secure 2024-09-19T11:55:50.952 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: crc 2024-09-19T11:55:50.952 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: secure 2024-09-19T11:55:50.952 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: crc 2024-09-19T11:55:50.952 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: secure 2024-09-19T11:55:50.953 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: crc 2024-09-19T11:55:50.953 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: crc 2024-09-19T11:55:50.953 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: secure 2024-09-19T11:55:50.953 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: crc 2024-09-19T11:55:50.953 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: secure 2024-09-19T11:55:50.953 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: crc 2024-09-19T11:55:50.953 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x55822abed9a0) adding con mode: secure 2024-09-19T11:55:50.953 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient: get_auth_request con 0x7ff400071b20 auth_method 0 2024-09-19T11:55:50.953 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.953 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: init 2024-09-19T11:55:50.953 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding auth protocol: cephx 2024-09-19T11:55:50.953 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding auth protocol: cephx 2024-09-19T11:55:50.953 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding auth protocol: cephx 2024-09-19T11:55:50.953 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: secure 2024-09-19T11:55:50.954 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: crc 2024-09-19T11:55:50.954 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: secure 2024-09-19T11:55:50.954 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: crc 2024-09-19T11:55:50.954 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: secure 2024-09-19T11:55:50.954 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: crc 2024-09-19T11:55:50.954 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: crc 2024-09-19T11:55:50.954 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: secure 2024-09-19T11:55:50.954 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: crc 2024-09-19T11:55:50.954 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: secure 2024-09-19T11:55:50.954 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: crc 2024-09-19T11:55:50.954 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9301e40) adding con mode: secure 2024-09-19T11:55:50.954 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.954 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.954 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command rotate-key cmddesc rotate-key hook 0x7ffca9301f88 EEXIST 2024-09-19T11:55:50.954 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:50.955 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T11:55:50.955 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-a con 0x55822abf1aa0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:50.955 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-c con 0x55822ac1c040 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:50.955 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-b con 0x55822ac1d2d0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:50.955 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.955 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.955 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.955 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:50.955 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient(hunting): authenticate will time out at 2244.802385s 2024-09-19T11:55:50.955 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): get_auth_request con 0x55822abf1aa0 auth_method 0 2024-09-19T11:55:50.955 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.955 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.955 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.955 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:55:50.485+0000 7ff52837e640 10 monclient(hunting): get_auth_request con 0x55822ac1c040 auth_method 0 2024-09-19T11:55:50.956 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:55:50.485+0000 7ff52837e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.956 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:55:50.485+0000 7ff52837e640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.956 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:55:50.485+0000 7ff52837e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.956 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.956 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.956 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.956 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:55:50.485+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.956 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:55:50.485+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.956 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:55:50.485+0000 7ff52837e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.956 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient(hunting): handle_auth_done global_id 6711 payload 274 2024-09-19T11:55:50.956 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient: _finish_hunting 0 2024-09-19T11:55:50.956 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:55:50.485+0000 7ff52737c640 1 monclient: found mon.noname-a 2024-09-19T11:55:50.956 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:55:50.485+0000 7ff52737c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.956 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.957 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:50.957 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: dump: 2024-09-19T11:55:50.957 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.957 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.957 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.957 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.957 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.957 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.957 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.957 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.957 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.957 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.957 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: _finish_auth 0 2024-09-19T11:55:50.957 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: _check_auth_tickets 2024-09-19T11:55:50.957 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:50.958 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.958 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:50.958 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:55:50.485+0000 7ff406ffd640 10 monclient: dump: 2024-09-19T11:55:50.958 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.958 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.958 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.958 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.958 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.958 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.958 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.958 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.958 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.959 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.959 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 5 monclient: authenticate success, global_id 6711 2024-09-19T11:55:50.959 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: get_monmap_and_config success 2024-09-19T11:55:50.959 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 4 set_mon_vals no callback set 2024-09-19T11:55:50.959 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: shutdown 2024-09-19T11:55:50.959 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:55:50.485+0000 7ff52a0779c0 10 monclient: build_initial_monmap 2024-09-19T11:55:50.959 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 1 build_initial for_mkfs: 0 2024-09-19T11:55:50.959 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: monmap: 2024-09-19T11:55:50.959 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:55:50.959 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:55:50.959 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:55:50.959 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:55:50.959 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:55:50.959 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.960 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:55:50.960 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:55:50.960 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:55:50.960 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.960 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding auth protocol: cephx 2024-09-19T11:55:50.960 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding auth protocol: cephx 2024-09-19T11:55:50.960 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding auth protocol: cephx 2024-09-19T11:55:50.960 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: secure 2024-09-19T11:55:50.960 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: crc 2024-09-19T11:55:50.960 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: secure 2024-09-19T11:55:50.960 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: crc 2024-09-19T11:55:50.960 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: secure 2024-09-19T11:55:50.960 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: crc 2024-09-19T11:55:50.960 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: crc 2024-09-19T11:55:50.961 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: secure 2024-09-19T11:55:50.961 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: crc 2024-09-19T11:55:50.961 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: secure 2024-09-19T11:55:50.961 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: crc 2024-09-19T11:55:50.961 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abf2a60) adding con mode: secure 2024-09-19T11:55:50.961 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.961 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 1 librados: starting msgr at 2024-09-19T11:55:50.961 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 1 librados: starting objecter 2024-09-19T11:55:50.961 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command objecter_requests cmddesc objecter_requests hook 0x55822ac14e70 EEXIST 2024-09-19T11:55:50.961 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 1 librados: setting wanted keys 2024-09-19T11:55:50.961 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 1 librados: calling monclient init 2024-09-19T11:55:50.961 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: init 2024-09-19T11:55:50.961 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding auth protocol: cephx 2024-09-19T11:55:50.961 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding auth protocol: cephx 2024-09-19T11:55:50.961 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding auth protocol: cephx 2024-09-19T11:55:50.962 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: secure 2024-09-19T11:55:50.962 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: crc 2024-09-19T11:55:50.962 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: secure 2024-09-19T11:55:50.962 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: crc 2024-09-19T11:55:50.962 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: secure 2024-09-19T11:55:50.962 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: crc 2024-09-19T11:55:50.962 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: crc 2024-09-19T11:55:50.962 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: secure 2024-09-19T11:55:50.962 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: crc 2024-09-19T11:55:50.962 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: secure 2024-09-19T11:55:50.962 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: crc 2024-09-19T11:55:50.962 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 AuthRegistry(0x55822abd0050) adding con mode: secure 2024-09-19T11:55:50.962 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.962 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.963 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command rotate-key cmddesc rotate-key hook 0x55822abd0198 EEXIST 2024-09-19T11:55:50.963 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: _reopen_session rank -1 2024-09-19T11:55:50.963 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T11:55:50.963 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-c con 0x55822abf1aa0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:55:50.963 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-b con 0x55822ac1c040 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:55:50.963 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): picked mon.noname-a con 0x55822ac1d2d0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:55:50.963 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.963 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.963 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:55:50.963 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): _renew_subs 2024-09-19T11:55:50.963 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient(hunting): authenticate will time out at 2244.805052s 2024-09-19T11:55:50.963 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:55:50.489+0000 7ff52737c640 10 monclient(hunting): get_auth_request con 0x55822abf1aa0 auth_method 0 2024-09-19T11:55:50.963 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:55:50.489+0000 7ff52737c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.963 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:55:50.489+0000 7ff52737c640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.963 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:55:50.489+0000 7ff52737c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.964 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): get_auth_request con 0x55822ac1d2d0 auth_method 0 2024-09-19T11:55:50.964 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:55:50.964 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:55:50.964 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:55:50.964 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:55:50.489+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.964 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:55:50.489+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.964 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:55:50.489+0000 7ff52737c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.964 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:55:50.964 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:55:50.964 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:55:50.964 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient(hunting): handle_auth_done global_id 6714 payload 824 2024-09-19T11:55:50.964 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient: _finish_hunting 0 2024-09-19T11:55:50.964 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:55:50.489+0000 7ff527b7d640 1 monclient: found mon.noname-a 2024-09-19T11:55:50.964 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:55:50.489+0000 7ff527b7d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.965 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.965 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:55:50.965 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: dump: 2024-09-19T11:55:50.965 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.965 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.965 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.965 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.965 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.965 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.965 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.965 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.965 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.965 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.965 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: _finish_auth 0 2024-09-19T11:55:50.966 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: _check_auth_tickets 2024-09-19T11:55:50.966 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: handle_config config(0 keys) 2024-09-19T11:55:50.966 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:55:50.966 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:55:50.966 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:55:50.489+0000 7ff4057fa640 10 monclient: dump: 2024-09-19T11:55:50.966 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:55:50.966 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:55:50.966 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.966 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:55:50.966 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:55:50.966 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:55:50.966 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:55:50.966 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:55:50.966 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:55:50.966 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.967 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 monclient: authenticate success, global_id 6714 2024-09-19T11:55:50.967 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: _renew_subs 2024-09-19T11:55:50.967 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:55:50.489+0000 7ff406ffd640 4 set_mon_vals no callback set 2024-09-19T11:55:50.967 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.967 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: _renew_subs 2024-09-19T11:55:50.967 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.967 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 1 librados: init done 2024-09-19T11:55:50.967 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command cr dump hook 0x55822ac199a8 2024-09-19T11:55:50.967 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:55:50.489+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.967 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:55:50.493+0000 7ff4057fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:55:50.967 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:55:50.493+0000 7ff4057fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:50.967 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:55:50.493+0000 7ff4057fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:55:50.967 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:55:50.493+0000 7ff52737c640 10 monclient: get_auth_request con 0x7ff3f0071be0 auth_method 0 2024-09-19T11:55:50.967 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:55:50.493+0000 7ff52837e640 10 monclient: get_auth_request con 0x55822ac3b510 auth_method 0 2024-09-19T11:55:50.968 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.968 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 realm 2024-09-19T11:55:50.968 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.968 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.968 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:50.968 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.968 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.968 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.968 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:55:50.493+0000 7ff52737c640 10 monclient: get_auth_request con 0x55822ac3f760 auth_method 0 2024-09-19T11:55:50.968 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:50.968 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:55:50.493+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.968 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:55:50.497+0000 7ff52837e640 10 monclient: get_auth_request con 0x55822ac43010 auth_method 0 2024-09-19T11:55:50.968 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:55:50.497+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:50.968 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:55:50.497+0000 7ff52a0779c0 20 searching for the correct realm 2024-09-19T11:55:50.968 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:55:50.497+0000 7ff527b7d640 10 monclient: get_auth_request con 0x55822ac47d30 auth_method 0 2024-09-19T11:55:50.969 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:55:50.497+0000 7ff52737c640 10 monclient: get_auth_request con 0x7ff5180bc040 auth_method 0 2024-09-19T11:55:50.969 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:55:50.501+0000 7ff52837e640 10 monclient: get_auth_request con 0x7ff51c03d070 auth_method 0 2024-09-19T11:55:50.969 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:55:50.501+0000 7ff527b7d640 10 monclient: get_auth_request con 0x7ff520008030 auth_method 0 2024-09-19T11:55:50.969 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:55:50.501+0000 7ff527b7d640 0 -- 172.21.15.120:0/1205192878 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff520008030 msgr2=0x7ff52005ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:50.969 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:55:50.705+0000 7ff527b7d640 10 monclient: get_auth_request con 0x7ff520008030 auth_method 0 2024-09-19T11:55:50.969 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:55:50.717+0000 7ff52737c640 10 monclient: get_auth_request con 0x7ff5180fae50 auth_method 0 2024-09-19T11:55:50.969 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:55:50.717+0000 7ff527b7d640 0 -- 172.21.15.120:0/1205192878 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff520008030 msgr2=0x7ff52005ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:50.969 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:55:50.717+0000 7ff4057fa640 1 client.6714.objecter ms_handle_reset 0x7ff520008030 session 0x7ff520091900 osd.4 2024-09-19T11:55:50.969 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:55:50.717+0000 7ff4057fa640 10 monclient: _renew_subs 2024-09-19T11:55:50.969 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:55:50.717+0000 7ff4057fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:55:50.969 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:55:50.717+0000 7ff527b7d640 10 monclient: get_auth_request con 0x7ff3f0082280 auth_method 0 2024-09-19T11:55:50.969 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:50.969 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:50.969 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:50.970 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:50.970 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:50.970 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:50.970 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.970 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:55:50.729+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.970 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.970 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:50.970 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.970 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:50.970 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 zone default found 2024-09-19T11:55:50.970 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 4 Realm: () 2024-09-19T11:55:50.970 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:50.970 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:50.970 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:50.970 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 zonegroup default 2024-09-19T11:55:50.971 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.971 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.971 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.971 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.971 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.971 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.971 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 started sync module instance, tier type = 2024-09-19T11:55:50.971 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:55:50.733+0000 7ff52a0779c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:50.971 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=0 2024-09-19T11:55:50.971 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=1 2024-09-19T11:55:50.971 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=2 2024-09-19T11:55:50.971 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=3 2024-09-19T11:55:50.971 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=4 2024-09-19T11:55:50.971 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=5 2024-09-19T11:55:50.971 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=6 2024-09-19T11:55:50.972 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 20 add_watcher() i=7 2024-09-19T11:55:50.972 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:55:50.757+0000 7ff52a0779c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:50.972 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding auth protocol: cephx 2024-09-19T11:55:50.972 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding auth protocol: cephx 2024-09-19T11:55:50.972 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding auth protocol: cephx 2024-09-19T11:55:50.972 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: secure 2024-09-19T11:55:50.972 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: crc 2024-09-19T11:55:50.972 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: secure 2024-09-19T11:55:50.972 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: crc 2024-09-19T11:55:50.972 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:55:50.761+0000 7ff3ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:50.972 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: secure 2024-09-19T11:55:50.972 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: crc 2024-09-19T11:55:50.972 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: crc 2024-09-19T11:55:50.972 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: secure 2024-09-19T11:55:50.973 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: crc 2024-09-19T11:55:50.973 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: secure 2024-09-19T11:55:50.973 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: crc 2024-09-19T11:55:50.973 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:55:50.761+0000 7ff52a0779c0 5 AuthRegistry(0x7ffca9302310) adding con mode: secure 2024-09-19T11:55:50.973 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:55:50.973 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:50.973 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:50.973 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command cache list hook 0x55822ac1b5b0 2024-09-19T11:55:50.973 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command cache inspect hook 0x55822ac1b5b0 2024-09-19T11:55:50.973 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command cache erase hook 0x55822ac1b5b0 2024-09-19T11:55:50.973 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command cache zap hook 0x55822ac1b5b0 2024-09-19T11:55:50.974 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 note: GC not initialized 2024-09-19T11:55:50.974 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:55:50.765+0000 7ff3dcfe1640 20 reqs_thread_entry: start 2024-09-19T11:55:50.974 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command sync trace show hook 0x7ff51c01c050 2024-09-19T11:55:50.974 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command sync trace history hook 0x7ff51c01c050 2024-09-19T11:55:50.974 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command sync trace active hook 0x7ff51c01c050 2024-09-19T11:55:50.974 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 5 asok(0x55822a943d90) register_command sync trace active_short hook 0x7ff51c01c050 2024-09-19T11:55:50.974 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:50.974 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 Filter name: none 2024-09-19T11:55:50.974 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:55:50.765+0000 7ff3567fc640 20 reqs_thread_entry: start 2024-09-19T11:55:50.974 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-19T11:55:50.974 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.974 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:50.974 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-19T11:55:50.975 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-19T11:55:50.975 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 : miss 2024-09-19T11:55:50.975 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:55:50.765+0000 7ff52a0779c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.975 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:55:50.769+0000 7ff52a0779c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:50.975 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:55:50.769+0000 7ff52a0779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 info.flags=0x17 2024-09-19T11:55:50.975 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:55:50.769+0000 7ff52a0779c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 to cache LRU end 2024-09-19T11:55:50.975 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:55:50.769+0000 7ff52a0779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:50.975 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:55:50.769+0000 7ff52a0779c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:50.975 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:55:50.769+0000 7ff52a0779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 2024-09-19T11:55:50.975 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:55:50.777+0000 7ff52a0779c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff52a0779c0 time 2024-09-19T11:55:50.776487+0000 2024-09-19T11:55:50.975 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:55:50.975 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.975 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:50.975 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff52d9512eb] 2024-09-19T11:55:50.976 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff52d95149f] 2024-09-19T11:55:50.976 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558228bba271] 2024-09-19T11:55:50.976 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x140fb48) [0x55822960ab48] 2024-09-19T11:55:50.976 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558228bca0dd] 2024-09-19T11:55:50.976 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:55:50.976 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff52c7b7d90] 2024-09-19T11:55:50.976 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:55:50.976 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:55:50.976 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.976 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:55:50.781+0000 7ff52a0779c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:55:50.976 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7ff52a0779c0 thread_name:radosgw-admin 2024-09-19T11:55:50.976 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.976 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:55:50.976 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff52c7d0520] 2024-09-19T11:55:50.977 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:55:50.977 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:55:50.977 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:55:50.977 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff52d951345] 2024-09-19T11:55:50.977 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff52d95149f] 2024-09-19T11:55:50.977 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558228bba271] 2024-09-19T11:55:50.977 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x140fb48) [0x55822960ab48] 2024-09-19T11:55:50.977 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558228bca0dd] 2024-09-19T11:55:50.977 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:55:50.977 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff52c7b7d90] 2024-09-19T11:55:50.977 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:55:50.977 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:55:50.977 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:55:50.977 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:50.978 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:55:50.978 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:55:50.978 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:55:50.978 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:55:50.978 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:55:50.978 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:55:50.978 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:55:50.978 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:55:50.978 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:55:50.978 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:55:50.978 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:55:50.978 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:55:50.978 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:55:50.978 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:55:50.978 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:55:50.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:55:50.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:55:50.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:55:50.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:55:50.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:55:50.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:55:50.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:55:50.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:55:50.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:55:50.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:55:50.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:55:50.979 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:55:50.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:55:50.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:55:50.979 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:55:50.980 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:55:50.980 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:55:50.980 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:55:50.980 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:55:50.980 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:55:50.980 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:55:50.980 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:55:50.980 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:55:50.980 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:55:50.980 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:55:50.980 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:55:50.980 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:55:50.980 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:55:50.980 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:55:50.981 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:55:50.981 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:55:50.981 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:55:50.981 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:55:50.981 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:55:50.981 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:55:50.981 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:55:50.981 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:55:50.981 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:55:50.981 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:55:50.981 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:55:50.981 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:55:50.981 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:55:50.981 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:55:50.981 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:55:50.982 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:55:50.982 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:55:50.982 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:55:50.982 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:55:50.982 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:55:50.982 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:55:50.982 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:55:50.982 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:55:50.982 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:55:50.982 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:55:50.982 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:55:50.982 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:55:50.982 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:55:50.982 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:55:50.983 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:55:50.983 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:55:50.983 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:55:50.983 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:55:50.983 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:55:50.983 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:55:50.983 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:55:50.983 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:55:50.983 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:55:50.983 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:55:50.983 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:55:50.983 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:55:50.983 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:55:50.983 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:55:50.983 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:55:50.984 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:55:50.984 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:55:50.984 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:55:50.984 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:55:50.984 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:55:50.984 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:55:50.984 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff3567fc640 / http_manager 2024-09-19T11:55:50.984 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff3dcfe1640 / http_manager 2024-09-19T11:55:50.984 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff3ddfe3640 / rgw_dt_lg_renew 2024-09-19T11:55:50.984 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4057fa640 / ms_dispatch 2024-09-19T11:55:50.984 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff406ffd640 / io_context_pool 2024-09-19T11:55:50.984 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff40d7fa640 / ms_dispatch 2024-09-19T11:55:50.984 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff40ffff640 / ms_dispatch 2024-09-19T11:55:50.984 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff415e0b640 / io_context_pool 2024-09-19T11:55:50.984 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff52737c640 / msgr-worker-2 2024-09-19T11:55:50.985 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff527b7d640 / msgr-worker-1 2024-09-19T11:55:50.985 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff52837e640 / msgr-worker-0 2024-09-19T11:55:50.985 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff528b7f640 / io_context_pool 2024-09-19T11:55:50.985 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff52a0779c0 / radosgw-admin 2024-09-19T11:55:50.985 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:55:50.985 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:55:50.985 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/lib/ceph/crash/2024-09-19T11:55:50.783390Z_4b108a40-cc2f-42df-abb2-a18a54e5694e/log 2024-09-19T11:55:50.985 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:55:50.985 INFO:tasks.workunit.client.0.smithi120.stderr:Aborted 2024-09-19T11:55:50.985 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-19T11:55:50.985 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:50.985 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:50.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.869+0000 7f803ce539c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.873+0000 7f803ce539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.873+0000 7f803ce539c0 20 realm 2024-09-19T11:55:50.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.873+0000 7f803ce539c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.873+0000 7f803ce539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.873+0000 7f803ce539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:50.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.873+0000 7f803ce539c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.873+0000 7f803ce539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:50.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.873+0000 7f803ce539c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.873+0000 7f803ce539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:50.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.873+0000 7f803ce539c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:50.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.877+0000 7f803ce539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:50.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.877+0000 7f803ce539c0 20 searching for the correct realm 2024-09-19T11:55:50.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:50.881+0000 7f803a959640 0 -- 172.21.15.120:0/3693335668 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f80340a9070 msgr2=0x7f80340b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:51.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.097+0000 7f803a959640 0 -- 172.21.15.120:0/3693335668 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f80340a9070 msgr2=0x7f80340b3040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:51.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.109+0000 7f803ce539c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:51.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.109+0000 7f803ce539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:51.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.109+0000 7f803ce539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:51.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.109+0000 7f803ce539c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:51.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.109+0000 7f803ce539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:51.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.109+0000 7f803ce539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:51.108 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.109+0000 7f803ce539c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.109+0000 7f803ce539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:51.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.109+0000 7f803ce539c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.113+0000 7f803ce539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:51.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.113+0000 7f803ce539c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.110 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.113+0000 7f803ce539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:51.110 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.113+0000 7f803ce539c0 20 zone default found 2024-09-19T11:55:51.110 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.113+0000 7f803ce539c0 4 Realm: () 2024-09-19T11:55:51.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.113+0000 7f803ce539c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:51.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.113+0000 7f803ce539c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:51.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.113+0000 7f803ce539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:51.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.113+0000 7f803ce539c0 20 zonegroup default 2024-09-19T11:55:51.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.113+0000 7f803ce539c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.112 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.113+0000 7f803ce539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:51.112 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.113+0000 7f803ce539c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.112 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.113+0000 7f803ce539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:51.112 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.113+0000 7f803ce539c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.117+0000 7f803ce539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:51.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.117+0000 7f803ce539c0 20 started sync module instance, tier type = 2024-09-19T11:55:51.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.117+0000 7f803ce539c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:51.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.141+0000 7f803ce539c0 20 add_watcher() i=0 2024-09-19T11:55:51.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.141+0000 7f803ce539c0 20 add_watcher() i=1 2024-09-19T11:55:51.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.141+0000 7f803ce539c0 20 add_watcher() i=2 2024-09-19T11:55:51.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.141+0000 7f803ce539c0 20 add_watcher() i=3 2024-09-19T11:55:51.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.141+0000 7f803ce539c0 20 add_watcher() i=4 2024-09-19T11:55:51.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.141+0000 7f803ce539c0 20 add_watcher() i=5 2024-09-19T11:55:51.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.141+0000 7f803ce539c0 20 add_watcher() i=6 2024-09-19T11:55:51.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.141+0000 7f803ce539c0 20 add_watcher() i=7 2024-09-19T11:55:51.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.141+0000 7f803ce539c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:51.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.145+0000 7f7ef17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:51.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.149+0000 7f803ce539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:51.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.149+0000 7f803ce539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:51.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.149+0000 7f803ce539c0 5 note: GC not initialized 2024-09-19T11:55:51.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.149+0000 7f7e6bfff640 20 reqs_thread_entry: start 2024-09-19T11:55:51.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.149+0000 7f803ce539c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:51.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.149+0000 7f803ce539c0 20 Filter name: none 2024-09-19T11:55:51.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.149+0000 7f7e69ffb640 20 reqs_thread_entry: start 2024-09-19T11:55:51.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.149+0000 7f803ce539c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.149+0000 7f803ce539c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:51.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.149+0000 7f803ce539c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.149+0000 7f803ce539c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:51.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.149+0000 7f803ce539c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:51.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.149+0000 7f803ce539c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.153+0000 7f803ce539c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:51.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.153+0000 7f803ce539c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.153+0000 7f803ce539c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:51.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.153+0000 7f803ce539c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:55:51.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.153+0000 7f7ef17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:51.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.161+0000 7f803ce539c0 20 remove_watcher() i=0 2024-09-19T11:55:51.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.161+0000 7f803ce539c0 2 removed watcher, disabling cache 2024-09-19T11:55:51.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.161+0000 7f803ce539c0 20 remove_watcher() i=1 2024-09-19T11:55:51.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.165+0000 7f803ce539c0 20 remove_watcher() i=2 2024-09-19T11:55:51.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.169+0000 7f803ce539c0 20 remove_watcher() i=3 2024-09-19T11:55:51.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.169+0000 7f803ce539c0 20 remove_watcher() i=4 2024-09-19T11:55:51.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.173+0000 7f803ce539c0 20 remove_watcher() i=5 2024-09-19T11:55:51.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.173+0000 7f803ce539c0 20 remove_watcher() i=6 2024-09-19T11:55:51.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.173+0000 7f803ce539c0 20 remove_watcher() i=7 2024-09-19T11:55:51.193 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:51.193 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:55:51.193 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-set-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:55:51.194 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:55:51.254 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:55:51.291 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:55:51.291 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:55:51.337 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.341+0000 7ff55fd8d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.341+0000 7ff55fd8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:51.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.341+0000 7ff55fd8d9c0 20 realm 2024-09-19T11:55:51.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.341+0000 7ff55fd8d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.341+0000 7ff55fd8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:51.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.341+0000 7ff55fd8d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:55:51.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.341+0000 7ff55fd8d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.341+0000 7ff55fd8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:51.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.341+0000 7ff55fd8d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.345+0000 7ff55fd8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:51.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.345+0000 7ff55fd8d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.345+0000 7ff55fd8d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:55:51.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.345+0000 7ff55fd8d9c0 20 searching for the correct realm 2024-09-19T11:55:51.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.349+0000 7ff55e094640 0 -- 172.21.15.120:0/951769627 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7ff554008050 msgr2=0x7ff55404c1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:55:51.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.357+0000 7ff55d092640 0 -- 172.21.15.120:0/951769627 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7ff550082b80 msgr2=0x7ff550053ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:55:51.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.573+0000 7ff55fd8d9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:55:51.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.573+0000 7ff55fd8d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:55:51.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.573+0000 7ff55fd8d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:55:51.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.573+0000 7ff55fd8d9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:55:51.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.573+0000 7ff55fd8d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:55:51.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.573+0000 7ff55fd8d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:55:51.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.573+0000 7ff55fd8d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.573+0000 7ff55fd8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:51.573 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.573+0000 7ff55fd8d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.573 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:55:51.573 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.573 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:55:51.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 20 zone default found 2024-09-19T11:55:51.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 4 Realm: () 2024-09-19T11:55:51.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:55:51.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:55:51.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:55:51.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 20 zonegroup default 2024-09-19T11:55:51.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:51.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:51.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.576 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:55:51.576 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 20 started sync module instance, tier type = 2024-09-19T11:55:51.576 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.577+0000 7ff55fd8d9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:55:51.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.601+0000 7ff55fd8d9c0 20 add_watcher() i=0 2024-09-19T11:55:51.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.601+0000 7ff55fd8d9c0 20 add_watcher() i=1 2024-09-19T11:55:51.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.601+0000 7ff55fd8d9c0 20 add_watcher() i=2 2024-09-19T11:55:51.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.601+0000 7ff55fd8d9c0 20 add_watcher() i=3 2024-09-19T11:55:51.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.601+0000 7ff55fd8d9c0 20 add_watcher() i=4 2024-09-19T11:55:51.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.601+0000 7ff55fd8d9c0 20 add_watcher() i=5 2024-09-19T11:55:51.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.601+0000 7ff55fd8d9c0 20 add_watcher() i=6 2024-09-19T11:55:51.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.605+0000 7ff55fd8d9c0 20 add_watcher() i=7 2024-09-19T11:55:51.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.605+0000 7ff55fd8d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:55:51.606 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.609+0000 7ff40f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:51.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.609+0000 7ff55fd8d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:55:51.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.609+0000 7ff55fd8d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:55:51.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.609+0000 7ff55fd8d9c0 5 note: GC not initialized 2024-09-19T11:55:51.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.609+0000 7ff40e7fc640 20 reqs_thread_entry: start 2024-09-19T11:55:51.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.609+0000 7ff55fd8d9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:55:51.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.609+0000 7ff55fd8d9c0 20 Filter name: none 2024-09-19T11:55:51.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.609+0000 7ff37ffff640 20 reqs_thread_entry: start 2024-09-19T11:55:51.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.613+0000 7ff55fd8d9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-19T11:55:51.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.613+0000 7ff55fd8d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.613+0000 7ff55fd8d9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:55:51.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.613+0000 7ff55fd8d9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-19T11:55:51.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.613+0000 7ff55fd8d9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-19T11:55:51.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.613+0000 7ff55fd8d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 : miss 2024-09-19T11:55:51.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.613+0000 7ff55fd8d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:55:51.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.613+0000 7ff55fd8d9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:55:51.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.613+0000 7ff55fd8d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 info.flags=0x17 2024-09-19T11:55:51.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.613+0000 7ff55fd8d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 to cache LRU end 2024-09-19T11:55:51.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.613+0000 7ff55fd8d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:55:51.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.613+0000 7ff55fd8d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:55:51.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.613+0000 7ff55fd8d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 2024-09-19T11:55:51.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.617+0000 7ff55fd8d9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 to be held by another RGW process; skipping for now 2024-09-19T11:55:51.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.617+0000 7ff40f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:55:51.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.621+0000 7ff55fd8d9c0 20 remove_watcher() i=0 2024-09-19T11:55:51.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.621+0000 7ff55fd8d9c0 2 removed watcher, disabling cache 2024-09-19T11:55:51.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.625+0000 7ff55fd8d9c0 20 remove_watcher() i=1 2024-09-19T11:55:51.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.625+0000 7ff55fd8d9c0 20 remove_watcher() i=2 2024-09-19T11:55:51.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.629+0000 7ff55fd8d9c0 20 remove_watcher() i=3 2024-09-19T11:55:51.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.629+0000 7ff55fd8d9c0 20 remove_watcher() i=4 2024-09-19T11:55:51.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.633+0000 7ff55fd8d9c0 20 remove_watcher() i=5 2024-09-19T11:55:51.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.633+0000 7ff55fd8d9c0 20 remove_watcher() i=6 2024-09-19T11:55:51.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:55:51.637+0000 7ff55fd8d9c0 20 remove_watcher() i=7 2024-09-19T11:55:51.647 INFO:tasks.workunit.client.0.smithi120.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T11:56:21.677 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:56:21.714 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:56:21.714 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:56:21.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:21.764+0000 7fb5602c99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:21.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:21.764+0000 7fb5602c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:21.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:21.764+0000 7fb5602c99c0 20 realm 2024-09-19T11:56:21.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:21.764+0000 7fb5602c99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:21.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:21.764+0000 7fb5602c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:21.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:21.764+0000 7fb5602c99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:21.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:21.764+0000 7fb5602c99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:21.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:21.764+0000 7fb5602c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:21.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:21.764+0000 7fb5602c99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:21.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:21.768+0000 7fb5602c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:21.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:21.768+0000 7fb5602c99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:21.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:21.768+0000 7fb5602c99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:21.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:21.768+0000 7fb5602c99c0 20 searching for the correct realm 2024-09-19T11:56:21.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:21.772+0000 7fb55ddcf640 0 -- 172.21.15.120:0/3422093028 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fb558063790 msgr2=0x7fb558062200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:21.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:21.988+0000 7fb55ddcf640 0 -- 172.21.15.120:0/3422093028 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fb558063790 msgr2=0x7fb558062200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:21.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.000+0000 7fb5602c99c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:21.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.000+0000 7fb5602c99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:22.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.000+0000 7fb5602c99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:22.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.000+0000 7fb5602c99c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:22.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.000+0000 7fb5602c99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:22.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.000+0000 7fb5602c99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:22.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.000+0000 7fb5602c99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.000+0000 7fb5602c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:22.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.000+0000 7fb5602c99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:22.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:22.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 20 zone default found 2024-09-19T11:56:22.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 4 Realm: () 2024-09-19T11:56:22.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:22.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:22.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:22.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 20 zonegroup default 2024-09-19T11:56:22.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:22.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:22.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:22.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 20 started sync module instance, tier type = 2024-09-19T11:56:22.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.004+0000 7fb5602c99c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:22.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.032+0000 7fb5602c99c0 20 add_watcher() i=0 2024-09-19T11:56:22.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.032+0000 7fb5602c99c0 20 add_watcher() i=1 2024-09-19T11:56:22.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.032+0000 7fb5602c99c0 20 add_watcher() i=2 2024-09-19T11:56:22.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.032+0000 7fb5602c99c0 20 add_watcher() i=3 2024-09-19T11:56:22.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.032+0000 7fb5602c99c0 20 add_watcher() i=4 2024-09-19T11:56:22.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.032+0000 7fb5602c99c0 20 add_watcher() i=5 2024-09-19T11:56:22.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.032+0000 7fb5602c99c0 20 add_watcher() i=6 2024-09-19T11:56:22.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.032+0000 7fb5602c99c0 20 add_watcher() i=7 2024-09-19T11:56:22.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.032+0000 7fb5602c99c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:22.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.036+0000 7fb40ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:22.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.036+0000 7fb5602c99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:22.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.036+0000 7fb5602c99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:22.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 5 note: GC not initialized 2024-09-19T11:56:22.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb40effd640 20 reqs_thread_entry: start 2024-09-19T11:56:22.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:22.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 20 Filter name: none 2024-09-19T11:56:22.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb40cff9640 20 reqs_thread_entry: start 2024-09-19T11:56:22.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-19T11:56:22.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:56:22.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-19T11:56:22.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-19T11:56:22.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 : miss 2024-09-19T11:56:22.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:56:22.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 info.flags=0x17 2024-09-19T11:56:22.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 to cache LRU end 2024-09-19T11:56:22.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:56:22.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:22.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.040+0000 7fb5602c99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 2024-09-19T11:56:22.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.048+0000 7fb5602c99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 info.flags=0x17 2024-09-19T11:56:22.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.048+0000 7fb5602c99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 to cache LRU end 2024-09-19T11:56:22.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.048+0000 7fb5602c99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:22.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.048+0000 7fb5602c99c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25, ofs0, ns] 2024-09-19T11:56:22.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.048+0000 7fb4417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366227 cookie 94475308853376 notifier 6338 bl.length()=1009 2024-09-19T11:56:22.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.048+0000 7fb4417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 info.flags=0x17 2024-09-19T11:56:22.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.048+0000 7fb4417fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 to cache LRU end 2024-09-19T11:56:22.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.048+0000 7fb4417fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:22.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.052+0000 7fb5602c99c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25]): orig_sources= new_sources= 2024-09-19T11:56:22.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.052+0000 7fb5602c99c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25]): potential sources added=[] removed=[] 2024-09-19T11:56:22.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.052+0000 7fb5602c99c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25]): orig_dests= new_dests= 2024-09-19T11:56:22.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.052+0000 7fb5602c99c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25]): potential dests added=[] removed=[] 2024-09-19T11:56:22.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.052+0000 7fb5602c99c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25.1.0 2024-09-19T11:56:22.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.052+0000 7fb5602c99c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25.1.0 2024-09-19T11:56:22.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.052+0000 7fb5602c99c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25.1.1 2024-09-19T11:56:22.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.052+0000 7fb5602c99c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25.1.1 2024-09-19T11:56:22.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.052+0000 7fb5602c99c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25.0 2024-09-19T11:56:22.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.060+0000 7fb5602c99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 : hit (requested=0x17, cached=0x17) 2024-09-19T11:56:22.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.060+0000 7fb5602c99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 2024-09-19T11:56:22.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.060+0000 7fb5602c99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 info.flags=0x17 2024-09-19T11:56:22.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.060+0000 7fb5602c99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 to cache LRU end 2024-09-19T11:56:22.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.060+0000 7fb5602c99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:22.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.060+0000 7fb5602c99c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25, ofs0, ns] 2024-09-19T11:56:22.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.060+0000 7fb4417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366228 cookie 94475308853376 notifier 6338 bl.length()=1009 2024-09-19T11:56:22.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.060+0000 7fb4417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 info.flags=0x17 2024-09-19T11:56:22.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.060+0000 7fb4417fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 to cache LRU end 2024-09-19T11:56:22.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.060+0000 7fb4417fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:22.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.064+0000 7fb5602c99c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25]): orig_sources= new_sources= 2024-09-19T11:56:22.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.064+0000 7fb5602c99c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25]): potential sources added=[] removed=[] 2024-09-19T11:56:22.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.064+0000 7fb5602c99c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25]): orig_dests= new_dests= 2024-09-19T11:56:22.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.064+0000 7fb5602c99c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25]): potential dests added=[] removed=[] 2024-09-19T11:56:22.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.064+0000 7fb5602c99c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25.0 2024-09-19T11:56:22.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.064+0000 7fb5602c99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 : hit (requested=0x17, cached=0x17) 2024-09-19T11:56:22.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.064+0000 7fb5602c99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 2024-09-19T11:56:22.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.068+0000 7fb5602c99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 info.flags=0x17 2024-09-19T11:56:22.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.068+0000 7fb5602c99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 to cache LRU end 2024-09-19T11:56:22.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.068+0000 7fb5602c99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:22.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.068+0000 7fb5602c99c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25, ofs0, ns] 2024-09-19T11:56:22.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.068+0000 7fb440ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366229 cookie 94475308853376 notifier 6338 bl.length()=977 2024-09-19T11:56:22.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.068+0000 7fb440ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 info.flags=0x17 2024-09-19T11:56:22.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.068+0000 7fb440ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 to cache LRU end 2024-09-19T11:56:22.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.068+0000 7fb440ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:22.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.068+0000 7fb5602c99c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25]): orig_sources= new_sources= 2024-09-19T11:56:22.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.068+0000 7fb5602c99c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25]): potential sources added=[] removed=[] 2024-09-19T11:56:22.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.068+0000 7fb5602c99c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25]): orig_dests= new_dests= 2024-09-19T11:56:22.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.068+0000 7fb5602c99c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25]): potential dests added=[] removed=[] 2024-09-19T11:56:22.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.072+0000 7fb5602c99c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-19T11:56:22.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.076+0000 7fb40ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:22.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.080+0000 7fb5602c99c0 20 remove_watcher() i=0 2024-09-19T11:56:22.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.080+0000 7fb5602c99c0 2 removed watcher, disabling cache 2024-09-19T11:56:22.080 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.084+0000 7fb5602c99c0 20 remove_watcher() i=1 2024-09-19T11:56:22.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.084+0000 7fb5602c99c0 20 remove_watcher() i=2 2024-09-19T11:56:22.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.088+0000 7fb5602c99c0 20 remove_watcher() i=3 2024-09-19T11:56:22.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.092+0000 7fb5602c99c0 20 remove_watcher() i=4 2024-09-19T11:56:22.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.092+0000 7fb5602c99c0 20 remove_watcher() i=5 2024-09-19T11:56:22.091 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.092+0000 7fb5602c99c0 20 remove_watcher() i=6 2024-09-19T11:56:22.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.096+0000 7fb5602c99c0 20 remove_watcher() i=7 2024-09-19T11:56:22.109 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-19T11:56:22.143 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:56:22.143 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:56:22.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.188+0000 7fb3557259c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.192+0000 7fb3557259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:22.189 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.192+0000 7fb3557259c0 20 realm 2024-09-19T11:56:22.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.192+0000 7fb3557259c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.192+0000 7fb3557259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:22.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.192+0000 7fb3557259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:22.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.192+0000 7fb3557259c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.192+0000 7fb3557259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:22.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.192+0000 7fb3557259c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.192+0000 7fb3557259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:22.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.192+0000 7fb3557259c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.196+0000 7fb3557259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:22.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.196+0000 7fb3557259c0 20 searching for the correct realm 2024-09-19T11:56:22.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.196+0000 7fb353a2c640 0 -- 172.21.15.120:0/2623524919 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fb3480ff960 msgr2=0x7fb348101bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:56:22.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.204+0000 7fb352a2a640 0 -- 172.21.15.120:0/2623524919 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fb344044040 msgr2=0x7fb344044930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:22.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.420+0000 7fb3557259c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:22.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.420+0000 7fb3557259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:22.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.420+0000 7fb3557259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:22.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.420+0000 7fb3557259c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:22.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.420+0000 7fb3557259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:22.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.420+0000 7fb3557259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:22.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.420+0000 7fb3557259c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.424+0000 7fb3557259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:22.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.424+0000 7fb3557259c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.424+0000 7fb3557259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:22.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.424+0000 7fb3557259c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.424+0000 7fb3557259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:22.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.424+0000 7fb3557259c0 20 zone default found 2024-09-19T11:56:22.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.424+0000 7fb3557259c0 4 Realm: () 2024-09-19T11:56:22.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.424+0000 7fb3557259c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:22.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.424+0000 7fb3557259c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:22.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.424+0000 7fb3557259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:22.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.424+0000 7fb3557259c0 20 zonegroup default 2024-09-19T11:56:22.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.424+0000 7fb3557259c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.424+0000 7fb3557259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:22.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.424+0000 7fb3557259c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.428+0000 7fb3557259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:22.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.428+0000 7fb3557259c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.428+0000 7fb3557259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:22.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.428+0000 7fb3557259c0 20 started sync module instance, tier type = 2024-09-19T11:56:22.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.428+0000 7fb3557259c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:22.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.452+0000 7fb3557259c0 20 add_watcher() i=0 2024-09-19T11:56:22.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.452+0000 7fb3557259c0 20 add_watcher() i=1 2024-09-19T11:56:22.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.452+0000 7fb3557259c0 20 add_watcher() i=2 2024-09-19T11:56:22.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.452+0000 7fb3557259c0 20 add_watcher() i=3 2024-09-19T11:56:22.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.452+0000 7fb3557259c0 20 add_watcher() i=4 2024-09-19T11:56:22.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.452+0000 7fb3557259c0 20 add_watcher() i=5 2024-09-19T11:56:22.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.452+0000 7fb3557259c0 20 add_watcher() i=6 2024-09-19T11:56:22.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.452+0000 7fb3557259c0 20 add_watcher() i=7 2024-09-19T11:56:22.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.452+0000 7fb3557259c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:22.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.460+0000 7fb209fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:22.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.460+0000 7fb3557259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:22.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.460+0000 7fb3557259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:22.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.460+0000 7fb3557259c0 5 note: GC not initialized 2024-09-19T11:56:22.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.460+0000 7fb208fe1640 20 reqs_thread_entry: start 2024-09-19T11:56:22.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.460+0000 7fb3557259c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:22.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.460+0000 7fb3557259c0 20 Filter name: none 2024-09-19T11:56:22.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.460+0000 7fb1827fc640 20 reqs_thread_entry: start 2024-09-19T11:56:22.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.460+0000 7fb3557259c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.460+0000 7fb3557259c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:56:22.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.460+0000 7fb3557259c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.464+0000 7fb3557259c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:56:22.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.464+0000 7fb3557259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:22.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.464+0000 7fb3557259c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.464+0000 7fb3557259c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-19T11:56:22.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.464+0000 7fb3557259c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:22.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.464+0000 7fb3557259c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-19T11:56:22.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.464+0000 7fb3557259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:22.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.468+0000 7fb209fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:22.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.472+0000 7fb3557259c0 20 remove_watcher() i=0 2024-09-19T11:56:22.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.472+0000 7fb3557259c0 2 removed watcher, disabling cache 2024-09-19T11:56:22.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.476+0000 7fb3557259c0 20 remove_watcher() i=1 2024-09-19T11:56:22.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.476+0000 7fb3557259c0 20 remove_watcher() i=2 2024-09-19T11:56:22.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.480+0000 7fb3557259c0 20 remove_watcher() i=3 2024-09-19T11:56:22.478 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.480+0000 7fb3557259c0 20 remove_watcher() i=4 2024-09-19T11:56:22.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.484+0000 7fb3557259c0 20 remove_watcher() i=5 2024-09-19T11:56:22.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.484+0000 7fb3557259c0 20 remove_watcher() i=6 2024-09-19T11:56:22.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:22.484+0000 7fb3557259c0 20 remove_watcher() i=7 2024-09-19T11:56:22.498 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:22.498 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:56:22.499 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-set-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T11:56:22.499 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:22.587 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-19T11:56:22.587 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:23.073 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-19T11:56:23.106 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:56:23.106 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:56:23.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.152+0000 7fa76c06e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.156+0000 7fa76c06e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:23.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.156+0000 7fa76c06e9c0 20 realm 2024-09-19T11:56:23.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.156+0000 7fa76c06e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.156+0000 7fa76c06e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:23.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.156+0000 7fa76c06e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:23.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.156+0000 7fa76c06e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.156+0000 7fa76c06e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:23.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.156+0000 7fa76c06e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.160+0000 7fa76c06e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:23.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.160+0000 7fa76c06e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.364+0000 7fa76c06e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:23.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.364+0000 7fa76c06e9c0 20 searching for the correct realm 2024-09-19T11:56:23.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.368+0000 7fa76a375640 0 -- 172.21.15.120:0/3206423481 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fa760093b60 msgr2=0x7fa76008fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:56:23.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.584+0000 7fa769373640 0 -- 172.21.15.120:0/3206423481 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7fa75c0c2400 msgr2=0x7fa75c0c2880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:23.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.600+0000 7fa76c06e9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:23.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.600+0000 7fa76c06e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:23.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.600+0000 7fa76c06e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:23.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.600+0000 7fa76c06e9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:23.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.600+0000 7fa76c06e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:23.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.600+0000 7fa76c06e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:23.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.600+0000 7fa76c06e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.600+0000 7fa76c06e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:23.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.600+0000 7fa76c06e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.600+0000 7fa76c06e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:23.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.600+0000 7fa76c06e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.604+0000 7fa76c06e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:23.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.604+0000 7fa76c06e9c0 20 zone default found 2024-09-19T11:56:23.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.604+0000 7fa76c06e9c0 4 Realm: () 2024-09-19T11:56:23.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.604+0000 7fa76c06e9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:23.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.604+0000 7fa76c06e9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:23.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.604+0000 7fa76c06e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:23.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.604+0000 7fa76c06e9c0 20 zonegroup default 2024-09-19T11:56:23.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.604+0000 7fa76c06e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.604+0000 7fa76c06e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:23.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.604+0000 7fa76c06e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.604+0000 7fa76c06e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:23.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.604+0000 7fa76c06e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.604+0000 7fa76c06e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:23.603 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.604+0000 7fa76c06e9c0 20 started sync module instance, tier type = 2024-09-19T11:56:23.603 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.604+0000 7fa76c06e9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:23.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.628+0000 7fa76c06e9c0 20 add_watcher() i=0 2024-09-19T11:56:23.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.628+0000 7fa76c06e9c0 20 add_watcher() i=1 2024-09-19T11:56:23.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.628+0000 7fa76c06e9c0 20 add_watcher() i=2 2024-09-19T11:56:23.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.628+0000 7fa76c06e9c0 20 add_watcher() i=3 2024-09-19T11:56:23.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.628+0000 7fa76c06e9c0 20 add_watcher() i=4 2024-09-19T11:56:23.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.628+0000 7fa76c06e9c0 20 add_watcher() i=5 2024-09-19T11:56:23.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.628+0000 7fa76c06e9c0 20 add_watcher() i=6 2024-09-19T11:56:23.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.628+0000 7fa76c06e9c0 20 add_watcher() i=7 2024-09-19T11:56:23.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.628+0000 7fa76c06e9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:23.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.636+0000 7fa61b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:23.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.636+0000 7fa76c06e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:23.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.636+0000 7fa76c06e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:23.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.636+0000 7fa76c06e9c0 5 note: GC not initialized 2024-09-19T11:56:23.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.636+0000 7fa61a7fc640 20 reqs_thread_entry: start 2024-09-19T11:56:23.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.636+0000 7fa76c06e9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:23.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.636+0000 7fa76c06e9c0 20 Filter name: none 2024-09-19T11:56:23.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.636+0000 7fa58bfff640 20 reqs_thread_entry: start 2024-09-19T11:56:23.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.636+0000 7fa76c06e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.636+0000 7fa76c06e9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:23.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.640+0000 7fa76c06e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.640+0000 7fa76c06e9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:56:23.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.640+0000 7fa76c06e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:23.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.640+0000 7fa76c06e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.640+0000 7fa76c06e9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:23.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.640+0000 7fa76c06e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.640+0000 7fa76c06e9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:56:23.639 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.640+0000 7fa76c06e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:23.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.644+0000 7fa61b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:23.647 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.648+0000 7fa76c06e9c0 20 remove_watcher() i=0 2024-09-19T11:56:23.647 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.648+0000 7fa76c06e9c0 2 removed watcher, disabling cache 2024-09-19T11:56:23.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.652+0000 7fa76c06e9c0 20 remove_watcher() i=1 2024-09-19T11:56:23.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.652+0000 7fa76c06e9c0 20 remove_watcher() i=2 2024-09-19T11:56:23.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.656+0000 7fa76c06e9c0 20 remove_watcher() i=3 2024-09-19T11:56:23.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.656+0000 7fa76c06e9c0 20 remove_watcher() i=4 2024-09-19T11:56:23.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.660+0000 7fa76c06e9c0 20 remove_watcher() i=5 2024-09-19T11:56:23.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.660+0000 7fa76c06e9c0 20 remove_watcher() i=6 2024-09-19T11:56:23.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.664+0000 7fa76c06e9c0 20 remove_watcher() i=7 2024-09-19T11:56:23.675 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:23.675 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:56:23.675 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-trim-reshard-log-entries id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:56:23.675 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:23.676 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-19T11:56:23.708 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:56:23.709 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:56:23.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.756+0000 7f99dbb4d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.756+0000 7f99dbb4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:23.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.756+0000 7f99dbb4d9c0 20 realm 2024-09-19T11:56:23.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.756+0000 7f99dbb4d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.756+0000 7f99dbb4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:23.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.756+0000 7f99dbb4d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:23.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.756+0000 7f99dbb4d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.756+0000 7f99dbb4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:23.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.756+0000 7f99dbb4d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.760+0000 7f99dbb4d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:23.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.760+0000 7f99dbb4d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.760+0000 7f99dbb4d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:23.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.760+0000 7f99dbb4d9c0 20 searching for the correct realm 2024-09-19T11:56:23.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.764+0000 7f99d8e52640 0 -- 172.21.15.120:0/4025772728 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7f99cc008050 msgr2=0x7f99cc05d1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:23.976 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.976+0000 7f99d9e54640 0 -- 172.21.15.120:0/4025772728 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f99d006b050 msgr2=0x7f99d006d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:23.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:23.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:23.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:23.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:23.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:23.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:23.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:23.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:23.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:23.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 zone default found 2024-09-19T11:56:23.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 4 Realm: () 2024-09-19T11:56:23.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:23.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:23.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:23.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 zonegroup default 2024-09-19T11:56:23.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:23.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:23.996+0000 7f99dbb4d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.000+0000 7f99dbb4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:23.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.000+0000 7f99dbb4d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:23.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.000+0000 7f99dbb4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:23.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.000+0000 7f99dbb4d9c0 20 started sync module instance, tier type = 2024-09-19T11:56:23.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.000+0000 7f99dbb4d9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:24.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.024+0000 7f99dbb4d9c0 20 add_watcher() i=0 2024-09-19T11:56:24.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.024+0000 7f99dbb4d9c0 20 add_watcher() i=1 2024-09-19T11:56:24.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.024+0000 7f99dbb4d9c0 20 add_watcher() i=2 2024-09-19T11:56:24.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.024+0000 7f99dbb4d9c0 20 add_watcher() i=3 2024-09-19T11:56:24.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.024+0000 7f99dbb4d9c0 20 add_watcher() i=4 2024-09-19T11:56:24.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.024+0000 7f99dbb4d9c0 20 add_watcher() i=5 2024-09-19T11:56:24.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.024+0000 7f99dbb4d9c0 20 add_watcher() i=6 2024-09-19T11:56:24.023 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.024+0000 7f99dbb4d9c0 20 add_watcher() i=7 2024-09-19T11:56:24.023 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.024+0000 7f99dbb4d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:24.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.028+0000 7f988ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:24.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.032+0000 7f99dbb4d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:24.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.032+0000 7f99dbb4d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:24.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.032+0000 7f99dbb4d9c0 5 note: GC not initialized 2024-09-19T11:56:24.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.032+0000 7f988efe5640 20 reqs_thread_entry: start 2024-09-19T11:56:24.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.032+0000 7f99dbb4d9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:24.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.032+0000 7f99dbb4d9c0 20 Filter name: none 2024-09-19T11:56:24.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.032+0000 7f988cfe1640 20 reqs_thread_entry: start 2024-09-19T11:56:24.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.032+0000 7f99dbb4d9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-19T11:56:24.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.032+0000 7f99dbb4d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.032+0000 7f99dbb4d9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:24.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.032+0000 7f99dbb4d9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T11:56:24.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.032+0000 7f99dbb4d9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-19T11:56:24.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.032+0000 7f99dbb4d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 : miss 2024-09-19T11:56:24.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.032+0000 7f99dbb4d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.036+0000 7f99dbb4d9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:56:24.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.036+0000 7f99dbb4d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 info.flags=0x17 2024-09-19T11:56:24.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.036+0000 7f99dbb4d9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 to cache LRU end 2024-09-19T11:56:24.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.036+0000 7f99dbb4d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:56:24.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.036+0000 7f99dbb4d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:24.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.036+0000 7f99dbb4d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 2024-09-19T11:56:24.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.044+0000 7f99dbb4d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 info.flags=0x17 2024-09-19T11:56:24.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.044+0000 7f99dbb4d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 to cache LRU end 2024-09-19T11:56:24.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.044+0000 7f99dbb4d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:24.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.044+0000 7f99dbb4d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26, ofs0, ns] 2024-09-19T11:56:24.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.044+0000 7f98bcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366206 cookie 94816884150592 notifier 6392 bl.length()=1023 2024-09-19T11:56:24.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.044+0000 7f98bcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 info.flags=0x17 2024-09-19T11:56:24.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.044+0000 7f98bcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 to cache LRU end 2024-09-19T11:56:24.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.044+0000 7f98bcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:24.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.044+0000 7f99dbb4d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): orig_sources= new_sources= 2024-09-19T11:56:24.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.044+0000 7f99dbb4d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): potential sources added=[] removed=[] 2024-09-19T11:56:24.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.044+0000 7f99dbb4d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): orig_dests= new_dests= 2024-09-19T11:56:24.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.044+0000 7f99dbb4d9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): potential dests added=[] removed=[] 2024-09-19T11:56:24.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.044+0000 7f99dbb4d9c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-19T11:56:24.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.044+0000 7f99dbb4d9c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-19T11:56:24.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.048+0000 7f988ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:24.050 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.052+0000 7f99dbb4d9c0 20 remove_watcher() i=0 2024-09-19T11:56:24.050 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.052+0000 7f99dbb4d9c0 2 removed watcher, disabling cache 2024-09-19T11:56:24.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.056+0000 7f99dbb4d9c0 20 remove_watcher() i=1 2024-09-19T11:56:24.054 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.056+0000 7f99dbb4d9c0 20 remove_watcher() i=2 2024-09-19T11:56:24.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.060+0000 7f99dbb4d9c0 20 remove_watcher() i=3 2024-09-19T11:56:24.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.060+0000 7f99dbb4d9c0 20 remove_watcher() i=4 2024-09-19T11:56:24.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.064+0000 7f99dbb4d9c0 20 remove_watcher() i=5 2024-09-19T11:56:24.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.064+0000 7f99dbb4d9c0 20 remove_watcher() i=6 2024-09-19T11:56:24.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.064+0000 7f99dbb4d9c0 20 remove_watcher() i=7 2024-09-19T11:56:24.080 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-19T11:56:24.111 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:56:24.111 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:56:24.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.156+0000 7fd45f4c09c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.160+0000 7fd45f4c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:24.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.160+0000 7fd45f4c09c0 20 realm 2024-09-19T11:56:24.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.160+0000 7fd45f4c09c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.160+0000 7fd45f4c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:24.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.160+0000 7fd45f4c09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:24.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.160+0000 7fd45f4c09c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.160+0000 7fd45f4c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:24.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.160+0000 7fd45f4c09c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.160+0000 7fd45f4c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:24.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.160+0000 7fd45f4c09c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.164+0000 7fd45f4c09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:24.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.164+0000 7fd45f4c09c0 20 searching for the correct realm 2024-09-19T11:56:24.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.168+0000 7fd45cfc6640 0 -- 172.21.15.120:0/233900329 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fd454134100 msgr2=0x7fd4540fcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:24.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.384+0000 7fd45cfc6640 0 -- 172.21.15.120:0/233900329 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fd454134100 msgr2=0x7fd4540fcf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:24.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.396+0000 7fd45f4c09c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:24.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.396+0000 7fd45f4c09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:24.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.396+0000 7fd45f4c09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:24.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.396+0000 7fd45f4c09c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:24.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.396+0000 7fd45f4c09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:24.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.396+0000 7fd45f4c09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:24.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.396+0000 7fd45f4c09c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.396+0000 7fd45f4c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:24.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.396+0000 7fd45f4c09c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:24.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:24.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 20 zone default found 2024-09-19T11:56:24.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 4 Realm: () 2024-09-19T11:56:24.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:24.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:24.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:24.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 20 zonegroup default 2024-09-19T11:56:24.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:24.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:24.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:24.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 20 started sync module instance, tier type = 2024-09-19T11:56:24.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.400+0000 7fd45f4c09c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:24.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.424+0000 7fd45f4c09c0 20 add_watcher() i=0 2024-09-19T11:56:24.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.424+0000 7fd45f4c09c0 20 add_watcher() i=1 2024-09-19T11:56:24.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.424+0000 7fd45f4c09c0 20 add_watcher() i=2 2024-09-19T11:56:24.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.424+0000 7fd45f4c09c0 20 add_watcher() i=3 2024-09-19T11:56:24.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.424+0000 7fd45f4c09c0 20 add_watcher() i=4 2024-09-19T11:56:24.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.424+0000 7fd45f4c09c0 20 add_watcher() i=5 2024-09-19T11:56:24.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.424+0000 7fd45f4c09c0 20 add_watcher() i=6 2024-09-19T11:56:24.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.428+0000 7fd45f4c09c0 20 add_watcher() i=7 2024-09-19T11:56:24.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.428+0000 7fd45f4c09c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:24.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.432+0000 7fd3137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:24.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.432+0000 7fd45f4c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:24.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.432+0000 7fd45f4c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:24.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.432+0000 7fd45f4c09c0 5 note: GC not initialized 2024-09-19T11:56:24.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.432+0000 7fd3127e4640 20 reqs_thread_entry: start 2024-09-19T11:56:24.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.432+0000 7fd45f4c09c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:24.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.436+0000 7fd45f4c09c0 20 Filter name: none 2024-09-19T11:56:24.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.436+0000 7fd30b7fe640 20 reqs_thread_entry: start 2024-09-19T11:56:24.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.436+0000 7fd45f4c09c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.436+0000 7fd45f4c09c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:24.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.436+0000 7fd45f4c09c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.436+0000 7fd45f4c09c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-19T11:56:24.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.436+0000 7fd45f4c09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:24.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.436+0000 7fd45f4c09c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.440+0000 7fd45f4c09c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:24.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.440+0000 7fd45f4c09c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.440+0000 7fd45f4c09c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-19T11:56:24.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.440+0000 7fd45f4c09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:24.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.444+0000 7fd3137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:24.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.448+0000 7fd45f4c09c0 20 remove_watcher() i=0 2024-09-19T11:56:24.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.448+0000 7fd45f4c09c0 2 removed watcher, disabling cache 2024-09-19T11:56:24.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.452+0000 7fd45f4c09c0 20 remove_watcher() i=1 2024-09-19T11:56:24.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.452+0000 7fd45f4c09c0 20 remove_watcher() i=2 2024-09-19T11:56:24.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.456+0000 7fd45f4c09c0 20 remove_watcher() i=3 2024-09-19T11:56:24.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.456+0000 7fd45f4c09c0 20 remove_watcher() i=4 2024-09-19T11:56:24.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.460+0000 7fd45f4c09c0 20 remove_watcher() i=5 2024-09-19T11:56:24.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.460+0000 7fd45f4c09c0 20 remove_watcher() i=6 2024-09-19T11:56:24.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.464+0000 7fd45f4c09c0 20 remove_watcher() i=7 2024-09-19T11:56:24.476 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:24.476 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:56:24.476 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-trim-reshard-log-entries id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:56:24.476 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:24.533 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:56:24.565 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:56:24.566 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:56:24.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.612+0000 7f378b1de9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.612+0000 7f378b1de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:24.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.612+0000 7f378b1de9c0 20 realm 2024-09-19T11:56:24.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.612+0000 7f378b1de9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.616+0000 7f378b1de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:24.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.616+0000 7f378b1de9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:24.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.616+0000 7f378b1de9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.616+0000 7f378b1de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:24.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.616+0000 7f378b1de9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.616+0000 7f378b1de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:24.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.616+0000 7f378b1de9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.616+0000 7f378b1de9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:24.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.616+0000 7f378b1de9c0 20 searching for the correct realm 2024-09-19T11:56:24.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.620+0000 7f37894e5640 0 -- 172.21.15.120:0/482364150 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f377c0e7040 msgr2=0x7f377c0da440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:24.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.628+0000 7f37884e3640 0 -- 172.21.15.120:0/482364150 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f3778041040 msgr2=0x7f3778042940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:24.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.844+0000 7f378b1de9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:24.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.844+0000 7f378b1de9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:24.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.844+0000 7f378b1de9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:24.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.844+0000 7f378b1de9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:24.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.844+0000 7f378b1de9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:24.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.844+0000 7f378b1de9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:24.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.844+0000 7f378b1de9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.844+0000 7f378b1de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:24.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.844+0000 7f378b1de9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:24.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:24.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 20 zone default found 2024-09-19T11:56:24.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 4 Realm: () 2024-09-19T11:56:24.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:24.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:24.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:24.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 20 zonegroup default 2024-09-19T11:56:24.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:24.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:24.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:24.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 20 started sync module instance, tier type = 2024-09-19T11:56:24.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.848+0000 7f378b1de9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:24.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.872+0000 7f378b1de9c0 20 add_watcher() i=0 2024-09-19T11:56:24.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.872+0000 7f378b1de9c0 20 add_watcher() i=1 2024-09-19T11:56:24.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.872+0000 7f378b1de9c0 20 add_watcher() i=2 2024-09-19T11:56:24.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.872+0000 7f378b1de9c0 20 add_watcher() i=3 2024-09-19T11:56:24.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.872+0000 7f378b1de9c0 20 add_watcher() i=4 2024-09-19T11:56:24.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.872+0000 7f378b1de9c0 20 add_watcher() i=5 2024-09-19T11:56:24.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.872+0000 7f378b1de9c0 20 add_watcher() i=6 2024-09-19T11:56:24.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.872+0000 7f378b1de9c0 20 add_watcher() i=7 2024-09-19T11:56:24.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.872+0000 7f378b1de9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:24.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.876+0000 7f363efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:24.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.880+0000 7f378b1de9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:24.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.880+0000 7f378b1de9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:24.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.880+0000 7f378b1de9c0 5 note: GC not initialized 2024-09-19T11:56:24.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.880+0000 7f363dfe3640 20 reqs_thread_entry: start 2024-09-19T11:56:24.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.880+0000 7f378b1de9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:24.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.880+0000 7f378b1de9c0 20 Filter name: none 2024-09-19T11:56:24.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.880+0000 7f35af7fe640 20 reqs_thread_entry: start 2024-09-19T11:56:24.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.880+0000 7f378b1de9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-19T11:56:24.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.880+0000 7f378b1de9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.880+0000 7f378b1de9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:24.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.880+0000 7f378b1de9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T11:56:24.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.880+0000 7f378b1de9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-19T11:56:24.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.880+0000 7f378b1de9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 : miss 2024-09-19T11:56:24.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.880+0000 7f378b1de9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:24.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.884+0000 7f378b1de9c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-19T11:56:24.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.884+0000 7f378b1de9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 info.flags=0x17 2024-09-19T11:56:24.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.884+0000 7f378b1de9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 to cache LRU end 2024-09-19T11:56:24.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.884+0000 7f378b1de9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:56:24.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.884+0000 7f378b1de9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:24.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.884+0000 7f378b1de9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 2024-09-19T11:56:24.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.884+0000 7f378b1de9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T11:56:24.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.892+0000 7f378b1de9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 info.flags=0x17 2024-09-19T11:56:24.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.892+0000 7f378b1de9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 to cache LRU end 2024-09-19T11:56:24.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.892+0000 7f378b1de9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:24.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.892+0000 7f378b1de9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26, ofs0, ns] 2024-09-19T11:56:24.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.896+0000 7f365ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366207 cookie 94401955556320 notifier 6425 bl.length()=1023 2024-09-19T11:56:24.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.896+0000 7f365ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 info.flags=0x17 2024-09-19T11:56:24.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.896+0000 7f365ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 to cache LRU end 2024-09-19T11:56:24.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.896+0000 7f365ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:24.893 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.896+0000 7f378b1de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): orig_sources= new_sources= 2024-09-19T11:56:24.893 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.896+0000 7f378b1de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): potential sources added=[] removed=[] 2024-09-19T11:56:24.893 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.896+0000 7f378b1de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): orig_dests= new_dests= 2024-09-19T11:56:24.893 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.896+0000 7f378b1de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): potential dests added=[] removed=[] 2024-09-19T11:56:24.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.900+0000 7f378b1de9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26.2.0 2024-09-19T11:56:24.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.900+0000 7f378b1de9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26.2.0 2024-09-19T11:56:24.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.900+0000 7f378b1de9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26.2.1 2024-09-19T11:56:24.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.900+0000 7f378b1de9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26.2.1 2024-09-19T11:56:24.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.900+0000 7f378b1de9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26.0 2024-09-19T11:56:24.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.904+0000 7f378b1de9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 : hit (requested=0x17, cached=0x17) 2024-09-19T11:56:24.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.908+0000 7f378b1de9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 2024-09-19T11:56:24.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.908+0000 7f378b1de9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 info.flags=0x17 2024-09-19T11:56:24.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.908+0000 7f378b1de9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 to cache LRU end 2024-09-19T11:56:24.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.908+0000 7f378b1de9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:24.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.908+0000 7f378b1de9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26, ofs0, ns] 2024-09-19T11:56:24.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.908+0000 7f365ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366208 cookie 94401955556320 notifier 6425 bl.length()=1023 2024-09-19T11:56:24.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.908+0000 7f365ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 info.flags=0x17 2024-09-19T11:56:24.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.908+0000 7f365ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 to cache LRU end 2024-09-19T11:56:24.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.908+0000 7f365ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:24.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.912+0000 7f378b1de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): orig_sources= new_sources= 2024-09-19T11:56:24.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.912+0000 7f378b1de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): potential sources added=[] removed=[] 2024-09-19T11:56:24.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.912+0000 7f378b1de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): orig_dests= new_dests= 2024-09-19T11:56:24.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.912+0000 7f378b1de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): potential dests added=[] removed=[] 2024-09-19T11:56:24.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.916+0000 7f378b1de9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26.0 2024-09-19T11:56:24.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.916+0000 7f378b1de9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 : hit (requested=0x17, cached=0x17) 2024-09-19T11:56:24.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.916+0000 7f378b1de9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 2024-09-19T11:56:24.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.916+0000 7f378b1de9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 info.flags=0x17 2024-09-19T11:56:24.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.916+0000 7f378b1de9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 to cache LRU end 2024-09-19T11:56:24.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.916+0000 7f378b1de9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:24.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.916+0000 7f378b1de9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26, ofs0, ns] 2024-09-19T11:56:24.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.920+0000 7f365ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366209 cookie 94401955556320 notifier 6425 bl.length()=991 2024-09-19T11:56:24.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.920+0000 7f365ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 info.flags=0x17 2024-09-19T11:56:24.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.920+0000 7f365ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 to cache LRU end 2024-09-19T11:56:24.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.920+0000 7f365ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:24.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.920+0000 7f378b1de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): orig_sources= new_sources= 2024-09-19T11:56:24.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.920+0000 7f378b1de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): potential sources added=[] removed=[] 2024-09-19T11:56:24.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.920+0000 7f378b1de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): orig_dests= new_dests= 2024-09-19T11:56:24.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.920+0000 7f378b1de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26]): potential dests added=[] removed=[] 2024-09-19T11:56:24.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.924+0000 7f378b1de9c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-19T11:56:24.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.924+0000 7f363efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:24.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.932+0000 7f378b1de9c0 20 remove_watcher() i=0 2024-09-19T11:56:24.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.932+0000 7f378b1de9c0 2 removed watcher, disabling cache 2024-09-19T11:56:24.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.932+0000 7f378b1de9c0 20 remove_watcher() i=1 2024-09-19T11:56:24.933 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.936+0000 7f378b1de9c0 20 remove_watcher() i=2 2024-09-19T11:56:24.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.940+0000 7f378b1de9c0 20 remove_watcher() i=3 2024-09-19T11:56:24.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.940+0000 7f378b1de9c0 20 remove_watcher() i=4 2024-09-19T11:56:24.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.940+0000 7f378b1de9c0 20 remove_watcher() i=5 2024-09-19T11:56:24.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.944+0000 7f378b1de9c0 20 remove_watcher() i=6 2024-09-19T11:56:24.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:24.944+0000 7f378b1de9c0 20 remove_watcher() i=7 2024-09-19T11:56:24.958 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-19T11:56:24.985 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:56:24.985 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:56:25.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.032+0000 7f8348ef99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:25.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.032+0000 7f8348ef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:25.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.032+0000 7f8348ef99c0 20 realm 2024-09-19T11:56:25.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.032+0000 7f8348ef99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:25.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.032+0000 7f8348ef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:25.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.032+0000 7f8348ef99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:25.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.032+0000 7f8348ef99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:25.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.032+0000 7f8348ef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:25.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.032+0000 7f8348ef99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:25.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.036+0000 7f8348ef99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:25.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.036+0000 7f8348ef99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:25.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.036+0000 7f8348ef99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:25.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.036+0000 7f8348ef99c0 20 searching for the correct realm 2024-09-19T11:56:25.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.040+0000 7f83469ff640 0 -- 172.21.15.120:0/896547046 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f83400d6040 msgr2=0x7f83400c9470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:25.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.256+0000 7f83469ff640 0 -- 172.21.15.120:0/896547046 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f83400d6040 msgr2=0x7f83400c9470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:25.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.268+0000 7f8348ef99c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:25.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.268+0000 7f8348ef99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:25.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.268+0000 7f8348ef99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:25.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.268+0000 7f8348ef99c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:25.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.268+0000 7f8348ef99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:25.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.268+0000 7f8348ef99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:25.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.268+0000 7f8348ef99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:25.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.268+0000 7f8348ef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:25.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.268+0000 7f8348ef99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:25.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:25.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:25.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:25.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 20 zone default found 2024-09-19T11:56:25.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 4 Realm: () 2024-09-19T11:56:25.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:25.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:25.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:25.270 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 20 zonegroup default 2024-09-19T11:56:25.270 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:25.270 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:25.270 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:25.270 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:25.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:25.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:25.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 20 started sync module instance, tier type = 2024-09-19T11:56:25.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.272+0000 7f8348ef99c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:25.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.296+0000 7f8348ef99c0 20 add_watcher() i=0 2024-09-19T11:56:25.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.296+0000 7f8348ef99c0 20 add_watcher() i=1 2024-09-19T11:56:25.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.296+0000 7f8348ef99c0 20 add_watcher() i=2 2024-09-19T11:56:25.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.296+0000 7f8348ef99c0 20 add_watcher() i=3 2024-09-19T11:56:25.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.296+0000 7f8348ef99c0 20 add_watcher() i=4 2024-09-19T11:56:25.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.296+0000 7f8348ef99c0 20 add_watcher() i=5 2024-09-19T11:56:25.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.296+0000 7f8348ef99c0 20 add_watcher() i=6 2024-09-19T11:56:25.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.296+0000 7f8348ef99c0 20 add_watcher() i=7 2024-09-19T11:56:25.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.296+0000 7f8348ef99c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:25.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.300+0000 7f81fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:25.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.304+0000 7f8348ef99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:25.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.304+0000 7f8348ef99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:25.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.304+0000 7f8348ef99c0 5 note: GC not initialized 2024-09-19T11:56:25.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.304+0000 7f8177fff640 20 reqs_thread_entry: start 2024-09-19T11:56:25.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.304+0000 7f8348ef99c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:25.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.304+0000 7f8348ef99c0 20 Filter name: none 2024-09-19T11:56:25.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.304+0000 7f8175ffb640 20 reqs_thread_entry: start 2024-09-19T11:56:25.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.304+0000 7f8348ef99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:25.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.304+0000 7f8348ef99c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:25.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.304+0000 7f8348ef99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:25.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.308+0000 7f8348ef99c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:56:25.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.308+0000 7f8348ef99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:25.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.308+0000 7f8348ef99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:25.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.308+0000 7f8348ef99c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:25.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.308+0000 7f8348ef99c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:25.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.308+0000 7f8348ef99c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:56:25.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.308+0000 7f8348ef99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:25.309 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.312+0000 7f81fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:25.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.320+0000 7f8348ef99c0 20 remove_watcher() i=0 2024-09-19T11:56:25.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.320+0000 7f8348ef99c0 2 removed watcher, disabling cache 2024-09-19T11:56:25.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.320+0000 7f8348ef99c0 20 remove_watcher() i=1 2024-09-19T11:56:25.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.324+0000 7f8348ef99c0 20 remove_watcher() i=2 2024-09-19T11:56:25.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.328+0000 7f8348ef99c0 20 remove_watcher() i=3 2024-09-19T11:56:25.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.328+0000 7f8348ef99c0 20 remove_watcher() i=4 2024-09-19T11:56:25.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.332+0000 7f8348ef99c0 20 remove_watcher() i=5 2024-09-19T11:56:25.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.332+0000 7f8348ef99c0 20 remove_watcher() i=6 2024-09-19T11:56:25.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:25.332+0000 7f8348ef99c0 20 remove_watcher() i=7 2024-09-19T11:56:25.355 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:25.355 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:56:25.355 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-trim-reshard-log-entries id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T11:56:25.355 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:25.441 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-19T11:56:25.441 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:25.941 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-19T11:56:25.972 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:56:25.972 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:56:26.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.016+0000 7f4d1df7a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.020+0000 7f4d1df7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:26.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.020+0000 7f4d1df7a9c0 20 realm 2024-09-19T11:56:26.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.020+0000 7f4d1df7a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.020+0000 7f4d1df7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:26.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.020+0000 7f4d1df7a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:26.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.020+0000 7f4d1df7a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.020+0000 7f4d1df7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:26.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.020+0000 7f4d1df7a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.020+0000 7f4d1df7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:26.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.020+0000 7f4d1df7a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.024+0000 7f4d1df7a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:26.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.024+0000 7f4d1df7a9c0 20 searching for the correct realm 2024-09-19T11:56:26.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.028+0000 7f4d1ba80640 0 -- 172.21.15.120:0/591313304 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f4d14033070 msgr2=0x7f4d14033960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:26.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.244+0000 7f4d1ba80640 0 -- 172.21.15.120:0/591313304 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f4d14033070 msgr2=0x7f4d14033960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:26.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:26.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:26.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:26.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:26.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:26.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:26.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:26.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:26.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:26.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 20 zone default found 2024-09-19T11:56:26.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 4 Realm: () 2024-09-19T11:56:26.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:26.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:26.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:26.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 20 zonegroup default 2024-09-19T11:56:26.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.256+0000 7f4d1df7a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.260+0000 7f4d1df7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:26.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.260+0000 7f4d1df7a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.260+0000 7f4d1df7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:26.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.260+0000 7f4d1df7a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.260+0000 7f4d1df7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:26.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.260+0000 7f4d1df7a9c0 20 started sync module instance, tier type = 2024-09-19T11:56:26.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.260+0000 7f4d1df7a9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:26.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.284+0000 7f4d1df7a9c0 20 add_watcher() i=0 2024-09-19T11:56:26.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.284+0000 7f4d1df7a9c0 20 add_watcher() i=1 2024-09-19T11:56:26.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.284+0000 7f4d1df7a9c0 20 add_watcher() i=2 2024-09-19T11:56:26.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.284+0000 7f4d1df7a9c0 20 add_watcher() i=3 2024-09-19T11:56:26.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.284+0000 7f4d1df7a9c0 20 add_watcher() i=4 2024-09-19T11:56:26.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.284+0000 7f4d1df7a9c0 20 add_watcher() i=5 2024-09-19T11:56:26.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.284+0000 7f4d1df7a9c0 20 add_watcher() i=6 2024-09-19T11:56:26.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.288+0000 7f4d1df7a9c0 20 add_watcher() i=7 2024-09-19T11:56:26.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.288+0000 7f4d1df7a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:26.288 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.292+0000 7f4bd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:26.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.292+0000 7f4d1df7a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:26.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.292+0000 7f4d1df7a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:26.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.292+0000 7f4d1df7a9c0 5 note: GC not initialized 2024-09-19T11:56:26.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.292+0000 7f4bd0fe1640 20 reqs_thread_entry: start 2024-09-19T11:56:26.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.292+0000 7f4d1df7a9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:26.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.292+0000 7f4d1df7a9c0 20 Filter name: none 2024-09-19T11:56:26.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.292+0000 7f4b4a7fc640 20 reqs_thread_entry: start 2024-09-19T11:56:26.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.292+0000 7f4d1df7a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.292 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.292+0000 7f4d1df7a9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:26.292 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.292+0000 7f4d1df7a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.296+0000 7f4d1df7a9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:56:26.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.296+0000 7f4d1df7a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:26.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.296+0000 7f4d1df7a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.296+0000 7f4d1df7a9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:26.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.296+0000 7f4d1df7a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.296+0000 7f4d1df7a9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:56:26.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.296+0000 7f4d1df7a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:26.297 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.300+0000 7f4bd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:26.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.304+0000 7f4d1df7a9c0 20 remove_watcher() i=0 2024-09-19T11:56:26.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.304+0000 7f4d1df7a9c0 2 removed watcher, disabling cache 2024-09-19T11:56:26.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.308+0000 7f4d1df7a9c0 20 remove_watcher() i=1 2024-09-19T11:56:26.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.308+0000 7f4d1df7a9c0 20 remove_watcher() i=2 2024-09-19T11:56:26.309 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.312+0000 7f4d1df7a9c0 20 remove_watcher() i=3 2024-09-19T11:56:26.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.316+0000 7f4d1df7a9c0 20 remove_watcher() i=4 2024-09-19T11:56:26.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.316+0000 7f4d1df7a9c0 20 remove_watcher() i=5 2024-09-19T11:56:26.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.320+0000 7f4d1df7a9c0 20 remove_watcher() i=6 2024-09-19T11:56:26.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.320+0000 7f4d1df7a9c0 20 remove_watcher() i=7 2024-09-19T11:56:26.335 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:26.335 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:56:26.335 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-trim-reshard-log-entries id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:56:26.335 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:26.335 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-19T11:56:26.371 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:56:26.371 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:56:26.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.416+0000 7f856ab609c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.420+0000 7f856ab609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:26.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.420+0000 7f856ab609c0 20 realm 2024-09-19T11:56:26.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.420+0000 7f856ab609c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.420+0000 7f856ab609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:26.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.420+0000 7f856ab609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:26.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.420+0000 7f856ab609c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.420+0000 7f856ab609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:26.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.420+0000 7f856ab609c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.420+0000 7f856ab609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:26.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.420+0000 7f856ab609c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.424+0000 7f856ab609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:26.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.424+0000 7f856ab609c0 20 searching for the correct realm 2024-09-19T11:56:26.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.428+0000 7f8568e67640 0 -- 172.21.15.120:0/2507844134 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f8550027020 msgr2=0x7f855005e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:26.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.644+0000 7f8567e65640 0 -- 172.21.15.120:0/2507844134 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f8558049040 msgr2=0x7f8558016040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:26.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.860+0000 7f856ab609c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:26.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.860+0000 7f856ab609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:26.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.860+0000 7f856ab609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:26.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.860+0000 7f856ab609c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:26.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.860+0000 7f856ab609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:26.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.860+0000 7f856ab609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:26.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.860+0000 7f856ab609c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.864+0000 7f856ab609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:26.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.864+0000 7f856ab609c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.864+0000 7f856ab609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:26.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.864+0000 7f856ab609c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.864+0000 7f856ab609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:26.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.864+0000 7f856ab609c0 20 zone default found 2024-09-19T11:56:26.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.864+0000 7f856ab609c0 4 Realm: () 2024-09-19T11:56:26.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.864+0000 7f856ab609c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:26.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.864+0000 7f856ab609c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:26.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.864+0000 7f856ab609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:26.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.864+0000 7f856ab609c0 20 zonegroup default 2024-09-19T11:56:26.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.864+0000 7f856ab609c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.864+0000 7f856ab609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:26.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.864+0000 7f856ab609c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.868+0000 7f856ab609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:26.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.868+0000 7f856ab609c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.868+0000 7f856ab609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:26.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.868+0000 7f856ab609c0 20 started sync module instance, tier type = 2024-09-19T11:56:26.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.868+0000 7f856ab609c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:26.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.888+0000 7f856ab609c0 20 add_watcher() i=0 2024-09-19T11:56:26.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.888+0000 7f856ab609c0 20 add_watcher() i=1 2024-09-19T11:56:26.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.888+0000 7f856ab609c0 20 add_watcher() i=2 2024-09-19T11:56:26.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.888+0000 7f856ab609c0 20 add_watcher() i=3 2024-09-19T11:56:26.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.888+0000 7f856ab609c0 20 add_watcher() i=4 2024-09-19T11:56:26.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.888+0000 7f856ab609c0 20 add_watcher() i=5 2024-09-19T11:56:26.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.888+0000 7f856ab609c0 20 add_watcher() i=6 2024-09-19T11:56:26.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.892+0000 7f856ab609c0 20 add_watcher() i=7 2024-09-19T11:56:26.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.892+0000 7f856ab609c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:26.894 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.896+0000 7f841e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:26.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.896+0000 7f856ab609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:26.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.896+0000 7f856ab609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:26.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.896+0000 7f856ab609c0 5 note: GC not initialized 2024-09-19T11:56:26.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.896+0000 7f841d7e2640 20 reqs_thread_entry: start 2024-09-19T11:56:26.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.896+0000 7f856ab609c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:26.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.896+0000 7f856ab609c0 20 Filter name: none 2024-09-19T11:56:26.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.900+0000 7f838effd640 20 reqs_thread_entry: start 2024-09-19T11:56:26.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.900+0000 7f856ab609c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-19T11:56:26.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.900+0000 7f856ab609c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.900+0000 7f856ab609c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:26.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.900+0000 7f856ab609c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T11:56:26.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.900+0000 7f856ab609c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-19T11:56:26.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.900+0000 7f856ab609c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 : miss 2024-09-19T11:56:26.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.900+0000 7f856ab609c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:26.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.900+0000 7f856ab609c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:56:26.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.900+0000 7f856ab609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 info.flags=0x17 2024-09-19T11:56:26.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.900+0000 7f856ab609c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 to cache LRU end 2024-09-19T11:56:26.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.900+0000 7f856ab609c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:56:26.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.900+0000 7f856ab609c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:26.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.900+0000 7f856ab609c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 2024-09-19T11:56:26.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.908+0000 7f856ab609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 info.flags=0x17 2024-09-19T11:56:26.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.908+0000 7f856ab609c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 to cache LRU end 2024-09-19T11:56:26.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.908+0000 7f856ab609c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:26.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.908+0000 7f856ab609c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27, ofs0, ns] 2024-09-19T11:56:26.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.908+0000 7f84477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366212 cookie 93944459534656 notifier 6476 bl.length()=1023 2024-09-19T11:56:26.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.908+0000 7f84477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 info.flags=0x17 2024-09-19T11:56:26.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.908+0000 7f84477fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 to cache LRU end 2024-09-19T11:56:26.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.908+0000 7f84477fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:26.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.908+0000 7f856ab609c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27]): orig_sources= new_sources= 2024-09-19T11:56:26.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.908+0000 7f856ab609c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27]): potential sources added=[] removed=[] 2024-09-19T11:56:26.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.908+0000 7f856ab609c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27]): orig_dests= new_dests= 2024-09-19T11:56:26.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.908+0000 7f856ab609c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27]): potential dests added=[] removed=[] 2024-09-19T11:56:26.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.908+0000 7f856ab609c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-19T11:56:26.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.908+0000 7f856ab609c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-19T11:56:26.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.912+0000 7f856ab609c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27.1.0 2024-09-19T11:56:26.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.912+0000 7f856ab609c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27.1.0 2024-09-19T11:56:26.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.912+0000 7f856ab609c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27.1.1 2024-09-19T11:56:26.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.912+0000 7f856ab609c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27.1.1 2024-09-19T11:56:26.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.912+0000 7f856ab609c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27.0 2024-09-19T11:56:26.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.916+0000 7f856ab609c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 : hit (requested=0x17, cached=0x17) 2024-09-19T11:56:26.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.916+0000 7f856ab609c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 2024-09-19T11:56:26.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.916+0000 7f856ab609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 info.flags=0x17 2024-09-19T11:56:26.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.916+0000 7f856ab609c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 to cache LRU end 2024-09-19T11:56:26.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.916+0000 7f856ab609c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:26.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.916+0000 7f856ab609c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27, ofs0, ns] 2024-09-19T11:56:26.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.920+0000 7f8446ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366213 cookie 93944459534656 notifier 6476 bl.length()=991 2024-09-19T11:56:26.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.920+0000 7f8446ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 info.flags=0x17 2024-09-19T11:56:26.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.920+0000 7f8446ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 to cache LRU end 2024-09-19T11:56:26.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.920+0000 7f8446ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:26.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.920+0000 7f856ab609c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27]): orig_sources= new_sources= 2024-09-19T11:56:26.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.920+0000 7f856ab609c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27]): potential sources added=[] removed=[] 2024-09-19T11:56:26.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.920+0000 7f856ab609c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27]): orig_dests= new_dests= 2024-09-19T11:56:26.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.920+0000 7f856ab609c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27]): potential dests added=[] removed=[] 2024-09-19T11:56:26.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.920+0000 7f856ab609c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-19T11:56:26.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.924+0000 7f841e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:26.927 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.928+0000 7f856ab609c0 20 remove_watcher() i=0 2024-09-19T11:56:26.927 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.928+0000 7f856ab609c0 2 removed watcher, disabling cache 2024-09-19T11:56:26.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.932+0000 7f856ab609c0 20 remove_watcher() i=1 2024-09-19T11:56:26.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.932+0000 7f856ab609c0 20 remove_watcher() i=2 2024-09-19T11:56:26.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.936+0000 7f856ab609c0 20 remove_watcher() i=3 2024-09-19T11:56:26.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.940+0000 7f856ab609c0 20 remove_watcher() i=4 2024-09-19T11:56:26.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.940+0000 7f856ab609c0 20 remove_watcher() i=5 2024-09-19T11:56:26.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.940+0000 7f856ab609c0 20 remove_watcher() i=6 2024-09-19T11:56:26.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:26.944+0000 7f856ab609c0 20 remove_watcher() i=7 2024-09-19T11:56:26.955 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-19T11:56:26.982 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:56:26.982 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:56:27.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.028+0000 7f3bbd06a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.028+0000 7f3bbd06a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:27.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.028+0000 7f3bbd06a9c0 20 realm 2024-09-19T11:56:27.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.028+0000 7f3bbd06a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.028+0000 7f3bbd06a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:27.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.028+0000 7f3bbd06a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:27.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.028+0000 7f3bbd06a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.032+0000 7f3bbd06a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:27.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.032+0000 7f3bbd06a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.032+0000 7f3bbd06a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:27.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.032+0000 7f3bbd06a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.032+0000 7f3bbd06a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:27.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.032+0000 7f3bbd06a9c0 20 searching for the correct realm 2024-09-19T11:56:27.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.036+0000 7f3bba36f640 0 -- 172.21.15.120:0/2631478510 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7f3bac008040 msgr2=0x7f3bac05b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:27.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.248+0000 7f3bbab70640 0 -- 172.21.15.120:0/2631478510 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f3bb41085d0 msgr2=0x7f3bb41240d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:56:27.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.268+0000 7f3bbd06a9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:27.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.268+0000 7f3bbd06a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:27.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.268+0000 7f3bbd06a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:27.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.268+0000 7f3bbd06a9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:27.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.268+0000 7f3bbd06a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:27.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.268+0000 7f3bbd06a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:27.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.268+0000 7f3bbd06a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.268+0000 7f3bbd06a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:27.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.268+0000 7f3bbd06a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:27.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:27.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 20 zone default found 2024-09-19T11:56:27.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 4 Realm: () 2024-09-19T11:56:27.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:27.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:27.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:27.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 20 zonegroup default 2024-09-19T11:56:27.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.270 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:27.270 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.270 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:27.270 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:27.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 20 started sync module instance, tier type = 2024-09-19T11:56:27.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.272+0000 7f3bbd06a9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:27.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.296+0000 7f3bbd06a9c0 20 add_watcher() i=0 2024-09-19T11:56:27.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.296+0000 7f3bbd06a9c0 20 add_watcher() i=1 2024-09-19T11:56:27.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.296+0000 7f3bbd06a9c0 20 add_watcher() i=2 2024-09-19T11:56:27.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.296+0000 7f3bbd06a9c0 20 add_watcher() i=3 2024-09-19T11:56:27.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.296+0000 7f3bbd06a9c0 20 add_watcher() i=4 2024-09-19T11:56:27.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.296+0000 7f3bbd06a9c0 20 add_watcher() i=5 2024-09-19T11:56:27.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.296+0000 7f3bbd06a9c0 20 add_watcher() i=6 2024-09-19T11:56:27.298 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.300+0000 7f3bbd06a9c0 20 add_watcher() i=7 2024-09-19T11:56:27.298 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.300+0000 7f3bbd06a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:27.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.304+0000 7f3a717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:27.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.304+0000 7f3bbd06a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:27.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.304+0000 7f3bbd06a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:27.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.304+0000 7f3bbd06a9c0 5 note: GC not initialized 2024-09-19T11:56:27.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.304+0000 7f39ebfff640 20 reqs_thread_entry: start 2024-09-19T11:56:27.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.304+0000 7f3bbd06a9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:27.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.304+0000 7f3bbd06a9c0 20 Filter name: none 2024-09-19T11:56:27.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.308+0000 7f39e9ffb640 20 reqs_thread_entry: start 2024-09-19T11:56:27.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.308+0000 7f3bbd06a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.308+0000 7f3bbd06a9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:27.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.308+0000 7f3bbd06a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.308+0000 7f3bbd06a9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:56:27.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.308+0000 7f3bbd06a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:27.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.308+0000 7f3bbd06a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.308+0000 7f3bbd06a9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:27.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.308+0000 7f3bbd06a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.308+0000 7f3bbd06a9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:56:27.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.308+0000 7f3bbd06a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:27.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.312+0000 7f3a717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:27.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.316+0000 7f3bbd06a9c0 20 remove_watcher() i=0 2024-09-19T11:56:27.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.316+0000 7f3bbd06a9c0 2 removed watcher, disabling cache 2024-09-19T11:56:27.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.320+0000 7f3bbd06a9c0 20 remove_watcher() i=1 2024-09-19T11:56:27.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.324+0000 7f3bbd06a9c0 20 remove_watcher() i=2 2024-09-19T11:56:27.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.324+0000 7f3bbd06a9c0 20 remove_watcher() i=3 2024-09-19T11:56:27.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.328+0000 7f3bbd06a9c0 20 remove_watcher() i=4 2024-09-19T11:56:27.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.328+0000 7f3bbd06a9c0 20 remove_watcher() i=5 2024-09-19T11:56:27.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.332+0000 7f3bbd06a9c0 20 remove_watcher() i=6 2024-09-19T11:56:27.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:27.332+0000 7f3bbd06a9c0 20 remove_watcher() i=7 2024-09-19T11:56:27.345 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:27.345 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:56:27.345 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-trim-reshard-log-entries id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-19T11:56:27.345 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:27.432 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-19T11:56:27.432 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:27.915 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-19T11:56:27.946 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:56:27.947 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:56:27.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.000+0000 7f39f22499c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.000+0000 7f39f22499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:27.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.000+0000 7f39f22499c0 20 realm 2024-09-19T11:56:27.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.000+0000 7f39f22499c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.000+0000 7f39f22499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:27.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.000+0000 7f39f22499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:27.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.000+0000 7f39f22499c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:27.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.000+0000 7f39f22499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:27.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.000+0000 7f39f22499c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.004+0000 7f39f22499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:28.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.004+0000 7f39f22499c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.004+0000 7f39f22499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:28.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.004+0000 7f39f22499c0 20 searching for the correct realm 2024-09-19T11:56:28.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.008+0000 7f39f0550640 0 -- 172.21.15.120:0/3791528785 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f39d8008070 msgr2=0x7f39d802e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:28.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.224+0000 7f39ef54e640 0 -- 172.21.15.120:0/3791528785 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f39e8114b90 msgr2=0x7f39e8100370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:28.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.440+0000 7f39f22499c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:28.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.440+0000 7f39f22499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:28.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.440+0000 7f39f22499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:28.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.440+0000 7f39f22499c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:28.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.440+0000 7f39f22499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:28.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.440+0000 7f39f22499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:28.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.440+0000 7f39f22499c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.440+0000 7f39f22499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.440+0000 7f39f22499c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:28.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:28.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 20 zone default found 2024-09-19T11:56:28.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 4 Realm: () 2024-09-19T11:56:28.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:28.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:28.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:28.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 20 zonegroup default 2024-09-19T11:56:28.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 20 started sync module instance, tier type = 2024-09-19T11:56:28.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.444+0000 7f39f22499c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:28.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.472+0000 7f39f22499c0 20 add_watcher() i=0 2024-09-19T11:56:28.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.472+0000 7f39f22499c0 20 add_watcher() i=1 2024-09-19T11:56:28.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.472+0000 7f39f22499c0 20 add_watcher() i=2 2024-09-19T11:56:28.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.472+0000 7f39f22499c0 20 add_watcher() i=3 2024-09-19T11:56:28.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.472+0000 7f39f22499c0 20 add_watcher() i=4 2024-09-19T11:56:28.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.472+0000 7f39f22499c0 20 add_watcher() i=5 2024-09-19T11:56:28.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.476+0000 7f39f22499c0 20 add_watcher() i=6 2024-09-19T11:56:28.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.476+0000 7f39f22499c0 20 add_watcher() i=7 2024-09-19T11:56:28.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.476+0000 7f39f22499c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:28.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.480+0000 7f38a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:28.478 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.480+0000 7f39f22499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:28.478 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.480+0000 7f39f22499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:28.478 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.480+0000 7f39f22499c0 5 note: GC not initialized 2024-09-19T11:56:28.479 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.480+0000 7f38a4fe1640 20 reqs_thread_entry: start 2024-09-19T11:56:28.479 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.480+0000 7f39f22499c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:28.479 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.480+0000 7f39f22499c0 20 Filter name: none 2024-09-19T11:56:28.479 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.480+0000 7f381e7fc640 20 reqs_thread_entry: start 2024-09-19T11:56:28.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.480+0000 7f39f22499c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.484+0000 7f39f22499c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:28.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.484+0000 7f39f22499c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.484+0000 7f39f22499c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:56:28.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.484+0000 7f39f22499c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:28.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.484+0000 7f39f22499c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.484+0000 7f39f22499c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:28.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.484+0000 7f39f22499c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.485 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.488+0000 7f39f22499c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:56:28.485 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.488+0000 7f39f22499c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:28.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.492+0000 7f38a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:28.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.496+0000 7f39f22499c0 20 remove_watcher() i=0 2024-09-19T11:56:28.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.496+0000 7f39f22499c0 2 removed watcher, disabling cache 2024-09-19T11:56:28.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.496+0000 7f39f22499c0 20 remove_watcher() i=1 2024-09-19T11:56:28.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.500+0000 7f39f22499c0 20 remove_watcher() i=2 2024-09-19T11:56:28.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.500+0000 7f39f22499c0 20 remove_watcher() i=3 2024-09-19T11:56:28.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.504+0000 7f39f22499c0 20 remove_watcher() i=4 2024-09-19T11:56:28.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.504+0000 7f39f22499c0 20 remove_watcher() i=5 2024-09-19T11:56:28.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.508+0000 7f39f22499c0 20 remove_watcher() i=6 2024-09-19T11:56:28.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.508+0000 7f39f22499c0 20 remove_watcher() i=7 2024-09-19T11:56:28.524 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.524 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:56:28.524 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-trim-reshard-log-entries id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:56:28.524 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.524 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-19T11:56:28.562 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:56:28.562 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:56:28.606 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.608+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.612+0000 7f048dd709c0 20 realm 2024-09-19T11:56:28.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.612+0000 7f048dd709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:28.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.609 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:28.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.616+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:28.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.616+0000 7f048dd709c0 20 searching for the correct realm 2024-09-19T11:56:28.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.620+0000 7f048b876640 0 -- 172.21.15.120:0/128529382 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f04840c7040 msgr2=0x7f04840c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:28.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.836+0000 7f048b876640 0 -- 172.21.15.120:0/128529382 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f04840c7040 msgr2=0x7f04840c7420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:28.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:28.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:28.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:28.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:28.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:28.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:28.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.848+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.848+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.848+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:28.849 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:28.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 20 zone default found 2024-09-19T11:56:28.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 4 Realm: () 2024-09-19T11:56:28.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:28.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:28.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:28.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 20 zonegroup default 2024-09-19T11:56:28.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.851 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 20 started sync module instance, tier type = 2024-09-19T11:56:28.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.852+0000 7f048dd709c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:28.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=0 2024-09-19T11:56:28.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=1 2024-09-19T11:56:28.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=2 2024-09-19T11:56:28.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=3 2024-09-19T11:56:28.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=4 2024-09-19T11:56:28.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=5 2024-09-19T11:56:28.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=6 2024-09-19T11:56:28.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.880+0000 7f048dd709c0 20 add_watcher() i=7 2024-09-19T11:56:28.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.880+0000 7f048dd709c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:28.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.884+0000 7f0341fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:28.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.884+0000 7f048dd709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:28.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.884+0000 7f048dd709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:28.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.884+0000 7f048dd709c0 5 note: GC not initialized 2024-09-19T11:56:28.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.884+0000 7f0340fe1640 20 reqs_thread_entry: start 2024-09-19T11:56:28.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.884+0000 7f048dd709c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:28.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.884+0000 7f048dd709c0 20 Filter name: none 2024-09-19T11:56:28.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.888+0000 7f02ba7fc640 20 reqs_thread_entry: start 2024-09-19T11:56:28.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.888+0000 7f048dd709c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-19T11:56:28.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.888+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.888+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:28.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.888+0000 7f048dd709c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T11:56:28.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.888+0000 7f048dd709c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-19T11:56:28.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.888+0000 7f048dd709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 : miss 2024-09-19T11:56:28.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.888+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.888+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:56:28.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.888+0000 7f048dd709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:56:28.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.888+0000 7f048dd709c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:56:28.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.888+0000 7f048dd709c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:56:28.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.888+0000 7f048dd709c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:28.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.888+0000 7f048dd709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 2024-09-19T11:56:28.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.900+0000 7f048dd709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:56:28.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.900+0000 7f048dd709c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:56:28.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.900+0000 7f048dd709c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:28.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.900+0000 7f048dd709c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28, ofs0, ns] 2024-09-19T11:56:28.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.900+0000 7f036affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366233 cookie 94303574186768 notifier 6975 bl.length()=1023 2024-09-19T11:56:28.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.900+0000 7f036affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:56:28.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.900+0000 7f036affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:56:28.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.900+0000 7f036affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:28.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.900+0000 7f048dd709c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): orig_sources= new_sources= 2024-09-19T11:56:28.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.900+0000 7f048dd709c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): potential sources added=[] removed=[] 2024-09-19T11:56:28.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.900+0000 7f048dd709c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): orig_dests= new_dests= 2024-09-19T11:56:28.899 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f048dd709c0 time 2024-09-19T11:56:28.905183+0000 2024-09-19T11:56:28.899 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:56:28.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.900+0000 7f048dd709c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): potential dests added=[] removed=[] 2024-09-19T11:56:28.901 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:56:28.901 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f049164a2eb] 2024-09-19T11:56:28.901 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f049164a49f] 2024-09-19T11:56:28.901 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c4c14eb271] 2024-09-19T11:56:28.901 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x141050e) [0x55c4c1f3c50e] 2024-09-19T11:56:28.901 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c4c14fb0dd] 2024-09-19T11:56:28.901 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:56:28.901 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f04904b0d90] 2024-09-19T11:56:28.901 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:56:28.902 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:56:28.902 INFO:tasks.workunit.client.0.smithi120.stderr:*** Caught signal (Aborted) ** 2024-09-19T11:56:28.902 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f048dd709c0 thread_name:radosgw-admin 2024-09-19T11:56:28.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.904+0000 7f048dd709c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f048dd709c0 time 2024-09-19T11:56:28.905183+0000 2024-09-19T11:56:28.902 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:56:28.902 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.902 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:56:28.902 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f049164a2eb] 2024-09-19T11:56:28.902 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f049164a49f] 2024-09-19T11:56:28.902 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c4c14eb271] 2024-09-19T11:56:28.903 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x141050e) [0x55c4c1f3c50e] 2024-09-19T11:56:28.903 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c4c14fb0dd] 2024-09-19T11:56:28.903 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:56:28.903 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f04904b0d90] 2024-09-19T11:56:28.903 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:56:28.903 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:56:28.903 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.909 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:56:28.909 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f04904c9520] 2024-09-19T11:56:28.909 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:56:28.909 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:56:28.909 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:56:28.909 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f049164a345] 2024-09-19T11:56:28.909 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f049164a49f] 2024-09-19T11:56:28.909 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c4c14eb271] 2024-09-19T11:56:28.909 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x141050e) [0x55c4c1f3c50e] 2024-09-19T11:56:28.910 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c4c14fb0dd] 2024-09-19T11:56:28.910 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:56:28.910 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f04904b0d90] 2024-09-19T11:56:28.910 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:56:28.910 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:56:28.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:28.904+0000 7f048dd709c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:56:28.910 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f048dd709c0 thread_name:radosgw-admin 2024-09-19T11:56:28.910 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.910 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:56:28.910 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f04904c9520] 2024-09-19T11:56:28.910 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:56:28.910 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:56:28.910 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:56:28.911 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f049164a345] 2024-09-19T11:56:28.911 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f049164a49f] 2024-09-19T11:56:28.911 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c4c14eb271] 2024-09-19T11:56:28.911 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x141050e) [0x55c4c1f3c50e] 2024-09-19T11:56:28.911 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c4c14fb0dd] 2024-09-19T11:56:28.911 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:56:28.911 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f04904b0d90] 2024-09-19T11:56:28.911 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:56:28.911 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:56:28.911 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:56:28.911 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.911 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:56:28.911 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:56:28.584+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.912 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:56:28.584+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.912 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:56:28.584+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.912 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:56:28.584+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.912 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:56:28.584+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.912 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:56:28.588+0000 7f048b075640 10 monclient(hunting): handle_auth_done global_id 6515 payload 274 2024-09-19T11:56:28.912 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:56:28.588+0000 7f048b075640 10 monclient: _finish_hunting 0 2024-09-19T11:56:28.912 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:56:28.588+0000 7f048b075640 1 monclient: found mon.noname-c 2024-09-19T11:56:28.912 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:56:28.588+0000 7f048b075640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:56:28.912 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.912 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:56:28.912 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: dump: 2024-09-19T11:56:28.912 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.913 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.913 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.913 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.913 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.913 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.913 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.913 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.913 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.913 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.913 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: _finish_auth 0 2024-09-19T11:56:28.913 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: _check_auth_tickets 2024-09-19T11:56:28.913 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: handle_config config(0 keys) 2024-09-19T11:56:28.913 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.913 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:56:28.914 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: dump: 2024-09-19T11:56:28.914 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.914 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.914 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.914 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.914 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.914 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.914 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.914 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.914 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.914 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.914 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 monclient: authenticate success, global_id 6515 2024-09-19T11:56:28.914 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: get_monmap_and_config success 2024-09-19T11:56:28.914 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:56:28.588+0000 7f048dd709c0 4 set_mon_vals no callback set 2024-09-19T11:56:28.915 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: shutdown 2024-09-19T11:56:28.915 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) unregister_commands rotate-key 2024-09-19T11:56:28.915 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: build_initial_monmap 2024-09-19T11:56:28.915 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:56:28.588+0000 7f048dd709c0 1 build_initial for_mkfs: 0 2024-09-19T11:56:28.915 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: monmap: 2024-09-19T11:56:28.915 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:56:28.915 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:56:28.915 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:56:28.915 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:56:28.915 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:56:28.915 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.915 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:56:28.915 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:56:28.915 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:56:28.916 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.916 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding auth protocol: cephx 2024-09-19T11:56:28.916 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding auth protocol: cephx 2024-09-19T11:56:28.916 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding auth protocol: cephx 2024-09-19T11:56:28.916 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: secure 2024-09-19T11:56:28.916 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: crc 2024-09-19T11:56:28.916 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: secure 2024-09-19T11:56:28.916 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: crc 2024-09-19T11:56:28.916 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: secure 2024-09-19T11:56:28.916 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: crc 2024-09-19T11:56:28.916 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: crc 2024-09-19T11:56:28.916 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: secure 2024-09-19T11:56:28.916 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: crc 2024-09-19T11:56:28.916 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: secure 2024-09-19T11:56:28.917 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: crc 2024-09-19T11:56:28.917 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: secure 2024-09-19T11:56:28.917 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:56:28.588+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.917 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:56:28.588+0000 7f048dd709c0 1 librados: starting msgr at 2024-09-19T11:56:28.917 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:56:28.588+0000 7f048dd709c0 1 librados: starting objecter 2024-09-19T11:56:28.917 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command objecter_requests hook 0x55c4c2faf640 2024-09-19T11:56:28.917 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:56:28.588+0000 7f048dd709c0 1 librados: setting wanted keys 2024-09-19T11:56:28.917 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:56:28.588+0000 7f048dd709c0 1 librados: calling monclient init 2024-09-19T11:56:28.917 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: init 2024-09-19T11:56:28.917 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding auth protocol: cephx 2024-09-19T11:56:28.917 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding auth protocol: cephx 2024-09-19T11:56:28.917 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding auth protocol: cephx 2024-09-19T11:56:28.917 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: secure 2024-09-19T11:56:28.917 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: crc 2024-09-19T11:56:28.917 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: secure 2024-09-19T11:56:28.918 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: crc 2024-09-19T11:56:28.918 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: secure 2024-09-19T11:56:28.918 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: crc 2024-09-19T11:56:28.918 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: crc 2024-09-19T11:56:28.918 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: secure 2024-09-19T11:56:28.918 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: crc 2024-09-19T11:56:28.918 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: secure 2024-09-19T11:56:28.918 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: crc 2024-09-19T11:56:28.918 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: secure 2024-09-19T11:56:28.918 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:56:28.588+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.918 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:56:28.588+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.918 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command rotate-key hook 0x55c4c2fa8288 2024-09-19T11:56:28.918 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: _reopen_session rank -1 2024-09-19T11:56:28.918 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T11:56:28.919 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-c con 0x55c4c2e34cf0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:56:28.919 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-b con 0x55c4c2e63e30 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:56:28.919 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-a con 0x55c4c2eedd70 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:56:28.919 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.919 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.919 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.919 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): _renew_subs 2024-09-19T11:56:28.919 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): authenticate will time out at 2282.906609s 2024-09-19T11:56:28.919 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): get_auth_request con 0x55c4c2e34cf0 auth_method 0 2024-09-19T11:56:28.919 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:28.919 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:28.919 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:28.919 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:56:28.588+0000 7f048c077640 10 monclient(hunting): get_auth_request con 0x55c4c2eedd70 auth_method 0 2024-09-19T11:56:28.919 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:56:28.588+0000 7f048c077640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:28.920 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:56:28.588+0000 7f048c077640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:28.920 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:56:28.588+0000 7f048c077640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:28.920 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.920 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.920 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.920 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:56:28.588+0000 7f048c077640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.920 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:56:28.588+0000 7f048c077640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.920 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:56:28.588+0000 7f048c077640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.920 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): handle_auth_done global_id 6518 payload 824 2024-09-19T11:56:28.920 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient: _finish_hunting 0 2024-09-19T11:56:28.920 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:56:28.588+0000 7f048b876640 1 monclient: found mon.noname-c 2024-09-19T11:56:28.920 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:56:28.920 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.921 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:56:28.921 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: dump: 2024-09-19T11:56:28.921 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.921 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.921 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.921 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.921 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.921 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.921 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.921 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.921 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.921 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.921 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: _finish_auth 0 2024-09-19T11:56:28.921 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: _check_auth_tickets 2024-09-19T11:56:28.921 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: handle_config config(0 keys) 2024-09-19T11:56:28.922 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.922 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:56:28.922 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: dump: 2024-09-19T11:56:28.922 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.922 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.922 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.922 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.922 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.922 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.922 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.922 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.922 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.922 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.922 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 monclient: authenticate success, global_id 6518 2024-09-19T11:56:28.923 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: _renew_subs 2024-09-19T11:56:28.923 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:56:28.588+0000 7f0379e0b640 4 set_mon_vals no callback set 2024-09-19T11:56:28.923 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:56:28.923 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: _renew_subs 2024-09-19T11:56:28.923 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:56:28.923 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:56:28.588+0000 7f048dd709c0 1 librados: init done 2024-09-19T11:56:28.923 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:56:28.592+0000 7f0373fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:56:28.923 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:56:28.592+0000 7f0373fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:56:28.923 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:56:28.592+0000 7f0373fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:56:28.923 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:56:28.592+0000 7f048b075640 10 monclient: get_auth_request con 0x7f0374071be0 auth_method 0 2024-09-19T11:56:28.923 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:56:28.592+0000 7f048c077640 10 monclient: get_auth_request con 0x55c4c2ff02e0 auth_method 0 2024-09-19T11:56:28.923 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:56:28.592+0000 7f048b876640 10 monclient: get_auth_request con 0x55c4c2ff34c0 auth_method 0 2024-09-19T11:56:28.923 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:56:28.596+0000 7f048b075640 10 monclient: get_auth_request con 0x55c4c2ff76b0 auth_method 0 2024-09-19T11:56:28.924 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:56:28.596+0000 7f048c077640 10 monclient: get_auth_request con 0x55c4c2ff6d40 auth_method 0 2024-09-19T11:56:28.924 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:56:28.596+0000 7f048dd709c0 10 monclient: build_initial_monmap 2024-09-19T11:56:28.924 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:56:28.596+0000 7f048dd709c0 1 build_initial for_mkfs: 0 2024-09-19T11:56:28.924 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:56:28.596+0000 7f048dd709c0 10 monclient: monmap: 2024-09-19T11:56:28.924 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:56:28.924 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:56:28.924 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:56:28.924 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:56:28.924 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:56:28.924 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.924 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:56:28.924 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:56:28.924 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:56:28.925 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.925 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding auth protocol: cephx 2024-09-19T11:56:28.925 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding auth protocol: cephx 2024-09-19T11:56:28.925 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding auth protocol: cephx 2024-09-19T11:56:28.925 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: secure 2024-09-19T11:56:28.925 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: crc 2024-09-19T11:56:28.925 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: secure 2024-09-19T11:56:28.925 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: crc 2024-09-19T11:56:28.925 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: secure 2024-09-19T11:56:28.925 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: crc 2024-09-19T11:56:28.925 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: crc 2024-09-19T11:56:28.925 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: secure 2024-09-19T11:56:28.925 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: crc 2024-09-19T11:56:28.926 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: secure 2024-09-19T11:56:28.926 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: crc 2024-09-19T11:56:28.926 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: secure 2024-09-19T11:56:28.926 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:56:28.600+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.926 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command objecter_requests cmddesc objecter_requests hook 0x55c4c3003090 EEXIST 2024-09-19T11:56:28.926 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient: init 2024-09-19T11:56:28.926 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding auth protocol: cephx 2024-09-19T11:56:28.926 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding auth protocol: cephx 2024-09-19T11:56:28.926 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding auth protocol: cephx 2024-09-19T11:56:28.926 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: secure 2024-09-19T11:56:28.926 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: crc 2024-09-19T11:56:28.926 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: secure 2024-09-19T11:56:28.926 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: crc 2024-09-19T11:56:28.927 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: secure 2024-09-19T11:56:28.927 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: crc 2024-09-19T11:56:28.927 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: crc 2024-09-19T11:56:28.927 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: secure 2024-09-19T11:56:28.927 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: crc 2024-09-19T11:56:28.927 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: secure 2024-09-19T11:56:28.927 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: crc 2024-09-19T11:56:28.927 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: secure 2024-09-19T11:56:28.927 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:56:28.600+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.927 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:56:28.600+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.927 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command rotate-key cmddesc rotate-key hook 0x55c4c2ffe730 EEXIST 2024-09-19T11:56:28.927 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient: _reopen_session rank -1 2024-09-19T11:56:28.927 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T11:56:28.928 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-b con 0x55c4c3027240 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:56:28.928 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-a con 0x55c4c3026b70 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:56:28.928 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-c con 0x55c4c3025550 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:56:28.928 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.928 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.928 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.928 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): _renew_subs 2024-09-19T11:56:28.928 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): authenticate will time out at 2282.917172s 2024-09-19T11:56:28.928 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:56:28.600+0000 7f048c077640 10 monclient(hunting): get_auth_request con 0x55c4c3026b70 auth_method 0 2024-09-19T11:56:28.928 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:56:28.600+0000 7f048c077640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:28.928 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:56:28.600+0000 7f048c077640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:28.928 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:56:28.600+0000 7f048c077640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:28.928 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): get_auth_request con 0x55c4c3025550 auth_method 0 2024-09-19T11:56:28.928 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:28.929 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:28.929 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:28.929 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.929 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.929 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.929 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:56:28.600+0000 7f048c077640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.929 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:56:28.600+0000 7f048c077640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.929 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:56:28.600+0000 7f048c077640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.929 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): handle_auth_done global_id 6521 payload 824 2024-09-19T11:56:28.929 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient: _finish_hunting 0 2024-09-19T11:56:28.929 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:56:28.600+0000 7f048b876640 1 monclient: found mon.noname-c 2024-09-19T11:56:28.929 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:56:28.930 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:56:28.600+0000 7f048b075640 10 monclient: get_auth_request con 0x55c4c3027240 auth_method 0 2024-09-19T11:56:28.930 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.930 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:56:28.930 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: dump: 2024-09-19T11:56:28.930 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.930 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.930 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.930 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.930 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.930 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.930 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.930 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.930 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.931 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.931 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: _finish_auth 0 2024-09-19T11:56:28.931 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: _check_auth_tickets 2024-09-19T11:56:28.931 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: handle_config config(0 keys) 2024-09-19T11:56:28.931 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.931 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:56:28.931 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: dump: 2024-09-19T11:56:28.931 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.931 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.931 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.931 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.931 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.931 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.932 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.932 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.932 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.932 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.932 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 monclient: authenticate success, global_id 6521 2024-09-19T11:56:28.932 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:56:28.600+0000 7f048c878640 4 set_mon_vals no callback set 2024-09-19T11:56:28.932 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient: _renew_subs 2024-09-19T11:56:28.932 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:56:28.932 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient: _renew_subs 2024-09-19T11:56:28.932 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:56:28.932 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:56:28.600+0000 7f03717fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:56:28.933 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:56:28.600+0000 7f03717fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:56:28.933 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:56:28.600+0000 7f03717fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:56:28.933 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: get_monmap_and_config 2024-09-19T11:56:28.933 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: build_initial_monmap 2024-09-19T11:56:28.933 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:56:28.604+0000 7f048dd709c0 1 build_initial for_mkfs: 0 2024-09-19T11:56:28.933 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: monmap: 2024-09-19T11:56:28.933 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:56:28.933 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:56:28.933 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:56:28.933 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:56:28.933 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:56:28.934 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.934 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:56:28.934 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:56:28.934 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:56:28.934 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.934 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding auth protocol: cephx 2024-09-19T11:56:28.934 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding auth protocol: cephx 2024-09-19T11:56:28.934 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding auth protocol: cephx 2024-09-19T11:56:28.934 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: secure 2024-09-19T11:56:28.934 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: crc 2024-09-19T11:56:28.934 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: secure 2024-09-19T11:56:28.934 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: crc 2024-09-19T11:56:28.934 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: secure 2024-09-19T11:56:28.935 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: crc 2024-09-19T11:56:28.935 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: crc 2024-09-19T11:56:28.935 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: secure 2024-09-19T11:56:28.935 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: crc 2024-09-19T11:56:28.935 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: secure 2024-09-19T11:56:28.935 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: crc 2024-09-19T11:56:28.935 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: secure 2024-09-19T11:56:28.935 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient: get_auth_request con 0x7f0364071b20 auth_method 0 2024-09-19T11:56:28.935 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:56:28.604+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.935 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: init 2024-09-19T11:56:28.935 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding auth protocol: cephx 2024-09-19T11:56:28.935 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding auth protocol: cephx 2024-09-19T11:56:28.935 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding auth protocol: cephx 2024-09-19T11:56:28.935 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: secure 2024-09-19T11:56:28.936 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: crc 2024-09-19T11:56:28.936 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: secure 2024-09-19T11:56:28.936 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: crc 2024-09-19T11:56:28.936 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: secure 2024-09-19T11:56:28.936 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: crc 2024-09-19T11:56:28.936 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: crc 2024-09-19T11:56:28.936 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: secure 2024-09-19T11:56:28.936 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: crc 2024-09-19T11:56:28.936 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: secure 2024-09-19T11:56:28.936 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: crc 2024-09-19T11:56:28.936 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: secure 2024-09-19T11:56:28.936 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:56:28.604+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.936 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:56:28.604+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.937 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command rotate-key cmddesc rotate-key hook 0x7ffd14fa95e8 EEXIST 2024-09-19T11:56:28.937 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: _reopen_session rank -1 2024-09-19T11:56:28.937 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T11:56:28.937 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-c con 0x55c4c30751a0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:56:28.937 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-b con 0x55c4c3080a00 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:56:28.937 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-a con 0x55c4c3047bf0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:56:28.937 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.937 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.937 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.937 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): _renew_subs 2024-09-19T11:56:28.937 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): authenticate will time out at 2282.921195s 2024-09-19T11:56:28.937 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): get_auth_request con 0x55c4c3047bf0 auth_method 0 2024-09-19T11:56:28.937 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:28.937 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:28.938 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:28.938 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): get_auth_request con 0x55c4c30751a0 auth_method 0 2024-09-19T11:56:28.938 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:28.938 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:28.938 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:28.938 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.938 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.938 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.938 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.938 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.938 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.938 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): handle_auth_done global_id 6972 payload 274 2024-09-19T11:56:28.938 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient: _finish_hunting 0 2024-09-19T11:56:28.938 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:56:28.604+0000 7f048b876640 1 monclient: found mon.noname-a 2024-09-19T11:56:28.939 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:56:28.939 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.939 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:56:28.939 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: dump: 2024-09-19T11:56:28.939 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.939 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.939 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.939 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.939 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.939 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.939 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.939 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.939 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.939 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.939 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: _finish_auth 0 2024-09-19T11:56:28.940 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: _check_auth_tickets 2024-09-19T11:56:28.940 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 monclient: authenticate success, global_id 6972 2024-09-19T11:56:28.940 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: handle_config config(0 keys) 2024-09-19T11:56:28.940 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: get_monmap_and_config success 2024-09-19T11:56:28.940 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:56:28.604+0000 7f048dd709c0 4 set_mon_vals no callback set 2024-09-19T11:56:28.940 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.940 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:56:28.940 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: dump: 2024-09-19T11:56:28.940 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.940 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.940 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.940 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.940 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.941 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.941 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.941 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.941 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.941 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.941 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: shutdown 2024-09-19T11:56:28.941 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: build_initial_monmap 2024-09-19T11:56:28.941 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:56:28.604+0000 7f048dd709c0 1 build_initial for_mkfs: 0 2024-09-19T11:56:28.941 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: monmap: 2024-09-19T11:56:28.941 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:56:28.941 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:56:28.941 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:56:28.941 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:56:28.942 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:56:28.942 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.942 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:56:28.942 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:56:28.942 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:56:28.942 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.942 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding auth protocol: cephx 2024-09-19T11:56:28.942 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding auth protocol: cephx 2024-09-19T11:56:28.942 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding auth protocol: cephx 2024-09-19T11:56:28.942 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: secure 2024-09-19T11:56:28.942 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: crc 2024-09-19T11:56:28.942 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: secure 2024-09-19T11:56:28.942 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: crc 2024-09-19T11:56:28.942 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: secure 2024-09-19T11:56:28.943 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: crc 2024-09-19T11:56:28.943 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: crc 2024-09-19T11:56:28.943 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: secure 2024-09-19T11:56:28.943 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: crc 2024-09-19T11:56:28.943 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: secure 2024-09-19T11:56:28.943 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: crc 2024-09-19T11:56:28.943 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: secure 2024-09-19T11:56:28.943 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:56:28.604+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.943 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:56:28.604+0000 7f048dd709c0 1 librados: starting msgr at 2024-09-19T11:56:28.943 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:56:28.604+0000 7f048dd709c0 1 librados: starting objecter 2024-09-19T11:56:28.943 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command objecter_requests cmddesc objecter_requests hook 0x55c4c304bbd0 EEXIST 2024-09-19T11:56:28.943 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:56:28.604+0000 7f048dd709c0 1 librados: setting wanted keys 2024-09-19T11:56:28.943 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:56:28.604+0000 7f048dd709c0 1 librados: calling monclient init 2024-09-19T11:56:28.943 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: init 2024-09-19T11:56:28.944 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding auth protocol: cephx 2024-09-19T11:56:28.944 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding auth protocol: cephx 2024-09-19T11:56:28.944 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding auth protocol: cephx 2024-09-19T11:56:28.944 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: secure 2024-09-19T11:56:28.944 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: crc 2024-09-19T11:56:28.944 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: secure 2024-09-19T11:56:28.944 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: crc 2024-09-19T11:56:28.944 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: secure 2024-09-19T11:56:28.944 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: crc 2024-09-19T11:56:28.944 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: crc 2024-09-19T11:56:28.944 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: secure 2024-09-19T11:56:28.945 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: crc 2024-09-19T11:56:28.945 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: secure 2024-09-19T11:56:28.945 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: crc 2024-09-19T11:56:28.945 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: secure 2024-09-19T11:56:28.945 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:56:28.604+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.945 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:56:28.604+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.945 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command rotate-key cmddesc rotate-key hook 0x55c4c30291a8 EEXIST 2024-09-19T11:56:28.945 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: _reopen_session rank -1 2024-09-19T11:56:28.945 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T11:56:28.945 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-a con 0x55c4c3047bf0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:56:28.945 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-b con 0x55c4c30751a0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:56:28.945 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-c con 0x55c4c3080a00 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:56:28.945 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.946 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.946 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.946 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): _renew_subs 2024-09-19T11:56:28.946 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): authenticate will time out at 2282.923824s 2024-09-19T11:56:28.946 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): get_auth_request con 0x55c4c3047bf0 auth_method 0 2024-09-19T11:56:28.946 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:28.946 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:28.946 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:28.946 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): get_auth_request con 0x55c4c3080a00 auth_method 0 2024-09-19T11:56:28.946 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:28.946 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:28.946 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:28.946 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:56:28.608+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.947 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:56:28.608+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.947 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:56:28.608+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.947 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:56:28.608+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.947 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:56:28.608+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.947 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:56:28.608+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.947 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:56:28.608+0000 7f048b075640 10 monclient(hunting): handle_auth_done global_id 6975 payload 824 2024-09-19T11:56:28.947 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:56:28.608+0000 7f048b075640 10 monclient: _finish_hunting 0 2024-09-19T11:56:28.947 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:56:28.608+0000 7f048b075640 1 monclient: found mon.noname-a 2024-09-19T11:56:28.947 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:56:28.608+0000 7f048b075640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:56:28.947 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:56:28.608+0000 7f048c077640 10 monclient: get_auth_request con 0x55c4c30751a0 auth_method 0 2024-09-19T11:56:28.947 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.947 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:56:28.948 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: dump: 2024-09-19T11:56:28.948 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.948 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.948 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.948 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.948 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.948 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.948 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.948 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.948 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.948 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.948 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: _finish_auth 0 2024-09-19T11:56:28.948 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: _check_auth_tickets 2024-09-19T11:56:28.948 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: handle_config config(0 keys) 2024-09-19T11:56:28.949 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.949 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:56:28.949 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: dump: 2024-09-19T11:56:28.949 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.949 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.949 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.949 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.949 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.949 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.949 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.949 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.949 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.949 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.950 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:56:28.608+0000 7f036affd640 4 set_mon_vals no callback set 2024-09-19T11:56:28.950 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:56:28.608+0000 7f048dd709c0 5 monclient: authenticate success, global_id 6975 2024-09-19T11:56:28.950 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:56:28.608+0000 7f048dd709c0 10 monclient: _renew_subs 2024-09-19T11:56:28.950 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:56:28.608+0000 7f048dd709c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:56:28.950 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:56:28.608+0000 7f048dd709c0 10 monclient: _renew_subs 2024-09-19T11:56:28.950 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:56:28.608+0000 7f048dd709c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:56:28.950 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:56:28.608+0000 7f048dd709c0 1 librados: init done 2024-09-19T11:56:28.950 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:56:28.608+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command cr dump hook 0x7f047c091398 2024-09-19T11:56:28.950 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:56:28.608+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.950 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:56:28.608+0000 7f03697fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:56:28.950 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:56:28.608+0000 7f03697fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:56:28.950 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:56:28.608+0000 7f03697fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:56:28.950 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:56:28.608+0000 7f048b876640 10 monclient: get_auth_request con 0x55c4c3094df0 auth_method 0 2024-09-19T11:56:28.950 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:56:28.608+0000 7f048c077640 10 monclient: get_auth_request con 0x7f0354071c10 auth_method 0 2024-09-19T11:56:28.951 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.951 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 realm 2024-09-19T11:56:28.951 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.951 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.951 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:56:28.612+0000 7f048dd709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:28.951 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.951 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.951 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.951 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:56:28.612+0000 7f048b075640 10 monclient: get_auth_request con 0x55c4c3099000 auth_method 0 2024-09-19T11:56:28.951 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:28.951 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.951 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:56:28.612+0000 7f048c077640 10 monclient: get_auth_request con 0x55c4c309c840 auth_method 0 2024-09-19T11:56:28.951 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:56:28.616+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:28.951 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:56:28.616+0000 7f048dd709c0 20 searching for the correct realm 2024-09-19T11:56:28.952 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:56:28.616+0000 7f048b876640 10 monclient: get_auth_request con 0x55c4c30a1620 auth_method 0 2024-09-19T11:56:28.952 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:56:28.616+0000 7f048b075640 10 monclient: get_auth_request con 0x7f047c080050 auth_method 0 2024-09-19T11:56:28.952 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:56:28.616+0000 7f048c077640 10 monclient: get_auth_request con 0x7f0474034070 auth_method 0 2024-09-19T11:56:28.952 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:56:28.616+0000 7f048b876640 10 monclient: get_auth_request con 0x7f04840c7040 auth_method 0 2024-09-19T11:56:28.952 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:56:28.620+0000 7f048b876640 0 -- 172.21.15.120:0/128529382 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f04840c7040 msgr2=0x7f04840c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:28.952 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:56:28.824+0000 7f048b876640 10 monclient: get_auth_request con 0x7f04840c7040 auth_method 0 2024-09-19T11:56:28.952 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:56:28.836+0000 7f048b075640 10 monclient: get_auth_request con 0x7f047c01f060 auth_method 0 2024-09-19T11:56:28.952 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:56:28.836+0000 7f048b876640 0 -- 172.21.15.120:0/128529382 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f04840c7040 msgr2=0x7f04840c7420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:28.952 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:56:28.836+0000 7f03697fa640 1 client.6975.objecter ms_handle_reset 0x7f04840c7040 session 0x7f04840cb070 osd.4 2024-09-19T11:56:28.952 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:56:28.836+0000 7f03697fa640 10 monclient: _renew_subs 2024-09-19T11:56:28.952 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:56:28.836+0000 7f03697fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:56:28.952 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:56:28.836+0000 7f048b876640 10 monclient: get_auth_request con 0x7f0354082230 auth_method 0 2024-09-19T11:56:28.952 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:28.952 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:28.953 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:28.953 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:28.953 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:28.953 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:28.953 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.953 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.953 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.953 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:28.953 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.953 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:28.953 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 zone default found 2024-09-19T11:56:28.953 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:56:28.852+0000 7f048dd709c0 4 Realm: () 2024-09-19T11:56:28.953 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:56:28.852+0000 7f048dd709c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:28.954 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:56:28.852+0000 7f048dd709c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:28.954 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:56:28.852+0000 7f048dd709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:28.954 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 zonegroup default 2024-09-19T11:56:28.954 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.954 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.954 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.954 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.954 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.954 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:28.954 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 started sync module instance, tier type = 2024-09-19T11:56:28.954 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:28.954 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=0 2024-09-19T11:56:28.954 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=1 2024-09-19T11:56:28.954 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=2 2024-09-19T11:56:28.955 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=3 2024-09-19T11:56:28.955 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=4 2024-09-19T11:56:28.955 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=5 2024-09-19T11:56:28.955 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=6 2024-09-19T11:56:28.955 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:56:28.880+0000 7f048dd709c0 20 add_watcher() i=7 2024-09-19T11:56:28.955 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:56:28.880+0000 7f048dd709c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:28.955 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding auth protocol: cephx 2024-09-19T11:56:28.955 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding auth protocol: cephx 2024-09-19T11:56:28.955 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding auth protocol: cephx 2024-09-19T11:56:28.955 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: secure 2024-09-19T11:56:28.955 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: crc 2024-09-19T11:56:28.955 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: secure 2024-09-19T11:56:28.955 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: crc 2024-09-19T11:56:28.956 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: secure 2024-09-19T11:56:28.956 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: crc 2024-09-19T11:56:28.956 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: crc 2024-09-19T11:56:28.956 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: secure 2024-09-19T11:56:28.956 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: crc 2024-09-19T11:56:28.956 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: secure 2024-09-19T11:56:28.956 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:56:28.884+0000 7f0341fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:28.956 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: crc 2024-09-19T11:56:28.956 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: secure 2024-09-19T11:56:28.956 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:56:28.884+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.956 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:56:28.884+0000 7f048dd709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:28.956 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:56:28.884+0000 7f048dd709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:28.956 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command cache list hook 0x55c4c3078e10 2024-09-19T11:56:28.957 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command cache inspect hook 0x55c4c3078e10 2024-09-19T11:56:28.957 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command cache erase hook 0x55c4c3078e10 2024-09-19T11:56:28.957 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command cache zap hook 0x55c4c3078e10 2024-09-19T11:56:28.957 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 note: GC not initialized 2024-09-19T11:56:28.957 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:56:28.884+0000 7f0340fe1640 20 reqs_thread_entry: start 2024-09-19T11:56:28.957 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command sync trace show hook 0x7f047c061070 2024-09-19T11:56:28.957 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command sync trace history hook 0x7f047c061070 2024-09-19T11:56:28.957 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command sync trace active hook 0x7f047c061070 2024-09-19T11:56:28.957 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command sync trace active_short hook 0x7f047c061070 2024-09-19T11:56:28.957 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:56:28.884+0000 7f048dd709c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:28.957 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:56:28.884+0000 7f048dd709c0 20 Filter name: none 2024-09-19T11:56:28.957 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:56:28.888+0000 7f02ba7fc640 20 reqs_thread_entry: start 2024-09-19T11:56:28.957 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-19T11:56:28.958 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:56:28.888+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.958 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:56:28.888+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:28.958 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T11:56:28.958 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-19T11:56:28.958 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 : miss 2024-09-19T11:56:28.958 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:56:28.888+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:28.958 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:56:28.888+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:56:28.958 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:56:28.958 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:56:28.958 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:56:28.958 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:28.958 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 2024-09-19T11:56:28.958 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:56:28.900+0000 7f048dd709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:56:28.959 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:56:28.900+0000 7f048dd709c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:56:28.959 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:56:28.900+0000 7f048dd709c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:28.959 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:56:28.900+0000 7f048dd709c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28, ofs0, ns] 2024-09-19T11:56:28.959 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:56:28.900+0000 7f036affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366233 cookie 94303574186768 notifier 6975 bl.length()=1023 2024-09-19T11:56:28.959 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:56:28.900+0000 7f036affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:56:28.959 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:56:28.900+0000 7f036affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:56:28.959 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:56:28.900+0000 7f036affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:28.959 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:56:28.900+0000 7f048dd709c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): orig_sources= new_sources= 2024-09-19T11:56:28.959 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:56:28.900+0000 7f048dd709c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): potential sources added=[] removed=[] 2024-09-19T11:56:28.960 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:56:28.900+0000 7f048dd709c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): orig_dests= new_dests= 2024-09-19T11:56:28.960 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:56:28.900+0000 7f048dd709c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): potential dests added=[] removed=[] 2024-09-19T11:56:28.960 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:56:28.904+0000 7f048dd709c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f048dd709c0 time 2024-09-19T11:56:28.905183+0000 2024-09-19T11:56:28.960 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:56:28.960 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.960 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:56:28.960 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f049164a2eb] 2024-09-19T11:56:28.960 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f049164a49f] 2024-09-19T11:56:28.960 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c4c14eb271] 2024-09-19T11:56:28.960 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x141050e) [0x55c4c1f3c50e] 2024-09-19T11:56:28.960 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c4c14fb0dd] 2024-09-19T11:56:28.960 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:56:28.960 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f04904b0d90] 2024-09-19T11:56:28.961 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:56:28.961 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:56:28.961 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.961 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:56:28.904+0000 7f048dd709c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:56:28.961 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f048dd709c0 thread_name:radosgw-admin 2024-09-19T11:56:28.961 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.961 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:56:28.961 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f04904c9520] 2024-09-19T11:56:28.961 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:56:28.961 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:56:28.961 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:56:28.961 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f049164a345] 2024-09-19T11:56:28.961 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f049164a49f] 2024-09-19T11:56:28.961 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c4c14eb271] 2024-09-19T11:56:28.962 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x141050e) [0x55c4c1f3c50e] 2024-09-19T11:56:28.962 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c4c14fb0dd] 2024-09-19T11:56:28.962 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:56:28.962 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f04904b0d90] 2024-09-19T11:56:28.962 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:56:28.962 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:56:28.962 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:56:28.962 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.962 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:56:28.962 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:56:28.962 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:56:28.962 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:56:28.962 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:56:28.963 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:56:28.963 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:56:28.963 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:56:28.963 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:56:28.963 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:56:28.963 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:56:28.963 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:56:28.963 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:56:28.963 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:56:28.963 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:56:28.963 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:56:28.963 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:56:28.963 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:56:28.963 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:56:28.964 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:56:28.964 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:56:28.964 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:56:28.964 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:56:28.964 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:56:28.964 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:56:28.964 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:56:28.964 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:56:28.964 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:56:28.964 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:56:28.964 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:56:28.964 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:56:28.964 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:56:28.964 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:56:28.965 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:56:28.965 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:56:28.965 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:56:28.965 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:56:28.965 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:56:28.965 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:56:28.965 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:56:28.965 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:56:28.965 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:56:28.965 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:56:28.965 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:56:28.965 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:56:28.966 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:56:28.966 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:56:28.966 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:56:28.966 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:56:28.966 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:56:28.966 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:56:28.966 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:56:28.966 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:56:28.966 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:56:28.966 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:56:28.966 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:56:28.966 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:56:28.967 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:56:28.967 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:56:28.967 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:56:28.967 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:56:28.967 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:56:28.967 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:56:28.967 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:56:28.967 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:56:28.967 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:56:28.967 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:56:28.967 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:56:28.967 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:56:28.967 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:56:28.968 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:56:28.968 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:56:28.968 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:56:28.968 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:56:28.968 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:56:28.968 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:56:28.968 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:56:28.968 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:56:28.968 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:56:28.968 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:56:28.968 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:56:28.968 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:56:28.968 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:56:28.969 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:56:28.969 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:56:28.969 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:56:28.969 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:56:28.969 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:56:28.969 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:56:28.969 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:56:28.969 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:56:28.969 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:56:28.969 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:56:28.969 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:56:28.969 INFO:tasks.workunit.client.0.smithi120.stderr: 7f02ba7fc640 / http_manager 2024-09-19T11:56:28.969 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0340fe1640 / http_manager 2024-09-19T11:56:28.969 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0341fe3640 / rgw_dt_lg_renew 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr: 7f03697fa640 / ms_dispatch 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr: 7f036affd640 / io_context_pool 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr: 7f03717fa640 / ms_dispatch 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0373fff640 / ms_dispatch 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0379e0b640 / io_context_pool 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr: 7f048b075640 / msgr-worker-2 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr: 7f048b876640 / msgr-worker-1 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr: 7f048c077640 / msgr-worker-0 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr: 7f048c878640 / io_context_pool 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr: 7f048dd709c0 / radosgw-admin 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/log/ceph/ceph-client.admin.99830.log 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:56:28.970 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:56:28.584+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.971 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:56:28.584+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.971 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:56:28.584+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.971 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:56:28.584+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.971 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:56:28.584+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.971 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:56:28.588+0000 7f048b075640 10 monclient(hunting): handle_auth_done global_id 6515 payload 274 2024-09-19T11:56:28.971 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:56:28.588+0000 7f048b075640 10 monclient: _finish_hunting 0 2024-09-19T11:56:28.971 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:56:28.588+0000 7f048b075640 1 monclient: found mon.noname-c 2024-09-19T11:56:28.971 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:56:28.588+0000 7f048b075640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:56:28.971 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.971 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:56:28.971 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: dump: 2024-09-19T11:56:28.971 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.971 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.971 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.972 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.972 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.972 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.972 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.972 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.972 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.972 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.972 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: _finish_auth 0 2024-09-19T11:56:28.972 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: _check_auth_tickets 2024-09-19T11:56:28.972 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: handle_config config(0 keys) 2024-09-19T11:56:28.972 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.972 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:56:28.972 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:56:28.588+0000 7f0379e0b640 10 monclient: dump: 2024-09-19T11:56:28.973 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.973 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.973 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.973 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.973 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.973 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.973 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.973 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.973 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.973 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.973 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 monclient: authenticate success, global_id 6515 2024-09-19T11:56:28.973 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: get_monmap_and_config success 2024-09-19T11:56:28.973 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:56:28.588+0000 7f048dd709c0 4 set_mon_vals no callback set 2024-09-19T11:56:28.973 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: shutdown 2024-09-19T11:56:28.974 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) unregister_commands rotate-key 2024-09-19T11:56:28.974 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: build_initial_monmap 2024-09-19T11:56:28.974 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:56:28.588+0000 7f048dd709c0 1 build_initial for_mkfs: 0 2024-09-19T11:56:28.974 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: monmap: 2024-09-19T11:56:28.974 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:56:28.974 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:56:28.974 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:56:28.974 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:56:28.974 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:56:28.974 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.974 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:56:28.974 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:56:28.974 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:56:28.974 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding auth protocol: cephx 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding auth protocol: cephx 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding auth protocol: cephx 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: secure 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: crc 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: secure 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: crc 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: secure 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: crc 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: crc 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: secure 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: crc 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: secure 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: crc 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2faa220) adding con mode: secure 2024-09-19T11:56:28.975 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:56:28.588+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.976 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:56:28.588+0000 7f048dd709c0 1 librados: starting msgr at 2024-09-19T11:56:28.976 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:56:28.588+0000 7f048dd709c0 1 librados: starting objecter 2024-09-19T11:56:28.976 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command objecter_requests hook 0x55c4c2faf640 2024-09-19T11:56:28.976 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:56:28.588+0000 7f048dd709c0 1 librados: setting wanted keys 2024-09-19T11:56:28.976 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:56:28.588+0000 7f048dd709c0 1 librados: calling monclient init 2024-09-19T11:56:28.976 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: init 2024-09-19T11:56:28.976 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding auth protocol: cephx 2024-09-19T11:56:28.976 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding auth protocol: cephx 2024-09-19T11:56:28.976 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding auth protocol: cephx 2024-09-19T11:56:28.976 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: secure 2024-09-19T11:56:28.976 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: crc 2024-09-19T11:56:28.976 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: secure 2024-09-19T11:56:28.977 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: crc 2024-09-19T11:56:28.977 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: secure 2024-09-19T11:56:28.977 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: crc 2024-09-19T11:56:28.977 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: crc 2024-09-19T11:56:28.977 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: secure 2024-09-19T11:56:28.977 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: crc 2024-09-19T11:56:28.977 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: secure 2024-09-19T11:56:28.977 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: crc 2024-09-19T11:56:28.977 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fa8140) adding con mode: secure 2024-09-19T11:56:28.977 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:56:28.588+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.977 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:56:28.588+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.977 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command rotate-key hook 0x55c4c2fa8288 2024-09-19T11:56:28.977 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: _reopen_session rank -1 2024-09-19T11:56:28.978 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T11:56:28.978 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-c con 0x55c4c2e34cf0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:56:28.978 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-b con 0x55c4c2e63e30 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:56:28.978 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-a con 0x55c4c2eedd70 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:56:28.978 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.978 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.978 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.978 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): _renew_subs 2024-09-19T11:56:28.978 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient(hunting): authenticate will time out at 2282.906609s 2024-09-19T11:56:28.978 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): get_auth_request con 0x55c4c2e34cf0 auth_method 0 2024-09-19T11:56:28.978 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:28.978 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:28.978 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:28.979 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:56:28.588+0000 7f048c077640 10 monclient(hunting): get_auth_request con 0x55c4c2eedd70 auth_method 0 2024-09-19T11:56:28.979 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:56:28.588+0000 7f048c077640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:28.979 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:56:28.588+0000 7f048c077640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:28.979 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:56:28.588+0000 7f048c077640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:28.979 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.979 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.979 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.979 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:56:28.588+0000 7f048c077640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.979 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:56:28.588+0000 7f048c077640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.979 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:56:28.588+0000 7f048c077640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.979 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient(hunting): handle_auth_done global_id 6518 payload 824 2024-09-19T11:56:28.979 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient: _finish_hunting 0 2024-09-19T11:56:28.979 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:56:28.588+0000 7f048b876640 1 monclient: found mon.noname-c 2024-09-19T11:56:28.980 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:56:28.588+0000 7f048b876640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:56:28.980 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.980 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:56:28.980 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: dump: 2024-09-19T11:56:28.980 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.980 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.980 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.980 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.980 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.980 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.980 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.980 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.980 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.980 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.981 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: _finish_auth 0 2024-09-19T11:56:28.981 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: _check_auth_tickets 2024-09-19T11:56:28.981 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: handle_config config(0 keys) 2024-09-19T11:56:28.981 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.981 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:56:28.981 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:56:28.588+0000 7f0373fff640 10 monclient: dump: 2024-09-19T11:56:28.981 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.981 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.981 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.981 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.981 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.981 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.981 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.982 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.982 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.982 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.982 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:56:28.588+0000 7f048dd709c0 5 monclient: authenticate success, global_id 6518 2024-09-19T11:56:28.982 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: _renew_subs 2024-09-19T11:56:28.982 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:56:28.588+0000 7f0379e0b640 4 set_mon_vals no callback set 2024-09-19T11:56:28.982 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:56:28.982 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: _renew_subs 2024-09-19T11:56:28.982 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:56:28.588+0000 7f048dd709c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:56:28.982 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:56:28.588+0000 7f048dd709c0 1 librados: init done 2024-09-19T11:56:28.982 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:56:28.592+0000 7f0373fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:56:28.983 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:56:28.592+0000 7f0373fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:56:28.983 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:56:28.592+0000 7f0373fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:56:28.983 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:56:28.592+0000 7f048b075640 10 monclient: get_auth_request con 0x7f0374071be0 auth_method 0 2024-09-19T11:56:28.983 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:56:28.592+0000 7f048c077640 10 monclient: get_auth_request con 0x55c4c2ff02e0 auth_method 0 2024-09-19T11:56:28.983 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:56:28.592+0000 7f048b876640 10 monclient: get_auth_request con 0x55c4c2ff34c0 auth_method 0 2024-09-19T11:56:28.983 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:56:28.596+0000 7f048b075640 10 monclient: get_auth_request con 0x55c4c2ff76b0 auth_method 0 2024-09-19T11:56:28.983 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:56:28.596+0000 7f048c077640 10 monclient: get_auth_request con 0x55c4c2ff6d40 auth_method 0 2024-09-19T11:56:28.983 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:56:28.596+0000 7f048dd709c0 10 monclient: build_initial_monmap 2024-09-19T11:56:28.983 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:56:28.596+0000 7f048dd709c0 1 build_initial for_mkfs: 0 2024-09-19T11:56:28.983 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:56:28.596+0000 7f048dd709c0 10 monclient: monmap: 2024-09-19T11:56:28.983 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:56:28.983 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:56:28.983 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:56:28.983 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:56:28.984 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:56:28.984 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.984 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:56:28.984 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:56:28.984 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:56:28.984 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.984 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding auth protocol: cephx 2024-09-19T11:56:28.984 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding auth protocol: cephx 2024-09-19T11:56:28.984 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding auth protocol: cephx 2024-09-19T11:56:28.984 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: secure 2024-09-19T11:56:28.984 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: crc 2024-09-19T11:56:28.984 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: secure 2024-09-19T11:56:28.984 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: crc 2024-09-19T11:56:28.984 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: secure 2024-09-19T11:56:28.985 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: crc 2024-09-19T11:56:28.985 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: crc 2024-09-19T11:56:28.985 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: secure 2024-09-19T11:56:28.985 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: crc 2024-09-19T11:56:28.985 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:56:28.596+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: secure 2024-09-19T11:56:28.985 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: crc 2024-09-19T11:56:28.985 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2fff6a0) adding con mode: secure 2024-09-19T11:56:28.985 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:56:28.600+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.985 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command objecter_requests cmddesc objecter_requests hook 0x55c4c3003090 EEXIST 2024-09-19T11:56:28.985 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient: init 2024-09-19T11:56:28.985 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding auth protocol: cephx 2024-09-19T11:56:28.985 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding auth protocol: cephx 2024-09-19T11:56:28.985 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding auth protocol: cephx 2024-09-19T11:56:28.985 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: secure 2024-09-19T11:56:28.985 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: crc 2024-09-19T11:56:28.986 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: secure 2024-09-19T11:56:28.986 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: crc 2024-09-19T11:56:28.986 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: secure 2024-09-19T11:56:28.986 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: crc 2024-09-19T11:56:28.986 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: crc 2024-09-19T11:56:28.986 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: secure 2024-09-19T11:56:28.986 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: crc 2024-09-19T11:56:28.986 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: secure 2024-09-19T11:56:28.986 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: crc 2024-09-19T11:56:28.986 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 AuthRegistry(0x55c4c2ffe5e8) adding con mode: secure 2024-09-19T11:56:28.986 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:56:28.600+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.986 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:56:28.600+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.986 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command rotate-key cmddesc rotate-key hook 0x55c4c2ffe730 EEXIST 2024-09-19T11:56:28.986 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient: _reopen_session rank -1 2024-09-19T11:56:28.987 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T11:56:28.987 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-b con 0x55c4c3027240 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:56:28.987 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-a con 0x55c4c3026b70 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:56:28.987 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-c con 0x55c4c3025550 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:56:28.987 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.987 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.987 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.987 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): _renew_subs 2024-09-19T11:56:28.987 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient(hunting): authenticate will time out at 2282.917172s 2024-09-19T11:56:28.987 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:56:28.600+0000 7f048c077640 10 monclient(hunting): get_auth_request con 0x55c4c3026b70 auth_method 0 2024-09-19T11:56:28.987 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:56:28.600+0000 7f048c077640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:28.987 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:56:28.600+0000 7f048c077640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:28.987 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:56:28.600+0000 7f048c077640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:28.987 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): get_auth_request con 0x55c4c3025550 auth_method 0 2024-09-19T11:56:28.988 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:28.988 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:28.988 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:28.988 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.988 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.988 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.988 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:56:28.600+0000 7f048c077640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.988 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:56:28.600+0000 7f048c077640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.988 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:56:28.600+0000 7f048c077640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.988 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient(hunting): handle_auth_done global_id 6521 payload 824 2024-09-19T11:56:28.988 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient: _finish_hunting 0 2024-09-19T11:56:28.988 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:56:28.600+0000 7f048b876640 1 monclient: found mon.noname-c 2024-09-19T11:56:28.989 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:56:28.600+0000 7f048b876640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:56:28.989 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:56:28.600+0000 7f048b075640 10 monclient: get_auth_request con 0x55c4c3027240 auth_method 0 2024-09-19T11:56:28.989 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.989 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:56:28.989 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: dump: 2024-09-19T11:56:28.989 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.989 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.989 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.989 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.989 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.989 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.989 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.990 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.990 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.990 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.990 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: _finish_auth 0 2024-09-19T11:56:28.990 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: _check_auth_tickets 2024-09-19T11:56:28.990 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: handle_config config(0 keys) 2024-09-19T11:56:28.990 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.990 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:56:28.990 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:56:28.600+0000 7f03717fa640 10 monclient: dump: 2024-09-19T11:56:28.990 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.990 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.990 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.990 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.990 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.991 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.991 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.991 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.991 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.991 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.991 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:56:28.600+0000 7f048dd709c0 5 monclient: authenticate success, global_id 6521 2024-09-19T11:56:28.991 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:56:28.600+0000 7f048c878640 4 set_mon_vals no callback set 2024-09-19T11:56:28.991 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient: _renew_subs 2024-09-19T11:56:28.991 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:56:28.991 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient: _renew_subs 2024-09-19T11:56:28.991 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:56:28.600+0000 7f048dd709c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:56:28.991 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:56:28.600+0000 7f03717fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:56:28.991 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:56:28.600+0000 7f03717fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:56:28.991 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:56:28.600+0000 7f03717fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:56:28.992 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: get_monmap_and_config 2024-09-19T11:56:28.992 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: build_initial_monmap 2024-09-19T11:56:28.992 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:56:28.604+0000 7f048dd709c0 1 build_initial for_mkfs: 0 2024-09-19T11:56:28.992 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: monmap: 2024-09-19T11:56:28.992 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:56:28.992 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:56:28.992 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:56:28.992 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:56:28.992 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:56:28.992 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.992 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:56:28.992 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:56:28.992 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:56:28.993 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.993 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding auth protocol: cephx 2024-09-19T11:56:28.993 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding auth protocol: cephx 2024-09-19T11:56:28.993 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding auth protocol: cephx 2024-09-19T11:56:28.993 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: secure 2024-09-19T11:56:28.993 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: crc 2024-09-19T11:56:28.993 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: secure 2024-09-19T11:56:28.993 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: crc 2024-09-19T11:56:28.993 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: secure 2024-09-19T11:56:28.993 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: crc 2024-09-19T11:56:28.993 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: crc 2024-09-19T11:56:28.993 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: secure 2024-09-19T11:56:28.993 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: crc 2024-09-19T11:56:28.994 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: secure 2024-09-19T11:56:28.994 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: crc 2024-09-19T11:56:28.994 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3046bd0) adding con mode: secure 2024-09-19T11:56:28.994 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient: get_auth_request con 0x7f0364071b20 auth_method 0 2024-09-19T11:56:28.994 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:56:28.604+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.994 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: init 2024-09-19T11:56:28.994 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding auth protocol: cephx 2024-09-19T11:56:28.994 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding auth protocol: cephx 2024-09-19T11:56:28.994 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding auth protocol: cephx 2024-09-19T11:56:28.994 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: secure 2024-09-19T11:56:28.994 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: crc 2024-09-19T11:56:28.994 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: secure 2024-09-19T11:56:28.995 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: crc 2024-09-19T11:56:28.995 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: secure 2024-09-19T11:56:28.995 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: crc 2024-09-19T11:56:28.995 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: crc 2024-09-19T11:56:28.995 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: secure 2024-09-19T11:56:28.995 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: crc 2024-09-19T11:56:28.995 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: secure 2024-09-19T11:56:28.995 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: crc 2024-09-19T11:56:28.995 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa94a0) adding con mode: secure 2024-09-19T11:56:28.995 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:56:28.604+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.995 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:56:28.604+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:28.995 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command rotate-key cmddesc rotate-key hook 0x7ffd14fa95e8 EEXIST 2024-09-19T11:56:28.995 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: _reopen_session rank -1 2024-09-19T11:56:28.995 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T11:56:28.996 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-c con 0x55c4c30751a0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:56:28.996 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-b con 0x55c4c3080a00 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:56:28.996 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-a con 0x55c4c3047bf0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:56:28.996 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.996 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.996 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:28.996 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): _renew_subs 2024-09-19T11:56:28.996 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): authenticate will time out at 2282.921195s 2024-09-19T11:56:28.996 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): get_auth_request con 0x55c4c3047bf0 auth_method 0 2024-09-19T11:56:28.996 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:28.996 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:28.997 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:28.997 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): get_auth_request con 0x55c4c30751a0 auth_method 0 2024-09-19T11:56:28.997 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:28.997 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:28.997 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:28.997 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.997 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.997 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.997 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:28.997 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:28.997 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:28.997 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): handle_auth_done global_id 6972 payload 274 2024-09-19T11:56:28.998 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient: _finish_hunting 0 2024-09-19T11:56:28.998 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:56:28.604+0000 7f048b876640 1 monclient: found mon.noname-a 2024-09-19T11:56:28.998 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:56:28.998 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.998 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:56:28.998 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: dump: 2024-09-19T11:56:28.998 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:28.998 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:28.998 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.998 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:28.998 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:28.998 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:28.998 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:28.999 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:28.999 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:28.999 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:28.999 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: _finish_auth 0 2024-09-19T11:56:28.999 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: _check_auth_tickets 2024-09-19T11:56:28.999 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 monclient: authenticate success, global_id 6972 2024-09-19T11:56:28.999 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: handle_config config(0 keys) 2024-09-19T11:56:28.999 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: get_monmap_and_config success 2024-09-19T11:56:28.999 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:56:28.604+0000 7f048dd709c0 4 set_mon_vals no callback set 2024-09-19T11:56:28.999 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:28.999 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:56:29.000 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:56:28.604+0000 7f036affd640 10 monclient: dump: 2024-09-19T11:56:29.000 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:29.000 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:29.000 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:29.000 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:29.000 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:29.000 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:29.000 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:29.000 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:29.000 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:29.000 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:29.000 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: shutdown 2024-09-19T11:56:29.000 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: build_initial_monmap 2024-09-19T11:56:29.001 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:56:28.604+0000 7f048dd709c0 1 build_initial for_mkfs: 0 2024-09-19T11:56:29.001 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: monmap: 2024-09-19T11:56:29.001 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:56:29.001 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:56:29.001 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:56:29.001 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:56:29.001 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:56:29.001 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:29.001 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:56:29.001 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:56:29.001 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:56:29.001 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:29.001 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding auth protocol: cephx 2024-09-19T11:56:29.001 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding auth protocol: cephx 2024-09-19T11:56:29.002 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding auth protocol: cephx 2024-09-19T11:56:29.002 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: secure 2024-09-19T11:56:29.002 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: crc 2024-09-19T11:56:29.002 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: secure 2024-09-19T11:56:29.002 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: crc 2024-09-19T11:56:29.004 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: secure 2024-09-19T11:56:29.004 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: crc 2024-09-19T11:56:29.004 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: crc 2024-09-19T11:56:29.004 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: secure 2024-09-19T11:56:29.004 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: crc 2024-09-19T11:56:29.004 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: secure 2024-09-19T11:56:29.004 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: crc 2024-09-19T11:56:29.004 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c304ab80) adding con mode: secure 2024-09-19T11:56:29.005 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:56:28.604+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:29.005 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:56:28.604+0000 7f048dd709c0 1 librados: starting msgr at 2024-09-19T11:56:29.005 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:56:28.604+0000 7f048dd709c0 1 librados: starting objecter 2024-09-19T11:56:29.005 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command objecter_requests cmddesc objecter_requests hook 0x55c4c304bbd0 EEXIST 2024-09-19T11:56:29.005 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:56:28.604+0000 7f048dd709c0 1 librados: setting wanted keys 2024-09-19T11:56:29.005 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:56:28.604+0000 7f048dd709c0 1 librados: calling monclient init 2024-09-19T11:56:29.005 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: init 2024-09-19T11:56:29.005 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding auth protocol: cephx 2024-09-19T11:56:29.005 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding auth protocol: cephx 2024-09-19T11:56:29.005 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding auth protocol: cephx 2024-09-19T11:56:29.006 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: secure 2024-09-19T11:56:29.006 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: crc 2024-09-19T11:56:29.006 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: secure 2024-09-19T11:56:29.006 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: crc 2024-09-19T11:56:29.006 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: secure 2024-09-19T11:56:29.006 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: crc 2024-09-19T11:56:29.006 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: crc 2024-09-19T11:56:29.006 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: secure 2024-09-19T11:56:29.006 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: crc 2024-09-19T11:56:29.006 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: secure 2024-09-19T11:56:29.006 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: crc 2024-09-19T11:56:29.006 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 AuthRegistry(0x55c4c3029060) adding con mode: secure 2024-09-19T11:56:29.006 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:56:28.604+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:29.007 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:56:28.604+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:29.007 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:56:28.604+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command rotate-key cmddesc rotate-key hook 0x55c4c30291a8 EEXIST 2024-09-19T11:56:29.007 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: _reopen_session rank -1 2024-09-19T11:56:29.007 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T11:56:29.007 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-a con 0x55c4c3047bf0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:56:29.007 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-b con 0x55c4c30751a0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:56:29.007 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): picked mon.noname-c con 0x55c4c3080a00 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:56:29.007 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:29.007 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:29.007 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:56:29.007 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): _renew_subs 2024-09-19T11:56:29.007 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:56:28.604+0000 7f048dd709c0 10 monclient(hunting): authenticate will time out at 2282.923824s 2024-09-19T11:56:29.008 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): get_auth_request con 0x55c4c3047bf0 auth_method 0 2024-09-19T11:56:29.008 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:29.008 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:29.008 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:56:28.604+0000 7f048b075640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:29.008 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): get_auth_request con 0x55c4c3080a00 auth_method 0 2024-09-19T11:56:29.008 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:56:29.008 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:56:29.008 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:56:28.604+0000 7f048b876640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:56:29.008 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:56:28.608+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:29.008 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:56:28.608+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:29.008 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:56:28.608+0000 7f048b075640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:29.009 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:56:28.608+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:56:29.009 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:56:28.608+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:56:29.009 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:56:28.608+0000 7f048b876640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:56:29.009 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:56:28.608+0000 7f048b075640 10 monclient(hunting): handle_auth_done global_id 6975 payload 824 2024-09-19T11:56:29.009 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:56:28.608+0000 7f048b075640 10 monclient: _finish_hunting 0 2024-09-19T11:56:29.009 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:56:28.608+0000 7f048b075640 1 monclient: found mon.noname-a 2024-09-19T11:56:29.009 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:56:28.608+0000 7f048b075640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:56:29.009 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:56:28.608+0000 7f048c077640 10 monclient: get_auth_request con 0x55c4c30751a0 auth_method 0 2024-09-19T11:56:29.009 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:29.009 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:56:29.009 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: dump: 2024-09-19T11:56:29.009 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:29.009 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:29.010 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:29.010 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:29.010 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:29.010 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:29.010 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:29.010 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:29.010 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:29.010 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:29.010 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: _finish_auth 0 2024-09-19T11:56:29.010 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: _check_auth_tickets 2024-09-19T11:56:29.010 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: handle_config config(0 keys) 2024-09-19T11:56:29.010 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:56:29.010 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:56:29.011 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:56:28.608+0000 7f03697fa640 10 monclient: dump: 2024-09-19T11:56:29.011 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:56:29.011 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:56:29.011 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:29.011 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:56:29.011 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:56:29.011 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:56:29.011 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:56:29.011 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:56:29.011 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:56:29.011 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:29.011 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:56:28.608+0000 7f036affd640 4 set_mon_vals no callback set 2024-09-19T11:56:29.012 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:56:28.608+0000 7f048dd709c0 5 monclient: authenticate success, global_id 6975 2024-09-19T11:56:29.012 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:56:28.608+0000 7f048dd709c0 10 monclient: _renew_subs 2024-09-19T11:56:29.012 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:56:28.608+0000 7f048dd709c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:56:29.012 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:56:28.608+0000 7f048dd709c0 10 monclient: _renew_subs 2024-09-19T11:56:29.012 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:56:28.608+0000 7f048dd709c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:56:29.012 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:56:28.608+0000 7f048dd709c0 1 librados: init done 2024-09-19T11:56:29.012 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:56:28.608+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command cr dump hook 0x7f047c091398 2024-09-19T11:56:29.012 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:56:28.608+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.012 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:56:28.608+0000 7f03697fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:56:29.012 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:56:28.608+0000 7f03697fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:56:29.012 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:56:28.608+0000 7f03697fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:56:29.012 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:56:28.608+0000 7f048b876640 10 monclient: get_auth_request con 0x55c4c3094df0 auth_method 0 2024-09-19T11:56:29.012 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:56:28.608+0000 7f048c077640 10 monclient: get_auth_request con 0x7f0354071c10 auth_method 0 2024-09-19T11:56:29.013 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.013 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 realm 2024-09-19T11:56:29.013 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.013 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.013 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:56:28.612+0000 7f048dd709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:29.013 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.013 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.013 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.013 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:56:28.612+0000 7f048b075640 10 monclient: get_auth_request con 0x55c4c3099000 auth_method 0 2024-09-19T11:56:29.013 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:29.013 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:56:28.612+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.013 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:56:28.612+0000 7f048c077640 10 monclient: get_auth_request con 0x55c4c309c840 auth_method 0 2024-09-19T11:56:29.013 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:56:28.616+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:29.014 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:56:28.616+0000 7f048dd709c0 20 searching for the correct realm 2024-09-19T11:56:29.014 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:56:28.616+0000 7f048b876640 10 monclient: get_auth_request con 0x55c4c30a1620 auth_method 0 2024-09-19T11:56:29.014 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:56:28.616+0000 7f048b075640 10 monclient: get_auth_request con 0x7f047c080050 auth_method 0 2024-09-19T11:56:29.014 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:56:28.616+0000 7f048c077640 10 monclient: get_auth_request con 0x7f0474034070 auth_method 0 2024-09-19T11:56:29.014 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:56:28.616+0000 7f048b876640 10 monclient: get_auth_request con 0x7f04840c7040 auth_method 0 2024-09-19T11:56:29.014 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:56:28.620+0000 7f048b876640 0 -- 172.21.15.120:0/128529382 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f04840c7040 msgr2=0x7f04840c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:29.014 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:56:28.824+0000 7f048b876640 10 monclient: get_auth_request con 0x7f04840c7040 auth_method 0 2024-09-19T11:56:29.014 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:56:28.836+0000 7f048b075640 10 monclient: get_auth_request con 0x7f047c01f060 auth_method 0 2024-09-19T11:56:29.014 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:56:28.836+0000 7f048b876640 0 -- 172.21.15.120:0/128529382 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f04840c7040 msgr2=0x7f04840c7420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:29.014 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:56:28.836+0000 7f03697fa640 1 client.6975.objecter ms_handle_reset 0x7f04840c7040 session 0x7f04840cb070 osd.4 2024-09-19T11:56:29.014 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:56:28.836+0000 7f03697fa640 10 monclient: _renew_subs 2024-09-19T11:56:29.014 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:56:28.836+0000 7f03697fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:56:29.015 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:56:28.836+0000 7f048b876640 10 monclient: get_auth_request con 0x7f0354082230 auth_method 0 2024-09-19T11:56:29.015 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:29.015 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:29.015 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:29.015 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:29.015 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:29.015 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:29.015 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.015 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.015 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:56:28.848+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.015 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:29.015 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.015 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:29.016 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 zone default found 2024-09-19T11:56:29.016 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:56:28.852+0000 7f048dd709c0 4 Realm: () 2024-09-19T11:56:29.016 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:56:28.852+0000 7f048dd709c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:29.016 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:56:28.852+0000 7f048dd709c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:29.016 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:56:28.852+0000 7f048dd709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:29.016 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 zonegroup default 2024-09-19T11:56:29.016 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.016 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.016 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.016 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.016 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.016 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.016 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 started sync module instance, tier type = 2024-09-19T11:56:29.016 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:56:28.852+0000 7f048dd709c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:29.017 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=0 2024-09-19T11:56:29.017 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=1 2024-09-19T11:56:29.017 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=2 2024-09-19T11:56:29.017 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=3 2024-09-19T11:56:29.017 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=4 2024-09-19T11:56:29.017 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=5 2024-09-19T11:56:29.017 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:56:28.876+0000 7f048dd709c0 20 add_watcher() i=6 2024-09-19T11:56:29.017 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:56:28.880+0000 7f048dd709c0 20 add_watcher() i=7 2024-09-19T11:56:29.017 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:56:28.880+0000 7f048dd709c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:29.017 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding auth protocol: cephx 2024-09-19T11:56:29.017 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding auth protocol: cephx 2024-09-19T11:56:29.017 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding auth protocol: cephx 2024-09-19T11:56:29.017 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: secure 2024-09-19T11:56:29.017 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: crc 2024-09-19T11:56:29.018 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: secure 2024-09-19T11:56:29.018 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: crc 2024-09-19T11:56:29.018 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: secure 2024-09-19T11:56:29.018 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: crc 2024-09-19T11:56:29.018 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: crc 2024-09-19T11:56:29.018 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: secure 2024-09-19T11:56:29.018 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: crc 2024-09-19T11:56:29.018 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: secure 2024-09-19T11:56:29.018 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:56:28.884+0000 7f0341fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:29.018 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: crc 2024-09-19T11:56:29.018 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 AuthRegistry(0x7ffd14fa9970) adding con mode: secure 2024-09-19T11:56:29.018 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:56:28.884+0000 7f048dd709c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:56:29.018 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:56:28.884+0000 7f048dd709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:29.018 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:56:28.884+0000 7f048dd709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:29.019 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command cache list hook 0x55c4c3078e10 2024-09-19T11:56:29.019 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command cache inspect hook 0x55c4c3078e10 2024-09-19T11:56:29.019 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command cache erase hook 0x55c4c3078e10 2024-09-19T11:56:29.019 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command cache zap hook 0x55c4c3078e10 2024-09-19T11:56:29.019 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 note: GC not initialized 2024-09-19T11:56:29.019 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:56:28.884+0000 7f0340fe1640 20 reqs_thread_entry: start 2024-09-19T11:56:29.019 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command sync trace show hook 0x7f047c061070 2024-09-19T11:56:29.019 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command sync trace history hook 0x7f047c061070 2024-09-19T11:56:29.019 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command sync trace active hook 0x7f047c061070 2024-09-19T11:56:29.019 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:56:28.884+0000 7f048dd709c0 5 asok(0x55c4c2d9ad90) register_command sync trace active_short hook 0x7f047c061070 2024-09-19T11:56:29.019 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:56:28.884+0000 7f048dd709c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:29.019 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:56:28.884+0000 7f048dd709c0 20 Filter name: none 2024-09-19T11:56:29.019 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:56:28.888+0000 7f02ba7fc640 20 reqs_thread_entry: start 2024-09-19T11:56:29.019 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-19T11:56:29.020 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:56:28.888+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.020 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:56:28.888+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:29.020 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T11:56:29.020 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-19T11:56:29.020 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 : miss 2024-09-19T11:56:29.020 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:56:28.888+0000 7f048dd709c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.020 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:56:28.888+0000 7f048dd709c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:56:29.020 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:56:29.020 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:56:29.020 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:56:29.020 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:29.020 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:56:28.888+0000 7f048dd709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 2024-09-19T11:56:29.020 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:56:28.900+0000 7f048dd709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:56:29.020 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:56:28.900+0000 7f048dd709c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:56:29.021 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:56:28.900+0000 7f048dd709c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:29.021 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:56:28.900+0000 7f048dd709c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28, ofs0, ns] 2024-09-19T11:56:29.021 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:56:28.900+0000 7f036affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366233 cookie 94303574186768 notifier 6975 bl.length()=1023 2024-09-19T11:56:29.021 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:56:28.900+0000 7f036affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:56:29.021 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:56:28.900+0000 7f036affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:56:29.021 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:56:28.900+0000 7f036affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:29.021 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:56:28.900+0000 7f048dd709c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): orig_sources= new_sources= 2024-09-19T11:56:29.021 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:56:28.900+0000 7f048dd709c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): potential sources added=[] removed=[] 2024-09-19T11:56:29.021 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:56:28.900+0000 7f048dd709c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): orig_dests= new_dests= 2024-09-19T11:56:29.021 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:56:28.900+0000 7f048dd709c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): potential dests added=[] removed=[] 2024-09-19T11:56:29.021 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:56:28.904+0000 7f048dd709c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f048dd709c0 time 2024-09-19T11:56:28.905183+0000 2024-09-19T11:56:29.021 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:56:29.021 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:29.021 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:56:29.022 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f049164a2eb] 2024-09-19T11:56:29.022 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f049164a49f] 2024-09-19T11:56:29.022 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c4c14eb271] 2024-09-19T11:56:29.022 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x141050e) [0x55c4c1f3c50e] 2024-09-19T11:56:29.022 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c4c14fb0dd] 2024-09-19T11:56:29.022 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:56:29.022 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f04904b0d90] 2024-09-19T11:56:29.022 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:56:29.022 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:56:29.022 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:29.022 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:56:28.904+0000 7f048dd709c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:56:29.022 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f048dd709c0 thread_name:radosgw-admin 2024-09-19T11:56:29.022 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:29.022 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:56:29.022 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f04904c9520] 2024-09-19T11:56:29.023 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:56:29.023 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:56:29.023 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:56:29.023 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f049164a345] 2024-09-19T11:56:29.023 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f049164a49f] 2024-09-19T11:56:29.023 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c4c14eb271] 2024-09-19T11:56:29.023 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x141050e) [0x55c4c1f3c50e] 2024-09-19T11:56:29.023 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c4c14fb0dd] 2024-09-19T11:56:29.023 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:56:29.023 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f04904b0d90] 2024-09-19T11:56:29.023 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:56:29.023 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:56:29.023 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:56:29.023 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:29.023 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:56:29.024 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:56:29.024 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:56:29.024 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:56:29.024 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:56:29.024 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:56:29.024 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:56:29.024 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:56:29.024 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:56:29.024 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:56:29.024 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:56:29.024 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:56:29.024 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:56:29.024 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:56:29.024 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:56:29.025 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:56:29.025 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:56:29.025 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:56:29.025 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:56:29.025 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:56:29.025 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:56:29.025 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:56:29.025 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:56:29.025 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:56:29.025 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:56:29.025 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:56:29.025 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:56:29.025 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:56:29.025 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:56:29.025 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:56:29.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:56:29.026 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:56:29.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:56:29.026 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:56:29.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:56:29.026 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:56:29.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:56:29.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:56:29.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:56:29.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:56:29.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:56:29.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:56:29.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:56:29.028 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:56:29.028 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:56:29.028 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:56:29.028 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:56:29.028 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:56:29.028 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:56:29.028 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:56:29.028 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:56:29.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:56:29.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:56:29.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:56:29.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:56:29.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:56:29.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:56:29.029 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:56:29.029 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:56:29.029 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:56:29.029 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:56:29.029 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:56:29.029 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:56:29.029 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:56:29.029 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:56:29.029 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:56:29.029 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:56:29.029 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:56:29.029 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:56:29.029 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:56:29.030 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:56:29.030 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:56:29.037 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:56:29.037 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:56:29.037 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:56:29.037 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:56:29.037 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:56:29.037 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:56:29.038 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:56:29.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f02ba7fc640 / http_manager 2024-09-19T11:56:29.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0340fe1640 / http_manager 2024-09-19T11:56:29.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0341fe3640 / rgw_dt_lg_renew 2024-09-19T11:56:29.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f03697fa640 / ms_dispatch 2024-09-19T11:56:29.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f036affd640 / io_context_pool 2024-09-19T11:56:29.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f03717fa640 / ms_dispatch 2024-09-19T11:56:29.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0373fff640 / ms_dispatch 2024-09-19T11:56:29.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0379e0b640 / io_context_pool 2024-09-19T11:56:29.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f048b075640 / msgr-worker-2 2024-09-19T11:56:29.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f048b876640 / msgr-worker-1 2024-09-19T11:56:29.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f048c077640 / msgr-worker-0 2024-09-19T11:56:29.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f048c878640 / io_context_pool 2024-09-19T11:56:29.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f048dd709c0 / radosgw-admin 2024-09-19T11:56:29.039 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:56:29.039 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:56:29.039 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/lib/ceph/crash/2024-09-19T11:56:28.908510Z_b2e86722-7b83-4ecd-9d86-4add4af9b23a/log 2024-09-19T11:56:29.039 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:56:29.040 INFO:tasks.workunit.client.0.smithi120.stderr:Aborted 2024-09-19T11:56:29.040 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-19T11:56:29.040 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:56:29.040 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:56:29.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.204+0000 7feff1c9a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.208+0000 7feff1c9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.208+0000 7feff1c9a9c0 20 realm 2024-09-19T11:56:29.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.208+0000 7feff1c9a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.208+0000 7feff1c9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.208+0000 7feff1c9a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:29.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.208+0000 7feff1c9a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.208+0000 7feff1c9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.208+0000 7feff1c9a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.208+0000 7feff1c9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:29.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.208+0000 7feff1c9a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.212+0000 7feff1c9a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:29.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.212+0000 7feff1c9a9c0 20 searching for the correct realm 2024-09-19T11:56:29.212 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.216+0000 7fefeffa1640 0 -- 172.21.15.120:0/1065149530 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x55c232b57810 msgr2=0x7fefe40fec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:29.220 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.224+0000 7fefeef9f640 0 -- 172.21.15.120:0/1065149530 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fefe0066a20 msgr2=0x7fefe00779e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:56:29.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.440+0000 7feff1c9a9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:29.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.440+0000 7feff1c9a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:29.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.440+0000 7feff1c9a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:29.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.440+0000 7feff1c9a9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:29.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.440+0000 7feff1c9a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:29.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.440+0000 7feff1c9a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:29.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.440+0000 7feff1c9a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.440+0000 7feff1c9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.440+0000 7feff1c9a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:29.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:29.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 20 zone default found 2024-09-19T11:56:29.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 4 Realm: () 2024-09-19T11:56:29.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:29.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:29.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:29.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 20 zonegroup default 2024-09-19T11:56:29.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 20 started sync module instance, tier type = 2024-09-19T11:56:29.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.444+0000 7feff1c9a9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:29.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.484+0000 7feff1c9a9c0 20 add_watcher() i=0 2024-09-19T11:56:29.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.484+0000 7feff1c9a9c0 20 add_watcher() i=1 2024-09-19T11:56:29.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.484+0000 7feff1c9a9c0 20 add_watcher() i=2 2024-09-19T11:56:29.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.484+0000 7feff1c9a9c0 20 add_watcher() i=3 2024-09-19T11:56:29.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.484+0000 7feff1c9a9c0 20 add_watcher() i=4 2024-09-19T11:56:29.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.484+0000 7feff1c9a9c0 20 add_watcher() i=5 2024-09-19T11:56:29.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.484+0000 7feff1c9a9c0 20 add_watcher() i=6 2024-09-19T11:56:29.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.484+0000 7feff1c9a9c0 20 add_watcher() i=7 2024-09-19T11:56:29.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.484+0000 7feff1c9a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:29.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.488+0000 7feea5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:29.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.492+0000 7feff1c9a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:29.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.492+0000 7feff1c9a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:29.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.492+0000 7feff1c9a9c0 5 note: GC not initialized 2024-09-19T11:56:29.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.492+0000 7feea4fe1640 20 reqs_thread_entry: start 2024-09-19T11:56:29.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.492+0000 7feff1c9a9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:29.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.492+0000 7feff1c9a9c0 20 Filter name: none 2024-09-19T11:56:29.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.492+0000 7fee1e7fc640 20 reqs_thread_entry: start 2024-09-19T11:56:29.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.492+0000 7feff1c9a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.492+0000 7feff1c9a9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:29.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.492+0000 7feff1c9a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.496+0000 7feff1c9a9c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-19T11:56:29.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.496+0000 7feff1c9a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:29.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.496+0000 7feff1c9a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.496+0000 7feff1c9a9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:29.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.496+0000 7feff1c9a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.496+0000 7feff1c9a9c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-19T11:56:29.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.496+0000 7feff1c9a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:56:29.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.500+0000 7feea5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:29.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.504+0000 7feff1c9a9c0 20 remove_watcher() i=0 2024-09-19T11:56:29.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.504+0000 7feff1c9a9c0 2 removed watcher, disabling cache 2024-09-19T11:56:29.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.508+0000 7feff1c9a9c0 20 remove_watcher() i=1 2024-09-19T11:56:29.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.508+0000 7feff1c9a9c0 20 remove_watcher() i=2 2024-09-19T11:56:29.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.512+0000 7feff1c9a9c0 20 remove_watcher() i=3 2024-09-19T11:56:29.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.512+0000 7feff1c9a9c0 20 remove_watcher() i=4 2024-09-19T11:56:29.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.516+0000 7feff1c9a9c0 20 remove_watcher() i=5 2024-09-19T11:56:29.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.516+0000 7feff1c9a9c0 20 remove_watcher() i=6 2024-09-19T11:56:29.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.516+0000 7feff1c9a9c0 20 remove_watcher() i=7 2024-09-19T11:56:29.530 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:29.530 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:56:29.530 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-trim-reshard-log-entries id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:56:29.530 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:56:29.585 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:56:29.621 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:56:29.621 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:56:29.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.672+0000 7fcb2e2969c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.672+0000 7fcb2e2969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.672+0000 7fcb2e2969c0 20 realm 2024-09-19T11:56:29.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.672+0000 7fcb2e2969c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.672+0000 7fcb2e2969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.672+0000 7fcb2e2969c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:56:29.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.672+0000 7fcb2e2969c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.672+0000 7fcb2e2969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.672+0000 7fcb2e2969c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.673 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.676+0000 7fcb2e2969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:29.673 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.676+0000 7fcb2e2969c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.676+0000 7fcb2e2969c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:56:29.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.676+0000 7fcb2e2969c0 20 searching for the correct realm 2024-09-19T11:56:29.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.680+0000 7fcb2bd9c640 0 -- 172.21.15.120:0/3012309483 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fcb2400e070 msgr2=0x7fcb24071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:29.894 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.896+0000 7fcb2bd9c640 0 -- 172.21.15.120:0/3012309483 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fcb2400e070 msgr2=0x7fcb24071c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:56:29.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:56:29.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:56:29.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:56:29.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:56:29.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:56:29.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:56:29.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:56:29.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:56:29.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 zone default found 2024-09-19T11:56:29.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 4 Realm: () 2024-09-19T11:56:29.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:56:29.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:56:29.907 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:56:29.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 zonegroup default 2024-09-19T11:56:29.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.908+0000 7fcb2e2969c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.912+0000 7fcb2e2969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.912+0000 7fcb2e2969c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.912+0000 7fcb2e2969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:56:29.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.912+0000 7fcb2e2969c0 20 started sync module instance, tier type = 2024-09-19T11:56:29.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.912+0000 7fcb2e2969c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:56:29.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.932+0000 7fcb2e2969c0 20 add_watcher() i=0 2024-09-19T11:56:29.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.932+0000 7fcb2e2969c0 20 add_watcher() i=1 2024-09-19T11:56:29.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.932+0000 7fcb2e2969c0 20 add_watcher() i=2 2024-09-19T11:56:29.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.932+0000 7fcb2e2969c0 20 add_watcher() i=3 2024-09-19T11:56:29.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.932+0000 7fcb2e2969c0 20 add_watcher() i=4 2024-09-19T11:56:29.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.932+0000 7fcb2e2969c0 20 add_watcher() i=5 2024-09-19T11:56:29.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.932+0000 7fcb2e2969c0 20 add_watcher() i=6 2024-09-19T11:56:29.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.932+0000 7fcb2e2969c0 20 add_watcher() i=7 2024-09-19T11:56:29.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.932+0000 7fcb2e2969c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:56:29.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.936+0000 7fc9e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:29.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:56:29.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:56:29.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 5 note: GC not initialized 2024-09-19T11:56:29.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fc9e0fe1640 20 reqs_thread_entry: start 2024-09-19T11:56:29.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 20 init_complete bucket index max shards: 1 2024-09-19T11:56:29.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 20 Filter name: none 2024-09-19T11:56:29.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fc95a7fc640 20 reqs_thread_entry: start 2024-09-19T11:56:29.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-19T11:56:29.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:56:29.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T11:56:29.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-19T11:56:29.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 : miss 2024-09-19T11:56:29.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 20 rados->read ofs=0 len=0 2024-09-19T11:56:29.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-19T11:56:29.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:56:29.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:56:29.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:56:29.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:56:29.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.940+0000 7fcb2e2969c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 2024-09-19T11:56:29.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.944+0000 7fcb2e2969c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to be held by another RGW process; skipping for now 2024-09-19T11:56:29.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.948+0000 7fc9e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:56:29.949 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.952+0000 7fcb2e2969c0 20 remove_watcher() i=0 2024-09-19T11:56:29.949 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.952+0000 7fcb2e2969c0 2 removed watcher, disabling cache 2024-09-19T11:56:29.951 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.952+0000 7fcb2e2969c0 20 remove_watcher() i=1 2024-09-19T11:56:29.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.956+0000 7fcb2e2969c0 20 remove_watcher() i=2 2024-09-19T11:56:29.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.960+0000 7fcb2e2969c0 20 remove_watcher() i=3 2024-09-19T11:56:29.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.960+0000 7fcb2e2969c0 20 remove_watcher() i=4 2024-09-19T11:56:29.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.964+0000 7fcb2e2969c0 20 remove_watcher() i=5 2024-09-19T11:56:29.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.964+0000 7fcb2e2969c0 20 remove_watcher() i=6 2024-09-19T11:56:29.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:56:29.964+0000 7fcb2e2969c0 20 remove_watcher() i=7 2024-09-19T11:56:29.987 INFO:tasks.workunit.client.0.smithi120.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T11:57:00.017 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:57:00.054 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:00.054 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:00.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.100+0000 7fc9e1e339c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:00.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.104+0000 7fc9e1e339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:00.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.104+0000 7fc9e1e339c0 20 realm 2024-09-19T11:57:00.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.104+0000 7fc9e1e339c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:00.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.104+0000 7fc9e1e339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:00.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.104+0000 7fc9e1e339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:00.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.104+0000 7fc9e1e339c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:00.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.104+0000 7fc9e1e339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:00.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.104+0000 7fc9e1e339c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:00.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.104+0000 7fc9e1e339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:00.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.104+0000 7fc9e1e339c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:00.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.108+0000 7fc9e1e339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:00.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.108+0000 7fc9e1e339c0 20 searching for the correct realm 2024-09-19T11:57:00.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.312+0000 7fc9e013a640 0 -- 172.21.15.120:0/2318649771 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fc9d00d2070 msgr2=0x7fc9d00e0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:00.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.728+0000 7fc9df138640 0 -- 172.21.15.120:0/2318649771 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fc9c8008040 msgr2=0x7fc9c8053670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:57:00.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.944+0000 7fc9e1e339c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:00.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.944+0000 7fc9e1e339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:00.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.944+0000 7fc9e1e339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:00.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.944+0000 7fc9e1e339c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:00.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.944+0000 7fc9e1e339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:00.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.944+0000 7fc9e1e339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:00.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.944+0000 7fc9e1e339c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:00.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.944+0000 7fc9e1e339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:00.943 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.944+0000 7fc9e1e339c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:00.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:00.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:00.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:00.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 20 zone default found 2024-09-19T11:57:00.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 4 Realm: () 2024-09-19T11:57:00.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:00.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:00.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:00.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 20 zonegroup default 2024-09-19T11:57:00.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:00.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:00.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:00.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:00.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:00.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:00.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 20 started sync module instance, tier type = 2024-09-19T11:57:00.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.948+0000 7fc9e1e339c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:00.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.976+0000 7fc9e1e339c0 20 add_watcher() i=0 2024-09-19T11:57:00.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.976+0000 7fc9e1e339c0 20 add_watcher() i=1 2024-09-19T11:57:00.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.976+0000 7fc9e1e339c0 20 add_watcher() i=2 2024-09-19T11:57:00.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.976+0000 7fc9e1e339c0 20 add_watcher() i=3 2024-09-19T11:57:00.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.976+0000 7fc9e1e339c0 20 add_watcher() i=4 2024-09-19T11:57:00.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.976+0000 7fc9e1e339c0 20 add_watcher() i=5 2024-09-19T11:57:00.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.976+0000 7fc9e1e339c0 20 add_watcher() i=6 2024-09-19T11:57:00.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.976+0000 7fc9e1e339c0 20 add_watcher() i=7 2024-09-19T11:57:00.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.976+0000 7fc9e1e339c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:00.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.980+0000 7fc895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:00.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.980+0000 7fc9e1e339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:00.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.980+0000 7fc9e1e339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:00.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.980+0000 7fc9e1e339c0 5 note: GC not initialized 2024-09-19T11:57:00.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc894fe1640 20 reqs_thread_entry: start 2024-09-19T11:57:00.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc9e1e339c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:00.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc9e1e339c0 20 Filter name: none 2024-09-19T11:57:00.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc80e7fc640 20 reqs_thread_entry: start 2024-09-19T11:57:00.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc9e1e339c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-19T11:57:00.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc9e1e339c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:00.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc9e1e339c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:57:00.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc9e1e339c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T11:57:00.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc9e1e339c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-19T11:57:00.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc9e1e339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 : miss 2024-09-19T11:57:00.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc9e1e339c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:00.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc9e1e339c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-19T11:57:00.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc9e1e339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:57:00.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc9e1e339c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:57:00.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc9e1e339c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:57:00.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc9e1e339c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:00.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.984+0000 7fc9e1e339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 2024-09-19T11:57:00.988 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.988+0000 7fc9e1e339c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T11:57:00.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.996+0000 7fc9e1e339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:57:00.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.996+0000 7fc9e1e339c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:57:00.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.996+0000 7fc9e1e339c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:00.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.996+0000 7fc9e1e339c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28, ofs0, ns] 2024-09-19T11:57:00.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.996+0000 7fc8beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366234 cookie 94370776762112 notifier 7032 bl.length()=1023 2024-09-19T11:57:00.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.996+0000 7fc8beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:57:00.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.996+0000 7fc8beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:57:00.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.996+0000 7fc8beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:00.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.996+0000 7fc9e1e339c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): orig_sources= new_sources= 2024-09-19T11:57:00.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.996+0000 7fc9e1e339c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): potential sources added=[] removed=[] 2024-09-19T11:57:00.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.996+0000 7fc9e1e339c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): orig_dests= new_dests= 2024-09-19T11:57:00.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:00.996+0000 7fc9e1e339c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): potential dests added=[] removed=[] 2024-09-19T11:57:00.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.000+0000 7fc9e1e339c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28.2.0 2024-09-19T11:57:00.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.000+0000 7fc9e1e339c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28.2.0 2024-09-19T11:57:00.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.000+0000 7fc9e1e339c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28.2.1 2024-09-19T11:57:00.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.000+0000 7fc9e1e339c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28.2.1 2024-09-19T11:57:00.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.000+0000 7fc9e1e339c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28.0 2024-09-19T11:57:01.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.004+0000 7fc9e1e339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:01.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.004+0000 7fc9e1e339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 2024-09-19T11:57:01.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.008+0000 7fc9e1e339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:57:01.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.008+0000 7fc9e1e339c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:57:01.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.008+0000 7fc9e1e339c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:01.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.008+0000 7fc9e1e339c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28, ofs0, ns] 2024-09-19T11:57:01.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.008+0000 7fc8beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366235 cookie 94370776762112 notifier 7032 bl.length()=1023 2024-09-19T11:57:01.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.008+0000 7fc8beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:57:01.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.008+0000 7fc8beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:57:01.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.008+0000 7fc8beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:01.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.012+0000 7fc9e1e339c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): orig_sources= new_sources= 2024-09-19T11:57:01.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.012+0000 7fc9e1e339c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): potential sources added=[] removed=[] 2024-09-19T11:57:01.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.012+0000 7fc9e1e339c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): orig_dests= new_dests= 2024-09-19T11:57:01.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.012+0000 7fc9e1e339c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): potential dests added=[] removed=[] 2024-09-19T11:57:01.010 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.012+0000 7fc9e1e339c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28.0 2024-09-19T11:57:01.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.012+0000 7fc9e1e339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:01.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.012+0000 7fc9e1e339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 2024-09-19T11:57:01.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.016+0000 7fc9e1e339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:57:01.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.016+0000 7fc9e1e339c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:57:01.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.016+0000 7fc9e1e339c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:01.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.016+0000 7fc9e1e339c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28, ofs0, ns] 2024-09-19T11:57:01.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.016+0000 7fc8be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366236 cookie 94370776762112 notifier 7032 bl.length()=991 2024-09-19T11:57:01.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.016+0000 7fc8be7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 info.flags=0x17 2024-09-19T11:57:01.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.016+0000 7fc8be7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 to cache LRU end 2024-09-19T11:57:01.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.016+0000 7fc8be7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:01.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.020+0000 7fc9e1e339c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): orig_sources= new_sources= 2024-09-19T11:57:01.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.020+0000 7fc9e1e339c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): potential sources added=[] removed=[] 2024-09-19T11:57:01.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.020+0000 7fc9e1e339c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): orig_dests= new_dests= 2024-09-19T11:57:01.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.020+0000 7fc9e1e339c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28]): potential dests added=[] removed=[] 2024-09-19T11:57:01.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.020+0000 7fc9e1e339c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-19T11:57:01.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.024+0000 7fc895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:01.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.028+0000 7fc9e1e339c0 20 remove_watcher() i=0 2024-09-19T11:57:01.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.028+0000 7fc9e1e339c0 2 removed watcher, disabling cache 2024-09-19T11:57:01.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.032+0000 7fc9e1e339c0 20 remove_watcher() i=1 2024-09-19T11:57:01.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.032+0000 7fc9e1e339c0 20 remove_watcher() i=2 2024-09-19T11:57:01.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.036+0000 7fc9e1e339c0 20 remove_watcher() i=3 2024-09-19T11:57:01.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.036+0000 7fc9e1e339c0 20 remove_watcher() i=4 2024-09-19T11:57:01.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.040+0000 7fc9e1e339c0 20 remove_watcher() i=5 2024-09-19T11:57:01.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.040+0000 7fc9e1e339c0 20 remove_watcher() i=6 2024-09-19T11:57:01.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.040+0000 7fc9e1e339c0 20 remove_watcher() i=7 2024-09-19T11:57:01.053 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-19T11:57:01.085 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:01.085 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:01.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.132+0000 7ff5861e99c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:01.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.132+0000 7ff5861e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:01.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.132+0000 7ff5861e99c0 20 realm 2024-09-19T11:57:01.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.132+0000 7ff5861e99c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:01.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.132+0000 7ff5861e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:01.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.132+0000 7ff5861e99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:01.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.132+0000 7ff5861e99c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:01.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.132+0000 7ff5861e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:01.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.132+0000 7ff5861e99c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:01.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.136+0000 7ff5861e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:01.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.136+0000 7ff5861e99c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:01.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.136+0000 7ff5861e99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:01.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.136+0000 7ff5861e99c0 20 searching for the correct realm 2024-09-19T11:57:01.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.140+0000 7ff583cef640 0 -- 172.21.15.120:0/2030017670 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff57c102060 msgr2=0x7ff57c108a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:01.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.356+0000 7ff583cef640 0 -- 172.21.15.120:0/2030017670 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff57c102060 msgr2=0x7ff57c108a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:01.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:01.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:01.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:01.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:01.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:01.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:01.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:01.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:01.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:01.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:01.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:01.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:01.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 20 zone default found 2024-09-19T11:57:01.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 4 Realm: () 2024-09-19T11:57:01.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:01.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:01.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:01.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 20 zonegroup default 2024-09-19T11:57:01.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.368+0000 7ff5861e99c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:01.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.372+0000 7ff5861e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:01.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.372+0000 7ff5861e99c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:01.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.372+0000 7ff5861e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:01.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.372+0000 7ff5861e99c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:01.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.372+0000 7ff5861e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:01.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.372+0000 7ff5861e99c0 20 started sync module instance, tier type = 2024-09-19T11:57:01.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.372+0000 7ff5861e99c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:01.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.396+0000 7ff5861e99c0 20 add_watcher() i=0 2024-09-19T11:57:01.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.396+0000 7ff5861e99c0 20 add_watcher() i=1 2024-09-19T11:57:01.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.396+0000 7ff5861e99c0 20 add_watcher() i=2 2024-09-19T11:57:01.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.396+0000 7ff5861e99c0 20 add_watcher() i=3 2024-09-19T11:57:01.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.396+0000 7ff5861e99c0 20 add_watcher() i=4 2024-09-19T11:57:01.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.396+0000 7ff5861e99c0 20 add_watcher() i=5 2024-09-19T11:57:01.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.396+0000 7ff5861e99c0 20 add_watcher() i=6 2024-09-19T11:57:01.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.396+0000 7ff5861e99c0 20 add_watcher() i=7 2024-09-19T11:57:01.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.396+0000 7ff5861e99c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:01.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.400+0000 7ff439fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:01.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.400+0000 7ff5861e99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:01.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.400+0000 7ff5861e99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:01.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.400+0000 7ff5861e99c0 5 note: GC not initialized 2024-09-19T11:57:01.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.404+0000 7ff438fe1640 20 reqs_thread_entry: start 2024-09-19T11:57:01.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.404+0000 7ff5861e99c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:01.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.404+0000 7ff5861e99c0 20 Filter name: none 2024-09-19T11:57:01.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.404+0000 7ff3b27fc640 20 reqs_thread_entry: start 2024-09-19T11:57:01.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.404+0000 7ff5861e99c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:01.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.404+0000 7ff5861e99c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:57:01.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.404+0000 7ff5861e99c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:01.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.404+0000 7ff5861e99c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:57:01.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.404+0000 7ff5861e99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:01.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.404+0000 7ff5861e99c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:01.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.408+0000 7ff5861e99c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T11:57:01.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.408+0000 7ff5861e99c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:01.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.408+0000 7ff5861e99c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T11:57:01.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.408+0000 7ff5861e99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:01.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.408+0000 7ff439fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:01.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.416+0000 7ff5861e99c0 20 remove_watcher() i=0 2024-09-19T11:57:01.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.416+0000 7ff5861e99c0 2 removed watcher, disabling cache 2024-09-19T11:57:01.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.416+0000 7ff5861e99c0 20 remove_watcher() i=1 2024-09-19T11:57:01.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.420+0000 7ff5861e99c0 20 remove_watcher() i=2 2024-09-19T11:57:01.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.420+0000 7ff5861e99c0 20 remove_watcher() i=3 2024-09-19T11:57:01.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.424+0000 7ff5861e99c0 20 remove_watcher() i=4 2024-09-19T11:57:01.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.424+0000 7ff5861e99c0 20 remove_watcher() i=5 2024-09-19T11:57:01.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.428+0000 7ff5861e99c0 20 remove_watcher() i=6 2024-09-19T11:57:01.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:01.428+0000 7ff5861e99c0 20 remove_watcher() i=7 2024-09-19T11:57:01.440 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:01.441 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:57:01.441 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-trim-reshard-log-entries id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T11:57:01.441 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:01.519 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-19T11:57:01.520 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:02.011 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-19T11:57:02.044 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:02.044 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:02.091 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.091+0000 7f5eaa1349c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.095+0000 7f5eaa1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.095+0000 7f5eaa1349c0 20 realm 2024-09-19T11:57:02.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.095+0000 7f5eaa1349c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.095+0000 7f5eaa1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.095+0000 7f5eaa1349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:02.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.095+0000 7f5eaa1349c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.095+0000 7f5eaa1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.095+0000 7f5eaa1349c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.095+0000 7f5eaa1349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:02.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.095+0000 7f5eaa1349c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.099+0000 7f5eaa1349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:02.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.099+0000 7f5eaa1349c0 20 searching for the correct realm 2024-09-19T11:57:02.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.099+0000 7f5ea7439640 0 -- 172.21.15.120:0/4091995127 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7f5e9801c040 msgr2=0x7f5e980638e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:02.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.311+0000 7f5ea843b640 0 -- 172.21.15.120:0/4091995127 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f5e9c0ca670 msgr2=0x7f5e9c0e8410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:02.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:02.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:02.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:02.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:02.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:02.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:02.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:02.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:02.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 zone default found 2024-09-19T11:57:02.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 4 Realm: () 2024-09-19T11:57:02.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:02.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:02.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:02.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 zonegroup default 2024-09-19T11:57:02.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.331+0000 7f5eaa1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.335+0000 7f5eaa1349c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.335+0000 7f5eaa1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.335+0000 7f5eaa1349c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.335+0000 7f5eaa1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.335+0000 7f5eaa1349c0 20 started sync module instance, tier type = 2024-09-19T11:57:02.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.335+0000 7f5eaa1349c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:02.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.359+0000 7f5eaa1349c0 20 add_watcher() i=0 2024-09-19T11:57:02.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.359+0000 7f5eaa1349c0 20 add_watcher() i=1 2024-09-19T11:57:02.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.359+0000 7f5eaa1349c0 20 add_watcher() i=2 2024-09-19T11:57:02.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.359+0000 7f5eaa1349c0 20 add_watcher() i=3 2024-09-19T11:57:02.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.359+0000 7f5eaa1349c0 20 add_watcher() i=4 2024-09-19T11:57:02.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.359+0000 7f5eaa1349c0 20 add_watcher() i=5 2024-09-19T11:57:02.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.359+0000 7f5eaa1349c0 20 add_watcher() i=6 2024-09-19T11:57:02.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.363+0000 7f5eaa1349c0 20 add_watcher() i=7 2024-09-19T11:57:02.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.363+0000 7f5eaa1349c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:02.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.367+0000 7f5d5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:02.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.367+0000 7f5eaa1349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:02.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.367+0000 7f5eaa1349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:02.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.367+0000 7f5eaa1349c0 5 note: GC not initialized 2024-09-19T11:57:02.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.367+0000 7f5d5cfe1640 20 reqs_thread_entry: start 2024-09-19T11:57:02.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.367+0000 7f5eaa1349c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:02.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.367+0000 7f5eaa1349c0 20 Filter name: none 2024-09-19T11:57:02.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.367+0000 7f5cd67fc640 20 reqs_thread_entry: start 2024-09-19T11:57:02.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.367+0000 7f5eaa1349c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.371+0000 7f5eaa1349c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:02.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.371+0000 7f5eaa1349c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.371+0000 7f5eaa1349c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T11:57:02.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.371+0000 7f5eaa1349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:02.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.371+0000 7f5eaa1349c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.371+0000 7f5eaa1349c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:02.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.371+0000 7f5eaa1349c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.371+0000 7f5eaa1349c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T11:57:02.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.371+0000 7f5eaa1349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:02.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.375+0000 7f5d5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:02.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.379+0000 7f5eaa1349c0 20 remove_watcher() i=0 2024-09-19T11:57:02.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.379+0000 7f5eaa1349c0 2 removed watcher, disabling cache 2024-09-19T11:57:02.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.383+0000 7f5eaa1349c0 20 remove_watcher() i=1 2024-09-19T11:57:02.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.383+0000 7f5eaa1349c0 20 remove_watcher() i=2 2024-09-19T11:57:02.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.387+0000 7f5eaa1349c0 20 remove_watcher() i=3 2024-09-19T11:57:02.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.387+0000 7f5eaa1349c0 20 remove_watcher() i=4 2024-09-19T11:57:02.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.391+0000 7f5eaa1349c0 20 remove_watcher() i=5 2024-09-19T11:57:02.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.391+0000 7f5eaa1349c0 20 remove_watcher() i=6 2024-09-19T11:57:02.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.391+0000 7f5eaa1349c0 20 remove_watcher() i=7 2024-09-19T11:57:02.409 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:02.409 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:57:02.410 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-block-writes id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:57:02.410 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:02.410 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-19T11:57:02.448 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:02.448 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:02.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.495+0000 7f31d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.495+0000 7f31d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.495+0000 7f31d7db79c0 20 realm 2024-09-19T11:57:02.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.495+0000 7f31d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.495+0000 7f31d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.495+0000 7f31d7db79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:02.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.495+0000 7f31d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.495+0000 7f31d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.495+0000 7f31d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.499+0000 7f31d7db79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:02.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.499+0000 7f31d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.499+0000 7f31d7db79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:02.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.499+0000 7f31d7db79c0 20 searching for the correct realm 2024-09-19T11:57:02.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.503+0000 7f31d60be640 0 -- 172.21.15.120:0/1896838132 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f31cc0c1020 msgr2=0x7f31cc114880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:02.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.511+0000 7f31d50bc640 0 -- 172.21.15.120:0/1896838132 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f31c801a040 msgr2=0x7f31c807b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:02.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.727+0000 7f31d7db79c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:02.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.727+0000 7f31d7db79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:02.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.727+0000 7f31d7db79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:02.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.727+0000 7f31d7db79c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:02.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.727+0000 7f31d7db79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:02.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.727+0000 7f31d7db79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:02.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.727+0000 7f31d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.727+0000 7f31d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.727+0000 7f31d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:02.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:02.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 20 zone default found 2024-09-19T11:57:02.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 4 Realm: () 2024-09-19T11:57:02.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:02.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:02.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:02.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 20 zonegroup default 2024-09-19T11:57:02.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 20 started sync module instance, tier type = 2024-09-19T11:57:02.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.731+0000 7f31d7db79c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:02.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.751+0000 7f31d7db79c0 20 add_watcher() i=0 2024-09-19T11:57:02.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.751+0000 7f31d7db79c0 20 add_watcher() i=1 2024-09-19T11:57:02.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.751+0000 7f31d7db79c0 20 add_watcher() i=2 2024-09-19T11:57:02.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.751+0000 7f31d7db79c0 20 add_watcher() i=3 2024-09-19T11:57:02.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.751+0000 7f31d7db79c0 20 add_watcher() i=4 2024-09-19T11:57:02.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.751+0000 7f31d7db79c0 20 add_watcher() i=5 2024-09-19T11:57:02.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.751+0000 7f31d7db79c0 20 add_watcher() i=6 2024-09-19T11:57:02.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.755+0000 7f31d7db79c0 20 add_watcher() i=7 2024-09-19T11:57:02.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.755+0000 7f31d7db79c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:02.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.759+0000 7f30877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:02.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.759+0000 7f31d7db79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:02.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.759+0000 7f31d7db79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:02.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.759+0000 7f31d7db79c0 5 note: GC not initialized 2024-09-19T11:57:02.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.759+0000 7f30867fc640 20 reqs_thread_entry: start 2024-09-19T11:57:02.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.759+0000 7f31d7db79c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:02.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.759+0000 7f31d7db79c0 20 Filter name: none 2024-09-19T11:57:02.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.763+0000 7f2ff7fff640 20 reqs_thread_entry: start 2024-09-19T11:57:02.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.763+0000 7f31d7db79c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-19T11:57:02.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.763+0000 7f31d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.763+0000 7f31d7db79c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:02.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.763+0000 7f31d7db79c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-19T11:57:02.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.763+0000 7f31d7db79c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-19T11:57:02.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.763+0000 7f31d7db79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 : miss 2024-09-19T11:57:02.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.763+0000 7f31d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.763+0000 7f31d7db79c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T11:57:02.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.763+0000 7f31d7db79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 info.flags=0x17 2024-09-19T11:57:02.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.763+0000 7f31d7db79c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 to cache LRU end 2024-09-19T11:57:02.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.763+0000 7f31d7db79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:57:02.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.763+0000 7f31d7db79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:02.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.763+0000 7f31d7db79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 2024-09-19T11:57:02.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.771+0000 7f31d7db79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 info.flags=0x17 2024-09-19T11:57:02.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.771+0000 7f31d7db79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 to cache LRU end 2024-09-19T11:57:02.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.771+0000 7f31d7db79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:02.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.771+0000 7f31d7db79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29, ofs0, ns] 2024-09-19T11:57:02.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.771+0000 7f30b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366216 cookie 93871814048208 notifier 7083 bl.length()=999 2024-09-19T11:57:02.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.771+0000 7f30b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 info.flags=0x17 2024-09-19T11:57:02.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.771+0000 7f30b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 to cache LRU end 2024-09-19T11:57:02.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.771+0000 7f30b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:02.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.771+0000 7f31d7db79c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): orig_sources= new_sources= 2024-09-19T11:57:02.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.771+0000 7f31d7db79c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): potential sources added=[] removed=[] 2024-09-19T11:57:02.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.771+0000 7f31d7db79c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): orig_dests= new_dests= 2024-09-19T11:57:02.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.771+0000 7f31d7db79c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): potential dests added=[] removed=[] 2024-09-19T11:57:02.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.775+0000 7f31d7db79c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29.1.0 2024-09-19T11:57:02.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.775+0000 7f31d7db79c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29.1.0 2024-09-19T11:57:02.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.775+0000 7f31d7db79c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29.1.1 2024-09-19T11:57:02.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.775+0000 7f31d7db79c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29.1.1 2024-09-19T11:57:02.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.775+0000 7f31d7db79c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29.0 2024-09-19T11:57:02.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.783+0000 7f31d7db79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:02.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.783+0000 7f31d7db79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 2024-09-19T11:57:02.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.783+0000 7f31d7db79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 info.flags=0x17 2024-09-19T11:57:02.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.783+0000 7f31d7db79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 to cache LRU end 2024-09-19T11:57:02.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.783+0000 7f31d7db79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:02.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.783+0000 7f31d7db79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29, ofs0, ns] 2024-09-19T11:57:02.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.783+0000 7f30b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366217 cookie 93871814048208 notifier 7083 bl.length()=999 2024-09-19T11:57:02.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.783+0000 7f30b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 info.flags=0x17 2024-09-19T11:57:02.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.783+0000 7f30b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 to cache LRU end 2024-09-19T11:57:02.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.783+0000 7f30b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:02.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.787+0000 7f31d7db79c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): orig_sources= new_sources= 2024-09-19T11:57:02.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.787+0000 7f31d7db79c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): potential sources added=[] removed=[] 2024-09-19T11:57:02.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.787+0000 7f31d7db79c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): orig_dests= new_dests= 2024-09-19T11:57:02.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.787+0000 7f31d7db79c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): potential dests added=[] removed=[] 2024-09-19T11:57:02.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.787+0000 7f31d7db79c0 -1 Injecting error=-5 at location=block_writes 2024-09-19T11:57:02.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.787+0000 7f31d7db79c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-19T11:57:02.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.791+0000 7f31d7db79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:02.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.791+0000 7f31d7db79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 2024-09-19T11:57:02.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.791+0000 7f31d7db79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 info.flags=0x17 2024-09-19T11:57:02.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.791+0000 7f31d7db79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 to cache LRU end 2024-09-19T11:57:02.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.791+0000 7f31d7db79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:02.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.791+0000 7f31d7db79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29, ofs0, ns] 2024-09-19T11:57:02.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.795+0000 7f30b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366218 cookie 93871814048208 notifier 7083 bl.length()=967 2024-09-19T11:57:02.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.795+0000 7f30b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 info.flags=0x17 2024-09-19T11:57:02.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.795+0000 7f30b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 to cache LRU end 2024-09-19T11:57:02.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.795+0000 7f30b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:02.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.795+0000 7f31d7db79c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): orig_sources= new_sources= 2024-09-19T11:57:02.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.795+0000 7f31d7db79c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): potential sources added=[] removed=[] 2024-09-19T11:57:02.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.795+0000 7f31d7db79c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): orig_dests= new_dests= 2024-09-19T11:57:02.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.795+0000 7f31d7db79c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): potential dests added=[] removed=[] 2024-09-19T11:57:02.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.795+0000 7f31d7db79c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-19T11:57:02.797 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.799+0000 7f30877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:02.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.803+0000 7f31d7db79c0 20 remove_watcher() i=0 2024-09-19T11:57:02.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.803+0000 7f31d7db79c0 2 removed watcher, disabling cache 2024-09-19T11:57:02.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.807+0000 7f31d7db79c0 20 remove_watcher() i=1 2024-09-19T11:57:02.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.807+0000 7f31d7db79c0 20 remove_watcher() i=2 2024-09-19T11:57:02.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.811+0000 7f31d7db79c0 20 remove_watcher() i=3 2024-09-19T11:57:02.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.811+0000 7f31d7db79c0 20 remove_watcher() i=4 2024-09-19T11:57:02.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.815+0000 7f31d7db79c0 20 remove_watcher() i=5 2024-09-19T11:57:02.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.815+0000 7f31d7db79c0 20 remove_watcher() i=6 2024-09-19T11:57:02.815 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.815+0000 7f31d7db79c0 20 remove_watcher() i=7 2024-09-19T11:57:02.831 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-19T11:57:02.862 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:02.862 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:02.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.907+0000 7f5748d509c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.911+0000 7f5748d509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.911+0000 7f5748d509c0 20 realm 2024-09-19T11:57:02.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.911+0000 7f5748d509c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.911+0000 7f5748d509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.911+0000 7f5748d509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:02.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.911+0000 7f5748d509c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.911+0000 7f5748d509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:02.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.911+0000 7f5748d509c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.911+0000 7f5748d509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:02.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.911+0000 7f5748d509c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:02.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.915+0000 7f5748d509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:02.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.915+0000 7f5748d509c0 20 searching for the correct realm 2024-09-19T11:57:02.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:02.915+0000 7f5747057640 0 -- 172.21.15.120:0/2455418709 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f573c00e070 msgr2=0x7f573c070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:03.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.131+0000 7f5746055640 0 -- 172.21.15.120:0/2455418709 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f57380662d0 msgr2=0x7f573806cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:57:03.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:03.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:03.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:03.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:03.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:03.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:03.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:03.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:03.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:03.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:03.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:03.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:03.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 20 zone default found 2024-09-19T11:57:03.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 4 Realm: () 2024-09-19T11:57:03.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:03.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:03.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:03.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 20 zonegroup default 2024-09-19T11:57:03.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.351+0000 7f5748d509c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:03.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.355+0000 7f5748d509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:03.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.355+0000 7f5748d509c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:03.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.355+0000 7f5748d509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:03.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.355+0000 7f5748d509c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:03.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.355+0000 7f5748d509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:03.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.355+0000 7f5748d509c0 20 started sync module instance, tier type = 2024-09-19T11:57:03.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.355+0000 7f5748d509c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:03.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.375+0000 7f5748d509c0 20 add_watcher() i=0 2024-09-19T11:57:03.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.375+0000 7f5748d509c0 20 add_watcher() i=1 2024-09-19T11:57:03.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.375+0000 7f5748d509c0 20 add_watcher() i=2 2024-09-19T11:57:03.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.375+0000 7f5748d509c0 20 add_watcher() i=3 2024-09-19T11:57:03.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.375+0000 7f5748d509c0 20 add_watcher() i=4 2024-09-19T11:57:03.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.375+0000 7f5748d509c0 20 add_watcher() i=5 2024-09-19T11:57:03.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.375+0000 7f5748d509c0 20 add_watcher() i=6 2024-09-19T11:57:03.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.379+0000 7f5748d509c0 20 add_watcher() i=7 2024-09-19T11:57:03.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.379+0000 7f5748d509c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:03.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.383+0000 7f55fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:03.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.383+0000 7f5748d509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:03.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.383+0000 7f5748d509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:03.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.383+0000 7f5748d509c0 5 note: GC not initialized 2024-09-19T11:57:03.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.383+0000 7f5577fff640 20 reqs_thread_entry: start 2024-09-19T11:57:03.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.383+0000 7f5748d509c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:03.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.383+0000 7f5748d509c0 20 Filter name: none 2024-09-19T11:57:03.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.383+0000 7f5575ffb640 20 reqs_thread_entry: start 2024-09-19T11:57:03.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.383+0000 7f5748d509c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:03.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.387+0000 7f5748d509c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:03.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.387+0000 7f5748d509c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:03.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.387+0000 7f5748d509c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T11:57:03.385 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.387+0000 7f5748d509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:03.385 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.387+0000 7f5748d509c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:03.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.387+0000 7f5748d509c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:03.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.387+0000 7f5748d509c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:03.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.387+0000 7f5748d509c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T11:57:03.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.387+0000 7f5748d509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:03.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.391+0000 7f55fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:03.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.395+0000 7f5748d509c0 20 remove_watcher() i=0 2024-09-19T11:57:03.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.395+0000 7f5748d509c0 2 removed watcher, disabling cache 2024-09-19T11:57:03.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.395+0000 7f5748d509c0 20 remove_watcher() i=1 2024-09-19T11:57:03.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.399+0000 7f5748d509c0 20 remove_watcher() i=2 2024-09-19T11:57:03.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.399+0000 7f5748d509c0 20 remove_watcher() i=3 2024-09-19T11:57:03.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.403+0000 7f5748d509c0 20 remove_watcher() i=4 2024-09-19T11:57:03.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.403+0000 7f5748d509c0 20 remove_watcher() i=5 2024-09-19T11:57:03.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.407+0000 7f5748d509c0 20 remove_watcher() i=6 2024-09-19T11:57:03.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.407+0000 7f5748d509c0 20 remove_watcher() i=7 2024-09-19T11:57:03.420 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:03.421 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:57:03.421 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-block-writes id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:57:03.421 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:03.477 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:57:03.514 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:03.515 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:03.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.563+0000 7f98a59e19c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:03.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.563+0000 7f98a59e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:03.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.563+0000 7f98a59e19c0 20 realm 2024-09-19T11:57:03.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.563+0000 7f98a59e19c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:03.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.563+0000 7f98a59e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:03.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.563+0000 7f98a59e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:03.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.563+0000 7f98a59e19c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:03.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.563+0000 7f98a59e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:03.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.563+0000 7f98a59e19c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:03.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.567+0000 7f98a59e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:03.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.567+0000 7f98a59e19c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:03.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.567+0000 7f98a59e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:03.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.567+0000 7f98a59e19c0 20 searching for the correct realm 2024-09-19T11:57:03.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.571+0000 7f98a3ce8640 0 -- 172.21.15.120:0/694863518 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f98980fe0b0 msgr2=0x7f9898100810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:03.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:03.787+0000 7f98a2ce6640 0 -- 172.21.15.120:0/694863518 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f989402b950 msgr2=0x7f9894047400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:04.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:04.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:04.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:04.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:04.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:04.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:04.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:04.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:04.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:04.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 zone default found 2024-09-19T11:57:04.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 4 Realm: () 2024-09-19T11:57:04.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:04.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:04.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:04.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 zonegroup default 2024-09-19T11:57:04.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:04.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.007+0000 7f98a59e19c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.011+0000 7f98a59e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:04.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.011+0000 7f98a59e19c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.011+0000 7f98a59e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:04.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.011+0000 7f98a59e19c0 20 started sync module instance, tier type = 2024-09-19T11:57:04.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.011+0000 7f98a59e19c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:04.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.035+0000 7f98a59e19c0 20 add_watcher() i=0 2024-09-19T11:57:04.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.035+0000 7f98a59e19c0 20 add_watcher() i=1 2024-09-19T11:57:04.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.035+0000 7f98a59e19c0 20 add_watcher() i=2 2024-09-19T11:57:04.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.035+0000 7f98a59e19c0 20 add_watcher() i=3 2024-09-19T11:57:04.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.035+0000 7f98a59e19c0 20 add_watcher() i=4 2024-09-19T11:57:04.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.035+0000 7f98a59e19c0 20 add_watcher() i=5 2024-09-19T11:57:04.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.035+0000 7f98a59e19c0 20 add_watcher() i=6 2024-09-19T11:57:04.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.039+0000 7f98a59e19c0 20 add_watcher() i=7 2024-09-19T11:57:04.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.039+0000 7f98a59e19c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:04.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.043+0000 7f9759fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:04.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.043+0000 7f98a59e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:04.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.043+0000 7f98a59e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:04.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.043+0000 7f98a59e19c0 5 note: GC not initialized 2024-09-19T11:57:04.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.043+0000 7f9758fe1640 20 reqs_thread_entry: start 2024-09-19T11:57:04.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.043+0000 7f98a59e19c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:04.042 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.043+0000 7f98a59e19c0 20 Filter name: none 2024-09-19T11:57:04.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.043+0000 7f96d27fc640 20 reqs_thread_entry: start 2024-09-19T11:57:04.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.043+0000 7f98a59e19c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-19T11:57:04.043 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.043+0000 7f98a59e19c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.043+0000 7f98a59e19c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:04.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.043+0000 7f98a59e19c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-19T11:57:04.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.043+0000 7f98a59e19c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-19T11:57:04.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.047+0000 7f98a59e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 : miss 2024-09-19T11:57:04.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.047+0000 7f98a59e19c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.047+0000 7f98a59e19c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T11:57:04.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.047+0000 7f98a59e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 info.flags=0x17 2024-09-19T11:57:04.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.047+0000 7f98a59e19c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 to cache LRU end 2024-09-19T11:57:04.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.047+0000 7f98a59e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:57:04.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.047+0000 7f98a59e19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:04.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.047+0000 7f98a59e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 2024-09-19T11:57:04.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.055+0000 7f98a59e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 info.flags=0x17 2024-09-19T11:57:04.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.055+0000 7f98a59e19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 to cache LRU end 2024-09-19T11:57:04.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.055+0000 7f98a59e19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:04.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.055+0000 7f98a59e19c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29, ofs0, ns] 2024-09-19T11:57:04.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.055+0000 7f9786ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366219 cookie 94745253346368 notifier 7122 bl.length()=999 2024-09-19T11:57:04.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.055+0000 7f9786ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 info.flags=0x17 2024-09-19T11:57:04.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.055+0000 7f9786ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 to cache LRU end 2024-09-19T11:57:04.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.055+0000 7f9786ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:04.054 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.055+0000 7f98a59e19c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): orig_sources= new_sources= 2024-09-19T11:57:04.054 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.055+0000 7f98a59e19c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): potential sources added=[] removed=[] 2024-09-19T11:57:04.054 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.055+0000 7f98a59e19c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): orig_dests= new_dests= 2024-09-19T11:57:04.054 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.055+0000 7f98a59e19c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): potential dests added=[] removed=[] 2024-09-19T11:57:04.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.059+0000 7f98a59e19c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29.1.0 2024-09-19T11:57:04.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.059+0000 7f98a59e19c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29.1.0 2024-09-19T11:57:04.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.059+0000 7f98a59e19c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29.1.1 2024-09-19T11:57:04.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.059+0000 7f98a59e19c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29.1.1 2024-09-19T11:57:04.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.059+0000 7f98a59e19c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29.0 2024-09-19T11:57:04.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.063+0000 7f98a59e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:04.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.063+0000 7f98a59e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 2024-09-19T11:57:04.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.067+0000 7f98a59e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 info.flags=0x17 2024-09-19T11:57:04.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.067+0000 7f98a59e19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 to cache LRU end 2024-09-19T11:57:04.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.067+0000 7f98a59e19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:04.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.067+0000 7f98a59e19c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29, ofs0, ns] 2024-09-19T11:57:04.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.067+0000 7f9786ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366220 cookie 94745253346368 notifier 7122 bl.length()=999 2024-09-19T11:57:04.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.067+0000 7f9786ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 info.flags=0x17 2024-09-19T11:57:04.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.067+0000 7f9786ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 to cache LRU end 2024-09-19T11:57:04.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.067+0000 7f9786ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:04.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.067+0000 7f98a59e19c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): orig_sources= new_sources= 2024-09-19T11:57:04.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.067+0000 7f98a59e19c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): potential sources added=[] removed=[] 2024-09-19T11:57:04.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.067+0000 7f98a59e19c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): orig_dests= new_dests= 2024-09-19T11:57:04.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.067+0000 7f98a59e19c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): potential dests added=[] removed=[] 2024-09-19T11:57:04.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.067+0000 7f98a59e19c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29.0 2024-09-19T11:57:04.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.071+0000 7f98a59e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:04.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.071+0000 7f98a59e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 2024-09-19T11:57:04.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.071+0000 7f98a59e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 info.flags=0x17 2024-09-19T11:57:04.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.071+0000 7f98a59e19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 to cache LRU end 2024-09-19T11:57:04.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.071+0000 7f98a59e19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:04.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.071+0000 7f98a59e19c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29, ofs0, ns] 2024-09-19T11:57:04.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.071+0000 7f97867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366221 cookie 94745253346368 notifier 7122 bl.length()=967 2024-09-19T11:57:04.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.071+0000 7f97867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 info.flags=0x17 2024-09-19T11:57:04.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.071+0000 7f97867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 to cache LRU end 2024-09-19T11:57:04.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.071+0000 7f97867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:04.074 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.075+0000 7f98a59e19c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): orig_sources= new_sources= 2024-09-19T11:57:04.074 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.075+0000 7f98a59e19c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): potential sources added=[] removed=[] 2024-09-19T11:57:04.074 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.075+0000 7f98a59e19c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): orig_dests= new_dests= 2024-09-19T11:57:04.074 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.075+0000 7f98a59e19c0 20 handle_bi_update(): bucket=:error-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29]): potential dests added=[] removed=[] 2024-09-19T11:57:04.074 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.075+0000 7f98a59e19c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-19T11:57:04.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.079+0000 7f9759fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:04.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.083+0000 7f98a59e19c0 20 remove_watcher() i=0 2024-09-19T11:57:04.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.083+0000 7f98a59e19c0 2 removed watcher, disabling cache 2024-09-19T11:57:04.084 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.087+0000 7f98a59e19c0 20 remove_watcher() i=1 2024-09-19T11:57:04.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.087+0000 7f98a59e19c0 20 remove_watcher() i=2 2024-09-19T11:57:04.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.091+0000 7f98a59e19c0 20 remove_watcher() i=3 2024-09-19T11:57:04.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.091+0000 7f98a59e19c0 20 remove_watcher() i=4 2024-09-19T11:57:04.092 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.095+0000 7f98a59e19c0 20 remove_watcher() i=5 2024-09-19T11:57:04.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.095+0000 7f98a59e19c0 20 remove_watcher() i=6 2024-09-19T11:57:04.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.095+0000 7f98a59e19c0 20 remove_watcher() i=7 2024-09-19T11:57:04.110 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-19T11:57:04.138 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:04.138 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:04.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.183+0000 7f0eb04e69c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.183+0000 7f0eb04e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:04.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.183+0000 7f0eb04e69c0 20 realm 2024-09-19T11:57:04.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.183+0000 7f0eb04e69c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.183+0000 7f0eb04e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:04.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.183+0000 7f0eb04e69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:04.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.183+0000 7f0eb04e69c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.187+0000 7f0eb04e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:04.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.187+0000 7f0eb04e69c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.186 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.187+0000 7f0eb04e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:04.186 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.187+0000 7f0eb04e69c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.187+0000 7f0eb04e69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:04.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.187+0000 7f0eb04e69c0 20 searching for the correct realm 2024-09-19T11:57:04.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.191+0000 7f0eadfec640 0 -- 172.21.15.120:0/2696380404 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f0ea80e8040 msgr2=0x7f0ea80b7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:04.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.407+0000 7f0eadfec640 0 -- 172.21.15.120:0/2696380404 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f0ea80e8040 msgr2=0x7f0ea80b7420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:04.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:04.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:04.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:04.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:04.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:04.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:04.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:04.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:04.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:04.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 20 zone default found 2024-09-19T11:57:04.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 4 Realm: () 2024-09-19T11:57:04.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:04.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:04.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:04.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 20 zonegroup default 2024-09-19T11:57:04.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.419+0000 7f0eb04e69c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.423+0000 7f0eb04e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:04.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.423+0000 7f0eb04e69c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.423+0000 7f0eb04e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:04.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.423+0000 7f0eb04e69c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.423+0000 7f0eb04e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:04.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.423+0000 7f0eb04e69c0 20 started sync module instance, tier type = 2024-09-19T11:57:04.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.423+0000 7f0eb04e69c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:04.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.447+0000 7f0eb04e69c0 20 add_watcher() i=0 2024-09-19T11:57:04.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.447+0000 7f0eb04e69c0 20 add_watcher() i=1 2024-09-19T11:57:04.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.447+0000 7f0eb04e69c0 20 add_watcher() i=2 2024-09-19T11:57:04.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.447+0000 7f0eb04e69c0 20 add_watcher() i=3 2024-09-19T11:57:04.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.447+0000 7f0eb04e69c0 20 add_watcher() i=4 2024-09-19T11:57:04.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.447+0000 7f0eb04e69c0 20 add_watcher() i=5 2024-09-19T11:57:04.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.447+0000 7f0eb04e69c0 20 add_watcher() i=6 2024-09-19T11:57:04.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.451+0000 7f0eb04e69c0 20 add_watcher() i=7 2024-09-19T11:57:04.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.451+0000 7f0eb04e69c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:04.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.455+0000 7f0d5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:04.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.455+0000 7f0eb04e69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:04.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.455+0000 7f0eb04e69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:04.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.455+0000 7f0eb04e69c0 5 note: GC not initialized 2024-09-19T11:57:04.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.455+0000 7f0d5e7fc640 20 reqs_thread_entry: start 2024-09-19T11:57:04.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.455+0000 7f0eb04e69c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:04.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.459+0000 7f0eb04e69c0 20 Filter name: none 2024-09-19T11:57:04.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.459+0000 7f0ccffff640 20 reqs_thread_entry: start 2024-09-19T11:57:04.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.459+0000 7f0eb04e69c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.459+0000 7f0eb04e69c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:04.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.459+0000 7f0eb04e69c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.459+0000 7f0eb04e69c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T11:57:04.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.459+0000 7f0eb04e69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:04.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.459+0000 7f0eb04e69c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.459+0000 7f0eb04e69c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:04.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.459+0000 7f0eb04e69c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:04.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.463+0000 7f0eb04e69c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T11:57:04.460 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.463+0000 7f0eb04e69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:04.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.463+0000 7f0d5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:04.467 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.467+0000 7f0eb04e69c0 20 remove_watcher() i=0 2024-09-19T11:57:04.467 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.467+0000 7f0eb04e69c0 2 removed watcher, disabling cache 2024-09-19T11:57:04.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.471+0000 7f0eb04e69c0 20 remove_watcher() i=1 2024-09-19T11:57:04.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.471+0000 7f0eb04e69c0 20 remove_watcher() i=2 2024-09-19T11:57:04.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.475+0000 7f0eb04e69c0 20 remove_watcher() i=3 2024-09-19T11:57:04.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.475+0000 7f0eb04e69c0 20 remove_watcher() i=4 2024-09-19T11:57:04.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.479+0000 7f0eb04e69c0 20 remove_watcher() i=5 2024-09-19T11:57:04.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.479+0000 7f0eb04e69c0 20 remove_watcher() i=6 2024-09-19T11:57:04.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:04.483+0000 7f0eb04e69c0 20 remove_watcher() i=7 2024-09-19T11:57:04.496 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:04.496 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:57:04.496 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-block-writes id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T11:57:04.496 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:04.569 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with abort at block_writes 2024-09-19T11:57:04.569 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.048 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-19T11:57:05.081 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:05.081 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:05.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.127+0000 7fec0ef4f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.131+0000 7fec0ef4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.131+0000 7fec0ef4f9c0 20 realm 2024-09-19T11:57:05.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.131+0000 7fec0ef4f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.131+0000 7fec0ef4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.131+0000 7fec0ef4f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:05.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.131+0000 7fec0ef4f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.131+0000 7fec0ef4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.131+0000 7fec0ef4f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.131+0000 7fec0ef4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:05.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.131+0000 7fec0ef4f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.135+0000 7fec0ef4f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:05.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.135+0000 7fec0ef4f9c0 20 searching for the correct realm 2024-09-19T11:57:05.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.139+0000 7fec0d256640 0 -- 172.21.15.120:0/1208805166 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fec00092040 msgr2=0x7fec00071840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:05.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.143+0000 7fec0c254640 0 -- 172.21.15.120:0/1208805166 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7febfc0ef940 msgr2=0x7febfc0e5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:05.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:05.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:05.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:05.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:05.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:05.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:05.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:05.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:05.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 zone default found 2024-09-19T11:57:05.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 4 Realm: () 2024-09-19T11:57:05.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:05.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:05.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:05.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 zonegroup default 2024-09-19T11:57:05.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.363+0000 7fec0ef4f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.367+0000 7fec0ef4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.367+0000 7fec0ef4f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.367+0000 7fec0ef4f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.367+0000 7fec0ef4f9c0 20 started sync module instance, tier type = 2024-09-19T11:57:05.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.367+0000 7fec0ef4f9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:05.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.391+0000 7fec0ef4f9c0 20 add_watcher() i=0 2024-09-19T11:57:05.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.391+0000 7fec0ef4f9c0 20 add_watcher() i=1 2024-09-19T11:57:05.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.391+0000 7fec0ef4f9c0 20 add_watcher() i=2 2024-09-19T11:57:05.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.391+0000 7fec0ef4f9c0 20 add_watcher() i=3 2024-09-19T11:57:05.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.391+0000 7fec0ef4f9c0 20 add_watcher() i=4 2024-09-19T11:57:05.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.391+0000 7fec0ef4f9c0 20 add_watcher() i=5 2024-09-19T11:57:05.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.391+0000 7fec0ef4f9c0 20 add_watcher() i=6 2024-09-19T11:57:05.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.391+0000 7fec0ef4f9c0 20 add_watcher() i=7 2024-09-19T11:57:05.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.391+0000 7fec0ef4f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:05.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.395+0000 7feac2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:05.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fec0ef4f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:05.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fec0ef4f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:05.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fec0ef4f9c0 5 note: GC not initialized 2024-09-19T11:57:05.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7feac1fe3640 20 reqs_thread_entry: start 2024-09-19T11:57:05.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fec0ef4f9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:05.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fec0ef4f9c0 20 Filter name: none 2024-09-19T11:57:05.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fea337fe640 20 reqs_thread_entry: start 2024-09-19T11:57:05.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fec0ef4f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fec0ef4f9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:05.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fec0ef4f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fec0ef4f9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T11:57:05.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fec0ef4f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:05.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fec0ef4f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fec0ef4f9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:05.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fec0ef4f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fec0ef4f9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T11:57:05.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.399+0000 7fec0ef4f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:05.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.403+0000 7feac2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:05.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.407+0000 7fec0ef4f9c0 20 remove_watcher() i=0 2024-09-19T11:57:05.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.407+0000 7fec0ef4f9c0 2 removed watcher, disabling cache 2024-09-19T11:57:05.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.411+0000 7fec0ef4f9c0 20 remove_watcher() i=1 2024-09-19T11:57:05.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.415+0000 7fec0ef4f9c0 20 remove_watcher() i=2 2024-09-19T11:57:05.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.415+0000 7fec0ef4f9c0 20 remove_watcher() i=3 2024-09-19T11:57:05.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.419+0000 7fec0ef4f9c0 20 remove_watcher() i=4 2024-09-19T11:57:05.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.419+0000 7fec0ef4f9c0 20 remove_watcher() i=5 2024-09-19T11:57:05.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.423+0000 7fec0ef4f9c0 20 remove_watcher() i=6 2024-09-19T11:57:05.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.423+0000 7fec0ef4f9c0 20 remove_watcher() i=7 2024-09-19T11:57:05.438 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.438 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:57:05.438 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-block-writes id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:57:05.438 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.439 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-19T11:57:05.475 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:05.476 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:05.522 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.523+0000 7f81548e39c0 20 realm 2024-09-19T11:57:05.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.523+0000 7f81548e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:05.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.527+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:05.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.527+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.527+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:05.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.527+0000 7f81548e39c0 20 searching for the correct realm 2024-09-19T11:57:05.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.531+0000 7f81523e9640 0 -- 172.21.15.120:0/2215818959 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f814c045430 msgr2=0x7f814c045830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:57:05.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.747+0000 7f81523e9640 0 -- 172.21.15.120:0/2215818959 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f814c045430 msgr2=0x7f814c045830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:05.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:05.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:05.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:05.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:05.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:05.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:05.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:05.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:05.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.763+0000 7f81548e39c0 20 zone default found 2024-09-19T11:57:05.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.763+0000 7f81548e39c0 4 Realm: () 2024-09-19T11:57:05.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.763+0000 7f81548e39c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:05.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.763+0000 7f81548e39c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:05.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.763+0000 7f81548e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:05.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.763+0000 7f81548e39c0 20 zonegroup default 2024-09-19T11:57:05.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.763+0000 7f81548e39c0 20 started sync module instance, tier type = 2024-09-19T11:57:05.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.763+0000 7f81548e39c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:05.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=0 2024-09-19T11:57:05.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=1 2024-09-19T11:57:05.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=2 2024-09-19T11:57:05.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=3 2024-09-19T11:57:05.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=4 2024-09-19T11:57:05.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=5 2024-09-19T11:57:05.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=6 2024-09-19T11:57:05.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.787+0000 7f81548e39c0 20 add_watcher() i=7 2024-09-19T11:57:05.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.787+0000 7f81548e39c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:05.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.791+0000 7f8008fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:05.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.791+0000 7f81548e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:05.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.791+0000 7f81548e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:05.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.791+0000 7f81548e39c0 5 note: GC not initialized 2024-09-19T11:57:05.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.791+0000 7f7f837fe640 20 reqs_thread_entry: start 2024-09-19T11:57:05.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.791+0000 7f81548e39c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:05.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.791+0000 7f81548e39c0 20 Filter name: none 2024-09-19T11:57:05.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.791+0000 7f7f817fa640 20 reqs_thread_entry: start 2024-09-19T11:57:05.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.791+0000 7f81548e39c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-19T11:57:05.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.791+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.791+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:05.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.791+0000 7f81548e39c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-19T11:57:05.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.791+0000 7f81548e39c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-19T11:57:05.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.791+0000 7f81548e39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 : miss 2024-09-19T11:57:05.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.791+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.795+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T11:57:05.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.795+0000 7f81548e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:05.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.795+0000 7f81548e39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:05.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.795+0000 7f81548e39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:57:05.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.795+0000 7f81548e39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:05.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.795+0000 7f81548e39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 2024-09-19T11:57:05.800 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.803+0000 7f81548e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:05.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.803+0000 7f81548e39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:05.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.803+0000 7f81548e39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:05.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.803+0000 7f81548e39c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30, ofs0, ns] 2024-09-19T11:57:05.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.803+0000 7f8035ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366241 cookie 93992750303488 notifier 7176 bl.length()=999 2024-09-19T11:57:05.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.803+0000 7f8035ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:05.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.803+0000 7f8035ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:05.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.803+0000 7f8035ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:05.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.803+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_sources= new_sources= 2024-09-19T11:57:05.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.803+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential sources added=[] removed=[] 2024-09-19T11:57:05.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.803+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_dests= new_dests= 2024-09-19T11:57:05.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.803+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential dests added=[] removed=[] 2024-09-19T11:57:05.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.807+0000 7f81548e39c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.1.0 2024-09-19T11:57:05.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.807+0000 7f81548e39c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.1.0 2024-09-19T11:57:05.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.807+0000 7f81548e39c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.1.1 2024-09-19T11:57:05.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.807+0000 7f81548e39c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.1.1 2024-09-19T11:57:05.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.807+0000 7f81548e39c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.0 2024-09-19T11:57:05.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.815+0000 7f81548e39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:05.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.815+0000 7f81548e39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 2024-09-19T11:57:05.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.815+0000 7f81548e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:05.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.815+0000 7f81548e39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:05.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.815+0000 7f81548e39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:05.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.815+0000 7f81548e39c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30, ofs0, ns] 2024-09-19T11:57:05.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.819+0000 7f80357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366242 cookie 93992750303488 notifier 7176 bl.length()=999 2024-09-19T11:57:05.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.819+0000 7f80357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:05.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.819+0000 7f80357fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:05.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.819+0000 7f80357fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:05.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.819+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_sources= new_sources= 2024-09-19T11:57:05.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.819+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential sources added=[] removed=[] 2024-09-19T11:57:05.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.819+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_dests= new_dests= 2024-09-19T11:57:05.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.819+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential dests added=[] removed=[] 2024-09-19T11:57:05.818 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f81548e39c0 time 2024-09-19T11:57:05.824502+0000 2024-09-19T11:57:05.818 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:57:05.821 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:05.821 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f81581bd2eb] 2024-09-19T11:57:05.821 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f81581bd49f] 2024-09-19T11:57:05.821 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c6319b271] 2024-09-19T11:57:05.821 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x557c631aa4ab] 2024-09-19T11:57:05.821 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x557c631aba94] 2024-09-19T11:57:05.821 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:57:05.822 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8157023d90] 2024-09-19T11:57:05.822 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:57:05.822 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:57:05.822 INFO:tasks.workunit.client.0.smithi120.stderr:*** Caught signal (Aborted) ** 2024-09-19T11:57:05.822 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f81548e39c0 thread_name:radosgw-admin 2024-09-19T11:57:05.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.823+0000 7f81548e39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f81548e39c0 time 2024-09-19T11:57:05.824502+0000 2024-09-19T11:57:05.822 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:57:05.822 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.822 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:05.822 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f81581bd2eb] 2024-09-19T11:57:05.822 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f81581bd49f] 2024-09-19T11:57:05.822 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c6319b271] 2024-09-19T11:57:05.822 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x557c631aa4ab] 2024-09-19T11:57:05.822 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x557c631aba94] 2024-09-19T11:57:05.823 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:57:05.823 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8157023d90] 2024-09-19T11:57:05.823 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:57:05.823 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:57:05.823 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.825 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:05.825 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f815703c520] 2024-09-19T11:57:05.825 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:57:05.825 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:57:05.825 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:57:05.825 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f81581bd345] 2024-09-19T11:57:05.825 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f81581bd49f] 2024-09-19T11:57:05.825 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c6319b271] 2024-09-19T11:57:05.825 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x557c631aa4ab] 2024-09-19T11:57:05.825 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x557c631aba94] 2024-09-19T11:57:05.825 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:57:05.826 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8157023d90] 2024-09-19T11:57:05.826 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:57:05.826 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:57:05.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.827+0000 7f81548e39c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:57:05.826 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f81548e39c0 thread_name:radosgw-admin 2024-09-19T11:57:05.826 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.826 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:05.826 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f815703c520] 2024-09-19T11:57:05.826 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:57:05.826 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:57:05.826 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:57:05.826 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f81581bd345] 2024-09-19T11:57:05.826 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f81581bd49f] 2024-09-19T11:57:05.827 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c6319b271] 2024-09-19T11:57:05.827 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x557c631aa4ab] 2024-09-19T11:57:05.827 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x557c631aba94] 2024-09-19T11:57:05.827 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:57:05.827 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8157023d90] 2024-09-19T11:57:05.827 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:57:05.827 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:57:05.827 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:57:05.827 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.827 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:57:05.862 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 asok(0x557c644dad90) unregister_commands rotate-key 2024-09-19T11:57:05.862 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: build_initial_monmap 2024-09-19T11:57:05.862 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:57:05.503+0000 7f81548e39c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:05.862 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: monmap: 2024-09-19T11:57:05.862 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:05.862 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:05.862 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:05.862 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:05.862 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:05.863 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.863 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:05.863 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:05.863 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:05.863 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.863 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding auth protocol: cephx 2024-09-19T11:57:05.863 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding auth protocol: cephx 2024-09-19T11:57:05.863 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding auth protocol: cephx 2024-09-19T11:57:05.863 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: secure 2024-09-19T11:57:05.863 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: crc 2024-09-19T11:57:05.863 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: secure 2024-09-19T11:57:05.863 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: crc 2024-09-19T11:57:05.863 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: secure 2024-09-19T11:57:05.863 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: crc 2024-09-19T11:57:05.864 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: crc 2024-09-19T11:57:05.864 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: secure 2024-09-19T11:57:05.864 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: crc 2024-09-19T11:57:05.864 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: secure 2024-09-19T11:57:05.864 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: crc 2024-09-19T11:57:05.864 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: secure 2024-09-19T11:57:05.864 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:57:05.503+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.864 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:57:05.503+0000 7f81548e39c0 1 librados: starting msgr at 2024-09-19T11:57:05.864 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:57:05.503+0000 7f81548e39c0 1 librados: starting objecter 2024-09-19T11:57:05.864 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command objecter_requests hook 0x557c646eb230 2024-09-19T11:57:05.864 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:57:05.503+0000 7f81548e39c0 1 librados: setting wanted keys 2024-09-19T11:57:05.864 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:57:05.503+0000 7f81548e39c0 1 librados: calling monclient init 2024-09-19T11:57:05.864 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: init 2024-09-19T11:57:05.864 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding auth protocol: cephx 2024-09-19T11:57:05.865 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding auth protocol: cephx 2024-09-19T11:57:05.865 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding auth protocol: cephx 2024-09-19T11:57:05.865 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: secure 2024-09-19T11:57:05.865 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: crc 2024-09-19T11:57:05.865 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: secure 2024-09-19T11:57:05.865 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: crc 2024-09-19T11:57:05.865 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: secure 2024-09-19T11:57:05.865 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: crc 2024-09-19T11:57:05.865 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: crc 2024-09-19T11:57:05.865 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: secure 2024-09-19T11:57:05.865 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: crc 2024-09-19T11:57:05.865 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: secure 2024-09-19T11:57:05.865 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: crc 2024-09-19T11:57:05.865 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: secure 2024-09-19T11:57:05.866 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:57:05.503+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.866 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:57:05.503+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.866 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command rotate-key hook 0x557c646e8438 2024-09-19T11:57:05.866 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:05.866 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T11:57:05.866 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-b con 0x557c64574500 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:05.866 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-a con 0x557c645a3da0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:05.866 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-c con 0x557c64634bc0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:05.866 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.866 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.866 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.866 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:05.866 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): authenticate will time out at 2319.822154s 2024-09-19T11:57:05.866 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:57:05.503+0000 7f8152bea640 10 monclient(hunting): get_auth_request con 0x557c64634bc0 auth_method 0 2024-09-19T11:57:05.866 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:57:05.503+0000 7f8152bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.867 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:57:05.503+0000 7f8152bea640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.867 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:57:05.503+0000 7f8152bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.867 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): get_auth_request con 0x557c645a3da0 auth_method 0 2024-09-19T11:57:05.867 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.867 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.867 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.867 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:57:05.503+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.867 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:57:05.503+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.867 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:57:05.503+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.867 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.867 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.867 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.867 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:57:05.503+0000 7f81523e9640 10 monclient(hunting): get_auth_request con 0x557c64574500 auth_method 0 2024-09-19T11:57:05.868 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:57:05.503+0000 7f81523e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.868 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:57:05.503+0000 7f81523e9640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.868 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:57:05.503+0000 7f81523e9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.868 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): handle_auth_done global_id 7167 payload 824 2024-09-19T11:57:05.868 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient: _finish_hunting 0 2024-09-19T11:57:05.868 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:57:05.503+0000 7f8149be8640 1 monclient: found mon.noname-a 2024-09-19T11:57:05.868 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.868 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.868 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:57:05.868 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: dump: 2024-09-19T11:57:05.868 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.868 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.868 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.869 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.869 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.869 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.869 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.869 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.869 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.869 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.869 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: _finish_auth 0 2024-09-19T11:57:05.869 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: _check_auth_tickets 2024-09-19T11:57:05.869 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:05.869 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.869 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:57:05.869 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: dump: 2024-09-19T11:57:05.869 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.870 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.870 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.870 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.870 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.870 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.870 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.870 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.870 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.870 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.870 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:57:05.503+0000 7f8040608640 4 set_mon_vals no callback set 2024-09-19T11:57:05.870 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 monclient: authenticate success, global_id 7167 2024-09-19T11:57:05.870 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: _renew_subs 2024-09-19T11:57:05.870 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.870 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: _renew_subs 2024-09-19T11:57:05.871 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.871 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:57:05.503+0000 7f81548e39c0 1 librados: init done 2024-09-19T11:57:05.871 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:57:05.507+0000 7f803ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:57:05.871 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:57:05.507+0000 7f803ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:05.871 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:57:05.507+0000 7f803ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:05.871 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:57:05.507+0000 7f81523e9640 10 monclient: get_auth_request con 0x7f8038071be0 auth_method 0 2024-09-19T11:57:05.871 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:57:05.507+0000 7f8152bea640 10 monclient: get_auth_request con 0x557c64730500 auth_method 0 2024-09-19T11:57:05.871 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:57:05.507+0000 7f81523e9640 10 monclient: get_auth_request con 0x557c647336e0 auth_method 0 2024-09-19T11:57:05.871 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:57:05.511+0000 7f8149be8640 10 monclient: get_auth_request con 0x557c647378d0 auth_method 0 2024-09-19T11:57:05.871 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:57:05.511+0000 7f8152bea640 10 monclient: get_auth_request con 0x557c6473b5b0 auth_method 0 2024-09-19T11:57:05.871 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:57:05.511+0000 7f81548e39c0 10 monclient: build_initial_monmap 2024-09-19T11:57:05.871 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:57:05.511+0000 7f81548e39c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:05.871 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:57:05.511+0000 7f81548e39c0 10 monclient: monmap: 2024-09-19T11:57:05.871 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:05.871 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:05.872 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:05.872 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:05.872 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:05.872 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.872 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:05.872 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:05.872 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:05.872 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.872 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding auth protocol: cephx 2024-09-19T11:57:05.872 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding auth protocol: cephx 2024-09-19T11:57:05.872 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding auth protocol: cephx 2024-09-19T11:57:05.872 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: secure 2024-09-19T11:57:05.872 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: crc 2024-09-19T11:57:05.872 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: secure 2024-09-19T11:57:05.872 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: crc 2024-09-19T11:57:05.873 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: secure 2024-09-19T11:57:05.873 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: crc 2024-09-19T11:57:05.873 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: crc 2024-09-19T11:57:05.873 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: secure 2024-09-19T11:57:05.873 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: crc 2024-09-19T11:57:05.873 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: secure 2024-09-19T11:57:05.873 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: crc 2024-09-19T11:57:05.873 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: secure 2024-09-19T11:57:05.873 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:57:05.511+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.873 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command objecter_requests cmddesc objecter_requests hook 0x557c64742ef0 EEXIST 2024-09-19T11:57:05.873 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: init 2024-09-19T11:57:05.873 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding auth protocol: cephx 2024-09-19T11:57:05.873 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding auth protocol: cephx 2024-09-19T11:57:05.873 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding auth protocol: cephx 2024-09-19T11:57:05.873 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: secure 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: crc 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: secure 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: crc 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: secure 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: crc 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: crc 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: secure 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: crc 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: secure 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: crc 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: secure 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:57:05.515+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:57:05.515+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command rotate-key cmddesc rotate-key hook 0x557c6473e610 EEXIST 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:05.874 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T11:57:05.875 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-a con 0x557c647670a0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:05.875 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-c con 0x557c647669d0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:05.875 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-b con 0x557c647653b0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:05.875 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.875 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.875 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.875 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:05.875 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): authenticate will time out at 2319.832819s 2024-09-19T11:57:05.875 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): get_auth_request con 0x557c647670a0 auth_method 0 2024-09-19T11:57:05.875 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.875 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.875 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.875 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:57:05.515+0000 7f8152bea640 10 monclient(hunting): get_auth_request con 0x557c647669d0 auth_method 0 2024-09-19T11:57:05.876 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:57:05.515+0000 7f8152bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.876 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:57:05.515+0000 7f8152bea640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.876 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:57:05.515+0000 7f8152bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.876 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.876 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.876 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.876 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:57:05.515+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.876 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:57:05.515+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.876 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:57:05.515+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.876 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): handle_auth_done global_id 7170 payload 824 2024-09-19T11:57:05.876 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient: _finish_hunting 0 2024-09-19T11:57:05.876 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:57:05.515+0000 7f8149be8640 1 monclient: found mon.noname-a 2024-09-19T11:57:05.876 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.876 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:57:05.515+0000 7f81523e9640 10 monclient: get_auth_request con 0x557c647653b0 auth_method 0 2024-09-19T11:57:05.877 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.877 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:57:05.877 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: dump: 2024-09-19T11:57:05.877 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.877 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.877 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.877 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.877 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.877 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.877 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.877 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.877 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.877 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.878 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: _finish_auth 0 2024-09-19T11:57:05.878 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: _check_auth_tickets 2024-09-19T11:57:05.878 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:05.878 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.878 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:57:05.878 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: dump: 2024-09-19T11:57:05.878 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.878 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.878 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.878 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.878 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.878 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.878 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.878 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.879 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.879 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.879 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 monclient: authenticate success, global_id 7170 2024-09-19T11:57:05.879 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:57:05.515+0000 7f81533eb640 4 set_mon_vals no callback set 2024-09-19T11:57:05.879 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: _renew_subs 2024-09-19T11:57:05.879 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.879 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: _renew_subs 2024-09-19T11:57:05.879 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.879 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:57:05.515+0000 7f8037fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:57:05.879 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:57:05.515+0000 7f8037fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:05.879 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:57:05.515+0000 7f8037fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:05.879 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: get_monmap_and_config 2024-09-19T11:57:05.879 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: build_initial_monmap 2024-09-19T11:57:05.880 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:57:05.515+0000 7f81548e39c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:05.880 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: monmap: 2024-09-19T11:57:05.880 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:05.880 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:05.880 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:05.880 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:05.880 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:05.880 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.880 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:05.880 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:05.880 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:05.880 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.880 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding auth protocol: cephx 2024-09-19T11:57:05.880 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding auth protocol: cephx 2024-09-19T11:57:05.880 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding auth protocol: cephx 2024-09-19T11:57:05.881 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: secure 2024-09-19T11:57:05.881 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: crc 2024-09-19T11:57:05.881 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: secure 2024-09-19T11:57:05.881 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: crc 2024-09-19T11:57:05.881 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: secure 2024-09-19T11:57:05.881 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: crc 2024-09-19T11:57:05.881 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: crc 2024-09-19T11:57:05.881 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: secure 2024-09-19T11:57:05.881 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: crc 2024-09-19T11:57:05.881 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: secure 2024-09-19T11:57:05.881 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: crc 2024-09-19T11:57:05.881 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: secure 2024-09-19T11:57:05.881 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient: get_auth_request con 0x7f802c071b20 auth_method 0 2024-09-19T11:57:05.881 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:57:05.519+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: init 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding auth protocol: cephx 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding auth protocol: cephx 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding auth protocol: cephx 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: secure 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: crc 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: secure 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: crc 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: secure 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: crc 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: crc 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: secure 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: crc 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: secure 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: crc 2024-09-19T11:57:05.882 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: secure 2024-09-19T11:57:05.883 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:57:05.519+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.883 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:57:05.519+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.883 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command rotate-key cmddesc rotate-key hook 0x7ffe428df888 EEXIST 2024-09-19T11:57:05.883 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:05.883 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T11:57:05.883 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-a con 0x557c647ba8d0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:05.883 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-c con 0x557c647bacb0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:05.883 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-b con 0x557c647b5090 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:05.883 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.883 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.883 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.883 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:05.883 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): authenticate will time out at 2319.836994s 2024-09-19T11:57:05.883 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): get_auth_request con 0x557c647ba8d0 auth_method 0 2024-09-19T11:57:05.883 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.884 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.884 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.884 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): get_auth_request con 0x557c647bacb0 auth_method 0 2024-09-19T11:57:05.884 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.884 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.884 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.884 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.884 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.884 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.884 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.884 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.884 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.884 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_done global_id 7173 payload 274 2024-09-19T11:57:05.884 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient: _finish_hunting 0 2024-09-19T11:57:05.885 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:57:05.519+0000 7f8149be8640 1 monclient: found mon.noname-a 2024-09-19T11:57:05.885 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.885 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.885 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:57:05.885 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: dump: 2024-09-19T11:57:05.885 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.885 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.885 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.885 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.885 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.885 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.885 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.885 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.885 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.885 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.886 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: _finish_auth 0 2024-09-19T11:57:05.886 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: _check_auth_tickets 2024-09-19T11:57:05.886 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:05.886 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 monclient: authenticate success, global_id 7173 2024-09-19T11:57:05.886 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: get_monmap_and_config success 2024-09-19T11:57:05.886 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:57:05.519+0000 7f81548e39c0 4 set_mon_vals no callback set 2024-09-19T11:57:05.886 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.886 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:57:05.886 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: dump: 2024-09-19T11:57:05.886 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.886 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.886 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.886 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.886 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.886 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.887 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.887 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.887 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.887 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.887 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: shutdown 2024-09-19T11:57:05.887 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: build_initial_monmap 2024-09-19T11:57:05.887 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:57:05.519+0000 7f81548e39c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:05.887 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: monmap: 2024-09-19T11:57:05.887 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:05.887 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:05.887 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:05.887 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:05.887 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:05.888 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.888 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:05.888 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:05.888 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:05.888 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.888 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding auth protocol: cephx 2024-09-19T11:57:05.888 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding auth protocol: cephx 2024-09-19T11:57:05.888 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding auth protocol: cephx 2024-09-19T11:57:05.888 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: secure 2024-09-19T11:57:05.888 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: crc 2024-09-19T11:57:05.888 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: secure 2024-09-19T11:57:05.888 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: crc 2024-09-19T11:57:05.888 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: secure 2024-09-19T11:57:05.888 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: crc 2024-09-19T11:57:05.889 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: crc 2024-09-19T11:57:05.889 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: secure 2024-09-19T11:57:05.889 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: crc 2024-09-19T11:57:05.889 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: secure 2024-09-19T11:57:05.889 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: crc 2024-09-19T11:57:05.889 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: secure 2024-09-19T11:57:05.889 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:57:05.519+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.889 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:57:05.519+0000 7f81548e39c0 1 librados: starting msgr at 2024-09-19T11:57:05.889 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:57:05.519+0000 7f81548e39c0 1 librados: starting objecter 2024-09-19T11:57:05.890 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command objecter_requests cmddesc objecter_requests hook 0x557c647b6b10 EEXIST 2024-09-19T11:57:05.890 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:57:05.519+0000 7f81548e39c0 1 librados: setting wanted keys 2024-09-19T11:57:05.890 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:57:05.519+0000 7f81548e39c0 1 librados: calling monclient init 2024-09-19T11:57:05.890 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: init 2024-09-19T11:57:05.890 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding auth protocol: cephx 2024-09-19T11:57:05.890 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding auth protocol: cephx 2024-09-19T11:57:05.890 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding auth protocol: cephx 2024-09-19T11:57:05.890 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: secure 2024-09-19T11:57:05.890 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: crc 2024-09-19T11:57:05.890 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: secure 2024-09-19T11:57:05.891 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: crc 2024-09-19T11:57:05.891 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: secure 2024-09-19T11:57:05.891 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: crc 2024-09-19T11:57:05.892 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: crc 2024-09-19T11:57:05.892 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: secure 2024-09-19T11:57:05.892 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: crc 2024-09-19T11:57:05.892 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: secure 2024-09-19T11:57:05.892 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: crc 2024-09-19T11:57:05.892 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: secure 2024-09-19T11:57:05.892 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:57:05.519+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.892 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:57:05.519+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.892 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command rotate-key cmddesc rotate-key hook 0x557c64769008 EEXIST 2024-09-19T11:57:05.892 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:05.892 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T11:57:05.893 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-a con 0x557c647b5090 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:05.893 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-c con 0x557c647ba8d0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:05.893 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-b con 0x557c647b0900 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:05.893 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.893 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.893 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.893 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:05.893 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): authenticate will time out at 2319.839570s 2024-09-19T11:57:05.893 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): get_auth_request con 0x557c647b5090 auth_method 0 2024-09-19T11:57:05.893 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.893 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.893 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.893 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.894 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.894 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.894 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): get_auth_request con 0x557c647ba8d0 auth_method 0 2024-09-19T11:57:05.894 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.894 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.894 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.894 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.894 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.894 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.894 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_done global_id 7176 payload 824 2024-09-19T11:57:05.895 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient: _finish_hunting 0 2024-09-19T11:57:05.895 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:57:05.519+0000 7f8149be8640 1 monclient: found mon.noname-a 2024-09-19T11:57:05.895 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.895 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.895 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:57:05.895 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: dump: 2024-09-19T11:57:05.895 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.895 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.895 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.895 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.896 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.896 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.896 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.896 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.896 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.896 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.896 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: _finish_auth 0 2024-09-19T11:57:05.896 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: _check_auth_tickets 2024-09-19T11:57:05.896 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:05.896 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.896 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:57:05.896 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: dump: 2024-09-19T11:57:05.897 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.897 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.897 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.897 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.897 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.897 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.897 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.897 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.897 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.897 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.897 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:57:05.523+0000 7f81548e39c0 5 monclient: authenticate success, global_id 7176 2024-09-19T11:57:05.897 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:57:05.523+0000 7f81548e39c0 10 monclient: _renew_subs 2024-09-19T11:57:05.897 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:57:05.523+0000 7f8035ffb640 4 set_mon_vals no callback set 2024-09-19T11:57:05.898 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:57:05.523+0000 7f81548e39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.898 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:57:05.523+0000 7f81548e39c0 10 monclient: _renew_subs 2024-09-19T11:57:05.898 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:57:05.523+0000 7f81548e39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.898 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:57:05.523+0000 7f81548e39c0 1 librados: init done 2024-09-19T11:57:05.898 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:57:05.523+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command cr dump hook 0x7f813c004108 2024-09-19T11:57:05.898 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.898 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:57:05.523+0000 7f8023fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:57:05.898 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:57:05.523+0000 7f8023fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:05.898 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:57:05.523+0000 7f8023fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:05.898 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:57:05.523+0000 7f8152bea640 10 monclient: get_auth_request con 0x7f801c071be0 auth_method 0 2024-09-19T11:57:05.898 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:57:05.523+0000 7f81523e9640 10 monclient: get_auth_request con 0x557c647d3f60 auth_method 0 2024-09-19T11:57:05.898 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.898 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 realm 2024-09-19T11:57:05.898 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.898 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.899 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:57:05.523+0000 7f81548e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:05.899 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.899 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.899 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.899 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:57:05.527+0000 7f8149be8640 10 monclient: get_auth_request con 0x557c647d80b0 auth_method 0 2024-09-19T11:57:05.899 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:57:05.527+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:05.899 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:57:05.527+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.900 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:57:05.527+0000 7f8152bea640 10 monclient: get_auth_request con 0x557c647db980 auth_method 0 2024-09-19T11:57:05.900 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:57:05.527+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:05.900 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:57:05.527+0000 7f81548e39c0 20 searching for the correct realm 2024-09-19T11:57:05.900 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:57:05.527+0000 7f81523e9640 10 monclient: get_auth_request con 0x557c647e0760 auth_method 0 2024-09-19T11:57:05.900 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:57:05.531+0000 7f8149be8640 10 monclient: get_auth_request con 0x7f814401d940 auth_method 0 2024-09-19T11:57:05.900 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:57:05.531+0000 7f8152bea640 10 monclient: get_auth_request con 0x7f813c0c0020 auth_method 0 2024-09-19T11:57:05.900 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:57:05.531+0000 7f81523e9640 10 monclient: get_auth_request con 0x7f814c045430 auth_method 0 2024-09-19T11:57:05.900 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:57:05.531+0000 7f81523e9640 0 -- 172.21.15.120:0/2215818959 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f814c045430 msgr2=0x7f814c045830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:57:05.900 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:57:05.735+0000 7f81523e9640 10 monclient: get_auth_request con 0x7f814c045430 auth_method 0 2024-09-19T11:57:05.901 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:57:05.747+0000 7f8149be8640 10 monclient: get_auth_request con 0x7f814403f900 auth_method 0 2024-09-19T11:57:05.901 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:57:05.747+0000 7f81523e9640 0 -- 172.21.15.120:0/2215818959 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f814c045430 msgr2=0x7f814c045830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:05.901 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:57:05.747+0000 7f8023fff640 1 client.7176.objecter ms_handle_reset 0x7f814c045430 session 0x7f814c03e040 osd.4 2024-09-19T11:57:05.901 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:57:05.747+0000 7f8023fff640 10 monclient: _renew_subs 2024-09-19T11:57:05.901 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:57:05.747+0000 7f8023fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.901 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:57:05.747+0000 7f81523e9640 10 monclient: get_auth_request con 0x7f801c082200 auth_method 0 2024-09-19T11:57:05.901 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:05.901 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:05.901 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:05.901 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:05.902 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:05.902 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:05.902 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.902 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.902 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.902 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:05.902 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.902 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:05.902 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 zone default found 2024-09-19T11:57:05.902 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:57:05.763+0000 7f81548e39c0 4 Realm: () 2024-09-19T11:57:05.902 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:57:05.763+0000 7f81548e39c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:05.902 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:57:05.763+0000 7f81548e39c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:05.902 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:57:05.763+0000 7f81548e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:05.903 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 zonegroup default 2024-09-19T11:57:05.903 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.903 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.903 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.903 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.903 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.903 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.903 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 started sync module instance, tier type = 2024-09-19T11:57:05.903 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:05.903 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=0 2024-09-19T11:57:05.903 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=1 2024-09-19T11:57:05.903 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=2 2024-09-19T11:57:05.903 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=3 2024-09-19T11:57:05.903 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=4 2024-09-19T11:57:05.904 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=5 2024-09-19T11:57:05.904 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=6 2024-09-19T11:57:05.904 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:57:05.787+0000 7f81548e39c0 20 add_watcher() i=7 2024-09-19T11:57:05.904 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:57:05.787+0000 7f81548e39c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:05.904 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding auth protocol: cephx 2024-09-19T11:57:05.904 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding auth protocol: cephx 2024-09-19T11:57:05.904 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding auth protocol: cephx 2024-09-19T11:57:05.904 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: secure 2024-09-19T11:57:05.904 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: crc 2024-09-19T11:57:05.904 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: secure 2024-09-19T11:57:05.904 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: crc 2024-09-19T11:57:05.904 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: secure 2024-09-19T11:57:05.904 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: crc 2024-09-19T11:57:05.904 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: crc 2024-09-19T11:57:05.905 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: secure 2024-09-19T11:57:05.905 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: crc 2024-09-19T11:57:05.905 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: secure 2024-09-19T11:57:05.905 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: crc 2024-09-19T11:57:05.905 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: secure 2024-09-19T11:57:05.905 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:57:05.791+0000 7f8008fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:05.905 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:57:05.791+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.905 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:57:05.791+0000 7f81548e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:05.905 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:57:05.791+0000 7f81548e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:05.905 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command cache list hook 0x557c647b2650 2024-09-19T11:57:05.905 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command cache inspect hook 0x557c647b2650 2024-09-19T11:57:05.905 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command cache erase hook 0x557c647b2650 2024-09-19T11:57:05.905 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command cache zap hook 0x557c647b2650 2024-09-19T11:57:05.905 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 note: GC not initialized 2024-09-19T11:57:05.906 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:57:05.791+0000 7f7f837fe640 20 reqs_thread_entry: start 2024-09-19T11:57:05.906 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command sync trace show hook 0x7f813c105030 2024-09-19T11:57:05.906 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command sync trace history hook 0x7f813c105030 2024-09-19T11:57:05.906 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command sync trace active hook 0x7f813c105030 2024-09-19T11:57:05.906 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command sync trace active_short hook 0x7f813c105030 2024-09-19T11:57:05.906 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:57:05.791+0000 7f81548e39c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:05.908 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:57:05.791+0000 7f81548e39c0 20 Filter name: none 2024-09-19T11:57:05.908 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:57:05.791+0000 7f7f817fa640 20 reqs_thread_entry: start 2024-09-19T11:57:05.908 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:57:05.791+0000 7f81548e39c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-19T11:57:05.908 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:57:05.791+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.908 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:57:05.791+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:05.908 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:57:05.791+0000 7f81548e39c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-19T11:57:05.908 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:57:05.791+0000 7f81548e39c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-19T11:57:05.908 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:57:05.791+0000 7f81548e39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 : miss 2024-09-19T11:57:05.909 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:57:05.791+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.909 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:57:05.795+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T11:57:05.909 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:57:05.795+0000 7f81548e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:05.909 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:57:05.795+0000 7f81548e39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:05.909 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:57:05.795+0000 7f81548e39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:57:05.909 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:57:05.795+0000 7f81548e39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:05.909 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:57:05.795+0000 7f81548e39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 2024-09-19T11:57:05.909 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:57:05.803+0000 7f81548e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:05.909 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:57:05.803+0000 7f81548e39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:05.909 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:57:05.803+0000 7f81548e39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:05.910 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:57:05.803+0000 7f81548e39c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30, ofs0, ns] 2024-09-19T11:57:05.910 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:57:05.803+0000 7f8035ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366241 cookie 93992750303488 notifier 7176 bl.length()=999 2024-09-19T11:57:05.910 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:57:05.803+0000 7f8035ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:05.910 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:57:05.803+0000 7f8035ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:05.910 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:57:05.803+0000 7f8035ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:05.910 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:57:05.803+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_sources= new_sources= 2024-09-19T11:57:05.910 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:57:05.803+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential sources added=[] removed=[] 2024-09-19T11:57:05.910 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:57:05.803+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_dests= new_dests= 2024-09-19T11:57:05.910 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:57:05.803+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential dests added=[] removed=[] 2024-09-19T11:57:05.910 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:57:05.807+0000 7f81548e39c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.1.0 2024-09-19T11:57:05.910 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:57:05.807+0000 7f81548e39c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.1.0 2024-09-19T11:57:05.910 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:57:05.807+0000 7f81548e39c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.1.1 2024-09-19T11:57:05.910 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:57:05.807+0000 7f81548e39c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.1.1 2024-09-19T11:57:05.910 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:57:05.807+0000 7f81548e39c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.0 2024-09-19T11:57:05.911 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:57:05.815+0000 7f81548e39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:05.911 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:57:05.815+0000 7f81548e39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 2024-09-19T11:57:05.911 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:57:05.815+0000 7f81548e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:05.911 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:57:05.815+0000 7f81548e39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:05.911 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:57:05.815+0000 7f81548e39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:05.911 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:57:05.815+0000 7f81548e39c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30, ofs0, ns] 2024-09-19T11:57:05.911 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:57:05.819+0000 7f80357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366242 cookie 93992750303488 notifier 7176 bl.length()=999 2024-09-19T11:57:05.911 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:57:05.819+0000 7f80357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:05.911 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:57:05.819+0000 7f80357fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:05.911 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:57:05.819+0000 7f80357fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:05.911 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:57:05.819+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_sources= new_sources= 2024-09-19T11:57:05.911 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:57:05.819+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential sources added=[] removed=[] 2024-09-19T11:57:05.912 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:57:05.819+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_dests= new_dests= 2024-09-19T11:57:05.912 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:57:05.819+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential dests added=[] removed=[] 2024-09-19T11:57:05.912 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:57:05.823+0000 7f81548e39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f81548e39c0 time 2024-09-19T11:57:05.824502+0000 2024-09-19T11:57:05.912 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:57:05.912 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.912 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:05.912 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f81581bd2eb] 2024-09-19T11:57:05.912 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f81581bd49f] 2024-09-19T11:57:05.912 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c6319b271] 2024-09-19T11:57:05.912 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x557c631aa4ab] 2024-09-19T11:57:05.912 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x557c631aba94] 2024-09-19T11:57:05.912 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:57:05.912 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8157023d90] 2024-09-19T11:57:05.913 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:57:05.913 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:57:05.913 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.913 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:57:05.827+0000 7f81548e39c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:57:05.913 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f81548e39c0 thread_name:radosgw-admin 2024-09-19T11:57:05.913 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.913 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:05.913 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f815703c520] 2024-09-19T11:57:05.913 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:57:05.913 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:57:05.913 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:57:05.913 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f81581bd345] 2024-09-19T11:57:05.913 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f81581bd49f] 2024-09-19T11:57:05.913 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c6319b271] 2024-09-19T11:57:05.914 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x557c631aa4ab] 2024-09-19T11:57:05.914 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x557c631aba94] 2024-09-19T11:57:05.914 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:57:05.914 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8157023d90] 2024-09-19T11:57:05.914 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:57:05.914 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:57:05.914 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:57:05.914 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.914 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:57:05.914 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:57:05.914 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:57:05.915 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:57:05.915 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:57:05.915 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:57:05.915 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:57:05.915 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:57:05.915 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:57:05.915 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:57:05.915 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:57:05.915 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:57:05.915 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:57:05.915 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:57:05.915 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:57:05.915 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:57:05.915 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:57:05.916 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:57:05.916 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:57:05.916 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:57:05.916 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:57:05.916 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:57:05.916 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:57:05.916 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:57:05.916 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:57:05.916 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:57:05.916 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:57:05.916 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:57:05.916 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:57:05.916 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:57:05.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:57:05.917 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:57:05.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:57:05.917 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:57:05.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:57:05.917 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:57:05.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:57:05.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:57:05.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:57:05.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:57:05.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:57:05.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:57:05.917 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:57:05.917 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:57:05.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:57:05.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:57:05.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:57:05.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:57:05.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:57:05.918 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:57:05.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:57:05.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:57:05.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:57:05.918 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:57:05.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:57:05.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:57:05.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:57:05.918 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:57:05.919 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:57:05.919 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:57:05.919 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:57:05.919 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:57:05.919 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:57:05.919 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:57:05.919 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:57:05.919 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:57:05.919 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:57:05.919 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:57:05.919 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:57:05.920 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:57:05.920 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:57:05.920 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:57:05.920 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:57:05.920 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:57:05.920 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:57:05.920 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:57:05.920 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:57:05.920 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:57:05.920 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:57:05.920 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:57:05.920 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:57:05.921 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:57:05.921 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:57:05.921 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:57:05.921 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:57:05.921 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:57:05.921 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:57:05.921 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:57:05.921 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:57:05.921 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:57:05.921 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:57:05.921 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:57:05.921 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:57:05.921 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:57:05.922 INFO:tasks.workunit.client.0.smithi120.stderr: 7f7f817fa640 / http_manager 2024-09-19T11:57:05.922 INFO:tasks.workunit.client.0.smithi120.stderr: 7f7f837fe640 / http_manager 2024-09-19T11:57:05.922 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8008fe1640 / rgw_dt_lg_renew 2024-09-19T11:57:05.922 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8023fff640 / ms_dispatch 2024-09-19T11:57:05.922 INFO:tasks.workunit.client.0.smithi120.stderr: 7f80357fa640 / io_context_pool 2024-09-19T11:57:05.922 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8035ffb640 / io_context_pool 2024-09-19T11:57:05.922 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8037fff640 / ms_dispatch 2024-09-19T11:57:05.922 INFO:tasks.workunit.client.0.smithi120.stderr: 7f803ee05640 / ms_dispatch 2024-09-19T11:57:05.922 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8040608640 / io_context_pool 2024-09-19T11:57:05.922 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8149be8640 / msgr-worker-2 2024-09-19T11:57:05.922 INFO:tasks.workunit.client.0.smithi120.stderr: 7f81523e9640 / msgr-worker-1 2024-09-19T11:57:05.922 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8152bea640 / msgr-worker-0 2024-09-19T11:57:05.922 INFO:tasks.workunit.client.0.smithi120.stderr: 7f81533eb640 / io_context_pool 2024-09-19T11:57:05.922 INFO:tasks.workunit.client.0.smithi120.stderr: 7f81548e39c0 / radosgw-admin 2024-09-19T11:57:05.922 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:57:05.923 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:57:05.923 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/log/ceph/ceph-client.admin.106322.log 2024-09-19T11:57:05.923 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:57:05.923 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:57:05.923 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 asok(0x557c644dad90) unregister_commands rotate-key 2024-09-19T11:57:05.923 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: build_initial_monmap 2024-09-19T11:57:05.923 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:57:05.503+0000 7f81548e39c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:05.923 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: monmap: 2024-09-19T11:57:05.923 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:05.923 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:05.923 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:05.923 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:05.923 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:05.923 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.924 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:05.924 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:05.924 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:05.924 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.924 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding auth protocol: cephx 2024-09-19T11:57:05.924 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding auth protocol: cephx 2024-09-19T11:57:05.924 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding auth protocol: cephx 2024-09-19T11:57:05.924 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: secure 2024-09-19T11:57:05.924 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: crc 2024-09-19T11:57:05.924 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: secure 2024-09-19T11:57:05.924 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: crc 2024-09-19T11:57:05.925 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: secure 2024-09-19T11:57:05.925 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: crc 2024-09-19T11:57:05.925 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: crc 2024-09-19T11:57:05.925 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: secure 2024-09-19T11:57:05.925 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: crc 2024-09-19T11:57:05.925 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: secure 2024-09-19T11:57:05.925 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: crc 2024-09-19T11:57:05.925 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c64714df0) adding con mode: secure 2024-09-19T11:57:05.925 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:57:05.503+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.925 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:57:05.503+0000 7f81548e39c0 1 librados: starting msgr at 2024-09-19T11:57:05.925 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:57:05.503+0000 7f81548e39c0 1 librados: starting objecter 2024-09-19T11:57:05.925 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command objecter_requests hook 0x557c646eb230 2024-09-19T11:57:05.925 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:57:05.503+0000 7f81548e39c0 1 librados: setting wanted keys 2024-09-19T11:57:05.926 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:57:05.503+0000 7f81548e39c0 1 librados: calling monclient init 2024-09-19T11:57:05.926 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: init 2024-09-19T11:57:05.926 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding auth protocol: cephx 2024-09-19T11:57:05.926 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding auth protocol: cephx 2024-09-19T11:57:05.926 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding auth protocol: cephx 2024-09-19T11:57:05.926 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: secure 2024-09-19T11:57:05.926 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: crc 2024-09-19T11:57:05.926 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: secure 2024-09-19T11:57:05.926 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: crc 2024-09-19T11:57:05.926 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: secure 2024-09-19T11:57:05.926 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: crc 2024-09-19T11:57:05.926 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: crc 2024-09-19T11:57:05.926 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: secure 2024-09-19T11:57:05.926 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: crc 2024-09-19T11:57:05.927 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: secure 2024-09-19T11:57:05.927 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: crc 2024-09-19T11:57:05.927 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 AuthRegistry(0x557c646e82f0) adding con mode: secure 2024-09-19T11:57:05.927 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:57:05.503+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.927 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:57:05.503+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.927 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command rotate-key hook 0x557c646e8438 2024-09-19T11:57:05.927 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:05.927 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T11:57:05.927 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-b con 0x557c64574500 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:05.927 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-a con 0x557c645a3da0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:05.927 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-c con 0x557c64634bc0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:05.927 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.927 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.927 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.928 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:05.928 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient(hunting): authenticate will time out at 2319.822154s 2024-09-19T11:57:05.928 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:57:05.503+0000 7f8152bea640 10 monclient(hunting): get_auth_request con 0x557c64634bc0 auth_method 0 2024-09-19T11:57:05.928 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:57:05.503+0000 7f8152bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.928 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:57:05.503+0000 7f8152bea640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.928 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:57:05.503+0000 7f8152bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.928 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): get_auth_request con 0x557c645a3da0 auth_method 0 2024-09-19T11:57:05.928 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.928 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.928 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.928 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:57:05.503+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.928 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:57:05.503+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.928 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:57:05.503+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.929 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.929 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.929 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.929 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:57:05.503+0000 7f81523e9640 10 monclient(hunting): get_auth_request con 0x557c64574500 auth_method 0 2024-09-19T11:57:05.929 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:57:05.503+0000 7f81523e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.929 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:57:05.503+0000 7f81523e9640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.929 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:57:05.503+0000 7f81523e9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.929 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient(hunting): handle_auth_done global_id 7167 payload 824 2024-09-19T11:57:05.929 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient: _finish_hunting 0 2024-09-19T11:57:05.929 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:57:05.503+0000 7f8149be8640 1 monclient: found mon.noname-a 2024-09-19T11:57:05.929 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:57:05.503+0000 7f8149be8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.929 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.929 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:57:05.930 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: dump: 2024-09-19T11:57:05.930 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.930 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.930 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.930 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.930 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.930 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.930 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.930 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.930 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.930 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.930 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: _finish_auth 0 2024-09-19T11:57:05.931 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: _check_auth_tickets 2024-09-19T11:57:05.931 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:05.931 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.931 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:57:05.931 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:57:05.503+0000 7f803ee05640 10 monclient: dump: 2024-09-19T11:57:05.931 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.931 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.931 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.931 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.931 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.931 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.931 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.931 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.931 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.932 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.932 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:57:05.503+0000 7f8040608640 4 set_mon_vals no callback set 2024-09-19T11:57:05.932 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:57:05.503+0000 7f81548e39c0 5 monclient: authenticate success, global_id 7167 2024-09-19T11:57:05.932 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: _renew_subs 2024-09-19T11:57:05.932 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.932 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: _renew_subs 2024-09-19T11:57:05.932 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:57:05.503+0000 7f81548e39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.932 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:57:05.503+0000 7f81548e39c0 1 librados: init done 2024-09-19T11:57:05.932 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:57:05.507+0000 7f803ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:57:05.932 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:57:05.507+0000 7f803ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:05.932 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:57:05.507+0000 7f803ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:05.932 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:57:05.507+0000 7f81523e9640 10 monclient: get_auth_request con 0x7f8038071be0 auth_method 0 2024-09-19T11:57:05.932 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:57:05.507+0000 7f8152bea640 10 monclient: get_auth_request con 0x557c64730500 auth_method 0 2024-09-19T11:57:05.933 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:57:05.507+0000 7f81523e9640 10 monclient: get_auth_request con 0x557c647336e0 auth_method 0 2024-09-19T11:57:05.933 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:57:05.511+0000 7f8149be8640 10 monclient: get_auth_request con 0x557c647378d0 auth_method 0 2024-09-19T11:57:05.933 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:57:05.511+0000 7f8152bea640 10 monclient: get_auth_request con 0x557c6473b5b0 auth_method 0 2024-09-19T11:57:05.933 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:57:05.511+0000 7f81548e39c0 10 monclient: build_initial_monmap 2024-09-19T11:57:05.933 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:57:05.511+0000 7f81548e39c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:05.933 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:57:05.511+0000 7f81548e39c0 10 monclient: monmap: 2024-09-19T11:57:05.933 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:05.933 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:05.933 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:05.933 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:05.933 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:05.933 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.934 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:05.934 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:05.934 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:05.934 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.934 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding auth protocol: cephx 2024-09-19T11:57:05.934 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding auth protocol: cephx 2024-09-19T11:57:05.934 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding auth protocol: cephx 2024-09-19T11:57:05.934 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: secure 2024-09-19T11:57:05.934 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: crc 2024-09-19T11:57:05.934 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: secure 2024-09-19T11:57:05.934 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: crc 2024-09-19T11:57:05.934 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: secure 2024-09-19T11:57:05.934 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: crc 2024-09-19T11:57:05.934 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: crc 2024-09-19T11:57:05.935 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: secure 2024-09-19T11:57:05.935 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: crc 2024-09-19T11:57:05.935 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: secure 2024-09-19T11:57:05.935 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: crc 2024-09-19T11:57:05.935 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:57:05.511+0000 7f81548e39c0 5 AuthRegistry(0x557c6473f580) adding con mode: secure 2024-09-19T11:57:05.935 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:57:05.511+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.935 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command objecter_requests cmddesc objecter_requests hook 0x557c64742ef0 EEXIST 2024-09-19T11:57:05.935 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: init 2024-09-19T11:57:05.935 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding auth protocol: cephx 2024-09-19T11:57:05.935 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding auth protocol: cephx 2024-09-19T11:57:05.935 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding auth protocol: cephx 2024-09-19T11:57:05.935 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: secure 2024-09-19T11:57:05.935 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: crc 2024-09-19T11:57:05.936 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: secure 2024-09-19T11:57:05.936 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: crc 2024-09-19T11:57:05.936 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: secure 2024-09-19T11:57:05.936 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: crc 2024-09-19T11:57:05.936 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: crc 2024-09-19T11:57:05.936 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: secure 2024-09-19T11:57:05.936 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: crc 2024-09-19T11:57:05.936 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: secure 2024-09-19T11:57:05.936 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: crc 2024-09-19T11:57:05.936 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c6473e4c8) adding con mode: secure 2024-09-19T11:57:05.936 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:57:05.515+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.936 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:57:05.515+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.936 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command rotate-key cmddesc rotate-key hook 0x557c6473e610 EEXIST 2024-09-19T11:57:05.937 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:05.937 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T11:57:05.937 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-a con 0x557c647670a0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:05.937 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-c con 0x557c647669d0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:05.937 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-b con 0x557c647653b0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:05.937 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.937 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.937 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.937 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:05.937 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient(hunting): authenticate will time out at 2319.832819s 2024-09-19T11:57:05.937 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): get_auth_request con 0x557c647670a0 auth_method 0 2024-09-19T11:57:05.937 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.937 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.938 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.938 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:57:05.515+0000 7f8152bea640 10 monclient(hunting): get_auth_request con 0x557c647669d0 auth_method 0 2024-09-19T11:57:05.938 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:57:05.515+0000 7f8152bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.938 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:57:05.515+0000 7f8152bea640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.938 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:57:05.515+0000 7f8152bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.938 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.938 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.938 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.938 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:57:05.515+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.938 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:57:05.515+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.938 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:57:05.515+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.939 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient(hunting): handle_auth_done global_id 7170 payload 824 2024-09-19T11:57:05.939 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient: _finish_hunting 0 2024-09-19T11:57:05.939 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:57:05.515+0000 7f8149be8640 1 monclient: found mon.noname-a 2024-09-19T11:57:05.939 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:57:05.515+0000 7f8149be8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.939 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:57:05.515+0000 7f81523e9640 10 monclient: get_auth_request con 0x557c647653b0 auth_method 0 2024-09-19T11:57:05.939 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.939 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:57:05.939 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: dump: 2024-09-19T11:57:05.939 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.939 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.939 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.939 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.939 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.939 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.940 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.940 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.940 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.940 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.940 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: _finish_auth 0 2024-09-19T11:57:05.940 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: _check_auth_tickets 2024-09-19T11:57:05.940 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:05.940 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.940 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:57:05.940 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:57:05.515+0000 7f8037fff640 10 monclient: dump: 2024-09-19T11:57:05.941 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.941 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.941 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.941 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.941 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.941 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.941 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.941 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.941 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.941 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.941 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 monclient: authenticate success, global_id 7170 2024-09-19T11:57:05.941 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:57:05.515+0000 7f81533eb640 4 set_mon_vals no callback set 2024-09-19T11:57:05.941 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: _renew_subs 2024-09-19T11:57:05.941 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.942 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: _renew_subs 2024-09-19T11:57:05.942 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.942 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:57:05.515+0000 7f8037fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:57:05.942 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:57:05.515+0000 7f8037fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:05.942 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:57:05.515+0000 7f8037fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:05.942 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: get_monmap_and_config 2024-09-19T11:57:05.942 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: build_initial_monmap 2024-09-19T11:57:05.942 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:57:05.515+0000 7f81548e39c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:05.942 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:57:05.515+0000 7f81548e39c0 10 monclient: monmap: 2024-09-19T11:57:05.942 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:05.942 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:05.942 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:05.942 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:05.942 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:05.942 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.943 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:05.943 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:05.943 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:05.943 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.943 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding auth protocol: cephx 2024-09-19T11:57:05.943 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding auth protocol: cephx 2024-09-19T11:57:05.943 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding auth protocol: cephx 2024-09-19T11:57:05.943 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: secure 2024-09-19T11:57:05.943 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: crc 2024-09-19T11:57:05.943 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: secure 2024-09-19T11:57:05.943 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: crc 2024-09-19T11:57:05.943 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: secure 2024-09-19T11:57:05.943 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: crc 2024-09-19T11:57:05.943 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: crc 2024-09-19T11:57:05.944 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: secure 2024-09-19T11:57:05.944 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: crc 2024-09-19T11:57:05.944 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: secure 2024-09-19T11:57:05.944 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: crc 2024-09-19T11:57:05.944 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:57:05.515+0000 7f81548e39c0 5 AuthRegistry(0x557c64786620) adding con mode: secure 2024-09-19T11:57:05.944 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient: get_auth_request con 0x7f802c071b20 auth_method 0 2024-09-19T11:57:05.944 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:57:05.519+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.944 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: init 2024-09-19T11:57:05.944 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding auth protocol: cephx 2024-09-19T11:57:05.944 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding auth protocol: cephx 2024-09-19T11:57:05.944 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding auth protocol: cephx 2024-09-19T11:57:05.944 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: secure 2024-09-19T11:57:05.945 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: crc 2024-09-19T11:57:05.945 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: secure 2024-09-19T11:57:05.945 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: crc 2024-09-19T11:57:05.945 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: secure 2024-09-19T11:57:05.945 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: crc 2024-09-19T11:57:05.945 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: crc 2024-09-19T11:57:05.945 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: secure 2024-09-19T11:57:05.945 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: crc 2024-09-19T11:57:05.945 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: secure 2024-09-19T11:57:05.946 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: crc 2024-09-19T11:57:05.946 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428df740) adding con mode: secure 2024-09-19T11:57:05.946 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:57:05.519+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.946 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:57:05.519+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.946 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command rotate-key cmddesc rotate-key hook 0x7ffe428df888 EEXIST 2024-09-19T11:57:05.946 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:05.946 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T11:57:05.946 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-a con 0x557c647ba8d0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:05.946 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-c con 0x557c647bacb0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:05.946 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-b con 0x557c647b5090 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:05.946 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.946 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.947 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.947 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:05.947 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): authenticate will time out at 2319.836994s 2024-09-19T11:57:05.947 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): get_auth_request con 0x557c647ba8d0 auth_method 0 2024-09-19T11:57:05.947 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.947 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.947 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.947 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): get_auth_request con 0x557c647bacb0 auth_method 0 2024-09-19T11:57:05.947 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.947 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.947 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.947 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.947 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.947 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.948 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.948 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.948 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.948 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_done global_id 7173 payload 274 2024-09-19T11:57:05.948 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient: _finish_hunting 0 2024-09-19T11:57:05.948 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:57:05.519+0000 7f8149be8640 1 monclient: found mon.noname-a 2024-09-19T11:57:05.948 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.948 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.948 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:57:05.948 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: dump: 2024-09-19T11:57:05.948 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.948 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.948 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.949 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.949 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.949 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.949 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.949 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.949 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.949 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.949 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: _finish_auth 0 2024-09-19T11:57:05.949 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: _check_auth_tickets 2024-09-19T11:57:05.949 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:05.949 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 monclient: authenticate success, global_id 7173 2024-09-19T11:57:05.949 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: get_monmap_and_config success 2024-09-19T11:57:05.949 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:57:05.519+0000 7f81548e39c0 4 set_mon_vals no callback set 2024-09-19T11:57:05.950 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.950 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:57:05.950 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:57:05.519+0000 7f8035ffb640 10 monclient: dump: 2024-09-19T11:57:05.950 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.950 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.950 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.950 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.950 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.950 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.950 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.950 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.951 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.951 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.951 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: shutdown 2024-09-19T11:57:05.951 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: build_initial_monmap 2024-09-19T11:57:05.951 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:57:05.519+0000 7f81548e39c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:05.951 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: monmap: 2024-09-19T11:57:05.951 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:05.951 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:05.951 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:05.951 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:05.951 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:05.951 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.951 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:05.952 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:05.952 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:05.952 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.952 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding auth protocol: cephx 2024-09-19T11:57:05.952 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding auth protocol: cephx 2024-09-19T11:57:05.952 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding auth protocol: cephx 2024-09-19T11:57:05.952 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: secure 2024-09-19T11:57:05.952 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: crc 2024-09-19T11:57:05.952 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: secure 2024-09-19T11:57:05.952 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: crc 2024-09-19T11:57:05.952 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: secure 2024-09-19T11:57:05.952 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: crc 2024-09-19T11:57:05.952 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: crc 2024-09-19T11:57:05.952 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: secure 2024-09-19T11:57:05.953 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: crc 2024-09-19T11:57:05.953 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: secure 2024-09-19T11:57:05.953 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: crc 2024-09-19T11:57:05.953 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c647acf90) adding con mode: secure 2024-09-19T11:57:05.953 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:57:05.519+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.953 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:57:05.519+0000 7f81548e39c0 1 librados: starting msgr at 2024-09-19T11:57:05.953 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:57:05.519+0000 7f81548e39c0 1 librados: starting objecter 2024-09-19T11:57:05.953 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command objecter_requests cmddesc objecter_requests hook 0x557c647b6b10 EEXIST 2024-09-19T11:57:05.953 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:57:05.519+0000 7f81548e39c0 1 librados: setting wanted keys 2024-09-19T11:57:05.953 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:57:05.519+0000 7f81548e39c0 1 librados: calling monclient init 2024-09-19T11:57:05.953 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: init 2024-09-19T11:57:05.953 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding auth protocol: cephx 2024-09-19T11:57:05.953 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding auth protocol: cephx 2024-09-19T11:57:05.953 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding auth protocol: cephx 2024-09-19T11:57:05.954 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: secure 2024-09-19T11:57:05.954 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: crc 2024-09-19T11:57:05.954 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: secure 2024-09-19T11:57:05.954 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: crc 2024-09-19T11:57:05.954 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: secure 2024-09-19T11:57:05.954 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: crc 2024-09-19T11:57:05.954 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: crc 2024-09-19T11:57:05.954 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: secure 2024-09-19T11:57:05.954 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: crc 2024-09-19T11:57:05.954 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: secure 2024-09-19T11:57:05.954 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: crc 2024-09-19T11:57:05.954 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 AuthRegistry(0x557c64768ec0) adding con mode: secure 2024-09-19T11:57:05.954 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:57:05.519+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.954 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:57:05.519+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.955 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:57:05.519+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command rotate-key cmddesc rotate-key hook 0x557c64769008 EEXIST 2024-09-19T11:57:05.955 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:05.955 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T11:57:05.955 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-a con 0x557c647b5090 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:05.955 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-c con 0x557c647ba8d0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:05.955 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): picked mon.noname-b con 0x557c647b0900 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:05.955 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.955 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.955 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:05.955 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:05.955 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:57:05.519+0000 7f81548e39c0 10 monclient(hunting): authenticate will time out at 2319.839570s 2024-09-19T11:57:05.955 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): get_auth_request con 0x557c647b5090 auth_method 0 2024-09-19T11:57:05.956 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.956 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.956 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.956 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.956 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.956 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.956 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): get_auth_request con 0x557c647ba8d0 auth_method 0 2024-09-19T11:57:05.956 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:05.956 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:05.956 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:05.956 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:05.956 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:05.956 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:57:05.519+0000 7f8152bea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:05.956 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient(hunting): handle_auth_done global_id 7176 payload 824 2024-09-19T11:57:05.957 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient: _finish_hunting 0 2024-09-19T11:57:05.957 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:57:05.519+0000 7f8149be8640 1 monclient: found mon.noname-a 2024-09-19T11:57:05.957 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:57:05.519+0000 7f8149be8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.957 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.957 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:57:05.957 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: dump: 2024-09-19T11:57:05.957 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.957 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.957 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.957 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.957 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.957 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.958 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.958 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.958 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.958 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.958 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: _finish_auth 0 2024-09-19T11:57:05.958 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: _check_auth_tickets 2024-09-19T11:57:05.958 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:05.958 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:05.958 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:57:05.958 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:57:05.523+0000 7f8023fff640 10 monclient: dump: 2024-09-19T11:57:05.958 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:05.958 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:05.958 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.958 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:05.959 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:05.959 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:05.959 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:05.959 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:05.959 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:05.959 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.959 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:57:05.523+0000 7f81548e39c0 5 monclient: authenticate success, global_id 7176 2024-09-19T11:57:05.959 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:57:05.523+0000 7f81548e39c0 10 monclient: _renew_subs 2024-09-19T11:57:05.959 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:57:05.523+0000 7f8035ffb640 4 set_mon_vals no callback set 2024-09-19T11:57:05.959 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:57:05.523+0000 7f81548e39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.959 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:57:05.523+0000 7f81548e39c0 10 monclient: _renew_subs 2024-09-19T11:57:05.959 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:57:05.523+0000 7f81548e39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.959 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:57:05.523+0000 7f81548e39c0 1 librados: init done 2024-09-19T11:57:05.959 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:57:05.523+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command cr dump hook 0x7f813c004108 2024-09-19T11:57:05.959 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.960 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:57:05.523+0000 7f8023fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:57:05.960 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:57:05.523+0000 7f8023fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:05.960 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:57:05.523+0000 7f8023fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:05.960 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:57:05.523+0000 7f8152bea640 10 monclient: get_auth_request con 0x7f801c071be0 auth_method 0 2024-09-19T11:57:05.960 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:57:05.523+0000 7f81523e9640 10 monclient: get_auth_request con 0x557c647d3f60 auth_method 0 2024-09-19T11:57:05.960 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.960 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 realm 2024-09-19T11:57:05.960 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.960 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.960 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:57:05.523+0000 7f81548e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:05.960 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.960 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.961 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:57:05.523+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.961 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:57:05.527+0000 7f8149be8640 10 monclient: get_auth_request con 0x557c647d80b0 auth_method 0 2024-09-19T11:57:05.961 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:57:05.527+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:05.961 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:57:05.527+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.961 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:57:05.527+0000 7f8152bea640 10 monclient: get_auth_request con 0x557c647db980 auth_method 0 2024-09-19T11:57:05.961 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:57:05.527+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:05.961 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:57:05.527+0000 7f81548e39c0 20 searching for the correct realm 2024-09-19T11:57:05.961 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:57:05.527+0000 7f81523e9640 10 monclient: get_auth_request con 0x557c647e0760 auth_method 0 2024-09-19T11:57:05.961 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:57:05.531+0000 7f8149be8640 10 monclient: get_auth_request con 0x7f814401d940 auth_method 0 2024-09-19T11:57:05.961 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:57:05.531+0000 7f8152bea640 10 monclient: get_auth_request con 0x7f813c0c0020 auth_method 0 2024-09-19T11:57:05.961 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:57:05.531+0000 7f81523e9640 10 monclient: get_auth_request con 0x7f814c045430 auth_method 0 2024-09-19T11:57:05.962 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:57:05.531+0000 7f81523e9640 0 -- 172.21.15.120:0/2215818959 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f814c045430 msgr2=0x7f814c045830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:57:05.962 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:57:05.735+0000 7f81523e9640 10 monclient: get_auth_request con 0x7f814c045430 auth_method 0 2024-09-19T11:57:05.962 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:57:05.747+0000 7f8149be8640 10 monclient: get_auth_request con 0x7f814403f900 auth_method 0 2024-09-19T11:57:05.962 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:57:05.747+0000 7f81523e9640 0 -- 172.21.15.120:0/2215818959 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f814c045430 msgr2=0x7f814c045830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:05.962 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:57:05.747+0000 7f8023fff640 1 client.7176.objecter ms_handle_reset 0x7f814c045430 session 0x7f814c03e040 osd.4 2024-09-19T11:57:05.962 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:57:05.747+0000 7f8023fff640 10 monclient: _renew_subs 2024-09-19T11:57:05.962 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:57:05.747+0000 7f8023fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:57:05.962 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:57:05.747+0000 7f81523e9640 10 monclient: get_auth_request con 0x7f801c082200 auth_method 0 2024-09-19T11:57:05.962 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:05.962 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:05.962 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:05.962 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:05.962 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:05.963 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:05.963 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.963 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.963 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.963 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:05.963 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.963 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:57:05.759+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:05.963 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 zone default found 2024-09-19T11:57:05.963 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:57:05.763+0000 7f81548e39c0 4 Realm: () 2024-09-19T11:57:05.963 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:57:05.763+0000 7f81548e39c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:05.963 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:57:05.763+0000 7f81548e39c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:05.963 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:57:05.763+0000 7f81548e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:05.964 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 zonegroup default 2024-09-19T11:57:05.964 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.964 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.964 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.964 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.964 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.964 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.964 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 started sync module instance, tier type = 2024-09-19T11:57:05.964 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:57:05.763+0000 7f81548e39c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:05.964 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=0 2024-09-19T11:57:05.964 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=1 2024-09-19T11:57:05.964 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=2 2024-09-19T11:57:05.964 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=3 2024-09-19T11:57:05.964 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=4 2024-09-19T11:57:05.965 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=5 2024-09-19T11:57:05.965 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:57:05.783+0000 7f81548e39c0 20 add_watcher() i=6 2024-09-19T11:57:05.965 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:57:05.787+0000 7f81548e39c0 20 add_watcher() i=7 2024-09-19T11:57:05.965 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:57:05.787+0000 7f81548e39c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:05.965 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding auth protocol: cephx 2024-09-19T11:57:05.965 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding auth protocol: cephx 2024-09-19T11:57:05.965 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding auth protocol: cephx 2024-09-19T11:57:05.965 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: secure 2024-09-19T11:57:05.965 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: crc 2024-09-19T11:57:05.965 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: secure 2024-09-19T11:57:05.965 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: crc 2024-09-19T11:57:05.965 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: secure 2024-09-19T11:57:05.965 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: crc 2024-09-19T11:57:05.966 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: crc 2024-09-19T11:57:05.966 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: secure 2024-09-19T11:57:05.966 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: crc 2024-09-19T11:57:05.966 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: secure 2024-09-19T11:57:05.966 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: crc 2024-09-19T11:57:05.966 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 AuthRegistry(0x7ffe428dfc10) adding con mode: secure 2024-09-19T11:57:05.966 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:57:05.791+0000 7f8008fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:05.966 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:57:05.791+0000 7f81548e39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:05.966 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:57:05.791+0000 7f81548e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:05.966 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:57:05.791+0000 7f81548e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:05.966 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command cache list hook 0x557c647b2650 2024-09-19T11:57:05.966 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command cache inspect hook 0x557c647b2650 2024-09-19T11:57:05.967 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command cache erase hook 0x557c647b2650 2024-09-19T11:57:05.967 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command cache zap hook 0x557c647b2650 2024-09-19T11:57:05.967 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 note: GC not initialized 2024-09-19T11:57:05.967 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:57:05.791+0000 7f7f837fe640 20 reqs_thread_entry: start 2024-09-19T11:57:05.967 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command sync trace show hook 0x7f813c105030 2024-09-19T11:57:05.967 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command sync trace history hook 0x7f813c105030 2024-09-19T11:57:05.967 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command sync trace active hook 0x7f813c105030 2024-09-19T11:57:05.967 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:57:05.791+0000 7f81548e39c0 5 asok(0x557c644dad90) register_command sync trace active_short hook 0x7f813c105030 2024-09-19T11:57:05.967 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:57:05.791+0000 7f81548e39c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:05.967 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:57:05.791+0000 7f81548e39c0 20 Filter name: none 2024-09-19T11:57:05.967 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:57:05.791+0000 7f7f817fa640 20 reqs_thread_entry: start 2024-09-19T11:57:05.967 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:57:05.791+0000 7f81548e39c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-19T11:57:05.967 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:57:05.791+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.968 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:57:05.791+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:05.968 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:57:05.791+0000 7f81548e39c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-19T11:57:05.968 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:57:05.791+0000 7f81548e39c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-19T11:57:05.968 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:57:05.791+0000 7f81548e39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 : miss 2024-09-19T11:57:05.968 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:57:05.791+0000 7f81548e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.968 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:57:05.795+0000 7f81548e39c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T11:57:05.968 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:57:05.795+0000 7f81548e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:05.968 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:57:05.795+0000 7f81548e39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:05.968 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:57:05.795+0000 7f81548e39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:57:05.968 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:57:05.795+0000 7f81548e39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:05.968 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:57:05.795+0000 7f81548e39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 2024-09-19T11:57:05.969 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:57:05.803+0000 7f81548e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:05.969 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:57:05.803+0000 7f81548e39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:05.969 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:57:05.803+0000 7f81548e39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:05.969 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:57:05.803+0000 7f81548e39c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30, ofs0, ns] 2024-09-19T11:57:05.969 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:57:05.803+0000 7f8035ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366241 cookie 93992750303488 notifier 7176 bl.length()=999 2024-09-19T11:57:05.969 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:57:05.803+0000 7f8035ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:05.969 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:57:05.803+0000 7f8035ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:05.969 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:57:05.803+0000 7f8035ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:05.969 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:57:05.803+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_sources= new_sources= 2024-09-19T11:57:05.969 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:57:05.803+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential sources added=[] removed=[] 2024-09-19T11:57:05.969 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:57:05.803+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_dests= new_dests= 2024-09-19T11:57:05.969 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:57:05.803+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential dests added=[] removed=[] 2024-09-19T11:57:05.969 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:57:05.807+0000 7f81548e39c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.1.0 2024-09-19T11:57:05.969 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:57:05.807+0000 7f81548e39c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.1.0 2024-09-19T11:57:05.969 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:57:05.807+0000 7f81548e39c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.1.1 2024-09-19T11:57:05.970 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:57:05.807+0000 7f81548e39c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.1.1 2024-09-19T11:57:05.970 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:57:05.807+0000 7f81548e39c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.0 2024-09-19T11:57:05.970 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:57:05.815+0000 7f81548e39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:05.970 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:57:05.815+0000 7f81548e39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 2024-09-19T11:57:05.970 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:57:05.815+0000 7f81548e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:05.970 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:57:05.815+0000 7f81548e39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:05.970 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:57:05.815+0000 7f81548e39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:05.970 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:57:05.815+0000 7f81548e39c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30, ofs0, ns] 2024-09-19T11:57:05.970 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:57:05.819+0000 7f80357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366242 cookie 93992750303488 notifier 7176 bl.length()=999 2024-09-19T11:57:05.970 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:57:05.819+0000 7f80357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:05.970 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:57:05.819+0000 7f80357fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:05.970 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:57:05.819+0000 7f80357fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:05.971 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:57:05.819+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_sources= new_sources= 2024-09-19T11:57:05.971 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:57:05.819+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential sources added=[] removed=[] 2024-09-19T11:57:05.971 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:57:05.819+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_dests= new_dests= 2024-09-19T11:57:05.971 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:57:05.819+0000 7f81548e39c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential dests added=[] removed=[] 2024-09-19T11:57:05.971 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:57:05.823+0000 7f81548e39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f81548e39c0 time 2024-09-19T11:57:05.824502+0000 2024-09-19T11:57:05.971 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:57:05.971 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.971 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:05.971 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f81581bd2eb] 2024-09-19T11:57:05.971 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f81581bd49f] 2024-09-19T11:57:05.971 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c6319b271] 2024-09-19T11:57:05.971 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x557c631aa4ab] 2024-09-19T11:57:05.971 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x557c631aba94] 2024-09-19T11:57:05.972 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:57:05.972 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8157023d90] 2024-09-19T11:57:05.972 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:57:05.972 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:57:05.972 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.972 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:57:05.827+0000 7f81548e39c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:57:05.972 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f81548e39c0 thread_name:radosgw-admin 2024-09-19T11:57:05.972 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.972 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:05.972 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f815703c520] 2024-09-19T11:57:05.972 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:57:05.972 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:57:05.973 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:57:05.973 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f81581bd345] 2024-09-19T11:57:05.973 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f81581bd49f] 2024-09-19T11:57:05.973 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557c6319b271] 2024-09-19T11:57:05.973 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x557c631aa4ab] 2024-09-19T11:57:05.973 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x557c631aba94] 2024-09-19T11:57:05.973 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:57:05.973 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8157023d90] 2024-09-19T11:57:05.973 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:57:05.973 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:57:05.973 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:57:05.973 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:05.973 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:57:05.974 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:57:05.974 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:57:05.974 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:57:05.974 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:57:05.974 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:57:05.974 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:57:05.974 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:57:05.974 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:57:05.974 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:57:05.974 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:57:05.974 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:57:05.974 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:57:05.974 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:57:05.974 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:57:05.975 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:57:05.975 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:57:05.975 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:57:05.975 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:57:05.975 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:57:05.975 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:57:05.975 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:57:05.975 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:57:05.975 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:57:05.975 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:57:05.975 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:57:05.975 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:57:05.975 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:57:05.975 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:57:05.976 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:57:05.976 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:57:05.976 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:57:05.976 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:57:05.976 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:57:05.976 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:57:05.976 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:57:05.976 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:57:05.976 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:57:05.976 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:57:05.976 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:57:05.976 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:57:05.976 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:57:05.976 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:57:05.977 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:57:05.977 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:57:05.977 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:57:05.977 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:57:05.977 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:57:05.977 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:57:05.977 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:57:05.977 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:57:05.977 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:57:05.977 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:57:05.977 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:57:05.977 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:57:05.977 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:57:05.977 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:57:05.978 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:57:05.978 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:57:05.978 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:57:05.978 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:57:05.978 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:57:05.978 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:57:05.978 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:57:05.978 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:57:05.978 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:57:05.978 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:57:05.978 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:57:05.978 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:57:05.978 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:57:05.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:57:05.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:57:05.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:57:05.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:57:05.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:57:05.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:57:05.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:57:05.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:57:05.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:57:05.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:57:05.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:57:05.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:57:05.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:57:05.979 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:57:05.980 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:57:05.980 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:57:05.980 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:57:05.980 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:57:05.980 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:57:05.980 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:57:05.980 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:57:05.980 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:57:05.980 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:57:05.980 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:57:05.980 INFO:tasks.workunit.client.0.smithi120.stderr: 7f7f817fa640 / http_manager 2024-09-19T11:57:05.980 INFO:tasks.workunit.client.0.smithi120.stderr: 7f7f837fe640 / http_manager 2024-09-19T11:57:05.980 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8008fe1640 / rgw_dt_lg_renew 2024-09-19T11:57:05.981 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8023fff640 / ms_dispatch 2024-09-19T11:57:05.981 INFO:tasks.workunit.client.0.smithi120.stderr: 7f80357fa640 / io_context_pool 2024-09-19T11:57:05.981 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8035ffb640 / io_context_pool 2024-09-19T11:57:05.981 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8037fff640 / ms_dispatch 2024-09-19T11:57:05.981 INFO:tasks.workunit.client.0.smithi120.stderr: 7f803ee05640 / ms_dispatch 2024-09-19T11:57:05.981 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8040608640 / io_context_pool 2024-09-19T11:57:05.981 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8149be8640 / msgr-worker-2 2024-09-19T11:57:05.981 INFO:tasks.workunit.client.0.smithi120.stderr: 7f81523e9640 / msgr-worker-1 2024-09-19T11:57:05.981 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8152bea640 / msgr-worker-0 2024-09-19T11:57:05.981 INFO:tasks.workunit.client.0.smithi120.stderr: 7f81533eb640 / io_context_pool 2024-09-19T11:57:05.981 INFO:tasks.workunit.client.0.smithi120.stderr: 7f81548e39c0 / radosgw-admin 2024-09-19T11:57:05.981 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:57:05.981 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:57:05.981 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/lib/ceph/crash/2024-09-19T11:57:05.831159Z_148d2382-57fc-4536-b27b-adb1301cc6c2/log 2024-09-19T11:57:05.982 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:57:05.982 INFO:tasks.workunit.client.0.smithi120.stderr:Aborted 2024-09-19T11:57:05.982 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-19T11:57:05.983 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:05.983 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:05.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.915+0000 7fa4b8e2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.915+0000 7fa4b8e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.915+0000 7fa4b8e2f9c0 20 realm 2024-09-19T11:57:05.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.915+0000 7fa4b8e2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.915+0000 7fa4b8e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.915+0000 7fa4b8e2f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:05.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.915+0000 7fa4b8e2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.915+0000 7fa4b8e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:05.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.915+0000 7fa4b8e2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.919+0000 7fa4b8e2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:05.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.919+0000 7fa4b8e2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:05.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.919+0000 7fa4b8e2f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:05.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.919+0000 7fa4b8e2f9c0 20 searching for the correct realm 2024-09-19T11:57:05.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:05.923+0000 7fa4b7136640 0 -- 172.21.15.120:0/3423690649 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fa4a002c050 msgr2=0x7fa4a002c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:06.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.139+0000 7fa4ae134640 0 -- 172.21.15.120:0/3423690649 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fa4a80f7910 msgr2=0x7fa4a80db3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:06.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.355+0000 7fa4b8e2f9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:06.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.355+0000 7fa4b8e2f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:06.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.355+0000 7fa4b8e2f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:06.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.355+0000 7fa4b8e2f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:06.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.355+0000 7fa4b8e2f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:06.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.355+0000 7fa4b8e2f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:06.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.355+0000 7fa4b8e2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.355+0000 7fa4b8e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:06.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.355+0000 7fa4b8e2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:06.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:06.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 20 zone default found 2024-09-19T11:57:06.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 4 Realm: () 2024-09-19T11:57:06.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:06.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:06.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:06.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 20 zonegroup default 2024-09-19T11:57:06.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:06.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.359 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:06.359 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.359 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:06.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 20 started sync module instance, tier type = 2024-09-19T11:57:06.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.359+0000 7fa4b8e2f9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:06.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.383+0000 7fa4b8e2f9c0 20 add_watcher() i=0 2024-09-19T11:57:06.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.383+0000 7fa4b8e2f9c0 20 add_watcher() i=1 2024-09-19T11:57:06.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.383+0000 7fa4b8e2f9c0 20 add_watcher() i=2 2024-09-19T11:57:06.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.383+0000 7fa4b8e2f9c0 20 add_watcher() i=3 2024-09-19T11:57:06.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.383+0000 7fa4b8e2f9c0 20 add_watcher() i=4 2024-09-19T11:57:06.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.383+0000 7fa4b8e2f9c0 20 add_watcher() i=5 2024-09-19T11:57:06.384 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.383+0000 7fa4b8e2f9c0 20 add_watcher() i=6 2024-09-19T11:57:06.385 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.387+0000 7fa4b8e2f9c0 20 add_watcher() i=7 2024-09-19T11:57:06.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.387+0000 7fa4b8e2f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:06.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.391+0000 7fa36d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:06.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.391+0000 7fa4b8e2f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:06.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.391+0000 7fa4b8e2f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:06.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.391+0000 7fa4b8e2f9c0 5 note: GC not initialized 2024-09-19T11:57:06.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.391+0000 7fa2e7fff640 20 reqs_thread_entry: start 2024-09-19T11:57:06.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.391+0000 7fa4b8e2f9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:06.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.391+0000 7fa4b8e2f9c0 20 Filter name: none 2024-09-19T11:57:06.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.391+0000 7fa2e5ffb640 20 reqs_thread_entry: start 2024-09-19T11:57:06.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.391+0000 7fa4b8e2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.395+0000 7fa4b8e2f9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:06.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.395+0000 7fa4b8e2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.395+0000 7fa4b8e2f9c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-19T11:57:06.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.395+0000 7fa4b8e2f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:06.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.395+0000 7fa4b8e2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.395+0000 7fa4b8e2f9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:06.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.395+0000 7fa4b8e2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.395+0000 7fa4b8e2f9c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-19T11:57:06.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.395+0000 7fa4b8e2f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:06.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.399+0000 7fa36d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:06.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.403+0000 7fa4b8e2f9c0 20 remove_watcher() i=0 2024-09-19T11:57:06.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.403+0000 7fa4b8e2f9c0 2 removed watcher, disabling cache 2024-09-19T11:57:06.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.407+0000 7fa4b8e2f9c0 20 remove_watcher() i=1 2024-09-19T11:57:06.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.407+0000 7fa4b8e2f9c0 20 remove_watcher() i=2 2024-09-19T11:57:06.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.411+0000 7fa4b8e2f9c0 20 remove_watcher() i=3 2024-09-19T11:57:06.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.411+0000 7fa4b8e2f9c0 20 remove_watcher() i=4 2024-09-19T11:57:06.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.415+0000 7fa4b8e2f9c0 20 remove_watcher() i=5 2024-09-19T11:57:06.413 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.415+0000 7fa4b8e2f9c0 20 remove_watcher() i=6 2024-09-19T11:57:06.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.415+0000 7fa4b8e2f9c0 20 remove_watcher() i=7 2024-09-19T11:57:06.430 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:06.430 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:57:06.430 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-block-writes id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:57:06.430 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:06.489 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:57:06.525 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:06.525 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:06.570 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.571+0000 7f65a532a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.571+0000 7f65a532a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:06.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.571+0000 7f65a532a9c0 20 realm 2024-09-19T11:57:06.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.571+0000 7f65a532a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.575+0000 7f65a532a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:06.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.575+0000 7f65a532a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:06.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.575+0000 7f65a532a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.575+0000 7f65a532a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:06.572 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.575+0000 7f65a532a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.575+0000 7f65a532a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:06.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.575+0000 7f65a532a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.575+0000 7f65a532a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:06.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.575+0000 7f65a532a9c0 20 searching for the correct realm 2024-09-19T11:57:06.579 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.579+0000 7f65a2e30640 0 -- 172.21.15.120:0/577730686 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f659c004050 msgr2=0x7f659c10e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:06.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.795+0000 7f65a2e30640 0 -- 172.21.15.120:0/577730686 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f659c004050 msgr2=0x7f659c10e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:06.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.807+0000 7f65a532a9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:06.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.807+0000 7f65a532a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:06.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.807+0000 7f65a532a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:06.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.807+0000 7f65a532a9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:06.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.807+0000 7f65a532a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:06.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.807+0000 7f65a532a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:06.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.807+0000 7f65a532a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.807+0000 7f65a532a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:06.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.807+0000 7f65a532a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:06.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:06.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 20 zone default found 2024-09-19T11:57:06.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 4 Realm: () 2024-09-19T11:57:06.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:06.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:06.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:06.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 20 zonegroup default 2024-09-19T11:57:06.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:06.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:06.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:06.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 20 started sync module instance, tier type = 2024-09-19T11:57:06.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.811+0000 7f65a532a9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:06.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.835+0000 7f65a532a9c0 20 add_watcher() i=0 2024-09-19T11:57:06.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.835+0000 7f65a532a9c0 20 add_watcher() i=1 2024-09-19T11:57:06.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.835+0000 7f65a532a9c0 20 add_watcher() i=2 2024-09-19T11:57:06.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.835+0000 7f65a532a9c0 20 add_watcher() i=3 2024-09-19T11:57:06.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.835+0000 7f65a532a9c0 20 add_watcher() i=4 2024-09-19T11:57:06.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.835+0000 7f65a532a9c0 20 add_watcher() i=5 2024-09-19T11:57:06.836 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.835+0000 7f65a532a9c0 20 add_watcher() i=6 2024-09-19T11:57:06.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.839+0000 7f65a532a9c0 20 add_watcher() i=7 2024-09-19T11:57:06.837 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.839+0000 7f65a532a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:06.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.843+0000 7f64597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:06.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.843+0000 7f65a532a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:06.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.843+0000 7f65a532a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:06.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.843+0000 7f65a532a9c0 5 note: GC not initialized 2024-09-19T11:57:06.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.843+0000 7f63d3fff640 20 reqs_thread_entry: start 2024-09-19T11:57:06.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.843+0000 7f65a532a9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:06.843 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.843+0000 7f65a532a9c0 20 Filter name: none 2024-09-19T11:57:06.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.843+0000 7f63d1ffb640 20 reqs_thread_entry: start 2024-09-19T11:57:06.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.843+0000 7f65a532a9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-19T11:57:06.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.843+0000 7f65a532a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.847+0000 7f65a532a9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:06.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.847+0000 7f65a532a9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-19T11:57:06.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.847+0000 7f65a532a9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-19T11:57:06.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.847+0000 7f65a532a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 : miss 2024-09-19T11:57:06.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.847+0000 7f65a532a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:06.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.847+0000 7f65a532a9c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-19T11:57:06.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.847+0000 7f65a532a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:06.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.847+0000 7f65a532a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:06.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.847+0000 7f65a532a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:57:06.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.847+0000 7f65a532a9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:06.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.847+0000 7f65a532a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 2024-09-19T11:57:06.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.851+0000 7f65a532a9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to be held by another RGW process; skipping for now 2024-09-19T11:57:06.849 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.851+0000 7f64597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:06.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.855+0000 7f65a532a9c0 20 remove_watcher() i=0 2024-09-19T11:57:06.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.855+0000 7f65a532a9c0 2 removed watcher, disabling cache 2024-09-19T11:57:06.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.859+0000 7f65a532a9c0 20 remove_watcher() i=1 2024-09-19T11:57:06.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.859+0000 7f65a532a9c0 20 remove_watcher() i=2 2024-09-19T11:57:06.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.863+0000 7f65a532a9c0 20 remove_watcher() i=3 2024-09-19T11:57:06.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.863+0000 7f65a532a9c0 20 remove_watcher() i=4 2024-09-19T11:57:06.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.867+0000 7f65a532a9c0 20 remove_watcher() i=5 2024-09-19T11:57:06.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.867+0000 7f65a532a9c0 20 remove_watcher() i=6 2024-09-19T11:57:06.867 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:06.867+0000 7f65a532a9c0 20 remove_watcher() i=7 2024-09-19T11:57:06.882 INFO:tasks.workunit.client.0.smithi120.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T11:57:36.913 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:57:36.950 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:36.950 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:36.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:36.995+0000 7f36a28759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:36.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:36.999+0000 7f36a28759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:36.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:36.999+0000 7f36a28759c0 20 realm 2024-09-19T11:57:36.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:36.999+0000 7f36a28759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:36.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:36.999+0000 7f36a28759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:36.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:36.999+0000 7f36a28759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:36.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:36.999+0000 7f36a28759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:36.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:36.999+0000 7f36a28759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:36.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:36.999+0000 7f36a28759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:36.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:36.999+0000 7f36a28759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:36.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:36.999+0000 7f36a28759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.003+0000 7f36a28759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:37.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.003+0000 7f36a28759c0 20 searching for the correct realm 2024-09-19T11:57:37.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.007+0000 7f36a0b7c640 0 -- 172.21.15.120:0/3787097151 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f368807c070 msgr2=0x7f3688098810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:37.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.011+0000 7f369fb7a640 0 -- 172.21.15.120:0/3787097151 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f369005ff90 msgr2=0x7f3690068c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:37.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.227+0000 7f36a28759c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:37.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.227+0000 7f36a28759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:37.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.227+0000 7f36a28759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:37.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.227+0000 7f36a28759c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:37.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.227+0000 7f36a28759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:37.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.227+0000 7f36a28759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:37.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.227+0000 7f36a28759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.227+0000 7f36a28759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:37.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.227+0000 7f36a28759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:37.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:37.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 20 zone default found 2024-09-19T11:57:37.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 4 Realm: () 2024-09-19T11:57:37.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:37.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:37.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:37.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 20 zonegroup default 2024-09-19T11:57:37.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:37.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:37.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:37.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 20 started sync module instance, tier type = 2024-09-19T11:57:37.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.231+0000 7f36a28759c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:37.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.255+0000 7f36a28759c0 20 add_watcher() i=0 2024-09-19T11:57:37.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.255+0000 7f36a28759c0 20 add_watcher() i=1 2024-09-19T11:57:37.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.255+0000 7f36a28759c0 20 add_watcher() i=2 2024-09-19T11:57:37.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.255+0000 7f36a28759c0 20 add_watcher() i=3 2024-09-19T11:57:37.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.255+0000 7f36a28759c0 20 add_watcher() i=4 2024-09-19T11:57:37.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.255+0000 7f36a28759c0 20 add_watcher() i=5 2024-09-19T11:57:37.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.255+0000 7f36a28759c0 20 add_watcher() i=6 2024-09-19T11:57:37.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.259+0000 7f36a28759c0 20 add_watcher() i=7 2024-09-19T11:57:37.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.259+0000 7f36a28759c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:37.262 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.263+0000 7f3556fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:37.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.263+0000 7f36a28759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:37.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.263+0000 7f36a28759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:37.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.263+0000 7f36a28759c0 5 note: GC not initialized 2024-09-19T11:57:37.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f3555fdb640 20 reqs_thread_entry: start 2024-09-19T11:57:37.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f36a28759c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:37.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f36a28759c0 20 Filter name: none 2024-09-19T11:57:37.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f34c77fe640 20 reqs_thread_entry: start 2024-09-19T11:57:37.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f36a28759c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-19T11:57:37.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f36a28759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f36a28759c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:37.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f36a28759c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-19T11:57:37.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f36a28759c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-19T11:57:37.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f36a28759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 : miss 2024-09-19T11:57:37.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f36a28759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f36a28759c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-19T11:57:37.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f36a28759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:37.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f36a28759c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:37.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f36a28759c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:57:37.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f36a28759c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:37.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.267+0000 7f36a28759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 2024-09-19T11:57:37.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.271+0000 7f36a28759c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T11:57:37.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.279+0000 7f36a28759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:37.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.279+0000 7f36a28759c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:37.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.279+0000 7f36a28759c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:37.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.279+0000 7f36a28759c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30, ofs0, ns] 2024-09-19T11:57:37.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.279+0000 7f3576ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366243 cookie 94853229949088 notifier 6764 bl.length()=999 2024-09-19T11:57:37.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.279+0000 7f3576ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:37.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.279+0000 7f3576ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:37.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.279+0000 7f3576ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:37.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.279+0000 7f36a28759c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_sources= new_sources= 2024-09-19T11:57:37.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.279+0000 7f36a28759c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential sources added=[] removed=[] 2024-09-19T11:57:37.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.279+0000 7f36a28759c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_dests= new_dests= 2024-09-19T11:57:37.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.279+0000 7f36a28759c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential dests added=[] removed=[] 2024-09-19T11:57:37.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.287+0000 7f36a28759c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.2.0 2024-09-19T11:57:37.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.287+0000 7f36a28759c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.2.0 2024-09-19T11:57:37.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.287+0000 7f36a28759c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.2.1 2024-09-19T11:57:37.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.287+0000 7f36a28759c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.2.1 2024-09-19T11:57:37.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.287+0000 7f36a28759c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.0 2024-09-19T11:57:37.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.295+0000 7f36a28759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:37.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.295+0000 7f36a28759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 2024-09-19T11:57:37.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.295+0000 7f36a28759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:37.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.295+0000 7f36a28759c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:37.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.295+0000 7f36a28759c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:37.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.299+0000 7f36a28759c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30, ofs0, ns] 2024-09-19T11:57:37.297 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.299+0000 7f35777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366244 cookie 94853229949088 notifier 6764 bl.length()=999 2024-09-19T11:57:37.297 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.299+0000 7f35777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:37.297 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.299+0000 7f35777fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:37.297 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.299+0000 7f35777fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:37.297 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.299+0000 7f36a28759c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_sources= new_sources= 2024-09-19T11:57:37.298 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.299+0000 7f36a28759c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential sources added=[] removed=[] 2024-09-19T11:57:37.298 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.299+0000 7f36a28759c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_dests= new_dests= 2024-09-19T11:57:37.298 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.299+0000 7f36a28759c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential dests added=[] removed=[] 2024-09-19T11:57:37.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.303+0000 7f36a28759c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30.0 2024-09-19T11:57:37.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.303+0000 7f36a28759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:37.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.303+0000 7f36a28759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 2024-09-19T11:57:37.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.303+0000 7f36a28759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:37.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.303+0000 7f36a28759c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:37.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.303+0000 7f36a28759c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:37.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.303+0000 7f36a28759c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30, ofs0, ns] 2024-09-19T11:57:37.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.307+0000 7f3576ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366245 cookie 94853229949088 notifier 6764 bl.length()=967 2024-09-19T11:57:37.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.307+0000 7f3576ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 info.flags=0x17 2024-09-19T11:57:37.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.307+0000 7f3576ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 to cache LRU end 2024-09-19T11:57:37.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.307+0000 7f3576ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:37.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.307+0000 7f36a28759c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_sources= new_sources= 2024-09-19T11:57:37.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.307+0000 7f36a28759c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential sources added=[] removed=[] 2024-09-19T11:57:37.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.307+0000 7f36a28759c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): orig_dests= new_dests= 2024-09-19T11:57:37.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.307+0000 7f36a28759c0 20 handle_bi_update(): bucket=:abort-at-block-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30]): potential dests added=[] removed=[] 2024-09-19T11:57:37.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.307+0000 7f36a28759c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-19T11:57:37.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.315+0000 7f3556fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:37.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.319+0000 7f36a28759c0 20 remove_watcher() i=0 2024-09-19T11:57:37.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.319+0000 7f36a28759c0 2 removed watcher, disabling cache 2024-09-19T11:57:37.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.323+0000 7f36a28759c0 20 remove_watcher() i=1 2024-09-19T11:57:37.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.323+0000 7f36a28759c0 20 remove_watcher() i=2 2024-09-19T11:57:37.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.327+0000 7f36a28759c0 20 remove_watcher() i=3 2024-09-19T11:57:37.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.331+0000 7f36a28759c0 20 remove_watcher() i=4 2024-09-19T11:57:37.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.331+0000 7f36a28759c0 20 remove_watcher() i=5 2024-09-19T11:57:37.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.335+0000 7f36a28759c0 20 remove_watcher() i=6 2024-09-19T11:57:37.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.335+0000 7f36a28759c0 20 remove_watcher() i=7 2024-09-19T11:57:37.354 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-19T11:57:37.386 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:37.386 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:37.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.431+0000 7f2842ef59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.435+0000 7f2842ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:37.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.435+0000 7f2842ef59c0 20 realm 2024-09-19T11:57:37.433 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.435+0000 7f2842ef59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.435+0000 7f2842ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:37.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.435+0000 7f2842ef59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:37.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.435+0000 7f2842ef59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.435+0000 7f2842ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:37.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.435+0000 7f2842ef59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.435+0000 7f2842ef59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:37.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.435+0000 7f2842ef59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.439+0000 7f2842ef59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:37.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.439+0000 7f2842ef59c0 20 searching for the correct realm 2024-09-19T11:57:37.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.443+0000 7f28411fc640 0 -- 172.21.15.120:0/3156646001 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f2828070040 msgr2=0x7f2828080870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:37.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.659+0000 7f28401fa640 0 -- 172.21.15.120:0/3156646001 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f28380c2440 msgr2=0x7f28380c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:37.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.875+0000 7f2842ef59c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:37.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.875+0000 7f2842ef59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:37.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.875+0000 7f2842ef59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:37.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.875+0000 7f2842ef59c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:37.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.875+0000 7f2842ef59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:37.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.875+0000 7f2842ef59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:37.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.875+0000 7f2842ef59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:37.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:37.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:37.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 20 zone default found 2024-09-19T11:57:37.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 4 Realm: () 2024-09-19T11:57:37.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:37.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:37.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:37.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 20 zonegroup default 2024-09-19T11:57:37.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:37.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:37.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.879+0000 7f2842ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:37.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.883+0000 7f2842ef59c0 20 started sync module instance, tier type = 2024-09-19T11:57:37.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.883+0000 7f2842ef59c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:37.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.903+0000 7f2842ef59c0 20 add_watcher() i=0 2024-09-19T11:57:37.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.903+0000 7f2842ef59c0 20 add_watcher() i=1 2024-09-19T11:57:37.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.903+0000 7f2842ef59c0 20 add_watcher() i=2 2024-09-19T11:57:37.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.903+0000 7f2842ef59c0 20 add_watcher() i=3 2024-09-19T11:57:37.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.903+0000 7f2842ef59c0 20 add_watcher() i=4 2024-09-19T11:57:37.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.903+0000 7f2842ef59c0 20 add_watcher() i=5 2024-09-19T11:57:37.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.903+0000 7f2842ef59c0 20 add_watcher() i=6 2024-09-19T11:57:37.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.907+0000 7f2842ef59c0 20 add_watcher() i=7 2024-09-19T11:57:37.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.907+0000 7f2842ef59c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:37.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.911+0000 7f26f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:37.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.911+0000 7f2842ef59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:37.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.911+0000 7f2842ef59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:37.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.911+0000 7f2842ef59c0 5 note: GC not initialized 2024-09-19T11:57:37.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.915+0000 7f26f5fe3640 20 reqs_thread_entry: start 2024-09-19T11:57:37.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.915+0000 7f2842ef59c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:37.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.915+0000 7f2842ef59c0 20 Filter name: none 2024-09-19T11:57:37.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.915+0000 7f26677fe640 20 reqs_thread_entry: start 2024-09-19T11:57:37.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.915+0000 7f2842ef59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.915+0000 7f2842ef59c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:37.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.915+0000 7f2842ef59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.915+0000 7f2842ef59c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T11:57:37.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.915+0000 7f2842ef59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:37.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.915+0000 7f2842ef59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.915+0000 7f2842ef59c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-19T11:57:37.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.915+0000 7f2842ef59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:37.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.919+0000 7f2842ef59c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-19T11:57:37.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.919+0000 7f2842ef59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:37.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.919+0000 7f26f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:37.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.927+0000 7f2842ef59c0 20 remove_watcher() i=0 2024-09-19T11:57:37.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.927+0000 7f2842ef59c0 2 removed watcher, disabling cache 2024-09-19T11:57:37.926 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.927+0000 7f2842ef59c0 20 remove_watcher() i=1 2024-09-19T11:57:37.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.931+0000 7f2842ef59c0 20 remove_watcher() i=2 2024-09-19T11:57:37.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.931+0000 7f2842ef59c0 20 remove_watcher() i=3 2024-09-19T11:57:37.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.935+0000 7f2842ef59c0 20 remove_watcher() i=4 2024-09-19T11:57:37.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.935+0000 7f2842ef59c0 20 remove_watcher() i=5 2024-09-19T11:57:37.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.939+0000 7f2842ef59c0 20 remove_watcher() i=6 2024-09-19T11:57:37.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:37.939+0000 7f2842ef59c0 20 remove_watcher() i=7 2024-09-19T11:57:37.961 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:37.961 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:57:37.961 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-block-writes id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T11:57:37.961 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:38.056 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-19T11:57:38.056 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:38.543 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-19T11:57:38.576 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:38.576 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:38.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.623+0000 7f3b2009f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:38.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.627+0000 7f3b2009f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:38.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.627+0000 7f3b2009f9c0 20 realm 2024-09-19T11:57:38.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.627+0000 7f3b2009f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:38.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.627+0000 7f3b2009f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:38.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.627+0000 7f3b2009f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:38.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.627+0000 7f3b2009f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:38.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.627+0000 7f3b2009f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:38.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.627+0000 7f3b2009f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:38.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.627+0000 7f3b2009f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:38.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.627+0000 7f3b2009f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:38.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.631+0000 7f3b2009f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:38.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.631+0000 7f3b2009f9c0 20 searching for the correct realm 2024-09-19T11:57:38.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.635+0000 7f3b1e3a6640 0 -- 172.21.15.120:0/1191480489 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f3b14053070 msgr2=0x7f3b1404aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:38.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.643+0000 7f3b1d3a4640 0 -- 172.21.15.120:0/1191480489 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f3b10101c10 msgr2=0x7f3b100fe9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:38.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.859+0000 7f3b2009f9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:38.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.859+0000 7f3b2009f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:38.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.859+0000 7f3b2009f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:38.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.859+0000 7f3b2009f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:38.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.859+0000 7f3b2009f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:38.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.859+0000 7f3b2009f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:38.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.859+0000 7f3b2009f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:38.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:38.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:38.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:38.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:38.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:38.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 20 zone default found 2024-09-19T11:57:38.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 4 Realm: () 2024-09-19T11:57:38.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:38.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:38.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:38.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 20 zonegroup default 2024-09-19T11:57:38.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:38.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:38.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:38.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:38.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.863+0000 7f3b2009f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:38.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.867+0000 7f3b2009f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:38.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.867+0000 7f3b2009f9c0 20 started sync module instance, tier type = 2024-09-19T11:57:38.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.867+0000 7f3b2009f9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:38.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.887+0000 7f3b2009f9c0 20 add_watcher() i=0 2024-09-19T11:57:38.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.887+0000 7f3b2009f9c0 20 add_watcher() i=1 2024-09-19T11:57:38.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.887+0000 7f3b2009f9c0 20 add_watcher() i=2 2024-09-19T11:57:38.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.887+0000 7f3b2009f9c0 20 add_watcher() i=3 2024-09-19T11:57:38.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.887+0000 7f3b2009f9c0 20 add_watcher() i=4 2024-09-19T11:57:38.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.887+0000 7f3b2009f9c0 20 add_watcher() i=5 2024-09-19T11:57:38.888 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.887+0000 7f3b2009f9c0 20 add_watcher() i=6 2024-09-19T11:57:38.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.891+0000 7f3b2009f9c0 20 add_watcher() i=7 2024-09-19T11:57:38.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.891+0000 7f3b2009f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:38.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.895+0000 7f39cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:38.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.895+0000 7f3b2009f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:38.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.895+0000 7f3b2009f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:38.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.895+0000 7f3b2009f9c0 5 note: GC not initialized 2024-09-19T11:57:38.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.899+0000 7f39ce7fc640 20 reqs_thread_entry: start 2024-09-19T11:57:38.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.899+0000 7f3b2009f9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:38.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.899+0000 7f3b2009f9c0 20 Filter name: none 2024-09-19T11:57:38.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.899+0000 7f393ffff640 20 reqs_thread_entry: start 2024-09-19T11:57:38.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.899+0000 7f3b2009f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:38.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.899+0000 7f3b2009f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:38.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.899+0000 7f3b2009f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:38.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.903+0000 7f3b2009f9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:57:38.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.903+0000 7f3b2009f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:38.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.903+0000 7f3b2009f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:38.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.903+0000 7f3b2009f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:38.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.903+0000 7f3b2009f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:38.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.903+0000 7f3b2009f9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:57:38.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.903+0000 7f3b2009f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:38.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.907+0000 7f39cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:38.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.911+0000 7f3b2009f9c0 20 remove_watcher() i=0 2024-09-19T11:57:38.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.911+0000 7f3b2009f9c0 2 removed watcher, disabling cache 2024-09-19T11:57:38.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.915+0000 7f3b2009f9c0 20 remove_watcher() i=1 2024-09-19T11:57:38.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.915+0000 7f3b2009f9c0 20 remove_watcher() i=2 2024-09-19T11:57:38.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.919+0000 7f3b2009f9c0 20 remove_watcher() i=3 2024-09-19T11:57:38.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.919+0000 7f3b2009f9c0 20 remove_watcher() i=4 2024-09-19T11:57:38.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.923+0000 7f3b2009f9c0 20 remove_watcher() i=5 2024-09-19T11:57:38.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.923+0000 7f3b2009f9c0 20 remove_watcher() i=6 2024-09-19T11:57:38.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:38.923+0000 7f3b2009f9c0 20 remove_watcher() i=7 2024-09-19T11:57:38.937 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:38.937 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:57:38.937 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-commit-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:57:38.938 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:38.938 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-19T11:57:38.971 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:38.971 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:39.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.019+0000 7f9344d619c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.019+0000 7f9344d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.019+0000 7f9344d619c0 20 realm 2024-09-19T11:57:39.017 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.019+0000 7f9344d619c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.019+0000 7f9344d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.019+0000 7f9344d619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:39.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.019+0000 7f9344d619c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.019+0000 7f9344d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.019+0000 7f9344d619c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.019+0000 7f9344d619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:39.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.019+0000 7f9344d619c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.023+0000 7f9344d619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:39.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.023+0000 7f9344d619c0 20 searching for the correct realm 2024-09-19T11:57:39.024 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.027+0000 7f9343068640 0 -- 172.21.15.120:0/1027765396 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f932c040070 msgr2=0x7f932c04e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:39.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.035+0000 7f933bfff640 0 -- 172.21.15.120:0/1027765396 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x5612f1bfdad0 msgr2=0x7f9334101f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:39.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.251+0000 7f9344d619c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:39.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.251+0000 7f9344d619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:39.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.251+0000 7f9344d619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:39.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.251+0000 7f9344d619c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:39.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.251+0000 7f9344d619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:39.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.251+0000 7f9344d619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:39.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.251+0000 7f9344d619c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.251+0000 7f9344d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.251+0000 7f9344d619c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:39.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:39.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 20 zone default found 2024-09-19T11:57:39.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 4 Realm: () 2024-09-19T11:57:39.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:39.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:39.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:39.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 20 zonegroup default 2024-09-19T11:57:39.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 20 started sync module instance, tier type = 2024-09-19T11:57:39.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.255+0000 7f9344d619c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:39.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.283+0000 7f9344d619c0 20 add_watcher() i=0 2024-09-19T11:57:39.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.283+0000 7f9344d619c0 20 add_watcher() i=1 2024-09-19T11:57:39.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.283+0000 7f9344d619c0 20 add_watcher() i=2 2024-09-19T11:57:39.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.283+0000 7f9344d619c0 20 add_watcher() i=3 2024-09-19T11:57:39.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.283+0000 7f9344d619c0 20 add_watcher() i=4 2024-09-19T11:57:39.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.283+0000 7f9344d619c0 20 add_watcher() i=5 2024-09-19T11:57:39.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.283+0000 7f9344d619c0 20 add_watcher() i=6 2024-09-19T11:57:39.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.283+0000 7f9344d619c0 20 add_watcher() i=7 2024-09-19T11:57:39.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.283+0000 7f9344d619c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:39.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.287+0000 7f91f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:39.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.287+0000 7f9344d619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:39.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.287+0000 7f9344d619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:39.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.287+0000 7f9344d619c0 5 note: GC not initialized 2024-09-19T11:57:39.288 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f91f8fe1640 20 reqs_thread_entry: start 2024-09-19T11:57:39.288 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f9344d619c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:39.288 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f9344d619c0 20 Filter name: none 2024-09-19T11:57:39.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f91f1ffb640 20 reqs_thread_entry: start 2024-09-19T11:57:39.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f9344d619c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-19T11:57:39.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f9344d619c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f9344d619c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:39.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f9344d619c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-19T11:57:39.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f9344d619c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-19T11:57:39.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f9344d619c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 : miss 2024-09-19T11:57:39.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f9344d619c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f9344d619c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:57:39.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f9344d619c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 info.flags=0x17 2024-09-19T11:57:39.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f9344d619c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 to cache LRU end 2024-09-19T11:57:39.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f9344d619c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:57:39.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f9344d619c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:39.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.291+0000 7f9344d619c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 2024-09-19T11:57:39.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.303+0000 7f9344d619c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 info.flags=0x17 2024-09-19T11:57:39.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.303+0000 7f9344d619c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 to cache LRU end 2024-09-19T11:57:39.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.303+0000 7f9344d619c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:39.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.303+0000 7f9344d619c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31, ofs0, ns] 2024-09-19T11:57:39.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.303+0000 7f92267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366250 cookie 94639367647504 notifier 6815 bl.length()=1015 2024-09-19T11:57:39.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.303+0000 7f92267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 info.flags=0x17 2024-09-19T11:57:39.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.303+0000 7f92267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 to cache LRU end 2024-09-19T11:57:39.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.303+0000 7f92267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:39.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.303+0000 7f9344d619c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): orig_sources= new_sources= 2024-09-19T11:57:39.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.303+0000 7f9344d619c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): potential sources added=[] removed=[] 2024-09-19T11:57:39.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.303+0000 7f9344d619c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): orig_dests= new_dests= 2024-09-19T11:57:39.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.303+0000 7f9344d619c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): potential dests added=[] removed=[] 2024-09-19T11:57:39.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.307+0000 7f9344d619c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31.1.0 2024-09-19T11:57:39.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.307+0000 7f9344d619c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31.1.0 2024-09-19T11:57:39.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.307+0000 7f9344d619c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31.1.1 2024-09-19T11:57:39.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.307+0000 7f9344d619c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31.1.1 2024-09-19T11:57:39.308 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.307+0000 7f9344d619c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31.0 2024-09-19T11:57:39.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.315+0000 7f9344d619c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:39.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.315+0000 7f9344d619c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 2024-09-19T11:57:39.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.315+0000 7f9344d619c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 info.flags=0x17 2024-09-19T11:57:39.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.315+0000 7f9344d619c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 to cache LRU end 2024-09-19T11:57:39.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.315+0000 7f9344d619c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:39.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.315+0000 7f9344d619c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31, ofs0, ns] 2024-09-19T11:57:39.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.319+0000 7f92267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366251 cookie 94639367647504 notifier 6815 bl.length()=1015 2024-09-19T11:57:39.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.319+0000 7f92267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 info.flags=0x17 2024-09-19T11:57:39.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.319+0000 7f92267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 to cache LRU end 2024-09-19T11:57:39.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.319+0000 7f92267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:39.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.319+0000 7f9344d619c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): orig_sources= new_sources= 2024-09-19T11:57:39.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.319+0000 7f9344d619c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): potential sources added=[] removed=[] 2024-09-19T11:57:39.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.319+0000 7f9344d619c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): orig_dests= new_dests= 2024-09-19T11:57:39.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.319+0000 7f9344d619c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): potential dests added=[] removed=[] 2024-09-19T11:57:39.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.323+0000 7f9344d619c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31.0 2024-09-19T11:57:39.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.323+0000 7f9344d619c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-19T11:57:39.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.323+0000 7f9344d619c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-19T11:57:39.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.331+0000 7f91f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:39.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.335+0000 7f9344d619c0 20 remove_watcher() i=0 2024-09-19T11:57:39.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.335+0000 7f9344d619c0 2 removed watcher, disabling cache 2024-09-19T11:57:39.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.335+0000 7f9344d619c0 20 remove_watcher() i=1 2024-09-19T11:57:39.337 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.339+0000 7f9344d619c0 20 remove_watcher() i=2 2024-09-19T11:57:39.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.343+0000 7f9344d619c0 20 remove_watcher() i=3 2024-09-19T11:57:39.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.343+0000 7f9344d619c0 20 remove_watcher() i=4 2024-09-19T11:57:39.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.343+0000 7f9344d619c0 20 remove_watcher() i=5 2024-09-19T11:57:39.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.347+0000 7f9344d619c0 20 remove_watcher() i=6 2024-09-19T11:57:39.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.347+0000 7f9344d619c0 20 remove_watcher() i=7 2024-09-19T11:57:39.361 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-19T11:57:39.392 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:39.392 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:39.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.435+0000 7f95415a59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.439+0000 7f95415a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.439+0000 7f95415a59c0 20 realm 2024-09-19T11:57:39.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.439+0000 7f95415a59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.439+0000 7f95415a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.439+0000 7f95415a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:39.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.439+0000 7f95415a59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.439+0000 7f95415a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.439+0000 7f95415a59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.439+0000 7f95415a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:39.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.439+0000 7f95415a59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.443+0000 7f95415a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:39.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.443+0000 7f95415a59c0 20 searching for the correct realm 2024-09-19T11:57:39.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.447+0000 7f953f0ab640 0 -- 172.21.15.120:0/1024447150 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f95380d0070 msgr2=0x7f95380ea940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:39.664 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.667+0000 7f953f0ab640 0 -- 172.21.15.120:0/1024447150 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f95380d0070 msgr2=0x7f95380ea940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:39.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:39.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:39.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:39.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:39.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:39.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:39.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:39.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:39.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 zone default found 2024-09-19T11:57:39.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 4 Realm: () 2024-09-19T11:57:39.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:39.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:39.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:39.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 zonegroup default 2024-09-19T11:57:39.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.679+0000 7f95415a59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.683+0000 7f95415a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.683+0000 7f95415a59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.683+0000 7f95415a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.683+0000 7f95415a59c0 20 started sync module instance, tier type = 2024-09-19T11:57:39.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.683+0000 7f95415a59c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:39.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.707+0000 7f95415a59c0 20 add_watcher() i=0 2024-09-19T11:57:39.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.707+0000 7f95415a59c0 20 add_watcher() i=1 2024-09-19T11:57:39.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.707+0000 7f95415a59c0 20 add_watcher() i=2 2024-09-19T11:57:39.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.707+0000 7f95415a59c0 20 add_watcher() i=3 2024-09-19T11:57:39.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.707+0000 7f95415a59c0 20 add_watcher() i=4 2024-09-19T11:57:39.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.707+0000 7f95415a59c0 20 add_watcher() i=5 2024-09-19T11:57:39.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.707+0000 7f95415a59c0 20 add_watcher() i=6 2024-09-19T11:57:39.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.711+0000 7f95415a59c0 20 add_watcher() i=7 2024-09-19T11:57:39.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.711+0000 7f95415a59c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:39.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.719+0000 7f93f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:39.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.719+0000 7f95415a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:39.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.719+0000 7f95415a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:39.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.719+0000 7f95415a59c0 5 note: GC not initialized 2024-09-19T11:57:39.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.719+0000 7f93f4fe1640 20 reqs_thread_entry: start 2024-09-19T11:57:39.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.719+0000 7f95415a59c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:39.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.719+0000 7f95415a59c0 20 Filter name: none 2024-09-19T11:57:39.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.719+0000 7f95415a59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.719+0000 7f936e7fc640 20 reqs_thread_entry: start 2024-09-19T11:57:39.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.719+0000 7f95415a59c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:39.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.719+0000 7f95415a59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.719+0000 7f95415a59c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T11:57:39.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.719+0000 7f95415a59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:39.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.719+0000 7f95415a59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.723+0000 7f95415a59c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:39.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.723+0000 7f95415a59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.723+0000 7f95415a59c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T11:57:39.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.723+0000 7f95415a59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:39.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.723+0000 7f93f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:39.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.731+0000 7f95415a59c0 20 remove_watcher() i=0 2024-09-19T11:57:39.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.731+0000 7f95415a59c0 2 removed watcher, disabling cache 2024-09-19T11:57:39.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.731+0000 7f95415a59c0 20 remove_watcher() i=1 2024-09-19T11:57:39.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.735+0000 7f95415a59c0 20 remove_watcher() i=2 2024-09-19T11:57:39.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.735+0000 7f95415a59c0 20 remove_watcher() i=3 2024-09-19T11:57:39.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.739+0000 7f95415a59c0 20 remove_watcher() i=4 2024-09-19T11:57:39.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.739+0000 7f95415a59c0 20 remove_watcher() i=5 2024-09-19T11:57:39.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.743+0000 7f95415a59c0 20 remove_watcher() i=6 2024-09-19T11:57:39.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.743+0000 7f95415a59c0 20 remove_watcher() i=7 2024-09-19T11:57:39.758 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:39.758 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:57:39.758 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-commit-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:57:39.758 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:39.817 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:57:39.854 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:39.854 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:39.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.903+0000 7f7acf2519c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.903+0000 7f7acf2519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.903+0000 7f7acf2519c0 20 realm 2024-09-19T11:57:39.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.903+0000 7f7acf2519c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.903+0000 7f7acf2519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.903+0000 7f7acf2519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:39.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.903+0000 7f7acf2519c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.903+0000 7f7acf2519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:39.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.903+0000 7f7acf2519c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.903+0000 7f7acf2519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:39.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.903+0000 7f7acf2519c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:39.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.907+0000 7f7acf2519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:39.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.907+0000 7f7acf2519c0 20 searching for the correct realm 2024-09-19T11:57:39.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:39.911+0000 7f7acd558640 0 -- 172.21.15.120:0/4111243888 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f7ab8008040 msgr2=0x7f7ab8077ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:40.125 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.127+0000 7f7ac7fff640 0 -- 172.21.15.120:0/4111243888 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f7ac0078020 msgr2=0x7f7ac00787f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:40.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.343+0000 7f7acf2519c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:40.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.343+0000 7f7acf2519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:40.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.343+0000 7f7acf2519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:40.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.343+0000 7f7acf2519c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:40.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.343+0000 7f7acf2519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:40.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.343+0000 7f7acf2519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:40.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.343+0000 7f7acf2519c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.343+0000 7f7acf2519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:40.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.343+0000 7f7acf2519c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.347+0000 7f7acf2519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:40.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.347+0000 7f7acf2519c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.347+0000 7f7acf2519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:40.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.347+0000 7f7acf2519c0 20 zone default found 2024-09-19T11:57:40.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.347+0000 7f7acf2519c0 4 Realm: () 2024-09-19T11:57:40.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.347+0000 7f7acf2519c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:40.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.347+0000 7f7acf2519c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:40.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.347+0000 7f7acf2519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:40.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.347+0000 7f7acf2519c0 20 zonegroup default 2024-09-19T11:57:40.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.347+0000 7f7acf2519c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.347+0000 7f7acf2519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:40.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.347+0000 7f7acf2519c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.347+0000 7f7acf2519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:40.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.347+0000 7f7acf2519c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.351+0000 7f7acf2519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:40.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.351+0000 7f7acf2519c0 20 started sync module instance, tier type = 2024-09-19T11:57:40.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.351+0000 7f7acf2519c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:40.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.371+0000 7f7acf2519c0 20 add_watcher() i=0 2024-09-19T11:57:40.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.371+0000 7f7acf2519c0 20 add_watcher() i=1 2024-09-19T11:57:40.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.371+0000 7f7acf2519c0 20 add_watcher() i=2 2024-09-19T11:57:40.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.371+0000 7f7acf2519c0 20 add_watcher() i=3 2024-09-19T11:57:40.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.371+0000 7f7acf2519c0 20 add_watcher() i=4 2024-09-19T11:57:40.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.371+0000 7f7acf2519c0 20 add_watcher() i=5 2024-09-19T11:57:40.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.371+0000 7f7acf2519c0 20 add_watcher() i=6 2024-09-19T11:57:40.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.375+0000 7f7acf2519c0 20 add_watcher() i=7 2024-09-19T11:57:40.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.375+0000 7f7acf2519c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:40.376 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.379+0000 7f7982fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:40.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.379+0000 7f7acf2519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:40.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.379+0000 7f7acf2519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:40.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.379+0000 7f7acf2519c0 5 note: GC not initialized 2024-09-19T11:57:40.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.379+0000 7f7981fe3640 20 reqs_thread_entry: start 2024-09-19T11:57:40.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.379+0000 7f7acf2519c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:40.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.379+0000 7f7acf2519c0 20 Filter name: none 2024-09-19T11:57:40.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.379+0000 7f78f37fe640 20 reqs_thread_entry: start 2024-09-19T11:57:40.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.379+0000 7f7acf2519c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-19T11:57:40.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.379+0000 7f7acf2519c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.379+0000 7f7acf2519c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:40.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.379+0000 7f7acf2519c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-19T11:57:40.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.379+0000 7f7acf2519c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-19T11:57:40.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.379+0000 7f7acf2519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 : miss 2024-09-19T11:57:40.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.379+0000 7f7acf2519c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.383+0000 7f7acf2519c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T11:57:40.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.383+0000 7f7acf2519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 info.flags=0x17 2024-09-19T11:57:40.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.383+0000 7f7acf2519c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 to cache LRU end 2024-09-19T11:57:40.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.383+0000 7f7acf2519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:57:40.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.383+0000 7f7acf2519c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:40.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.383+0000 7f7acf2519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 2024-09-19T11:57:40.383 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.383+0000 7f7acf2519c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T11:57:40.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.395+0000 7f7acf2519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 info.flags=0x17 2024-09-19T11:57:40.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.395+0000 7f7acf2519c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 to cache LRU end 2024-09-19T11:57:40.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.395+0000 7f7acf2519c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:40.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.395+0000 7f7acf2519c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31, ofs0, ns] 2024-09-19T11:57:40.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.395+0000 7f79a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366252 cookie 94641431205632 notifier 6848 bl.length()=1015 2024-09-19T11:57:40.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.395+0000 7f79a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 info.flags=0x17 2024-09-19T11:57:40.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.395+0000 7f79a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 to cache LRU end 2024-09-19T11:57:40.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.395+0000 7f79a3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:40.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.395+0000 7f7acf2519c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): orig_sources= new_sources= 2024-09-19T11:57:40.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.395+0000 7f7acf2519c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): potential sources added=[] removed=[] 2024-09-19T11:57:40.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.395+0000 7f7acf2519c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): orig_dests= new_dests= 2024-09-19T11:57:40.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.395+0000 7f7acf2519c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): potential dests added=[] removed=[] 2024-09-19T11:57:40.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.399+0000 7f7acf2519c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31.2.0 2024-09-19T11:57:40.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.399+0000 7f7acf2519c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31.2.0 2024-09-19T11:57:40.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.399+0000 7f7acf2519c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31.2.1 2024-09-19T11:57:40.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.399+0000 7f7acf2519c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31.2.1 2024-09-19T11:57:40.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.399+0000 7f7acf2519c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31.0 2024-09-19T11:57:40.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.407+0000 7f7acf2519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:40.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.407+0000 7f7acf2519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 2024-09-19T11:57:40.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.411+0000 7f7acf2519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 info.flags=0x17 2024-09-19T11:57:40.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.411+0000 7f7acf2519c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 to cache LRU end 2024-09-19T11:57:40.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.411+0000 7f7acf2519c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:40.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.411+0000 7f7acf2519c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31, ofs0, ns] 2024-09-19T11:57:40.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.411+0000 7f79a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366253 cookie 94641431205632 notifier 6848 bl.length()=1015 2024-09-19T11:57:40.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.411+0000 7f79a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 info.flags=0x17 2024-09-19T11:57:40.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.411+0000 7f79a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 to cache LRU end 2024-09-19T11:57:40.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.411+0000 7f79a3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:40.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.415+0000 7f7acf2519c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): orig_sources= new_sources= 2024-09-19T11:57:40.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.415+0000 7f7acf2519c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): potential sources added=[] removed=[] 2024-09-19T11:57:40.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.415+0000 7f7acf2519c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): orig_dests= new_dests= 2024-09-19T11:57:40.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.415+0000 7f7acf2519c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): potential dests added=[] removed=[] 2024-09-19T11:57:40.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.415+0000 7f7acf2519c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31.0 2024-09-19T11:57:40.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.415+0000 7f7acf2519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:40.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.415+0000 7f7acf2519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 2024-09-19T11:57:40.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.419+0000 7f7acf2519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 info.flags=0x17 2024-09-19T11:57:40.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.419+0000 7f7acf2519c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 to cache LRU end 2024-09-19T11:57:40.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.419+0000 7f7acf2519c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:40.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.419+0000 7f7acf2519c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31, ofs0, ns] 2024-09-19T11:57:40.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.419+0000 7f79a37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366254 cookie 94641431205632 notifier 6848 bl.length()=983 2024-09-19T11:57:40.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.419+0000 7f79a37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 info.flags=0x17 2024-09-19T11:57:40.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.419+0000 7f79a37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 to cache LRU end 2024-09-19T11:57:40.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.419+0000 7f79a37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:40.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.423+0000 7f7acf2519c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): orig_sources= new_sources= 2024-09-19T11:57:40.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.423+0000 7f7acf2519c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): potential sources added=[] removed=[] 2024-09-19T11:57:40.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.423+0000 7f7acf2519c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): orig_dests= new_dests= 2024-09-19T11:57:40.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.423+0000 7f7acf2519c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31]): potential dests added=[] removed=[] 2024-09-19T11:57:40.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.423+0000 7f7acf2519c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-19T11:57:40.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.427+0000 7f7982fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:40.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.435+0000 7f7acf2519c0 20 remove_watcher() i=0 2024-09-19T11:57:40.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.435+0000 7f7acf2519c0 2 removed watcher, disabling cache 2024-09-19T11:57:40.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.435+0000 7f7acf2519c0 20 remove_watcher() i=1 2024-09-19T11:57:40.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.439+0000 7f7acf2519c0 20 remove_watcher() i=2 2024-09-19T11:57:40.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.439+0000 7f7acf2519c0 20 remove_watcher() i=3 2024-09-19T11:57:40.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.443+0000 7f7acf2519c0 20 remove_watcher() i=4 2024-09-19T11:57:40.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.443+0000 7f7acf2519c0 20 remove_watcher() i=5 2024-09-19T11:57:40.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.447+0000 7f7acf2519c0 20 remove_watcher() i=6 2024-09-19T11:57:40.446 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.447+0000 7f7acf2519c0 20 remove_watcher() i=7 2024-09-19T11:57:40.463 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-19T11:57:40.493 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:40.493 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:40.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.539+0000 7fa13d0e59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.539+0000 7fa13d0e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:40.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.539+0000 7fa13d0e59c0 20 realm 2024-09-19T11:57:40.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.539+0000 7fa13d0e59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.543+0000 7fa13d0e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:40.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.543+0000 7fa13d0e59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:40.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.543+0000 7fa13d0e59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.543+0000 7fa13d0e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:40.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.543+0000 7fa13d0e59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.543+0000 7fa13d0e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:40.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.543+0000 7fa13d0e59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.543+0000 7fa13d0e59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:40.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.543+0000 7fa13d0e59c0 20 searching for the correct realm 2024-09-19T11:57:40.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.547+0000 7fa13abeb640 0 -- 172.21.15.120:0/3733038095 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fa1341086e0 msgr2=0x7fa1340cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:57:40.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.763+0000 7fa13abeb640 0 -- 172.21.15.120:0/3733038095 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fa1341086e0 msgr2=0x7fa1340cf420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:40.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:40.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:40.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:40.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:40.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:40.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:40.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:40.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:40.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:40.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 20 zone default found 2024-09-19T11:57:40.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 4 Realm: () 2024-09-19T11:57:40.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:40.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:40.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:40.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 20 zonegroup default 2024-09-19T11:57:40.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.775+0000 7fa13d0e59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.779+0000 7fa13d0e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:40.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.779+0000 7fa13d0e59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.779+0000 7fa13d0e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:40.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.779+0000 7fa13d0e59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.779+0000 7fa13d0e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:40.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.779+0000 7fa13d0e59c0 20 started sync module instance, tier type = 2024-09-19T11:57:40.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.779+0000 7fa13d0e59c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:40.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.803+0000 7fa13d0e59c0 20 add_watcher() i=0 2024-09-19T11:57:40.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.803+0000 7fa13d0e59c0 20 add_watcher() i=1 2024-09-19T11:57:40.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.803+0000 7fa13d0e59c0 20 add_watcher() i=2 2024-09-19T11:57:40.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.803+0000 7fa13d0e59c0 20 add_watcher() i=3 2024-09-19T11:57:40.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.803+0000 7fa13d0e59c0 20 add_watcher() i=4 2024-09-19T11:57:40.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.803+0000 7fa13d0e59c0 20 add_watcher() i=5 2024-09-19T11:57:40.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.803+0000 7fa13d0e59c0 20 add_watcher() i=6 2024-09-19T11:57:40.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.803+0000 7fa13d0e59c0 20 add_watcher() i=7 2024-09-19T11:57:40.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.803+0000 7fa13d0e59c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:40.807 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.807+0000 7f9ff1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:40.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.811+0000 7fa13d0e59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:40.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.811+0000 7fa13d0e59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:40.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.811+0000 7fa13d0e59c0 5 note: GC not initialized 2024-09-19T11:57:40.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.811+0000 7f9ff0fe1640 20 reqs_thread_entry: start 2024-09-19T11:57:40.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.811+0000 7fa13d0e59c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:40.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.811+0000 7fa13d0e59c0 20 Filter name: none 2024-09-19T11:57:40.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.811+0000 7f9fe9ffb640 20 reqs_thread_entry: start 2024-09-19T11:57:40.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.811+0000 7fa13d0e59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.811+0000 7fa13d0e59c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:40.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.811+0000 7fa13d0e59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.815+0000 7fa13d0e59c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:57:40.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.815+0000 7fa13d0e59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:40.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.815+0000 7fa13d0e59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.815+0000 7fa13d0e59c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:40.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.815+0000 7fa13d0e59c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:40.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.815+0000 7fa13d0e59c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:57:40.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.815+0000 7fa13d0e59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:40.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.819+0000 7f9ff1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:40.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.823+0000 7fa13d0e59c0 20 remove_watcher() i=0 2024-09-19T11:57:40.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.823+0000 7fa13d0e59c0 2 removed watcher, disabling cache 2024-09-19T11:57:40.824 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.827+0000 7fa13d0e59c0 20 remove_watcher() i=1 2024-09-19T11:57:40.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.827+0000 7fa13d0e59c0 20 remove_watcher() i=2 2024-09-19T11:57:40.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.831+0000 7fa13d0e59c0 20 remove_watcher() i=3 2024-09-19T11:57:40.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.831+0000 7fa13d0e59c0 20 remove_watcher() i=4 2024-09-19T11:57:40.832 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.835+0000 7fa13d0e59c0 20 remove_watcher() i=5 2024-09-19T11:57:40.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.835+0000 7fa13d0e59c0 20 remove_watcher() i=6 2024-09-19T11:57:40.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:40.839+0000 7fa13d0e59c0 20 remove_watcher() i=7 2024-09-19T11:57:40.857 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:40.857 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:57:40.857 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-commit-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T11:57:40.857 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:40.958 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-19T11:57:40.958 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:41.431 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-19T11:57:41.464 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:41.464 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:41.510 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.511+0000 7f27aeb469c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.515+0000 7f27aeb469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:41.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.515+0000 7f27aeb469c0 20 realm 2024-09-19T11:57:41.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.515+0000 7f27aeb469c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.515+0000 7f27aeb469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:41.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.515+0000 7f27aeb469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:41.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.515+0000 7f27aeb469c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.515+0000 7f27aeb469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:41.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.515+0000 7f27aeb469c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.515+0000 7f27aeb469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:41.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.515+0000 7f27aeb469c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.519+0000 7f27aeb469c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:41.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.519+0000 7f27aeb469c0 20 searching for the correct realm 2024-09-19T11:57:41.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.519+0000 7f27ace4d640 0 -- 172.21.15.120:0/2991591430 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f279411e040 msgr2=0x7f27940fdb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:41.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.527+0000 7f27abe4b640 0 -- 172.21.15.120:0/2991591430 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f279c09c250 msgr2=0x7f279c06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:41.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.743+0000 7f27aeb469c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:41.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.743+0000 7f27aeb469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:41.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.743+0000 7f27aeb469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:41.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.743+0000 7f27aeb469c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:41.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.743+0000 7f27aeb469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:41.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.743+0000 7f27aeb469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:41.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.743+0000 7f27aeb469c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.744 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.743+0000 7f27aeb469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:41.744 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.743+0000 7f27aeb469c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.744 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:41.744 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:41.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 20 zone default found 2024-09-19T11:57:41.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 4 Realm: () 2024-09-19T11:57:41.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:41.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:41.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:41.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 20 zonegroup default 2024-09-19T11:57:41.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:41.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:41.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:41.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 20 started sync module instance, tier type = 2024-09-19T11:57:41.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.747+0000 7f27aeb469c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:41.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.771+0000 7f27aeb469c0 20 add_watcher() i=0 2024-09-19T11:57:41.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.771+0000 7f27aeb469c0 20 add_watcher() i=1 2024-09-19T11:57:41.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.771+0000 7f27aeb469c0 20 add_watcher() i=2 2024-09-19T11:57:41.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.771+0000 7f27aeb469c0 20 add_watcher() i=3 2024-09-19T11:57:41.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.771+0000 7f27aeb469c0 20 add_watcher() i=4 2024-09-19T11:57:41.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.771+0000 7f27aeb469c0 20 add_watcher() i=5 2024-09-19T11:57:41.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.771+0000 7f27aeb469c0 20 add_watcher() i=6 2024-09-19T11:57:41.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.771+0000 7f27aeb469c0 20 add_watcher() i=7 2024-09-19T11:57:41.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.771+0000 7f27aeb469c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:41.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.775+0000 7f2662fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:41.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.775+0000 7f27aeb469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:41.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.775+0000 7f27aeb469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:41.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.775+0000 7f27aeb469c0 5 note: GC not initialized 2024-09-19T11:57:41.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.779+0000 7f2661fdb640 20 reqs_thread_entry: start 2024-09-19T11:57:41.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.779+0000 7f27aeb469c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:41.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.779+0000 7f27aeb469c0 20 Filter name: none 2024-09-19T11:57:41.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.779+0000 7f25d37fe640 20 reqs_thread_entry: start 2024-09-19T11:57:41.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.779+0000 7f27aeb469c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.779+0000 7f27aeb469c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:41.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.779+0000 7f27aeb469c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.779+0000 7f27aeb469c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:57:41.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.779+0000 7f27aeb469c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:41.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.779+0000 7f27aeb469c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.779+0000 7f27aeb469c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:41.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.779+0000 7f27aeb469c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.783+0000 7f27aeb469c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:57:41.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.783+0000 7f27aeb469c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:41.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.783+0000 7f2662fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:41.787 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.787+0000 7f27aeb469c0 20 remove_watcher() i=0 2024-09-19T11:57:41.787 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.787+0000 7f27aeb469c0 2 removed watcher, disabling cache 2024-09-19T11:57:41.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.791+0000 7f27aeb469c0 20 remove_watcher() i=1 2024-09-19T11:57:41.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.791+0000 7f27aeb469c0 20 remove_watcher() i=2 2024-09-19T11:57:41.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.795+0000 7f27aeb469c0 20 remove_watcher() i=3 2024-09-19T11:57:41.796 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.799+0000 7f27aeb469c0 20 remove_watcher() i=4 2024-09-19T11:57:41.797 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.799+0000 7f27aeb469c0 20 remove_watcher() i=5 2024-09-19T11:57:41.799 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.799+0000 7f27aeb469c0 20 remove_watcher() i=6 2024-09-19T11:57:41.801 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.803+0000 7f27aeb469c0 20 remove_watcher() i=7 2024-09-19T11:57:41.817 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:41.817 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:57:41.817 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-commit-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:57:41.817 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:41.817 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-19T11:57:41.856 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:41.856 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:41.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.903+0000 7f1a6491f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.903+0000 7f1a6491f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:41.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.903+0000 7f1a6491f9c0 20 realm 2024-09-19T11:57:41.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.903+0000 7f1a6491f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.903+0000 7f1a6491f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:41.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.903+0000 7f1a6491f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:41.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.903+0000 7f1a6491f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.903+0000 7f1a6491f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:41.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.903+0000 7f1a6491f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.907+0000 7f1a6491f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:41.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.907+0000 7f1a6491f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:41.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.907+0000 7f1a6491f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:41.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.907+0000 7f1a6491f9c0 20 searching for the correct realm 2024-09-19T11:57:41.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:41.907+0000 7f1a61c24640 0 -- 172.21.15.120:0/142170925 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7f1a540ac950 msgr2=0x7f1a540ba430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:42.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.119+0000 7f1a62c26640 0 -- 172.21.15.120:0/142170925 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f1a58033060 msgr2=0x7f1a58062f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:42.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:42.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:42.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:42.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:42.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:42.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:42.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:42.137 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:42.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:42.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 zone default found 2024-09-19T11:57:42.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 4 Realm: () 2024-09-19T11:57:42.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:42.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:42.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:42.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 zonegroup default 2024-09-19T11:57:42.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:42.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.139+0000 7f1a6491f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.143+0000 7f1a6491f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:42.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.143+0000 7f1a6491f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.143+0000 7f1a6491f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:42.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.143+0000 7f1a6491f9c0 20 started sync module instance, tier type = 2024-09-19T11:57:42.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.143+0000 7f1a6491f9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:42.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.167+0000 7f1a6491f9c0 20 add_watcher() i=0 2024-09-19T11:57:42.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.167+0000 7f1a6491f9c0 20 add_watcher() i=1 2024-09-19T11:57:42.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.167+0000 7f1a6491f9c0 20 add_watcher() i=2 2024-09-19T11:57:42.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.167+0000 7f1a6491f9c0 20 add_watcher() i=3 2024-09-19T11:57:42.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.167+0000 7f1a6491f9c0 20 add_watcher() i=4 2024-09-19T11:57:42.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.167+0000 7f1a6491f9c0 20 add_watcher() i=5 2024-09-19T11:57:42.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.167+0000 7f1a6491f9c0 20 add_watcher() i=6 2024-09-19T11:57:42.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.167+0000 7f1a6491f9c0 20 add_watcher() i=7 2024-09-19T11:57:42.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.167+0000 7f1a6491f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:42.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.171+0000 7f1918fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:42.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.171+0000 7f1a6491f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:42.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.171+0000 7f1a6491f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:42.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.171+0000 7f1a6491f9c0 5 note: GC not initialized 2024-09-19T11:57:42.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f18937fe640 20 reqs_thread_entry: start 2024-09-19T11:57:42.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f1a6491f9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:42.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f1a6491f9c0 20 Filter name: none 2024-09-19T11:57:42.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f18917fa640 20 reqs_thread_entry: start 2024-09-19T11:57:42.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f1a6491f9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-19T11:57:42.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f1a6491f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f1a6491f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:42.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f1a6491f9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-19T11:57:42.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f1a6491f9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-19T11:57:42.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f1a6491f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 : miss 2024-09-19T11:57:42.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f1a6491f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f1a6491f9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:57:42.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f1a6491f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 info.flags=0x17 2024-09-19T11:57:42.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f1a6491f9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 to cache LRU end 2024-09-19T11:57:42.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f1a6491f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:57:42.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f1a6491f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:42.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.175+0000 7f1a6491f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 2024-09-19T11:57:42.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.183+0000 7f1a6491f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 info.flags=0x17 2024-09-19T11:57:42.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.183+0000 7f1a6491f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 to cache LRU end 2024-09-19T11:57:42.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.183+0000 7f1a6491f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:42.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.183+0000 7f1a6491f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32, ofs0, ns] 2024-09-19T11:57:42.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.187+0000 7f1945ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366259 cookie 93852210277520 notifier 6896 bl.length()=1015 2024-09-19T11:57:42.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.187+0000 7f1945ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 info.flags=0x17 2024-09-19T11:57:42.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.187+0000 7f1945ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 to cache LRU end 2024-09-19T11:57:42.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.187+0000 7f1945ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:42.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.187+0000 7f1a6491f9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32]): orig_sources= new_sources= 2024-09-19T11:57:42.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.187+0000 7f1a6491f9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32]): potential sources added=[] removed=[] 2024-09-19T11:57:42.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.187+0000 7f1a6491f9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32]): orig_dests= new_dests= 2024-09-19T11:57:42.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.187+0000 7f1a6491f9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32]): potential dests added=[] removed=[] 2024-09-19T11:57:42.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.191+0000 7f1a6491f9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32.1.0 2024-09-19T11:57:42.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.191+0000 7f1a6491f9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32.1.0 2024-09-19T11:57:42.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.191+0000 7f1a6491f9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32.1.1 2024-09-19T11:57:42.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.191+0000 7f1a6491f9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32.1.1 2024-09-19T11:57:42.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.191+0000 7f1a6491f9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32.0 2024-09-19T11:57:42.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.199+0000 7f1a6491f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:42.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.199+0000 7f1a6491f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 2024-09-19T11:57:42.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.203+0000 7f1a6491f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 info.flags=0x17 2024-09-19T11:57:42.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.203+0000 7f1a6491f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 to cache LRU end 2024-09-19T11:57:42.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.203+0000 7f1a6491f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:42.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.203+0000 7f1a6491f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32, ofs0, ns] 2024-09-19T11:57:42.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.203+0000 7f1945ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366260 cookie 93852210277520 notifier 6896 bl.length()=1015 2024-09-19T11:57:42.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.203+0000 7f1945ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 info.flags=0x17 2024-09-19T11:57:42.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.203+0000 7f1945ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 to cache LRU end 2024-09-19T11:57:42.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.203+0000 7f1945ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:42.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.203+0000 7f1a6491f9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32]): orig_sources= new_sources= 2024-09-19T11:57:42.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.203+0000 7f1a6491f9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32]): potential sources added=[] removed=[] 2024-09-19T11:57:42.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.203+0000 7f1a6491f9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32]): orig_dests= new_dests= 2024-09-19T11:57:42.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.203+0000 7f1a6491f9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32]): potential dests added=[] removed=[] 2024-09-19T11:57:42.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.207+0000 7f1a6491f9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32.0 2024-09-19T11:57:42.206 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.207+0000 7f1a6491f9c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-19T11:57:42.206 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.207+0000 7f1a6491f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:42.206 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.207+0000 7f1a6491f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 2024-09-19T11:57:42.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.211+0000 7f1a6491f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 info.flags=0x17 2024-09-19T11:57:42.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.211+0000 7f1a6491f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 to cache LRU end 2024-09-19T11:57:42.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.211+0000 7f1a6491f9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:42.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.211+0000 7f1a6491f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32, ofs0, ns] 2024-09-19T11:57:42.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.211+0000 7f19457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366261 cookie 93852210277520 notifier 6896 bl.length()=983 2024-09-19T11:57:42.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.211+0000 7f19457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 info.flags=0x17 2024-09-19T11:57:42.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.211+0000 7f19457fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 to cache LRU end 2024-09-19T11:57:42.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.211+0000 7f19457fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:42.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.211+0000 7f1a6491f9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32]): orig_sources= new_sources= 2024-09-19T11:57:42.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.211+0000 7f1a6491f9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32]): potential sources added=[] removed=[] 2024-09-19T11:57:42.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.211+0000 7f1a6491f9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32]): orig_dests= new_dests= 2024-09-19T11:57:42.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.211+0000 7f1a6491f9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32]): potential dests added=[] removed=[] 2024-09-19T11:57:42.212 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.215+0000 7f1a6491f9c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-19T11:57:42.216 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.219+0000 7f1918fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:42.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.223+0000 7f1a6491f9c0 20 remove_watcher() i=0 2024-09-19T11:57:42.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.223+0000 7f1a6491f9c0 2 removed watcher, disabling cache 2024-09-19T11:57:42.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.227+0000 7f1a6491f9c0 20 remove_watcher() i=1 2024-09-19T11:57:42.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.227+0000 7f1a6491f9c0 20 remove_watcher() i=2 2024-09-19T11:57:42.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.231+0000 7f1a6491f9c0 20 remove_watcher() i=3 2024-09-19T11:57:42.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.231+0000 7f1a6491f9c0 20 remove_watcher() i=4 2024-09-19T11:57:42.233 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.235+0000 7f1a6491f9c0 20 remove_watcher() i=5 2024-09-19T11:57:42.234 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.235+0000 7f1a6491f9c0 20 remove_watcher() i=6 2024-09-19T11:57:42.236 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.239+0000 7f1a6491f9c0 20 remove_watcher() i=7 2024-09-19T11:57:42.251 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-19T11:57:42.278 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:42.278 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:42.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.323+0000 7f78ac59c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.327+0000 7f78ac59c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:42.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.327+0000 7f78ac59c9c0 20 realm 2024-09-19T11:57:42.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.327+0000 7f78ac59c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.327+0000 7f78ac59c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:42.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.327+0000 7f78ac59c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:42.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.327+0000 7f78ac59c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.327+0000 7f78ac59c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:42.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.327+0000 7f78ac59c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.327+0000 7f78ac59c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:42.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.327+0000 7f78ac59c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.331+0000 7f78ac59c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:42.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.331+0000 7f78ac59c9c0 20 searching for the correct realm 2024-09-19T11:57:42.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.331+0000 7f78aa8a3640 0 -- 172.21.15.120:0/3011534503 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f78a0053020 msgr2=0x7f78a007a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:42.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.339+0000 7f78a98a1640 0 -- 172.21.15.120:0/3011534503 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f789c026040 msgr2=0x7f789c06ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:42.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.555+0000 7f78ac59c9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:42.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.555+0000 7f78ac59c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:42.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.555+0000 7f78ac59c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:42.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.555+0000 7f78ac59c9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:42.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.555+0000 7f78ac59c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:42.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.555+0000 7f78ac59c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:42.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.555+0000 7f78ac59c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.555+0000 7f78ac59c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:42.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.555+0000 7f78ac59c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.559+0000 7f78ac59c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:42.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.559+0000 7f78ac59c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.559+0000 7f78ac59c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:42.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.559+0000 7f78ac59c9c0 20 zone default found 2024-09-19T11:57:42.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.559+0000 7f78ac59c9c0 4 Realm: () 2024-09-19T11:57:42.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.559+0000 7f78ac59c9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:42.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.559+0000 7f78ac59c9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:42.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.559+0000 7f78ac59c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:42.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.559+0000 7f78ac59c9c0 20 zonegroup default 2024-09-19T11:57:42.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.559+0000 7f78ac59c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.559+0000 7f78ac59c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:42.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.559+0000 7f78ac59c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.559+0000 7f78ac59c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:42.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.559+0000 7f78ac59c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.563+0000 7f78ac59c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:42.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.563+0000 7f78ac59c9c0 20 started sync module instance, tier type = 2024-09-19T11:57:42.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.563+0000 7f78ac59c9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:42.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.587+0000 7f78ac59c9c0 20 add_watcher() i=0 2024-09-19T11:57:42.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.587+0000 7f78ac59c9c0 20 add_watcher() i=1 2024-09-19T11:57:42.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.587+0000 7f78ac59c9c0 20 add_watcher() i=2 2024-09-19T11:57:42.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.587+0000 7f78ac59c9c0 20 add_watcher() i=3 2024-09-19T11:57:42.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.587+0000 7f78ac59c9c0 20 add_watcher() i=4 2024-09-19T11:57:42.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.587+0000 7f78ac59c9c0 20 add_watcher() i=5 2024-09-19T11:57:42.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.587+0000 7f78ac59c9c0 20 add_watcher() i=6 2024-09-19T11:57:42.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.587+0000 7f78ac59c9c0 20 add_watcher() i=7 2024-09-19T11:57:42.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.587+0000 7f78ac59c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:42.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.591+0000 7f7760fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:42.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.591+0000 7f78ac59c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:42.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.591+0000 7f78ac59c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:42.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.591+0000 7f78ac59c9c0 5 note: GC not initialized 2024-09-19T11:57:42.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.591+0000 7f76db7fe640 20 reqs_thread_entry: start 2024-09-19T11:57:42.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.591+0000 7f78ac59c9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:42.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.591+0000 7f78ac59c9c0 20 Filter name: none 2024-09-19T11:57:42.592 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.595+0000 7f76d97fa640 20 reqs_thread_entry: start 2024-09-19T11:57:42.592 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.595+0000 7f78ac59c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.595+0000 7f78ac59c9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:42.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.595+0000 7f78ac59c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.595+0000 7f78ac59c9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:57:42.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.595+0000 7f78ac59c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:42.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.595+0000 7f78ac59c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.595 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.599+0000 7f78ac59c9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:42.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.599+0000 7f78ac59c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:42.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.599+0000 7f78ac59c9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:57:42.596 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.599+0000 7f78ac59c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:42.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.599+0000 7f7760fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:42.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.607+0000 7f78ac59c9c0 20 remove_watcher() i=0 2024-09-19T11:57:42.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.607+0000 7f78ac59c9c0 2 removed watcher, disabling cache 2024-09-19T11:57:42.606 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.607+0000 7f78ac59c9c0 20 remove_watcher() i=1 2024-09-19T11:57:42.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.611+0000 7f78ac59c9c0 20 remove_watcher() i=2 2024-09-19T11:57:42.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.611+0000 7f78ac59c9c0 20 remove_watcher() i=3 2024-09-19T11:57:42.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.615+0000 7f78ac59c9c0 20 remove_watcher() i=4 2024-09-19T11:57:42.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.615+0000 7f78ac59c9c0 20 remove_watcher() i=5 2024-09-19T11:57:42.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.619+0000 7f78ac59c9c0 20 remove_watcher() i=6 2024-09-19T11:57:42.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:42.619+0000 7f78ac59c9c0 20 remove_watcher() i=7 2024-09-19T11:57:42.633 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:42.633 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:57:42.633 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-commit-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-19T11:57:42.633 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:42.709 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-19T11:57:42.709 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.175 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-19T11:57:43.209 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:43.209 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:43.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.255+0000 7f0a5be3f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.259+0000 7f0a5be3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:43.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.259+0000 7f0a5be3f9c0 20 realm 2024-09-19T11:57:43.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.259+0000 7f0a5be3f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.259+0000 7f0a5be3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:43.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.259+0000 7f0a5be3f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:43.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.259+0000 7f0a5be3f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.259+0000 7f0a5be3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:43.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.259+0000 7f0a5be3f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.259+0000 7f0a5be3f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:43.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.259+0000 7f0a5be3f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.260 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.263+0000 7f0a5be3f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:43.260 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.263+0000 7f0a5be3f9c0 20 searching for the correct realm 2024-09-19T11:57:43.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.267+0000 7f0a5a146640 0 -- 172.21.15.120:0/948105909 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f0a5006b0e0 msgr2=0x7f0a50062fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:43.271 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.271+0000 7f0a59144640 0 -- 172.21.15.120:0/948105909 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f0a4c1070b0 msgr2=0x7f0a4c0b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:57:43.487 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.487+0000 7f0a5be3f9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:43.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.487+0000 7f0a5be3f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:43.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.487+0000 7f0a5be3f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:43.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.487+0000 7f0a5be3f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:43.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.487+0000 7f0a5be3f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:43.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.487+0000 7f0a5be3f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:43.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.487+0000 7f0a5be3f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.488 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:43.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:43.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:43.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 20 zone default found 2024-09-19T11:57:43.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 4 Realm: () 2024-09-19T11:57:43.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:43.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:43.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:43.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 20 zonegroup default 2024-09-19T11:57:43.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:43.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:43.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.491+0000 7f0a5be3f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.495+0000 7f0a5be3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:43.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.495+0000 7f0a5be3f9c0 20 started sync module instance, tier type = 2024-09-19T11:57:43.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.495+0000 7f0a5be3f9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:43.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.515+0000 7f0a5be3f9c0 20 add_watcher() i=0 2024-09-19T11:57:43.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.515+0000 7f0a5be3f9c0 20 add_watcher() i=1 2024-09-19T11:57:43.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.515+0000 7f0a5be3f9c0 20 add_watcher() i=2 2024-09-19T11:57:43.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.515+0000 7f0a5be3f9c0 20 add_watcher() i=3 2024-09-19T11:57:43.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.515+0000 7f0a5be3f9c0 20 add_watcher() i=4 2024-09-19T11:57:43.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.515+0000 7f0a5be3f9c0 20 add_watcher() i=5 2024-09-19T11:57:43.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.515+0000 7f0a5be3f9c0 20 add_watcher() i=6 2024-09-19T11:57:43.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.519+0000 7f0a5be3f9c0 20 add_watcher() i=7 2024-09-19T11:57:43.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.519+0000 7f0a5be3f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:43.520 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.523+0000 7f090b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:43.521 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.523+0000 7f0a5be3f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:43.521 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.523+0000 7f0a5be3f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:43.522 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.523+0000 7f0a5be3f9c0 5 note: GC not initialized 2024-09-19T11:57:43.522 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.523+0000 7f090a7fc640 20 reqs_thread_entry: start 2024-09-19T11:57:43.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.523+0000 7f0a5be3f9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:43.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.523+0000 7f0a5be3f9c0 20 Filter name: none 2024-09-19T11:57:43.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.523+0000 7f087bfff640 20 reqs_thread_entry: start 2024-09-19T11:57:43.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.523+0000 7f0a5be3f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.527+0000 7f0a5be3f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:43.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.527+0000 7f0a5be3f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.527+0000 7f0a5be3f9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:57:43.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.527+0000 7f0a5be3f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:43.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.527+0000 7f0a5be3f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.527+0000 7f0a5be3f9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:43.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.527+0000 7f0a5be3f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.527+0000 7f0a5be3f9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:57:43.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.527+0000 7f0a5be3f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:43.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.531+0000 7f090b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:43.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.535+0000 7f0a5be3f9c0 20 remove_watcher() i=0 2024-09-19T11:57:43.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.535+0000 7f0a5be3f9c0 2 removed watcher, disabling cache 2024-09-19T11:57:43.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.539+0000 7f0a5be3f9c0 20 remove_watcher() i=1 2024-09-19T11:57:43.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.539+0000 7f0a5be3f9c0 20 remove_watcher() i=2 2024-09-19T11:57:43.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.543+0000 7f0a5be3f9c0 20 remove_watcher() i=3 2024-09-19T11:57:43.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.547+0000 7f0a5be3f9c0 20 remove_watcher() i=4 2024-09-19T11:57:43.545 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.547+0000 7f0a5be3f9c0 20 remove_watcher() i=5 2024-09-19T11:57:43.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.547+0000 7f0a5be3f9c0 20 remove_watcher() i=6 2024-09-19T11:57:43.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.551+0000 7f0a5be3f9c0 20 remove_watcher() i=7 2024-09-19T11:57:43.564 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.564 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:57:43.565 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-commit-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:57:43.565 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.565 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-19T11:57:43.602 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:43.603 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:43.647 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.647+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:43.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 realm 2024-09-19T11:57:43.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:43.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.651+0000 7fe0856dc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:43.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:43.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:43.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.655+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:43.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.655+0000 7fe0856dc9c0 20 searching for the correct realm 2024-09-19T11:57:43.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.655+0000 7fe0831e2640 0 -- 172.21.15.120:0/671929502 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fe07c008040 msgr2=0x7fe07c026460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:57:43.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.871+0000 7fe0831e2640 0 -- 172.21.15.120:0/671929502 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fe07c008040 msgr2=0x7fe07c026460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:43.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:43.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:43.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:43.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:43.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:43.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:43.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:43.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:43.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:43.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 zone default found 2024-09-19T11:57:43.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 4 Realm: () 2024-09-19T11:57:43.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:43.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:43.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:43.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 zonegroup default 2024-09-19T11:57:43.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:43.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:43.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:43.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 started sync module instance, tier type = 2024-09-19T11:57:43.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:43.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=0 2024-09-19T11:57:43.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=1 2024-09-19T11:57:43.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=2 2024-09-19T11:57:43.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=3 2024-09-19T11:57:43.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=4 2024-09-19T11:57:43.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=5 2024-09-19T11:57:43.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=6 2024-09-19T11:57:43.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.915+0000 7fe0856dc9c0 20 add_watcher() i=7 2024-09-19T11:57:43.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.915+0000 7fe0856dc9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:43.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.919+0000 7fdf39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:43.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.919+0000 7fe0856dc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:43.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.919+0000 7fe0856dc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:43.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 note: GC not initialized 2024-09-19T11:57:43.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.919+0000 7fdf38fe1640 20 reqs_thread_entry: start 2024-09-19T11:57:43.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.919+0000 7fe0856dc9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:43.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.923+0000 7fe0856dc9c0 20 Filter name: none 2024-09-19T11:57:43.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.923+0000 7fdeb27fc640 20 reqs_thread_entry: start 2024-09-19T11:57:43.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-19T11:57:43.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.923+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.923+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:43.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-19T11:57:43.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-19T11:57:43.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 : miss 2024-09-19T11:57:43.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.923+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:43.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.923+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:57:43.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:57:43.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:57:43.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:57:43.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:43.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 2024-09-19T11:57:43.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.931+0000 7fe0856dc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:57:43.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.931+0000 7fe0856dc9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:57:43.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.931+0000 7fe0856dc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:43.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.931+0000 7fe0856dc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33, ofs0, ns] 2024-09-19T11:57:43.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.931+0000 7fdf66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366189 cookie 94374115530944 notifier 6944 bl.length()=1015 2024-09-19T11:57:43.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.931+0000 7fdf66ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:57:43.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.931+0000 7fdf66ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:57:43.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.931+0000 7fdf66ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:43.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.931+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_sources= new_sources= 2024-09-19T11:57:43.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.931+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential sources added=[] removed=[] 2024-09-19T11:57:43.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.931+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_dests= new_dests= 2024-09-19T11:57:43.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.931+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential dests added=[] removed=[] 2024-09-19T11:57:43.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.939+0000 7fe0856dc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.0 2024-09-19T11:57:43.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.939+0000 7fe0856dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.0 2024-09-19T11:57:43.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.939+0000 7fe0856dc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.1 2024-09-19T11:57:43.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.939+0000 7fe0856dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.1 2024-09-19T11:57:43.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.939+0000 7fe0856dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.0 2024-09-19T11:57:43.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.943+0000 7fe0856dc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:43.941 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.943+0000 7fe0856dc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 2024-09-19T11:57:43.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.947+0000 7fe0856dc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:57:43.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.947+0000 7fe0856dc9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:57:43.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.947+0000 7fe0856dc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:43.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.947+0000 7fe0856dc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33, ofs0, ns] 2024-09-19T11:57:43.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.947+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366190 cookie 94374115530944 notifier 6944 bl.length()=1015 2024-09-19T11:57:43.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.947+0000 7fdf667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:57:43.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.947+0000 7fdf667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:57:43.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.947+0000 7fdf667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:43.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.947+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_sources= new_sources= 2024-09-19T11:57:43.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.947+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential sources added=[] removed=[] 2024-09-19T11:57:43.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.947+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_dests= new_dests= 2024-09-19T11:57:43.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.947+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential dests added=[] removed=[] 2024-09-19T11:57:43.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.951+0000 7fe0856dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.0 2024-09-19T11:57:43.949 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe0856dc9c0 time 2024-09-19T11:57:43.955656+0000 2024-09-19T11:57:43.949 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:57:43.950 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:43.950 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe088fb62eb] 2024-09-19T11:57:43.950 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe088fb649f] 2024-09-19T11:57:43.950 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d52e3be271] 2024-09-19T11:57:43.950 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55d52e3ce3b7] 2024-09-19T11:57:43.950 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T11:57:43.950 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe087e1cd90] 2024-09-19T11:57:43.950 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T11:57:43.950 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T11:57:43.950 INFO:tasks.workunit.client.0.smithi120.stderr:*** Caught signal (Aborted) ** 2024-09-19T11:57:43.951 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7fe0856dc9c0 thread_name:radosgw-admin 2024-09-19T11:57:43.951 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.951+0000 7fe0856dc9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe0856dc9c0 time 2024-09-19T11:57:43.955656+0000 2024-09-19T11:57:43.951 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:57:43.951 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.951 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:43.951 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe088fb62eb] 2024-09-19T11:57:43.951 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe088fb649f] 2024-09-19T11:57:43.951 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d52e3be271] 2024-09-19T11:57:43.951 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55d52e3ce3b7] 2024-09-19T11:57:43.951 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T11:57:43.951 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe087e1cd90] 2024-09-19T11:57:43.951 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T11:57:43.951 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T11:57:43.952 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.967 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:43.967 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe087e35520] 2024-09-19T11:57:43.967 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:57:43.967 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:57:43.968 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:57:43.968 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe088fb6345] 2024-09-19T11:57:43.968 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe088fb649f] 2024-09-19T11:57:43.968 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d52e3be271] 2024-09-19T11:57:43.968 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55d52e3ce3b7] 2024-09-19T11:57:43.968 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T11:57:43.968 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe087e1cd90] 2024-09-19T11:57:43.968 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T11:57:43.968 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T11:57:43.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:43.951+0000 7fe0856dc9c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:57:43.968 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7fe0856dc9c0 thread_name:radosgw-admin 2024-09-19T11:57:43.968 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.969 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:43.969 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe087e35520] 2024-09-19T11:57:43.969 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:57:43.969 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:57:43.969 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:57:43.969 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe088fb6345] 2024-09-19T11:57:43.969 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe088fb649f] 2024-09-19T11:57:43.969 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d52e3be271] 2024-09-19T11:57:43.969 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55d52e3ce3b7] 2024-09-19T11:57:43.969 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T11:57:43.969 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe087e1cd90] 2024-09-19T11:57:43.969 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T11:57:43.970 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T11:57:43.970 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:57:43.970 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.970 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:57:43.970 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient: shutdown 2024-09-19T11:57:43.970 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) unregister_commands rotate-key 2024-09-19T11:57:43.970 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:57:43.970 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:43.970 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient: monmap: 2024-09-19T11:57:43.970 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:43.970 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:43.970 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:43.970 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:43.971 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:43.971 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:43.971 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:43.971 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:43.971 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:43.971 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.971 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding auth protocol: cephx 2024-09-19T11:57:43.971 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding auth protocol: cephx 2024-09-19T11:57:43.971 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding auth protocol: cephx 2024-09-19T11:57:43.971 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: secure 2024-09-19T11:57:43.971 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: crc 2024-09-19T11:57:43.971 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: secure 2024-09-19T11:57:43.971 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: crc 2024-09-19T11:57:43.971 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: secure 2024-09-19T11:57:43.972 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: crc 2024-09-19T11:57:43.972 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: crc 2024-09-19T11:57:43.972 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: secure 2024-09-19T11:57:43.972 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: crc 2024-09-19T11:57:43.972 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: secure 2024-09-19T11:57:43.972 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: crc 2024-09-19T11:57:43.972 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: secure 2024-09-19T11:57:43.972 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:43.972 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 1 librados: starting msgr at 2024-09-19T11:57:43.972 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 1 librados: starting objecter 2024-09-19T11:57:43.972 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command objecter_requests hook 0x55d52f94b980 2024-09-19T11:57:43.972 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 1 librados: setting wanted keys 2024-09-19T11:57:43.972 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 1 librados: calling monclient init 2024-09-19T11:57:43.973 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient: init 2024-09-19T11:57:43.973 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding auth protocol: cephx 2024-09-19T11:57:43.973 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding auth protocol: cephx 2024-09-19T11:57:43.973 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding auth protocol: cephx 2024-09-19T11:57:43.973 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: secure 2024-09-19T11:57:43.973 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: crc 2024-09-19T11:57:43.973 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: secure 2024-09-19T11:57:43.973 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: crc 2024-09-19T11:57:43.973 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: secure 2024-09-19T11:57:43.973 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: crc 2024-09-19T11:57:43.973 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: crc 2024-09-19T11:57:43.973 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: secure 2024-09-19T11:57:43.973 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: crc 2024-09-19T11:57:43.974 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: secure 2024-09-19T11:57:43.974 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: crc 2024-09-19T11:57:43.974 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: secure 2024-09-19T11:57:43.974 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:43.974 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:43.974 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command rotate-key hook 0x55d52f91d1a8 2024-09-19T11:57:43.974 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:43.974 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T11:57:43.974 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55d52f7d6490 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:43.974 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55d52f7d8a00 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:43.974 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-b con 0x55d52f9239f0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:43.974 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:43.974 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:43.975 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:43.975 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:43.975 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): authenticate will time out at 2357.947337s 2024-09-19T11:57:43.975 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): get_auth_request con 0x55d52f7d8a00 auth_method 0 2024-09-19T11:57:43.975 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:43.975 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:43.975 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:43.975 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:57:43.627+0000 7fe0831e2640 10 monclient(hunting): get_auth_request con 0x55d52f7d6490 auth_method 0 2024-09-19T11:57:43.975 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:57:43.627+0000 7fe0831e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:43.975 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:57:43.627+0000 7fe0831e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:43.975 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:57:43.627+0000 7fe0831e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:43.975 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:43.975 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:43.975 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:43.975 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:57:43.627+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:43.976 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:57:43.627+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:43.976 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:57:43.627+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:43.976 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): handle_auth_done global_id 6935 payload 824 2024-09-19T11:57:43.976 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient: _finish_hunting 0 2024-09-19T11:57:43.976 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:57:43.627+0000 7fe0829e1640 1 monclient: found mon.noname-c 2024-09-19T11:57:43.976 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:57:43.976 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:43.976 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:57:43.976 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: dump: 2024-09-19T11:57:43.976 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:43.976 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:43.976 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:43.977 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:43.977 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:43.977 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:43.977 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:43.977 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:43.977 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:43.977 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.977 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: _finish_auth 0 2024-09-19T11:57:43.977 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: _check_auth_tickets 2024-09-19T11:57:43.977 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:43.977 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:43.977 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:57:43.978 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: dump: 2024-09-19T11:57:43.978 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:43.978 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:43.978 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:43.978 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:43.978 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:43.978 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:43.978 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:43.978 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:43.978 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:43.978 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.978 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:57:43.631+0000 7fe0856dc9c0 5 monclient: authenticate success, global_id 6935 2024-09-19T11:57:43.978 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:57:43.631+0000 7fe0856dc9c0 10 monclient: _renew_subs 2024-09-19T11:57:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:57:43.631+0000 7fdf7160a640 4 set_mon_vals no callback set 2024-09-19T11:57:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:57:43.631+0000 7fe0856dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:57:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:57:43.631+0000 7fe0856dc9c0 10 monclient: _renew_subs 2024-09-19T11:57:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:57:43.631+0000 7fe0856dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:57:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:57:43.631+0000 7fe0856dc9c0 1 librados: init done 2024-09-19T11:57:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:57:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:57:43.631+0000 7fe0831e2640 10 monclient: get_auth_request con 0x7fdf68071c10 auth_method 0 2024-09-19T11:57:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:57:43.631+0000 7fe0839e3640 10 monclient: get_auth_request con 0x55d52f945330 auth_method 0 2024-09-19T11:57:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:57:43.631+0000 7fe0831e2640 10 monclient: get_auth_request con 0x55d52f968160 auth_method 0 2024-09-19T11:57:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:57:43.635+0000 7fe0829e1640 10 monclient: get_auth_request con 0x55d52f96c510 auth_method 0 2024-09-19T11:57:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:57:43.635+0000 7fe0839e3640 10 monclient: get_auth_request con 0x55d52f96b9c0 auth_method 0 2024-09-19T11:57:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:57:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: monmap: 2024-09-19T11:57:43.980 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:43.980 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:43.980 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:43.980 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:43.980 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:43.980 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:43.980 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:43.980 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:43.980 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding auth protocol: cephx 2024-09-19T11:57:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding auth protocol: cephx 2024-09-19T11:57:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding auth protocol: cephx 2024-09-19T11:57:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: secure 2024-09-19T11:57:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: crc 2024-09-19T11:57:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: secure 2024-09-19T11:57:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: crc 2024-09-19T11:57:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: secure 2024-09-19T11:57:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: crc 2024-09-19T11:57:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: crc 2024-09-19T11:57:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: secure 2024-09-19T11:57:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: crc 2024-09-19T11:57:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: secure 2024-09-19T11:57:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: crc 2024-09-19T11:57:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: secure 2024-09-19T11:57:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d52f978000 EEXIST 2024-09-19T11:57:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: init 2024-09-19T11:57:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding auth protocol: cephx 2024-09-19T11:57:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding auth protocol: cephx 2024-09-19T11:57:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding auth protocol: cephx 2024-09-19T11:57:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: secure 2024-09-19T11:57:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: crc 2024-09-19T11:57:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: secure 2024-09-19T11:57:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: crc 2024-09-19T11:57:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: secure 2024-09-19T11:57:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: crc 2024-09-19T11:57:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: crc 2024-09-19T11:57:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: secure 2024-09-19T11:57:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: crc 2024-09-19T11:57:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: secure 2024-09-19T11:57:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: crc 2024-09-19T11:57:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: secure 2024-09-19T11:57:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command rotate-key cmddesc rotate-key hook 0x55d52f9736d0 EEXIST 2024-09-19T11:57:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T11:57:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-b con 0x55d52f99c1b0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55d52f99bae0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55d52f99a4c0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): authenticate will time out at 2357.957768s 2024-09-19T11:57:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): get_auth_request con 0x55d52f99a4c0 auth_method 0 2024-09-19T11:57:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:57:43.639+0000 7fe0839e3640 10 monclient(hunting): get_auth_request con 0x55d52f99bae0 auth_method 0 2024-09-19T11:57:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:57:43.639+0000 7fe0839e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:57:43.639+0000 7fe0839e3640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:57:43.639+0000 7fe0839e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:57:43.639+0000 7fe0839e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:57:43.639+0000 7fe0839e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:57:43.639+0000 7fe0839e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:57:43.639+0000 7fe0829e1640 10 monclient(hunting): get_auth_request con 0x55d52f99c1b0 auth_method 0 2024-09-19T11:57:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:57:43.639+0000 7fe0829e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:57:43.639+0000 7fe0829e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:57:43.639+0000 7fe0829e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): handle_auth_done global_id 6938 payload 824 2024-09-19T11:57:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient: _finish_hunting 0 2024-09-19T11:57:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:57:43.639+0000 7fe0831e2640 1 monclient: found mon.noname-c 2024-09-19T11:57:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:57:43.986 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:43.986 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:57:43.986 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: dump: 2024-09-19T11:57:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:43.986 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: _finish_auth 0 2024-09-19T11:57:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: _check_auth_tickets 2024-09-19T11:57:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:57:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: dump: 2024-09-19T11:57:43.987 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:43.987 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:43.987 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:43.987 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:43.987 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:43.987 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:43.987 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:43.988 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:43.988 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:57:43.639+0000 7fe0841e4640 4 set_mon_vals no callback set 2024-09-19T11:57:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 monclient: authenticate success, global_id 6938 2024-09-19T11:57:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: _renew_subs 2024-09-19T11:57:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:57:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: _renew_subs 2024-09-19T11:57:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:57:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:57:43.643+0000 7fdf6d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:57:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:57:43.643+0000 7fdf6d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:57:43.643+0000 7fdf6d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: get_monmap_and_config 2024-09-19T11:57:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:57:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: monmap: 2024-09-19T11:57:43.989 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:43.989 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:43.989 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:43.989 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:43.989 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:43.989 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:43.989 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:43.989 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:43.989 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding auth protocol: cephx 2024-09-19T11:57:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding auth protocol: cephx 2024-09-19T11:57:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding auth protocol: cephx 2024-09-19T11:57:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: secure 2024-09-19T11:57:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: crc 2024-09-19T11:57:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: secure 2024-09-19T11:57:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: crc 2024-09-19T11:57:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: secure 2024-09-19T11:57:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: crc 2024-09-19T11:57:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: crc 2024-09-19T11:57:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: secure 2024-09-19T11:57:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: crc 2024-09-19T11:57:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: secure 2024-09-19T11:57:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: crc 2024-09-19T11:57:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: secure 2024-09-19T11:57:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient: get_auth_request con 0x7fdf5c071b20 auth_method 0 2024-09-19T11:57:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: init 2024-09-19T11:57:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding auth protocol: cephx 2024-09-19T11:57:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding auth protocol: cephx 2024-09-19T11:57:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding auth protocol: cephx 2024-09-19T11:57:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: secure 2024-09-19T11:57:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: crc 2024-09-19T11:57:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: secure 2024-09-19T11:57:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: crc 2024-09-19T11:57:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: secure 2024-09-19T11:57:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: crc 2024-09-19T11:57:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: crc 2024-09-19T11:57:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: secure 2024-09-19T11:57:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: crc 2024-09-19T11:57:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: secure 2024-09-19T11:57:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: crc 2024-09-19T11:57:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: secure 2024-09-19T11:57:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command rotate-key cmddesc rotate-key hook 0x7ffc2e6281d8 EEXIST 2024-09-19T11:57:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T11:57:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55d52f9bfc10 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-b con 0x55d52f9eb380 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55d52f9ebd00 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): authenticate will time out at 2357.962448s 2024-09-19T11:57:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient(hunting): get_auth_request con 0x55d52f9bfc10 auth_method 0 2024-09-19T11:57:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): get_auth_request con 0x55d52f9ebd00 auth_method 0 2024-09-19T11:57:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): handle_auth_done global_id 7437 payload 274 2024-09-19T11:57:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient: _finish_hunting 0 2024-09-19T11:57:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:57:43.643+0000 7fe0831e2640 1 monclient: found mon.noname-a 2024-09-19T11:57:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:57:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:57:43.996 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: dump: 2024-09-19T11:57:43.996 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:43.996 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:43.996 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:43.996 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:43.996 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:43.997 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:43.997 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:43.997 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:43.997 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: _finish_auth 0 2024-09-19T11:57:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: _check_auth_tickets 2024-09-19T11:57:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:57:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: dump: 2024-09-19T11:57:43.997 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:43.997 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:43.998 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:43.998 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:43.998 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:43.998 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:43.998 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:43.998 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:43.998 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 monclient: authenticate success, global_id 7437 2024-09-19T11:57:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: get_monmap_and_config success 2024-09-19T11:57:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 4 set_mon_vals no callback set 2024-09-19T11:57:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: shutdown 2024-09-19T11:57:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:57:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: monmap: 2024-09-19T11:57:43.999 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:43.999 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:43.999 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:43.999 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:43.999 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:43.999 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:43.999 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:43.999 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:43.999 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding auth protocol: cephx 2024-09-19T11:57:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding auth protocol: cephx 2024-09-19T11:57:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding auth protocol: cephx 2024-09-19T11:57:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: secure 2024-09-19T11:57:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: crc 2024-09-19T11:57:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: secure 2024-09-19T11:57:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: crc 2024-09-19T11:57:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: secure 2024-09-19T11:57:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: crc 2024-09-19T11:57:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: crc 2024-09-19T11:57:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: secure 2024-09-19T11:57:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: crc 2024-09-19T11:57:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: secure 2024-09-19T11:57:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: crc 2024-09-19T11:57:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: secure 2024-09-19T11:57:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 1 librados: starting msgr at 2024-09-19T11:57:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 1 librados: starting objecter 2024-09-19T11:57:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d52f9bb750 EEXIST 2024-09-19T11:57:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 1 librados: setting wanted keys 2024-09-19T11:57:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 1 librados: calling monclient init 2024-09-19T11:57:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient: init 2024-09-19T11:57:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding auth protocol: cephx 2024-09-19T11:57:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding auth protocol: cephx 2024-09-19T11:57:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding auth protocol: cephx 2024-09-19T11:57:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: secure 2024-09-19T11:57:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: crc 2024-09-19T11:57:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: secure 2024-09-19T11:57:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: crc 2024-09-19T11:57:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: secure 2024-09-19T11:57:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: crc 2024-09-19T11:57:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: crc 2024-09-19T11:57:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: secure 2024-09-19T11:57:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: crc 2024-09-19T11:57:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: secure 2024-09-19T11:57:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: crc 2024-09-19T11:57:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: secure 2024-09-19T11:57:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command rotate-key cmddesc rotate-key hook 0x55d52f99e118 EEXIST 2024-09-19T11:57:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T11:57:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55d52f9bfc10 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55d52f9eb380 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-b con 0x55d52f9ebd00 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): authenticate will time out at 2357.965032s 2024-09-19T11:57:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): get_auth_request con 0x55d52f9bfc10 auth_method 0 2024-09-19T11:57:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:57:43.647+0000 7fe0839e3640 10 monclient(hunting): get_auth_request con 0x55d52f9eb380 auth_method 0 2024-09-19T11:57:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:57:43.647+0000 7fe0839e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:57:43.647+0000 7fe0839e3640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:57:43.647+0000 7fe0839e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:57:43.647+0000 7fe0839e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:57:43.647+0000 7fe0839e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:57:43.647+0000 7fe0839e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): handle_auth_done global_id 6944 payload 824 2024-09-19T11:57:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient: _finish_hunting 0 2024-09-19T11:57:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:57:43.647+0000 7fe0829e1640 1 monclient: found mon.noname-c 2024-09-19T11:57:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:57:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:57:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: dump: 2024-09-19T11:57:44.005 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:44.005 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:44.005 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.005 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.005 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:44.005 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:44.005 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:44.005 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:44.005 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: _finish_auth 0 2024-09-19T11:57:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: _check_auth_tickets 2024-09-19T11:57:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:57:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: dump: 2024-09-19T11:57:44.006 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:44.006 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:44.006 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.006 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.006 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:44.006 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:44.006 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:44.007 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:44.007 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 monclient: authenticate success, global_id 6944 2024-09-19T11:57:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:57:43.647+0000 7fdf66ffd640 4 set_mon_vals no callback set 2024-09-19T11:57:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient: _renew_subs 2024-09-19T11:57:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:57:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient: _renew_subs 2024-09-19T11:57:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:57:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 1 librados: init done 2024-09-19T11:57:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command cr dump hook 0x55d52f9e0598 2024-09-19T11:57:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:57:43.647+0000 7fdf657fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:57:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:57:43.647+0000 7fdf657fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:57:43.647+0000 7fdf657fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:57:43.651+0000 7fe0831e2640 10 monclient: get_auth_request con 0x55d52fa09a60 auth_method 0 2024-09-19T11:57:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:57:43.651+0000 7fe0839e3640 10 monclient: get_auth_request con 0x7fdf4c071be0 auth_method 0 2024-09-19T11:57:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 realm 2024-09-19T11:57:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:57:43.651+0000 7fe0829e1640 10 monclient: get_auth_request con 0x55d52fa0dc90 auth_method 0 2024-09-19T11:57:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:57:43.651+0000 7fe0839e3640 10 monclient: get_auth_request con 0x55d52fa114f0 auth_method 0 2024-09-19T11:57:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:57:43.655+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:57:43.655+0000 7fe0856dc9c0 20 searching for the correct realm 2024-09-19T11:57:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:57:43.655+0000 7fe0831e2640 10 monclient: get_auth_request con 0x55d52fa16270 auth_method 0 2024-09-19T11:57:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:57:43.655+0000 7fe0829e1640 10 monclient: get_auth_request con 0x7fe07410ac20 auth_method 0 2024-09-19T11:57:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:57:43.655+0000 7fe0839e3640 10 monclient: get_auth_request con 0x7fe0780657a0 auth_method 0 2024-09-19T11:57:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:57:43.655+0000 7fe0831e2640 0 -- 172.21.15.120:0/671929502 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fe07c008040 msgr2=0x7fe07c026460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:57:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:57:43.859+0000 7fe0831e2640 10 monclient: get_auth_request con 0x7fe07c008040 auth_method 0 2024-09-19T11:57:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:57:43.867+0000 7fe0829e1640 10 monclient: get_auth_request con 0x7fe074121590 auth_method 0 2024-09-19T11:57:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:57:43.871+0000 7fe0831e2640 0 -- 172.21.15.120:0/671929502 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fe07c008040 msgr2=0x7fe07c026460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:57:43.871+0000 7fdf657fa640 1 client.6944.objecter ms_handle_reset 0x7fe07c008040 session 0x7fe07c021040 osd.4 2024-09-19T11:57:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:57:43.871+0000 7fdf657fa640 10 monclient: _renew_subs 2024-09-19T11:57:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:57:43.871+0000 7fdf657fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:57:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:57:43.871+0000 7fe0831e2640 10 monclient: get_auth_request con 0x7fdf4c082280 auth_method 0 2024-09-19T11:57:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 zone default found 2024-09-19T11:57:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 4 Realm: () 2024-09-19T11:57:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 zonegroup default 2024-09-19T11:57:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 started sync module instance, tier type = 2024-09-19T11:57:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=0 2024-09-19T11:57:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=1 2024-09-19T11:57:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=2 2024-09-19T11:57:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=3 2024-09-19T11:57:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=4 2024-09-19T11:57:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=5 2024-09-19T11:57:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=6 2024-09-19T11:57:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:57:43.915+0000 7fe0856dc9c0 20 add_watcher() i=7 2024-09-19T11:57:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:57:43.915+0000 7fe0856dc9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding auth protocol: cephx 2024-09-19T11:57:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding auth protocol: cephx 2024-09-19T11:57:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding auth protocol: cephx 2024-09-19T11:57:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: secure 2024-09-19T11:57:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: crc 2024-09-19T11:57:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: secure 2024-09-19T11:57:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: crc 2024-09-19T11:57:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: secure 2024-09-19T11:57:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: crc 2024-09-19T11:57:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: crc 2024-09-19T11:57:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: secure 2024-09-19T11:57:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: crc 2024-09-19T11:57:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: secure 2024-09-19T11:57:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: crc 2024-09-19T11:57:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: secure 2024-09-19T11:57:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:57:43.919+0000 7fdf39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command cache list hook 0x55d52f9de340 2024-09-19T11:57:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command cache inspect hook 0x55d52f9de340 2024-09-19T11:57:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command cache erase hook 0x55d52f9de340 2024-09-19T11:57:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command cache zap hook 0x55d52f9de340 2024-09-19T11:57:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 note: GC not initialized 2024-09-19T11:57:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:57:43.919+0000 7fdf38fe1640 20 reqs_thread_entry: start 2024-09-19T11:57:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command sync trace show hook 0x7fe07c004700 2024-09-19T11:57:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command sync trace history hook 0x7fe07c004700 2024-09-19T11:57:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command sync trace active hook 0x7fe07c004700 2024-09-19T11:57:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command sync trace active_short hook 0x7fe07c004700 2024-09-19T11:57:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 20 Filter name: none 2024-09-19T11:57:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:57:43.923+0000 7fdeb27fc640 20 reqs_thread_entry: start 2024-09-19T11:57:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-19T11:57:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-19T11:57:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-19T11:57:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 : miss 2024-09-19T11:57:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:57:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:57:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:57:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:57:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 2024-09-19T11:57:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:57:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:57:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33, ofs0, ns] 2024-09-19T11:57:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:57:43.931+0000 7fdf66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366189 cookie 94374115530944 notifier 6944 bl.length()=1015 2024-09-19T11:57:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:57:43.931+0000 7fdf66ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:57:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:57:43.931+0000 7fdf66ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:57:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:57:43.931+0000 7fdf66ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_sources= new_sources= 2024-09-19T11:57:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential sources added=[] removed=[] 2024-09-19T11:57:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_dests= new_dests= 2024-09-19T11:57:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential dests added=[] removed=[] 2024-09-19T11:57:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:57:43.939+0000 7fe0856dc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.0 2024-09-19T11:57:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:57:43.939+0000 7fe0856dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.0 2024-09-19T11:57:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:57:43.939+0000 7fe0856dc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.1 2024-09-19T11:57:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:57:43.939+0000 7fe0856dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.1 2024-09-19T11:57:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:57:43.939+0000 7fe0856dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.0 2024-09-19T11:57:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:57:43.943+0000 7fe0856dc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:57:43.943+0000 7fe0856dc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 2024-09-19T11:57:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:57:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:57:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33, ofs0, ns] 2024-09-19T11:57:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:57:43.947+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366190 cookie 94374115530944 notifier 6944 bl.length()=1015 2024-09-19T11:57:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:57:43.947+0000 7fdf667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:57:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:57:43.947+0000 7fdf667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:57:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:57:43.947+0000 7fdf667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_sources= new_sources= 2024-09-19T11:57:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential sources added=[] removed=[] 2024-09-19T11:57:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_dests= new_dests= 2024-09-19T11:57:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential dests added=[] removed=[] 2024-09-19T11:57:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:57:43.951+0000 7fe0856dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.0 2024-09-19T11:57:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:57:43.951+0000 7fe0856dc9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe0856dc9c0 time 2024-09-19T11:57:43.955656+0000 2024-09-19T11:57:44.020 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:57:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe088fb62eb] 2024-09-19T11:57:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe088fb649f] 2024-09-19T11:57:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d52e3be271] 2024-09-19T11:57:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55d52e3ce3b7] 2024-09-19T11:57:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T11:57:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe087e1cd90] 2024-09-19T11:57:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T11:57:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T11:57:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:57:43.951+0000 7fe0856dc9c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:57:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7fe0856dc9c0 thread_name:radosgw-admin 2024-09-19T11:57:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe087e35520] 2024-09-19T11:57:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:57:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:57:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:57:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe088fb6345] 2024-09-19T11:57:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe088fb649f] 2024-09-19T11:57:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d52e3be271] 2024-09-19T11:57:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55d52e3ce3b7] 2024-09-19T11:57:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T11:57:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe087e1cd90] 2024-09-19T11:57:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T11:57:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T11:57:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:57:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.022 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:57:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:57:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:57:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:57:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:57:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:57:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:57:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:57:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:57:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:57:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:57:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:57:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:57:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:57:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:57:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:57:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:57:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:57:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:57:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:57:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:57:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:57:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:57:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:57:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:57:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:57:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:57:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:57:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:57:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:57:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:57:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:57:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:57:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:57:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:57:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:57:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:57:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:57:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:57:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:57:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:57:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:57:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:57:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:57:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:57:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:57:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:57:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:57:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:57:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:57:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:57:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:57:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:57:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:57:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:57:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:57:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:57:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:57:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:57:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:57:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:57:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:57:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:57:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:57:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:57:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:57:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:57:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:57:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:57:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:57:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:57:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:57:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:57:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:57:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:57:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:57:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:57:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:57:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:57:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:57:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:57:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:57:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:57:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:57:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:57:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:57:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:57:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:57:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:57:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:57:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:57:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:57:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:57:44.029 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:57:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdeb27fc640 / http_manager 2024-09-19T11:57:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf38fe1640 / http_manager 2024-09-19T11:57:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf39fe3640 / rgw_dt_lg_renew 2024-09-19T11:57:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf657fa640 / ms_dispatch 2024-09-19T11:57:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf667fc640 / io_context_pool 2024-09-19T11:57:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf66ffd640 / io_context_pool 2024-09-19T11:57:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf6d602640 / ms_dispatch 2024-09-19T11:57:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf6fe07640 / ms_dispatch 2024-09-19T11:57:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf7160a640 / io_context_pool 2024-09-19T11:57:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 7fe0829e1640 / msgr-worker-2 2024-09-19T11:57:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 7fe0831e2640 / msgr-worker-1 2024-09-19T11:57:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 7fe0839e3640 / msgr-worker-0 2024-09-19T11:57:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 7fe0841e4640 / io_context_pool 2024-09-19T11:57:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 7fe0856dc9c0 / radosgw-admin 2024-09-19T11:57:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:57:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:57:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/log/ceph/ceph-client.admin.114583.log 2024-09-19T11:57:44.030 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:57:44.030 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:57:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient: shutdown 2024-09-19T11:57:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) unregister_commands rotate-key 2024-09-19T11:57:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:57:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient: monmap: 2024-09-19T11:57:44.031 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:44.031 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:44.031 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:44.031 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:44.031 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:44.031 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:44.031 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:44.031 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:44.032 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding auth protocol: cephx 2024-09-19T11:57:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding auth protocol: cephx 2024-09-19T11:57:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding auth protocol: cephx 2024-09-19T11:57:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: secure 2024-09-19T11:57:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: crc 2024-09-19T11:57:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: secure 2024-09-19T11:57:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: crc 2024-09-19T11:57:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: secure 2024-09-19T11:57:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: crc 2024-09-19T11:57:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: crc 2024-09-19T11:57:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: secure 2024-09-19T11:57:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: crc 2024-09-19T11:57:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: secure 2024-09-19T11:57:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: crc 2024-09-19T11:57:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f94e5b0) adding con mode: secure 2024-09-19T11:57:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 1 librados: starting msgr at 2024-09-19T11:57:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 1 librados: starting objecter 2024-09-19T11:57:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command objecter_requests hook 0x55d52f94b980 2024-09-19T11:57:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 1 librados: setting wanted keys 2024-09-19T11:57:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 1 librados: calling monclient init 2024-09-19T11:57:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient: init 2024-09-19T11:57:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding auth protocol: cephx 2024-09-19T11:57:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding auth protocol: cephx 2024-09-19T11:57:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding auth protocol: cephx 2024-09-19T11:57:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: secure 2024-09-19T11:57:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: crc 2024-09-19T11:57:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: secure 2024-09-19T11:57:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: crc 2024-09-19T11:57:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: secure 2024-09-19T11:57:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: crc 2024-09-19T11:57:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: crc 2024-09-19T11:57:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: secure 2024-09-19T11:57:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: crc 2024-09-19T11:57:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: secure 2024-09-19T11:57:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: crc 2024-09-19T11:57:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f91d060) adding con mode: secure 2024-09-19T11:57:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command rotate-key hook 0x55d52f91d1a8 2024-09-19T11:57:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T11:57:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55d52f7d6490 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55d52f7d8a00 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-b con 0x55d52f9239f0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:57:43.627+0000 7fe0856dc9c0 10 monclient(hunting): authenticate will time out at 2357.947337s 2024-09-19T11:57:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): get_auth_request con 0x55d52f7d8a00 auth_method 0 2024-09-19T11:57:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:57:43.627+0000 7fe0831e2640 10 monclient(hunting): get_auth_request con 0x55d52f7d6490 auth_method 0 2024-09-19T11:57:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:57:43.627+0000 7fe0831e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:57:43.627+0000 7fe0831e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:57:43.627+0000 7fe0831e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:57:43.627+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:57:43.627+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:57:43.627+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient(hunting): handle_auth_done global_id 6935 payload 824 2024-09-19T11:57:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient: _finish_hunting 0 2024-09-19T11:57:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:57:43.627+0000 7fe0829e1640 1 monclient: found mon.noname-c 2024-09-19T11:57:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:57:43.627+0000 7fe0829e1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:57:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:57:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: dump: 2024-09-19T11:57:44.037 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:44.037 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:44.037 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.037 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.037 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:44.038 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:44.038 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:44.038 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:44.038 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: _finish_auth 0 2024-09-19T11:57:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: _check_auth_tickets 2024-09-19T11:57:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:57:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 10 monclient: dump: 2024-09-19T11:57:44.038 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:44.038 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:44.038 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.039 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.039 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:44.039 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:44.039 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:44.039 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:44.039 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:57:43.631+0000 7fe0856dc9c0 5 monclient: authenticate success, global_id 6935 2024-09-19T11:57:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:57:43.631+0000 7fe0856dc9c0 10 monclient: _renew_subs 2024-09-19T11:57:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:57:43.631+0000 7fdf7160a640 4 set_mon_vals no callback set 2024-09-19T11:57:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:57:43.631+0000 7fe0856dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:57:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:57:43.631+0000 7fe0856dc9c0 10 monclient: _renew_subs 2024-09-19T11:57:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:57:43.631+0000 7fe0856dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:57:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:57:43.631+0000 7fe0856dc9c0 1 librados: init done 2024-09-19T11:57:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:57:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:57:43.631+0000 7fdf6fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:57:43.631+0000 7fe0831e2640 10 monclient: get_auth_request con 0x7fdf68071c10 auth_method 0 2024-09-19T11:57:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:57:43.631+0000 7fe0839e3640 10 monclient: get_auth_request con 0x55d52f945330 auth_method 0 2024-09-19T11:57:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:57:43.631+0000 7fe0831e2640 10 monclient: get_auth_request con 0x55d52f968160 auth_method 0 2024-09-19T11:57:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:57:43.635+0000 7fe0829e1640 10 monclient: get_auth_request con 0x55d52f96c510 auth_method 0 2024-09-19T11:57:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:57:43.635+0000 7fe0839e3640 10 monclient: get_auth_request con 0x55d52f96b9c0 auth_method 0 2024-09-19T11:57:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:57:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: monmap: 2024-09-19T11:57:44.040 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:44.040 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:44.041 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:44.041 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:44.041 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:44.041 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:44.041 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:44.041 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:44.041 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:44.041 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.041 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding auth protocol: cephx 2024-09-19T11:57:44.041 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding auth protocol: cephx 2024-09-19T11:57:44.041 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding auth protocol: cephx 2024-09-19T11:57:44.041 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: secure 2024-09-19T11:57:44.041 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: crc 2024-09-19T11:57:44.041 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: secure 2024-09-19T11:57:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: crc 2024-09-19T11:57:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: secure 2024-09-19T11:57:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: crc 2024-09-19T11:57:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: crc 2024-09-19T11:57:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: secure 2024-09-19T11:57:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: crc 2024-09-19T11:57:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: secure 2024-09-19T11:57:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: crc 2024-09-19T11:57:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f974690) adding con mode: secure 2024-09-19T11:57:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d52f978000 EEXIST 2024-09-19T11:57:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: init 2024-09-19T11:57:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding auth protocol: cephx 2024-09-19T11:57:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding auth protocol: cephx 2024-09-19T11:57:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding auth protocol: cephx 2024-09-19T11:57:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: secure 2024-09-19T11:57:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: crc 2024-09-19T11:57:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: secure 2024-09-19T11:57:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: crc 2024-09-19T11:57:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: secure 2024-09-19T11:57:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: crc 2024-09-19T11:57:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: crc 2024-09-19T11:57:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: secure 2024-09-19T11:57:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: crc 2024-09-19T11:57:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: secure 2024-09-19T11:57:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: crc 2024-09-19T11:57:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f973588) adding con mode: secure 2024-09-19T11:57:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command rotate-key cmddesc rotate-key hook 0x55d52f9736d0 EEXIST 2024-09-19T11:57:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T11:57:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-b con 0x55d52f99c1b0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55d52f99bae0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55d52f99a4c0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient(hunting): authenticate will time out at 2357.957768s 2024-09-19T11:57:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): get_auth_request con 0x55d52f99a4c0 auth_method 0 2024-09-19T11:57:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:57:43.639+0000 7fe0839e3640 10 monclient(hunting): get_auth_request con 0x55d52f99bae0 auth_method 0 2024-09-19T11:57:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:57:43.639+0000 7fe0839e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:57:43.639+0000 7fe0839e3640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:57:43.639+0000 7fe0839e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:57:43.639+0000 7fe0839e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:57:43.639+0000 7fe0839e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:57:43.639+0000 7fe0839e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:57:43.639+0000 7fe0829e1640 10 monclient(hunting): get_auth_request con 0x55d52f99c1b0 auth_method 0 2024-09-19T11:57:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:57:43.639+0000 7fe0829e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:57:43.639+0000 7fe0829e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:57:43.639+0000 7fe0829e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient(hunting): handle_auth_done global_id 6938 payload 824 2024-09-19T11:57:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient: _finish_hunting 0 2024-09-19T11:57:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:57:43.639+0000 7fe0831e2640 1 monclient: found mon.noname-c 2024-09-19T11:57:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:57:43.639+0000 7fe0831e2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:57:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:57:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: dump: 2024-09-19T11:57:44.046 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:44.047 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:44.047 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.047 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.047 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:44.047 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:44.047 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:44.047 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:44.047 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: _finish_auth 0 2024-09-19T11:57:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: _check_auth_tickets 2024-09-19T11:57:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:44.048 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:57:44.048 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:57:43.639+0000 7fdf6d602640 10 monclient: dump: 2024-09-19T11:57:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:44.048 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.048 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:57:43.639+0000 7fe0841e4640 4 set_mon_vals no callback set 2024-09-19T11:57:44.048 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 5 monclient: authenticate success, global_id 6938 2024-09-19T11:57:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: _renew_subs 2024-09-19T11:57:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:57:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: _renew_subs 2024-09-19T11:57:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:57:43.639+0000 7fe0856dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:57:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:57:43.643+0000 7fdf6d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:57:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:57:43.643+0000 7fdf6d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:57:43.643+0000 7fdf6d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: get_monmap_and_config 2024-09-19T11:57:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:57:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: monmap: 2024-09-19T11:57:44.049 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:44.049 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:44.049 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:44.050 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:44.050 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:44.050 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:44.050 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:44.050 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:44.050 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding auth protocol: cephx 2024-09-19T11:57:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding auth protocol: cephx 2024-09-19T11:57:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding auth protocol: cephx 2024-09-19T11:57:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: secure 2024-09-19T11:57:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: crc 2024-09-19T11:57:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: secure 2024-09-19T11:57:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: crc 2024-09-19T11:57:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: secure 2024-09-19T11:57:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: crc 2024-09-19T11:57:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: crc 2024-09-19T11:57:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: secure 2024-09-19T11:57:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: crc 2024-09-19T11:57:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: secure 2024-09-19T11:57:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: crc 2024-09-19T11:57:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9bba60) adding con mode: secure 2024-09-19T11:57:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient: get_auth_request con 0x7fdf5c071b20 auth_method 0 2024-09-19T11:57:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: init 2024-09-19T11:57:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding auth protocol: cephx 2024-09-19T11:57:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding auth protocol: cephx 2024-09-19T11:57:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding auth protocol: cephx 2024-09-19T11:57:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: secure 2024-09-19T11:57:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: crc 2024-09-19T11:57:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: secure 2024-09-19T11:57:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: crc 2024-09-19T11:57:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: secure 2024-09-19T11:57:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: crc 2024-09-19T11:57:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: crc 2024-09-19T11:57:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: secure 2024-09-19T11:57:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: crc 2024-09-19T11:57:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: secure 2024-09-19T11:57:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: crc 2024-09-19T11:57:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628090) adding con mode: secure 2024-09-19T11:57:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command rotate-key cmddesc rotate-key hook 0x7ffc2e6281d8 EEXIST 2024-09-19T11:57:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T11:57:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55d52f9bfc10 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-b con 0x55d52f9eb380 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55d52f9ebd00 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient(hunting): authenticate will time out at 2357.962448s 2024-09-19T11:57:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient(hunting): get_auth_request con 0x55d52f9bfc10 auth_method 0 2024-09-19T11:57:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): get_auth_request con 0x55d52f9ebd00 auth_method 0 2024-09-19T11:57:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:57:43.643+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient(hunting): handle_auth_done global_id 7437 payload 274 2024-09-19T11:57:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient: _finish_hunting 0 2024-09-19T11:57:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:57:43.643+0000 7fe0831e2640 1 monclient: found mon.noname-a 2024-09-19T11:57:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:57:43.643+0000 7fe0831e2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:57:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:57:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: dump: 2024-09-19T11:57:44.055 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:44.055 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:44.055 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.055 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.055 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:44.055 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:44.055 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:44.055 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:44.056 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: _finish_auth 0 2024-09-19T11:57:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: _check_auth_tickets 2024-09-19T11:57:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:57:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:57:43.643+0000 7fdf66ffd640 10 monclient: dump: 2024-09-19T11:57:44.056 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:44.056 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:44.056 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.056 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.056 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:44.057 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:44.057 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:44.057 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:44.057 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:44.057 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.057 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 5 monclient: authenticate success, global_id 7437 2024-09-19T11:57:44.057 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: get_monmap_and_config success 2024-09-19T11:57:44.057 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 4 set_mon_vals no callback set 2024-09-19T11:57:44.057 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: shutdown 2024-09-19T11:57:44.057 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:57:44.057 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:57:44.057 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:57:43.643+0000 7fe0856dc9c0 10 monclient: monmap: 2024-09-19T11:57:44.057 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:57:44.057 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:57:44.058 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:57:44.058 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:57:44.058 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:57:44.058 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:44.058 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:57:44.058 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:57:44.058 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:57:44.058 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.058 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding auth protocol: cephx 2024-09-19T11:57:44.058 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding auth protocol: cephx 2024-09-19T11:57:44.058 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding auth protocol: cephx 2024-09-19T11:57:44.058 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: secure 2024-09-19T11:57:44.058 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: crc 2024-09-19T11:57:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: secure 2024-09-19T11:57:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: crc 2024-09-19T11:57:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: secure 2024-09-19T11:57:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: crc 2024-09-19T11:57:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: crc 2024-09-19T11:57:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: secure 2024-09-19T11:57:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: crc 2024-09-19T11:57:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: secure 2024-09-19T11:57:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: crc 2024-09-19T11:57:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f9ec1e0) adding con mode: secure 2024-09-19T11:57:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 1 librados: starting msgr at 2024-09-19T11:57:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 1 librados: starting objecter 2024-09-19T11:57:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d52f9bb750 EEXIST 2024-09-19T11:57:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 1 librados: setting wanted keys 2024-09-19T11:57:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 1 librados: calling monclient init 2024-09-19T11:57:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient: init 2024-09-19T11:57:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding auth protocol: cephx 2024-09-19T11:57:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding auth protocol: cephx 2024-09-19T11:57:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding auth protocol: cephx 2024-09-19T11:57:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: secure 2024-09-19T11:57:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: crc 2024-09-19T11:57:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: secure 2024-09-19T11:57:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: crc 2024-09-19T11:57:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: secure 2024-09-19T11:57:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: crc 2024-09-19T11:57:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: crc 2024-09-19T11:57:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: secure 2024-09-19T11:57:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: crc 2024-09-19T11:57:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: secure 2024-09-19T11:57:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: crc 2024-09-19T11:57:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 AuthRegistry(0x55d52f99dfd0) adding con mode: secure 2024-09-19T11:57:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command rotate-key cmddesc rotate-key hook 0x55d52f99e118 EEXIST 2024-09-19T11:57:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:57:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T11:57:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55d52f9bfc10 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:57:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55d52f9eb380 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:57:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): picked mon.noname-b con 0x55d52f9ebd00 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:57:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:57:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:57:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient(hunting): authenticate will time out at 2357.965032s 2024-09-19T11:57:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): get_auth_request con 0x55d52f9bfc10 auth_method 0 2024-09-19T11:57:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:57:43.647+0000 7fe0839e3640 10 monclient(hunting): get_auth_request con 0x55d52f9eb380 auth_method 0 2024-09-19T11:57:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:57:43.647+0000 7fe0839e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:57:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:57:43.647+0000 7fe0839e3640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:57:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:57:43.647+0000 7fe0839e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:57:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:57:43.647+0000 7fe0839e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:57:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:57:43.647+0000 7fe0839e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:57:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:57:43.647+0000 7fe0839e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:57:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient(hunting): handle_auth_done global_id 6944 payload 824 2024-09-19T11:57:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient: _finish_hunting 0 2024-09-19T11:57:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:57:43.647+0000 7fe0829e1640 1 monclient: found mon.noname-c 2024-09-19T11:57:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:57:43.647+0000 7fe0829e1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:57:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:57:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: dump: 2024-09-19T11:57:44.063 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:44.063 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:44.063 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.064 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.064 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:44.064 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:44.064 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:44.064 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:44.064 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: _finish_auth 0 2024-09-19T11:57:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: _check_auth_tickets 2024-09-19T11:57:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: handle_config config(0 keys) 2024-09-19T11:57:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:57:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:57:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:57:43.647+0000 7fdf657fa640 10 monclient: dump: 2024-09-19T11:57:44.065 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:57:44.065 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:57:44.065 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.065 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:57:44.065 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:57:44.065 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:57:44.065 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:57:44.065 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:57:44.065 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:57:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 monclient: authenticate success, global_id 6944 2024-09-19T11:57:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:57:43.647+0000 7fdf66ffd640 4 set_mon_vals no callback set 2024-09-19T11:57:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient: _renew_subs 2024-09-19T11:57:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:57:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient: _renew_subs 2024-09-19T11:57:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:57:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 1 librados: init done 2024-09-19T11:57:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command cr dump hook 0x55d52f9e0598 2024-09-19T11:57:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:57:43.647+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:57:43.647+0000 7fdf657fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:57:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:57:43.647+0000 7fdf657fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:57:43.647+0000 7fdf657fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:57:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:57:43.651+0000 7fe0831e2640 10 monclient: get_auth_request con 0x55d52fa09a60 auth_method 0 2024-09-19T11:57:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:57:43.651+0000 7fe0839e3640 10 monclient: get_auth_request con 0x7fdf4c071be0 auth_method 0 2024-09-19T11:57:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 realm 2024-09-19T11:57:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:57:43.651+0000 7fe0829e1640 10 monclient: get_auth_request con 0x55d52fa0dc90 auth_method 0 2024-09-19T11:57:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:57:43.651+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:57:43.651+0000 7fe0839e3640 10 monclient: get_auth_request con 0x55d52fa114f0 auth_method 0 2024-09-19T11:57:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:57:43.655+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:57:43.655+0000 7fe0856dc9c0 20 searching for the correct realm 2024-09-19T11:57:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:57:43.655+0000 7fe0831e2640 10 monclient: get_auth_request con 0x55d52fa16270 auth_method 0 2024-09-19T11:57:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:57:43.655+0000 7fe0829e1640 10 monclient: get_auth_request con 0x7fe07410ac20 auth_method 0 2024-09-19T11:57:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:57:43.655+0000 7fe0839e3640 10 monclient: get_auth_request con 0x7fe0780657a0 auth_method 0 2024-09-19T11:57:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:57:43.655+0000 7fe0831e2640 0 -- 172.21.15.120:0/671929502 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fe07c008040 msgr2=0x7fe07c026460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:57:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:57:43.859+0000 7fe0831e2640 10 monclient: get_auth_request con 0x7fe07c008040 auth_method 0 2024-09-19T11:57:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:57:43.867+0000 7fe0829e1640 10 monclient: get_auth_request con 0x7fe074121590 auth_method 0 2024-09-19T11:57:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:57:43.871+0000 7fe0831e2640 0 -- 172.21.15.120:0/671929502 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fe07c008040 msgr2=0x7fe07c026460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:57:43.871+0000 7fdf657fa640 1 client.6944.objecter ms_handle_reset 0x7fe07c008040 session 0x7fe07c021040 osd.4 2024-09-19T11:57:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:57:43.871+0000 7fdf657fa640 10 monclient: _renew_subs 2024-09-19T11:57:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:57:43.871+0000 7fdf657fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:57:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:57:43.871+0000 7fe0831e2640 10 monclient: get_auth_request con 0x7fdf4c082280 auth_method 0 2024-09-19T11:57:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 zone default found 2024-09-19T11:57:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 4 Realm: () 2024-09-19T11:57:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 zonegroup default 2024-09-19T11:57:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:57:43.883+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 started sync module instance, tier type = 2024-09-19T11:57:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:57:43.887+0000 7fe0856dc9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=0 2024-09-19T11:57:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=1 2024-09-19T11:57:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=2 2024-09-19T11:57:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=3 2024-09-19T11:57:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=4 2024-09-19T11:57:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=5 2024-09-19T11:57:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:57:43.911+0000 7fe0856dc9c0 20 add_watcher() i=6 2024-09-19T11:57:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:57:43.915+0000 7fe0856dc9c0 20 add_watcher() i=7 2024-09-19T11:57:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:57:43.915+0000 7fe0856dc9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding auth protocol: cephx 2024-09-19T11:57:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding auth protocol: cephx 2024-09-19T11:57:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding auth protocol: cephx 2024-09-19T11:57:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: secure 2024-09-19T11:57:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: crc 2024-09-19T11:57:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: secure 2024-09-19T11:57:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: crc 2024-09-19T11:57:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: secure 2024-09-19T11:57:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: crc 2024-09-19T11:57:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: crc 2024-09-19T11:57:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: secure 2024-09-19T11:57:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: crc 2024-09-19T11:57:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: secure 2024-09-19T11:57:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: crc 2024-09-19T11:57:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 AuthRegistry(0x7ffc2e628560) adding con mode: secure 2024-09-19T11:57:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:57:43.919+0000 7fdf39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:57:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command cache list hook 0x55d52f9de340 2024-09-19T11:57:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command cache inspect hook 0x55d52f9de340 2024-09-19T11:57:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command cache erase hook 0x55d52f9de340 2024-09-19T11:57:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command cache zap hook 0x55d52f9de340 2024-09-19T11:57:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 note: GC not initialized 2024-09-19T11:57:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:57:43.919+0000 7fdf38fe1640 20 reqs_thread_entry: start 2024-09-19T11:57:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command sync trace show hook 0x7fe07c004700 2024-09-19T11:57:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command sync trace history hook 0x7fe07c004700 2024-09-19T11:57:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command sync trace active hook 0x7fe07c004700 2024-09-19T11:57:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 5 asok(0x55d52f711d90) register_command sync trace active_short hook 0x7fe07c004700 2024-09-19T11:57:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:57:43.919+0000 7fe0856dc9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 20 Filter name: none 2024-09-19T11:57:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:57:43.923+0000 7fdeb27fc640 20 reqs_thread_entry: start 2024-09-19T11:57:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-19T11:57:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-19T11:57:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-19T11:57:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 : miss 2024-09-19T11:57:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:57:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:57:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:57:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:57:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:57:43.923+0000 7fe0856dc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 2024-09-19T11:57:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:57:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:57:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33, ofs0, ns] 2024-09-19T11:57:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:57:43.931+0000 7fdf66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366189 cookie 94374115530944 notifier 6944 bl.length()=1015 2024-09-19T11:57:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:57:43.931+0000 7fdf66ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:57:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:57:43.931+0000 7fdf66ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:57:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:57:43.931+0000 7fdf66ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_sources= new_sources= 2024-09-19T11:57:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential sources added=[] removed=[] 2024-09-19T11:57:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_dests= new_dests= 2024-09-19T11:57:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:57:43.931+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential dests added=[] removed=[] 2024-09-19T11:57:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:57:43.939+0000 7fe0856dc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.0 2024-09-19T11:57:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:57:43.939+0000 7fe0856dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.0 2024-09-19T11:57:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:57:43.939+0000 7fe0856dc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.1 2024-09-19T11:57:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:57:43.939+0000 7fe0856dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.1 2024-09-19T11:57:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:57:43.939+0000 7fe0856dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.0 2024-09-19T11:57:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:57:43.943+0000 7fe0856dc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 : hit (requested=0x17, cached=0x17) 2024-09-19T11:57:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:57:43.943+0000 7fe0856dc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 2024-09-19T11:57:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:57:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:57:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33, ofs0, ns] 2024-09-19T11:57:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:57:43.947+0000 7fdf667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366190 cookie 94374115530944 notifier 6944 bl.length()=1015 2024-09-19T11:57:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:57:43.947+0000 7fdf667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:57:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:57:43.947+0000 7fdf667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:57:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:57:43.947+0000 7fdf667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:57:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_sources= new_sources= 2024-09-19T11:57:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential sources added=[] removed=[] 2024-09-19T11:57:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_dests= new_dests= 2024-09-19T11:57:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:57:43.947+0000 7fe0856dc9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential dests added=[] removed=[] 2024-09-19T11:57:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:57:43.951+0000 7fe0856dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.0 2024-09-19T11:57:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:57:43.951+0000 7fe0856dc9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe0856dc9c0 time 2024-09-19T11:57:43.955656+0000 2024-09-19T11:57:44.076 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:57:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe088fb62eb] 2024-09-19T11:57:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe088fb649f] 2024-09-19T11:57:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d52e3be271] 2024-09-19T11:57:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55d52e3ce3b7] 2024-09-19T11:57:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T11:57:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe087e1cd90] 2024-09-19T11:57:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T11:57:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T11:57:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:57:43.951+0000 7fe0856dc9c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:57:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7fe0856dc9c0 thread_name:radosgw-admin 2024-09-19T11:57:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:57:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe087e35520] 2024-09-19T11:57:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:57:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:57:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:57:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe088fb6345] 2024-09-19T11:57:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe088fb649f] 2024-09-19T11:57:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d52e3be271] 2024-09-19T11:57:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55d52e3ce3b7] 2024-09-19T11:57:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T11:57:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe087e1cd90] 2024-09-19T11:57:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T11:57:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T11:57:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:57:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.079 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:57:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:57:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:57:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:57:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:57:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:57:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:57:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:57:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:57:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:57:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:57:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:57:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:57:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:57:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:57:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:57:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:57:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:57:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:57:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:57:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:57:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:57:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:57:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:57:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:57:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:57:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:57:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:57:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:57:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:57:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:57:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:57:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:57:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:57:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:57:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:57:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:57:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:57:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:57:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:57:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:57:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:57:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:57:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:57:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:57:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:57:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:57:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:57:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:57:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:57:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:57:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:57:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:57:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:57:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:57:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:57:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:57:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:57:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:57:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:57:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:57:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:57:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:57:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:57:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:57:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:57:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:57:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:57:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:57:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:57:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:57:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:57:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:57:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:57:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:57:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:57:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:57:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:57:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:57:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:57:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:57:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:57:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:57:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:57:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:57:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:57:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:57:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:57:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:57:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:57:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:57:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:57:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:57:44.086 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:57:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdeb27fc640 / http_manager 2024-09-19T11:57:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf38fe1640 / http_manager 2024-09-19T11:57:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf39fe3640 / rgw_dt_lg_renew 2024-09-19T11:57:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf657fa640 / ms_dispatch 2024-09-19T11:57:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf667fc640 / io_context_pool 2024-09-19T11:57:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf66ffd640 / io_context_pool 2024-09-19T11:57:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf6d602640 / ms_dispatch 2024-09-19T11:57:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf6fe07640 / ms_dispatch 2024-09-19T11:57:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: 7fdf7160a640 / io_context_pool 2024-09-19T11:57:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: 7fe0829e1640 / msgr-worker-2 2024-09-19T11:57:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: 7fe0831e2640 / msgr-worker-1 2024-09-19T11:57:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: 7fe0839e3640 / msgr-worker-0 2024-09-19T11:57:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: 7fe0841e4640 / io_context_pool 2024-09-19T11:57:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: 7fe0856dc9c0 / radosgw-admin 2024-09-19T11:57:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:57:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:57:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/lib/ceph/crash/2024-09-19T11:57:43.957956Z_fc9165b7-2207-42ba-b7f0-e2de2b3dd1c0/log 2024-09-19T11:57:44.087 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:57:44.087 INFO:tasks.workunit.client.0.smithi120.stderr:Aborted 2024-09-19T11:57:44.087 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-19T11:57:44.088 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:57:44.089 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:57:44.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.039+0000 7f932c5759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.039+0000 7f932c5759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.039+0000 7f932c5759c0 20 realm 2024-09-19T11:57:44.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.039+0000 7f932c5759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.039+0000 7f932c5759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.039+0000 7f932c5759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:57:44.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.039+0000 7f932c5759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.039+0000 7f932c5759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.039+0000 7f932c5759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.043+0000 7f932c5759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:44.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.043+0000 7f932c5759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.043+0000 7f932c5759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:57:44.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.043+0000 7f932c5759c0 20 searching for the correct realm 2024-09-19T11:57:44.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.047+0000 7f932a07b640 0 -- 172.21.15.120:0/1820754337 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f932403b400 msgr2=0x7f932403b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:57:44.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.263+0000 7f932a07b640 0 -- 172.21.15.120:0/1820754337 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f932403b400 msgr2=0x7f932403b820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:57:44.272 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:57:44.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:57:44.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:57:44.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:57:44.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:57:44.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:57:44.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:57:44.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:57:44.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 zone default found 2024-09-19T11:57:44.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 4 Realm: () 2024-09-19T11:57:44.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:57:44.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:57:44.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:57:44.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 zonegroup default 2024-09-19T11:57:44.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.276 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.276 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.275+0000 7f932c5759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.276 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.279+0000 7f932c5759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.276 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.279+0000 7f932c5759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.279+0000 7f932c5759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:57:44.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.279+0000 7f932c5759c0 20 started sync module instance, tier type = 2024-09-19T11:57:44.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.279+0000 7f932c5759c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:57:44.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.303+0000 7f932c5759c0 20 add_watcher() i=0 2024-09-19T11:57:44.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.303+0000 7f932c5759c0 20 add_watcher() i=1 2024-09-19T11:57:44.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.303+0000 7f932c5759c0 20 add_watcher() i=2 2024-09-19T11:57:44.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.303+0000 7f932c5759c0 20 add_watcher() i=3 2024-09-19T11:57:44.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.303+0000 7f932c5759c0 20 add_watcher() i=4 2024-09-19T11:57:44.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.303+0000 7f932c5759c0 20 add_watcher() i=5 2024-09-19T11:57:44.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.303+0000 7f932c5759c0 20 add_watcher() i=6 2024-09-19T11:57:44.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.303+0000 7f932c5759c0 20 add_watcher() i=7 2024-09-19T11:57:44.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.303+0000 7f932c5759c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:57:44.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.307+0000 7f91e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:44.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.307+0000 7f932c5759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:57:44.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.307+0000 7f932c5759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:57:44.308 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.311+0000 7f932c5759c0 5 note: GC not initialized 2024-09-19T11:57:44.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.311+0000 7f915b7fe640 20 reqs_thread_entry: start 2024-09-19T11:57:44.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.311+0000 7f932c5759c0 20 init_complete bucket index max shards: 1 2024-09-19T11:57:44.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.311+0000 7f932c5759c0 20 Filter name: none 2024-09-19T11:57:44.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.311+0000 7f91597fa640 20 reqs_thread_entry: start 2024-09-19T11:57:44.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.311+0000 7f932c5759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.311+0000 7f932c5759c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:44.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.311+0000 7f932c5759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.311+0000 7f932c5759c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T11:57:44.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.311+0000 7f932c5759c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:44.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.311+0000 7f932c5759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.311+0000 7f932c5759c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:57:44.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.311+0000 7f932c5759c0 20 rados->read ofs=0 len=0 2024-09-19T11:57:44.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.315+0000 7f932c5759c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T11:57:44.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.315+0000 7f932c5759c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:57:44.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.315+0000 7f91e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:57:44.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.323+0000 7f932c5759c0 20 remove_watcher() i=0 2024-09-19T11:57:44.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.323+0000 7f932c5759c0 2 removed watcher, disabling cache 2024-09-19T11:57:44.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.323+0000 7f932c5759c0 20 remove_watcher() i=1 2024-09-19T11:57:44.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.327+0000 7f932c5759c0 20 remove_watcher() i=2 2024-09-19T11:57:44.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.327+0000 7f932c5759c0 20 remove_watcher() i=3 2024-09-19T11:57:44.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.331+0000 7f932c5759c0 20 remove_watcher() i=4 2024-09-19T11:57:44.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.331+0000 7f932c5759c0 20 remove_watcher() i=5 2024-09-19T11:57:44.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.335+0000 7f932c5759c0 20 remove_watcher() i=6 2024-09-19T11:57:44.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:57:44.335+0000 7f932c5759c0 20 remove_watcher() i=7 2024-09-19T11:57:44.350 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:57:44.350 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:57:44.350 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-commit-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:57:44.350 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:14.474 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:58:14.510 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:14.510 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:14.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.554+0000 7f30eb8359c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:14.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.558+0000 7f30eb8359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:14.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.558+0000 7f30eb8359c0 20 realm 2024-09-19T11:58:14.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.558+0000 7f30eb8359c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:14.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.558+0000 7f30eb8359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:14.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.558+0000 7f30eb8359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:14.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.558+0000 7f30eb8359c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:14.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.558+0000 7f30eb8359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:14.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.558+0000 7f30eb8359c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:14.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.558+0000 7f30eb8359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:14.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.558+0000 7f30eb8359c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:14.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.562+0000 7f30eb8359c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:14.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.562+0000 7f30eb8359c0 20 searching for the correct realm 2024-09-19T11:58:14.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.562+0000 7f30e9b3c640 0 -- 172.21.15.120:0/3293299216 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f30e00750b0 msgr2=0x7f30e0066110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:14.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.778+0000 7f30e8b3a640 0 -- 172.21.15.120:0/3293299216 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f30dc04e910 msgr2=0x7f30dc0403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:14.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:14.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:14.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:14.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:14.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:14.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:14.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:14.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:14.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:14.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:14.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:14.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:14.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 zone default found 2024-09-19T11:58:14.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 4 Realm: () 2024-09-19T11:58:14.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:14.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:14.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:14.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 zonegroup default 2024-09-19T11:58:14.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:14.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:14.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:14.998+0000 7f30eb8359c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.002+0000 7f30eb8359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:15.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.002+0000 7f30eb8359c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.002+0000 7f30eb8359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:15.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.002+0000 7f30eb8359c0 20 started sync module instance, tier type = 2024-09-19T11:58:15.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.002+0000 7f30eb8359c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:15.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.026+0000 7f30eb8359c0 20 add_watcher() i=0 2024-09-19T11:58:15.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.026+0000 7f30eb8359c0 20 add_watcher() i=1 2024-09-19T11:58:15.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.026+0000 7f30eb8359c0 20 add_watcher() i=2 2024-09-19T11:58:15.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.026+0000 7f30eb8359c0 20 add_watcher() i=3 2024-09-19T11:58:15.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.026+0000 7f30eb8359c0 20 add_watcher() i=4 2024-09-19T11:58:15.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.026+0000 7f30eb8359c0 20 add_watcher() i=5 2024-09-19T11:58:15.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.026+0000 7f30eb8359c0 20 add_watcher() i=6 2024-09-19T11:58:15.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.026+0000 7f30eb8359c0 20 add_watcher() i=7 2024-09-19T11:58:15.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.026+0000 7f30eb8359c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:15.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.030+0000 7f2f9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:15.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.034+0000 7f30eb8359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:15.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.034+0000 7f30eb8359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:15.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.034+0000 7f30eb8359c0 5 note: GC not initialized 2024-09-19T11:58:15.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.034+0000 7f2f9e7e4640 20 reqs_thread_entry: start 2024-09-19T11:58:15.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.034+0000 7f30eb8359c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:15.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.034+0000 7f30eb8359c0 20 Filter name: none 2024-09-19T11:58:15.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.034+0000 7f2f0ffff640 20 reqs_thread_entry: start 2024-09-19T11:58:15.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.034+0000 7f30eb8359c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-19T11:58:15.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.034+0000 7f30eb8359c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.034+0000 7f30eb8359c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:58:15.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.034+0000 7f30eb8359c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-19T11:58:15.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.034+0000 7f30eb8359c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-19T11:58:15.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.034+0000 7f30eb8359c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 : miss 2024-09-19T11:58:15.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.034+0000 7f30eb8359c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.038+0000 7f30eb8359c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:58:15.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.038+0000 7f30eb8359c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:58:15.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.038+0000 7f30eb8359c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:58:15.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.038+0000 7f30eb8359c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:58:15.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.038+0000 7f30eb8359c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:15.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.038+0000 7f30eb8359c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 2024-09-19T11:58:15.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.046+0000 7f30eb8359c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:58:15.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.046+0000 7f30eb8359c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:58:15.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.046+0000 7f30eb8359c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:15.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.046+0000 7f30eb8359c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33, ofs0, ns] 2024-09-19T11:58:15.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.046+0000 7f2fccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366192 cookie 94849725096976 notifier 6974 bl.length()=1015 2024-09-19T11:58:15.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.046+0000 7f2fccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:58:15.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.046+0000 7f2fccff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:58:15.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.046+0000 7f2fccff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:15.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.046+0000 7f30eb8359c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_sources= new_sources= 2024-09-19T11:58:15.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.046+0000 7f30eb8359c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential sources added=[] removed=[] 2024-09-19T11:58:15.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.046+0000 7f30eb8359c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_dests= new_dests= 2024-09-19T11:58:15.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.046+0000 7f30eb8359c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential dests added=[] removed=[] 2024-09-19T11:58:15.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.050+0000 7f30eb8359c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.0 2024-09-19T11:58:15.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.050+0000 7f30eb8359c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.0 2024-09-19T11:58:15.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.050+0000 7f30eb8359c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.1 2024-09-19T11:58:15.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.050+0000 7f30eb8359c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.1.1 2024-09-19T11:58:15.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.050+0000 7f30eb8359c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.0 2024-09-19T11:58:15.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.058+0000 7f30eb8359c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 : hit (requested=0x17, cached=0x17) 2024-09-19T11:58:15.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.058+0000 7f30eb8359c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 2024-09-19T11:58:15.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.058+0000 7f30eb8359c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:58:15.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.058+0000 7f30eb8359c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:58:15.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.058+0000 7f30eb8359c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:15.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.058+0000 7f30eb8359c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33, ofs0, ns] 2024-09-19T11:58:15.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.058+0000 7f2fbffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366193 cookie 94849725096976 notifier 6974 bl.length()=1015 2024-09-19T11:58:15.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.058+0000 7f2fbffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:58:15.059 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.058+0000 7f2fbffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:58:15.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.058+0000 7f2fbffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:15.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.058+0000 7f30eb8359c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_sources= new_sources= 2024-09-19T11:58:15.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.058+0000 7f30eb8359c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential sources added=[] removed=[] 2024-09-19T11:58:15.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.058+0000 7f30eb8359c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_dests= new_dests= 2024-09-19T11:58:15.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.058+0000 7f30eb8359c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential dests added=[] removed=[] 2024-09-19T11:58:15.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.062+0000 7f30eb8359c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33.0 2024-09-19T11:58:15.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.062+0000 7f30eb8359c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 : hit (requested=0x17, cached=0x17) 2024-09-19T11:58:15.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.062+0000 7f30eb8359c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 2024-09-19T11:58:15.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.066+0000 7f30eb8359c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:58:15.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.066+0000 7f30eb8359c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:58:15.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.066+0000 7f30eb8359c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:15.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.066+0000 7f30eb8359c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33, ofs0, ns] 2024-09-19T11:58:15.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.066+0000 7f2fccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366194 cookie 94849725096976 notifier 6974 bl.length()=983 2024-09-19T11:58:15.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.066+0000 7f2fccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 info.flags=0x17 2024-09-19T11:58:15.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.066+0000 7f2fccff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 to cache LRU end 2024-09-19T11:58:15.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.066+0000 7f2fccff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:15.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.066+0000 7f30eb8359c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_sources= new_sources= 2024-09-19T11:58:15.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.066+0000 7f30eb8359c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential sources added=[] removed=[] 2024-09-19T11:58:15.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.066+0000 7f30eb8359c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): orig_dests= new_dests= 2024-09-19T11:58:15.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.066+0000 7f30eb8359c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33]): potential dests added=[] removed=[] 2024-09-19T11:58:15.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.070+0000 7f30eb8359c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-19T11:58:15.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.074+0000 7f2f9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:15.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.078+0000 7f30eb8359c0 20 remove_watcher() i=0 2024-09-19T11:58:15.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.078+0000 7f30eb8359c0 2 removed watcher, disabling cache 2024-09-19T11:58:15.080 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.082+0000 7f30eb8359c0 20 remove_watcher() i=1 2024-09-19T11:58:15.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.082+0000 7f30eb8359c0 20 remove_watcher() i=2 2024-09-19T11:58:15.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.086+0000 7f30eb8359c0 20 remove_watcher() i=3 2024-09-19T11:58:15.087 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.090+0000 7f30eb8359c0 20 remove_watcher() i=4 2024-09-19T11:58:15.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.090+0000 7f30eb8359c0 20 remove_watcher() i=5 2024-09-19T11:58:15.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.090+0000 7f30eb8359c0 20 remove_watcher() i=6 2024-09-19T11:58:15.092 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.094+0000 7f30eb8359c0 20 remove_watcher() i=7 2024-09-19T11:58:15.107 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-19T11:58:15.134 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:15.134 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:15.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.390+0000 7fa9112a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.390+0000 7fa9112a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:15.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.390+0000 7fa9112a49c0 20 realm 2024-09-19T11:58:15.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.390+0000 7fa9112a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.390+0000 7fa9112a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:15.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.390+0000 7fa9112a49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:15.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.390+0000 7fa9112a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.390+0000 7fa9112a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:15.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.390+0000 7fa9112a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.394+0000 7fa9112a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:15.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.394+0000 7fa9112a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.394+0000 7fa9112a49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:15.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.394+0000 7fa9112a49c0 20 searching for the correct realm 2024-09-19T11:58:15.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.398+0000 7fa90e5a9640 0 -- 172.21.15.120:0/1480196956 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7fa9080c7920 msgr2=0x7fa9080d6400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:15.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.610+0000 7fa90f5ab640 0 -- 172.21.15.120:0/1480196956 >> [v2:172.21.15.151:6808/4185618971,v1:172.21.15.151:6809/4185618971] conn(0x557014388da0 msgr2=0x55701438b190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:15.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:15.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:15.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:15.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:15.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:15.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:15.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:15.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:15.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:15.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 20 zone default found 2024-09-19T11:58:15.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 4 Realm: () 2024-09-19T11:58:15.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:15.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:15.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:15.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 20 zonegroup default 2024-09-19T11:58:15.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.630+0000 7fa9112a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.634+0000 7fa9112a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:15.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.634+0000 7fa9112a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.634+0000 7fa9112a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:15.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.634+0000 7fa9112a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.634+0000 7fa9112a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:15.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.634+0000 7fa9112a49c0 20 started sync module instance, tier type = 2024-09-19T11:58:15.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.634+0000 7fa9112a49c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:15.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.658+0000 7fa9112a49c0 20 add_watcher() i=0 2024-09-19T11:58:15.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.658+0000 7fa9112a49c0 20 add_watcher() i=1 2024-09-19T11:58:15.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.658+0000 7fa9112a49c0 20 add_watcher() i=2 2024-09-19T11:58:15.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.658+0000 7fa9112a49c0 20 add_watcher() i=3 2024-09-19T11:58:15.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.658+0000 7fa9112a49c0 20 add_watcher() i=4 2024-09-19T11:58:15.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.658+0000 7fa9112a49c0 20 add_watcher() i=5 2024-09-19T11:58:15.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.658+0000 7fa9112a49c0 20 add_watcher() i=6 2024-09-19T11:58:15.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.662+0000 7fa9112a49c0 20 add_watcher() i=7 2024-09-19T11:58:15.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.662+0000 7fa9112a49c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:15.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.670+0000 7fa7c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:15.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.670+0000 7fa9112a49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:15.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.670+0000 7fa9112a49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:15.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.670+0000 7fa9112a49c0 5 note: GC not initialized 2024-09-19T11:58:15.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.670+0000 7fa73ffff640 20 reqs_thread_entry: start 2024-09-19T11:58:15.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.670+0000 7fa9112a49c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:15.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.670+0000 7fa9112a49c0 20 Filter name: none 2024-09-19T11:58:15.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.670+0000 7fa73dffb640 20 reqs_thread_entry: start 2024-09-19T11:58:15.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.670+0000 7fa9112a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.670+0000 7fa9112a49c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:58:15.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.670+0000 7fa9112a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.674+0000 7fa9112a49c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:58:15.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.674+0000 7fa9112a49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:15.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.674+0000 7fa9112a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.674+0000 7fa9112a49c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:58:15.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.674+0000 7fa9112a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:15.673 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.674+0000 7fa9112a49c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:58:15.673 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.674+0000 7fa9112a49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:15.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.678+0000 7fa7c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:15.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.682+0000 7fa9112a49c0 20 remove_watcher() i=0 2024-09-19T11:58:15.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.682+0000 7fa9112a49c0 2 removed watcher, disabling cache 2024-09-19T11:58:15.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.682+0000 7fa9112a49c0 20 remove_watcher() i=1 2024-09-19T11:58:15.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.686+0000 7fa9112a49c0 20 remove_watcher() i=2 2024-09-19T11:58:15.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.690+0000 7fa9112a49c0 20 remove_watcher() i=3 2024-09-19T11:58:15.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.690+0000 7fa9112a49c0 20 remove_watcher() i=4 2024-09-19T11:58:15.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.690+0000 7fa9112a49c0 20 remove_watcher() i=5 2024-09-19T11:58:15.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.694+0000 7fa9112a49c0 20 remove_watcher() i=6 2024-09-19T11:58:15.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:15.694+0000 7fa9112a49c0 20 remove_watcher() i=7 2024-09-19T11:58:15.709 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:15.709 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:58:15.709 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-commit-target-layout id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T11:58:15.709 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:15.787 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-19T11:58:15.787 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:16.318 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-19T11:58:16.350 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:16.350 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:16.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.398+0000 7fd36203e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.398+0000 7fd36203e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:16.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.398+0000 7fd36203e9c0 20 realm 2024-09-19T11:58:16.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.398+0000 7fd36203e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.398+0000 7fd36203e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:16.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.398+0000 7fd36203e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:16.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.398+0000 7fd36203e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.398+0000 7fd36203e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:16.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.398+0000 7fd36203e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.402+0000 7fd36203e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:16.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.402+0000 7fd36203e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.402+0000 7fd36203e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:16.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.402+0000 7fd36203e9c0 20 searching for the correct realm 2024-09-19T11:58:16.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.406+0000 7fd35fb44640 0 -- 172.21.15.120:0/1511701064 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fd35802f450 msgr2=0x7fd35802f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:16.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.622+0000 7fd35fb44640 0 -- 172.21.15.120:0/1511701064 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fd35802f450 msgr2=0x7fd35802f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:16.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.634+0000 7fd36203e9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:16.633 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.634+0000 7fd36203e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:16.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.634+0000 7fd36203e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:16.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.634+0000 7fd36203e9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:16.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.634+0000 7fd36203e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:16.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.634+0000 7fd36203e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:16.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.634+0000 7fd36203e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.634+0000 7fd36203e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:16.634 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.634+0000 7fd36203e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.634+0000 7fd36203e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:16.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.634+0000 7fd36203e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.638+0000 7fd36203e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:16.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.638+0000 7fd36203e9c0 20 zone default found 2024-09-19T11:58:16.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.638+0000 7fd36203e9c0 4 Realm: () 2024-09-19T11:58:16.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.638+0000 7fd36203e9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:16.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.638+0000 7fd36203e9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:16.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.638+0000 7fd36203e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:16.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.638+0000 7fd36203e9c0 20 zonegroup default 2024-09-19T11:58:16.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.638+0000 7fd36203e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.638+0000 7fd36203e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:16.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.638+0000 7fd36203e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.638+0000 7fd36203e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:16.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.638+0000 7fd36203e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.638+0000 7fd36203e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:16.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.638+0000 7fd36203e9c0 20 started sync module instance, tier type = 2024-09-19T11:58:16.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.638+0000 7fd36203e9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:16.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.662+0000 7fd36203e9c0 20 add_watcher() i=0 2024-09-19T11:58:16.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.662+0000 7fd36203e9c0 20 add_watcher() i=1 2024-09-19T11:58:16.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.662+0000 7fd36203e9c0 20 add_watcher() i=2 2024-09-19T11:58:16.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.662+0000 7fd36203e9c0 20 add_watcher() i=3 2024-09-19T11:58:16.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.662+0000 7fd36203e9c0 20 add_watcher() i=4 2024-09-19T11:58:16.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.662+0000 7fd36203e9c0 20 add_watcher() i=5 2024-09-19T11:58:16.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.662+0000 7fd36203e9c0 20 add_watcher() i=6 2024-09-19T11:58:16.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.666+0000 7fd36203e9c0 20 add_watcher() i=7 2024-09-19T11:58:16.664 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.666+0000 7fd36203e9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:16.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.670+0000 7fd215fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:16.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.670+0000 7fd36203e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:16.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.670+0000 7fd36203e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:16.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.670+0000 7fd36203e9c0 5 note: GC not initialized 2024-09-19T11:58:16.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.670+0000 7fd214fe1640 20 reqs_thread_entry: start 2024-09-19T11:58:16.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.670+0000 7fd36203e9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:16.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.670+0000 7fd36203e9c0 20 Filter name: none 2024-09-19T11:58:16.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.670+0000 7fd18e7fc640 20 reqs_thread_entry: start 2024-09-19T11:58:16.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.670+0000 7fd36203e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.670+0000 7fd36203e9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:16.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.670+0000 7fd36203e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.670+0000 7fd36203e9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:58:16.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.670+0000 7fd36203e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:16.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.670+0000 7fd36203e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.674+0000 7fd36203e9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:16.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.674+0000 7fd36203e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.674+0000 7fd36203e9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:58:16.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.674+0000 7fd36203e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:16.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.674+0000 7fd215fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:16.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.682+0000 7fd36203e9c0 20 remove_watcher() i=0 2024-09-19T11:58:16.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.682+0000 7fd36203e9c0 2 removed watcher, disabling cache 2024-09-19T11:58:16.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.682+0000 7fd36203e9c0 20 remove_watcher() i=1 2024-09-19T11:58:16.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.686+0000 7fd36203e9c0 20 remove_watcher() i=2 2024-09-19T11:58:16.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.690+0000 7fd36203e9c0 20 remove_watcher() i=3 2024-09-19T11:58:16.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.690+0000 7fd36203e9c0 20 remove_watcher() i=4 2024-09-19T11:58:16.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.690+0000 7fd36203e9c0 20 remove_watcher() i=5 2024-09-19T11:58:16.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.694+0000 7fd36203e9c0 20 remove_watcher() i=6 2024-09-19T11:58:16.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.694+0000 7fd36203e9c0 20 remove_watcher() i=7 2024-09-19T11:58:16.709 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:16.709 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:58:16.709 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-do-reshard id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:58:16.709 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:16.710 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-19T11:58:16.742 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:16.743 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:16.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.790+0000 7fb23a2d09c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.790+0000 7fb23a2d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:16.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.790+0000 7fb23a2d09c0 20 realm 2024-09-19T11:58:16.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.790+0000 7fb23a2d09c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.790+0000 7fb23a2d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:16.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.790+0000 7fb23a2d09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:16.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.790+0000 7fb23a2d09c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.790+0000 7fb23a2d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:16.790 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.790+0000 7fb23a2d09c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.790+0000 7fb23a2d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:16.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.790+0000 7fb23a2d09c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:16.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.794+0000 7fb23a2d09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:16.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.794+0000 7fb23a2d09c0 20 searching for the correct realm 2024-09-19T11:58:16.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:16.794+0000 7fb22ffff640 0 -- 172.21.15.120:0/600389213 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7fb22801c040 msgr2=0x7fb228067800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:17.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.010+0000 7fb2385d7640 0 -- 172.21.15.120:0/600389213 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fb22002b060 msgr2=0x7fb2200656a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:17.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.026+0000 7fb23a2d09c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:17.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.026+0000 7fb23a2d09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:17.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.026+0000 7fb23a2d09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:17.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.026+0000 7fb23a2d09c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:17.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.026+0000 7fb23a2d09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:17.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.026+0000 7fb23a2d09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:17.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.026+0000 7fb23a2d09c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.026+0000 7fb23a2d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.026+0000 7fb23a2d09c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:17.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:17.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 20 zone default found 2024-09-19T11:58:17.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 4 Realm: () 2024-09-19T11:58:17.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:17.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:17.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:17.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 20 zonegroup default 2024-09-19T11:58:17.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 20 started sync module instance, tier type = 2024-09-19T11:58:17.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.030+0000 7fb23a2d09c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:17.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.058+0000 7fb23a2d09c0 20 add_watcher() i=0 2024-09-19T11:58:17.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.058+0000 7fb23a2d09c0 20 add_watcher() i=1 2024-09-19T11:58:17.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.058+0000 7fb23a2d09c0 20 add_watcher() i=2 2024-09-19T11:58:17.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.058+0000 7fb23a2d09c0 20 add_watcher() i=3 2024-09-19T11:58:17.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.058+0000 7fb23a2d09c0 20 add_watcher() i=4 2024-09-19T11:58:17.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.058+0000 7fb23a2d09c0 20 add_watcher() i=5 2024-09-19T11:58:17.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.058+0000 7fb23a2d09c0 20 add_watcher() i=6 2024-09-19T11:58:17.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.058+0000 7fb23a2d09c0 20 add_watcher() i=7 2024-09-19T11:58:17.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.058+0000 7fb23a2d09c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:17.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.062+0000 7fb0edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:17.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.062+0000 7fb23a2d09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:17.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.062+0000 7fb23a2d09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:17.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.062+0000 7fb23a2d09c0 5 note: GC not initialized 2024-09-19T11:58:17.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb0ecfe1640 20 reqs_thread_entry: start 2024-09-19T11:58:17.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb23a2d09c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:17.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb23a2d09c0 20 Filter name: none 2024-09-19T11:58:17.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb0667fc640 20 reqs_thread_entry: start 2024-09-19T11:58:17.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb23a2d09c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-19T11:58:17.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb23a2d09c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb23a2d09c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:17.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb23a2d09c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-19T11:58:17.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb23a2d09c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-19T11:58:17.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb23a2d09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 : miss 2024-09-19T11:58:17.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb23a2d09c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb23a2d09c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:58:17.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb23a2d09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 info.flags=0x17 2024-09-19T11:58:17.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb23a2d09c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 to cache LRU end 2024-09-19T11:58:17.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb23a2d09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:58:17.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb23a2d09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:17.067 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.066+0000 7fb23a2d09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 2024-09-19T11:58:17.076 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.078+0000 7fb23a2d09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 info.flags=0x17 2024-09-19T11:58:17.076 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.078+0000 7fb23a2d09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 to cache LRU end 2024-09-19T11:58:17.076 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.078+0000 7fb23a2d09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:17.076 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.078+0000 7fb23a2d09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34, ofs0, ns] 2024-09-19T11:58:17.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.078+0000 7fb116ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366266 cookie 94869175054512 notifier 7025 bl.length()=995 2024-09-19T11:58:17.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.078+0000 7fb116ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 info.flags=0x17 2024-09-19T11:58:17.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.078+0000 7fb116ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 to cache LRU end 2024-09-19T11:58:17.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.078+0000 7fb116ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:17.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.078+0000 7fb23a2d09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): orig_sources= new_sources= 2024-09-19T11:58:17.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.078+0000 7fb23a2d09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): potential sources added=[] removed=[] 2024-09-19T11:58:17.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.078+0000 7fb23a2d09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): orig_dests= new_dests= 2024-09-19T11:58:17.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.078+0000 7fb23a2d09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): potential dests added=[] removed=[] 2024-09-19T11:58:17.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.086+0000 7fb23a2d09c0 -1 Injecting error=-5 at location=do_reshard 2024-09-19T11:58:17.091 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.090+0000 7fb23a2d09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 : hit (requested=0x17, cached=0x17) 2024-09-19T11:58:17.091 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.090+0000 7fb23a2d09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 2024-09-19T11:58:17.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.094+0000 7fb23a2d09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 info.flags=0x17 2024-09-19T11:58:17.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.094+0000 7fb23a2d09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 to cache LRU end 2024-09-19T11:58:17.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.094+0000 7fb23a2d09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:17.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.094+0000 7fb23a2d09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34, ofs0, ns] 2024-09-19T11:58:17.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.094+0000 7fb116ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366267 cookie 94869175054512 notifier 7025 bl.length()=963 2024-09-19T11:58:17.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.094+0000 7fb116ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 info.flags=0x17 2024-09-19T11:58:17.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.094+0000 7fb116ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 to cache LRU end 2024-09-19T11:58:17.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.094+0000 7fb116ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:17.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.098+0000 7fb23a2d09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): orig_sources= new_sources= 2024-09-19T11:58:17.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.098+0000 7fb23a2d09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): potential sources added=[] removed=[] 2024-09-19T11:58:17.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.098+0000 7fb23a2d09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): orig_dests= new_dests= 2024-09-19T11:58:17.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.098+0000 7fb23a2d09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): potential dests added=[] removed=[] 2024-09-19T11:58:17.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.098+0000 7fb23a2d09c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-19T11:58:17.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.102+0000 7fb0edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:17.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.106+0000 7fb23a2d09c0 20 remove_watcher() i=0 2024-09-19T11:58:17.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.106+0000 7fb23a2d09c0 2 removed watcher, disabling cache 2024-09-19T11:58:17.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.110+0000 7fb23a2d09c0 20 remove_watcher() i=1 2024-09-19T11:58:17.110 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.110+0000 7fb23a2d09c0 20 remove_watcher() i=2 2024-09-19T11:58:17.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.114+0000 7fb23a2d09c0 20 remove_watcher() i=3 2024-09-19T11:58:17.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.118+0000 7fb23a2d09c0 20 remove_watcher() i=4 2024-09-19T11:58:17.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.118+0000 7fb23a2d09c0 20 remove_watcher() i=5 2024-09-19T11:58:17.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.118+0000 7fb23a2d09c0 20 remove_watcher() i=6 2024-09-19T11:58:17.121 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.122+0000 7fb23a2d09c0 20 remove_watcher() i=7 2024-09-19T11:58:17.135 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-19T11:58:17.163 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:17.163 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:17.209 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.210+0000 7ff714e8f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.210+0000 7ff714e8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.210+0000 7ff714e8f9c0 20 realm 2024-09-19T11:58:17.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.210+0000 7ff714e8f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.210+0000 7ff714e8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.210+0000 7ff714e8f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:17.211 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.210+0000 7ff714e8f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.212 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.210+0000 7ff714e8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.212 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.210+0000 7ff714e8f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.213 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.214+0000 7ff714e8f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:17.213 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.214+0000 7ff714e8f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.215 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.218+0000 7ff714e8f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:17.215 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.218+0000 7ff714e8f9c0 20 searching for the correct realm 2024-09-19T11:58:17.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.222+0000 7ff712995640 0 -- 172.21.15.120:0/871542657 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff70c004030 msgr2=0x7ff70c1056f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:58:17.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.438+0000 7ff712995640 0 -- 172.21.15.120:0/871542657 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff70c004030 msgr2=0x7ff70c1056f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:17.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.450+0000 7ff714e8f9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:17.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.450+0000 7ff714e8f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:17.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.450+0000 7ff714e8f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:17.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.450+0000 7ff714e8f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:17.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.450+0000 7ff714e8f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:17.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.450+0000 7ff714e8f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:17.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.450+0000 7ff714e8f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.450+0000 7ff714e8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.450+0000 7ff714e8f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.450+0000 7ff714e8f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:17.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.450+0000 7ff714e8f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.454+0000 7ff714e8f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:17.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.454+0000 7ff714e8f9c0 20 zone default found 2024-09-19T11:58:17.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.454+0000 7ff714e8f9c0 4 Realm: () 2024-09-19T11:58:17.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.454+0000 7ff714e8f9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:17.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.454+0000 7ff714e8f9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:17.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.454+0000 7ff714e8f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:17.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.454+0000 7ff714e8f9c0 20 zonegroup default 2024-09-19T11:58:17.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.454+0000 7ff714e8f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.454+0000 7ff714e8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.454+0000 7ff714e8f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.454+0000 7ff714e8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.453 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.454+0000 7ff714e8f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.454+0000 7ff714e8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.454+0000 7ff714e8f9c0 20 started sync module instance, tier type = 2024-09-19T11:58:17.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.454+0000 7ff714e8f9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:17.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.474+0000 7ff714e8f9c0 20 add_watcher() i=0 2024-09-19T11:58:17.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.474+0000 7ff714e8f9c0 20 add_watcher() i=1 2024-09-19T11:58:17.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.474+0000 7ff714e8f9c0 20 add_watcher() i=2 2024-09-19T11:58:17.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.474+0000 7ff714e8f9c0 20 add_watcher() i=3 2024-09-19T11:58:17.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.474+0000 7ff714e8f9c0 20 add_watcher() i=4 2024-09-19T11:58:17.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.474+0000 7ff714e8f9c0 20 add_watcher() i=5 2024-09-19T11:58:17.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.474+0000 7ff714e8f9c0 20 add_watcher() i=6 2024-09-19T11:58:17.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.478+0000 7ff714e8f9c0 20 add_watcher() i=7 2024-09-19T11:58:17.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.478+0000 7ff714e8f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:17.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.482+0000 7ff5c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:17.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.482+0000 7ff714e8f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:17.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.482+0000 7ff714e8f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:17.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.482+0000 7ff714e8f9c0 5 note: GC not initialized 2024-09-19T11:58:17.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.482+0000 7ff543fff640 20 reqs_thread_entry: start 2024-09-19T11:58:17.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.482+0000 7ff714e8f9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:17.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.482+0000 7ff714e8f9c0 20 Filter name: none 2024-09-19T11:58:17.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.482+0000 7ff714e8f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.482+0000 7ff541ffb640 20 reqs_thread_entry: start 2024-09-19T11:58:17.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.482+0000 7ff714e8f9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:17.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.482+0000 7ff714e8f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.486+0000 7ff714e8f9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:58:17.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.486+0000 7ff714e8f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:17.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.486+0000 7ff714e8f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.486+0000 7ff714e8f9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:17.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.486+0000 7ff714e8f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.486+0000 7ff714e8f9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:58:17.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.486+0000 7ff714e8f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:17.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.486+0000 7ff5c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:17.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.494+0000 7ff714e8f9c0 20 remove_watcher() i=0 2024-09-19T11:58:17.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.494+0000 7ff714e8f9c0 2 removed watcher, disabling cache 2024-09-19T11:58:17.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.494+0000 7ff714e8f9c0 20 remove_watcher() i=1 2024-09-19T11:58:17.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.498+0000 7ff714e8f9c0 20 remove_watcher() i=2 2024-09-19T11:58:17.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.498+0000 7ff714e8f9c0 20 remove_watcher() i=3 2024-09-19T11:58:17.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.502+0000 7ff714e8f9c0 20 remove_watcher() i=4 2024-09-19T11:58:17.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.502+0000 7ff714e8f9c0 20 remove_watcher() i=5 2024-09-19T11:58:17.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.506+0000 7ff714e8f9c0 20 remove_watcher() i=6 2024-09-19T11:58:17.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.506+0000 7ff714e8f9c0 20 remove_watcher() i=7 2024-09-19T11:58:17.520 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:17.521 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:58:17.521 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-do-reshard id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:58:17.521 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:17.581 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:58:17.618 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:17.618 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:17.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.666+0000 7f9adcbd89c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.665 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.666+0000 7f9adcbd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.665 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.666+0000 7f9adcbd89c0 20 realm 2024-09-19T11:58:17.665 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.666+0000 7f9adcbd89c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.666+0000 7f9adcbd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.666+0000 7f9adcbd89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:17.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.666+0000 7f9adcbd89c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.666+0000 7f9adcbd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.666+0000 7f9adcbd89c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.666+0000 7f9adcbd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:17.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.666+0000 7f9adcbd89c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.670+0000 7f9adcbd89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:17.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.670+0000 7f9adcbd89c0 20 searching for the correct realm 2024-09-19T11:58:17.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.674+0000 7f9adaedf640 0 -- 172.21.15.120:0/2038949926 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f9ac406d7d0 msgr2=0x7f9ac4062fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:17.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.682+0000 7f9ad3fff640 0 -- 172.21.15.120:0/2038949926 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f9acc07bc20 msgr2=0x7f9acc06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:17.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.898+0000 7f9adcbd89c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:17.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.898+0000 7f9adcbd89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:17.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.898+0000 7f9adcbd89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:17.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.898+0000 7f9adcbd89c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:17.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.898+0000 7f9adcbd89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:17.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.898+0000 7f9adcbd89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:17.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.898+0000 7f9adcbd89c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.898+0000 7f9adcbd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.898+0000 7f9adcbd89c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.902+0000 7f9adcbd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:17.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.902+0000 7f9adcbd89c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.902+0000 7f9adcbd89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:17.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.902+0000 7f9adcbd89c0 20 zone default found 2024-09-19T11:58:17.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.902+0000 7f9adcbd89c0 4 Realm: () 2024-09-19T11:58:17.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.902+0000 7f9adcbd89c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:17.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.902+0000 7f9adcbd89c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:17.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.902+0000 7f9adcbd89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:17.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.902+0000 7f9adcbd89c0 20 zonegroup default 2024-09-19T11:58:17.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.902+0000 7f9adcbd89c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.902+0000 7f9adcbd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.902+0000 7f9adcbd89c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.902+0000 7f9adcbd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.902+0000 7f9adcbd89c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.906+0000 7f9adcbd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:17.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.906+0000 7f9adcbd89c0 20 started sync module instance, tier type = 2024-09-19T11:58:17.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.906+0000 7f9adcbd89c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:17.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.930+0000 7f9adcbd89c0 20 add_watcher() i=0 2024-09-19T11:58:17.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.930+0000 7f9adcbd89c0 20 add_watcher() i=1 2024-09-19T11:58:17.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.930+0000 7f9adcbd89c0 20 add_watcher() i=2 2024-09-19T11:58:17.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.930+0000 7f9adcbd89c0 20 add_watcher() i=3 2024-09-19T11:58:17.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.930+0000 7f9adcbd89c0 20 add_watcher() i=4 2024-09-19T11:58:17.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.930+0000 7f9adcbd89c0 20 add_watcher() i=5 2024-09-19T11:58:17.928 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.930+0000 7f9adcbd89c0 20 add_watcher() i=6 2024-09-19T11:58:17.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.930+0000 7f9adcbd89c0 20 add_watcher() i=7 2024-09-19T11:58:17.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.930+0000 7f9adcbd89c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:17.934 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.934+0000 7f9990fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:17.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:17.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:17.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 5 note: GC not initialized 2024-09-19T11:58:17.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f990b7fe640 20 reqs_thread_entry: start 2024-09-19T11:58:17.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:17.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 20 Filter name: none 2024-09-19T11:58:17.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f99097fa640 20 reqs_thread_entry: start 2024-09-19T11:58:17.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-19T11:58:17.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:17.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-19T11:58:17.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-19T11:58:17.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 : miss 2024-09-19T11:58:17.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:17.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:58:17.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 info.flags=0x17 2024-09-19T11:58:17.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 to cache LRU end 2024-09-19T11:58:17.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:58:17.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:17.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.938+0000 7f9adcbd89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 2024-09-19T11:58:17.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.946+0000 7f9adcbd89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 info.flags=0x17 2024-09-19T11:58:17.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.946+0000 7f9adcbd89c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 to cache LRU end 2024-09-19T11:58:17.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.946+0000 7f9adcbd89c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:17.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.946+0000 7f9adcbd89c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34, ofs0, ns] 2024-09-19T11:58:17.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.950+0000 7f99bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366268 cookie 94396355845968 notifier 7058 bl.length()=995 2024-09-19T11:58:17.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.950+0000 7f99bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 info.flags=0x17 2024-09-19T11:58:17.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.950+0000 7f99bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 to cache LRU end 2024-09-19T11:58:17.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.950+0000 7f99bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:17.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.950+0000 7f9adcbd89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): orig_sources= new_sources= 2024-09-19T11:58:17.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.950+0000 7f9adcbd89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): potential sources added=[] removed=[] 2024-09-19T11:58:17.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.950+0000 7f9adcbd89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): orig_dests= new_dests= 2024-09-19T11:58:17.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.950+0000 7f9adcbd89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): potential dests added=[] removed=[] 2024-09-19T11:58:17.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.954+0000 7f9adcbd89c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34.1.0 2024-09-19T11:58:17.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.954+0000 7f9adcbd89c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34.1.0 2024-09-19T11:58:17.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.954+0000 7f9adcbd89c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34.1.1 2024-09-19T11:58:17.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.954+0000 7f9adcbd89c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34.1.1 2024-09-19T11:58:17.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.954+0000 7f9adcbd89c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34.0 2024-09-19T11:58:17.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.962+0000 7f9adcbd89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 : hit (requested=0x17, cached=0x17) 2024-09-19T11:58:17.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.962+0000 7f9adcbd89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 2024-09-19T11:58:17.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.962+0000 7f9adcbd89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 info.flags=0x17 2024-09-19T11:58:17.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.962+0000 7f9adcbd89c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 to cache LRU end 2024-09-19T11:58:17.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.962+0000 7f9adcbd89c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:17.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.962+0000 7f9adcbd89c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34, ofs0, ns] 2024-09-19T11:58:17.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.966+0000 7f99bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366269 cookie 94396355845968 notifier 7058 bl.length()=995 2024-09-19T11:58:17.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.966+0000 7f99bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 info.flags=0x17 2024-09-19T11:58:17.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.966+0000 7f99bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 to cache LRU end 2024-09-19T11:58:17.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.966+0000 7f99bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:17.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.966+0000 7f9adcbd89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): orig_sources= new_sources= 2024-09-19T11:58:17.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.966+0000 7f9adcbd89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): potential sources added=[] removed=[] 2024-09-19T11:58:17.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.966+0000 7f9adcbd89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): orig_dests= new_dests= 2024-09-19T11:58:17.965 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.966+0000 7f9adcbd89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): potential dests added=[] removed=[] 2024-09-19T11:58:17.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.970+0000 7f9adcbd89c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34.0 2024-09-19T11:58:17.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.970+0000 7f9adcbd89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 : hit (requested=0x17, cached=0x17) 2024-09-19T11:58:17.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.970+0000 7f9adcbd89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 2024-09-19T11:58:17.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.970+0000 7f9adcbd89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 info.flags=0x17 2024-09-19T11:58:17.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.970+0000 7f9adcbd89c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 to cache LRU end 2024-09-19T11:58:17.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.970+0000 7f9adcbd89c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:17.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.970+0000 7f9adcbd89c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34, ofs0, ns] 2024-09-19T11:58:17.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.974+0000 7f99bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366270 cookie 94396355845968 notifier 7058 bl.length()=963 2024-09-19T11:58:17.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.974+0000 7f99bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 info.flags=0x17 2024-09-19T11:58:17.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.974+0000 7f99bdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 to cache LRU end 2024-09-19T11:58:17.972 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.974+0000 7f99bdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:17.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.974+0000 7f9adcbd89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): orig_sources= new_sources= 2024-09-19T11:58:17.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.974+0000 7f9adcbd89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): potential sources added=[] removed=[] 2024-09-19T11:58:17.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.974+0000 7f9adcbd89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): orig_dests= new_dests= 2024-09-19T11:58:17.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.974+0000 7f9adcbd89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34]): potential dests added=[] removed=[] 2024-09-19T11:58:17.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.978+0000 7f9adcbd89c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-19T11:58:17.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.982+0000 7f9990fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:17.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.986+0000 7f9adcbd89c0 20 remove_watcher() i=0 2024-09-19T11:58:17.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.986+0000 7f9adcbd89c0 2 removed watcher, disabling cache 2024-09-19T11:58:17.989 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.990+0000 7f9adcbd89c0 20 remove_watcher() i=1 2024-09-19T11:58:17.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.990+0000 7f9adcbd89c0 20 remove_watcher() i=2 2024-09-19T11:58:17.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.994+0000 7f9adcbd89c0 20 remove_watcher() i=3 2024-09-19T11:58:17.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:17.998+0000 7f9adcbd89c0 20 remove_watcher() i=4 2024-09-19T11:58:18.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.002+0000 7f9adcbd89c0 20 remove_watcher() i=5 2024-09-19T11:58:18.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.006+0000 7f9adcbd89c0 20 remove_watcher() i=6 2024-09-19T11:58:18.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.006+0000 7f9adcbd89c0 20 remove_watcher() i=7 2024-09-19T11:58:18.022 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-19T11:58:18.053 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:18.053 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:18.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.098+0000 7f55bc7a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:18.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.102+0000 7f55bc7a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:18.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.102+0000 7f55bc7a49c0 20 realm 2024-09-19T11:58:18.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.102+0000 7f55bc7a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:18.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.102+0000 7f55bc7a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:18.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.102+0000 7f55bc7a49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:18.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.102+0000 7f55bc7a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:18.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.102+0000 7f55bc7a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:18.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.102+0000 7f55bc7a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:18.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.102+0000 7f55bc7a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:18.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.102+0000 7f55bc7a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:18.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.106+0000 7f55bc7a49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:18.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.106+0000 7f55bc7a49c0 20 searching for the correct realm 2024-09-19T11:58:18.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.110+0000 7f55ba2aa640 0 -- 172.21.15.120:0/210027440 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f55b403fc00 msgr2=0x7f55b4035410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:18.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.326+0000 7f55ba2aa640 0 -- 172.21.15.120:0/210027440 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f55b403fc00 msgr2=0x7f55b4035410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:18.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.338+0000 7f55bc7a49c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:18.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.338+0000 7f55bc7a49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:18.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.338+0000 7f55bc7a49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:18.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.338+0000 7f55bc7a49c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:18.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.338+0000 7f55bc7a49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:18.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.338+0000 7f55bc7a49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:18.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.338+0000 7f55bc7a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:18.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.338+0000 7f55bc7a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:18.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.338+0000 7f55bc7a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:18.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.338+0000 7f55bc7a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:18.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.338+0000 7f55bc7a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:18.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.342+0000 7f55bc7a49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:18.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.342+0000 7f55bc7a49c0 20 zone default found 2024-09-19T11:58:18.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.342+0000 7f55bc7a49c0 4 Realm: () 2024-09-19T11:58:18.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.342+0000 7f55bc7a49c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:18.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.342+0000 7f55bc7a49c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:18.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.342+0000 7f55bc7a49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:18.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.342+0000 7f55bc7a49c0 20 zonegroup default 2024-09-19T11:58:18.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.342+0000 7f55bc7a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:18.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.342+0000 7f55bc7a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:18.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.342+0000 7f55bc7a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:18.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.342+0000 7f55bc7a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:18.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.342+0000 7f55bc7a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:18.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.342+0000 7f55bc7a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:18.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.342+0000 7f55bc7a49c0 20 started sync module instance, tier type = 2024-09-19T11:58:18.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.342+0000 7f55bc7a49c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:18.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.366+0000 7f55bc7a49c0 20 add_watcher() i=0 2024-09-19T11:58:18.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.366+0000 7f55bc7a49c0 20 add_watcher() i=1 2024-09-19T11:58:18.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.366+0000 7f55bc7a49c0 20 add_watcher() i=2 2024-09-19T11:58:18.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.366+0000 7f55bc7a49c0 20 add_watcher() i=3 2024-09-19T11:58:18.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.366+0000 7f55bc7a49c0 20 add_watcher() i=4 2024-09-19T11:58:18.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.366+0000 7f55bc7a49c0 20 add_watcher() i=5 2024-09-19T11:58:18.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.366+0000 7f55bc7a49c0 20 add_watcher() i=6 2024-09-19T11:58:18.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.366+0000 7f55bc7a49c0 20 add_watcher() i=7 2024-09-19T11:58:18.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.366+0000 7f55bc7a49c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:18.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.370+0000 7f5470fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:18.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.370+0000 7f55bc7a49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:18.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.370+0000 7f55bc7a49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:18.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.370+0000 7f55bc7a49c0 5 note: GC not initialized 2024-09-19T11:58:18.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.374+0000 7f53eb7fe640 20 reqs_thread_entry: start 2024-09-19T11:58:18.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.374+0000 7f55bc7a49c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:18.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.374+0000 7f55bc7a49c0 20 Filter name: none 2024-09-19T11:58:18.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.374+0000 7f53e97fa640 20 reqs_thread_entry: start 2024-09-19T11:58:18.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.374+0000 7f55bc7a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:18.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.374+0000 7f55bc7a49c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:18.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.374+0000 7f55bc7a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:18.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.374+0000 7f55bc7a49c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:58:18.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.374+0000 7f55bc7a49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:18.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.374+0000 7f55bc7a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:18.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.374+0000 7f55bc7a49c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:18.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.374+0000 7f55bc7a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:18.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.378+0000 7f55bc7a49c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:58:18.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.378+0000 7f55bc7a49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:18.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.378+0000 7f5470fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:18.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.386+0000 7f55bc7a49c0 20 remove_watcher() i=0 2024-09-19T11:58:18.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.386+0000 7f55bc7a49c0 2 removed watcher, disabling cache 2024-09-19T11:58:18.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.390+0000 7f55bc7a49c0 20 remove_watcher() i=1 2024-09-19T11:58:18.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.390+0000 7f55bc7a49c0 20 remove_watcher() i=2 2024-09-19T11:58:18.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.394+0000 7f55bc7a49c0 20 remove_watcher() i=3 2024-09-19T11:58:18.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.398+0000 7f55bc7a49c0 20 remove_watcher() i=4 2024-09-19T11:58:18.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.398+0000 7f55bc7a49c0 20 remove_watcher() i=5 2024-09-19T11:58:18.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.402+0000 7f55bc7a49c0 20 remove_watcher() i=6 2024-09-19T11:58:18.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:18.402+0000 7f55bc7a49c0 20 remove_watcher() i=7 2024-09-19T11:58:18.417 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:18.417 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:58:18.417 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-do-reshard id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T11:58:18.420 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:18.517 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-19T11:58:18.518 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:19.016 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-19T11:58:19.048 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:19.048 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:19.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.098+0000 7f546ed259c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.098+0000 7f546ed259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:19.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.098+0000 7f546ed259c0 20 realm 2024-09-19T11:58:19.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.098+0000 7f546ed259c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.098+0000 7f546ed259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:19.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.098+0000 7f546ed259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:19.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.098+0000 7f546ed259c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.098+0000 7f546ed259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:19.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.098+0000 7f546ed259c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.102+0000 7f546ed259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:19.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.102+0000 7f546ed259c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.102+0000 7f546ed259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:19.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.102+0000 7f546ed259c0 20 searching for the correct realm 2024-09-19T11:58:19.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.106+0000 7f546d02c640 0 -- 172.21.15.120:0/3588074203 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f54600c5040 msgr2=0x7f5460009ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:19.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.322+0000 7f546c02a640 0 -- 172.21.15.120:0/3588074203 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f545c084120 msgr2=0x7f545c064a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:58:19.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.538+0000 7f546ed259c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:19.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.538+0000 7f546ed259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:19.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.538+0000 7f546ed259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:19.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.538+0000 7f546ed259c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:19.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.538+0000 7f546ed259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:19.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.538+0000 7f546ed259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:19.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.538+0000 7f546ed259c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:19.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:19.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:19.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 20 zone default found 2024-09-19T11:58:19.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 4 Realm: () 2024-09-19T11:58:19.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:19.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:19.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:19.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 20 zonegroup default 2024-09-19T11:58:19.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:19.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:19.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.542+0000 7f546ed259c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.546+0000 7f546ed259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:19.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.546+0000 7f546ed259c0 20 started sync module instance, tier type = 2024-09-19T11:58:19.545 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.546+0000 7f546ed259c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:19.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.574+0000 7f546ed259c0 20 add_watcher() i=0 2024-09-19T11:58:19.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.574+0000 7f546ed259c0 20 add_watcher() i=1 2024-09-19T11:58:19.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.574+0000 7f546ed259c0 20 add_watcher() i=2 2024-09-19T11:58:19.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.574+0000 7f546ed259c0 20 add_watcher() i=3 2024-09-19T11:58:19.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.574+0000 7f546ed259c0 20 add_watcher() i=4 2024-09-19T11:58:19.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.574+0000 7f546ed259c0 20 add_watcher() i=5 2024-09-19T11:58:19.575 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.574+0000 7f546ed259c0 20 add_watcher() i=6 2024-09-19T11:58:19.577 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.578+0000 7f546ed259c0 20 add_watcher() i=7 2024-09-19T11:58:19.577 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.578+0000 7f546ed259c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:19.581 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.582+0000 7f53237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:19.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.582+0000 7f546ed259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:19.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.582+0000 7f546ed259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:19.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.582+0000 7f546ed259c0 5 note: GC not initialized 2024-09-19T11:58:19.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.582+0000 7f53227e4640 20 reqs_thread_entry: start 2024-09-19T11:58:19.582 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.582+0000 7f546ed259c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:19.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.582+0000 7f546ed259c0 20 Filter name: none 2024-09-19T11:58:19.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.582+0000 7f531b7fe640 20 reqs_thread_entry: start 2024-09-19T11:58:19.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.582+0000 7f546ed259c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.586+0000 7f546ed259c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:19.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.586+0000 7f546ed259c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.586+0000 7f546ed259c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:58:19.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.586+0000 7f546ed259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:19.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.586+0000 7f546ed259c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.586+0000 7f546ed259c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:19.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.586+0000 7f546ed259c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.586+0000 7f546ed259c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:58:19.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.586+0000 7f546ed259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:19.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.590+0000 7f53237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:19.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.594+0000 7f546ed259c0 20 remove_watcher() i=0 2024-09-19T11:58:19.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.594+0000 7f546ed259c0 2 removed watcher, disabling cache 2024-09-19T11:58:19.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.598+0000 7f546ed259c0 20 remove_watcher() i=1 2024-09-19T11:58:19.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.602+0000 7f546ed259c0 20 remove_watcher() i=2 2024-09-19T11:58:19.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.602+0000 7f546ed259c0 20 remove_watcher() i=3 2024-09-19T11:58:19.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.606+0000 7f546ed259c0 20 remove_watcher() i=4 2024-09-19T11:58:19.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.606+0000 7f546ed259c0 20 remove_watcher() i=5 2024-09-19T11:58:19.607 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.606+0000 7f546ed259c0 20 remove_watcher() i=6 2024-09-19T11:58:19.608 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.610+0000 7f546ed259c0 20 remove_watcher() i=7 2024-09-19T11:58:19.627 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:19.627 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:58:19.627 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-do-reshard id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:58:19.627 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:19.628 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-19T11:58:19.669 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:19.669 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:19.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:19.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.718+0000 7f9083b909c0 20 realm 2024-09-19T11:58:19.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:19.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.718+0000 7f9083b909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:19.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:19.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.722+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:19.720 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.722+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.722+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:19.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.722+0000 7f9083b909c0 20 searching for the correct realm 2024-09-19T11:58:19.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.726+0000 7f9081696640 0 -- 172.21.15.120:0/868883666 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f907c09a260 msgr2=0x7f907c062f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:58:19.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.942+0000 7f9081696640 0 -- 172.21.15.120:0/868883666 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f907c09a260 msgr2=0x7f907c062f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:19.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:19.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:19.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:19.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:19.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:19.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:19.953 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:19.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:19.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:19.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 20 zone default found 2024-09-19T11:58:19.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 4 Realm: () 2024-09-19T11:58:19.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:19.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:19.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:19.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 20 zonegroup default 2024-09-19T11:58:19.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.958+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:19.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.958+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.958+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:19.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.958+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.958+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:19.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.958+0000 7f9083b909c0 20 started sync module instance, tier type = 2024-09-19T11:58:19.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.958+0000 7f9083b909c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:19.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=0 2024-09-19T11:58:19.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=1 2024-09-19T11:58:19.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=2 2024-09-19T11:58:19.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=3 2024-09-19T11:58:19.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=4 2024-09-19T11:58:19.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=5 2024-09-19T11:58:19.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=6 2024-09-19T11:58:19.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.982+0000 7f9083b909c0 20 add_watcher() i=7 2024-09-19T11:58:19.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.982+0000 7f9083b909c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:19.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.982+0000 7f8f377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:19.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:19.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:19.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 5 note: GC not initialized 2024-09-19T11:58:19.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f8f367e4640 20 reqs_thread_entry: start 2024-09-19T11:58:19.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:19.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 20 Filter name: none 2024-09-19T11:58:19.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f8ea7fff640 20 reqs_thread_entry: start 2024-09-19T11:58:19.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-19T11:58:19.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:19.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-19T11:58:19.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-19T11:58:19.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 : miss 2024-09-19T11:58:19.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:19.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:58:19.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:19.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:19.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:58:19.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:19.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.986+0000 7f9083b909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 2024-09-19T11:58:19.995 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.998+0000 7f9083b909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:19.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.998+0000 7f9083b909c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:19.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.998+0000 7f9083b909c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:19.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.998+0000 7f9083b909c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35, ofs0, ns] 2024-09-19T11:58:19.996 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.998+0000 7f8f64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366155 cookie 94392996999216 notifier 7106 bl.length()=995 2024-09-19T11:58:19.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.998+0000 7f8f64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:19.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.998+0000 7f8f64ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:19.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.998+0000 7f8f64ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:19.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.998+0000 7f9083b909c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): orig_sources= new_sources= 2024-09-19T11:58:19.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.998+0000 7f9083b909c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): potential sources added=[] removed=[] 2024-09-19T11:58:19.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.998+0000 7f9083b909c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): orig_dests= new_dests= 2024-09-19T11:58:19.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:19.998+0000 7f9083b909c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): potential dests added=[] removed=[] 2024-09-19T11:58:20.001 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9083b909c0 time 2024-09-19T11:58:20.008021+0000 2024-09-19T11:58:20.001 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:58:20.002 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:20.002 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f908746a2eb] 2024-09-19T11:58:20.003 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f908746a49f] 2024-09-19T11:58:20.003 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d99354c271] 2024-09-19T11:58:20.003 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d99355c14a] 2024-09-19T11:58:20.003 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T11:58:20.003 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f90862d0d90] 2024-09-19T11:58:20.003 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T11:58:20.003 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T11:58:20.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.002+0000 7f9083b909c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9083b909c0 time 2024-09-19T11:58:20.008021+0000 2024-09-19T11:58:20.004 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:58:20.004 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.004 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:20.004 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f908746a2eb] 2024-09-19T11:58:20.004 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f908746a49f] 2024-09-19T11:58:20.005 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d99354c271] 2024-09-19T11:58:20.005 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d99355c14a] 2024-09-19T11:58:20.005 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T11:58:20.005 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f90862d0d90] 2024-09-19T11:58:20.005 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T11:58:20.005 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T11:58:20.006 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.006 INFO:tasks.workunit.client.0.smithi120.stderr:*** Caught signal (Aborted) ** 2024-09-19T11:58:20.006 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f9083b909c0 thread_name:radosgw-admin 2024-09-19T11:58:20.018 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:20.019 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f90862e9520] 2024-09-19T11:58:20.019 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:58:20.019 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:58:20.019 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:58:20.019 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f908746a345] 2024-09-19T11:58:20.019 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f908746a49f] 2024-09-19T11:58:20.019 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d99354c271] 2024-09-19T11:58:20.019 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d99355c14a] 2024-09-19T11:58:20.019 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T11:58:20.019 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f90862d0d90] 2024-09-19T11:58:20.019 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T11:58:20.020 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T11:58:20.020 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.006+0000 7f9083b909c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:58:20.020 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f9083b909c0 thread_name:radosgw-admin 2024-09-19T11:58:20.020 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.020 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:20.020 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f90862e9520] 2024-09-19T11:58:20.020 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:58:20.020 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:58:20.020 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:58:20.020 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f908746a345] 2024-09-19T11:58:20.020 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f908746a49f] 2024-09-19T11:58:20.020 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d99354c271] 2024-09-19T11:58:20.020 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d99355c14a] 2024-09-19T11:58:20.021 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T11:58:20.021 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f90862d0d90] 2024-09-19T11:58:20.021 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T11:58:20.021 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T11:58:20.021 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:58:20.021 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.021 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:58:20.021 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:58:19.694+0000 7f9081696640 10 monclient: _finish_hunting 0 2024-09-19T11:58:20.021 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:58:19.694+0000 7f9081696640 1 monclient: found mon.noname-c 2024-09-19T11:58:20.021 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:58:19.694+0000 7f9081696640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.021 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.021 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:20.021 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: dump: 2024-09-19T11:58:20.022 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.022 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.022 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.022 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.022 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.022 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.022 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.022 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.022 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.023 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.023 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: _finish_auth 0 2024-09-19T11:58:20.023 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: _check_auth_tickets 2024-09-19T11:58:20.023 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:20.023 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.024 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:20.024 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: dump: 2024-09-19T11:58:20.024 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.024 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.024 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.024 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.024 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.025 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.025 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.025 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.025 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.025 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.025 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 monclient: authenticate success, global_id 7094 2024-09-19T11:58:20.025 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient: get_monmap_and_config success 2024-09-19T11:58:20.026 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:58:19.694+0000 7f9083b909c0 4 set_mon_vals no callback set 2024-09-19T11:58:20.026 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient: shutdown 2024-09-19T11:58:20.026 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 asok(0x55d994dd2d90) unregister_commands rotate-key 2024-09-19T11:58:20.026 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient: build_initial_monmap 2024-09-19T11:58:20.026 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:58:19.694+0000 7f9083b909c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:20.026 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient: monmap: 2024-09-19T11:58:20.026 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:20.027 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:20.027 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:20.027 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:20.027 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:20.027 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.027 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:20.027 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:20.028 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:20.028 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.028 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding auth protocol: cephx 2024-09-19T11:58:20.028 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding auth protocol: cephx 2024-09-19T11:58:20.028 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding auth protocol: cephx 2024-09-19T11:58:20.028 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: secure 2024-09-19T11:58:20.029 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: crc 2024-09-19T11:58:20.029 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: secure 2024-09-19T11:58:20.029 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: crc 2024-09-19T11:58:20.029 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: secure 2024-09-19T11:58:20.029 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: crc 2024-09-19T11:58:20.029 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: crc 2024-09-19T11:58:20.030 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: secure 2024-09-19T11:58:20.030 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: crc 2024-09-19T11:58:20.030 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: secure 2024-09-19T11:58:20.030 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: crc 2024-09-19T11:58:20.030 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: secure 2024-09-19T11:58:20.030 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:58:19.694+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.030 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:58:19.694+0000 7f9083b909c0 1 librados: starting msgr at 2024-09-19T11:58:20.031 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:58:19.694+0000 7f9083b909c0 1 librados: starting objecter 2024-09-19T11:58:20.031 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command objecter_requests hook 0x55d994dbd160 2024-09-19T11:58:20.031 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:58:19.694+0000 7f9083b909c0 1 librados: setting wanted keys 2024-09-19T11:58:20.031 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:58:19.694+0000 7f9083b909c0 1 librados: calling monclient init 2024-09-19T11:58:20.031 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient: init 2024-09-19T11:58:20.032 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding auth protocol: cephx 2024-09-19T11:58:20.032 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding auth protocol: cephx 2024-09-19T11:58:20.032 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding auth protocol: cephx 2024-09-19T11:58:20.032 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: secure 2024-09-19T11:58:20.032 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: crc 2024-09-19T11:58:20.032 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: secure 2024-09-19T11:58:20.033 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: crc 2024-09-19T11:58:20.033 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: secure 2024-09-19T11:58:20.033 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: crc 2024-09-19T11:58:20.033 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: crc 2024-09-19T11:58:20.033 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: secure 2024-09-19T11:58:20.033 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: crc 2024-09-19T11:58:20.033 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: secure 2024-09-19T11:58:20.033 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: crc 2024-09-19T11:58:20.033 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: secure 2024-09-19T11:58:20.033 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:58:19.694+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.034 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:58:19.694+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.034 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command rotate-key hook 0x55d994fe0b08 2024-09-19T11:58:20.034 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:20.034 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T11:58:20.034 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-c con 0x55d994f29870 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:20.034 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-a con 0x55d99500a620 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:20.034 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-b con 0x55d99500aa00 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:20.034 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.034 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.034 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.034 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:20.034 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient(hunting): authenticate will time out at 2394.016046s 2024-09-19T11:58:20.034 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): get_auth_request con 0x55d994f29870 auth_method 0 2024-09-19T11:58:20.034 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.035 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.035 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.035 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient(hunting): get_auth_request con 0x55d99500a620 auth_method 0 2024-09-19T11:58:20.035 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.035 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.035 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.035 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:20.035 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:20.035 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:20.035 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:20.035 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:20.036 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:20.036 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:58:19.698+0000 7f9081e97640 10 monclient(hunting): get_auth_request con 0x55d99500aa00 auth_method 0 2024-09-19T11:58:20.036 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:58:19.698+0000 7f9081e97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.036 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:58:19.698+0000 7f9081e97640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.036 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:58:19.698+0000 7f9081e97640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.036 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): handle_auth_done global_id 7097 payload 824 2024-09-19T11:58:20.036 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient: _finish_hunting 0 2024-09-19T11:58:20.036 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:58:19.698+0000 7f9081696640 1 monclient: found mon.noname-c 2024-09-19T11:58:20.036 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.036 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.037 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:20.037 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: dump: 2024-09-19T11:58:20.037 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.037 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.037 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.037 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.037 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.037 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.037 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.037 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.037 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.037 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.038 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: _finish_auth 0 2024-09-19T11:58:20.038 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: _check_auth_tickets 2024-09-19T11:58:20.038 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:20.038 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.038 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:20.038 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: dump: 2024-09-19T11:58:20.038 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.038 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.038 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.038 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.038 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.039 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.039 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.039 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.039 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.039 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.039 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:58:19.698+0000 7f9083b909c0 5 monclient: authenticate success, global_id 7097 2024-09-19T11:58:20.039 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:58:19.698+0000 7f8f6f606640 4 set_mon_vals no callback set 2024-09-19T11:58:20.039 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient: _renew_subs 2024-09-19T11:58:20.039 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.039 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient: _renew_subs 2024-09-19T11:58:20.039 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.039 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:58:19.698+0000 7f9083b909c0 1 librados: init done 2024-09-19T11:58:20.039 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:58:19.698+0000 7f8f6de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:58:20.040 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:58:19.698+0000 7f8f6de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:20.040 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:58:19.698+0000 7f8f6de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:20.040 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient: get_auth_request con 0x7f8f68071be0 auth_method 0 2024-09-19T11:58:20.040 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:58:19.698+0000 7f9081e97640 10 monclient: get_auth_request con 0x55d995009190 auth_method 0 2024-09-19T11:58:20.041 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:58:19.702+0000 7f9081696640 10 monclient: get_auth_request con 0x55d99502b950 auth_method 0 2024-09-19T11:58:20.041 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:58:19.702+0000 7f9080e95640 10 monclient: get_auth_request con 0x55d99502fcb0 auth_method 0 2024-09-19T11:58:20.041 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient: get_auth_request con 0x55d99502f1d0 auth_method 0 2024-09-19T11:58:20.041 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: build_initial_monmap 2024-09-19T11:58:20.041 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:58:19.706+0000 7f9083b909c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:20.041 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: monmap: 2024-09-19T11:58:20.041 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:20.041 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:20.041 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:20.041 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:20.042 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:20.042 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.042 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:20.042 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:20.042 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:20.042 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.042 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding auth protocol: cephx 2024-09-19T11:58:20.042 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding auth protocol: cephx 2024-09-19T11:58:20.042 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding auth protocol: cephx 2024-09-19T11:58:20.043 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: secure 2024-09-19T11:58:20.043 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: crc 2024-09-19T11:58:20.043 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: secure 2024-09-19T11:58:20.043 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: crc 2024-09-19T11:58:20.043 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: secure 2024-09-19T11:58:20.043 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: crc 2024-09-19T11:58:20.043 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: crc 2024-09-19T11:58:20.043 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: secure 2024-09-19T11:58:20.044 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: crc 2024-09-19T11:58:20.044 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: secure 2024-09-19T11:58:20.044 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: crc 2024-09-19T11:58:20.044 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: secure 2024-09-19T11:58:20.044 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:58:19.706+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.044 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d99503b7f0 EEXIST 2024-09-19T11:58:20.044 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: init 2024-09-19T11:58:20.044 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding auth protocol: cephx 2024-09-19T11:58:20.044 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding auth protocol: cephx 2024-09-19T11:58:20.044 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding auth protocol: cephx 2024-09-19T11:58:20.044 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: secure 2024-09-19T11:58:20.044 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: crc 2024-09-19T11:58:20.045 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: secure 2024-09-19T11:58:20.045 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: crc 2024-09-19T11:58:20.045 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: secure 2024-09-19T11:58:20.045 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: crc 2024-09-19T11:58:20.045 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: crc 2024-09-19T11:58:20.045 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: secure 2024-09-19T11:58:20.045 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: crc 2024-09-19T11:58:20.045 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: secure 2024-09-19T11:58:20.045 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: crc 2024-09-19T11:58:20.045 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: secure 2024-09-19T11:58:20.045 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:58:19.706+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.045 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:58:19.706+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.045 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command rotate-key cmddesc rotate-key hook 0x55d995036e90 EEXIST 2024-09-19T11:58:20.046 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:20.046 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T11:58:20.046 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-b con 0x55d99505f9a0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:20.046 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-c con 0x55d99505f2d0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:20.046 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-a con 0x55d99505dcb0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:20.046 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.046 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.046 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.046 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:20.046 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): authenticate will time out at 2394.026758s 2024-09-19T11:58:20.046 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): get_auth_request con 0x55d99505f2d0 auth_method 0 2024-09-19T11:58:20.046 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.046 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.046 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.047 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:58:19.706+0000 7f9081696640 10 monclient(hunting): get_auth_request con 0x55d99505dcb0 auth_method 0 2024-09-19T11:58:20.047 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:58:19.706+0000 7f9081696640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.047 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:58:19.706+0000 7f9081696640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.047 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:58:19.706+0000 7f9081696640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.047 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:20.047 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:20.047 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:20.047 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:58:19.706+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:20.047 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:58:19.706+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:20.047 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:58:19.706+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:20.047 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:58:19.706+0000 7f9080e95640 10 monclient(hunting): get_auth_request con 0x55d99505f9a0 auth_method 0 2024-09-19T11:58:20.047 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:58:19.706+0000 7f9080e95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.047 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:58:19.706+0000 7f9080e95640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.048 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:58:19.706+0000 7f9080e95640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.048 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): handle_auth_done global_id 7100 payload 824 2024-09-19T11:58:20.048 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient: _finish_hunting 0 2024-09-19T11:58:20.048 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:58:19.706+0000 7f9081e97640 1 monclient: found mon.noname-c 2024-09-19T11:58:20.048 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.048 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.048 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:20.048 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: dump: 2024-09-19T11:58:20.048 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.048 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.048 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.048 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.049 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.049 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.049 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.049 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.049 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.049 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.049 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: _finish_auth 0 2024-09-19T11:58:20.049 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: _check_auth_tickets 2024-09-19T11:58:20.049 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:20.049 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.049 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:20.049 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: dump: 2024-09-19T11:58:20.049 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.049 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.050 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.050 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.050 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.050 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.050 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.050 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.050 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.050 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.050 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 monclient: authenticate success, global_id 7100 2024-09-19T11:58:20.050 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:58:19.706+0000 7f9082698640 4 set_mon_vals no callback set 2024-09-19T11:58:20.050 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: _renew_subs 2024-09-19T11:58:20.050 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.050 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: _renew_subs 2024-09-19T11:58:20.050 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.051 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:58:19.710+0000 7f8f66ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:58:20.051 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:58:19.710+0000 7f8f66ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:20.051 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:58:19.710+0000 7f8f66ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:20.051 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient: get_monmap_and_config 2024-09-19T11:58:20.051 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient: build_initial_monmap 2024-09-19T11:58:20.051 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:58:19.710+0000 7f9083b909c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:20.051 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient: monmap: 2024-09-19T11:58:20.051 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:20.051 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:20.051 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:20.051 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:20.051 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:20.051 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.052 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:20.052 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:20.052 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:20.052 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.052 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding auth protocol: cephx 2024-09-19T11:58:20.052 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding auth protocol: cephx 2024-09-19T11:58:20.052 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding auth protocol: cephx 2024-09-19T11:58:20.052 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: secure 2024-09-19T11:58:20.052 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: crc 2024-09-19T11:58:20.053 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: secure 2024-09-19T11:58:20.053 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: crc 2024-09-19T11:58:20.053 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: secure 2024-09-19T11:58:20.053 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: crc 2024-09-19T11:58:20.053 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: crc 2024-09-19T11:58:20.053 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: secure 2024-09-19T11:58:20.053 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: crc 2024-09-19T11:58:20.053 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: secure 2024-09-19T11:58:20.054 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: crc 2024-09-19T11:58:20.054 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: secure 2024-09-19T11:58:20.054 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient: get_auth_request con 0x7f8f5c071b20 auth_method 0 2024-09-19T11:58:20.054 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:58:19.710+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.054 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient: init 2024-09-19T11:58:20.054 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding auth protocol: cephx 2024-09-19T11:58:20.054 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding auth protocol: cephx 2024-09-19T11:58:20.054 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding auth protocol: cephx 2024-09-19T11:58:20.054 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: secure 2024-09-19T11:58:20.054 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: crc 2024-09-19T11:58:20.054 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: secure 2024-09-19T11:58:20.054 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: crc 2024-09-19T11:58:20.055 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: secure 2024-09-19T11:58:20.055 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: crc 2024-09-19T11:58:20.055 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: crc 2024-09-19T11:58:20.055 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: secure 2024-09-19T11:58:20.055 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: crc 2024-09-19T11:58:20.055 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: secure 2024-09-19T11:58:20.055 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: crc 2024-09-19T11:58:20.055 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: secure 2024-09-19T11:58:20.055 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:58:19.710+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.055 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:58:19.710+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.055 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command rotate-key cmddesc rotate-key hook 0x7fffe6043328 EEXIST 2024-09-19T11:58:20.055 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:20.055 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T11:58:20.055 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-a con 0x55d9950832c0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:20.056 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-b con 0x55d9950836a0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:20.056 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-c con 0x55d9950add10 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:20.056 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.056 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.056 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.056 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:20.056 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): authenticate will time out at 2394.031007s 2024-09-19T11:58:20.056 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): get_auth_request con 0x55d9950832c0 auth_method 0 2024-09-19T11:58:20.056 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.056 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.056 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.056 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:58:19.710+0000 7f9081696640 10 monclient(hunting): get_auth_request con 0x55d9950add10 auth_method 0 2024-09-19T11:58:20.056 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:58:19.710+0000 7f9081696640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.056 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:58:19.710+0000 7f9081696640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.057 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:58:19.710+0000 7f9081696640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.057 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:20.057 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:20.057 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:20.057 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): handle_auth_done global_id 7620 payload 274 2024-09-19T11:58:20.057 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient: _finish_hunting 0 2024-09-19T11:58:20.057 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:58:19.710+0000 7f9080e95640 1 monclient: found mon.noname-a 2024-09-19T11:58:20.057 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:58:20.057 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.058 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:58:20.058 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: dump: 2024-09-19T11:58:20.058 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.059 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.060 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.060 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.060 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.060 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.060 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.060 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.060 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.060 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.060 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: _finish_auth 0 2024-09-19T11:58:20.060 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: _check_auth_tickets 2024-09-19T11:58:20.060 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:20.060 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.060 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:58:20.061 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: dump: 2024-09-19T11:58:20.061 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.061 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.061 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.061 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.061 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.061 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.061 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.061 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.061 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.061 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.061 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 monclient: authenticate success, global_id 7620 2024-09-19T11:58:20.061 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient: get_monmap_and_config success 2024-09-19T11:58:20.062 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:58:19.710+0000 7f9083b909c0 4 set_mon_vals no callback set 2024-09-19T11:58:20.062 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: shutdown 2024-09-19T11:58:20.062 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: build_initial_monmap 2024-09-19T11:58:20.062 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:58:19.714+0000 7f9083b909c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:20.062 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: monmap: 2024-09-19T11:58:20.062 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:20.062 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:20.062 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:20.062 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:20.062 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:20.062 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.062 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:20.062 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:20.062 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:20.063 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.063 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding auth protocol: cephx 2024-09-19T11:58:20.063 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding auth protocol: cephx 2024-09-19T11:58:20.063 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding auth protocol: cephx 2024-09-19T11:58:20.063 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: secure 2024-09-19T11:58:20.063 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: crc 2024-09-19T11:58:20.063 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: secure 2024-09-19T11:58:20.063 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: crc 2024-09-19T11:58:20.063 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: secure 2024-09-19T11:58:20.063 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: crc 2024-09-19T11:58:20.063 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: crc 2024-09-19T11:58:20.063 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: secure 2024-09-19T11:58:20.063 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: crc 2024-09-19T11:58:20.064 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: secure 2024-09-19T11:58:20.064 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: crc 2024-09-19T11:58:20.064 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: secure 2024-09-19T11:58:20.064 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:58:19.714+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.064 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:58:19.714+0000 7f9083b909c0 1 librados: starting msgr at 2024-09-19T11:58:20.064 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:58:19.714+0000 7f9083b909c0 1 librados: starting objecter 2024-09-19T11:58:20.064 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d9950af6c0 EEXIST 2024-09-19T11:58:20.064 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:58:19.714+0000 7f9083b909c0 1 librados: setting wanted keys 2024-09-19T11:58:20.064 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:58:19.714+0000 7f9083b909c0 1 librados: calling monclient init 2024-09-19T11:58:20.064 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: init 2024-09-19T11:58:20.064 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding auth protocol: cephx 2024-09-19T11:58:20.064 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding auth protocol: cephx 2024-09-19T11:58:20.064 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding auth protocol: cephx 2024-09-19T11:58:20.064 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: secure 2024-09-19T11:58:20.065 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: crc 2024-09-19T11:58:20.065 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: secure 2024-09-19T11:58:20.065 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: crc 2024-09-19T11:58:20.065 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: secure 2024-09-19T11:58:20.065 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: crc 2024-09-19T11:58:20.065 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: crc 2024-09-19T11:58:20.065 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: secure 2024-09-19T11:58:20.065 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: crc 2024-09-19T11:58:20.065 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: secure 2024-09-19T11:58:20.065 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: crc 2024-09-19T11:58:20.065 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: secure 2024-09-19T11:58:20.065 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:58:19.714+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.066 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:58:19.714+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.066 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command rotate-key cmddesc rotate-key hook 0x55d995061908 EEXIST 2024-09-19T11:58:20.066 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:20.066 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T11:58:20.066 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-a con 0x55d9950832c0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:20.066 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-b con 0x55d9950add10 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:20.066 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-c con 0x55d9950a7f20 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:20.066 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.066 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.066 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.066 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:20.066 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): authenticate will time out at 2394.033778s 2024-09-19T11:58:20.066 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): get_auth_request con 0x55d9950a7f20 auth_method 0 2024-09-19T11:58:20.066 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.067 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.067 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.067 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:58:19.714+0000 7f9080e95640 10 monclient(hunting): get_auth_request con 0x55d9950832c0 auth_method 0 2024-09-19T11:58:20.067 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:58:19.714+0000 7f9080e95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.067 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:58:19.714+0000 7f9080e95640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.067 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:58:19.714+0000 7f9080e95640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.067 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:20.067 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:20.067 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:20.067 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:58:19.714+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:20.067 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:58:19.714+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:20.067 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:58:19.714+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:20.067 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:58:19.714+0000 7f9081e97640 10 monclient(hunting): get_auth_request con 0x55d9950add10 auth_method 0 2024-09-19T11:58:20.068 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:58:19.714+0000 7f9081e97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.068 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:58:19.714+0000 7f9081e97640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.068 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:58:19.714+0000 7f9081e97640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.068 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): handle_auth_done global_id 7106 payload 824 2024-09-19T11:58:20.068 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient: _finish_hunting 0 2024-09-19T11:58:20.068 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:58:19.714+0000 7f9081696640 1 monclient: found mon.noname-c 2024-09-19T11:58:20.068 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.068 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.068 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:20.068 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: dump: 2024-09-19T11:58:20.068 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.068 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.068 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.069 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.069 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.069 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.069 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.069 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.069 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.069 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.069 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: _finish_auth 0 2024-09-19T11:58:20.069 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: _check_auth_tickets 2024-09-19T11:58:20.069 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 monclient: authenticate success, global_id 7106 2024-09-19T11:58:20.069 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: _renew_subs 2024-09-19T11:58:20.069 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.069 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:20.069 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.070 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:20.070 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: dump: 2024-09-19T11:58:20.070 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.070 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.070 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.070 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.070 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.070 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.070 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.070 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.070 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.070 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.070 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:58:19.714+0000 7f8f64ff9640 4 set_mon_vals no callback set 2024-09-19T11:58:20.070 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: _renew_subs 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:58:19.714+0000 7f9083b909c0 1 librados: init done 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command cr dump hook 0x55d9950a79f8 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:58:19.718+0000 7f8f52ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:58:19.718+0000 7f8f52ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:58:19.718+0000 7f8f52ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:58:19.718+0000 7f9081e97640 10 monclient: get_auth_request con 0x55d9950cd4c0 auth_method 0 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:58:19.718+0000 7f9080e95640 10 monclient: get_auth_request con 0x7f8f4c071c10 auth_method 0 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 realm 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:58:19.718+0000 7f9083b909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.071 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.072 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.072 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:58:19.718+0000 7f9080e95640 10 monclient: get_auth_request con 0x55d9950d17b0 auth_method 0 2024-09-19T11:58:20.072 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:58:19.722+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:20.072 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:58:19.722+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.072 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:58:19.722+0000 7f9081e97640 10 monclient: get_auth_request con 0x55d9950d4ed0 auth_method 0 2024-09-19T11:58:20.072 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:58:19.722+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:20.072 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:58:19.722+0000 7f9083b909c0 20 searching for the correct realm 2024-09-19T11:58:20.072 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:58:19.722+0000 7f9081696640 10 monclient: get_auth_request con 0x55d9950d9bf0 auth_method 0 2024-09-19T11:58:20.072 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:58:19.726+0000 7f9080e95640 10 monclient: get_auth_request con 0x55d994e6ba70 auth_method 0 2024-09-19T11:58:20.072 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:58:19.726+0000 7f9081e97640 10 monclient: get_auth_request con 0x7f907802a070 auth_method 0 2024-09-19T11:58:20.072 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:58:19.726+0000 7f9081696640 0 -- 172.21.15.120:0/868883666 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f907c09a260 msgr2=0x7f907c062f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:58:20.072 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:58:19.930+0000 7f9081696640 10 monclient: get_auth_request con 0x7f907c09a260 auth_method 0 2024-09-19T11:58:20.072 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:58:19.938+0000 7f9080e95640 10 monclient: get_auth_request con 0x7f9074111040 auth_method 0 2024-09-19T11:58:20.073 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:58:19.942+0000 7f9081696640 0 -- 172.21.15.120:0/868883666 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f907c09a260 msgr2=0x7f907c062f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:20.073 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:58:19.942+0000 7f8f52ffd640 1 client.7106.objecter ms_handle_reset 0x7f907c09a260 session 0x7f907c017040 osd.4 2024-09-19T11:58:20.073 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:58:19.942+0000 7f8f52ffd640 10 monclient: _renew_subs 2024-09-19T11:58:20.073 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:58:19.942+0000 7f8f52ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.073 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:58:19.942+0000 7f9081696640 10 monclient: get_auth_request con 0x7f8f4c082230 auth_method 0 2024-09-19T11:58:20.073 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:20.073 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:20.073 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:20.073 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:20.073 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:20.073 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:20.073 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.073 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.073 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.074 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:20.074 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.074 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:20.074 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 zone default found 2024-09-19T11:58:20.074 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:58:19.954+0000 7f9083b909c0 4 Realm: () 2024-09-19T11:58:20.074 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:58:19.954+0000 7f9083b909c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:20.074 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:58:19.954+0000 7f9083b909c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:20.074 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:58:19.954+0000 7f9083b909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:20.074 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 zonegroup default 2024-09-19T11:58:20.074 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.074 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:58:19.958+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.074 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:58:19.958+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.074 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:58:19.958+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.074 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:58:19.958+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.074 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:58:19.958+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.075 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:58:19.958+0000 7f9083b909c0 20 started sync module instance, tier type = 2024-09-19T11:58:20.075 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:58:19.958+0000 7f9083b909c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:20.075 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=0 2024-09-19T11:58:20.075 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=1 2024-09-19T11:58:20.075 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=2 2024-09-19T11:58:20.075 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=3 2024-09-19T11:58:20.075 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=4 2024-09-19T11:58:20.075 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=5 2024-09-19T11:58:20.075 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=6 2024-09-19T11:58:20.075 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:58:19.982+0000 7f9083b909c0 20 add_watcher() i=7 2024-09-19T11:58:20.075 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:58:19.982+0000 7f9083b909c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:20.075 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding auth protocol: cephx 2024-09-19T11:58:20.075 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding auth protocol: cephx 2024-09-19T11:58:20.075 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding auth protocol: cephx 2024-09-19T11:58:20.076 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: secure 2024-09-19T11:58:20.076 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: crc 2024-09-19T11:58:20.076 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: secure 2024-09-19T11:58:20.076 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: crc 2024-09-19T11:58:20.076 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: secure 2024-09-19T11:58:20.076 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: crc 2024-09-19T11:58:20.076 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: crc 2024-09-19T11:58:20.076 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: secure 2024-09-19T11:58:20.076 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: crc 2024-09-19T11:58:20.076 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: secure 2024-09-19T11:58:20.076 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:58:19.982+0000 7f8f377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:20.076 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: crc 2024-09-19T11:58:20.076 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: secure 2024-09-19T11:58:20.077 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:58:19.986+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.077 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:20.077 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:20.077 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command cache list hook 0x55d9950a3d80 2024-09-19T11:58:20.077 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command cache inspect hook 0x55d9950a3d80 2024-09-19T11:58:20.077 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command cache erase hook 0x55d9950a3d80 2024-09-19T11:58:20.077 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command cache zap hook 0x55d9950a3d80 2024-09-19T11:58:20.077 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 note: GC not initialized 2024-09-19T11:58:20.077 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:58:19.986+0000 7f8f367e4640 20 reqs_thread_entry: start 2024-09-19T11:58:20.077 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command sync trace show hook 0x7f9078013070 2024-09-19T11:58:20.077 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command sync trace history hook 0x7f9078013070 2024-09-19T11:58:20.077 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command sync trace active hook 0x7f9078013070 2024-09-19T11:58:20.077 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command sync trace active_short hook 0x7f9078013070 2024-09-19T11:58:20.077 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:20.078 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 Filter name: none 2024-09-19T11:58:20.078 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:58:19.986+0000 7f8ea7fff640 20 reqs_thread_entry: start 2024-09-19T11:58:20.078 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-19T11:58:20.078 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.078 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:20.078 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-19T11:58:20.078 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-19T11:58:20.078 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 : miss 2024-09-19T11:58:20.078 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.078 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:58:20.078 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:20.078 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:20.078 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:58:20.079 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:20.079 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 2024-09-19T11:58:20.079 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:58:19.998+0000 7f9083b909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:20.079 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:58:19.998+0000 7f9083b909c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:20.079 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:58:19.998+0000 7f9083b909c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:20.079 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:58:19.998+0000 7f9083b909c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35, ofs0, ns] 2024-09-19T11:58:20.079 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:58:19.998+0000 7f8f64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366155 cookie 94392996999216 notifier 7106 bl.length()=995 2024-09-19T11:58:20.079 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:58:19.998+0000 7f8f64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:20.079 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:58:19.998+0000 7f8f64ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:20.079 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:58:19.998+0000 7f8f64ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:20.079 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:58:19.998+0000 7f9083b909c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): orig_sources= new_sources= 2024-09-19T11:58:20.079 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:58:19.998+0000 7f9083b909c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): potential sources added=[] removed=[] 2024-09-19T11:58:20.079 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:58:19.998+0000 7f9083b909c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): orig_dests= new_dests= 2024-09-19T11:58:20.079 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:58:19.998+0000 7f9083b909c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): potential dests added=[] removed=[] 2024-09-19T11:58:20.080 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:58:20.002+0000 7f9083b909c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9083b909c0 time 2024-09-19T11:58:20.008021+0000 2024-09-19T11:58:20.080 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:58:20.080 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.080 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:20.080 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f908746a2eb] 2024-09-19T11:58:20.080 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f908746a49f] 2024-09-19T11:58:20.080 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d99354c271] 2024-09-19T11:58:20.080 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d99355c14a] 2024-09-19T11:58:20.080 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T11:58:20.080 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f90862d0d90] 2024-09-19T11:58:20.080 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T11:58:20.080 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T11:58:20.080 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.081 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:58:20.006+0000 7f9083b909c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:58:20.081 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f9083b909c0 thread_name:radosgw-admin 2024-09-19T11:58:20.081 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.081 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:20.081 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f90862e9520] 2024-09-19T11:58:20.081 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:58:20.081 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:58:20.081 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:58:20.081 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f908746a345] 2024-09-19T11:58:20.081 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f908746a49f] 2024-09-19T11:58:20.081 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d99354c271] 2024-09-19T11:58:20.081 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d99355c14a] 2024-09-19T11:58:20.081 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T11:58:20.082 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f90862d0d90] 2024-09-19T11:58:20.082 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T11:58:20.082 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T11:58:20.082 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:58:20.082 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.082 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:58:20.082 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:58:20.082 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:58:20.082 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:58:20.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:58:20.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:58:20.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:58:20.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:58:20.082 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:58:20.083 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:58:20.083 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:58:20.083 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:58:20.083 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:58:20.083 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:58:20.083 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:58:20.083 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:58:20.083 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:58:20.083 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:58:20.083 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:58:20.083 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:58:20.083 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:58:20.083 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:58:20.083 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:58:20.083 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:58:20.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:58:20.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:58:20.084 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:58:20.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:58:20.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:58:20.084 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:58:20.084 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:58:20.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:58:20.084 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:58:20.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:58:20.084 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:58:20.084 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:58:20.084 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:58:20.084 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:58:20.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:58:20.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:58:20.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:58:20.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:58:20.085 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:58:20.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:58:20.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:58:20.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:58:20.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:58:20.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:58:20.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:58:20.085 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:58:20.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:58:20.085 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:58:20.086 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:58:20.086 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:58:20.086 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:58:20.086 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:58:20.086 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:58:20.086 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:58:20.086 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:58:20.086 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:58:20.086 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:58:20.086 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:58:20.086 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:58:20.086 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:58:20.086 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:58:20.086 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:58:20.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:58:20.088 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:58:20.088 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:58:20.088 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:58:20.088 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:58:20.088 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:58:20.088 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:58:20.088 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:58:20.088 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:58:20.088 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:58:20.088 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:58:20.088 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:58:20.088 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:58:20.088 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8ea7fff640 / http_manager 2024-09-19T11:58:20.088 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8f367e4640 / http_manager 2024-09-19T11:58:20.088 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8f377e6640 / rgw_dt_lg_renew 2024-09-19T11:58:20.089 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8f52ffd640 / ms_dispatch 2024-09-19T11:58:20.089 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8f64ff9640 / io_context_pool 2024-09-19T11:58:20.089 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8f66ffd640 / ms_dispatch 2024-09-19T11:58:20.089 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8f6de03640 / ms_dispatch 2024-09-19T11:58:20.089 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8f6f606640 / io_context_pool 2024-09-19T11:58:20.089 INFO:tasks.workunit.client.0.smithi120.stderr: 7f9080e95640 / msgr-worker-2 2024-09-19T11:58:20.089 INFO:tasks.workunit.client.0.smithi120.stderr: 7f9081696640 / msgr-worker-1 2024-09-19T11:58:20.089 INFO:tasks.workunit.client.0.smithi120.stderr: 7f9081e97640 / msgr-worker-0 2024-09-19T11:58:20.089 INFO:tasks.workunit.client.0.smithi120.stderr: 7f9082698640 / io_context_pool 2024-09-19T11:58:20.089 INFO:tasks.workunit.client.0.smithi120.stderr: 7f9083b909c0 / radosgw-admin 2024-09-19T11:58:20.089 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:58:20.089 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:58:20.089 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/log/ceph/ceph-client.admin.120483.log 2024-09-19T11:58:20.090 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:58:20.090 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:58:20.090 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:58:19.694+0000 7f9081696640 10 monclient: _finish_hunting 0 2024-09-19T11:58:20.090 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:58:19.694+0000 7f9081696640 1 monclient: found mon.noname-c 2024-09-19T11:58:20.090 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:58:19.694+0000 7f9081696640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.090 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.090 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:20.090 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: dump: 2024-09-19T11:58:20.090 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.090 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.090 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.090 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.090 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.091 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.091 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.091 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.091 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.091 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.091 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: _finish_auth 0 2024-09-19T11:58:20.091 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: _check_auth_tickets 2024-09-19T11:58:20.091 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:20.091 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.091 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:20.091 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:58:19.694+0000 7f8f6f606640 10 monclient: dump: 2024-09-19T11:58:20.091 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.091 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.092 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.092 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.092 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.092 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.092 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.092 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.092 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.092 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.092 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 monclient: authenticate success, global_id 7094 2024-09-19T11:58:20.092 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient: get_monmap_and_config success 2024-09-19T11:58:20.092 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:58:19.694+0000 7f9083b909c0 4 set_mon_vals no callback set 2024-09-19T11:58:20.092 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient: shutdown 2024-09-19T11:58:20.092 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 asok(0x55d994dd2d90) unregister_commands rotate-key 2024-09-19T11:58:20.093 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient: build_initial_monmap 2024-09-19T11:58:20.093 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:58:19.694+0000 7f9083b909c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:20.093 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient: monmap: 2024-09-19T11:58:20.093 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:20.093 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:20.093 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:20.093 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:20.093 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:20.093 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.093 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:20.093 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:20.093 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:20.093 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.094 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding auth protocol: cephx 2024-09-19T11:58:20.094 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding auth protocol: cephx 2024-09-19T11:58:20.094 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding auth protocol: cephx 2024-09-19T11:58:20.094 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: secure 2024-09-19T11:58:20.094 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: crc 2024-09-19T11:58:20.094 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: secure 2024-09-19T11:58:20.094 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: crc 2024-09-19T11:58:20.094 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: secure 2024-09-19T11:58:20.094 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: crc 2024-09-19T11:58:20.094 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: crc 2024-09-19T11:58:20.094 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: secure 2024-09-19T11:58:20.094 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: crc 2024-09-19T11:58:20.094 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: secure 2024-09-19T11:58:20.094 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: crc 2024-09-19T11:58:20.094 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe5d40) adding con mode: secure 2024-09-19T11:58:20.095 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:58:19.694+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.095 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:58:19.694+0000 7f9083b909c0 1 librados: starting msgr at 2024-09-19T11:58:20.095 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:58:19.694+0000 7f9083b909c0 1 librados: starting objecter 2024-09-19T11:58:20.095 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command objecter_requests hook 0x55d994dbd160 2024-09-19T11:58:20.095 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:58:19.694+0000 7f9083b909c0 1 librados: setting wanted keys 2024-09-19T11:58:20.095 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:58:19.694+0000 7f9083b909c0 1 librados: calling monclient init 2024-09-19T11:58:20.095 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient: init 2024-09-19T11:58:20.095 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding auth protocol: cephx 2024-09-19T11:58:20.095 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding auth protocol: cephx 2024-09-19T11:58:20.095 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding auth protocol: cephx 2024-09-19T11:58:20.095 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: secure 2024-09-19T11:58:20.095 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: crc 2024-09-19T11:58:20.095 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: secure 2024-09-19T11:58:20.095 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: crc 2024-09-19T11:58:20.096 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: secure 2024-09-19T11:58:20.096 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: crc 2024-09-19T11:58:20.096 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: crc 2024-09-19T11:58:20.096 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: secure 2024-09-19T11:58:20.096 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: crc 2024-09-19T11:58:20.096 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: secure 2024-09-19T11:58:20.096 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: crc 2024-09-19T11:58:20.096 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 AuthRegistry(0x55d994fe09c0) adding con mode: secure 2024-09-19T11:58:20.096 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:58:19.694+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.096 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:58:19.694+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.096 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:58:19.694+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command rotate-key hook 0x55d994fe0b08 2024-09-19T11:58:20.096 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:20.096 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T11:58:20.097 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:58:19.694+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-c con 0x55d994f29870 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:20.097 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-a con 0x55d99500a620 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:20.097 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-b con 0x55d99500aa00 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:20.097 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.097 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.097 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.097 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:20.097 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient(hunting): authenticate will time out at 2394.016046s 2024-09-19T11:58:20.097 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): get_auth_request con 0x55d994f29870 auth_method 0 2024-09-19T11:58:20.097 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.097 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.097 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.097 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient(hunting): get_auth_request con 0x55d99500a620 auth_method 0 2024-09-19T11:58:20.097 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.098 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.098 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.098 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:20.098 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:20.098 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:20.098 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:20.098 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:20.098 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:20.098 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:58:19.698+0000 7f9081e97640 10 monclient(hunting): get_auth_request con 0x55d99500aa00 auth_method 0 2024-09-19T11:58:20.098 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:58:19.698+0000 7f9081e97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.098 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:58:19.698+0000 7f9081e97640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.098 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:58:19.698+0000 7f9081e97640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.098 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient(hunting): handle_auth_done global_id 7097 payload 824 2024-09-19T11:58:20.098 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient: _finish_hunting 0 2024-09-19T11:58:20.099 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:58:19.698+0000 7f9081696640 1 monclient: found mon.noname-c 2024-09-19T11:58:20.099 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:58:19.698+0000 7f9081696640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.099 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.099 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:20.099 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: dump: 2024-09-19T11:58:20.099 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.099 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.099 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.099 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.099 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.099 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.099 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.099 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.100 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.100 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.100 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: _finish_auth 0 2024-09-19T11:58:20.100 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: _check_auth_tickets 2024-09-19T11:58:20.100 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:20.100 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.100 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:20.100 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:58:19.698+0000 7f8f6de03640 10 monclient: dump: 2024-09-19T11:58:20.100 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.100 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.100 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.100 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.100 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.100 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.101 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.101 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.101 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.101 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.101 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:58:19.698+0000 7f9083b909c0 5 monclient: authenticate success, global_id 7097 2024-09-19T11:58:20.101 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:58:19.698+0000 7f8f6f606640 4 set_mon_vals no callback set 2024-09-19T11:58:20.101 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient: _renew_subs 2024-09-19T11:58:20.101 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.101 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient: _renew_subs 2024-09-19T11:58:20.101 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:58:19.698+0000 7f9083b909c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.101 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:58:19.698+0000 7f9083b909c0 1 librados: init done 2024-09-19T11:58:20.101 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:58:19.698+0000 7f8f6de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:58:20.101 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:58:19.698+0000 7f8f6de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:20.101 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:58:19.698+0000 7f8f6de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:20.102 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:58:19.698+0000 7f9080e95640 10 monclient: get_auth_request con 0x7f8f68071be0 auth_method 0 2024-09-19T11:58:20.102 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:58:19.698+0000 7f9081e97640 10 monclient: get_auth_request con 0x55d995009190 auth_method 0 2024-09-19T11:58:20.102 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:58:19.702+0000 7f9081696640 10 monclient: get_auth_request con 0x55d99502b950 auth_method 0 2024-09-19T11:58:20.102 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:58:19.702+0000 7f9080e95640 10 monclient: get_auth_request con 0x55d99502fcb0 auth_method 0 2024-09-19T11:58:20.102 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient: get_auth_request con 0x55d99502f1d0 auth_method 0 2024-09-19T11:58:20.102 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: build_initial_monmap 2024-09-19T11:58:20.102 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:58:19.706+0000 7f9083b909c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:20.102 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: monmap: 2024-09-19T11:58:20.102 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:20.102 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:20.102 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:20.102 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:20.102 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:20.103 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.103 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:20.103 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:20.103 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:20.103 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.103 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding auth protocol: cephx 2024-09-19T11:58:20.103 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding auth protocol: cephx 2024-09-19T11:58:20.103 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding auth protocol: cephx 2024-09-19T11:58:20.103 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: secure 2024-09-19T11:58:20.103 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: crc 2024-09-19T11:58:20.103 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: secure 2024-09-19T11:58:20.103 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: crc 2024-09-19T11:58:20.103 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: secure 2024-09-19T11:58:20.103 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: crc 2024-09-19T11:58:20.104 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: crc 2024-09-19T11:58:20.104 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: secure 2024-09-19T11:58:20.104 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: crc 2024-09-19T11:58:20.104 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: secure 2024-09-19T11:58:20.104 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: crc 2024-09-19T11:58:20.104 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995037e00) adding con mode: secure 2024-09-19T11:58:20.104 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:58:19.706+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.104 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d99503b7f0 EEXIST 2024-09-19T11:58:20.104 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: init 2024-09-19T11:58:20.104 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding auth protocol: cephx 2024-09-19T11:58:20.104 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding auth protocol: cephx 2024-09-19T11:58:20.104 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding auth protocol: cephx 2024-09-19T11:58:20.104 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: secure 2024-09-19T11:58:20.104 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: crc 2024-09-19T11:58:20.105 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: secure 2024-09-19T11:58:20.105 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: crc 2024-09-19T11:58:20.105 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: secure 2024-09-19T11:58:20.105 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: crc 2024-09-19T11:58:20.105 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: crc 2024-09-19T11:58:20.105 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: secure 2024-09-19T11:58:20.105 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: crc 2024-09-19T11:58:20.105 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: secure 2024-09-19T11:58:20.105 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: crc 2024-09-19T11:58:20.105 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 AuthRegistry(0x55d995036d48) adding con mode: secure 2024-09-19T11:58:20.105 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:58:19.706+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.105 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:58:19.706+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.105 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command rotate-key cmddesc rotate-key hook 0x55d995036e90 EEXIST 2024-09-19T11:58:20.106 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:20.106 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T11:58:20.106 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-b con 0x55d99505f9a0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:20.106 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-c con 0x55d99505f2d0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:20.106 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-a con 0x55d99505dcb0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:20.106 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.106 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.106 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.106 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:20.106 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient(hunting): authenticate will time out at 2394.026758s 2024-09-19T11:58:20.106 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): get_auth_request con 0x55d99505f2d0 auth_method 0 2024-09-19T11:58:20.106 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.106 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.107 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.107 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:58:19.706+0000 7f9081696640 10 monclient(hunting): get_auth_request con 0x55d99505dcb0 auth_method 0 2024-09-19T11:58:20.107 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:58:19.706+0000 7f9081696640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.107 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:58:19.706+0000 7f9081696640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.107 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:58:19.706+0000 7f9081696640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.107 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:20.107 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:20.107 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:20.107 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:58:19.706+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:20.107 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:58:19.706+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:20.107 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:58:19.706+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:20.107 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:58:19.706+0000 7f9080e95640 10 monclient(hunting): get_auth_request con 0x55d99505f9a0 auth_method 0 2024-09-19T11:58:20.107 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:58:19.706+0000 7f9080e95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.107 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:58:19.706+0000 7f9080e95640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.108 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:58:19.706+0000 7f9080e95640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.108 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient(hunting): handle_auth_done global_id 7100 payload 824 2024-09-19T11:58:20.108 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient: _finish_hunting 0 2024-09-19T11:58:20.108 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:58:19.706+0000 7f9081e97640 1 monclient: found mon.noname-c 2024-09-19T11:58:20.108 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:58:19.706+0000 7f9081e97640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.108 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.108 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:20.108 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: dump: 2024-09-19T11:58:20.108 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.108 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.108 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.108 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.108 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.108 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.109 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.109 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.109 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.109 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.109 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: _finish_auth 0 2024-09-19T11:58:20.109 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: _check_auth_tickets 2024-09-19T11:58:20.109 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:20.109 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.109 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:20.109 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:58:19.706+0000 7f8f66ffd640 10 monclient: dump: 2024-09-19T11:58:20.109 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.109 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.109 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.109 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.110 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.110 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.110 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.110 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.110 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.110 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.110 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:58:19.706+0000 7f9083b909c0 5 monclient: authenticate success, global_id 7100 2024-09-19T11:58:20.110 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:58:19.706+0000 7f9082698640 4 set_mon_vals no callback set 2024-09-19T11:58:20.110 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: _renew_subs 2024-09-19T11:58:20.110 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.110 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: _renew_subs 2024-09-19T11:58:20.110 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:58:19.706+0000 7f9083b909c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.110 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:58:19.710+0000 7f8f66ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:58:20.111 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:58:19.710+0000 7f8f66ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:20.111 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:58:19.710+0000 7f8f66ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:20.111 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient: get_monmap_and_config 2024-09-19T11:58:20.111 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient: build_initial_monmap 2024-09-19T11:58:20.111 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:58:19.710+0000 7f9083b909c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:20.111 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient: monmap: 2024-09-19T11:58:20.111 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:20.111 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:20.111 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:20.111 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:20.111 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:20.111 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.111 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:20.112 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:20.112 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:20.112 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.112 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding auth protocol: cephx 2024-09-19T11:58:20.112 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding auth protocol: cephx 2024-09-19T11:58:20.112 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding auth protocol: cephx 2024-09-19T11:58:20.112 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: secure 2024-09-19T11:58:20.112 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: crc 2024-09-19T11:58:20.112 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: secure 2024-09-19T11:58:20.112 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: crc 2024-09-19T11:58:20.112 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: secure 2024-09-19T11:58:20.112 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: crc 2024-09-19T11:58:20.112 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: crc 2024-09-19T11:58:20.112 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: secure 2024-09-19T11:58:20.113 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: crc 2024-09-19T11:58:20.113 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: secure 2024-09-19T11:58:20.113 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: crc 2024-09-19T11:58:20.113 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x55d99507f3a0) adding con mode: secure 2024-09-19T11:58:20.113 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient: get_auth_request con 0x7f8f5c071b20 auth_method 0 2024-09-19T11:58:20.113 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:58:19.710+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.113 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient: init 2024-09-19T11:58:20.113 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding auth protocol: cephx 2024-09-19T11:58:20.113 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding auth protocol: cephx 2024-09-19T11:58:20.113 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding auth protocol: cephx 2024-09-19T11:58:20.113 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: secure 2024-09-19T11:58:20.113 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: crc 2024-09-19T11:58:20.113 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: secure 2024-09-19T11:58:20.114 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: crc 2024-09-19T11:58:20.114 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: secure 2024-09-19T11:58:20.114 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: crc 2024-09-19T11:58:20.114 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: crc 2024-09-19T11:58:20.114 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: secure 2024-09-19T11:58:20.114 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: crc 2024-09-19T11:58:20.114 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: secure 2024-09-19T11:58:20.114 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: crc 2024-09-19T11:58:20.114 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60431e0) adding con mode: secure 2024-09-19T11:58:20.114 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:58:19.710+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.114 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:58:19.710+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.114 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command rotate-key cmddesc rotate-key hook 0x7fffe6043328 EEXIST 2024-09-19T11:58:20.114 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:20.114 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T11:58:20.115 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-a con 0x55d9950832c0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:20.115 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-b con 0x55d9950836a0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:20.115 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-c con 0x55d9950add10 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:20.115 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.115 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.115 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.115 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:20.115 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient(hunting): authenticate will time out at 2394.031007s 2024-09-19T11:58:20.115 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): get_auth_request con 0x55d9950832c0 auth_method 0 2024-09-19T11:58:20.115 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.115 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.115 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.115 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:58:19.710+0000 7f9081696640 10 monclient(hunting): get_auth_request con 0x55d9950add10 auth_method 0 2024-09-19T11:58:20.115 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:58:19.710+0000 7f9081696640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.115 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:58:19.710+0000 7f9081696640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.116 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:58:19.710+0000 7f9081696640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.116 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:20.116 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:20.116 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:20.116 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient(hunting): handle_auth_done global_id 7620 payload 274 2024-09-19T11:58:20.116 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient: _finish_hunting 0 2024-09-19T11:58:20.116 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:58:19.710+0000 7f9080e95640 1 monclient: found mon.noname-a 2024-09-19T11:58:20.116 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:58:19.710+0000 7f9080e95640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:58:20.116 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.116 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:58:20.116 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: dump: 2024-09-19T11:58:20.116 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.117 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.117 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.117 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.117 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.117 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.117 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.117 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.117 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.117 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.117 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: _finish_auth 0 2024-09-19T11:58:20.117 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: _check_auth_tickets 2024-09-19T11:58:20.118 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:20.118 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.118 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:58:20.118 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:58:19.710+0000 7f8f64ff9640 10 monclient: dump: 2024-09-19T11:58:20.118 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.118 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.118 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.118 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.118 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.118 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.118 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.118 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.118 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.118 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.119 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:58:19.710+0000 7f9083b909c0 5 monclient: authenticate success, global_id 7620 2024-09-19T11:58:20.119 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:58:19.710+0000 7f9083b909c0 10 monclient: get_monmap_and_config success 2024-09-19T11:58:20.119 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:58:19.710+0000 7f9083b909c0 4 set_mon_vals no callback set 2024-09-19T11:58:20.119 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: shutdown 2024-09-19T11:58:20.119 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: build_initial_monmap 2024-09-19T11:58:20.119 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:58:19.714+0000 7f9083b909c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:20.119 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: monmap: 2024-09-19T11:58:20.119 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:20.119 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:20.119 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:20.119 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:20.119 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:20.119 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.119 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:20.120 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:20.120 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:20.120 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.120 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding auth protocol: cephx 2024-09-19T11:58:20.120 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding auth protocol: cephx 2024-09-19T11:58:20.120 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding auth protocol: cephx 2024-09-19T11:58:20.120 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: secure 2024-09-19T11:58:20.120 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: crc 2024-09-19T11:58:20.120 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: secure 2024-09-19T11:58:20.120 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: crc 2024-09-19T11:58:20.120 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: secure 2024-09-19T11:58:20.120 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: crc 2024-09-19T11:58:20.120 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: crc 2024-09-19T11:58:20.120 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: secure 2024-09-19T11:58:20.121 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: crc 2024-09-19T11:58:20.121 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: secure 2024-09-19T11:58:20.121 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: crc 2024-09-19T11:58:20.121 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d995084520) adding con mode: secure 2024-09-19T11:58:20.121 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:58:19.714+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.121 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:58:19.714+0000 7f9083b909c0 1 librados: starting msgr at 2024-09-19T11:58:20.121 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:58:19.714+0000 7f9083b909c0 1 librados: starting objecter 2024-09-19T11:58:20.121 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d9950af6c0 EEXIST 2024-09-19T11:58:20.121 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:58:19.714+0000 7f9083b909c0 1 librados: setting wanted keys 2024-09-19T11:58:20.121 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:58:19.714+0000 7f9083b909c0 1 librados: calling monclient init 2024-09-19T11:58:20.121 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: init 2024-09-19T11:58:20.121 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding auth protocol: cephx 2024-09-19T11:58:20.121 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding auth protocol: cephx 2024-09-19T11:58:20.121 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding auth protocol: cephx 2024-09-19T11:58:20.122 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: secure 2024-09-19T11:58:20.122 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: crc 2024-09-19T11:58:20.122 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: secure 2024-09-19T11:58:20.122 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: crc 2024-09-19T11:58:20.122 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: secure 2024-09-19T11:58:20.122 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: crc 2024-09-19T11:58:20.122 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: crc 2024-09-19T11:58:20.122 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: secure 2024-09-19T11:58:20.122 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: crc 2024-09-19T11:58:20.122 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: secure 2024-09-19T11:58:20.122 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: crc 2024-09-19T11:58:20.122 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 AuthRegistry(0x55d9950617c0) adding con mode: secure 2024-09-19T11:58:20.122 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:58:19.714+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.122 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:58:19.714+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.123 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command rotate-key cmddesc rotate-key hook 0x55d995061908 EEXIST 2024-09-19T11:58:20.123 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:20.123 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T11:58:20.123 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-a con 0x55d9950832c0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:20.123 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-b con 0x55d9950add10 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:20.123 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): picked mon.noname-c con 0x55d9950a7f20 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:20.123 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.123 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.123 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:20.123 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:20.123 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient(hunting): authenticate will time out at 2394.033778s 2024-09-19T11:58:20.123 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): get_auth_request con 0x55d9950a7f20 auth_method 0 2024-09-19T11:58:20.123 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.124 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.124 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.124 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:58:19.714+0000 7f9080e95640 10 monclient(hunting): get_auth_request con 0x55d9950832c0 auth_method 0 2024-09-19T11:58:20.124 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:58:19.714+0000 7f9080e95640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.124 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:58:19.714+0000 7f9080e95640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.124 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:58:19.714+0000 7f9080e95640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.124 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:20.124 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:20.124 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:20.124 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:58:19.714+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:20.124 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:58:19.714+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:20.124 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:58:19.714+0000 7f9080e95640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:20.124 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:58:19.714+0000 7f9081e97640 10 monclient(hunting): get_auth_request con 0x55d9950add10 auth_method 0 2024-09-19T11:58:20.124 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:58:19.714+0000 7f9081e97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:20.125 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:58:19.714+0000 7f9081e97640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:20.125 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:58:19.714+0000 7f9081e97640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:20.125 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient(hunting): handle_auth_done global_id 7106 payload 824 2024-09-19T11:58:20.125 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient: _finish_hunting 0 2024-09-19T11:58:20.125 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:58:19.714+0000 7f9081696640 1 monclient: found mon.noname-c 2024-09-19T11:58:20.125 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:58:19.714+0000 7f9081696640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.125 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.125 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:20.125 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: dump: 2024-09-19T11:58:20.125 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.125 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.125 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.125 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.125 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.126 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.126 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.126 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.126 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.126 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.126 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: _finish_auth 0 2024-09-19T11:58:20.126 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: _check_auth_tickets 2024-09-19T11:58:20.126 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 monclient: authenticate success, global_id 7106 2024-09-19T11:58:20.126 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: _renew_subs 2024-09-19T11:58:20.126 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.126 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:20.126 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:20.126 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:20.127 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:58:19.714+0000 7f8f52ffd640 10 monclient: dump: 2024-09-19T11:58:20.127 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:20.127 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:20.127 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.127 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:20.127 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:20.127 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:20.127 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:20.127 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:20.127 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:20.127 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.127 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:58:19.714+0000 7f8f64ff9640 4 set_mon_vals no callback set 2024-09-19T11:58:20.127 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: _renew_subs 2024-09-19T11:58:20.127 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:58:19.714+0000 7f9083b909c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.128 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:58:19.714+0000 7f9083b909c0 1 librados: init done 2024-09-19T11:58:20.128 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:58:19.714+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command cr dump hook 0x55d9950a79f8 2024-09-19T11:58:20.128 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.128 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:58:19.718+0000 7f8f52ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:58:20.128 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:58:19.718+0000 7f8f52ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:20.128 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:58:19.718+0000 7f8f52ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:20.128 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:58:19.718+0000 7f9081e97640 10 monclient: get_auth_request con 0x55d9950cd4c0 auth_method 0 2024-09-19T11:58:20.128 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:58:19.718+0000 7f9080e95640 10 monclient: get_auth_request con 0x7f8f4c071c10 auth_method 0 2024-09-19T11:58:20.128 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.128 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 realm 2024-09-19T11:58:20.128 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.128 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.128 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:58:19.718+0000 7f9083b909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:20.129 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.129 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.129 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:58:19.718+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.129 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:58:19.718+0000 7f9080e95640 10 monclient: get_auth_request con 0x55d9950d17b0 auth_method 0 2024-09-19T11:58:20.129 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:58:19.722+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:20.129 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:58:19.722+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.129 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:58:19.722+0000 7f9081e97640 10 monclient: get_auth_request con 0x55d9950d4ed0 auth_method 0 2024-09-19T11:58:20.129 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:58:19.722+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:20.129 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:58:19.722+0000 7f9083b909c0 20 searching for the correct realm 2024-09-19T11:58:20.129 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:58:19.722+0000 7f9081696640 10 monclient: get_auth_request con 0x55d9950d9bf0 auth_method 0 2024-09-19T11:58:20.129 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:58:19.726+0000 7f9080e95640 10 monclient: get_auth_request con 0x55d994e6ba70 auth_method 0 2024-09-19T11:58:20.129 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:58:19.726+0000 7f9081e97640 10 monclient: get_auth_request con 0x7f907802a070 auth_method 0 2024-09-19T11:58:20.129 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:58:19.726+0000 7f9081696640 0 -- 172.21.15.120:0/868883666 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f907c09a260 msgr2=0x7f907c062f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:58:20.130 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:58:19.930+0000 7f9081696640 10 monclient: get_auth_request con 0x7f907c09a260 auth_method 0 2024-09-19T11:58:20.130 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:58:19.938+0000 7f9080e95640 10 monclient: get_auth_request con 0x7f9074111040 auth_method 0 2024-09-19T11:58:20.130 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:58:19.942+0000 7f9081696640 0 -- 172.21.15.120:0/868883666 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f907c09a260 msgr2=0x7f907c062f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:20.130 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:58:19.942+0000 7f8f52ffd640 1 client.7106.objecter ms_handle_reset 0x7f907c09a260 session 0x7f907c017040 osd.4 2024-09-19T11:58:20.130 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:58:19.942+0000 7f8f52ffd640 10 monclient: _renew_subs 2024-09-19T11:58:20.130 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:58:19.942+0000 7f8f52ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:20.130 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:58:19.942+0000 7f9081696640 10 monclient: get_auth_request con 0x7f8f4c082230 auth_method 0 2024-09-19T11:58:20.130 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:20.130 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:20.130 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:20.130 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:20.130 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:20.130 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:20.130 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.131 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.131 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.131 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:20.131 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.131 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:20.131 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 zone default found 2024-09-19T11:58:20.131 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:58:19.954+0000 7f9083b909c0 4 Realm: () 2024-09-19T11:58:20.131 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:58:19.954+0000 7f9083b909c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:20.131 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:58:19.954+0000 7f9083b909c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:20.131 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:58:19.954+0000 7f9083b909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:20.131 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 zonegroup default 2024-09-19T11:58:20.131 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:58:19.954+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.131 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:58:19.958+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.131 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:58:19.958+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.132 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:58:19.958+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.132 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:58:19.958+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.132 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:58:19.958+0000 7f9083b909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.132 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:58:19.958+0000 7f9083b909c0 20 started sync module instance, tier type = 2024-09-19T11:58:20.132 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:58:19.958+0000 7f9083b909c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:20.132 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=0 2024-09-19T11:58:20.132 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=1 2024-09-19T11:58:20.132 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=2 2024-09-19T11:58:20.132 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=3 2024-09-19T11:58:20.132 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=4 2024-09-19T11:58:20.132 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=5 2024-09-19T11:58:20.132 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:58:19.978+0000 7f9083b909c0 20 add_watcher() i=6 2024-09-19T11:58:20.132 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:58:19.982+0000 7f9083b909c0 20 add_watcher() i=7 2024-09-19T11:58:20.133 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:58:19.982+0000 7f9083b909c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:20.133 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding auth protocol: cephx 2024-09-19T11:58:20.133 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding auth protocol: cephx 2024-09-19T11:58:20.133 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding auth protocol: cephx 2024-09-19T11:58:20.133 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: secure 2024-09-19T11:58:20.133 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: crc 2024-09-19T11:58:20.133 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: secure 2024-09-19T11:58:20.133 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: crc 2024-09-19T11:58:20.133 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: secure 2024-09-19T11:58:20.133 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: crc 2024-09-19T11:58:20.133 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: crc 2024-09-19T11:58:20.133 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: secure 2024-09-19T11:58:20.133 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: crc 2024-09-19T11:58:20.133 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: secure 2024-09-19T11:58:20.134 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:58:19.982+0000 7f8f377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:20.134 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: crc 2024-09-19T11:58:20.134 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:58:19.982+0000 7f9083b909c0 5 AuthRegistry(0x7fffe60436b0) adding con mode: secure 2024-09-19T11:58:20.134 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:58:19.986+0000 7f9083b909c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:20.134 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:20.134 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:20.134 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command cache list hook 0x55d9950a3d80 2024-09-19T11:58:20.134 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command cache inspect hook 0x55d9950a3d80 2024-09-19T11:58:20.134 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command cache erase hook 0x55d9950a3d80 2024-09-19T11:58:20.134 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command cache zap hook 0x55d9950a3d80 2024-09-19T11:58:20.134 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 note: GC not initialized 2024-09-19T11:58:20.134 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:58:19.986+0000 7f8f367e4640 20 reqs_thread_entry: start 2024-09-19T11:58:20.134 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command sync trace show hook 0x7f9078013070 2024-09-19T11:58:20.134 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command sync trace history hook 0x7f9078013070 2024-09-19T11:58:20.134 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command sync trace active hook 0x7f9078013070 2024-09-19T11:58:20.135 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:58:19.986+0000 7f9083b909c0 5 asok(0x55d994dd2d90) register_command sync trace active_short hook 0x7f9078013070 2024-09-19T11:58:20.135 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:20.135 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 Filter name: none 2024-09-19T11:58:20.135 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:58:19.986+0000 7f8ea7fff640 20 reqs_thread_entry: start 2024-09-19T11:58:20.135 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-19T11:58:20.135 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.135 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:20.135 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-19T11:58:20.135 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-19T11:58:20.135 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 : miss 2024-09-19T11:58:20.135 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.135 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:58:19.986+0000 7f9083b909c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:58:20.135 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:20.135 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:20.136 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:58:20.136 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:20.136 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:58:19.986+0000 7f9083b909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 2024-09-19T11:58:20.136 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:58:19.998+0000 7f9083b909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:20.136 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:58:19.998+0000 7f9083b909c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:20.136 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:58:19.998+0000 7f9083b909c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:20.136 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:58:19.998+0000 7f9083b909c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35, ofs0, ns] 2024-09-19T11:58:20.136 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:58:19.998+0000 7f8f64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366155 cookie 94392996999216 notifier 7106 bl.length()=995 2024-09-19T11:58:20.136 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:58:19.998+0000 7f8f64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:20.136 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:58:19.998+0000 7f8f64ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:20.136 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:58:19.998+0000 7f8f64ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:20.136 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:58:19.998+0000 7f9083b909c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): orig_sources= new_sources= 2024-09-19T11:58:20.136 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:58:19.998+0000 7f9083b909c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): potential sources added=[] removed=[] 2024-09-19T11:58:20.137 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:58:19.998+0000 7f9083b909c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): orig_dests= new_dests= 2024-09-19T11:58:20.137 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:58:19.998+0000 7f9083b909c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): potential dests added=[] removed=[] 2024-09-19T11:58:20.137 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:58:20.002+0000 7f9083b909c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9083b909c0 time 2024-09-19T11:58:20.008021+0000 2024-09-19T11:58:20.137 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:58:20.137 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.137 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:20.137 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f908746a2eb] 2024-09-19T11:58:20.137 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f908746a49f] 2024-09-19T11:58:20.137 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d99354c271] 2024-09-19T11:58:20.137 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d99355c14a] 2024-09-19T11:58:20.137 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T11:58:20.137 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f90862d0d90] 2024-09-19T11:58:20.137 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T11:58:20.137 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T11:58:20.138 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.138 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:58:20.006+0000 7f9083b909c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:58:20.138 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f9083b909c0 thread_name:radosgw-admin 2024-09-19T11:58:20.138 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.138 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:20.138 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f90862e9520] 2024-09-19T11:58:20.138 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:58:20.138 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:58:20.138 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:58:20.138 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f908746a345] 2024-09-19T11:58:20.138 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f908746a49f] 2024-09-19T11:58:20.138 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d99354c271] 2024-09-19T11:58:20.138 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d99355c14a] 2024-09-19T11:58:20.138 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T11:58:20.139 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f90862d0d90] 2024-09-19T11:58:20.139 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T11:58:20.139 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T11:58:20.139 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:58:20.139 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.139 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:58:20.139 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:58:20.139 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:58:20.139 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:58:20.139 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:58:20.139 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:58:20.139 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:58:20.139 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:58:20.139 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:58:20.140 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:58:20.140 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:58:20.140 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:58:20.140 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:58:20.140 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:58:20.140 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:58:20.140 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:58:20.140 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:58:20.140 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:58:20.140 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:58:20.140 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:58:20.140 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:58:20.140 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:58:20.140 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:58:20.141 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:58:20.141 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:58:20.141 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:58:20.141 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:58:20.141 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:58:20.141 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:58:20.141 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:58:20.141 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:58:20.141 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:58:20.141 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:58:20.141 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:58:20.141 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:58:20.141 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:58:20.141 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:58:20.142 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:58:20.142 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:58:20.142 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:58:20.142 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:58:20.142 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:58:20.142 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:58:20.142 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:58:20.142 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:58:20.142 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:58:20.142 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:58:20.142 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:58:20.142 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:58:20.142 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:58:20.142 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:58:20.143 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:58:20.143 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:58:20.143 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:58:20.143 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:58:20.143 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:58:20.143 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:58:20.143 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:58:20.143 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:58:20.143 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:58:20.143 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:58:20.143 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:58:20.143 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:58:20.143 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:58:20.143 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:58:20.143 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:58:20.144 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:58:20.144 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:58:20.144 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:58:20.144 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:58:20.144 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:58:20.144 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:58:20.144 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:58:20.144 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:58:20.144 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:58:20.144 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:58:20.144 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:58:20.144 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:58:20.144 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:58:20.145 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:58:20.145 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:58:20.145 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:58:20.145 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:58:20.145 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:58:20.145 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:58:20.145 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:58:20.145 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:58:20.145 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:58:20.145 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:58:20.145 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:58:20.145 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:58:20.145 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:58:20.146 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:58:20.146 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:58:20.146 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8ea7fff640 / http_manager 2024-09-19T11:58:20.146 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8f367e4640 / http_manager 2024-09-19T11:58:20.146 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8f377e6640 / rgw_dt_lg_renew 2024-09-19T11:58:20.146 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8f52ffd640 / ms_dispatch 2024-09-19T11:58:20.146 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8f64ff9640 / io_context_pool 2024-09-19T11:58:20.146 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8f66ffd640 / ms_dispatch 2024-09-19T11:58:20.146 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8f6de03640 / ms_dispatch 2024-09-19T11:58:20.146 INFO:tasks.workunit.client.0.smithi120.stderr: 7f8f6f606640 / io_context_pool 2024-09-19T11:58:20.146 INFO:tasks.workunit.client.0.smithi120.stderr: 7f9080e95640 / msgr-worker-2 2024-09-19T11:58:20.146 INFO:tasks.workunit.client.0.smithi120.stderr: 7f9081696640 / msgr-worker-1 2024-09-19T11:58:20.146 INFO:tasks.workunit.client.0.smithi120.stderr: 7f9081e97640 / msgr-worker-0 2024-09-19T11:58:20.146 INFO:tasks.workunit.client.0.smithi120.stderr: 7f9082698640 / io_context_pool 2024-09-19T11:58:20.147 INFO:tasks.workunit.client.0.smithi120.stderr: 7f9083b909c0 / radosgw-admin 2024-09-19T11:58:20.147 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:58:20.147 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:58:20.147 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/lib/ceph/crash/2024-09-19T11:58:20.010593Z_e82bf291-e172-4057-a2cb-e33ec5abfff4/log 2024-09-19T11:58:20.147 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:58:20.147 INFO:tasks.workunit.client.0.smithi120.stderr:Aborted 2024-09-19T11:58:20.147 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-19T11:58:20.149 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:20.149 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:20.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.086+0000 7fca7cfd79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.090+0000 7fca7cfd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.090+0000 7fca7cfd79c0 20 realm 2024-09-19T11:58:20.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.090+0000 7fca7cfd79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.090+0000 7fca7cfd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.090+0000 7fca7cfd79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:20.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.090+0000 7fca7cfd79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.090+0000 7fca7cfd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.090+0000 7fca7cfd79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.090+0000 7fca7cfd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:20.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.090+0000 7fca7cfd79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.094+0000 7fca7cfd79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:20.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.094+0000 7fca7cfd79c0 20 searching for the correct realm 2024-09-19T11:58:20.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.094+0000 7fca7b2de640 0 -- 172.21.15.120:0/1616234602 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fca7001a040 msgr2=0x7fca70075ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:20.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.102+0000 7fca7a2dc640 0 -- 172.21.15.120:0/1616234602 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fca6c10d420 msgr2=0x7fca6c1290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:20.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.318+0000 7fca7cfd79c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:20.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.318+0000 7fca7cfd79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:20.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.318+0000 7fca7cfd79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:20.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.318+0000 7fca7cfd79c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:20.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.318+0000 7fca7cfd79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:20.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.318+0000 7fca7cfd79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:20.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.318+0000 7fca7cfd79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.322+0000 7fca7cfd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.322+0000 7fca7cfd79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.322+0000 7fca7cfd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:20.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.322+0000 7fca7cfd79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.322+0000 7fca7cfd79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:20.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.322+0000 7fca7cfd79c0 20 zone default found 2024-09-19T11:58:20.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.322+0000 7fca7cfd79c0 4 Realm: () 2024-09-19T11:58:20.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.322+0000 7fca7cfd79c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:20.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.322+0000 7fca7cfd79c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:20.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.322+0000 7fca7cfd79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:20.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.322+0000 7fca7cfd79c0 20 zonegroup default 2024-09-19T11:58:20.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.322+0000 7fca7cfd79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.322+0000 7fca7cfd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.322+0000 7fca7cfd79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.326+0000 7fca7cfd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.326+0000 7fca7cfd79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.326+0000 7fca7cfd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.326+0000 7fca7cfd79c0 20 started sync module instance, tier type = 2024-09-19T11:58:20.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.326+0000 7fca7cfd79c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:20.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.350+0000 7fca7cfd79c0 20 add_watcher() i=0 2024-09-19T11:58:20.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.350+0000 7fca7cfd79c0 20 add_watcher() i=1 2024-09-19T11:58:20.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.350+0000 7fca7cfd79c0 20 add_watcher() i=2 2024-09-19T11:58:20.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.350+0000 7fca7cfd79c0 20 add_watcher() i=3 2024-09-19T11:58:20.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.350+0000 7fca7cfd79c0 20 add_watcher() i=4 2024-09-19T11:58:20.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.350+0000 7fca7cfd79c0 20 add_watcher() i=5 2024-09-19T11:58:20.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.350+0000 7fca7cfd79c0 20 add_watcher() i=6 2024-09-19T11:58:20.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.350+0000 7fca7cfd79c0 20 add_watcher() i=7 2024-09-19T11:58:20.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.350+0000 7fca7cfd79c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:20.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.354+0000 7fc9317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:20.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.354+0000 7fca7cfd79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:20.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.354+0000 7fca7cfd79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:20.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.354+0000 7fca7cfd79c0 5 note: GC not initialized 2024-09-19T11:58:20.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.358+0000 7fc8abfff640 20 reqs_thread_entry: start 2024-09-19T11:58:20.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.358+0000 7fca7cfd79c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:20.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.358+0000 7fca7cfd79c0 20 Filter name: none 2024-09-19T11:58:20.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.358+0000 7fc8a9ffb640 20 reqs_thread_entry: start 2024-09-19T11:58:20.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.358+0000 7fca7cfd79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.358+0000 7fca7cfd79c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:20.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.358+0000 7fca7cfd79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.359 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.358+0000 7fca7cfd79c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-19T11:58:20.359 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.358+0000 7fca7cfd79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:20.359 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.358+0000 7fca7cfd79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.362+0000 7fca7cfd79c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:20.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.362+0000 7fca7cfd79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.362+0000 7fca7cfd79c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-19T11:58:20.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.362+0000 7fca7cfd79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:20.363 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.362+0000 7fc9317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:20.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.370+0000 7fca7cfd79c0 20 remove_watcher() i=0 2024-09-19T11:58:20.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.370+0000 7fca7cfd79c0 2 removed watcher, disabling cache 2024-09-19T11:58:20.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.370+0000 7fca7cfd79c0 20 remove_watcher() i=1 2024-09-19T11:58:20.372 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.374+0000 7fca7cfd79c0 20 remove_watcher() i=2 2024-09-19T11:58:20.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.374+0000 7fca7cfd79c0 20 remove_watcher() i=3 2024-09-19T11:58:20.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.378+0000 7fca7cfd79c0 20 remove_watcher() i=4 2024-09-19T11:58:20.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.378+0000 7fca7cfd79c0 20 remove_watcher() i=5 2024-09-19T11:58:20.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.382+0000 7fca7cfd79c0 20 remove_watcher() i=6 2024-09-19T11:58:20.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.382+0000 7fca7cfd79c0 20 remove_watcher() i=7 2024-09-19T11:58:20.397 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.397 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:58:20.397 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-do-reshard id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:58:20.398 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:20.456 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:58:20.489 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:20.489 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:20.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.730+0000 7fecb0ae8640 0 --2- 172.21.15.120:0/1457435781 >> [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] conn(0x560171638480 0x56017164c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-19T11:58:20.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.746+0000 7fecb37e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.746+0000 7fecb37e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.746+0000 7fecb37e39c0 20 realm 2024-09-19T11:58:20.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.746+0000 7fecb37e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.746+0000 7fecb37e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.746+0000 7fecb37e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:20.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.746+0000 7fecb37e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.746+0000 7fecb37e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.746 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.746+0000 7fecb37e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.750+0000 7fecb37e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:20.747 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.750+0000 7fecb37e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.750+0000 7fecb37e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:20.749 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.750+0000 7fecb37e39c0 20 searching for the correct realm 2024-09-19T11:58:20.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.750+0000 7fecb0ae8640 0 -- 172.21.15.120:0/2298385805 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7feca403a040 msgr2=0x7feca4026920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:58:20.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.962+0000 7fecb1aea640 0 -- 172.21.15.120:0/2298385805 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7feca810c040 msgr2=0x7feca8100a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:20.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:20.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:20.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:20.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:20.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:20.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:20.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:20.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:20.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 zone default found 2024-09-19T11:58:20.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 4 Realm: () 2024-09-19T11:58:20.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:20.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:20.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:20.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 zonegroup default 2024-09-19T11:58:20.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.982+0000 7fecb37e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.986+0000 7fecb37e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.986+0000 7fecb37e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:20.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.986+0000 7fecb37e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:20.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.986+0000 7fecb37e39c0 20 started sync module instance, tier type = 2024-09-19T11:58:20.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:20.986+0000 7fecb37e39c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:21.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.006+0000 7fecb37e39c0 20 add_watcher() i=0 2024-09-19T11:58:21.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.006+0000 7fecb37e39c0 20 add_watcher() i=1 2024-09-19T11:58:21.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.006+0000 7fecb37e39c0 20 add_watcher() i=2 2024-09-19T11:58:21.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.006+0000 7fecb37e39c0 20 add_watcher() i=3 2024-09-19T11:58:21.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.006+0000 7fecb37e39c0 20 add_watcher() i=4 2024-09-19T11:58:21.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.006+0000 7fecb37e39c0 20 add_watcher() i=5 2024-09-19T11:58:21.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.006+0000 7fecb37e39c0 20 add_watcher() i=6 2024-09-19T11:58:21.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.010+0000 7fecb37e39c0 20 add_watcher() i=7 2024-09-19T11:58:21.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.010+0000 7fecb37e39c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:21.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.010+0000 7feb67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:21.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:21.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:21.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 5 note: GC not initialized 2024-09-19T11:58:21.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7feb66fe5640 20 reqs_thread_entry: start 2024-09-19T11:58:21.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:21.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 20 Filter name: none 2024-09-19T11:58:21.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7feb64fe1640 20 reqs_thread_entry: start 2024-09-19T11:58:21.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-19T11:58:21.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:21.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:21.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-19T11:58:21.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-19T11:58:21.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 : miss 2024-09-19T11:58:21.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:21.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-19T11:58:21.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:21.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:21.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:58:21.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:21.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.014+0000 7fecb37e39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 2024-09-19T11:58:21.018 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.018+0000 7fecb37e39c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to be held by another RGW process; skipping for now 2024-09-19T11:58:21.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.022+0000 7feb67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:21.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.030+0000 7fecb37e39c0 20 remove_watcher() i=0 2024-09-19T11:58:21.028 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.030+0000 7fecb37e39c0 2 removed watcher, disabling cache 2024-09-19T11:58:21.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.030+0000 7fecb37e39c0 20 remove_watcher() i=1 2024-09-19T11:58:21.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.034+0000 7fecb37e39c0 20 remove_watcher() i=2 2024-09-19T11:58:21.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.034+0000 7fecb37e39c0 20 remove_watcher() i=3 2024-09-19T11:58:21.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.038+0000 7fecb37e39c0 20 remove_watcher() i=4 2024-09-19T11:58:21.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.038+0000 7fecb37e39c0 20 remove_watcher() i=5 2024-09-19T11:58:21.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.038+0000 7fecb37e39c0 20 remove_watcher() i=6 2024-09-19T11:58:21.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:21.042+0000 7fecb37e39c0 20 remove_watcher() i=7 2024-09-19T11:58:21.056 INFO:tasks.workunit.client.0.smithi120.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T11:58:51.084 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:58:51.121 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:51.121 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:51.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.170+0000 7f50162df9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.174+0000 7f50162df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:51.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.174+0000 7f50162df9c0 20 realm 2024-09-19T11:58:51.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.174+0000 7f50162df9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.174+0000 7f50162df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:51.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.174+0000 7f50162df9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:51.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.174+0000 7f50162df9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.169 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.174+0000 7f50162df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:51.169 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.174+0000 7f50162df9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.174+0000 7f50162df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:51.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.174+0000 7f50162df9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.178+0000 7f50162df9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:51.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.178+0000 7f50162df9c0 20 searching for the correct realm 2024-09-19T11:58:51.175 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.178+0000 7f5013de5640 0 -- 172.21.15.120:0/1208013497 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f500c079c20 msgr2=0x7f500c086da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:58:51.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.394+0000 7f5013de5640 0 -- 172.21.15.120:0/1208013497 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f500c079c20 msgr2=0x7f500c086da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:51.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:51.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:51.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:51.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:51.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:51.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:51.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:51.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:51.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:51.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 20 zone default found 2024-09-19T11:58:51.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 4 Realm: () 2024-09-19T11:58:51.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:51.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:51.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:51.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 20 zonegroup default 2024-09-19T11:58:51.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.406+0000 7f50162df9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.410+0000 7f50162df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:51.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.410+0000 7f50162df9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.404 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.410+0000 7f50162df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:51.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.410+0000 7f50162df9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.410+0000 7f50162df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:51.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.410+0000 7f50162df9c0 20 started sync module instance, tier type = 2024-09-19T11:58:51.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.410+0000 7f50162df9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:51.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.434+0000 7f50162df9c0 20 add_watcher() i=0 2024-09-19T11:58:51.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.434+0000 7f50162df9c0 20 add_watcher() i=1 2024-09-19T11:58:51.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.434+0000 7f50162df9c0 20 add_watcher() i=2 2024-09-19T11:58:51.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.434+0000 7f50162df9c0 20 add_watcher() i=3 2024-09-19T11:58:51.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.434+0000 7f50162df9c0 20 add_watcher() i=4 2024-09-19T11:58:51.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.434+0000 7f50162df9c0 20 add_watcher() i=5 2024-09-19T11:58:51.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.434+0000 7f50162df9c0 20 add_watcher() i=6 2024-09-19T11:58:51.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.438+0000 7f50162df9c0 20 add_watcher() i=7 2024-09-19T11:58:51.431 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.438+0000 7f50162df9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:51.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.442+0000 7f4eca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:51.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.442+0000 7f50162df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:51.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.442+0000 7f50162df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:51.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.442+0000 7f50162df9c0 5 note: GC not initialized 2024-09-19T11:58:51.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.442+0000 7f4ec97e2640 20 reqs_thread_entry: start 2024-09-19T11:58:51.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.442+0000 7f50162df9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:51.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.442+0000 7f50162df9c0 20 Filter name: none 2024-09-19T11:58:51.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.442+0000 7f50162df9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-19T11:58:51.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.442+0000 7f4ec27fc640 20 reqs_thread_entry: start 2024-09-19T11:58:51.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.442+0000 7f50162df9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.442+0000 7f50162df9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:51.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.442+0000 7f50162df9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-19T11:58:51.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.442+0000 7f50162df9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-19T11:58:51.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.442+0000 7f50162df9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 : miss 2024-09-19T11:58:51.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.442+0000 7f50162df9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.446+0000 7f50162df9c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-19T11:58:51.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.446+0000 7f50162df9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:51.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.446+0000 7f50162df9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:51.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.446+0000 7f50162df9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:58:51.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.446+0000 7f50162df9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:51.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.446+0000 7f50162df9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 2024-09-19T11:58:51.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.446+0000 7f50162df9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T11:58:51.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.454+0000 7f50162df9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:51.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.454+0000 7f50162df9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:51.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.454+0000 7f50162df9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:51.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.454+0000 7f50162df9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35, ofs0, ns] 2024-09-19T11:58:51.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.454+0000 7f4ef2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366156 cookie 94122855701840 notifier 7154 bl.length()=995 2024-09-19T11:58:51.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.454+0000 7f4ef2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:51.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.454+0000 7f4ef2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:51.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.454+0000 7f4ef2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:51.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.458+0000 7f50162df9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): orig_sources= new_sources= 2024-09-19T11:58:51.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.458+0000 7f50162df9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): potential sources added=[] removed=[] 2024-09-19T11:58:51.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.458+0000 7f50162df9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): orig_dests= new_dests= 2024-09-19T11:58:51.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.458+0000 7f50162df9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): potential dests added=[] removed=[] 2024-09-19T11:58:51.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.462+0000 7f50162df9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35.2.0 2024-09-19T11:58:51.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.462+0000 7f50162df9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35.2.0 2024-09-19T11:58:51.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.462+0000 7f50162df9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35.2.1 2024-09-19T11:58:51.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.462+0000 7f50162df9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35.2.1 2024-09-19T11:58:51.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.462+0000 7f50162df9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35.0 2024-09-19T11:58:51.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.466+0000 7f50162df9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 : hit (requested=0x17, cached=0x17) 2024-09-19T11:58:51.461 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.466+0000 7f50162df9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 2024-09-19T11:58:51.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.470+0000 7f50162df9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:51.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.470+0000 7f50162df9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:51.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.470+0000 7f50162df9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:51.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.470+0000 7f50162df9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35, ofs0, ns] 2024-09-19T11:58:51.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.470+0000 7f4ef2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366157 cookie 94122855701840 notifier 7154 bl.length()=995 2024-09-19T11:58:51.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.470+0000 7f4ef2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:51.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.470+0000 7f4ef2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:51.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.470+0000 7f4ef2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:51.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.470+0000 7f50162df9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): orig_sources= new_sources= 2024-09-19T11:58:51.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.470+0000 7f50162df9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): potential sources added=[] removed=[] 2024-09-19T11:58:51.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.470+0000 7f50162df9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): orig_dests= new_dests= 2024-09-19T11:58:51.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.470+0000 7f50162df9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): potential dests added=[] removed=[] 2024-09-19T11:58:51.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.470+0000 7f50162df9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35.0 2024-09-19T11:58:51.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.470+0000 7f50162df9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 : hit (requested=0x17, cached=0x17) 2024-09-19T11:58:51.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.470+0000 7f50162df9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 2024-09-19T11:58:51.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.474+0000 7f50162df9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:51.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.474+0000 7f50162df9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:51.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.474+0000 7f50162df9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:51.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.474+0000 7f50162df9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35, ofs0, ns] 2024-09-19T11:58:51.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.474+0000 7f4ef2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366158 cookie 94122855701840 notifier 7154 bl.length()=963 2024-09-19T11:58:51.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.474+0000 7f4ef2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 info.flags=0x17 2024-09-19T11:58:51.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.474+0000 7f4ef2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 to cache LRU end 2024-09-19T11:58:51.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.474+0000 7f4ef2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:51.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.474+0000 7f50162df9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): orig_sources= new_sources= 2024-09-19T11:58:51.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.474+0000 7f50162df9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): potential sources added=[] removed=[] 2024-09-19T11:58:51.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.474+0000 7f50162df9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): orig_dests= new_dests= 2024-09-19T11:58:51.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.474+0000 7f50162df9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35]): potential dests added=[] removed=[] 2024-09-19T11:58:51.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.478+0000 7f50162df9c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-19T11:58:51.479 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.486+0000 7f4eca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:51.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.490+0000 7f50162df9c0 20 remove_watcher() i=0 2024-09-19T11:58:51.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.490+0000 7f50162df9c0 2 removed watcher, disabling cache 2024-09-19T11:58:51.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.490+0000 7f50162df9c0 20 remove_watcher() i=1 2024-09-19T11:58:51.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.494+0000 7f50162df9c0 20 remove_watcher() i=2 2024-09-19T11:58:51.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.498+0000 7f50162df9c0 20 remove_watcher() i=3 2024-09-19T11:58:51.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.498+0000 7f50162df9c0 20 remove_watcher() i=4 2024-09-19T11:58:51.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.498+0000 7f50162df9c0 20 remove_watcher() i=5 2024-09-19T11:58:51.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.502+0000 7f50162df9c0 20 remove_watcher() i=6 2024-09-19T11:58:51.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.502+0000 7f50162df9c0 20 remove_watcher() i=7 2024-09-19T11:58:51.514 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-19T11:58:51.544 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:51.544 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:51.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.594+0000 7f75117729c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.594+0000 7f75117729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:51.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.594+0000 7f75117729c0 20 realm 2024-09-19T11:58:51.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.594+0000 7f75117729c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.594+0000 7f75117729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:51.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.594+0000 7f75117729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:51.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.594+0000 7f75117729c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.594+0000 7f75117729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:51.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.594+0000 7f75117729c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.598+0000 7f75117729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:51.592 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.598+0000 7f75117729c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.598+0000 7f75117729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:51.594 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.598+0000 7f75117729c0 20 searching for the correct realm 2024-09-19T11:58:51.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.602+0000 7f750f278640 0 -- 172.21.15.120:0/3034753658 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f7508067760 msgr2=0x7f750805cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:51.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.818+0000 7f750f278640 0 -- 172.21.15.120:0/3034753658 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f7508067760 msgr2=0x7f750805cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:51.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.830+0000 7f75117729c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:51.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.830+0000 7f75117729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:51.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.830+0000 7f75117729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:51.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.830+0000 7f75117729c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:51.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.830+0000 7f75117729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:51.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.830+0000 7f75117729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:51.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.830+0000 7f75117729c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.830+0000 7f75117729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:51.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.830+0000 7f75117729c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.830+0000 7f75117729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:51.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.830+0000 7f75117729c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.834+0000 7f75117729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:51.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.834+0000 7f75117729c0 20 zone default found 2024-09-19T11:58:51.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.834+0000 7f75117729c0 4 Realm: () 2024-09-19T11:58:51.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.834+0000 7f75117729c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:51.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.834+0000 7f75117729c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:51.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.834+0000 7f75117729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:51.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.834+0000 7f75117729c0 20 zonegroup default 2024-09-19T11:58:51.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.834+0000 7f75117729c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.834+0000 7f75117729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:51.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.834+0000 7f75117729c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.834+0000 7f75117729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:51.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.834+0000 7f75117729c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.834+0000 7f75117729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:51.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.834+0000 7f75117729c0 20 started sync module instance, tier type = 2024-09-19T11:58:51.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.834+0000 7f75117729c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:51.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.858+0000 7f75117729c0 20 add_watcher() i=0 2024-09-19T11:58:51.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.858+0000 7f75117729c0 20 add_watcher() i=1 2024-09-19T11:58:51.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.858+0000 7f75117729c0 20 add_watcher() i=2 2024-09-19T11:58:51.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.858+0000 7f75117729c0 20 add_watcher() i=3 2024-09-19T11:58:51.855 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.858+0000 7f75117729c0 20 add_watcher() i=4 2024-09-19T11:58:51.855 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.858+0000 7f75117729c0 20 add_watcher() i=5 2024-09-19T11:58:51.855 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.858+0000 7f75117729c0 20 add_watcher() i=6 2024-09-19T11:58:51.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.862+0000 7f75117729c0 20 add_watcher() i=7 2024-09-19T11:58:51.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.862+0000 7f75117729c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:51.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.866+0000 7f73c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:51.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.866+0000 7f75117729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:51.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.866+0000 7f75117729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:51.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.866+0000 7f75117729c0 5 note: GC not initialized 2024-09-19T11:58:51.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.866+0000 7f73c4fe1640 20 reqs_thread_entry: start 2024-09-19T11:58:51.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.866+0000 7f75117729c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:51.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.866+0000 7f75117729c0 20 Filter name: none 2024-09-19T11:58:51.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.866+0000 7f733e7fc640 20 reqs_thread_entry: start 2024-09-19T11:58:51.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.866+0000 7f75117729c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.870+0000 7f75117729c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:51.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.870+0000 7f75117729c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.870+0000 7f75117729c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:58:51.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.870+0000 7f75117729c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:51.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.870+0000 7f75117729c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.870+0000 7f75117729c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-19T11:58:51.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.870+0000 7f75117729c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:51.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.870+0000 7f75117729c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-19T11:58:51.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.870+0000 7f75117729c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:51.868 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.874+0000 7f73c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:51.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.878+0000 7f75117729c0 20 remove_watcher() i=0 2024-09-19T11:58:51.873 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.878+0000 7f75117729c0 2 removed watcher, disabling cache 2024-09-19T11:58:51.876 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.882+0000 7f75117729c0 20 remove_watcher() i=1 2024-09-19T11:58:51.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.882+0000 7f75117729c0 20 remove_watcher() i=2 2024-09-19T11:58:51.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.886+0000 7f75117729c0 20 remove_watcher() i=3 2024-09-19T11:58:51.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.886+0000 7f75117729c0 20 remove_watcher() i=4 2024-09-19T11:58:51.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.890+0000 7f75117729c0 20 remove_watcher() i=5 2024-09-19T11:58:51.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.890+0000 7f75117729c0 20 remove_watcher() i=6 2024-09-19T11:58:51.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:51.890+0000 7f75117729c0 20 remove_watcher() i=7 2024-09-19T11:58:51.901 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:51.901 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:58:51.901 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-do-reshard id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T11:58:51.902 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:51.981 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-19T11:58:51.981 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:52.477 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-19T11:58:52.509 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:52.509 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:52.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:52.558+0000 7f9361c2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:52.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:52.562+0000 7f9361c2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:52.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:52.562+0000 7f9361c2f9c0 20 realm 2024-09-19T11:58:52.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:52.562+0000 7f9361c2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:52.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:52.562+0000 7f9361c2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:52.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:52.562+0000 7f9361c2f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:52.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:52.562+0000 7f9361c2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:52.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:52.562+0000 7f9361c2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:52.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:52.562+0000 7f9361c2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:52.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:52.562+0000 7f9361c2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:52.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:52.562+0000 7f9361c2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:52.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:52.566+0000 7f9361c2f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:52.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:52.566+0000 7f9361c2f9c0 20 searching for the correct realm 2024-09-19T11:58:52.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:52.570+0000 7f935ff36640 0 -- 172.21.15.120:0/96447448 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f93540da060 msgr2=0x7f93540d2040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:52.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:52.786+0000 7f935ef34640 0 -- 172.21.15.120:0/96447448 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f9350066330 msgr2=0x7f93500750c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:58:52.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.002+0000 7f9361c2f9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:52.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.002+0000 7f9361c2f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:52.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.002+0000 7f9361c2f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:52.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.002+0000 7f9361c2f9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:52.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.002+0000 7f9361c2f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:52.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.002+0000 7f9361c2f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:52.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.002+0000 7f9361c2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:52.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.002+0000 7f9361c2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:52.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.002+0000 7f9361c2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:53.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:53.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 20 zone default found 2024-09-19T11:58:53.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 4 Realm: () 2024-09-19T11:58:53.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:53.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:53.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:53.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 20 zonegroup default 2024-09-19T11:58:53.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 20 started sync module instance, tier type = 2024-09-19T11:58:53.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.006+0000 7f9361c2f9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:53.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.030+0000 7f9361c2f9c0 20 add_watcher() i=0 2024-09-19T11:58:53.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.030+0000 7f9361c2f9c0 20 add_watcher() i=1 2024-09-19T11:58:53.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.030+0000 7f9361c2f9c0 20 add_watcher() i=2 2024-09-19T11:58:53.026 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.030+0000 7f9361c2f9c0 20 add_watcher() i=3 2024-09-19T11:58:53.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.030+0000 7f9361c2f9c0 20 add_watcher() i=4 2024-09-19T11:58:53.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.030+0000 7f9361c2f9c0 20 add_watcher() i=5 2024-09-19T11:58:53.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.030+0000 7f9361c2f9c0 20 add_watcher() i=6 2024-09-19T11:58:53.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.034+0000 7f9361c2f9c0 20 add_watcher() i=7 2024-09-19T11:58:53.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.034+0000 7f9361c2f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:53.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.038+0000 7f9215fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:53.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.038+0000 7f9361c2f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:53.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.038+0000 7f9361c2f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:53.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.038+0000 7f9361c2f9c0 5 note: GC not initialized 2024-09-19T11:58:53.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.042+0000 7f9214fe1640 20 reqs_thread_entry: start 2024-09-19T11:58:53.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.042+0000 7f9361c2f9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:53.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.042+0000 7f9361c2f9c0 20 Filter name: none 2024-09-19T11:58:53.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.042+0000 7f918e7fc640 20 reqs_thread_entry: start 2024-09-19T11:58:53.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.042+0000 7f9361c2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.042+0000 7f9361c2f9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:53.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.042+0000 7f9361c2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.042+0000 7f9361c2f9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T11:58:53.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.042+0000 7f9361c2f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:53.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.042+0000 7f9361c2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.046+0000 7f9361c2f9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:53.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.046+0000 7f9361c2f9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.046+0000 7f9361c2f9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T11:58:53.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.046+0000 7f9361c2f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:53.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.046+0000 7f9215fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:53.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.050+0000 7f9361c2f9c0 20 remove_watcher() i=0 2024-09-19T11:58:53.046 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.050+0000 7f9361c2f9c0 2 removed watcher, disabling cache 2024-09-19T11:58:53.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.054+0000 7f9361c2f9c0 20 remove_watcher() i=1 2024-09-19T11:58:53.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.058+0000 7f9361c2f9c0 20 remove_watcher() i=2 2024-09-19T11:58:53.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.058+0000 7f9361c2f9c0 20 remove_watcher() i=3 2024-09-19T11:58:53.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.062+0000 7f9361c2f9c0 20 remove_watcher() i=4 2024-09-19T11:58:53.057 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.062+0000 7f9361c2f9c0 20 remove_watcher() i=5 2024-09-19T11:58:53.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.062+0000 7f9361c2f9c0 20 remove_watcher() i=6 2024-09-19T11:58:53.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.066+0000 7f9361c2f9c0 20 remove_watcher() i=7 2024-09-19T11:58:53.075 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:53.075 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:58:53.076 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-logrecord-writes id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:58:53.076 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:53.076 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-19T11:58:53.111 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:53.112 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:53.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.162+0000 7feae4a029c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.162+0000 7feae4a029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.162+0000 7feae4a029c0 20 realm 2024-09-19T11:58:53.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.162+0000 7feae4a029c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.162+0000 7feae4a029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.162+0000 7feae4a029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:53.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.162+0000 7feae4a029c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.162+0000 7feae4a029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.162+0000 7feae4a029c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.166+0000 7feae4a029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:53.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.166+0000 7feae4a029c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.166+0000 7feae4a029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:53.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.166+0000 7feae4a029c0 20 searching for the correct realm 2024-09-19T11:58:53.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.170+0000 7feae2d09640 0 -- 172.21.15.120:0/1784838396 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fead8008040 msgr2=0x7fead803d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:53.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.174+0000 7feae1d07640 0 -- 172.21.15.120:0/1784838396 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fead403c770 msgr2=0x7fead4066b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:53.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.390+0000 7feae4a029c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:53.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.390+0000 7feae4a029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:53.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.390+0000 7feae4a029c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:53.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.390+0000 7feae4a029c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:53.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.390+0000 7feae4a029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:53.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.390+0000 7feae4a029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:53.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.390+0000 7feae4a029c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.390+0000 7feae4a029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.390+0000 7feae4a029c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.388 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:53.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:53.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 20 zone default found 2024-09-19T11:58:53.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 4 Realm: () 2024-09-19T11:58:53.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:53.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:53.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:53.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 20 zonegroup default 2024-09-19T11:58:53.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 20 started sync module instance, tier type = 2024-09-19T11:58:53.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.394+0000 7feae4a029c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:53.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.422+0000 7feae4a029c0 20 add_watcher() i=0 2024-09-19T11:58:53.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.422+0000 7feae4a029c0 20 add_watcher() i=1 2024-09-19T11:58:53.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.422+0000 7feae4a029c0 20 add_watcher() i=2 2024-09-19T11:58:53.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.422+0000 7feae4a029c0 20 add_watcher() i=3 2024-09-19T11:58:53.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.422+0000 7feae4a029c0 20 add_watcher() i=4 2024-09-19T11:58:53.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.422+0000 7feae4a029c0 20 add_watcher() i=5 2024-09-19T11:58:53.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.422+0000 7feae4a029c0 20 add_watcher() i=6 2024-09-19T11:58:53.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.422+0000 7feae4a029c0 20 add_watcher() i=7 2024-09-19T11:58:53.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.422+0000 7feae4a029c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:53.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.426+0000 7fe998fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:53.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.426+0000 7feae4a029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:53.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.426+0000 7feae4a029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:53.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.426+0000 7feae4a029c0 5 note: GC not initialized 2024-09-19T11:58:53.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7fe9137fe640 20 reqs_thread_entry: start 2024-09-19T11:58:53.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7feae4a029c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:53.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7feae4a029c0 20 Filter name: none 2024-09-19T11:58:53.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7fe9117fa640 20 reqs_thread_entry: start 2024-09-19T11:58:53.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7feae4a029c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-19T11:58:53.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7feae4a029c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7feae4a029c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:53.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7feae4a029c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-19T11:58:53.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7feae4a029c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-19T11:58:53.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7feae4a029c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 : miss 2024-09-19T11:58:53.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7feae4a029c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7feae4a029c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T11:58:53.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7feae4a029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 info.flags=0x17 2024-09-19T11:58:53.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7feae4a029c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 to cache LRU end 2024-09-19T11:58:53.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7feae4a029c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:58:53.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7feae4a029c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:53.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.430+0000 7feae4a029c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 2024-09-19T11:58:53.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.442+0000 7feae4a029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 info.flags=0x17 2024-09-19T11:58:53.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.442+0000 7feae4a029c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 to cache LRU end 2024-09-19T11:58:53.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.442+0000 7feae4a029c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:53.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.442+0000 7feae4a029c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36, ofs0, ns] 2024-09-19T11:58:53.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.442+0000 7fe9c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366197 cookie 94694985123632 notifier 7205 bl.length()=1007 2024-09-19T11:58:53.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.442+0000 7fe9c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 info.flags=0x17 2024-09-19T11:58:53.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.442+0000 7fe9c5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 to cache LRU end 2024-09-19T11:58:53.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.442+0000 7fe9c5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:53.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.442+0000 7feae4a029c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): orig_sources= new_sources= 2024-09-19T11:58:53.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.442+0000 7feae4a029c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): potential sources added=[] removed=[] 2024-09-19T11:58:53.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.442+0000 7feae4a029c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): orig_dests= new_dests= 2024-09-19T11:58:53.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.442+0000 7feae4a029c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): potential dests added=[] removed=[] 2024-09-19T11:58:53.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.446+0000 7feae4a029c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-19T11:58:53.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.446+0000 7feae4a029c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-19T11:58:53.443 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.450+0000 7feae4a029c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 : hit (requested=0x17, cached=0x17) 2024-09-19T11:58:53.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.450+0000 7feae4a029c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 2024-09-19T11:58:53.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.454+0000 7feae4a029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 info.flags=0x17 2024-09-19T11:58:53.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.454+0000 7feae4a029c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 to cache LRU end 2024-09-19T11:58:53.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.454+0000 7feae4a029c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:53.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.454+0000 7feae4a029c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36, ofs0, ns] 2024-09-19T11:58:53.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.454+0000 7fe9c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366198 cookie 94694985123632 notifier 7205 bl.length()=975 2024-09-19T11:58:53.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.454+0000 7fe9c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 info.flags=0x17 2024-09-19T11:58:53.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.454+0000 7fe9c5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 to cache LRU end 2024-09-19T11:58:53.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.454+0000 7fe9c5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:53.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.454+0000 7feae4a029c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): orig_sources= new_sources= 2024-09-19T11:58:53.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.454+0000 7feae4a029c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): potential sources added=[] removed=[] 2024-09-19T11:58:53.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.454+0000 7feae4a029c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): orig_dests= new_dests= 2024-09-19T11:58:53.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.454+0000 7feae4a029c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): potential dests added=[] removed=[] 2024-09-19T11:58:53.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.458+0000 7fe998fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:53.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.462+0000 7feae4a029c0 20 remove_watcher() i=0 2024-09-19T11:58:53.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.462+0000 7feae4a029c0 2 removed watcher, disabling cache 2024-09-19T11:58:53.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.466+0000 7feae4a029c0 20 remove_watcher() i=1 2024-09-19T11:58:53.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.466+0000 7feae4a029c0 20 remove_watcher() i=2 2024-09-19T11:58:53.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.470+0000 7feae4a029c0 20 remove_watcher() i=3 2024-09-19T11:58:53.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.470+0000 7feae4a029c0 20 remove_watcher() i=4 2024-09-19T11:58:53.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.474+0000 7feae4a029c0 20 remove_watcher() i=5 2024-09-19T11:58:53.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.474+0000 7feae4a029c0 20 remove_watcher() i=6 2024-09-19T11:58:53.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.474+0000 7feae4a029c0 20 remove_watcher() i=7 2024-09-19T11:58:53.486 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-19T11:58:53.517 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:53.517 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:53.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.566+0000 7ff2ef18b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.570+0000 7ff2ef18b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.570+0000 7ff2ef18b9c0 20 realm 2024-09-19T11:58:53.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.570+0000 7ff2ef18b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.570+0000 7ff2ef18b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.570+0000 7ff2ef18b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:53.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.570+0000 7ff2ef18b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.570+0000 7ff2ef18b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.570+0000 7ff2ef18b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.570+0000 7ff2ef18b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:53.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.570+0000 7ff2ef18b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.574+0000 7ff2ef18b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:53.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.574+0000 7ff2ef18b9c0 20 searching for the correct realm 2024-09-19T11:58:53.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.574+0000 7ff2ecc91640 0 -- 172.21.15.120:0/4195915525 >> [v2:172.21.15.120:6824/1565558845,v1:172.21.15.120:6825/1565558845] conn(0x563e9ba397f0 msgr2=0x563e9ba3bcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:53.577 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.578+0000 7ff2ecc91640 0 -- 172.21.15.120:0/4195915525 >> [v2:172.21.15.120:6816/2362810278,v1:172.21.15.120:6817/2362810278] conn(0x563e9ba2d040 msgr2=0x563e9ba2f490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:53.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.590+0000 7ff2ef18b9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:53.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.590+0000 7ff2ef18b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:53.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.590+0000 7ff2ef18b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:53.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.590+0000 7ff2ef18b9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:53.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.590+0000 7ff2ef18b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:53.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.590+0000 7ff2ef18b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:53.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.590+0000 7ff2ef18b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.590+0000 7ff2ef18b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.590+0000 7ff2ef18b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:53.589 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:53.590 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 20 zone default found 2024-09-19T11:58:53.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 4 Realm: () 2024-09-19T11:58:53.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:53.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:53.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:53.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 20 zonegroup default 2024-09-19T11:58:53.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 20 started sync module instance, tier type = 2024-09-19T11:58:53.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.594+0000 7ff2ef18b9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:53.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.610+0000 7ff2ef18b9c0 20 add_watcher() i=0 2024-09-19T11:58:53.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.610+0000 7ff2ef18b9c0 20 add_watcher() i=1 2024-09-19T11:58:53.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.610+0000 7ff2ef18b9c0 20 add_watcher() i=2 2024-09-19T11:58:53.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.610+0000 7ff2ef18b9c0 20 add_watcher() i=3 2024-09-19T11:58:53.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.610+0000 7ff2ef18b9c0 20 add_watcher() i=4 2024-09-19T11:58:53.605 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.610+0000 7ff2ef18b9c0 20 add_watcher() i=5 2024-09-19T11:58:53.606 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.610+0000 7ff2ef18b9c0 20 add_watcher() i=6 2024-09-19T11:58:53.606 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.610+0000 7ff2ef18b9c0 20 add_watcher() i=7 2024-09-19T11:58:53.606 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.610+0000 7ff2ef18b9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:53.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.614+0000 7ff1a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:53.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.614+0000 7ff2ef18b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:53.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.614+0000 7ff2ef18b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:53.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.614+0000 7ff2ef18b9c0 5 note: GC not initialized 2024-09-19T11:58:53.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.614+0000 7ff1a1fe3640 20 reqs_thread_entry: start 2024-09-19T11:58:53.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.614+0000 7ff2ef18b9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:53.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.614+0000 7ff2ef18b9c0 20 Filter name: none 2024-09-19T11:58:53.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.614+0000 7ff1137fe640 20 reqs_thread_entry: start 2024-09-19T11:58:53.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.614+0000 7ff2ef18b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.614+0000 7ff2ef18b9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:53.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.614+0000 7ff2ef18b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.618+0000 7ff2ef18b9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T11:58:53.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.618+0000 7ff2ef18b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:53.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.618+0000 7ff2ef18b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.618+0000 7ff2ef18b9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:53.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.618+0000 7ff2ef18b9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.618+0000 7ff2ef18b9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T11:58:53.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.618+0000 7ff2ef18b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:53.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.618+0000 7ff1a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:53.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.626+0000 7ff2ef18b9c0 20 remove_watcher() i=0 2024-09-19T11:58:53.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.626+0000 7ff2ef18b9c0 2 removed watcher, disabling cache 2024-09-19T11:58:53.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.626+0000 7ff2ef18b9c0 20 remove_watcher() i=1 2024-09-19T11:58:53.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.630+0000 7ff2ef18b9c0 20 remove_watcher() i=2 2024-09-19T11:58:53.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.630+0000 7ff2ef18b9c0 20 remove_watcher() i=3 2024-09-19T11:58:53.628 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.634+0000 7ff2ef18b9c0 20 remove_watcher() i=4 2024-09-19T11:58:53.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.634+0000 7ff2ef18b9c0 20 remove_watcher() i=5 2024-09-19T11:58:53.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.634+0000 7ff2ef18b9c0 20 remove_watcher() i=6 2024-09-19T11:58:53.631 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.638+0000 7ff2ef18b9c0 20 remove_watcher() i=7 2024-09-19T11:58:53.645 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:53.645 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:58:53.645 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-logrecord-writes id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:58:53.645 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:53.704 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:58:53.739 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:53.739 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:53.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.790+0000 7f90ed6aa9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.790+0000 7f90ed6aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.790+0000 7f90ed6aa9c0 20 realm 2024-09-19T11:58:53.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.790+0000 7f90ed6aa9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.790+0000 7f90ed6aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.790+0000 7f90ed6aa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:53.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.790+0000 7f90ed6aa9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.790+0000 7f90ed6aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:53.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.790+0000 7f90ed6aa9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.787 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.794+0000 7f90ed6aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:53.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.794+0000 7f90ed6aa9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:53.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.794+0000 7f90ed6aa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:53.789 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.794+0000 7f90ed6aa9c0 20 searching for the correct realm 2024-09-19T11:58:53.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:53.798+0000 7f90eb9b1640 0 -- 172.21.15.120:0/3138244870 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f90e006db60 msgr2=0x7f90e00633e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:54.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.014+0000 7f90ea9af640 0 -- 172.21.15.120:0/3138244870 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f90dc0e6960 msgr2=0x7f90dc0e53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:54.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.230+0000 7f90ed6aa9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:54.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.230+0000 7f90ed6aa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:54.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.230+0000 7f90ed6aa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:54.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.230+0000 7f90ed6aa9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:54.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.230+0000 7f90ed6aa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:54.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.230+0000 7f90ed6aa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:54.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.230+0000 7f90ed6aa9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.230+0000 7f90ed6aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:54.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.230+0000 7f90ed6aa9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:54.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:54.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 20 zone default found 2024-09-19T11:58:54.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 4 Realm: () 2024-09-19T11:58:54.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:54.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:54.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:54.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 20 zonegroup default 2024-09-19T11:58:54.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:54.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:54.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:54.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 20 started sync module instance, tier type = 2024-09-19T11:58:54.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.234+0000 7f90ed6aa9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:54.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.258+0000 7f90ed6aa9c0 20 add_watcher() i=0 2024-09-19T11:58:54.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.258+0000 7f90ed6aa9c0 20 add_watcher() i=1 2024-09-19T11:58:54.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.258+0000 7f90ed6aa9c0 20 add_watcher() i=2 2024-09-19T11:58:54.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.258+0000 7f90ed6aa9c0 20 add_watcher() i=3 2024-09-19T11:58:54.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.258+0000 7f90ed6aa9c0 20 add_watcher() i=4 2024-09-19T11:58:54.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.258+0000 7f90ed6aa9c0 20 add_watcher() i=5 2024-09-19T11:58:54.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.258+0000 7f90ed6aa9c0 20 add_watcher() i=6 2024-09-19T11:58:54.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.262+0000 7f90ed6aa9c0 20 add_watcher() i=7 2024-09-19T11:58:54.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.262+0000 7f90ed6aa9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:54.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.266+0000 7f8fa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:54.262 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.266+0000 7f90ed6aa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:54.262 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.266+0000 7f90ed6aa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:54.262 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.266+0000 7f90ed6aa9c0 5 note: GC not initialized 2024-09-19T11:58:54.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.266+0000 7f8fa0fe1640 20 reqs_thread_entry: start 2024-09-19T11:58:54.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.266+0000 7f90ed6aa9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:54.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.270+0000 7f90ed6aa9c0 20 Filter name: none 2024-09-19T11:58:54.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.270+0000 7f8f1a7fc640 20 reqs_thread_entry: start 2024-09-19T11:58:54.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.270+0000 7f90ed6aa9c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-19T11:58:54.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.270+0000 7f90ed6aa9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.270+0000 7f90ed6aa9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:54.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.270+0000 7f90ed6aa9c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-19T11:58:54.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.270+0000 7f90ed6aa9c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-19T11:58:54.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.270+0000 7f90ed6aa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 : miss 2024-09-19T11:58:54.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.270+0000 7f90ed6aa9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.270+0000 7f90ed6aa9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T11:58:54.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.270+0000 7f90ed6aa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 info.flags=0x17 2024-09-19T11:58:54.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.270+0000 7f90ed6aa9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 to cache LRU end 2024-09-19T11:58:54.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.270+0000 7f90ed6aa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:58:54.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.270+0000 7f90ed6aa9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:54.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.270+0000 7f90ed6aa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 2024-09-19T11:58:54.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.278+0000 7f90ed6aa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 info.flags=0x17 2024-09-19T11:58:54.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.278+0000 7f90ed6aa9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 to cache LRU end 2024-09-19T11:58:54.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.278+0000 7f90ed6aa9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:54.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.278+0000 7f90ed6aa9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36, ofs0, ns] 2024-09-19T11:58:54.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.278+0000 7f8fceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366199 cookie 94777491556944 notifier 7238 bl.length()=1007 2024-09-19T11:58:54.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.278+0000 7f8fceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 info.flags=0x17 2024-09-19T11:58:54.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.278+0000 7f8fceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 to cache LRU end 2024-09-19T11:58:54.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.278+0000 7f8fceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:54.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.282+0000 7f90ed6aa9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): orig_sources= new_sources= 2024-09-19T11:58:54.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.282+0000 7f90ed6aa9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): potential sources added=[] removed=[] 2024-09-19T11:58:54.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.282+0000 7f90ed6aa9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): orig_dests= new_dests= 2024-09-19T11:58:54.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.282+0000 7f90ed6aa9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): potential dests added=[] removed=[] 2024-09-19T11:58:54.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.282+0000 7f90ed6aa9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36.1.0 2024-09-19T11:58:54.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.282+0000 7f90ed6aa9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36.1.0 2024-09-19T11:58:54.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.282+0000 7f90ed6aa9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36.1.1 2024-09-19T11:58:54.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.282+0000 7f90ed6aa9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36.1.1 2024-09-19T11:58:54.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.282+0000 7f90ed6aa9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36.0 2024-09-19T11:58:54.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.290+0000 7f90ed6aa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 : hit (requested=0x17, cached=0x17) 2024-09-19T11:58:54.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.290+0000 7f90ed6aa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 2024-09-19T11:58:54.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.290+0000 7f90ed6aa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 info.flags=0x17 2024-09-19T11:58:54.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.290+0000 7f90ed6aa9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 to cache LRU end 2024-09-19T11:58:54.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.290+0000 7f90ed6aa9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:54.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.290+0000 7f90ed6aa9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36, ofs0, ns] 2024-09-19T11:58:54.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.290+0000 7f8fceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366200 cookie 94777491556944 notifier 7238 bl.length()=1007 2024-09-19T11:58:54.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.290+0000 7f8fceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 info.flags=0x17 2024-09-19T11:58:54.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.290+0000 7f8fceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 to cache LRU end 2024-09-19T11:58:54.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.290+0000 7f8fceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:54.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.294+0000 7f90ed6aa9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): orig_sources= new_sources= 2024-09-19T11:58:54.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.294+0000 7f90ed6aa9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): potential sources added=[] removed=[] 2024-09-19T11:58:54.288 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.294+0000 7f90ed6aa9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): orig_dests= new_dests= 2024-09-19T11:58:54.288 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.294+0000 7f90ed6aa9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): potential dests added=[] removed=[] 2024-09-19T11:58:54.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.294+0000 7f90ed6aa9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36.0 2024-09-19T11:58:54.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.294+0000 7f90ed6aa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 : hit (requested=0x17, cached=0x17) 2024-09-19T11:58:54.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.294+0000 7f90ed6aa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 2024-09-19T11:58:54.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.298+0000 7f90ed6aa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 info.flags=0x17 2024-09-19T11:58:54.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.298+0000 7f90ed6aa9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 to cache LRU end 2024-09-19T11:58:54.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.298+0000 7f90ed6aa9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:54.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.298+0000 7f90ed6aa9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36, ofs0, ns] 2024-09-19T11:58:54.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.298+0000 7f8fce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366201 cookie 94777491556944 notifier 7238 bl.length()=975 2024-09-19T11:58:54.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.298+0000 7f8fce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 info.flags=0x17 2024-09-19T11:58:54.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.298+0000 7f8fce7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 to cache LRU end 2024-09-19T11:58:54.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.298+0000 7f8fce7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:54.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.298+0000 7f90ed6aa9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): orig_sources= new_sources= 2024-09-19T11:58:54.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.298+0000 7f90ed6aa9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): potential sources added=[] removed=[] 2024-09-19T11:58:54.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.298+0000 7f90ed6aa9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): orig_dests= new_dests= 2024-09-19T11:58:54.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.298+0000 7f90ed6aa9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36]): potential dests added=[] removed=[] 2024-09-19T11:58:54.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.302+0000 7f90ed6aa9c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-19T11:58:54.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.306+0000 7f8fa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:54.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.310+0000 7f90ed6aa9c0 20 remove_watcher() i=0 2024-09-19T11:58:54.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.310+0000 7f90ed6aa9c0 2 removed watcher, disabling cache 2024-09-19T11:58:54.308 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.314+0000 7f90ed6aa9c0 20 remove_watcher() i=1 2024-09-19T11:58:54.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.314+0000 7f90ed6aa9c0 20 remove_watcher() i=2 2024-09-19T11:58:54.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.318+0000 7f90ed6aa9c0 20 remove_watcher() i=3 2024-09-19T11:58:54.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.322+0000 7f90ed6aa9c0 20 remove_watcher() i=4 2024-09-19T11:58:54.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.322+0000 7f90ed6aa9c0 20 remove_watcher() i=5 2024-09-19T11:58:54.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.322+0000 7f90ed6aa9c0 20 remove_watcher() i=6 2024-09-19T11:58:54.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.326+0000 7f90ed6aa9c0 20 remove_watcher() i=7 2024-09-19T11:58:54.342 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-19T11:58:54.369 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:54.370 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:54.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.422+0000 7ff8e2d939c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.422+0000 7ff8e2d939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:54.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.422+0000 7ff8e2d939c0 20 realm 2024-09-19T11:58:54.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.422+0000 7ff8e2d939c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.422+0000 7ff8e2d939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:54.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.422+0000 7ff8e2d939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:54.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.422+0000 7ff8e2d939c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.422+0000 7ff8e2d939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:54.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.422+0000 7ff8e2d939c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.426+0000 7ff8e2d939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:54.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.426+0000 7ff8e2d939c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.426+0000 7ff8e2d939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:54.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.426+0000 7ff8e2d939c0 20 searching for the correct realm 2024-09-19T11:58:54.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.430+0000 7ff8e109a640 0 -- 172.21.15.120:0/1036635052 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7ff8d4048060 msgr2=0x7ff8d4036ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:54.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.438+0000 7ff8e0098640 0 -- 172.21.15.120:0/1036635052 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7ff8d0041920 msgr2=0x7ff8d000a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:54.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.654+0000 7ff8e2d939c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:54.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.654+0000 7ff8e2d939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:54.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.654+0000 7ff8e2d939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:54.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.654+0000 7ff8e2d939c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:54.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.654+0000 7ff8e2d939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:54.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.654+0000 7ff8e2d939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:54.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.654+0000 7ff8e2d939c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:54.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:54.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:54.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 20 zone default found 2024-09-19T11:58:54.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 4 Realm: () 2024-09-19T11:58:54.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:54.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:54.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:54.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 20 zonegroup default 2024-09-19T11:58:54.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:54.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:54.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.658+0000 7ff8e2d939c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.662+0000 7ff8e2d939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:54.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.662+0000 7ff8e2d939c0 20 started sync module instance, tier type = 2024-09-19T11:58:54.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.662+0000 7ff8e2d939c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:54.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.682+0000 7ff8e2d939c0 20 add_watcher() i=0 2024-09-19T11:58:54.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.682+0000 7ff8e2d939c0 20 add_watcher() i=1 2024-09-19T11:58:54.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.682+0000 7ff8e2d939c0 20 add_watcher() i=2 2024-09-19T11:58:54.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.682+0000 7ff8e2d939c0 20 add_watcher() i=3 2024-09-19T11:58:54.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.682+0000 7ff8e2d939c0 20 add_watcher() i=4 2024-09-19T11:58:54.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.682+0000 7ff8e2d939c0 20 add_watcher() i=5 2024-09-19T11:58:54.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.686+0000 7ff8e2d939c0 20 add_watcher() i=6 2024-09-19T11:58:54.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.686+0000 7ff8e2d939c0 20 add_watcher() i=7 2024-09-19T11:58:54.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.686+0000 7ff8e2d939c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:54.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.690+0000 7ff796fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:54.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.690+0000 7ff8e2d939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:54.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.690+0000 7ff8e2d939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:54.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.690+0000 7ff8e2d939c0 5 note: GC not initialized 2024-09-19T11:58:54.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.694+0000 7ff795fe3640 20 reqs_thread_entry: start 2024-09-19T11:58:54.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.694+0000 7ff8e2d939c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:54.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.694+0000 7ff8e2d939c0 20 Filter name: none 2024-09-19T11:58:54.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.694+0000 7ff7077fe640 20 reqs_thread_entry: start 2024-09-19T11:58:54.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.694+0000 7ff8e2d939c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.694+0000 7ff8e2d939c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:54.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.694+0000 7ff8e2d939c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.694+0000 7ff8e2d939c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T11:58:54.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.694+0000 7ff8e2d939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:54.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.694+0000 7ff8e2d939c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.698+0000 7ff8e2d939c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:54.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.698+0000 7ff8e2d939c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:54.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.698+0000 7ff8e2d939c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T11:58:54.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.698+0000 7ff8e2d939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:54.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.702+0000 7ff796fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:54.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.706+0000 7ff8e2d939c0 20 remove_watcher() i=0 2024-09-19T11:58:54.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.706+0000 7ff8e2d939c0 2 removed watcher, disabling cache 2024-09-19T11:58:54.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.706+0000 7ff8e2d939c0 20 remove_watcher() i=1 2024-09-19T11:58:54.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.710+0000 7ff8e2d939c0 20 remove_watcher() i=2 2024-09-19T11:58:54.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.710+0000 7ff8e2d939c0 20 remove_watcher() i=3 2024-09-19T11:58:54.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.714+0000 7ff8e2d939c0 20 remove_watcher() i=4 2024-09-19T11:58:54.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.714+0000 7ff8e2d939c0 20 remove_watcher() i=5 2024-09-19T11:58:54.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.718+0000 7ff8e2d939c0 20 remove_watcher() i=6 2024-09-19T11:58:54.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:54.718+0000 7ff8e2d939c0 20 remove_watcher() i=7 2024-09-19T11:58:54.735 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:54.735 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:58:54.735 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-logrecord-writes id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T11:58:54.735 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:54.827 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-19T11:58:54.827 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:55.309 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-19T11:58:55.340 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:55.340 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:55.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.394+0000 7fc0f7a3a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.394+0000 7fc0f7a3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:55.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.394+0000 7fc0f7a3a9c0 20 realm 2024-09-19T11:58:55.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.394+0000 7fc0f7a3a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.398+0000 7fc0f7a3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:55.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.398+0000 7fc0f7a3a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:55.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.398+0000 7fc0f7a3a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.398+0000 7fc0f7a3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:55.391 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.398+0000 7fc0f7a3a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.398+0000 7fc0f7a3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:55.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.398+0000 7fc0f7a3a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.398+0000 7fc0f7a3a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:55.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.398+0000 7fc0f7a3a9c0 20 searching for the correct realm 2024-09-19T11:58:55.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.402+0000 7fc0f5d41640 0 -- 172.21.15.120:0/1197083114 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fc0ec07ec20 msgr2=0x7fc0ec0634e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:55.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.410+0000 7fc0f4d3f640 0 -- 172.21.15.120:0/1197083114 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fc0e80c6040 msgr2=0x7fc0e80c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:55.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.626+0000 7fc0f7a3a9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:55.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.626+0000 7fc0f7a3a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:55.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.626+0000 7fc0f7a3a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:55.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.626+0000 7fc0f7a3a9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:55.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.626+0000 7fc0f7a3a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:55.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.626+0000 7fc0f7a3a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:55.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.626+0000 7fc0f7a3a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:55.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:55.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:55.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 20 zone default found 2024-09-19T11:58:55.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 4 Realm: () 2024-09-19T11:58:55.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:55.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:55.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:55.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 20 zonegroup default 2024-09-19T11:58:55.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:55.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:55.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:55.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 20 started sync module instance, tier type = 2024-09-19T11:58:55.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.630+0000 7fc0f7a3a9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:55.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.654+0000 7fc0f7a3a9c0 20 add_watcher() i=0 2024-09-19T11:58:55.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.654+0000 7fc0f7a3a9c0 20 add_watcher() i=1 2024-09-19T11:58:55.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.654+0000 7fc0f7a3a9c0 20 add_watcher() i=2 2024-09-19T11:58:55.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.654+0000 7fc0f7a3a9c0 20 add_watcher() i=3 2024-09-19T11:58:55.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.654+0000 7fc0f7a3a9c0 20 add_watcher() i=4 2024-09-19T11:58:55.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.654+0000 7fc0f7a3a9c0 20 add_watcher() i=5 2024-09-19T11:58:55.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.654+0000 7fc0f7a3a9c0 20 add_watcher() i=6 2024-09-19T11:58:55.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.658+0000 7fc0f7a3a9c0 20 add_watcher() i=7 2024-09-19T11:58:55.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.658+0000 7fc0f7a3a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:55.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.662+0000 7fbfabfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:55.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.662+0000 7fc0f7a3a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:55.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.662+0000 7fc0f7a3a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:55.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.662+0000 7fc0f7a3a9c0 5 note: GC not initialized 2024-09-19T11:58:55.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.662+0000 7fbfaafe5640 20 reqs_thread_entry: start 2024-09-19T11:58:55.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.662+0000 7fc0f7a3a9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:55.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.662+0000 7fc0f7a3a9c0 20 Filter name: none 2024-09-19T11:58:55.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.662+0000 7fbfa8fe1640 20 reqs_thread_entry: start 2024-09-19T11:58:55.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.662+0000 7fc0f7a3a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.666+0000 7fc0f7a3a9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:55.660 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.666+0000 7fc0f7a3a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.666+0000 7fc0f7a3a9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T11:58:55.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.666+0000 7fc0f7a3a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:55.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.666+0000 7fc0f7a3a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.666+0000 7fc0f7a3a9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:55.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.666+0000 7fc0f7a3a9c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.670+0000 7fc0f7a3a9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T11:58:55.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.670+0000 7fc0f7a3a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:55.665 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.670+0000 7fbfabfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:55.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.674+0000 7fc0f7a3a9c0 20 remove_watcher() i=0 2024-09-19T11:58:55.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.678+0000 7fc0f7a3a9c0 2 removed watcher, disabling cache 2024-09-19T11:58:55.673 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.678+0000 7fc0f7a3a9c0 20 remove_watcher() i=1 2024-09-19T11:58:55.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.678+0000 7fc0f7a3a9c0 20 remove_watcher() i=2 2024-09-19T11:58:55.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.682+0000 7fc0f7a3a9c0 20 remove_watcher() i=3 2024-09-19T11:58:55.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.686+0000 7fc0f7a3a9c0 20 remove_watcher() i=4 2024-09-19T11:58:55.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.686+0000 7fc0f7a3a9c0 20 remove_watcher() i=5 2024-09-19T11:58:55.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.686+0000 7fc0f7a3a9c0 20 remove_watcher() i=6 2024-09-19T11:58:55.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.690+0000 7fc0f7a3a9c0 20 remove_watcher() i=7 2024-09-19T11:58:55.699 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:55.699 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:58:55.699 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-logrecord-writes id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:58:55.699 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:55.699 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-19T11:58:55.733 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:55.733 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:55.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.782+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:55.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 realm 2024-09-19T11:58:55.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:55.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.786+0000 7efcd75c69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:55.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:55.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:55.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:55.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.790+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:55.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.790+0000 7efcd75c69c0 20 searching for the correct realm 2024-09-19T11:58:55.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:55.790+0000 7efcd58cd640 0 -- 172.21.15.120:0/2945258286 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7efcc0041040 msgr2=0x7efcc0072fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:56.000 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.006+0000 7efcd48cb640 0 -- 172.21.15.120:0/2945258286 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7efcd0109bd0 msgr2=0x7efcd01167f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:56.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:56.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:56.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:56.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:56.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:56.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:56.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.220 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.220 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.220 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:56.220 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.220 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:56.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 zone default found 2024-09-19T11:58:56.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 4 Realm: () 2024-09-19T11:58:56.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:56.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:56.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:56.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 zonegroup default 2024-09-19T11:58:56.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 started sync module instance, tier type = 2024-09-19T11:58:56.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:56.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=0 2024-09-19T11:58:56.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=1 2024-09-19T11:58:56.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=2 2024-09-19T11:58:56.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=3 2024-09-19T11:58:56.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=4 2024-09-19T11:58:56.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=5 2024-09-19T11:58:56.244 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=6 2024-09-19T11:58:56.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.250+0000 7efcd75c69c0 20 add_watcher() i=7 2024-09-19T11:58:56.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.250+0000 7efcd75c69c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:56.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.254+0000 7efb8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:56.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.254+0000 7efcd75c69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:56.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.254+0000 7efcd75c69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:56.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 note: GC not initialized 2024-09-19T11:58:56.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.254+0000 7efb8a7e4640 20 reqs_thread_entry: start 2024-09-19T11:58:56.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.254+0000 7efcd75c69c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:56.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.254+0000 7efcd75c69c0 20 Filter name: none 2024-09-19T11:58:56.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.254+0000 7efafbfff640 20 reqs_thread_entry: start 2024-09-19T11:58:56.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.254+0000 7efcd75c69c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-19T11:58:56.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.254+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.258+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:56.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-19T11:58:56.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-19T11:58:56.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 : miss 2024-09-19T11:58:56.251 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.258+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.258+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T11:58:56.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:58:56.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:58:56.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:58:56.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:56.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 2024-09-19T11:58:56.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.262+0000 7efcd75c69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:58:56.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.262+0000 7efcd75c69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:58:56.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.262+0000 7efcd75c69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:56.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.262+0000 7efcd75c69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37, ofs0, ns] 2024-09-19T11:58:56.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.266+0000 7efbb8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366167 cookie 94793395146688 notifier 7289 bl.length()=1007 2024-09-19T11:58:56.260 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.266+0000 7efbb8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:58:56.260 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.266+0000 7efbb8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:58:56.260 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.266+0000 7efbb8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:56.260 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.266+0000 7efcd75c69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): orig_sources= new_sources= 2024-09-19T11:58:56.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.266+0000 7efcd75c69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): potential sources added=[] removed=[] 2024-09-19T11:58:56.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.266+0000 7efcd75c69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): orig_dests= new_dests= 2024-09-19T11:58:56.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.266+0000 7efcd75c69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): potential dests added=[] removed=[] 2024-09-19T11:58:56.263 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efcd75c69c0 time 2024-09-19T11:58:56.270304+0000 2024-09-19T11:58:56.263 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:58:56.264 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:56.265 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efcdaea02eb] 2024-09-19T11:58:56.265 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efcdaea049f] 2024-09-19T11:58:56.265 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636cbf76271] 2024-09-19T11:58:56.265 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x141057c) [0x5636cc9c757c] 2024-09-19T11:58:56.265 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5636cbf860dd] 2024-09-19T11:58:56.265 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:58:56.265 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efcd9d06d90] 2024-09-19T11:58:56.265 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:58:56.265 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:58:56.265 INFO:tasks.workunit.client.0.smithi120.stderr:*** Caught signal (Aborted) ** 2024-09-19T11:58:56.265 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7efcd75c69c0 thread_name:radosgw-admin 2024-09-19T11:58:56.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.270+0000 7efcd75c69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efcd75c69c0 time 2024-09-19T11:58:56.270304+0000 2024-09-19T11:58:56.265 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:58:56.266 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.266 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:56.266 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efcdaea02eb] 2024-09-19T11:58:56.266 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efcdaea049f] 2024-09-19T11:58:56.266 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636cbf76271] 2024-09-19T11:58:56.266 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x141057c) [0x5636cc9c757c] 2024-09-19T11:58:56.266 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5636cbf860dd] 2024-09-19T11:58:56.266 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:58:56.266 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efcd9d06d90] 2024-09-19T11:58:56.266 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:58:56.266 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:58:56.266 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.284 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:56.284 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efcd9d1f520] 2024-09-19T11:58:56.284 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:58:56.284 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:58:56.284 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:58:56.284 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efcdaea0345] 2024-09-19T11:58:56.284 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efcdaea049f] 2024-09-19T11:58:56.284 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636cbf76271] 2024-09-19T11:58:56.284 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x141057c) [0x5636cc9c757c] 2024-09-19T11:58:56.284 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5636cbf860dd] 2024-09-19T11:58:56.285 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:58:56.285 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efcd9d06d90] 2024-09-19T11:58:56.285 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:58:56.285 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:58:56.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.270+0000 7efcd75c69c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:58:56.285 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7efcd75c69c0 thread_name:radosgw-admin 2024-09-19T11:58:56.285 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.285 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:56.285 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efcd9d1f520] 2024-09-19T11:58:56.285 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:58:56.285 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:58:56.285 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:58:56.285 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efcdaea0345] 2024-09-19T11:58:56.286 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efcdaea049f] 2024-09-19T11:58:56.286 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636cbf76271] 2024-09-19T11:58:56.286 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x141057c) [0x5636cc9c757c] 2024-09-19T11:58:56.286 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5636cbf860dd] 2024-09-19T11:58:56.286 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:58:56.286 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efcd9d06d90] 2024-09-19T11:58:56.286 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:58:56.286 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:58:56.286 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:58:56.286 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.286 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:58:56.286 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:58:55.758+0000 7efcd48cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.286 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:58:55.758+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.287 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:58:55.758+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.287 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:58:55.758+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.287 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:58:55.758+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.287 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:58:55.758+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.287 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:58:55.758+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.287 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:58:55.758+0000 7efcd50cc640 10 monclient(hunting): handle_auth_done global_id 7277 payload 274 2024-09-19T11:58:56.287 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:58:55.758+0000 7efcd50cc640 10 monclient: _finish_hunting 0 2024-09-19T11:58:56.287 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:58:55.758+0000 7efcd50cc640 1 monclient: found mon.noname-c 2024-09-19T11:58:56.287 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:58:55.758+0000 7efcd50cc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.287 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:58:55.758+0000 7efbc3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.287 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:58:55.758+0000 7efbc3606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:56.287 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:58:55.758+0000 7efbc3606640 10 monclient: dump: 2024-09-19T11:58:56.287 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.287 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.288 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.288 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.288 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.288 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.288 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.288 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.288 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.288 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.288 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:58:55.758+0000 7efbc3606640 10 monclient: _finish_auth 0 2024-09-19T11:58:56.288 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:58:55.758+0000 7efbc3606640 10 monclient: _check_auth_tickets 2024-09-19T11:58:56.288 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:58:55.758+0000 7efbc3606640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:56.288 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:58:55.758+0000 7efbc3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.289 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:58:55.762+0000 7efbc3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:56.289 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:58:55.762+0000 7efbc3606640 10 monclient: dump: 2024-09-19T11:58:56.289 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.289 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.289 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.289 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.289 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.289 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.289 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.289 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.289 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.289 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.289 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 monclient: authenticate success, global_id 7277 2024-09-19T11:58:56.289 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: get_monmap_and_config success 2024-09-19T11:58:56.290 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 4 set_mon_vals no callback set 2024-09-19T11:58:56.290 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: shutdown 2024-09-19T11:58:56.290 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 asok(0x5636ce746d90) unregister_commands rotate-key 2024-09-19T11:58:56.290 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: build_initial_monmap 2024-09-19T11:58:56.290 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:56.290 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: monmap: 2024-09-19T11:58:56.290 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:56.290 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:56.290 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:56.290 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:56.290 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:56.290 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.290 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:56.290 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:56.290 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:56.291 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.291 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding auth protocol: cephx 2024-09-19T11:58:56.291 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding auth protocol: cephx 2024-09-19T11:58:56.291 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding auth protocol: cephx 2024-09-19T11:58:56.291 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: secure 2024-09-19T11:58:56.291 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: crc 2024-09-19T11:58:56.291 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: secure 2024-09-19T11:58:56.291 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: crc 2024-09-19T11:58:56.291 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: secure 2024-09-19T11:58:56.291 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: crc 2024-09-19T11:58:56.291 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: crc 2024-09-19T11:58:56.291 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: secure 2024-09-19T11:58:56.291 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: crc 2024-09-19T11:58:56.291 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: secure 2024-09-19T11:58:56.292 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: crc 2024-09-19T11:58:56.292 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: secure 2024-09-19T11:58:56.292 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.292 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 1 librados: starting msgr at 2024-09-19T11:58:56.292 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 1 librados: starting objecter 2024-09-19T11:58:56.292 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command objecter_requests hook 0x5636ce955e40 2024-09-19T11:58:56.292 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 1 librados: setting wanted keys 2024-09-19T11:58:56.292 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 1 librados: calling monclient init 2024-09-19T11:58:56.292 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: init 2024-09-19T11:58:56.292 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding auth protocol: cephx 2024-09-19T11:58:56.292 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding auth protocol: cephx 2024-09-19T11:58:56.292 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding auth protocol: cephx 2024-09-19T11:58:56.292 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: secure 2024-09-19T11:58:56.292 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: crc 2024-09-19T11:58:56.293 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: secure 2024-09-19T11:58:56.293 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: crc 2024-09-19T11:58:56.293 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: secure 2024-09-19T11:58:56.293 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: crc 2024-09-19T11:58:56.293 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: crc 2024-09-19T11:58:56.293 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: secure 2024-09-19T11:58:56.293 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: crc 2024-09-19T11:58:56.293 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: secure 2024-09-19T11:58:56.293 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: crc 2024-09-19T11:58:56.293 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: secure 2024-09-19T11:58:56.293 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.294 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.294 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command rotate-key hook 0x5636ce954108 2024-09-19T11:58:56.294 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:56.294 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T11:58:56.294 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-b con 0x5636ce7e0500 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:56.294 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-a con 0x5636ce80c330 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:56.294 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-c con 0x5636ce80c740 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:56.294 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.294 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.294 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.294 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:56.294 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): authenticate will time out at 2430.078131s 2024-09-19T11:58:56.294 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:58:55.762+0000 7efcd58cd640 10 monclient(hunting): get_auth_request con 0x5636ce80c740 auth_method 0 2024-09-19T11:58:56.294 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:58:55.762+0000 7efcd58cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.295 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:58:55.762+0000 7efcd58cd640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.295 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:58:55.762+0000 7efcd58cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.295 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): get_auth_request con 0x5636ce80c330 auth_method 0 2024-09-19T11:58:56.295 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.295 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.295 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.295 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:58:55.762+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.295 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:58:55.762+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.295 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:58:55.762+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.295 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.295 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.295 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.296 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): handle_auth_done global_id 7821 payload 824 2024-09-19T11:58:56.296 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient: _finish_hunting 0 2024-09-19T11:58:56.296 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:58:55.762+0000 7efcd48cb640 1 monclient: found mon.noname-a 2024-09-19T11:58:56.296 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:58:56.296 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.296 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:58:56.296 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: dump: 2024-09-19T11:58:56.296 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.296 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.296 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.296 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.296 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.296 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.296 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.297 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.297 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.297 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.297 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: _finish_auth 0 2024-09-19T11:58:56.297 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: _check_auth_tickets 2024-09-19T11:58:56.297 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:56.297 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.297 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:58:56.297 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: dump: 2024-09-19T11:58:56.297 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.297 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.297 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.297 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.297 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.298 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.298 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.298 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.298 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.298 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.298 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:58:55.762+0000 7efbc3606640 4 set_mon_vals no callback set 2024-09-19T11:58:56.298 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 monclient: authenticate success, global_id 7821 2024-09-19T11:58:56.298 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: _renew_subs 2024-09-19T11:58:56.298 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:58:56.298 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: _renew_subs 2024-09-19T11:58:56.298 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:58:56.298 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 1 librados: init done 2024-09-19T11:58:56.298 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:58:55.766+0000 7efbc1e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:58:56.298 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:58:55.766+0000 7efbc1e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:56.299 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:58:55.766+0000 7efbc1e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:56.299 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:58:55.766+0000 7efcd50cc640 10 monclient: get_auth_request con 0x7efbbc071be0 auth_method 0 2024-09-19T11:58:56.299 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:58:55.766+0000 7efcd58cd640 10 monclient: get_auth_request con 0x5636ce9774f0 auth_method 0 2024-09-19T11:58:56.299 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:58:55.766+0000 7efcd50cc640 10 monclient: get_auth_request con 0x5636ce99f0b0 auth_method 0 2024-09-19T11:58:56.299 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:58:55.770+0000 7efcd48cb640 10 monclient: get_auth_request con 0x5636ce9a3520 auth_method 0 2024-09-19T11:58:56.299 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:58:55.770+0000 7efcd58cd640 10 monclient: get_auth_request con 0x5636ce9a2970 auth_method 0 2024-09-19T11:58:56.299 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 10 monclient: build_initial_monmap 2024-09-19T11:58:56.299 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:56.299 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 10 monclient: monmap: 2024-09-19T11:58:56.299 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:56.299 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:56.299 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:56.299 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:56.299 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:56.300 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.300 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:56.300 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:56.300 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:56.300 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.300 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding auth protocol: cephx 2024-09-19T11:58:56.300 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding auth protocol: cephx 2024-09-19T11:58:56.300 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding auth protocol: cephx 2024-09-19T11:58:56.300 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: secure 2024-09-19T11:58:56.300 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: crc 2024-09-19T11:58:56.300 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: secure 2024-09-19T11:58:56.300 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: crc 2024-09-19T11:58:56.300 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: secure 2024-09-19T11:58:56.300 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: crc 2024-09-19T11:58:56.301 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: crc 2024-09-19T11:58:56.301 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: secure 2024-09-19T11:58:56.301 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: crc 2024-09-19T11:58:56.301 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: secure 2024-09-19T11:58:56.301 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: crc 2024-09-19T11:58:56.301 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: secure 2024-09-19T11:58:56.301 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.301 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command objecter_requests cmddesc objecter_requests hook 0x5636ce9af0b0 EEXIST 2024-09-19T11:58:56.301 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 10 monclient: init 2024-09-19T11:58:56.301 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding auth protocol: cephx 2024-09-19T11:58:56.301 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding auth protocol: cephx 2024-09-19T11:58:56.301 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding auth protocol: cephx 2024-09-19T11:58:56.301 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: secure 2024-09-19T11:58:56.301 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: crc 2024-09-19T11:58:56.302 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: secure 2024-09-19T11:58:56.302 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: crc 2024-09-19T11:58:56.302 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: secure 2024-09-19T11:58:56.302 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: crc 2024-09-19T11:58:56.302 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: crc 2024-09-19T11:58:56.302 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: secure 2024-09-19T11:58:56.302 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: crc 2024-09-19T11:58:56.302 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: secure 2024-09-19T11:58:56.302 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: crc 2024-09-19T11:58:56.302 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: secure 2024-09-19T11:58:56.302 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.302 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.302 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command rotate-key cmddesc rotate-key hook 0x5636ce9aa750 EEXIST 2024-09-19T11:58:56.302 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:56.303 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T11:58:56.303 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-c con 0x5636ce9d3260 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:56.303 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-a con 0x5636ce9d2b90 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:56.303 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-b con 0x5636ce9d1570 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:56.303 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.303 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.303 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.303 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:56.303 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): authenticate will time out at 2430.088516s 2024-09-19T11:58:56.303 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:58:55.774+0000 7efcd58cd640 10 monclient(hunting): get_auth_request con 0x5636ce9d2b90 auth_method 0 2024-09-19T11:58:56.303 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:58:55.774+0000 7efcd58cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.303 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:58:55.774+0000 7efcd58cd640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.303 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:58:55.774+0000 7efcd58cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.303 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): get_auth_request con 0x5636ce9d3260 auth_method 0 2024-09-19T11:58:56.303 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.304 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.304 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.304 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.304 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.304 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.304 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:58:55.774+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.304 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:58:55.774+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.304 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:58:55.774+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.304 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:58:55.774+0000 7efcd50cc640 10 monclient(hunting): get_auth_request con 0x5636ce9d1570 auth_method 0 2024-09-19T11:58:56.304 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:58:55.774+0000 7efcd50cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.304 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:58:55.774+0000 7efcd50cc640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.304 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:58:55.774+0000 7efcd50cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.304 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): handle_auth_done global_id 7283 payload 824 2024-09-19T11:58:56.304 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient: _finish_hunting 0 2024-09-19T11:58:56.305 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:58:55.774+0000 7efcd48cb640 1 monclient: found mon.noname-c 2024-09-19T11:58:56.305 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.305 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.305 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:56.305 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: dump: 2024-09-19T11:58:56.305 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.305 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.305 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.305 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.305 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.305 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.305 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.305 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.305 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.306 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.306 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: _finish_auth 0 2024-09-19T11:58:56.306 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: _check_auth_tickets 2024-09-19T11:58:56.306 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:56.306 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.306 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:56.306 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: dump: 2024-09-19T11:58:56.306 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.306 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.306 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.306 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.306 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.306 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.306 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.307 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.307 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.307 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.307 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:58:55.774+0000 7efcd60ce640 4 set_mon_vals no callback set 2024-09-19T11:58:56.307 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 5 monclient: authenticate success, global_id 7283 2024-09-19T11:58:56.307 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient: _renew_subs 2024-09-19T11:58:56.307 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.307 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient: _renew_subs 2024-09-19T11:58:56.307 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.307 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:58:55.774+0000 7efbbaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:58:56.307 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:58:55.774+0000 7efbbaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:56.307 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:58:55.774+0000 7efbbaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:56.307 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: get_monmap_and_config 2024-09-19T11:58:56.307 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: build_initial_monmap 2024-09-19T11:58:56.308 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:56.308 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: monmap: 2024-09-19T11:58:56.308 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:56.308 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:56.308 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:56.308 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:56.308 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:56.308 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.308 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:56.308 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:56.308 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:56.308 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.308 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding auth protocol: cephx 2024-09-19T11:58:56.308 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding auth protocol: cephx 2024-09-19T11:58:56.309 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding auth protocol: cephx 2024-09-19T11:58:56.309 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: secure 2024-09-19T11:58:56.309 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: crc 2024-09-19T11:58:56.309 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: secure 2024-09-19T11:58:56.309 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: crc 2024-09-19T11:58:56.309 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: secure 2024-09-19T11:58:56.309 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: crc 2024-09-19T11:58:56.309 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: crc 2024-09-19T11:58:56.309 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: secure 2024-09-19T11:58:56.309 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: crc 2024-09-19T11:58:56.309 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: secure 2024-09-19T11:58:56.309 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: crc 2024-09-19T11:58:56.309 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: secure 2024-09-19T11:58:56.309 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient: get_auth_request con 0x7efbb0071b20 auth_method 0 2024-09-19T11:58:56.309 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.310 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: init 2024-09-19T11:58:56.310 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding auth protocol: cephx 2024-09-19T11:58:56.310 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding auth protocol: cephx 2024-09-19T11:58:56.310 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding auth protocol: cephx 2024-09-19T11:58:56.310 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: secure 2024-09-19T11:58:56.310 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: crc 2024-09-19T11:58:56.310 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: secure 2024-09-19T11:58:56.310 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: crc 2024-09-19T11:58:56.310 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: secure 2024-09-19T11:58:56.310 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: crc 2024-09-19T11:58:56.310 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: crc 2024-09-19T11:58:56.310 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: secure 2024-09-19T11:58:56.310 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: crc 2024-09-19T11:58:56.310 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: secure 2024-09-19T11:58:56.310 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: crc 2024-09-19T11:58:56.311 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: secure 2024-09-19T11:58:56.311 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.311 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.311 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command rotate-key cmddesc rotate-key hook 0x7ffe221f5e28 EEXIST 2024-09-19T11:58:56.311 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:56.311 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T11:58:56.311 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-b con 0x5636cea27150 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:56.311 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-c con 0x5636cea21370 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:56.311 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-a con 0x5636cea225b0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:56.311 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.311 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.311 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.311 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:56.312 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): authenticate will time out at 2430.093132s 2024-09-19T11:58:56.312 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): get_auth_request con 0x5636cea21370 auth_method 0 2024-09-19T11:58:56.312 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.312 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.312 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.312 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): get_auth_request con 0x5636cea225b0 auth_method 0 2024-09-19T11:58:56.312 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.312 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.312 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.312 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.312 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.312 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.312 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.312 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.313 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.313 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): handle_auth_done global_id 7286 payload 274 2024-09-19T11:58:56.313 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient: _finish_hunting 0 2024-09-19T11:58:56.313 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:58:55.778+0000 7efcd58cd640 1 monclient: found mon.noname-c 2024-09-19T11:58:56.313 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.313 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.313 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:56.313 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: dump: 2024-09-19T11:58:56.313 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.313 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.313 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.313 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.313 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.313 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.314 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.314 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.314 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.314 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.314 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: _finish_auth 0 2024-09-19T11:58:56.314 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: _check_auth_tickets 2024-09-19T11:58:56.314 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:56.314 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.314 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:56.314 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: dump: 2024-09-19T11:58:56.314 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.314 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.314 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.314 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.315 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.315 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.315 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.315 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.315 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.315 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.315 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 monclient: authenticate success, global_id 7286 2024-09-19T11:58:56.315 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: get_monmap_and_config success 2024-09-19T11:58:56.315 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 4 set_mon_vals no callback set 2024-09-19T11:58:56.315 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: shutdown 2024-09-19T11:58:56.315 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: build_initial_monmap 2024-09-19T11:58:56.315 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:56.315 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: monmap: 2024-09-19T11:58:56.315 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:56.315 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:56.316 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:56.316 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:56.316 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:56.316 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.316 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:56.316 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:56.316 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:56.316 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.316 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding auth protocol: cephx 2024-09-19T11:58:56.317 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding auth protocol: cephx 2024-09-19T11:58:56.317 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding auth protocol: cephx 2024-09-19T11:58:56.317 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: secure 2024-09-19T11:58:56.317 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: crc 2024-09-19T11:58:56.317 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: secure 2024-09-19T11:58:56.317 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: crc 2024-09-19T11:58:56.317 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: secure 2024-09-19T11:58:56.317 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: crc 2024-09-19T11:58:56.317 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: crc 2024-09-19T11:58:56.317 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: secure 2024-09-19T11:58:56.317 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: crc 2024-09-19T11:58:56.317 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: secure 2024-09-19T11:58:56.317 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: crc 2024-09-19T11:58:56.317 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: secure 2024-09-19T11:58:56.318 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.318 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 1 librados: starting msgr at 2024-09-19T11:58:56.318 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 1 librados: starting objecter 2024-09-19T11:58:56.318 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command objecter_requests cmddesc objecter_requests hook 0x5636cea212a0 EEXIST 2024-09-19T11:58:56.318 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 1 librados: setting wanted keys 2024-09-19T11:58:56.318 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 1 librados: calling monclient init 2024-09-19T11:58:56.318 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: init 2024-09-19T11:58:56.318 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding auth protocol: cephx 2024-09-19T11:58:56.318 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding auth protocol: cephx 2024-09-19T11:58:56.318 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding auth protocol: cephx 2024-09-19T11:58:56.318 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: secure 2024-09-19T11:58:56.318 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: crc 2024-09-19T11:58:56.318 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: secure 2024-09-19T11:58:56.318 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: crc 2024-09-19T11:58:56.319 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: secure 2024-09-19T11:58:56.319 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: crc 2024-09-19T11:58:56.319 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: crc 2024-09-19T11:58:56.319 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: secure 2024-09-19T11:58:56.319 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: crc 2024-09-19T11:58:56.319 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: secure 2024-09-19T11:58:56.319 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: crc 2024-09-19T11:58:56.319 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: secure 2024-09-19T11:58:56.319 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.319 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.319 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command rotate-key cmddesc rotate-key hook 0x5636ce9d51c8 EEXIST 2024-09-19T11:58:56.319 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:56.319 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T11:58:56.319 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-a con 0x5636cea21370 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:56.320 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-b con 0x5636cea225b0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:56.320 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-c con 0x5636cea27150 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:56.320 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.320 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.320 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.320 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:56.320 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): authenticate will time out at 2430.095812s 2024-09-19T11:58:56.320 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): get_auth_request con 0x5636cea27150 auth_method 0 2024-09-19T11:58:56.320 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.320 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.320 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.320 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:58:55.778+0000 7efcd48cb640 10 monclient(hunting): get_auth_request con 0x5636cea21370 auth_method 0 2024-09-19T11:58:56.320 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:58:55.778+0000 7efcd48cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.320 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:58:55.778+0000 7efcd48cb640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.321 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:58:55.778+0000 7efcd48cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.321 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:58:55.782+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.321 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:58:55.782+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.321 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:58:55.782+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.321 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:58:55.782+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.321 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:58:55.782+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.321 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:58:55.782+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.321 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:58:55.782+0000 7efcd50cc640 10 monclient(hunting): handle_auth_done global_id 7289 payload 824 2024-09-19T11:58:56.321 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:58:55.782+0000 7efcd50cc640 10 monclient: _finish_hunting 0 2024-09-19T11:58:56.321 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:58:55.782+0000 7efcd50cc640 1 monclient: found mon.noname-c 2024-09-19T11:58:56.321 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:58:55.782+0000 7efcd50cc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.321 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.321 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:56.321 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: dump: 2024-09-19T11:58:56.322 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.322 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.322 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.322 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.322 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.322 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.322 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.322 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.322 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.322 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.322 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: _finish_auth 0 2024-09-19T11:58:56.322 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: _check_auth_tickets 2024-09-19T11:58:56.322 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:56.322 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.323 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:56.323 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: dump: 2024-09-19T11:58:56.323 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.323 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.323 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.323 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.323 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.323 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.323 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.323 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.323 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.323 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.323 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:58:55.782+0000 7efbb8ff9640 4 set_mon_vals no callback set 2024-09-19T11:58:56.323 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 5 monclient: authenticate success, global_id 7289 2024-09-19T11:58:56.324 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 10 monclient: _renew_subs 2024-09-19T11:58:56.324 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.324 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 10 monclient: _renew_subs 2024-09-19T11:58:56.324 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.324 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 1 librados: init done 2024-09-19T11:58:56.324 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command cr dump hook 0x5636cea15788 2024-09-19T11:58:56.324 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.324 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:58:55.782+0000 7efba6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:58:56.324 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:58:55.782+0000 7efba6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:56.324 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:58:55.782+0000 7efba6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:56.324 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:58:55.782+0000 7efcd58cd640 10 monclient: get_auth_request con 0x5636cea40a90 auth_method 0 2024-09-19T11:58:56.324 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:58:55.782+0000 7efcd48cb640 10 monclient: get_auth_request con 0x7efba0071be0 auth_method 0 2024-09-19T11:58:56.324 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.324 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 realm 2024-09-19T11:58:56.325 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.325 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.325 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:56.325 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.325 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.325 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.325 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:58:55.786+0000 7efcd48cb640 10 monclient: get_auth_request con 0x5636cea44e20 auth_method 0 2024-09-19T11:58:56.325 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:56.325 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.325 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:58:55.786+0000 7efcd58cd640 10 monclient: get_auth_request con 0x5636cea48540 auth_method 0 2024-09-19T11:58:56.325 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:58:55.790+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:56.325 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:58:55.790+0000 7efcd75c69c0 20 searching for the correct realm 2024-09-19T11:58:56.325 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:58:55.790+0000 7efcd50cc640 10 monclient: get_auth_request con 0x5636cea4d210 auth_method 0 2024-09-19T11:58:56.325 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:58:55.790+0000 7efcd48cb640 10 monclient: get_auth_request con 0x7efcd00cf040 auth_method 0 2024-09-19T11:58:56.326 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:58:55.790+0000 7efcd58cd640 10 monclient: get_auth_request con 0x7efcc0041040 auth_method 0 2024-09-19T11:58:56.326 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:58:55.790+0000 7efcd58cd640 0 -- 172.21.15.120:0/2945258286 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7efcc0041040 msgr2=0x7efcc0072fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:56.326 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:58:55.994+0000 7efcd58cd640 10 monclient: get_auth_request con 0x7efcc0041040 auth_method 0 2024-09-19T11:58:56.326 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:58:55.994+0000 7efcd50cc640 10 monclient: get_auth_request con 0x7efcc8043450 auth_method 0 2024-09-19T11:58:56.326 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:58:56.006+0000 7efcd48cb640 0 -- 172.21.15.120:0/2945258286 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7efcd0109bd0 msgr2=0x7efcd01167f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:56.326 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:58:56.210+0000 7efcd48cb640 10 monclient: get_auth_request con 0x7efcd0109bd0 auth_method 0 2024-09-19T11:58:56.326 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:56.326 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:56.326 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:56.326 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:56.326 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:56.326 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:56.326 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.326 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.327 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.327 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:56.327 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.327 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:56.327 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 zone default found 2024-09-19T11:58:56.327 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 4 Realm: () 2024-09-19T11:58:56.327 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:56.327 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:56.327 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:56.327 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 zonegroup default 2024-09-19T11:58:56.327 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.327 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.327 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.327 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.328 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.328 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.328 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 started sync module instance, tier type = 2024-09-19T11:58:56.328 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:56.328 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=0 2024-09-19T11:58:56.328 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=1 2024-09-19T11:58:56.328 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=2 2024-09-19T11:58:56.328 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=3 2024-09-19T11:58:56.328 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=4 2024-09-19T11:58:56.329 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=5 2024-09-19T11:58:56.329 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=6 2024-09-19T11:58:56.329 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:58:56.250+0000 7efcd75c69c0 20 add_watcher() i=7 2024-09-19T11:58:56.329 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:58:56.250+0000 7efcd75c69c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:56.329 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding auth protocol: cephx 2024-09-19T11:58:56.329 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding auth protocol: cephx 2024-09-19T11:58:56.329 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding auth protocol: cephx 2024-09-19T11:58:56.329 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: secure 2024-09-19T11:58:56.329 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: crc 2024-09-19T11:58:56.329 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: secure 2024-09-19T11:58:56.329 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: crc 2024-09-19T11:58:56.330 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: secure 2024-09-19T11:58:56.330 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: crc 2024-09-19T11:58:56.330 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: crc 2024-09-19T11:58:56.330 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: secure 2024-09-19T11:58:56.330 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: crc 2024-09-19T11:58:56.330 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: secure 2024-09-19T11:58:56.330 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: crc 2024-09-19T11:58:56.330 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: secure 2024-09-19T11:58:56.330 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:58:56.254+0000 7efb8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:56.330 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.330 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:56.330 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:56.330 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command cache list hook 0x5636cea20620 2024-09-19T11:58:56.330 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command cache inspect hook 0x5636cea20620 2024-09-19T11:58:56.331 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command cache erase hook 0x5636cea20620 2024-09-19T11:58:56.331 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command cache zap hook 0x5636cea20620 2024-09-19T11:58:56.331 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 note: GC not initialized 2024-09-19T11:58:56.331 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:58:56.254+0000 7efb8a7e4640 20 reqs_thread_entry: start 2024-09-19T11:58:56.331 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command sync trace show hook 0x7efcc800a950 2024-09-19T11:58:56.331 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command sync trace history hook 0x7efcc800a950 2024-09-19T11:58:56.331 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command sync trace active hook 0x7efcc800a950 2024-09-19T11:58:56.331 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command sync trace active_short hook 0x7efcc800a950 2024-09-19T11:58:56.331 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:56.331 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 20 Filter name: none 2024-09-19T11:58:56.331 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:58:56.254+0000 7efafbfff640 20 reqs_thread_entry: start 2024-09-19T11:58:56.331 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-19T11:58:56.331 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.332 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:56.332 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-19T11:58:56.332 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-19T11:58:56.332 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 : miss 2024-09-19T11:58:56.332 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.332 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T11:58:56.332 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:58:56.332 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:58:56.332 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:58:56.332 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:56.332 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 2024-09-19T11:58:56.332 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:58:56.262+0000 7efcd75c69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:58:56.332 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:58:56.262+0000 7efcd75c69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:58:56.332 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:58:56.262+0000 7efcd75c69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:56.333 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:58:56.262+0000 7efcd75c69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37, ofs0, ns] 2024-09-19T11:58:56.333 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:58:56.266+0000 7efbb8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366167 cookie 94793395146688 notifier 7289 bl.length()=1007 2024-09-19T11:58:56.333 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:58:56.266+0000 7efbb8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:58:56.333 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:58:56.266+0000 7efbb8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:58:56.333 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:58:56.266+0000 7efbb8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:56.333 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:58:56.266+0000 7efcd75c69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): orig_sources= new_sources= 2024-09-19T11:58:56.333 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:58:56.266+0000 7efcd75c69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): potential sources added=[] removed=[] 2024-09-19T11:58:56.333 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:58:56.266+0000 7efcd75c69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): orig_dests= new_dests= 2024-09-19T11:58:56.333 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:58:56.266+0000 7efcd75c69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): potential dests added=[] removed=[] 2024-09-19T11:58:56.333 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:58:56.270+0000 7efcd75c69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efcd75c69c0 time 2024-09-19T11:58:56.270304+0000 2024-09-19T11:58:56.333 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:58:56.333 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.333 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:56.334 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efcdaea02eb] 2024-09-19T11:58:56.334 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efcdaea049f] 2024-09-19T11:58:56.334 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636cbf76271] 2024-09-19T11:58:56.334 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x141057c) [0x5636cc9c757c] 2024-09-19T11:58:56.334 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5636cbf860dd] 2024-09-19T11:58:56.334 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:58:56.334 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efcd9d06d90] 2024-09-19T11:58:56.334 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:58:56.334 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:58:56.334 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.334 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:58:56.270+0000 7efcd75c69c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:58:56.334 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7efcd75c69c0 thread_name:radosgw-admin 2024-09-19T11:58:56.334 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.334 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:56.334 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efcd9d1f520] 2024-09-19T11:58:56.335 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:58:56.335 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:58:56.335 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:58:56.335 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efcdaea0345] 2024-09-19T11:58:56.335 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efcdaea049f] 2024-09-19T11:58:56.335 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636cbf76271] 2024-09-19T11:58:56.335 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x141057c) [0x5636cc9c757c] 2024-09-19T11:58:56.335 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5636cbf860dd] 2024-09-19T11:58:56.335 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:58:56.335 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efcd9d06d90] 2024-09-19T11:58:56.335 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:58:56.335 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:58:56.335 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:58:56.335 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.336 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:58:56.336 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:58:56.336 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:58:56.336 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:58:56.336 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:58:56.336 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:58:56.336 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:58:56.336 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:58:56.336 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:58:56.336 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:58:56.336 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:58:56.336 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:58:56.336 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:58:56.336 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:58:56.337 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:58:56.337 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:58:56.337 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:58:56.337 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:58:56.337 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:58:56.337 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:58:56.337 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:58:56.337 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:58:56.337 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:58:56.337 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:58:56.337 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:58:56.337 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:58:56.337 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:58:56.337 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:58:56.337 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:58:56.338 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:58:56.338 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:58:56.338 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:58:56.338 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:58:56.338 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:58:56.338 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:58:56.338 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:58:56.338 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:58:56.338 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:58:56.338 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:58:56.338 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:58:56.338 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:58:56.338 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:58:56.338 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:58:56.339 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:58:56.339 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:58:56.339 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:58:56.339 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:58:56.339 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:58:56.339 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:58:56.339 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:58:56.339 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:58:56.339 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:58:56.339 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:58:56.339 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:58:56.339 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:58:56.339 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:58:56.339 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:58:56.340 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:58:56.340 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:58:56.340 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:58:56.340 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:58:56.340 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:58:56.340 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:58:56.340 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:58:56.340 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:58:56.340 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:58:56.340 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:58:56.340 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:58:56.340 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:58:56.340 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:58:56.340 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:58:56.341 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:58:56.341 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:58:56.341 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:58:56.341 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:58:56.341 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:58:56.341 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:58:56.341 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:58:56.341 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:58:56.341 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:58:56.341 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:58:56.341 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:58:56.341 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:58:56.341 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:58:56.341 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:58:56.342 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:58:56.342 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:58:56.342 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:58:56.342 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:58:56.342 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:58:56.342 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:58:56.342 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:58:56.342 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:58:56.342 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:58:56.342 INFO:tasks.workunit.client.0.smithi120.stderr: 7efafbfff640 / http_manager 2024-09-19T11:58:56.342 INFO:tasks.workunit.client.0.smithi120.stderr: 7efb8a7e4640 / http_manager 2024-09-19T11:58:56.342 INFO:tasks.workunit.client.0.smithi120.stderr: 7efb8b7e6640 / rgw_dt_lg_renew 2024-09-19T11:58:56.342 INFO:tasks.workunit.client.0.smithi120.stderr: 7efba6ffd640 / ms_dispatch 2024-09-19T11:58:56.342 INFO:tasks.workunit.client.0.smithi120.stderr: 7efbb8ff9640 / io_context_pool 2024-09-19T11:58:56.343 INFO:tasks.workunit.client.0.smithi120.stderr: 7efbbaffd640 / ms_dispatch 2024-09-19T11:58:56.343 INFO:tasks.workunit.client.0.smithi120.stderr: 7efbc1e03640 / ms_dispatch 2024-09-19T11:58:56.343 INFO:tasks.workunit.client.0.smithi120.stderr: 7efbc3606640 / io_context_pool 2024-09-19T11:58:56.343 INFO:tasks.workunit.client.0.smithi120.stderr: 7efcd48cb640 / msgr-worker-2 2024-09-19T11:58:56.343 INFO:tasks.workunit.client.0.smithi120.stderr: 7efcd50cc640 / msgr-worker-1 2024-09-19T11:58:56.343 INFO:tasks.workunit.client.0.smithi120.stderr: 7efcd58cd640 / msgr-worker-0 2024-09-19T11:58:56.343 INFO:tasks.workunit.client.0.smithi120.stderr: 7efcd60ce640 / io_context_pool 2024-09-19T11:58:56.343 INFO:tasks.workunit.client.0.smithi120.stderr: 7efcd75c69c0 / radosgw-admin 2024-09-19T11:58:56.343 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:58:56.343 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:58:56.343 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/log/ceph/ceph-client.admin.126973.log 2024-09-19T11:58:56.343 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:58:56.343 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:58:56.343 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:58:55.758+0000 7efcd48cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.343 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:58:55.758+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.344 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:58:55.758+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.344 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:58:55.758+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.344 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:58:55.758+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.344 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:58:55.758+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.344 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:58:55.758+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.344 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:58:55.758+0000 7efcd50cc640 10 monclient(hunting): handle_auth_done global_id 7277 payload 274 2024-09-19T11:58:56.344 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:58:55.758+0000 7efcd50cc640 10 monclient: _finish_hunting 0 2024-09-19T11:58:56.344 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:58:55.758+0000 7efcd50cc640 1 monclient: found mon.noname-c 2024-09-19T11:58:56.344 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:58:55.758+0000 7efcd50cc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.344 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:58:55.758+0000 7efbc3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.344 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:58:55.758+0000 7efbc3606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:56.344 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:58:55.758+0000 7efbc3606640 10 monclient: dump: 2024-09-19T11:58:56.344 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.345 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.345 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.345 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.345 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.345 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.345 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.345 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.345 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.345 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.345 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:58:55.758+0000 7efbc3606640 10 monclient: _finish_auth 0 2024-09-19T11:58:56.345 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:58:55.758+0000 7efbc3606640 10 monclient: _check_auth_tickets 2024-09-19T11:58:56.345 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:58:55.758+0000 7efbc3606640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:56.345 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:58:55.758+0000 7efbc3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.345 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:58:55.762+0000 7efbc3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:56.345 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:58:55.762+0000 7efbc3606640 10 monclient: dump: 2024-09-19T11:58:56.346 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.346 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.346 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.346 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.346 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.346 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.346 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.346 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.346 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.346 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.346 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 monclient: authenticate success, global_id 7277 2024-09-19T11:58:56.346 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: get_monmap_and_config success 2024-09-19T11:58:56.346 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 4 set_mon_vals no callback set 2024-09-19T11:58:56.346 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: shutdown 2024-09-19T11:58:56.347 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 asok(0x5636ce746d90) unregister_commands rotate-key 2024-09-19T11:58:56.347 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: build_initial_monmap 2024-09-19T11:58:56.347 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:56.347 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: monmap: 2024-09-19T11:58:56.347 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:56.347 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:56.347 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:56.347 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:56.347 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:56.347 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.347 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:56.347 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:56.347 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:56.347 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.348 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding auth protocol: cephx 2024-09-19T11:58:56.348 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding auth protocol: cephx 2024-09-19T11:58:56.348 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding auth protocol: cephx 2024-09-19T11:58:56.348 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: secure 2024-09-19T11:58:56.348 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: crc 2024-09-19T11:58:56.348 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: secure 2024-09-19T11:58:56.348 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: crc 2024-09-19T11:58:56.348 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: secure 2024-09-19T11:58:56.348 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: crc 2024-09-19T11:58:56.348 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: crc 2024-09-19T11:58:56.348 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: secure 2024-09-19T11:58:56.348 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: crc 2024-09-19T11:58:56.348 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: secure 2024-09-19T11:58:56.348 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: crc 2024-09-19T11:58:56.349 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9595d0) adding con mode: secure 2024-09-19T11:58:56.349 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.349 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 1 librados: starting msgr at 2024-09-19T11:58:56.349 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 1 librados: starting objecter 2024-09-19T11:58:56.349 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command objecter_requests hook 0x5636ce955e40 2024-09-19T11:58:56.349 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 1 librados: setting wanted keys 2024-09-19T11:58:56.349 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 1 librados: calling monclient init 2024-09-19T11:58:56.349 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: init 2024-09-19T11:58:56.349 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding auth protocol: cephx 2024-09-19T11:58:56.349 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding auth protocol: cephx 2024-09-19T11:58:56.349 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding auth protocol: cephx 2024-09-19T11:58:56.349 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: secure 2024-09-19T11:58:56.349 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: crc 2024-09-19T11:58:56.349 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: secure 2024-09-19T11:58:56.350 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: crc 2024-09-19T11:58:56.350 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: secure 2024-09-19T11:58:56.350 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: crc 2024-09-19T11:58:56.350 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: crc 2024-09-19T11:58:56.350 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: secure 2024-09-19T11:58:56.350 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: crc 2024-09-19T11:58:56.350 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: secure 2024-09-19T11:58:56.350 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: crc 2024-09-19T11:58:56.350 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce953fc0) adding con mode: secure 2024-09-19T11:58:56.350 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.350 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.350 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command rotate-key hook 0x5636ce954108 2024-09-19T11:58:56.350 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:56.350 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T11:58:56.351 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-b con 0x5636ce7e0500 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:56.351 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-a con 0x5636ce80c330 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:56.351 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-c con 0x5636ce80c740 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:56.351 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.351 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.351 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.351 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:56.351 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient(hunting): authenticate will time out at 2430.078131s 2024-09-19T11:58:56.351 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:58:55.762+0000 7efcd58cd640 10 monclient(hunting): get_auth_request con 0x5636ce80c740 auth_method 0 2024-09-19T11:58:56.351 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:58:55.762+0000 7efcd58cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.351 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:58:55.762+0000 7efcd58cd640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.351 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:58:55.762+0000 7efcd58cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.351 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): get_auth_request con 0x5636ce80c330 auth_method 0 2024-09-19T11:58:56.351 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.351 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.352 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.352 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:58:55.762+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.352 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:58:55.762+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.352 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:58:55.762+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.352 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.352 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.352 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.352 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient(hunting): handle_auth_done global_id 7821 payload 824 2024-09-19T11:58:56.352 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient: _finish_hunting 0 2024-09-19T11:58:56.352 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:58:55.762+0000 7efcd48cb640 1 monclient: found mon.noname-a 2024-09-19T11:58:56.352 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:58:55.762+0000 7efcd48cb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:58:56.352 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.352 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:58:56.353 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: dump: 2024-09-19T11:58:56.353 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.353 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.353 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.353 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.353 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.353 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.353 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.353 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.353 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.353 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.353 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: _finish_auth 0 2024-09-19T11:58:56.353 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: _check_auth_tickets 2024-09-19T11:58:56.353 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:56.353 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.354 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:58:56.354 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:58:55.762+0000 7efbc1e03640 10 monclient: dump: 2024-09-19T11:58:56.354 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.354 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.354 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.354 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.354 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.354 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.354 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.354 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.354 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.354 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.354 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:58:55.762+0000 7efbc3606640 4 set_mon_vals no callback set 2024-09-19T11:58:56.354 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 5 monclient: authenticate success, global_id 7821 2024-09-19T11:58:56.355 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: _renew_subs 2024-09-19T11:58:56.355 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:58:56.355 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: _renew_subs 2024-09-19T11:58:56.355 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T11:58:56.355 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:58:55.762+0000 7efcd75c69c0 1 librados: init done 2024-09-19T11:58:56.355 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:58:55.766+0000 7efbc1e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:58:56.355 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:58:55.766+0000 7efbc1e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:56.355 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:58:55.766+0000 7efbc1e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:56.355 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:58:55.766+0000 7efcd50cc640 10 monclient: get_auth_request con 0x7efbbc071be0 auth_method 0 2024-09-19T11:58:56.355 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:58:55.766+0000 7efcd58cd640 10 monclient: get_auth_request con 0x5636ce9774f0 auth_method 0 2024-09-19T11:58:56.355 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:58:55.766+0000 7efcd50cc640 10 monclient: get_auth_request con 0x5636ce99f0b0 auth_method 0 2024-09-19T11:58:56.355 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:58:55.770+0000 7efcd48cb640 10 monclient: get_auth_request con 0x5636ce9a3520 auth_method 0 2024-09-19T11:58:56.355 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:58:55.770+0000 7efcd58cd640 10 monclient: get_auth_request con 0x5636ce9a2970 auth_method 0 2024-09-19T11:58:56.355 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 10 monclient: build_initial_monmap 2024-09-19T11:58:56.356 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:56.356 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 10 monclient: monmap: 2024-09-19T11:58:56.356 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:56.356 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:56.356 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:56.356 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:56.356 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:56.356 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.356 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:56.356 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:56.356 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:56.356 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.356 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding auth protocol: cephx 2024-09-19T11:58:56.356 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding auth protocol: cephx 2024-09-19T11:58:56.357 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding auth protocol: cephx 2024-09-19T11:58:56.357 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: secure 2024-09-19T11:58:56.357 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: crc 2024-09-19T11:58:56.357 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: secure 2024-09-19T11:58:56.357 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: crc 2024-09-19T11:58:56.357 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: secure 2024-09-19T11:58:56.357 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: crc 2024-09-19T11:58:56.357 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: crc 2024-09-19T11:58:56.357 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: secure 2024-09-19T11:58:56.357 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: crc 2024-09-19T11:58:56.357 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: secure 2024-09-19T11:58:56.357 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: crc 2024-09-19T11:58:56.357 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9ab6c0) adding con mode: secure 2024-09-19T11:58:56.357 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.358 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command objecter_requests cmddesc objecter_requests hook 0x5636ce9af0b0 EEXIST 2024-09-19T11:58:56.358 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 10 monclient: init 2024-09-19T11:58:56.358 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding auth protocol: cephx 2024-09-19T11:58:56.358 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding auth protocol: cephx 2024-09-19T11:58:56.358 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding auth protocol: cephx 2024-09-19T11:58:56.358 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: secure 2024-09-19T11:58:56.358 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: crc 2024-09-19T11:58:56.358 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: secure 2024-09-19T11:58:56.358 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: crc 2024-09-19T11:58:56.358 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: secure 2024-09-19T11:58:56.358 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: crc 2024-09-19T11:58:56.358 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: crc 2024-09-19T11:58:56.358 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: secure 2024-09-19T11:58:56.358 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: crc 2024-09-19T11:58:56.359 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: secure 2024-09-19T11:58:56.359 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: crc 2024-09-19T11:58:56.359 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:58:55.770+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9aa608) adding con mode: secure 2024-09-19T11:58:56.359 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.359 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.359 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command rotate-key cmddesc rotate-key hook 0x5636ce9aa750 EEXIST 2024-09-19T11:58:56.359 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:56.359 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T11:58:56.359 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-c con 0x5636ce9d3260 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:56.359 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-a con 0x5636ce9d2b90 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:56.359 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-b con 0x5636ce9d1570 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:56.359 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.359 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.360 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.360 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:56.360 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient(hunting): authenticate will time out at 2430.088516s 2024-09-19T11:58:56.360 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:58:55.774+0000 7efcd58cd640 10 monclient(hunting): get_auth_request con 0x5636ce9d2b90 auth_method 0 2024-09-19T11:58:56.360 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:58:55.774+0000 7efcd58cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.360 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:58:55.774+0000 7efcd58cd640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.360 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:58:55.774+0000 7efcd58cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.360 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): get_auth_request con 0x5636ce9d3260 auth_method 0 2024-09-19T11:58:56.360 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.360 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.360 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.360 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.360 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.361 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.361 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:58:55.774+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.361 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:58:55.774+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.361 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:58:55.774+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.361 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:58:55.774+0000 7efcd50cc640 10 monclient(hunting): get_auth_request con 0x5636ce9d1570 auth_method 0 2024-09-19T11:58:56.361 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:58:55.774+0000 7efcd50cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.361 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:58:55.774+0000 7efcd50cc640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.361 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:58:55.774+0000 7efcd50cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.361 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient(hunting): handle_auth_done global_id 7283 payload 824 2024-09-19T11:58:56.361 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient: _finish_hunting 0 2024-09-19T11:58:56.361 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:58:55.774+0000 7efcd48cb640 1 monclient: found mon.noname-c 2024-09-19T11:58:56.361 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:58:55.774+0000 7efcd48cb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.361 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.361 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:56.362 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: dump: 2024-09-19T11:58:56.362 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.362 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.362 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.362 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.362 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.362 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.362 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.362 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.362 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.362 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.362 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: _finish_auth 0 2024-09-19T11:58:56.362 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: _check_auth_tickets 2024-09-19T11:58:56.362 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:56.363 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.363 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:56.363 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:58:55.774+0000 7efbbaffd640 10 monclient: dump: 2024-09-19T11:58:56.363 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.363 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.363 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.363 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.363 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.363 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.363 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.363 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.363 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.364 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.364 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:58:55.774+0000 7efcd60ce640 4 set_mon_vals no callback set 2024-09-19T11:58:56.364 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 5 monclient: authenticate success, global_id 7283 2024-09-19T11:58:56.364 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient: _renew_subs 2024-09-19T11:58:56.364 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.364 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient: _renew_subs 2024-09-19T11:58:56.364 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:58:55.774+0000 7efcd75c69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.364 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:58:55.774+0000 7efbbaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:58:56.364 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:58:55.774+0000 7efbbaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:56.364 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:58:55.774+0000 7efbbaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:56.364 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: get_monmap_and_config 2024-09-19T11:58:56.364 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: build_initial_monmap 2024-09-19T11:58:56.364 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:56.365 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: monmap: 2024-09-19T11:58:56.365 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:56.365 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:56.365 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:56.365 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:56.365 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:56.365 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.365 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:56.365 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:56.365 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:56.365 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.365 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding auth protocol: cephx 2024-09-19T11:58:56.365 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding auth protocol: cephx 2024-09-19T11:58:56.365 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding auth protocol: cephx 2024-09-19T11:58:56.366 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: secure 2024-09-19T11:58:56.366 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: crc 2024-09-19T11:58:56.366 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: secure 2024-09-19T11:58:56.366 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: crc 2024-09-19T11:58:56.366 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: secure 2024-09-19T11:58:56.366 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: crc 2024-09-19T11:58:56.366 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: crc 2024-09-19T11:58:56.366 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: secure 2024-09-19T11:58:56.366 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: crc 2024-09-19T11:58:56.366 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: secure 2024-09-19T11:58:56.366 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: crc 2024-09-19T11:58:56.366 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9f2bc0) adding con mode: secure 2024-09-19T11:58:56.366 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient: get_auth_request con 0x7efbb0071b20 auth_method 0 2024-09-19T11:58:56.366 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.366 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: init 2024-09-19T11:58:56.367 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding auth protocol: cephx 2024-09-19T11:58:56.367 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding auth protocol: cephx 2024-09-19T11:58:56.367 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding auth protocol: cephx 2024-09-19T11:58:56.367 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: secure 2024-09-19T11:58:56.367 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: crc 2024-09-19T11:58:56.367 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: secure 2024-09-19T11:58:56.367 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: crc 2024-09-19T11:58:56.367 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: secure 2024-09-19T11:58:56.367 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: crc 2024-09-19T11:58:56.367 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: crc 2024-09-19T11:58:56.367 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: secure 2024-09-19T11:58:56.367 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: crc 2024-09-19T11:58:56.367 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: secure 2024-09-19T11:58:56.367 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: crc 2024-09-19T11:58:56.367 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f5ce0) adding con mode: secure 2024-09-19T11:58:56.368 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.368 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.368 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command rotate-key cmddesc rotate-key hook 0x7ffe221f5e28 EEXIST 2024-09-19T11:58:56.368 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:56.368 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T11:58:56.368 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-b con 0x5636cea27150 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:56.368 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-c con 0x5636cea21370 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:56.368 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-a con 0x5636cea225b0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:56.368 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.368 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.368 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.368 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:56.368 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): authenticate will time out at 2430.093132s 2024-09-19T11:58:56.368 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): get_auth_request con 0x5636cea21370 auth_method 0 2024-09-19T11:58:56.369 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.369 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.369 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.369 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): get_auth_request con 0x5636cea225b0 auth_method 0 2024-09-19T11:58:56.369 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.369 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.369 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.369 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.369 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.369 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.369 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.369 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.369 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.369 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient(hunting): handle_auth_done global_id 7286 payload 274 2024-09-19T11:58:56.370 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient: _finish_hunting 0 2024-09-19T11:58:56.370 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:58:55.778+0000 7efcd58cd640 1 monclient: found mon.noname-c 2024-09-19T11:58:56.370 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:58:55.778+0000 7efcd58cd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.370 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.370 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:56.370 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: dump: 2024-09-19T11:58:56.370 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.370 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.370 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.370 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.370 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.370 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.370 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.370 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.371 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.371 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.371 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: _finish_auth 0 2024-09-19T11:58:56.371 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: _check_auth_tickets 2024-09-19T11:58:56.371 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:56.371 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.371 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:56.371 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:58:55.778+0000 7efbb8ff9640 10 monclient: dump: 2024-09-19T11:58:56.371 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.371 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.371 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.371 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.371 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.371 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.372 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.372 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.372 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.372 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.372 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 monclient: authenticate success, global_id 7286 2024-09-19T11:58:56.372 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: get_monmap_and_config success 2024-09-19T11:58:56.372 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 4 set_mon_vals no callback set 2024-09-19T11:58:56.372 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: shutdown 2024-09-19T11:58:56.372 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: build_initial_monmap 2024-09-19T11:58:56.372 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 1 build_initial for_mkfs: 0 2024-09-19T11:58:56.372 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: monmap: 2024-09-19T11:58:56.372 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:58:56.372 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:58:56.373 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:58:56.373 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:58:56.373 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:58:56.373 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.373 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:58:56.373 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:58:56.373 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:58:56.373 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.373 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding auth protocol: cephx 2024-09-19T11:58:56.373 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding auth protocol: cephx 2024-09-19T11:58:56.373 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding auth protocol: cephx 2024-09-19T11:58:56.373 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: secure 2024-09-19T11:58:56.373 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: crc 2024-09-19T11:58:56.373 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: secure 2024-09-19T11:58:56.373 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: crc 2024-09-19T11:58:56.374 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: secure 2024-09-19T11:58:56.374 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: crc 2024-09-19T11:58:56.374 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: crc 2024-09-19T11:58:56.374 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: secure 2024-09-19T11:58:56.374 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: crc 2024-09-19T11:58:56.374 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: secure 2024-09-19T11:58:56.374 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: crc 2024-09-19T11:58:56.374 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636cea233b0) adding con mode: secure 2024-09-19T11:58:56.374 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.374 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 1 librados: starting msgr at 2024-09-19T11:58:56.374 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 1 librados: starting objecter 2024-09-19T11:58:56.374 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command objecter_requests cmddesc objecter_requests hook 0x5636cea212a0 EEXIST 2024-09-19T11:58:56.374 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 1 librados: setting wanted keys 2024-09-19T11:58:56.374 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 1 librados: calling monclient init 2024-09-19T11:58:56.375 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: init 2024-09-19T11:58:56.375 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding auth protocol: cephx 2024-09-19T11:58:56.375 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding auth protocol: cephx 2024-09-19T11:58:56.375 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding auth protocol: cephx 2024-09-19T11:58:56.375 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: secure 2024-09-19T11:58:56.375 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: crc 2024-09-19T11:58:56.375 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: secure 2024-09-19T11:58:56.375 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: crc 2024-09-19T11:58:56.375 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: secure 2024-09-19T11:58:56.375 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: crc 2024-09-19T11:58:56.375 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: crc 2024-09-19T11:58:56.375 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: secure 2024-09-19T11:58:56.375 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: crc 2024-09-19T11:58:56.375 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: secure 2024-09-19T11:58:56.376 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: crc 2024-09-19T11:58:56.376 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 AuthRegistry(0x5636ce9d5080) adding con mode: secure 2024-09-19T11:58:56.376 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.376 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.376 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command rotate-key cmddesc rotate-key hook 0x5636ce9d51c8 EEXIST 2024-09-19T11:58:56.376 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: _reopen_session rank -1 2024-09-19T11:58:56.376 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T11:58:56.376 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-a con 0x5636cea21370 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:58:56.376 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-b con 0x5636cea225b0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:58:56.376 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): picked mon.noname-c con 0x5636cea27150 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:58:56.376 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.376 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.376 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:58:56.376 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): _renew_subs 2024-09-19T11:58:56.377 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:58:55.778+0000 7efcd75c69c0 10 monclient(hunting): authenticate will time out at 2430.095812s 2024-09-19T11:58:56.377 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): get_auth_request con 0x5636cea27150 auth_method 0 2024-09-19T11:58:56.377 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.377 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.377 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:58:55.778+0000 7efcd50cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.377 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:58:55.778+0000 7efcd48cb640 10 monclient(hunting): get_auth_request con 0x5636cea21370 auth_method 0 2024-09-19T11:58:56.377 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:58:55.778+0000 7efcd48cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:58:56.377 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:58:55.778+0000 7efcd48cb640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:58:56.377 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:58:55.778+0000 7efcd48cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:58:56.377 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:58:55.782+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.377 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:58:55.782+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.377 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:58:55.782+0000 7efcd50cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.377 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:58:55.782+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:58:56.377 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:58:55.782+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:58:56.378 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:58:55.782+0000 7efcd48cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:58:56.378 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:58:55.782+0000 7efcd50cc640 10 monclient(hunting): handle_auth_done global_id 7289 payload 824 2024-09-19T11:58:56.378 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:58:55.782+0000 7efcd50cc640 10 monclient: _finish_hunting 0 2024-09-19T11:58:56.378 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:58:55.782+0000 7efcd50cc640 1 monclient: found mon.noname-c 2024-09-19T11:58:56.378 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:58:55.782+0000 7efcd50cc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.378 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.378 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:58:56.378 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: dump: 2024-09-19T11:58:56.378 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.378 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.378 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.378 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.378 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.378 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.379 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.379 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.379 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.379 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.379 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: _finish_auth 0 2024-09-19T11:58:56.379 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: _check_auth_tickets 2024-09-19T11:58:56.379 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T11:58:56.379 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:58:56.379 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:58:56.379 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:58:55.782+0000 7efba6ffd640 10 monclient: dump: 2024-09-19T11:58:56.379 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:58:56.379 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:58:56.379 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.379 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:58:56.380 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:58:56.380 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:58:56.380 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:58:56.380 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:58:56.380 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:58:56.380 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.380 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:58:55.782+0000 7efbb8ff9640 4 set_mon_vals no callback set 2024-09-19T11:58:56.380 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 5 monclient: authenticate success, global_id 7289 2024-09-19T11:58:56.380 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 10 monclient: _renew_subs 2024-09-19T11:58:56.380 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.380 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 10 monclient: _renew_subs 2024-09-19T11:58:56.380 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:58:56.380 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 1 librados: init done 2024-09-19T11:58:56.380 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command cr dump hook 0x5636cea15788 2024-09-19T11:58:56.381 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:58:55.782+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.381 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:58:55.782+0000 7efba6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:58:56.381 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:58:55.782+0000 7efba6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:56.381 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:58:55.782+0000 7efba6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:58:56.381 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:58:55.782+0000 7efcd58cd640 10 monclient: get_auth_request con 0x5636cea40a90 auth_method 0 2024-09-19T11:58:56.381 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:58:55.782+0000 7efcd48cb640 10 monclient: get_auth_request con 0x7efba0071be0 auth_method 0 2024-09-19T11:58:56.381 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.381 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 realm 2024-09-19T11:58:56.381 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.381 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.381 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:56.381 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.381 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.381 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.382 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:58:55.786+0000 7efcd48cb640 10 monclient: get_auth_request con 0x5636cea44e20 auth_method 0 2024-09-19T11:58:56.382 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:56.382 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:58:55.786+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.382 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:58:55.786+0000 7efcd58cd640 10 monclient: get_auth_request con 0x5636cea48540 auth_method 0 2024-09-19T11:58:56.382 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:58:55.790+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:56.382 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:58:55.790+0000 7efcd75c69c0 20 searching for the correct realm 2024-09-19T11:58:56.382 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:58:55.790+0000 7efcd50cc640 10 monclient: get_auth_request con 0x5636cea4d210 auth_method 0 2024-09-19T11:58:56.382 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:58:55.790+0000 7efcd48cb640 10 monclient: get_auth_request con 0x7efcd00cf040 auth_method 0 2024-09-19T11:58:56.382 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:58:55.790+0000 7efcd58cd640 10 monclient: get_auth_request con 0x7efcc0041040 auth_method 0 2024-09-19T11:58:56.382 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:58:55.790+0000 7efcd58cd640 0 -- 172.21.15.120:0/2945258286 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7efcc0041040 msgr2=0x7efcc0072fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:56.382 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:58:55.994+0000 7efcd58cd640 10 monclient: get_auth_request con 0x7efcc0041040 auth_method 0 2024-09-19T11:58:56.382 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:58:55.994+0000 7efcd50cc640 10 monclient: get_auth_request con 0x7efcc8043450 auth_method 0 2024-09-19T11:58:56.382 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:58:56.006+0000 7efcd48cb640 0 -- 172.21.15.120:0/2945258286 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7efcd0109bd0 msgr2=0x7efcd01167f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:56.382 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:58:56.210+0000 7efcd48cb640 10 monclient: get_auth_request con 0x7efcd0109bd0 auth_method 0 2024-09-19T11:58:56.383 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:56.383 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:56.383 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:56.383 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:56.383 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:56.383 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:56.383 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:58:56.222+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.383 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.383 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.383 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:56.383 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.383 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:56.383 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 zone default found 2024-09-19T11:58:56.383 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 4 Realm: () 2024-09-19T11:58:56.384 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:56.384 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:56.384 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:56.384 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 zonegroup default 2024-09-19T11:58:56.384 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.384 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.384 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.384 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.384 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.384 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.384 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 started sync module instance, tier type = 2024-09-19T11:58:56.384 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:58:56.226+0000 7efcd75c69c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:56.384 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=0 2024-09-19T11:58:56.384 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=1 2024-09-19T11:58:56.385 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=2 2024-09-19T11:58:56.385 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=3 2024-09-19T11:58:56.385 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=4 2024-09-19T11:58:56.385 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=5 2024-09-19T11:58:56.385 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:58:56.246+0000 7efcd75c69c0 20 add_watcher() i=6 2024-09-19T11:58:56.385 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:58:56.250+0000 7efcd75c69c0 20 add_watcher() i=7 2024-09-19T11:58:56.385 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:58:56.250+0000 7efcd75c69c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:56.385 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding auth protocol: cephx 2024-09-19T11:58:56.385 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding auth protocol: cephx 2024-09-19T11:58:56.385 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding auth protocol: cephx 2024-09-19T11:58:56.385 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: secure 2024-09-19T11:58:56.385 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: crc 2024-09-19T11:58:56.385 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: secure 2024-09-19T11:58:56.385 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: crc 2024-09-19T11:58:56.386 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: secure 2024-09-19T11:58:56.386 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: crc 2024-09-19T11:58:56.386 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: crc 2024-09-19T11:58:56.386 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: secure 2024-09-19T11:58:56.386 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: crc 2024-09-19T11:58:56.386 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: secure 2024-09-19T11:58:56.386 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: crc 2024-09-19T11:58:56.386 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 AuthRegistry(0x7ffe221f61b0) adding con mode: secure 2024-09-19T11:58:56.386 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:58:56.254+0000 7efb8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:56.386 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:58:56.386 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:56.386 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:56.386 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command cache list hook 0x5636cea20620 2024-09-19T11:58:56.386 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command cache inspect hook 0x5636cea20620 2024-09-19T11:58:56.387 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command cache erase hook 0x5636cea20620 2024-09-19T11:58:56.387 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command cache zap hook 0x5636cea20620 2024-09-19T11:58:56.387 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 note: GC not initialized 2024-09-19T11:58:56.387 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:58:56.254+0000 7efb8a7e4640 20 reqs_thread_entry: start 2024-09-19T11:58:56.387 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command sync trace show hook 0x7efcc800a950 2024-09-19T11:58:56.387 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command sync trace history hook 0x7efcc800a950 2024-09-19T11:58:56.387 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command sync trace active hook 0x7efcc800a950 2024-09-19T11:58:56.387 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 5 asok(0x5636ce746d90) register_command sync trace active_short hook 0x7efcc800a950 2024-09-19T11:58:56.387 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:56.387 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 20 Filter name: none 2024-09-19T11:58:56.387 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:58:56.254+0000 7efafbfff640 20 reqs_thread_entry: start 2024-09-19T11:58:56.387 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-19T11:58:56.387 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:58:56.254+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.387 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:56.387 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-19T11:58:56.388 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-19T11:58:56.388 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 : miss 2024-09-19T11:58:56.388 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.388 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T11:58:56.388 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:58:56.388 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:58:56.388 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:58:56.388 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:56.388 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:58:56.258+0000 7efcd75c69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 2024-09-19T11:58:56.388 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:58:56.262+0000 7efcd75c69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:58:56.388 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:58:56.262+0000 7efcd75c69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:58:56.388 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:58:56.262+0000 7efcd75c69c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:56.388 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:58:56.262+0000 7efcd75c69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37, ofs0, ns] 2024-09-19T11:58:56.388 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:58:56.266+0000 7efbb8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366167 cookie 94793395146688 notifier 7289 bl.length()=1007 2024-09-19T11:58:56.389 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:58:56.266+0000 7efbb8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:58:56.389 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:58:56.266+0000 7efbb8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:58:56.389 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:58:56.266+0000 7efbb8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:56.389 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:58:56.266+0000 7efcd75c69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): orig_sources= new_sources= 2024-09-19T11:58:56.389 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:58:56.266+0000 7efcd75c69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): potential sources added=[] removed=[] 2024-09-19T11:58:56.389 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:58:56.266+0000 7efcd75c69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): orig_dests= new_dests= 2024-09-19T11:58:56.389 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:58:56.266+0000 7efcd75c69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): potential dests added=[] removed=[] 2024-09-19T11:58:56.389 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:58:56.270+0000 7efcd75c69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efcd75c69c0 time 2024-09-19T11:58:56.270304+0000 2024-09-19T11:58:56.389 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:58:56.389 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.390 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:56.390 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efcdaea02eb] 2024-09-19T11:58:56.390 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efcdaea049f] 2024-09-19T11:58:56.390 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636cbf76271] 2024-09-19T11:58:56.390 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x141057c) [0x5636cc9c757c] 2024-09-19T11:58:56.390 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5636cbf860dd] 2024-09-19T11:58:56.390 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:58:56.390 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efcd9d06d90] 2024-09-19T11:58:56.390 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:58:56.390 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:58:56.390 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.390 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:58:56.270+0000 7efcd75c69c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:58:56.390 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7efcd75c69c0 thread_name:radosgw-admin 2024-09-19T11:58:56.390 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.391 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:58:56.391 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efcd9d1f520] 2024-09-19T11:58:56.391 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:58:56.391 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:58:56.391 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:58:56.391 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efcdaea0345] 2024-09-19T11:58:56.391 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efcdaea049f] 2024-09-19T11:58:56.391 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5636cbf76271] 2024-09-19T11:58:56.391 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x141057c) [0x5636cc9c757c] 2024-09-19T11:58:56.391 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5636cbf860dd] 2024-09-19T11:58:56.391 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:58:56.391 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efcd9d06d90] 2024-09-19T11:58:56.391 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:58:56.391 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:58:56.392 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:58:56.392 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.392 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:58:56.392 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:58:56.392 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:58:56.392 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:58:56.392 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:58:56.392 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:58:56.392 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:58:56.392 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:58:56.392 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:58:56.392 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:58:56.392 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:58:56.392 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:58:56.393 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:58:56.393 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:58:56.393 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:58:56.393 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:58:56.393 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:58:56.393 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:58:56.393 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:58:56.393 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:58:56.393 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:58:56.393 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:58:56.393 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:58:56.393 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:58:56.393 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:58:56.393 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:58:56.394 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:58:56.394 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:58:56.394 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:58:56.394 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:58:56.394 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:58:56.394 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:58:56.394 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:58:56.394 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:58:56.394 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:58:56.394 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:58:56.394 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:58:56.394 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:58:56.394 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:58:56.394 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:58:56.395 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:58:56.395 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:58:56.395 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:58:56.395 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:58:56.395 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:58:56.395 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:58:56.395 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:58:56.395 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:58:56.395 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:58:56.395 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:58:56.395 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:58:56.395 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:58:56.395 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:58:56.396 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:58:56.396 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:58:56.396 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:58:56.396 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:58:56.396 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:58:56.396 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:58:56.396 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:58:56.396 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:58:56.396 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:58:56.396 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:58:56.396 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:58:56.396 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:58:56.396 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:58:56.397 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:58:56.397 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:58:56.397 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:58:56.397 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:58:56.397 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:58:56.397 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:58:56.397 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:58:56.397 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:58:56.397 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:58:56.397 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:58:56.397 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:58:56.397 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:58:56.397 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:58:56.397 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:58:56.398 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:58:56.398 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:58:56.398 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:58:56.398 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:58:56.398 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:58:56.398 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:58:56.398 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:58:56.398 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:58:56.398 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:58:56.398 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:58:56.398 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:58:56.398 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:58:56.398 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:58:56.399 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:58:56.399 INFO:tasks.workunit.client.0.smithi120.stderr: 7efafbfff640 / http_manager 2024-09-19T11:58:56.399 INFO:tasks.workunit.client.0.smithi120.stderr: 7efb8a7e4640 / http_manager 2024-09-19T11:58:56.399 INFO:tasks.workunit.client.0.smithi120.stderr: 7efb8b7e6640 / rgw_dt_lg_renew 2024-09-19T11:58:56.399 INFO:tasks.workunit.client.0.smithi120.stderr: 7efba6ffd640 / ms_dispatch 2024-09-19T11:58:56.399 INFO:tasks.workunit.client.0.smithi120.stderr: 7efbb8ff9640 / io_context_pool 2024-09-19T11:58:56.399 INFO:tasks.workunit.client.0.smithi120.stderr: 7efbbaffd640 / ms_dispatch 2024-09-19T11:58:56.399 INFO:tasks.workunit.client.0.smithi120.stderr: 7efbc1e03640 / ms_dispatch 2024-09-19T11:58:56.399 INFO:tasks.workunit.client.0.smithi120.stderr: 7efbc3606640 / io_context_pool 2024-09-19T11:58:56.399 INFO:tasks.workunit.client.0.smithi120.stderr: 7efcd48cb640 / msgr-worker-2 2024-09-19T11:58:56.399 INFO:tasks.workunit.client.0.smithi120.stderr: 7efcd50cc640 / msgr-worker-1 2024-09-19T11:58:56.399 INFO:tasks.workunit.client.0.smithi120.stderr: 7efcd58cd640 / msgr-worker-0 2024-09-19T11:58:56.399 INFO:tasks.workunit.client.0.smithi120.stderr: 7efcd60ce640 / io_context_pool 2024-09-19T11:58:56.399 INFO:tasks.workunit.client.0.smithi120.stderr: 7efcd75c69c0 / radosgw-admin 2024-09-19T11:58:56.399 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:58:56.400 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:58:56.400 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/lib/ceph/crash/2024-09-19T11:58:56.273352Z_952b92a6-a783-40ec-b758-8fd41cd4348a/log 2024-09-19T11:58:56.400 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:58:56.400 INFO:tasks.workunit.client.0.smithi120.stderr:Aborted 2024-09-19T11:58:56.400 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-19T11:58:56.401 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:56.401 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:56.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.354+0000 7f08bff479c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.358+0000 7f08bff479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.358+0000 7f08bff479c0 20 realm 2024-09-19T11:58:56.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.358+0000 7f08bff479c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.358+0000 7f08bff479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.358+0000 7f08bff479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:56.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.358+0000 7f08bff479c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.358+0000 7f08bff479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.358+0000 7f08bff479c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.358+0000 7f08bff479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:56.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.358+0000 7f08bff479c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.362+0000 7f08bff479c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:56.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.362+0000 7f08bff479c0 20 searching for the correct realm 2024-09-19T11:58:56.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.362+0000 7f08be24e640 0 -- 172.21.15.120:0/2564873762 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f08b403d920 msgr2=0x7f08b400f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:58:56.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.370+0000 7f08bd24c640 0 -- 172.21.15.120:0/2564873762 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f08b00675c0 msgr2=0x7f08b0070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:56.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.586+0000 7f08bff479c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:56.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.586+0000 7f08bff479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:56.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.586+0000 7f08bff479c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:56.583 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.586+0000 7f08bff479c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:56.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.586+0000 7f08bff479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:56.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.586+0000 7f08bff479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:56.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.586+0000 7f08bff479c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.590+0000 7f08bff479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.584 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.590+0000 7f08bff479c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.590+0000 7f08bff479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:56.585 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.590+0000 7f08bff479c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.590+0000 7f08bff479c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:56.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.590+0000 7f08bff479c0 20 zone default found 2024-09-19T11:58:56.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.590+0000 7f08bff479c0 4 Realm: () 2024-09-19T11:58:56.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.590+0000 7f08bff479c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:56.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.590+0000 7f08bff479c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:56.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.590+0000 7f08bff479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:56.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.590+0000 7f08bff479c0 20 zonegroup default 2024-09-19T11:58:56.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.590+0000 7f08bff479c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.586 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.590+0000 7f08bff479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.590+0000 7f08bff479c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.594+0000 7f08bff479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.587 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.594+0000 7f08bff479c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.594+0000 7f08bff479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.594+0000 7f08bff479c0 20 started sync module instance, tier type = 2024-09-19T11:58:56.588 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.594+0000 7f08bff479c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:56.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.618+0000 7f08bff479c0 20 add_watcher() i=0 2024-09-19T11:58:56.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.618+0000 7f08bff479c0 20 add_watcher() i=1 2024-09-19T11:58:56.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.618+0000 7f08bff479c0 20 add_watcher() i=2 2024-09-19T11:58:56.612 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.618+0000 7f08bff479c0 20 add_watcher() i=3 2024-09-19T11:58:56.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.618+0000 7f08bff479c0 20 add_watcher() i=4 2024-09-19T11:58:56.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.618+0000 7f08bff479c0 20 add_watcher() i=5 2024-09-19T11:58:56.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.618+0000 7f08bff479c0 20 add_watcher() i=6 2024-09-19T11:58:56.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.618+0000 7f08bff479c0 20 add_watcher() i=7 2024-09-19T11:58:56.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.618+0000 7f08bff479c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:56.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.622+0000 7f076f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:56.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.626+0000 7f08bff479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:56.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.626+0000 7f08bff479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:56.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.626+0000 7f08bff479c0 5 note: GC not initialized 2024-09-19T11:58:56.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.626+0000 7f076e7fc640 20 reqs_thread_entry: start 2024-09-19T11:58:56.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.626+0000 7f08bff479c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:56.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.626+0000 7f08bff479c0 20 Filter name: none 2024-09-19T11:58:56.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.626+0000 7f06dffff640 20 reqs_thread_entry: start 2024-09-19T11:58:56.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.626+0000 7f08bff479c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.626+0000 7f08bff479c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:56.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.626+0000 7f08bff479c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.623 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.630+0000 7f08bff479c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-19T11:58:56.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.630+0000 7f08bff479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:56.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.630+0000 7f08bff479c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.630+0000 7f08bff479c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:56.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.630+0000 7f08bff479c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.630+0000 7f08bff479c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-19T11:58:56.625 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.630+0000 7f08bff479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:58:56.627 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.634+0000 7f076f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:56.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.638+0000 7f08bff479c0 20 remove_watcher() i=0 2024-09-19T11:58:56.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.638+0000 7f08bff479c0 2 removed watcher, disabling cache 2024-09-19T11:58:56.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.638+0000 7f08bff479c0 20 remove_watcher() i=1 2024-09-19T11:58:56.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.642+0000 7f08bff479c0 20 remove_watcher() i=2 2024-09-19T11:58:56.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.646+0000 7f08bff479c0 20 remove_watcher() i=3 2024-09-19T11:58:56.642 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.646+0000 7f08bff479c0 20 remove_watcher() i=4 2024-09-19T11:58:56.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.650+0000 7f08bff479c0 20 remove_watcher() i=5 2024-09-19T11:58:56.645 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.650+0000 7f08bff479c0 20 remove_watcher() i=6 2024-09-19T11:58:56.647 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.654+0000 7f08bff479c0 20 remove_watcher() i=7 2024-09-19T11:58:56.665 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.665 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:58:56.665 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-logrecord-writes id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:58:56.666 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:58:56.725 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:58:56.761 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:58:56.761 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:58:56.806 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.810+0000 7fea6d1d79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.814+0000 7fea6d1d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.814+0000 7fea6d1d79c0 20 realm 2024-09-19T11:58:56.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.814+0000 7fea6d1d79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.814+0000 7fea6d1d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.814+0000 7fea6d1d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:58:56.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.814+0000 7fea6d1d79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.814+0000 7fea6d1d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:56.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.814+0000 7fea6d1d79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.814+0000 7fea6d1d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:56.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.814+0000 7fea6d1d79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:56.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.818+0000 7fea6d1d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:58:56.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.818+0000 7fea6d1d79c0 20 searching for the correct realm 2024-09-19T11:58:56.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.818+0000 7fea6b4de640 0 -- 172.21.15.120:0/437610665 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fea6001a040 msgr2=0x7fea6006a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:58:56.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:56.826+0000 7fea6a4dc640 0 -- 172.21.15.120:0/437610665 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fea5c09a430 msgr2=0x7fea5c07e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:58:57.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.042+0000 7fea6d1d79c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:58:57.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.042+0000 7fea6d1d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:58:57.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.042+0000 7fea6d1d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:58:57.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.042+0000 7fea6d1d79c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:58:57.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.042+0000 7fea6d1d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:58:57.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.042+0000 7fea6d1d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:58:57.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.042+0000 7fea6d1d79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:57.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.042+0000 7fea6d1d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:57.039 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.046+0000 7fea6d1d79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:57.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.046+0000 7fea6d1d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:58:57.040 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.046+0000 7fea6d1d79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:57.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.046+0000 7fea6d1d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:58:57.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.046+0000 7fea6d1d79c0 20 zone default found 2024-09-19T11:58:57.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.046+0000 7fea6d1d79c0 4 Realm: () 2024-09-19T11:58:57.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.046+0000 7fea6d1d79c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:58:57.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.046+0000 7fea6d1d79c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:58:57.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.046+0000 7fea6d1d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:58:57.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.046+0000 7fea6d1d79c0 20 zonegroup default 2024-09-19T11:58:57.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.046+0000 7fea6d1d79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:57.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.046+0000 7fea6d1d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:57.044 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.046+0000 7fea6d1d79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:57.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.046+0000 7fea6d1d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:57.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.046+0000 7fea6d1d79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:57.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.050+0000 7fea6d1d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:58:57.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.050+0000 7fea6d1d79c0 20 started sync module instance, tier type = 2024-09-19T11:58:57.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.050+0000 7fea6d1d79c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:58:57.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.070+0000 7fea6d1d79c0 20 add_watcher() i=0 2024-09-19T11:58:57.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.070+0000 7fea6d1d79c0 20 add_watcher() i=1 2024-09-19T11:58:57.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.070+0000 7fea6d1d79c0 20 add_watcher() i=2 2024-09-19T11:58:57.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.070+0000 7fea6d1d79c0 20 add_watcher() i=3 2024-09-19T11:58:57.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.070+0000 7fea6d1d79c0 20 add_watcher() i=4 2024-09-19T11:58:57.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.070+0000 7fea6d1d79c0 20 add_watcher() i=5 2024-09-19T11:58:57.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.070+0000 7fea6d1d79c0 20 add_watcher() i=6 2024-09-19T11:58:57.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.074+0000 7fea6d1d79c0 20 add_watcher() i=7 2024-09-19T11:58:57.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.074+0000 7fea6d1d79c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:58:57.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.078+0000 7fe921fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:57.074 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.078+0000 7fea6d1d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:58:57.074 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.078+0000 7fea6d1d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:58:57.075 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.078+0000 7fea6d1d79c0 5 note: GC not initialized 2024-09-19T11:58:57.075 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.078+0000 7fe920fe1640 20 reqs_thread_entry: start 2024-09-19T11:58:57.075 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.078+0000 7fea6d1d79c0 20 init_complete bucket index max shards: 1 2024-09-19T11:58:57.075 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.082+0000 7fea6d1d79c0 20 Filter name: none 2024-09-19T11:58:57.076 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.082+0000 7fe919ffb640 20 reqs_thread_entry: start 2024-09-19T11:58:57.076 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.082+0000 7fea6d1d79c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-19T11:58:57.076 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.082+0000 7fea6d1d79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:57.076 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.082+0000 7fea6d1d79c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:58:57.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.082+0000 7fea6d1d79c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-19T11:58:57.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.082+0000 7fea6d1d79c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-19T11:58:57.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.082+0000 7fea6d1d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 : miss 2024-09-19T11:58:57.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.082+0000 7fea6d1d79c0 20 rados->read ofs=0 len=0 2024-09-19T11:58:57.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.082+0000 7fea6d1d79c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-19T11:58:57.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.082+0000 7fea6d1d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:58:57.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.082+0000 7fea6d1d79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:58:57.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.082+0000 7fea6d1d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:58:57.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.082+0000 7fea6d1d79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:58:57.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.082+0000 7fea6d1d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 2024-09-19T11:58:57.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.086+0000 7fea6d1d79c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to be held by another RGW process; skipping for now 2024-09-19T11:58:57.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.086+0000 7fe921fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:58:57.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.090+0000 7fea6d1d79c0 20 remove_watcher() i=0 2024-09-19T11:58:57.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.090+0000 7fea6d1d79c0 2 removed watcher, disabling cache 2024-09-19T11:58:57.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.094+0000 7fea6d1d79c0 20 remove_watcher() i=1 2024-09-19T11:58:57.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.094+0000 7fea6d1d79c0 20 remove_watcher() i=2 2024-09-19T11:58:57.092 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.098+0000 7fea6d1d79c0 20 remove_watcher() i=3 2024-09-19T11:58:57.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.098+0000 7fea6d1d79c0 20 remove_watcher() i=4 2024-09-19T11:58:57.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.102+0000 7fea6d1d79c0 20 remove_watcher() i=5 2024-09-19T11:58:57.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.102+0000 7fea6d1d79c0 20 remove_watcher() i=6 2024-09-19T11:58:57.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:58:57.102+0000 7fea6d1d79c0 20 remove_watcher() i=7 2024-09-19T11:58:57.112 INFO:tasks.workunit.client.0.smithi120.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T11:59:27.144 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:59:27.180 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:59:27.180 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:59:27.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.233+0000 7f08c8b769c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.237+0000 7f08c8b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:27.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.237+0000 7f08c8b769c0 20 realm 2024-09-19T11:59:27.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.237+0000 7f08c8b769c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.237+0000 7f08c8b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:27.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.237+0000 7f08c8b769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:27.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.237+0000 7f08c8b769c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.237+0000 7f08c8b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:27.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.237+0000 7f08c8b769c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.234 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.237+0000 7f08c8b769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:27.234 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.237+0000 7f08c8b769c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.238 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.241+0000 7f08c8b769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:27.238 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.241+0000 7f08c8b769c0 20 searching for the correct realm 2024-09-19T11:59:27.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.245+0000 7f08c667c640 0 -- 172.21.15.120:0/2684274879 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f08c00d8040 msgr2=0x7f08c00e5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:27.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.461+0000 7f08c667c640 0 -- 172.21.15.120:0/2684274879 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f08c00d8040 msgr2=0x7f08c00e5a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:27.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.473+0000 7f08c8b769c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:27.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.473+0000 7f08c8b769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:27.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.473+0000 7f08c8b769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:27.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.473+0000 7f08c8b769c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:27.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.473+0000 7f08c8b769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:27.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.473+0000 7f08c8b769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:27.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.473+0000 7f08c8b769c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.473+0000 7f08c8b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:27.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.473+0000 7f08c8b769c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:27.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:27.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 20 zone default found 2024-09-19T11:59:27.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 4 Realm: () 2024-09-19T11:59:27.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:27.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:27.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:27.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 20 zonegroup default 2024-09-19T11:59:27.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:27.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:27.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:27.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 20 started sync module instance, tier type = 2024-09-19T11:59:27.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.477+0000 7f08c8b769c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:27.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.501+0000 7f08c8b769c0 20 add_watcher() i=0 2024-09-19T11:59:27.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.501+0000 7f08c8b769c0 20 add_watcher() i=1 2024-09-19T11:59:27.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.501+0000 7f08c8b769c0 20 add_watcher() i=2 2024-09-19T11:59:27.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.501+0000 7f08c8b769c0 20 add_watcher() i=3 2024-09-19T11:59:27.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.501+0000 7f08c8b769c0 20 add_watcher() i=4 2024-09-19T11:59:27.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.501+0000 7f08c8b769c0 20 add_watcher() i=5 2024-09-19T11:59:27.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.501+0000 7f08c8b769c0 20 add_watcher() i=6 2024-09-19T11:59:27.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.505+0000 7f08c8b769c0 20 add_watcher() i=7 2024-09-19T11:59:27.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.505+0000 7f08c8b769c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:27.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f077cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:27.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:27.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:27.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 5 note: GC not initialized 2024-09-19T11:59:27.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f06f77fe640 20 reqs_thread_entry: start 2024-09-19T11:59:27.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:27.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 20 Filter name: none 2024-09-19T11:59:27.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f06f57fa640 20 reqs_thread_entry: start 2024-09-19T11:59:27.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-19T11:59:27.505 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:59:27.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-19T11:59:27.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-19T11:59:27.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 : miss 2024-09-19T11:59:27.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-19T11:59:27.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:59:27.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:59:27.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:59:27.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:27.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.509+0000 7f08c8b769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 2024-09-19T11:59:27.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.513+0000 7f08c8b769c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T11:59:27.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.521+0000 7f08c8b769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:59:27.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.521+0000 7f08c8b769c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:59:27.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.521+0000 7f08c8b769c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:27.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.521+0000 7f08c8b769c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37, ofs0, ns] 2024-09-19T11:59:27.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.521+0000 7f07a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366168 cookie 94072054486928 notifier 7887 bl.length()=1007 2024-09-19T11:59:27.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.521+0000 7f07a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:59:27.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.521+0000 7f07a9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:59:27.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.521+0000 7f07a9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:27.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.521+0000 7f08c8b769c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): orig_sources= new_sources= 2024-09-19T11:59:27.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.521+0000 7f08c8b769c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): potential sources added=[] removed=[] 2024-09-19T11:59:27.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.521+0000 7f08c8b769c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): orig_dests= new_dests= 2024-09-19T11:59:27.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.521+0000 7f08c8b769c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): potential dests added=[] removed=[] 2024-09-19T11:59:27.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.525+0000 7f08c8b769c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37.2.0 2024-09-19T11:59:27.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.525+0000 7f08c8b769c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37.2.0 2024-09-19T11:59:27.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.525+0000 7f08c8b769c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37.2.1 2024-09-19T11:59:27.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.525+0000 7f08c8b769c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37.2.1 2024-09-19T11:59:27.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.525+0000 7f08c8b769c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37.0 2024-09-19T11:59:27.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.533+0000 7f08c8b769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 : hit (requested=0x17, cached=0x17) 2024-09-19T11:59:27.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.533+0000 7f08c8b769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 2024-09-19T11:59:27.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.533+0000 7f08c8b769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:59:27.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.533+0000 7f08c8b769c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:59:27.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.533+0000 7f08c8b769c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:27.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.533+0000 7f08c8b769c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37, ofs0, ns] 2024-09-19T11:59:27.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.537+0000 7f07a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 94072054486928 notifier 7887 bl.length()=1007 2024-09-19T11:59:27.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.537+0000 7f07a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:59:27.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.537+0000 7f07a9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:59:27.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.537+0000 7f07a9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:27.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.537+0000 7f08c8b769c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): orig_sources= new_sources= 2024-09-19T11:59:27.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.537+0000 7f08c8b769c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): potential sources added=[] removed=[] 2024-09-19T11:59:27.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.537+0000 7f08c8b769c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): orig_dests= new_dests= 2024-09-19T11:59:27.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.537+0000 7f08c8b769c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): potential dests added=[] removed=[] 2024-09-19T11:59:27.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.537+0000 7f08c8b769c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37.0 2024-09-19T11:59:27.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.537+0000 7f08c8b769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 : hit (requested=0x17, cached=0x17) 2024-09-19T11:59:27.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.537+0000 7f08c8b769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 2024-09-19T11:59:27.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.541+0000 7f08c8b769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:59:27.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.541+0000 7f08c8b769c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:59:27.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.541+0000 7f08c8b769c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:27.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.541+0000 7f08c8b769c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37, ofs0, ns] 2024-09-19T11:59:27.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.541+0000 7f07a97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 94072054486928 notifier 7887 bl.length()=975 2024-09-19T11:59:27.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.541+0000 7f07a97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 info.flags=0x17 2024-09-19T11:59:27.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.541+0000 7f07a97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 to cache LRU end 2024-09-19T11:59:27.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.541+0000 7f07a97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:27.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.541+0000 7f08c8b769c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): orig_sources= new_sources= 2024-09-19T11:59:27.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.541+0000 7f08c8b769c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): potential sources added=[] removed=[] 2024-09-19T11:59:27.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.541+0000 7f08c8b769c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): orig_dests= new_dests= 2024-09-19T11:59:27.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.541+0000 7f08c8b769c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37]): potential dests added=[] removed=[] 2024-09-19T11:59:27.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.545+0000 7f08c8b769c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-19T11:59:27.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.549+0000 7f077cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:27.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.553+0000 7f08c8b769c0 20 remove_watcher() i=0 2024-09-19T11:59:27.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.553+0000 7f08c8b769c0 2 removed watcher, disabling cache 2024-09-19T11:59:27.551 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.557+0000 7f08c8b769c0 20 remove_watcher() i=1 2024-09-19T11:59:27.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.557+0000 7f08c8b769c0 20 remove_watcher() i=2 2024-09-19T11:59:27.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.561+0000 7f08c8b769c0 20 remove_watcher() i=3 2024-09-19T11:59:27.558 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.561+0000 7f08c8b769c0 20 remove_watcher() i=4 2024-09-19T11:59:27.560 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.565+0000 7f08c8b769c0 20 remove_watcher() i=5 2024-09-19T11:59:27.561 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.565+0000 7f08c8b769c0 20 remove_watcher() i=6 2024-09-19T11:59:27.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.569+0000 7f08c8b769c0 20 remove_watcher() i=7 2024-09-19T11:59:27.578 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-19T11:59:27.605 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:59:27.605 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:59:27.649 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.653+0000 7f6a67eff9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.653+0000 7f6a67eff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:27.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.653+0000 7f6a67eff9c0 20 realm 2024-09-19T11:59:27.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.653+0000 7f6a67eff9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.657+0000 7f6a67eff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:27.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.657+0000 7f6a67eff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:27.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.657+0000 7f6a67eff9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.657+0000 7f6a67eff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:27.651 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.657+0000 7f6a67eff9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.657+0000 7f6a67eff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:27.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.657+0000 7f6a67eff9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.657+0000 7f6a67eff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:27.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.657+0000 7f6a67eff9c0 20 searching for the correct realm 2024-09-19T11:59:27.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.661+0000 7f6a66206640 0 -- 172.21.15.120:0/3464028854 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f6a5c029070 msgr2=0x7f6a5c046930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:27.665 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.669+0000 7f6a65204640 0 -- 172.21.15.120:0/3464028854 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f6a58008050 msgr2=0x7f6a580680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:27.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.885+0000 7f6a67eff9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:27.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.885+0000 7f6a67eff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:27.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.885+0000 7f6a67eff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:27.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.885+0000 7f6a67eff9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:27.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.885+0000 7f6a67eff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:27.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.885+0000 7f6a67eff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:27.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.885+0000 7f6a67eff9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.885+0000 7f6a67eff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:27.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.885+0000 7f6a67eff9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.885+0000 7f6a67eff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:27.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.885+0000 7f6a67eff9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.889+0000 7f6a67eff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:27.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.889+0000 7f6a67eff9c0 20 zone default found 2024-09-19T11:59:27.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.889+0000 7f6a67eff9c0 4 Realm: () 2024-09-19T11:59:27.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.889+0000 7f6a67eff9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:27.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.889+0000 7f6a67eff9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:27.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.889+0000 7f6a67eff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:27.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.889+0000 7f6a67eff9c0 20 zonegroup default 2024-09-19T11:59:27.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.889+0000 7f6a67eff9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.889+0000 7f6a67eff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:27.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.889+0000 7f6a67eff9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.884 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.889+0000 7f6a67eff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:27.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.889+0000 7f6a67eff9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.889+0000 7f6a67eff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:27.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.889+0000 7f6a67eff9c0 20 started sync module instance, tier type = 2024-09-19T11:59:27.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.889+0000 7f6a67eff9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:27.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.913+0000 7f6a67eff9c0 20 add_watcher() i=0 2024-09-19T11:59:27.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.913+0000 7f6a67eff9c0 20 add_watcher() i=1 2024-09-19T11:59:27.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.913+0000 7f6a67eff9c0 20 add_watcher() i=2 2024-09-19T11:59:27.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.913+0000 7f6a67eff9c0 20 add_watcher() i=3 2024-09-19T11:59:27.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.913+0000 7f6a67eff9c0 20 add_watcher() i=4 2024-09-19T11:59:27.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.913+0000 7f6a67eff9c0 20 add_watcher() i=5 2024-09-19T11:59:27.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.913+0000 7f6a67eff9c0 20 add_watcher() i=6 2024-09-19T11:59:27.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.917+0000 7f6a67eff9c0 20 add_watcher() i=7 2024-09-19T11:59:27.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.917+0000 7f6a67eff9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:27.915 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.921+0000 7f69177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:27.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.921+0000 7f6a67eff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:27.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.921+0000 7f6a67eff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:27.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.921+0000 7f6a67eff9c0 5 note: GC not initialized 2024-09-19T11:59:27.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.921+0000 7f69167fc640 20 reqs_thread_entry: start 2024-09-19T11:59:27.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.921+0000 7f6a67eff9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:27.917 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.921+0000 7f6a67eff9c0 20 Filter name: none 2024-09-19T11:59:27.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.921+0000 7f6887fff640 20 reqs_thread_entry: start 2024-09-19T11:59:27.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.921+0000 7f6a67eff9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.921+0000 7f6a67eff9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:59:27.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.921+0000 7f6a67eff9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.925+0000 7f6a67eff9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T11:59:27.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.925+0000 7f6a67eff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:27.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.925+0000 7f6a67eff9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.925+0000 7f6a67eff9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-19T11:59:27.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.925+0000 7f6a67eff9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:27.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.925+0000 7f6a67eff9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-19T11:59:27.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.925+0000 7f6a67eff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:27.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.929+0000 7f69177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:27.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.933+0000 7f6a67eff9c0 20 remove_watcher() i=0 2024-09-19T11:59:27.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.933+0000 7f6a67eff9c0 2 removed watcher, disabling cache 2024-09-19T11:59:27.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.937+0000 7f6a67eff9c0 20 remove_watcher() i=1 2024-09-19T11:59:27.933 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.937+0000 7f6a67eff9c0 20 remove_watcher() i=2 2024-09-19T11:59:27.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.941+0000 7f6a67eff9c0 20 remove_watcher() i=3 2024-09-19T11:59:27.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.941+0000 7f6a67eff9c0 20 remove_watcher() i=4 2024-09-19T11:59:27.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.945+0000 7f6a67eff9c0 20 remove_watcher() i=5 2024-09-19T11:59:27.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.945+0000 7f6a67eff9c0 20 remove_watcher() i=6 2024-09-19T11:59:27.942 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:27.945+0000 7f6a67eff9c0 20 remove_watcher() i=7 2024-09-19T11:59:27.964 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:27.964 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:59:27.964 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-logrecord-writes id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T11:59:27.965 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:28.053 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-19T11:59:28.054 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:28.537 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-19T11:59:28.569 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:59:28.569 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:59:28.614 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.617+0000 7fb6f3b2d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:28.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.621+0000 7fb6f3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:28.616 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.621+0000 7fb6f3b2d9c0 20 realm 2024-09-19T11:59:28.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.621+0000 7fb6f3b2d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:28.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.621+0000 7fb6f3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:28.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.621+0000 7fb6f3b2d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:28.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.621+0000 7fb6f3b2d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:28.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.621+0000 7fb6f3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:28.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.621+0000 7fb6f3b2d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:28.618 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.621+0000 7fb6f3b2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:28.618 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.621+0000 7fb6f3b2d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:28.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.625+0000 7fb6f3b2d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:28.620 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.625+0000 7fb6f3b2d9c0 20 searching for the correct realm 2024-09-19T11:59:28.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.625+0000 7fb6f0e32640 0 -- 172.21.15.120:0/166261721 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7fb6e40c9040 msgr2=0x7fb6e40d8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:59:28.834 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.837+0000 7fb6f1e34640 0 -- 172.21.15.120:0/166261721 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fb6e8025070 msgr2=0x7fb6e805df20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:28.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:28.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:28.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:28.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:28.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:28.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:28.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:28.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:28.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:28.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:28.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:28.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:28.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 20 zone default found 2024-09-19T11:59:28.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 4 Realm: () 2024-09-19T11:59:28.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:28.854 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:28.855 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:28.855 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 20 zonegroup default 2024-09-19T11:59:28.855 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.857+0000 7fb6f3b2d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:28.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.861+0000 7fb6f3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:28.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.861+0000 7fb6f3b2d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:28.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.861+0000 7fb6f3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:28.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.861+0000 7fb6f3b2d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:28.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.861+0000 7fb6f3b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:28.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.861+0000 7fb6f3b2d9c0 20 started sync module instance, tier type = 2024-09-19T11:59:28.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.861+0000 7fb6f3b2d9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:28.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.885+0000 7fb6f3b2d9c0 20 add_watcher() i=0 2024-09-19T11:59:28.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.885+0000 7fb6f3b2d9c0 20 add_watcher() i=1 2024-09-19T11:59:28.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.885+0000 7fb6f3b2d9c0 20 add_watcher() i=2 2024-09-19T11:59:28.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.885+0000 7fb6f3b2d9c0 20 add_watcher() i=3 2024-09-19T11:59:28.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.885+0000 7fb6f3b2d9c0 20 add_watcher() i=4 2024-09-19T11:59:28.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.885+0000 7fb6f3b2d9c0 20 add_watcher() i=5 2024-09-19T11:59:28.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.885+0000 7fb6f3b2d9c0 20 add_watcher() i=6 2024-09-19T11:59:28.881 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.885+0000 7fb6f3b2d9c0 20 add_watcher() i=7 2024-09-19T11:59:28.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.885+0000 7fb6f3b2d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:28.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.889+0000 7fb5a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:28.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.889+0000 7fb6f3b2d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:28.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.889+0000 7fb6f3b2d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:28.886 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.889+0000 7fb6f3b2d9c0 5 note: GC not initialized 2024-09-19T11:59:28.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.893+0000 7fb5a67e4640 20 reqs_thread_entry: start 2024-09-19T11:59:28.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.893+0000 7fb6f3b2d9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:28.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.893+0000 7fb6f3b2d9c0 20 Filter name: none 2024-09-19T11:59:28.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.893+0000 7fb517fff640 20 reqs_thread_entry: start 2024-09-19T11:59:28.887 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.893+0000 7fb6f3b2d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:28.889 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.893+0000 7fb6f3b2d9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:28.889 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.893+0000 7fb6f3b2d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:28.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.893+0000 7fb6f3b2d9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:28.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.893+0000 7fb6f3b2d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:28.890 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.893+0000 7fb6f3b2d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:28.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.897+0000 7fb6f3b2d9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:28.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.897+0000 7fb6f3b2d9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:28.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.897+0000 7fb6f3b2d9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:28.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.897+0000 7fb6f3b2d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:28.894 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.897+0000 7fb5a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:28.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.905+0000 7fb6f3b2d9c0 20 remove_watcher() i=0 2024-09-19T11:59:28.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.905+0000 7fb6f3b2d9c0 2 removed watcher, disabling cache 2024-09-19T11:59:28.902 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.905+0000 7fb6f3b2d9c0 20 remove_watcher() i=1 2024-09-19T11:59:28.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.909+0000 7fb6f3b2d9c0 20 remove_watcher() i=2 2024-09-19T11:59:28.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.909+0000 7fb6f3b2d9c0 20 remove_watcher() i=3 2024-09-19T11:59:28.908 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.913+0000 7fb6f3b2d9c0 20 remove_watcher() i=4 2024-09-19T11:59:28.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.913+0000 7fb6f3b2d9c0 20 remove_watcher() i=5 2024-09-19T11:59:28.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.917+0000 7fb6f3b2d9c0 20 remove_watcher() i=6 2024-09-19T11:59:28.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:28.917+0000 7fb6f3b2d9c0 20 remove_watcher() i=7 2024-09-19T11:59:28.927 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:28.927 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:59:28.927 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-change-reshard-state id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:59:28.927 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:28.928 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-19T11:59:28.961 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:59:28.961 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:59:29.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.009+0000 7fb8343b09c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.013+0000 7fb8343b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.013+0000 7fb8343b09c0 20 realm 2024-09-19T11:59:29.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.013+0000 7fb8343b09c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.013+0000 7fb8343b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.013+0000 7fb8343b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:29.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.013+0000 7fb8343b09c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.013+0000 7fb8343b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.013+0000 7fb8343b09c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.013+0000 7fb8343b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:29.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.013+0000 7fb8343b09c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.017+0000 7fb8343b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:29.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.017+0000 7fb8343b09c0 20 searching for the correct realm 2024-09-19T11:59:29.015 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.021+0000 7fb831eb6640 0 -- 172.21.15.120:0/3306190236 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fb82401a040 msgr2=0x7fb8240635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:29.233 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.237+0000 7fb831eb6640 0 -- 172.21.15.120:0/3306190236 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fb82401a040 msgr2=0x7fb8240635f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:29.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.249+0000 7fb8343b09c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:29.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.249+0000 7fb8343b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:29.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.249+0000 7fb8343b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:29.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.249+0000 7fb8343b09c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:29.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.249+0000 7fb8343b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:29.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.249+0000 7fb8343b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:29.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.249+0000 7fb8343b09c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.246 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.249+0000 7fb8343b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.249+0000 7fb8343b09c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:29.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.247 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:29.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 20 zone default found 2024-09-19T11:59:29.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 4 Realm: () 2024-09-19T11:59:29.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:29.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:29.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:29.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 20 zonegroup default 2024-09-19T11:59:29.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 20 started sync module instance, tier type = 2024-09-19T11:59:29.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.253+0000 7fb8343b09c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:29.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.277+0000 7fb8343b09c0 20 add_watcher() i=0 2024-09-19T11:59:29.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.277+0000 7fb8343b09c0 20 add_watcher() i=1 2024-09-19T11:59:29.273 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.277+0000 7fb8343b09c0 20 add_watcher() i=2 2024-09-19T11:59:29.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.277+0000 7fb8343b09c0 20 add_watcher() i=3 2024-09-19T11:59:29.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.277+0000 7fb8343b09c0 20 add_watcher() i=4 2024-09-19T11:59:29.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.277+0000 7fb8343b09c0 20 add_watcher() i=5 2024-09-19T11:59:29.274 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.277+0000 7fb8343b09c0 20 add_watcher() i=6 2024-09-19T11:59:29.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.281+0000 7fb8343b09c0 20 add_watcher() i=7 2024-09-19T11:59:29.275 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.281+0000 7fb8343b09c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:29.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.285+0000 7fb6e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:29.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.285+0000 7fb8343b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:29.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.285+0000 7fb8343b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:29.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.285+0000 7fb8343b09c0 5 note: GC not initialized 2024-09-19T11:59:29.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.285+0000 7fb6e27fc640 20 reqs_thread_entry: start 2024-09-19T11:59:29.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.285+0000 7fb8343b09c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:29.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.285+0000 7fb8343b09c0 20 Filter name: none 2024-09-19T11:59:29.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.285+0000 7fb653fff640 20 reqs_thread_entry: start 2024-09-19T11:59:29.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.285+0000 7fb8343b09c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-19T11:59:29.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.285+0000 7fb8343b09c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.289+0000 7fb8343b09c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:29.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.289+0000 7fb8343b09c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-19T11:59:29.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.289+0000 7fb8343b09c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-19T11:59:29.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.289+0000 7fb8343b09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 : miss 2024-09-19T11:59:29.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.289+0000 7fb8343b09c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.289+0000 7fb8343b09c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:29.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.289+0000 7fb8343b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 info.flags=0x17 2024-09-19T11:59:29.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.289+0000 7fb8343b09c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 to cache LRU end 2024-09-19T11:59:29.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.289+0000 7fb8343b09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:59:29.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.289+0000 7fb8343b09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:29.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.289+0000 7fb8343b09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 2024-09-19T11:59:29.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.297+0000 7fb8343b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 info.flags=0x17 2024-09-19T11:59:29.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.297+0000 7fb8343b09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 to cache LRU end 2024-09-19T11:59:29.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.297+0000 7fb8343b09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:29.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.297+0000 7fb8343b09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38, ofs0, ns] 2024-09-19T11:59:29.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.301+0000 7fb7157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366204 cookie 94051570072240 notifier 7388 bl.length()=1015 2024-09-19T11:59:29.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.301+0000 7fb7157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 info.flags=0x17 2024-09-19T11:59:29.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.301+0000 7fb7157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 to cache LRU end 2024-09-19T11:59:29.295 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.301+0000 7fb7157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:29.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.301+0000 7fb8343b09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): orig_sources= new_sources= 2024-09-19T11:59:29.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.301+0000 7fb8343b09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): potential sources added=[] removed=[] 2024-09-19T11:59:29.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.301+0000 7fb8343b09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): orig_dests= new_dests= 2024-09-19T11:59:29.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.301+0000 7fb8343b09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): potential dests added=[] removed=[] 2024-09-19T11:59:29.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.305+0000 7fb8343b09c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38.1.0 2024-09-19T11:59:29.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.305+0000 7fb8343b09c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38.1.0 2024-09-19T11:59:29.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.305+0000 7fb8343b09c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38.1.1 2024-09-19T11:59:29.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.305+0000 7fb8343b09c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38.1.1 2024-09-19T11:59:29.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.305+0000 7fb8343b09c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38.0 2024-09-19T11:59:29.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.309+0000 7fb8343b09c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-19T11:59:29.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.309+0000 7fb8343b09c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-19T11:59:29.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.321+0000 7fb8343b09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 : hit (requested=0x17, cached=0x17) 2024-09-19T11:59:29.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.321+0000 7fb8343b09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 2024-09-19T11:59:29.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.321+0000 7fb8343b09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 info.flags=0x17 2024-09-19T11:59:29.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.321+0000 7fb8343b09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 to cache LRU end 2024-09-19T11:59:29.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.321+0000 7fb8343b09c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:29.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.321+0000 7fb8343b09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38, ofs0, ns] 2024-09-19T11:59:29.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.321+0000 7fb7157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366205 cookie 94051570072240 notifier 7388 bl.length()=983 2024-09-19T11:59:29.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.321+0000 7fb7157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 info.flags=0x17 2024-09-19T11:59:29.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.321+0000 7fb7157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 to cache LRU end 2024-09-19T11:59:29.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.321+0000 7fb7157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:29.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.325+0000 7fb8343b09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): orig_sources= new_sources= 2024-09-19T11:59:29.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.325+0000 7fb8343b09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): potential sources added=[] removed=[] 2024-09-19T11:59:29.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.325+0000 7fb8343b09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): orig_dests= new_dests= 2024-09-19T11:59:29.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.325+0000 7fb8343b09c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): potential dests added=[] removed=[] 2024-09-19T11:59:29.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.325+0000 7fb8343b09c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-19T11:59:29.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.329+0000 7fb6e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:29.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.333+0000 7fb8343b09c0 20 remove_watcher() i=0 2024-09-19T11:59:29.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.333+0000 7fb8343b09c0 2 removed watcher, disabling cache 2024-09-19T11:59:29.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.337+0000 7fb8343b09c0 20 remove_watcher() i=1 2024-09-19T11:59:29.336 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.337+0000 7fb8343b09c0 20 remove_watcher() i=2 2024-09-19T11:59:29.336 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.341+0000 7fb8343b09c0 20 remove_watcher() i=3 2024-09-19T11:59:29.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.341+0000 7fb8343b09c0 20 remove_watcher() i=4 2024-09-19T11:59:29.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.345+0000 7fb8343b09c0 20 remove_watcher() i=5 2024-09-19T11:59:29.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.345+0000 7fb8343b09c0 20 remove_watcher() i=6 2024-09-19T11:59:29.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.349+0000 7fb8343b09c0 20 remove_watcher() i=7 2024-09-19T11:59:29.361 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-19T11:59:29.391 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:59:29.391 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:59:29.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.441+0000 7fcf6e18c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.441+0000 7fcf6e18c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.441+0000 7fcf6e18c9c0 20 realm 2024-09-19T11:59:29.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.441+0000 7fcf6e18c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.441+0000 7fcf6e18c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.441+0000 7fcf6e18c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:29.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.441+0000 7fcf6e18c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.441+0000 7fcf6e18c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.441+0000 7fcf6e18c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.445+0000 7fcf6e18c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:29.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.445+0000 7fcf6e18c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.445+0000 7fcf6e18c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:29.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.445+0000 7fcf6e18c9c0 20 searching for the correct realm 2024-09-19T11:59:29.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.449+0000 7fcf6c493640 0 -- 172.21.15.120:0/940436272 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fcf6006a040 msgr2=0x7fcf60026460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:29.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.457+0000 7fcf6b491640 0 -- 172.21.15.120:0/940436272 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fcf5c01e410 msgr2=0x7fcf5c01e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:29.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:29.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:29.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:29.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:29.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:29.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:29.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.673 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:29.673 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:29.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 zone default found 2024-09-19T11:59:29.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 4 Realm: () 2024-09-19T11:59:29.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:29.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:29.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:29.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 zonegroup default 2024-09-19T11:59:29.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.677+0000 7fcf6e18c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.681+0000 7fcf6e18c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.681+0000 7fcf6e18c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.681+0000 7fcf6e18c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.681+0000 7fcf6e18c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.681+0000 7fcf6e18c9c0 20 started sync module instance, tier type = 2024-09-19T11:59:29.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.681+0000 7fcf6e18c9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:29.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.709+0000 7fcf6e18c9c0 20 add_watcher() i=0 2024-09-19T11:59:29.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.709+0000 7fcf6e18c9c0 20 add_watcher() i=1 2024-09-19T11:59:29.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.709+0000 7fcf6e18c9c0 20 add_watcher() i=2 2024-09-19T11:59:29.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.709+0000 7fcf6e18c9c0 20 add_watcher() i=3 2024-09-19T11:59:29.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.709+0000 7fcf6e18c9c0 20 add_watcher() i=4 2024-09-19T11:59:29.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.709+0000 7fcf6e18c9c0 20 add_watcher() i=5 2024-09-19T11:59:29.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.709+0000 7fcf6e18c9c0 20 add_watcher() i=6 2024-09-19T11:59:29.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.709+0000 7fcf6e18c9c0 20 add_watcher() i=7 2024-09-19T11:59:29.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.709+0000 7fcf6e18c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:29.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.713+0000 7fce21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:29.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.713+0000 7fcf6e18c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:29.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.713+0000 7fcf6e18c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:29.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.717+0000 7fcf6e18c9c0 5 note: GC not initialized 2024-09-19T11:59:29.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.717+0000 7fce20fe1640 20 reqs_thread_entry: start 2024-09-19T11:59:29.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.717+0000 7fcf6e18c9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:29.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.717+0000 7fcf6e18c9c0 20 Filter name: none 2024-09-19T11:59:29.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.717+0000 7fcd9a7fc640 20 reqs_thread_entry: start 2024-09-19T11:59:29.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.717+0000 7fcf6e18c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.717+0000 7fcf6e18c9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:29.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.717+0000 7fcf6e18c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.717+0000 7fcf6e18c9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:29.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.717+0000 7fcf6e18c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:29.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.717+0000 7fcf6e18c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.721+0000 7fcf6e18c9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:29.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.721+0000 7fcf6e18c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.721+0000 7fcf6e18c9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:29.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.721+0000 7fcf6e18c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:29.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.725+0000 7fce21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:29.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.729+0000 7fcf6e18c9c0 20 remove_watcher() i=0 2024-09-19T11:59:29.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.729+0000 7fcf6e18c9c0 2 removed watcher, disabling cache 2024-09-19T11:59:29.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.729+0000 7fcf6e18c9c0 20 remove_watcher() i=1 2024-09-19T11:59:29.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.733+0000 7fcf6e18c9c0 20 remove_watcher() i=2 2024-09-19T11:59:29.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.737+0000 7fcf6e18c9c0 20 remove_watcher() i=3 2024-09-19T11:59:29.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.737+0000 7fcf6e18c9c0 20 remove_watcher() i=4 2024-09-19T11:59:29.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.741+0000 7fcf6e18c9c0 20 remove_watcher() i=5 2024-09-19T11:59:29.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.741+0000 7fcf6e18c9c0 20 remove_watcher() i=6 2024-09-19T11:59:29.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.741+0000 7fcf6e18c9c0 20 remove_watcher() i=7 2024-09-19T11:59:29.755 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:29.755 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:59:29.756 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-change-reshard-state id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:59:29.756 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:29.812 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:59:29.849 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:59:29.850 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:59:29.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.901+0000 7f4c1e4a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.901+0000 7f4c1e4a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.901+0000 7f4c1e4a49c0 20 realm 2024-09-19T11:59:29.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.901+0000 7f4c1e4a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.901+0000 7f4c1e4a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.901+0000 7f4c1e4a49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:29.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.901+0000 7f4c1e4a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.901+0000 7f4c1e4a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:29.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.901+0000 7f4c1e4a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.905+0000 7f4c1e4a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:29.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.905+0000 7f4c1e4a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:29.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.905+0000 7f4c1e4a49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:29.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.905+0000 7f4c1e4a49c0 20 searching for the correct realm 2024-09-19T11:59:29.904 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.909+0000 7f4c1c7ab640 0 -- 172.21.15.120:0/4099772785 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f4c10008040 msgr2=0x7f4c100583d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:29.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:29.917+0000 7f4c1b7a9640 0 -- 172.21.15.120:0/4099772785 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f4c0c0e4040 msgr2=0x7f4c0c0e4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:59:30.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:30.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:30.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:30.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:30.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:30.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:30.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:30.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:30.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:30.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 zone default found 2024-09-19T11:59:30.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 4 Realm: () 2024-09-19T11:59:30.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:30.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:30.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:30.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 zonegroup default 2024-09-19T11:59:30.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:30.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.137+0000 7f4c1e4a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.141+0000 7f4c1e4a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:30.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.141+0000 7f4c1e4a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.141+0000 7f4c1e4a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:30.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.141+0000 7f4c1e4a49c0 20 started sync module instance, tier type = 2024-09-19T11:59:30.136 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.141+0000 7f4c1e4a49c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:30.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.165+0000 7f4c1e4a49c0 20 add_watcher() i=0 2024-09-19T11:59:30.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.165+0000 7f4c1e4a49c0 20 add_watcher() i=1 2024-09-19T11:59:30.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.165+0000 7f4c1e4a49c0 20 add_watcher() i=2 2024-09-19T11:59:30.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.165+0000 7f4c1e4a49c0 20 add_watcher() i=3 2024-09-19T11:59:30.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.165+0000 7f4c1e4a49c0 20 add_watcher() i=4 2024-09-19T11:59:30.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.165+0000 7f4c1e4a49c0 20 add_watcher() i=5 2024-09-19T11:59:30.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.165+0000 7f4c1e4a49c0 20 add_watcher() i=6 2024-09-19T11:59:30.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.165+0000 7f4c1e4a49c0 20 add_watcher() i=7 2024-09-19T11:59:30.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.165+0000 7f4c1e4a49c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:30.167 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.173+0000 7f4ad1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:30.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.173+0000 7f4c1e4a49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:30.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.173+0000 7f4c1e4a49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:30.169 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.173+0000 7f4c1e4a49c0 5 note: GC not initialized 2024-09-19T11:59:30.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.173+0000 7f4ad0fe1640 20 reqs_thread_entry: start 2024-09-19T11:59:30.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.173+0000 7f4c1e4a49c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:30.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.173+0000 7f4c1e4a49c0 20 Filter name: none 2024-09-19T11:59:30.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.173+0000 7f4a4a7fc640 20 reqs_thread_entry: start 2024-09-19T11:59:30.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.173+0000 7f4c1e4a49c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-19T11:59:30.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.173+0000 7f4c1e4a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.173+0000 7f4c1e4a49c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:30.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.173+0000 7f4c1e4a49c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-19T11:59:30.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.173+0000 7f4c1e4a49c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-19T11:59:30.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.173+0000 7f4c1e4a49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 : miss 2024-09-19T11:59:30.172 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.173+0000 7f4c1e4a49c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.177+0000 7f4c1e4a49c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:30.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.177+0000 7f4c1e4a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 info.flags=0x17 2024-09-19T11:59:30.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.177+0000 7f4c1e4a49c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 to cache LRU end 2024-09-19T11:59:30.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.177+0000 7f4c1e4a49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:59:30.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.177+0000 7f4c1e4a49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:30.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.177+0000 7f4c1e4a49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 2024-09-19T11:59:30.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.185+0000 7f4c1e4a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 info.flags=0x17 2024-09-19T11:59:30.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.185+0000 7f4c1e4a49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 to cache LRU end 2024-09-19T11:59:30.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.185+0000 7f4c1e4a49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:30.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.185+0000 7f4c1e4a49c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38, ofs0, ns] 2024-09-19T11:59:30.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.185+0000 7f4afaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366206 cookie 94844923803488 notifier 7421 bl.length()=1015 2024-09-19T11:59:30.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.185+0000 7f4afaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 info.flags=0x17 2024-09-19T11:59:30.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.185+0000 7f4afaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 to cache LRU end 2024-09-19T11:59:30.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.185+0000 7f4afaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:30.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.185+0000 7f4c1e4a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): orig_sources= new_sources= 2024-09-19T11:59:30.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.185+0000 7f4c1e4a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): potential sources added=[] removed=[] 2024-09-19T11:59:30.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.185+0000 7f4c1e4a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): orig_dests= new_dests= 2024-09-19T11:59:30.182 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.185+0000 7f4c1e4a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): potential dests added=[] removed=[] 2024-09-19T11:59:30.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.193+0000 7f4c1e4a49c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38.1.0 2024-09-19T11:59:30.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.193+0000 7f4c1e4a49c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38.1.0 2024-09-19T11:59:30.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.193+0000 7f4c1e4a49c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38.1.1 2024-09-19T11:59:30.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.193+0000 7f4c1e4a49c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38.1.1 2024-09-19T11:59:30.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.193+0000 7f4c1e4a49c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38.0 2024-09-19T11:59:30.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.193+0000 7f4c1e4a49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 : hit (requested=0x17, cached=0x17) 2024-09-19T11:59:30.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.193+0000 7f4c1e4a49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 2024-09-19T11:59:30.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.197+0000 7f4c1e4a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 info.flags=0x17 2024-09-19T11:59:30.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.197+0000 7f4c1e4a49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 to cache LRU end 2024-09-19T11:59:30.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.197+0000 7f4c1e4a49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:30.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.197+0000 7f4c1e4a49c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38, ofs0, ns] 2024-09-19T11:59:30.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.197+0000 7f4afaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366207 cookie 94844923803488 notifier 7421 bl.length()=1015 2024-09-19T11:59:30.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.197+0000 7f4afaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 info.flags=0x17 2024-09-19T11:59:30.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.197+0000 7f4afaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 to cache LRU end 2024-09-19T11:59:30.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.197+0000 7f4afaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:30.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.201+0000 7f4c1e4a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): orig_sources= new_sources= 2024-09-19T11:59:30.196 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.201+0000 7f4c1e4a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): potential sources added=[] removed=[] 2024-09-19T11:59:30.196 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.201+0000 7f4c1e4a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): orig_dests= new_dests= 2024-09-19T11:59:30.196 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.201+0000 7f4c1e4a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): potential dests added=[] removed=[] 2024-09-19T11:59:30.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.201+0000 7f4c1e4a49c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38.0 2024-09-19T11:59:30.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.201+0000 7f4c1e4a49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 : hit (requested=0x17, cached=0x17) 2024-09-19T11:59:30.199 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.201+0000 7f4c1e4a49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 2024-09-19T11:59:30.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.205+0000 7f4c1e4a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 info.flags=0x17 2024-09-19T11:59:30.201 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.205+0000 7f4c1e4a49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 to cache LRU end 2024-09-19T11:59:30.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.205+0000 7f4c1e4a49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:30.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.205+0000 7f4c1e4a49c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38, ofs0, ns] 2024-09-19T11:59:30.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.205+0000 7f4afa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366208 cookie 94844923803488 notifier 7421 bl.length()=983 2024-09-19T11:59:30.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.205+0000 7f4afa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 info.flags=0x17 2024-09-19T11:59:30.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.205+0000 7f4afa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 to cache LRU end 2024-09-19T11:59:30.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.205+0000 7f4afa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:30.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.209+0000 7f4c1e4a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): orig_sources= new_sources= 2024-09-19T11:59:30.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.209+0000 7f4c1e4a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): potential sources added=[] removed=[] 2024-09-19T11:59:30.203 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.209+0000 7f4c1e4a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): orig_dests= new_dests= 2024-09-19T11:59:30.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.209+0000 7f4c1e4a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38]): potential dests added=[] removed=[] 2024-09-19T11:59:30.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.209+0000 7f4c1e4a49c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-19T11:59:30.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.213+0000 7f4ad1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:30.214 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.217+0000 7f4c1e4a49c0 20 remove_watcher() i=0 2024-09-19T11:59:30.215 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.217+0000 7f4c1e4a49c0 2 removed watcher, disabling cache 2024-09-19T11:59:30.217 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.221+0000 7f4c1e4a49c0 20 remove_watcher() i=1 2024-09-19T11:59:30.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.225+0000 7f4c1e4a49c0 20 remove_watcher() i=2 2024-09-19T11:59:30.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.225+0000 7f4c1e4a49c0 20 remove_watcher() i=3 2024-09-19T11:59:30.223 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.229+0000 7f4c1e4a49c0 20 remove_watcher() i=4 2024-09-19T11:59:30.224 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.229+0000 7f4c1e4a49c0 20 remove_watcher() i=5 2024-09-19T11:59:30.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.229+0000 7f4c1e4a49c0 20 remove_watcher() i=6 2024-09-19T11:59:30.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.233+0000 7f4c1e4a49c0 20 remove_watcher() i=7 2024-09-19T11:59:30.246 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-19T11:59:30.276 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:59:30.276 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:59:30.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.325+0000 7fb00a8bc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.329+0000 7fb00a8bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:30.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.329+0000 7fb00a8bc9c0 20 realm 2024-09-19T11:59:30.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.329+0000 7fb00a8bc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.329+0000 7fb00a8bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:30.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.329+0000 7fb00a8bc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:30.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.329+0000 7fb00a8bc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.329+0000 7fb00a8bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:30.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.329+0000 7fb00a8bc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.329+0000 7fb00a8bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:30.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.329+0000 7fb00a8bc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.333+0000 7fb00a8bc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:30.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.333+0000 7fb00a8bc9c0 20 searching for the correct realm 2024-09-19T11:59:30.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.337+0000 7fb0083c2640 0 -- 172.21.15.120:0/2940952084 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fb000039410 msgr2=0x7fb000039830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:30.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.553+0000 7fb0083c2640 0 -- 172.21.15.120:0/2940952084 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fb000039410 msgr2=0x7fb000039830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:30.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:30.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:30.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:30.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:30.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:30.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:30.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:30.564 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:30.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:30.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 zone default found 2024-09-19T11:59:30.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 4 Realm: () 2024-09-19T11:59:30.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:30.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:30.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:30.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 zonegroup default 2024-09-19T11:59:30.566 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:30.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.569+0000 7fb00a8bc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.573+0000 7fb00a8bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:30.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.573+0000 7fb00a8bc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.573+0000 7fb00a8bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:30.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.573+0000 7fb00a8bc9c0 20 started sync module instance, tier type = 2024-09-19T11:59:30.568 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.573+0000 7fb00a8bc9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:30.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.597+0000 7fb00a8bc9c0 20 add_watcher() i=0 2024-09-19T11:59:30.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.597+0000 7fb00a8bc9c0 20 add_watcher() i=1 2024-09-19T11:59:30.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.597+0000 7fb00a8bc9c0 20 add_watcher() i=2 2024-09-19T11:59:30.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.597+0000 7fb00a8bc9c0 20 add_watcher() i=3 2024-09-19T11:59:30.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.597+0000 7fb00a8bc9c0 20 add_watcher() i=4 2024-09-19T11:59:30.591 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.597+0000 7fb00a8bc9c0 20 add_watcher() i=5 2024-09-19T11:59:30.592 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.597+0000 7fb00a8bc9c0 20 add_watcher() i=6 2024-09-19T11:59:30.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.597+0000 7fb00a8bc9c0 20 add_watcher() i=7 2024-09-19T11:59:30.593 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.597+0000 7fb00a8bc9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:30.597 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.601+0000 7faebefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:30.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.601+0000 7fb00a8bc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:30.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.601+0000 7fb00a8bc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:30.598 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.601+0000 7fb00a8bc9c0 5 note: GC not initialized 2024-09-19T11:59:30.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.601+0000 7faebdfdb640 20 reqs_thread_entry: start 2024-09-19T11:59:30.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.605+0000 7fb00a8bc9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:30.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.605+0000 7fb00a8bc9c0 20 Filter name: none 2024-09-19T11:59:30.599 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.605+0000 7fae2f7fe640 20 reqs_thread_entry: start 2024-09-19T11:59:30.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.605+0000 7fb00a8bc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.605+0000 7fb00a8bc9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:30.600 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.605+0000 7fb00a8bc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.605+0000 7fb00a8bc9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:30.601 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.605+0000 7fb00a8bc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:30.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.605+0000 7fb00a8bc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.605+0000 7fb00a8bc9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:30.602 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.605+0000 7fb00a8bc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:30.603 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.609+0000 7fb00a8bc9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:30.604 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.609+0000 7fb00a8bc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:30.606 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.609+0000 7faebefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:30.610 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.613+0000 7fb00a8bc9c0 20 remove_watcher() i=0 2024-09-19T11:59:30.611 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.617+0000 7fb00a8bc9c0 2 removed watcher, disabling cache 2024-09-19T11:59:30.613 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.617+0000 7fb00a8bc9c0 20 remove_watcher() i=1 2024-09-19T11:59:30.615 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.621+0000 7fb00a8bc9c0 20 remove_watcher() i=2 2024-09-19T11:59:30.617 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.621+0000 7fb00a8bc9c0 20 remove_watcher() i=3 2024-09-19T11:59:30.619 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.625+0000 7fb00a8bc9c0 20 remove_watcher() i=4 2024-09-19T11:59:30.621 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.625+0000 7fb00a8bc9c0 20 remove_watcher() i=5 2024-09-19T11:59:30.622 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.625+0000 7fb00a8bc9c0 20 remove_watcher() i=6 2024-09-19T11:59:30.624 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:30.629+0000 7fb00a8bc9c0 20 remove_watcher() i=7 2024-09-19T11:59:30.638 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:30.638 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:59:30.638 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-change-reshard-state id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T11:59:30.638 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:30.719 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-19T11:59:30.719 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:31.173 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-19T11:59:31.205 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:59:31.205 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:59:31.250 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.253+0000 7fc89eb3e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:31.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.257+0000 7fc89eb3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:31.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.257+0000 7fc89eb3e9c0 20 realm 2024-09-19T11:59:31.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.257+0000 7fc89eb3e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:31.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.257+0000 7fc89eb3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:31.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.257+0000 7fc89eb3e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:31.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.257+0000 7fc89eb3e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:31.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.257+0000 7fc89eb3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:31.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.257+0000 7fc89eb3e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:31.254 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.261+0000 7fc89eb3e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:31.255 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.261+0000 7fc89eb3e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:31.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.261+0000 7fc89eb3e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:31.256 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.261+0000 7fc89eb3e9c0 20 searching for the correct realm 2024-09-19T11:59:31.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.265+0000 7fc89ce45640 0 -- 172.21.15.120:0/366322235 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fc89001bbd0 msgr2=0x7fc8900433f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:59:31.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.481+0000 7fc89be43640 0 -- 172.21.15.120:0/366322235 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fc88c0e6be0 msgr2=0x7fc88c0f7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:59:31.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.697+0000 7fc89eb3e9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:31.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.697+0000 7fc89eb3e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:31.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.697+0000 7fc89eb3e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:31.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.697+0000 7fc89eb3e9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:31.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.697+0000 7fc89eb3e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:31.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.697+0000 7fc89eb3e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:31.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.697+0000 7fc89eb3e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:31.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.697+0000 7fc89eb3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:31.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.697+0000 7fc89eb3e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:31.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.701+0000 7fc89eb3e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:31.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.701+0000 7fc89eb3e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:31.696 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.701+0000 7fc89eb3e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:31.696 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.701+0000 7fc89eb3e9c0 20 zone default found 2024-09-19T11:59:31.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.701+0000 7fc89eb3e9c0 4 Realm: () 2024-09-19T11:59:31.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.701+0000 7fc89eb3e9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:31.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.701+0000 7fc89eb3e9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:31.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.701+0000 7fc89eb3e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:31.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.701+0000 7fc89eb3e9c0 20 zonegroup default 2024-09-19T11:59:31.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.701+0000 7fc89eb3e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:31.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.701+0000 7fc89eb3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:31.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.701+0000 7fc89eb3e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:31.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.701+0000 7fc89eb3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:31.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.701+0000 7fc89eb3e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:31.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.701+0000 7fc89eb3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:31.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.705+0000 7fc89eb3e9c0 20 started sync module instance, tier type = 2024-09-19T11:59:31.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.705+0000 7fc89eb3e9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:31.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.729+0000 7fc89eb3e9c0 20 add_watcher() i=0 2024-09-19T11:59:31.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.729+0000 7fc89eb3e9c0 20 add_watcher() i=1 2024-09-19T11:59:31.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.729+0000 7fc89eb3e9c0 20 add_watcher() i=2 2024-09-19T11:59:31.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.729+0000 7fc89eb3e9c0 20 add_watcher() i=3 2024-09-19T11:59:31.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.729+0000 7fc89eb3e9c0 20 add_watcher() i=4 2024-09-19T11:59:31.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.729+0000 7fc89eb3e9c0 20 add_watcher() i=5 2024-09-19T11:59:31.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.729+0000 7fc89eb3e9c0 20 add_watcher() i=6 2024-09-19T11:59:31.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.729+0000 7fc89eb3e9c0 20 add_watcher() i=7 2024-09-19T11:59:31.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.729+0000 7fc89eb3e9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:31.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.733+0000 7fc752fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:31.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.737+0000 7fc89eb3e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:31.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.737+0000 7fc89eb3e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:31.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.737+0000 7fc89eb3e9c0 5 note: GC not initialized 2024-09-19T11:59:31.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.737+0000 7fc751fdb640 20 reqs_thread_entry: start 2024-09-19T11:59:31.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.737+0000 7fc89eb3e9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:31.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.737+0000 7fc89eb3e9c0 20 Filter name: none 2024-09-19T11:59:31.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.737+0000 7fc6c37fe640 20 reqs_thread_entry: start 2024-09-19T11:59:31.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.737+0000 7fc89eb3e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:31.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.737+0000 7fc89eb3e9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:31.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.737+0000 7fc89eb3e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:31.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.737+0000 7fc89eb3e9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:31.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.737+0000 7fc89eb3e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:31.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.737+0000 7fc89eb3e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:31.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.741+0000 7fc89eb3e9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:31.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.741+0000 7fc89eb3e9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:31.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.741+0000 7fc89eb3e9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:31.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.741+0000 7fc89eb3e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:31.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.745+0000 7fc752fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:31.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.749+0000 7fc89eb3e9c0 20 remove_watcher() i=0 2024-09-19T11:59:31.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.749+0000 7fc89eb3e9c0 2 removed watcher, disabling cache 2024-09-19T11:59:31.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.749+0000 7fc89eb3e9c0 20 remove_watcher() i=1 2024-09-19T11:59:31.748 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.753+0000 7fc89eb3e9c0 20 remove_watcher() i=2 2024-09-19T11:59:31.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.753+0000 7fc89eb3e9c0 20 remove_watcher() i=3 2024-09-19T11:59:31.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.757+0000 7fc89eb3e9c0 20 remove_watcher() i=4 2024-09-19T11:59:31.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.757+0000 7fc89eb3e9c0 20 remove_watcher() i=5 2024-09-19T11:59:31.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.761+0000 7fc89eb3e9c0 20 remove_watcher() i=6 2024-09-19T11:59:31.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:31.761+0000 7fc89eb3e9c0 20 remove_watcher() i=7 2024-09-19T11:59:31.771 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:31.772 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:59:31.772 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-change-reshard-state id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:59:31.772 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:31.772 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-19T11:59:31.807 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:59:31.808 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:59:32.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.041+0000 7fbfc4713640 0 --2- 172.21.15.120:0/1875734201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564d1b8c4df0 0x564d1b8fbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-19T11:59:32.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.069+0000 7fbfc640c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.069+0000 7fbfc640c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:32.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.069+0000 7fbfc640c9c0 20 realm 2024-09-19T11:59:32.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.069+0000 7fbfc640c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.069+0000 7fbfc640c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:32.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.069+0000 7fbfc640c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:32.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.069+0000 7fbfc640c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.069+0000 7fbfc640c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:32.066 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.069+0000 7fbfc640c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.073+0000 7fbfc640c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:32.068 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.073+0000 7fbfc640c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.073+0000 7fbfc640c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:32.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.073+0000 7fbfc640c9c0 20 searching for the correct realm 2024-09-19T11:59:32.071 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.077+0000 7fbfc3711640 0 -- 172.21.15.120:0/144441576 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7fbfb4008050 msgr2=0x7fbfb4038410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:32.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.289+0000 7fbfc4713640 0 -- 172.21.15.120:0/144441576 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fbfb8087040 msgr2=0x7fbfb8037030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:32.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.309+0000 7fbfc640c9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:32.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.309+0000 7fbfc640c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:32.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.309+0000 7fbfc640c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:32.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.309+0000 7fbfc640c9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:32.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.309+0000 7fbfc640c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:32.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.309+0000 7fbfc640c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:32.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.309+0000 7fbfc640c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.309+0000 7fbfc640c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:32.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.309+0000 7fbfc640c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.309+0000 7fbfc640c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:32.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.309+0000 7fbfc640c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.313+0000 7fbfc640c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:32.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.313+0000 7fbfc640c9c0 20 zone default found 2024-09-19T11:59:32.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.313+0000 7fbfc640c9c0 4 Realm: () 2024-09-19T11:59:32.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.313+0000 7fbfc640c9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:32.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.313+0000 7fbfc640c9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:32.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.313+0000 7fbfc640c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:32.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.313+0000 7fbfc640c9c0 20 zonegroup default 2024-09-19T11:59:32.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.313+0000 7fbfc640c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.308 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.313+0000 7fbfc640c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:32.308 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.313+0000 7fbfc640c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.308 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.313+0000 7fbfc640c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:32.309 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.313+0000 7fbfc640c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.309 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.313+0000 7fbfc640c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:32.309 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.313+0000 7fbfc640c9c0 20 started sync module instance, tier type = 2024-09-19T11:59:32.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.313+0000 7fbfc640c9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:32.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.337+0000 7fbfc640c9c0 20 add_watcher() i=0 2024-09-19T11:59:32.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.337+0000 7fbfc640c9c0 20 add_watcher() i=1 2024-09-19T11:59:32.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.337+0000 7fbfc640c9c0 20 add_watcher() i=2 2024-09-19T11:59:32.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.337+0000 7fbfc640c9c0 20 add_watcher() i=3 2024-09-19T11:59:32.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.337+0000 7fbfc640c9c0 20 add_watcher() i=4 2024-09-19T11:59:32.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.337+0000 7fbfc640c9c0 20 add_watcher() i=5 2024-09-19T11:59:32.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.337+0000 7fbfc640c9c0 20 add_watcher() i=6 2024-09-19T11:59:32.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.337+0000 7fbfc640c9c0 20 add_watcher() i=7 2024-09-19T11:59:32.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.337+0000 7fbfc640c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:32.337 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.341+0000 7fbe79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:32.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.341+0000 7fbfc640c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:32.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.341+0000 7fbfc640c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:32.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.341+0000 7fbfc640c9c0 5 note: GC not initialized 2024-09-19T11:59:32.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.341+0000 7fbe78fe1640 20 reqs_thread_entry: start 2024-09-19T11:59:32.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.341+0000 7fbfc640c9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:32.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.341+0000 7fbfc640c9c0 20 Filter name: none 2024-09-19T11:59:32.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.341+0000 7fbdf27fc640 20 reqs_thread_entry: start 2024-09-19T11:59:32.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.345+0000 7fbfc640c9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-19T11:59:32.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.345+0000 7fbfc640c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.345+0000 7fbfc640c9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:32.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.345+0000 7fbfc640c9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-19T11:59:32.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.345+0000 7fbfc640c9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-19T11:59:32.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.345+0000 7fbfc640c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 : miss 2024-09-19T11:59:32.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.345+0000 7fbfc640c9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.345+0000 7fbfc640c9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:32.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.345+0000 7fbfc640c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 info.flags=0x17 2024-09-19T11:59:32.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.345+0000 7fbfc640c9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 to cache LRU end 2024-09-19T11:59:32.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.345+0000 7fbfc640c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:59:32.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.345+0000 7fbfc640c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:32.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.345+0000 7fbfc640c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 2024-09-19T11:59:32.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.353+0000 7fbfc640c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 info.flags=0x17 2024-09-19T11:59:32.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.353+0000 7fbfc640c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 to cache LRU end 2024-09-19T11:59:32.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.353+0000 7fbfc640c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:32.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.353+0000 7fbfc640c9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39, ofs0, ns] 2024-09-19T11:59:32.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.357+0000 7fbea27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366211 cookie 94889175638832 notifier 8034 bl.length()=1015 2024-09-19T11:59:32.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.357+0000 7fbea27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 info.flags=0x17 2024-09-19T11:59:32.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.357+0000 7fbea27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 to cache LRU end 2024-09-19T11:59:32.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.357+0000 7fbea27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:32.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.357+0000 7fbfc640c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39]): orig_sources= new_sources= 2024-09-19T11:59:32.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.357+0000 7fbfc640c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39]): potential sources added=[] removed=[] 2024-09-19T11:59:32.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.357+0000 7fbfc640c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39]): orig_dests= new_dests= 2024-09-19T11:59:32.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.357+0000 7fbfc640c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39]): potential dests added=[] removed=[] 2024-09-19T11:59:32.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.361+0000 7fbfc640c9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39.1.0 2024-09-19T11:59:32.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.361+0000 7fbfc640c9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39.1.0 2024-09-19T11:59:32.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.361+0000 7fbfc640c9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39.1.1 2024-09-19T11:59:32.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.361+0000 7fbfc640c9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39.1.1 2024-09-19T11:59:32.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.361+0000 7fbfc640c9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39.0 2024-09-19T11:59:32.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.365+0000 7fbfc640c9c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-19T11:59:32.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.365+0000 7fbfc640c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 : hit (requested=0x17, cached=0x17) 2024-09-19T11:59:32.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.365+0000 7fbfc640c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 2024-09-19T11:59:32.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.369+0000 7fbfc640c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 info.flags=0x17 2024-09-19T11:59:32.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.369+0000 7fbfc640c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 to cache LRU end 2024-09-19T11:59:32.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.369+0000 7fbfc640c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:32.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.369+0000 7fbfc640c9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39, ofs0, ns] 2024-09-19T11:59:32.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.369+0000 7fbea27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366212 cookie 94889175638832 notifier 8034 bl.length()=1015 2024-09-19T11:59:32.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.369+0000 7fbea27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 info.flags=0x17 2024-09-19T11:59:32.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.369+0000 7fbea27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 to cache LRU end 2024-09-19T11:59:32.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.369+0000 7fbea27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:32.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.369+0000 7fbfc640c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39]): orig_sources= new_sources= 2024-09-19T11:59:32.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.369+0000 7fbfc640c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39]): potential sources added=[] removed=[] 2024-09-19T11:59:32.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.369+0000 7fbfc640c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39]): orig_dests= new_dests= 2024-09-19T11:59:32.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.369+0000 7fbfc640c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39]): potential dests added=[] removed=[] 2024-09-19T11:59:32.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.373+0000 7fbfc640c9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39.0 2024-09-19T11:59:32.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.373+0000 7fbfc640c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 : hit (requested=0x17, cached=0x17) 2024-09-19T11:59:32.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.373+0000 7fbfc640c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 2024-09-19T11:59:32.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.377+0000 7fbfc640c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 info.flags=0x17 2024-09-19T11:59:32.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.377+0000 7fbfc640c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 to cache LRU end 2024-09-19T11:59:32.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.377+0000 7fbfc640c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:32.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.377+0000 7fbfc640c9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39, ofs0, ns] 2024-09-19T11:59:32.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.377+0000 7fbea2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366213 cookie 94889175638832 notifier 8034 bl.length()=983 2024-09-19T11:59:32.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.377+0000 7fbea2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 info.flags=0x17 2024-09-19T11:59:32.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.377+0000 7fbea2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 to cache LRU end 2024-09-19T11:59:32.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.377+0000 7fbea2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:32.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.377+0000 7fbfc640c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39]): orig_sources= new_sources= 2024-09-19T11:59:32.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.377+0000 7fbfc640c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39]): potential sources added=[] removed=[] 2024-09-19T11:59:32.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.377+0000 7fbfc640c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39]): orig_dests= new_dests= 2024-09-19T11:59:32.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.377+0000 7fbfc640c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39]): potential dests added=[] removed=[] 2024-09-19T11:59:32.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.381+0000 7fbfc640c9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-19T11:59:32.381 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.385+0000 7fbe79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:32.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.393+0000 7fbfc640c9c0 20 remove_watcher() i=0 2024-09-19T11:59:32.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.393+0000 7fbfc640c9c0 2 removed watcher, disabling cache 2024-09-19T11:59:32.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.393+0000 7fbfc640c9c0 20 remove_watcher() i=1 2024-09-19T11:59:32.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.397+0000 7fbfc640c9c0 20 remove_watcher() i=2 2024-09-19T11:59:32.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.397+0000 7fbfc640c9c0 20 remove_watcher() i=3 2024-09-19T11:59:32.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.401+0000 7fbfc640c9c0 20 remove_watcher() i=4 2024-09-19T11:59:32.398 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.401+0000 7fbfc640c9c0 20 remove_watcher() i=5 2024-09-19T11:59:32.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.405+0000 7fbfc640c9c0 20 remove_watcher() i=6 2024-09-19T11:59:32.401 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.405+0000 7fbfc640c9c0 20 remove_watcher() i=7 2024-09-19T11:59:32.418 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-19T11:59:32.449 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:59:32.449 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:59:32.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.501+0000 7fdbe50ee9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.501+0000 7fdbe50ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:32.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.501+0000 7fdbe50ee9c0 20 realm 2024-09-19T11:59:32.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.501+0000 7fdbe50ee9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.501+0000 7fdbe50ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:32.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.501+0000 7fdbe50ee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:32.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.501+0000 7fdbe50ee9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.501+0000 7fdbe50ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:32.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.501+0000 7fdbe50ee9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.505+0000 7fdbe50ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:32.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.505+0000 7fdbe50ee9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.505+0000 7fdbe50ee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:32.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.505+0000 7fdbe50ee9c0 20 searching for the correct realm 2024-09-19T11:59:32.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.509+0000 7fdbe33f5640 0 -- 172.21.15.120:0/3475948798 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fdbd8038070 msgr2=0x7fdbd8048930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:59:32.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.517+0000 7fdbe23f3640 0 -- 172.21.15.120:0/3475948798 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fdbd408ea60 msgr2=0x7fdbd404b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:32.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.733+0000 7fdbe50ee9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:32.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.733+0000 7fdbe50ee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:32.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.733+0000 7fdbe50ee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:32.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.733+0000 7fdbe50ee9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:32.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.733+0000 7fdbe50ee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:32.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.733+0000 7fdbe50ee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:32.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.733+0000 7fdbe50ee9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:32.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:32.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:32.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 20 zone default found 2024-09-19T11:59:32.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 4 Realm: () 2024-09-19T11:59:32.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:32.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:32.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:32.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 20 zonegroup default 2024-09-19T11:59:32.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:32.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:32.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.737+0000 7fdbe50ee9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.741+0000 7fdbe50ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:32.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.741+0000 7fdbe50ee9c0 20 started sync module instance, tier type = 2024-09-19T11:59:32.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.741+0000 7fdbe50ee9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:32.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.765+0000 7fdbe50ee9c0 20 add_watcher() i=0 2024-09-19T11:59:32.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.765+0000 7fdbe50ee9c0 20 add_watcher() i=1 2024-09-19T11:59:32.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.765+0000 7fdbe50ee9c0 20 add_watcher() i=2 2024-09-19T11:59:32.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.765+0000 7fdbe50ee9c0 20 add_watcher() i=3 2024-09-19T11:59:32.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.765+0000 7fdbe50ee9c0 20 add_watcher() i=4 2024-09-19T11:59:32.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.765+0000 7fdbe50ee9c0 20 add_watcher() i=5 2024-09-19T11:59:32.760 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.765+0000 7fdbe50ee9c0 20 add_watcher() i=6 2024-09-19T11:59:32.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.765+0000 7fdbe50ee9c0 20 add_watcher() i=7 2024-09-19T11:59:32.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.765+0000 7fdbe50ee9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:32.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.769+0000 7fda99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:32.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.773+0000 7fdbe50ee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:32.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.773+0000 7fdbe50ee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:32.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.773+0000 7fdbe50ee9c0 5 note: GC not initialized 2024-09-19T11:59:32.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.773+0000 7fda98fe1640 20 reqs_thread_entry: start 2024-09-19T11:59:32.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.773+0000 7fdbe50ee9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:32.768 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.773+0000 7fdbe50ee9c0 20 Filter name: none 2024-09-19T11:59:32.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.773+0000 7fda91ffb640 20 reqs_thread_entry: start 2024-09-19T11:59:32.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.773+0000 7fdbe50ee9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.773+0000 7fdbe50ee9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:32.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.773+0000 7fdbe50ee9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.777+0000 7fdbe50ee9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:32.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.777+0000 7fdbe50ee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:32.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.777+0000 7fdbe50ee9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.777+0000 7fdbe50ee9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:32.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.777+0000 7fdbe50ee9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:32.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.777+0000 7fdbe50ee9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:32.773 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.777+0000 7fdbe50ee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:32.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.781+0000 7fda99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:32.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.785+0000 7fdbe50ee9c0 20 remove_watcher() i=0 2024-09-19T11:59:32.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.785+0000 7fdbe50ee9c0 2 removed watcher, disabling cache 2024-09-19T11:59:32.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.789+0000 7fdbe50ee9c0 20 remove_watcher() i=1 2024-09-19T11:59:32.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.789+0000 7fdbe50ee9c0 20 remove_watcher() i=2 2024-09-19T11:59:32.788 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.793+0000 7fdbe50ee9c0 20 remove_watcher() i=3 2024-09-19T11:59:32.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.797+0000 7fdbe50ee9c0 20 remove_watcher() i=4 2024-09-19T11:59:32.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.797+0000 7fdbe50ee9c0 20 remove_watcher() i=5 2024-09-19T11:59:32.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.797+0000 7fdbe50ee9c0 20 remove_watcher() i=6 2024-09-19T11:59:32.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:32.801+0000 7fdbe50ee9c0 20 remove_watcher() i=7 2024-09-19T11:59:32.809 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:32.809 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:59:32.809 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: error-at-change-reshard-state id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-19T11:59:32.810 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:32.894 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-19T11:59:32.894 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:33.384 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-19T11:59:33.416 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:59:33.417 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:59:33.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.469+0000 7fd0d10809c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.469+0000 7fd0d10809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:33.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.469+0000 7fd0d10809c0 20 realm 2024-09-19T11:59:33.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.469+0000 7fd0d10809c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.469+0000 7fd0d10809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:33.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.469+0000 7fd0d10809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:33.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.469+0000 7fd0d10809c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.469+0000 7fd0d10809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:33.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.469+0000 7fd0d10809c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.467 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.473+0000 7fd0d10809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:33.467 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.473+0000 7fd0d10809c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.473+0000 7fd0d10809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:33.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.473+0000 7fd0d10809c0 20 searching for the correct realm 2024-09-19T11:59:33.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.477+0000 7fd0cf387640 0 -- 172.21.15.120:0/572076542 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fd0c4071590 msgr2=0x7fd0c4070f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:33.479 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.485+0000 7fd0ce385640 0 -- 172.21.15.120:0/572076542 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fd0c0054d30 msgr2=0x7fd0c005f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:33.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.701+0000 7fd0d10809c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:33.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.701+0000 7fd0d10809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:33.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.701+0000 7fd0d10809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:33.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.701+0000 7fd0d10809c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:33.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.701+0000 7fd0d10809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:33.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.701+0000 7fd0d10809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:33.698 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.701+0000 7fd0d10809c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.701+0000 7fd0d10809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:33.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.701+0000 7fd0d10809c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:33.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:33.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 20 zone default found 2024-09-19T11:59:33.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 4 Realm: () 2024-09-19T11:59:33.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:33.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:33.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:33.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 20 zonegroup default 2024-09-19T11:59:33.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:33.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:33.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:33.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 20 started sync module instance, tier type = 2024-09-19T11:59:33.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.705+0000 7fd0d10809c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:33.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.733+0000 7fd0d10809c0 20 add_watcher() i=0 2024-09-19T11:59:33.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.733+0000 7fd0d10809c0 20 add_watcher() i=1 2024-09-19T11:59:33.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.733+0000 7fd0d10809c0 20 add_watcher() i=2 2024-09-19T11:59:33.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.733+0000 7fd0d10809c0 20 add_watcher() i=3 2024-09-19T11:59:33.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.733+0000 7fd0d10809c0 20 add_watcher() i=4 2024-09-19T11:59:33.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.733+0000 7fd0d10809c0 20 add_watcher() i=5 2024-09-19T11:59:33.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.733+0000 7fd0d10809c0 20 add_watcher() i=6 2024-09-19T11:59:33.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.733+0000 7fd0d10809c0 20 add_watcher() i=7 2024-09-19T11:59:33.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.733+0000 7fd0d10809c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:33.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.737+0000 7fcf857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:33.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.741+0000 7fd0d10809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:33.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.741+0000 7fd0d10809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:33.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.741+0000 7fd0d10809c0 5 note: GC not initialized 2024-09-19T11:59:33.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.741+0000 7fcefffff640 20 reqs_thread_entry: start 2024-09-19T11:59:33.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.741+0000 7fd0d10809c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:33.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.741+0000 7fd0d10809c0 20 Filter name: none 2024-09-19T11:59:33.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.741+0000 7fcefdffb640 20 reqs_thread_entry: start 2024-09-19T11:59:33.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.741+0000 7fd0d10809c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.741+0000 7fd0d10809c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:33.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.741+0000 7fd0d10809c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.745+0000 7fd0d10809c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:33.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.745+0000 7fd0d10809c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:33.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.745+0000 7fd0d10809c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.745+0000 7fd0d10809c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:33.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.745+0000 7fd0d10809c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.745+0000 7fd0d10809c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:33.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.745+0000 7fd0d10809c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:33.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.745+0000 7fcf857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:33.748 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.753+0000 7fd0d10809c0 20 remove_watcher() i=0 2024-09-19T11:59:33.748 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.753+0000 7fd0d10809c0 2 removed watcher, disabling cache 2024-09-19T11:59:33.750 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.753+0000 7fd0d10809c0 20 remove_watcher() i=1 2024-09-19T11:59:33.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.757+0000 7fd0d10809c0 20 remove_watcher() i=2 2024-09-19T11:59:33.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.761+0000 7fd0d10809c0 20 remove_watcher() i=3 2024-09-19T11:59:33.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.761+0000 7fd0d10809c0 20 remove_watcher() i=4 2024-09-19T11:59:33.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.765+0000 7fd0d10809c0 20 remove_watcher() i=5 2024-09-19T11:59:33.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.765+0000 7fd0d10809c0 20 remove_watcher() i=6 2024-09-19T11:59:33.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.765+0000 7fd0d10809c0 20 remove_watcher() i=7 2024-09-19T11:59:33.777 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:33.777 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:59:33.777 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-change-reshard-state id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:59:33.777 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:33.777 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-19T11:59:33.814 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:59:33.814 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:59:33.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:33.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 realm 2024-09-19T11:59:33.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:33.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.865+0000 7fb4286dc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:33.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:33.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.869+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:33.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.869+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:33.864 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.869+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:33.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.869+0000 7fb4286dc9c0 20 searching for the correct realm 2024-09-19T11:59:33.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:33.869+0000 7fb41d9e1640 0 -- 172.21.15.120:0/1756472305 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7fb418025040 msgr2=0x7fb418066820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:59:34.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.081+0000 7fb4269e3640 0 -- 172.21.15.120:0/1756472305 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fb4100a50d0 msgr2=0x7fb410100040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:34.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:34.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:34.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:34.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:34.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:34.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:34.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:34.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:34.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 zone default found 2024-09-19T11:59:34.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 4 Realm: () 2024-09-19T11:59:34.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:34.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:34.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:34.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 zonegroup default 2024-09-19T11:59:34.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 started sync module instance, tier type = 2024-09-19T11:59:34.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:34.124 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=0 2024-09-19T11:59:34.124 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=1 2024-09-19T11:59:34.124 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=2 2024-09-19T11:59:34.124 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=3 2024-09-19T11:59:34.124 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=4 2024-09-19T11:59:34.124 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=5 2024-09-19T11:59:34.124 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=6 2024-09-19T11:59:34.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=7 2024-09-19T11:59:34.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.129+0000 7fb4286dc9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:34.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.133+0000 7fb2dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:34.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:34.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:34.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 note: GC not initialized 2024-09-19T11:59:34.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb2d77fe640 20 reqs_thread_entry: start 2024-09-19T11:59:34.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:34.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 Filter name: none 2024-09-19T11:59:34.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb2d57fa640 20 reqs_thread_entry: start 2024-09-19T11:59:34.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-19T11:59:34.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:34.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-19T11:59:34.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-19T11:59:34.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 : miss 2024-09-19T11:59:34.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:34.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T11:59:34.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T11:59:34.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:59:34.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:34.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 2024-09-19T11:59:34.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.149+0000 7fb4286dc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T11:59:34.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.149+0000 7fb4286dc9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T11:59:34.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.149+0000 7fb4286dc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:34.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.149+0000 7fb4286dc9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40, ofs0, ns] 2024-09-19T11:59:34.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.149+0000 7fb309ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 94554329376944 notifier 7517 bl.length()=1015 2024-09-19T11:59:34.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.149+0000 7fb309ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T11:59:34.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.149+0000 7fb309ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T11:59:34.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.149+0000 7fb309ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:34.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.149+0000 7fb4286dc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): orig_sources= new_sources= 2024-09-19T11:59:34.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.149+0000 7fb4286dc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): potential sources added=[] removed=[] 2024-09-19T11:59:34.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.149+0000 7fb4286dc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): orig_dests= new_dests= 2024-09-19T11:59:34.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.149+0000 7fb4286dc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): potential dests added=[] removed=[] 2024-09-19T11:59:34.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.153+0000 7fb4286dc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.1.0 2024-09-19T11:59:34.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.153+0000 7fb4286dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.1.0 2024-09-19T11:59:34.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.153+0000 7fb4286dc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.1.1 2024-09-19T11:59:34.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.153+0000 7fb4286dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.1.1 2024-09-19T11:59:34.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.153+0000 7fb4286dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.0 2024-09-19T11:59:34.154 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb4286dc9c0 time 2024-09-19T11:59:34.162242+0000 2024-09-19T11:59:34.154 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:59:34.158 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:59:34.158 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb42bfb62eb] 2024-09-19T11:59:34.158 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb42bfb649f] 2024-09-19T11:59:34.158 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff2271c271] 2024-09-19T11:59:34.158 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ff2272b441] 2024-09-19T11:59:34.158 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ff2272ca94] 2024-09-19T11:59:34.158 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:59:34.158 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb42ae1cd90] 2024-09-19T11:59:34.158 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:59:34.158 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:59:34.158 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.161+0000 7fb4286dc9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb4286dc9c0 time 2024-09-19T11:59:34.162242+0000 2024-09-19T11:59:34.158 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:59:34.158 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.159 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:59:34.159 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb42bfb62eb] 2024-09-19T11:59:34.159 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb42bfb649f] 2024-09-19T11:59:34.159 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff2271c271] 2024-09-19T11:59:34.159 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ff2272b441] 2024-09-19T11:59:34.159 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ff2272ca94] 2024-09-19T11:59:34.159 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:59:34.159 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb42ae1cd90] 2024-09-19T11:59:34.159 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:59:34.159 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:59:34.159 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.159 INFO:tasks.workunit.client.0.smithi120.stderr:*** Caught signal (Aborted) ** 2024-09-19T11:59:34.159 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7fb4286dc9c0 thread_name:radosgw-admin 2024-09-19T11:59:34.209 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:59:34.209 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb42ae35520] 2024-09-19T11:59:34.210 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:59:34.210 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:59:34.210 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:59:34.210 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb42bfb6345] 2024-09-19T11:59:34.210 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb42bfb649f] 2024-09-19T11:59:34.210 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff2271c271] 2024-09-19T11:59:34.210 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ff2272b441] 2024-09-19T11:59:34.210 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ff2272ca94] 2024-09-19T11:59:34.210 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:59:34.210 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb42ae1cd90] 2024-09-19T11:59:34.210 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:59:34.210 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:59:34.210 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.165+0000 7fb4286dc9c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:59:34.211 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7fb4286dc9c0 thread_name:radosgw-admin 2024-09-19T11:59:34.211 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.211 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:59:34.211 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb42ae35520] 2024-09-19T11:59:34.211 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:59:34.211 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:59:34.211 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:59:34.211 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb42bfb6345] 2024-09-19T11:59:34.211 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb42bfb649f] 2024-09-19T11:59:34.211 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff2271c271] 2024-09-19T11:59:34.211 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ff2272b441] 2024-09-19T11:59:34.211 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ff2272ca94] 2024-09-19T11:59:34.211 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:59:34.211 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb42ae1cd90] 2024-09-19T11:59:34.212 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:59:34.212 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:59:34.212 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:59:34.212 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.212 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:59:34.212 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:59:33.841+0000 7fb4269e3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.212 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.212 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:59:34.212 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: dump: 2024-09-19T11:59:34.213 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.213 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.213 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.213 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.213 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.213 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.213 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.213 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.213 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.213 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.213 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: _finish_auth 0 2024-09-19T11:59:34.213 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: _check_auth_tickets 2024-09-19T11:59:34.213 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 monclient: authenticate success, global_id 7505 2024-09-19T11:59:34.213 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: handle_config config(0 keys) 2024-09-19T11:59:34.214 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.214 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:59:34.214 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: dump: 2024-09-19T11:59:34.214 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.214 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.214 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.214 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.214 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.214 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.214 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.214 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.214 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.214 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.214 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 10 monclient: get_monmap_and_config success 2024-09-19T11:59:34.215 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 4 set_mon_vals no callback set 2024-09-19T11:59:34.215 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 10 monclient: shutdown 2024-09-19T11:59:34.215 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) unregister_commands rotate-key 2024-09-19T11:59:34.215 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:59:34.215 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:59:34.215 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 10 monclient: monmap: 2024-09-19T11:59:34.215 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:59:34.215 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:59:34.215 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:59:34.215 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:59:34.215 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:59:34.215 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.215 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:59:34.215 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:59:34.216 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:59:34.216 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.216 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding auth protocol: cephx 2024-09-19T11:59:34.216 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding auth protocol: cephx 2024-09-19T11:59:34.216 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding auth protocol: cephx 2024-09-19T11:59:34.216 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: secure 2024-09-19T11:59:34.216 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: crc 2024-09-19T11:59:34.216 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: secure 2024-09-19T11:59:34.216 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: crc 2024-09-19T11:59:34.216 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: secure 2024-09-19T11:59:34.216 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: crc 2024-09-19T11:59:34.217 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: crc 2024-09-19T11:59:34.217 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: secure 2024-09-19T11:59:34.217 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: crc 2024-09-19T11:59:34.217 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: secure 2024-09-19T11:59:34.217 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: crc 2024-09-19T11:59:34.217 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: secure 2024-09-19T11:59:34.217 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.217 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 1 librados: starting msgr at 2024-09-19T11:59:34.217 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 1 librados: starting objecter 2024-09-19T11:59:34.218 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command objecter_requests hook 0x55ff2504da70 2024-09-19T11:59:34.218 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 1 librados: setting wanted keys 2024-09-19T11:59:34.218 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 1 librados: calling monclient init 2024-09-19T11:59:34.218 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 10 monclient: init 2024-09-19T11:59:34.218 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding auth protocol: cephx 2024-09-19T11:59:34.218 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding auth protocol: cephx 2024-09-19T11:59:34.218 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding auth protocol: cephx 2024-09-19T11:59:34.218 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: secure 2024-09-19T11:59:34.218 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: crc 2024-09-19T11:59:34.218 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: secure 2024-09-19T11:59:34.218 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: crc 2024-09-19T11:59:34.218 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: secure 2024-09-19T11:59:34.218 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: crc 2024-09-19T11:59:34.219 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: crc 2024-09-19T11:59:34.219 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: secure 2024-09-19T11:59:34.219 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: crc 2024-09-19T11:59:34.219 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: secure 2024-09-19T11:59:34.219 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: crc 2024-09-19T11:59:34.219 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: secure 2024-09-19T11:59:34.219 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.219 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.219 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command rotate-key hook 0x55ff2526f418 2024-09-19T11:59:34.219 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:59:34.219 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T11:59:34.219 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff25298710 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:59:34.219 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff2529dca0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:59:34.219 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-b con 0x7fb414003100 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:59:34.220 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.220 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.220 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.220 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:59:34.220 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): authenticate will time out at 2468.160424s 2024-09-19T11:59:34.220 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request con 0x55ff2529dca0 auth_method 0 2024-09-19T11:59:34.220 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.220 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.220 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.220 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient(hunting): get_auth_request con 0x55ff25298710 auth_method 0 2024-09-19T11:59:34.220 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.220 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.220 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.221 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.221 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.221 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.221 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.221 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.221 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.221 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_done global_id 7508 payload 824 2024-09-19T11:59:34.221 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient: _finish_hunting 0 2024-09-19T11:59:34.221 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 1 monclient: found mon.noname-c 2024-09-19T11:59:34.221 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.221 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.221 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:59:34.221 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: dump: 2024-09-19T11:59:34.221 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.222 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.222 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.222 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.222 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.222 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.222 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.222 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.222 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.222 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.222 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: _finish_auth 0 2024-09-19T11:59:34.222 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: _check_auth_tickets 2024-09-19T11:59:34.222 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: handle_config config(0 keys) 2024-09-19T11:59:34.222 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.222 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:59:34.223 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: dump: 2024-09-19T11:59:34.223 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.223 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.223 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.223 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.223 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.223 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.223 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.223 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.223 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.223 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.224 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 5 monclient: authenticate success, global_id 7508 2024-09-19T11:59:34.224 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:59:33.845+0000 7fb314608640 4 set_mon_vals no callback set 2024-09-19T11:59:34.224 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient: _renew_subs 2024-09-19T11:59:34.224 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.224 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient: _renew_subs 2024-09-19T11:59:34.224 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.224 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 1 librados: init done 2024-09-19T11:59:34.224 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:59:33.845+0000 7fb312e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:59:34.224 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:59:33.845+0000 7fb312e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:59:34.224 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:59:33.845+0000 7fb312e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:59:34.224 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient: get_auth_request con 0x7fb30c071be0 auth_method 0 2024-09-19T11:59:34.224 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:59:33.845+0000 7fb4269e3640 10 monclient: get_auth_request con 0x55ff252af280 auth_method 0 2024-09-19T11:59:34.224 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:59:33.849+0000 7fb4261e2640 10 monclient: get_auth_request con 0x55ff252ba770 auth_method 0 2024-09-19T11:59:34.224 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:59:33.849+0000 7fb41d9e1640 10 monclient: get_auth_request con 0x55ff252bead0 auth_method 0 2024-09-19T11:59:34.225 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient: get_auth_request con 0x55ff252be030 auth_method 0 2024-09-19T11:59:34.225 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:59:34.225 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:59:34.225 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient: monmap: 2024-09-19T11:59:34.225 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:59:34.225 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:59:34.225 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:59:34.225 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:59:34.225 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:59:34.225 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.225 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:59:34.225 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:59:34.225 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:59:34.226 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.226 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding auth protocol: cephx 2024-09-19T11:59:34.226 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding auth protocol: cephx 2024-09-19T11:59:34.226 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding auth protocol: cephx 2024-09-19T11:59:34.226 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: secure 2024-09-19T11:59:34.226 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: crc 2024-09-19T11:59:34.226 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: secure 2024-09-19T11:59:34.226 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: crc 2024-09-19T11:59:34.226 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: secure 2024-09-19T11:59:34.226 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: crc 2024-09-19T11:59:34.226 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: crc 2024-09-19T11:59:34.226 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: secure 2024-09-19T11:59:34.226 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: crc 2024-09-19T11:59:34.226 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: secure 2024-09-19T11:59:34.227 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: crc 2024-09-19T11:59:34.227 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: secure 2024-09-19T11:59:34.227 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.227 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command objecter_requests cmddesc objecter_requests hook 0x55ff252ca580 EEXIST 2024-09-19T11:59:34.227 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient: init 2024-09-19T11:59:34.227 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding auth protocol: cephx 2024-09-19T11:59:34.227 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding auth protocol: cephx 2024-09-19T11:59:34.227 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding auth protocol: cephx 2024-09-19T11:59:34.227 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: secure 2024-09-19T11:59:34.227 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: crc 2024-09-19T11:59:34.227 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: secure 2024-09-19T11:59:34.227 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: crc 2024-09-19T11:59:34.227 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: secure 2024-09-19T11:59:34.227 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: crc 2024-09-19T11:59:34.228 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: crc 2024-09-19T11:59:34.228 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: secure 2024-09-19T11:59:34.228 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: crc 2024-09-19T11:59:34.228 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: secure 2024-09-19T11:59:34.228 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: crc 2024-09-19T11:59:34.228 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: secure 2024-09-19T11:59:34.228 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.228 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.228 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command rotate-key cmddesc rotate-key hook 0x55ff252c5c90 EEXIST 2024-09-19T11:59:34.228 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:59:34.228 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T11:59:34.228 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff252ee730 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:59:34.228 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff252ee060 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:59:34.228 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff252eca40 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:59:34.229 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.229 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.229 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.229 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:59:34.229 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): authenticate will time out at 2468.170671s 2024-09-19T11:59:34.229 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): get_auth_request con 0x55ff252ee060 auth_method 0 2024-09-19T11:59:34.229 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.229 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.229 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.229 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:59:33.853+0000 7fb4261e2640 10 monclient(hunting): get_auth_request con 0x55ff252eca40 auth_method 0 2024-09-19T11:59:34.229 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:59:33.853+0000 7fb4261e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.229 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:59:33.853+0000 7fb4261e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.229 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:59:33.853+0000 7fb4261e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.229 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.229 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.230 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.230 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:59:33.853+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.230 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:59:33.853+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.230 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:59:33.853+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.230 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:59:33.853+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request con 0x55ff252ee730 auth_method 0 2024-09-19T11:59:34.230 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:59:33.853+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.230 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:59:33.853+0000 7fb41d9e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.230 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:59:33.853+0000 7fb41d9e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.230 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): handle_auth_done global_id 7511 payload 824 2024-09-19T11:59:34.230 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient: _finish_hunting 0 2024-09-19T11:59:34.230 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:59:33.853+0000 7fb4269e3640 1 monclient: found mon.noname-c 2024-09-19T11:59:34.230 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.230 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.230 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:59:34.231 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: dump: 2024-09-19T11:59:34.231 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.231 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.231 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.231 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.231 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.231 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.231 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.231 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.231 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.231 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.231 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: _finish_auth 0 2024-09-19T11:59:34.231 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: _check_auth_tickets 2024-09-19T11:59:34.231 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: handle_config config(0 keys) 2024-09-19T11:59:34.232 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.232 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:59:34.232 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: dump: 2024-09-19T11:59:34.232 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.232 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.232 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.232 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.232 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.232 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.232 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.232 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.232 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.232 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.232 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:59:33.853+0000 7fb4271e4640 4 set_mon_vals no callback set 2024-09-19T11:59:34.233 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 monclient: authenticate success, global_id 7511 2024-09-19T11:59:34.233 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: _renew_subs 2024-09-19T11:59:34.233 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.233 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: _renew_subs 2024-09-19T11:59:34.233 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.233 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:59:33.857+0000 7fb30bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:59:34.233 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:59:33.857+0000 7fb30bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:59:34.233 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:59:33.857+0000 7fb30bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:59:34.233 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: get_monmap_and_config 2024-09-19T11:59:34.233 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:59:34.233 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:59:34.233 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: monmap: 2024-09-19T11:59:34.233 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:59:34.233 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:59:34.234 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:59:34.234 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:59:34.234 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:59:34.234 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.234 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:59:34.234 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:59:34.234 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:59:34.234 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.234 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding auth protocol: cephx 2024-09-19T11:59:34.234 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding auth protocol: cephx 2024-09-19T11:59:34.234 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding auth protocol: cephx 2024-09-19T11:59:34.234 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: secure 2024-09-19T11:59:34.234 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: crc 2024-09-19T11:59:34.234 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: secure 2024-09-19T11:59:34.235 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: crc 2024-09-19T11:59:34.235 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: secure 2024-09-19T11:59:34.235 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: crc 2024-09-19T11:59:34.235 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: crc 2024-09-19T11:59:34.235 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: secure 2024-09-19T11:59:34.235 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: crc 2024-09-19T11:59:34.235 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: secure 2024-09-19T11:59:34.235 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: crc 2024-09-19T11:59:34.235 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: secure 2024-09-19T11:59:34.235 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient: get_auth_request con 0x7fb300071b20 auth_method 0 2024-09-19T11:59:34.235 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.235 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: init 2024-09-19T11:59:34.235 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding auth protocol: cephx 2024-09-19T11:59:34.235 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding auth protocol: cephx 2024-09-19T11:59:34.236 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding auth protocol: cephx 2024-09-19T11:59:34.236 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: secure 2024-09-19T11:59:34.236 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: crc 2024-09-19T11:59:34.236 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: secure 2024-09-19T11:59:34.236 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: crc 2024-09-19T11:59:34.236 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: secure 2024-09-19T11:59:34.236 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: crc 2024-09-19T11:59:34.236 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: crc 2024-09-19T11:59:34.236 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: secure 2024-09-19T11:59:34.236 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: crc 2024-09-19T11:59:34.236 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: secure 2024-09-19T11:59:34.236 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: crc 2024-09-19T11:59:34.236 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: secure 2024-09-19T11:59:34.236 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.236 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.237 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command rotate-key cmddesc rotate-key hook 0x7ffe87677068 EEXIST 2024-09-19T11:59:34.237 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:59:34.237 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T11:59:34.237 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff25312060 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:59:34.237 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff25342710 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:59:34.237 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff2533d8c0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:59:34.237 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.237 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.237 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.237 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:59:34.237 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): authenticate will time out at 2468.175330s 2024-09-19T11:59:34.237 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request con 0x55ff25312060 auth_method 0 2024-09-19T11:59:34.237 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.237 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.238 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.238 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:59:33.857+0000 7fb4261e2640 10 monclient(hunting): get_auth_request con 0x55ff2533d8c0 auth_method 0 2024-09-19T11:59:34.238 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:59:33.857+0000 7fb4261e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.238 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:59:33.857+0000 7fb4261e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.238 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:59:33.857+0000 7fb4261e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.238 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.238 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.238 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.238 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:59:33.857+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.238 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:59:33.857+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.238 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:59:33.857+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.238 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_done global_id 8091 payload 274 2024-09-19T11:59:34.238 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient: _finish_hunting 0 2024-09-19T11:59:34.238 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 1 monclient: found mon.noname-a 2024-09-19T11:59:34.239 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:59:34.239 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:59:33.857+0000 7fb4269e3640 10 monclient: get_auth_request con 0x55ff25342710 auth_method 0 2024-09-19T11:59:34.239 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.239 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:59:34.239 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: dump: 2024-09-19T11:59:34.239 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.239 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.239 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.239 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.239 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.239 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.239 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.239 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.239 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.239 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.240 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: _finish_auth 0 2024-09-19T11:59:34.240 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: _check_auth_tickets 2024-09-19T11:59:34.240 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 monclient: authenticate success, global_id 8091 2024-09-19T11:59:34.240 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T11:59:34.240 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.240 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:59:34.240 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: dump: 2024-09-19T11:59:34.240 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.240 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.240 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.240 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.240 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.240 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.240 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.241 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.241 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.241 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.241 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: get_monmap_and_config success 2024-09-19T11:59:34.241 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 4 set_mon_vals no callback set 2024-09-19T11:59:34.241 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: shutdown 2024-09-19T11:59:34.241 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:59:34.241 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:59:34.241 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: monmap: 2024-09-19T11:59:34.241 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:59:34.241 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:59:34.241 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:59:34.241 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:59:34.241 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:59:34.242 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.242 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:59:34.242 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:59:34.242 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:59:34.242 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.242 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding auth protocol: cephx 2024-09-19T11:59:34.242 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding auth protocol: cephx 2024-09-19T11:59:34.242 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding auth protocol: cephx 2024-09-19T11:59:34.242 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: secure 2024-09-19T11:59:34.242 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: crc 2024-09-19T11:59:34.242 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: secure 2024-09-19T11:59:34.242 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: crc 2024-09-19T11:59:34.242 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: secure 2024-09-19T11:59:34.242 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: crc 2024-09-19T11:59:34.242 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: crc 2024-09-19T11:59:34.243 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: secure 2024-09-19T11:59:34.243 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: crc 2024-09-19T11:59:34.243 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: secure 2024-09-19T11:59:34.243 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: crc 2024-09-19T11:59:34.243 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: secure 2024-09-19T11:59:34.243 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.243 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 1 librados: starting msgr at 2024-09-19T11:59:34.243 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 1 librados: starting objecter 2024-09-19T11:59:34.243 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command objecter_requests cmddesc objecter_requests hook 0x55ff25314120 EEXIST 2024-09-19T11:59:34.243 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 1 librados: setting wanted keys 2024-09-19T11:59:34.243 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 1 librados: calling monclient init 2024-09-19T11:59:34.243 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: init 2024-09-19T11:59:34.243 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding auth protocol: cephx 2024-09-19T11:59:34.243 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding auth protocol: cephx 2024-09-19T11:59:34.243 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding auth protocol: cephx 2024-09-19T11:59:34.244 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: secure 2024-09-19T11:59:34.244 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: crc 2024-09-19T11:59:34.244 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: secure 2024-09-19T11:59:34.244 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: crc 2024-09-19T11:59:34.244 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: secure 2024-09-19T11:59:34.244 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: crc 2024-09-19T11:59:34.244 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: crc 2024-09-19T11:59:34.244 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: secure 2024-09-19T11:59:34.244 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: crc 2024-09-19T11:59:34.244 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: secure 2024-09-19T11:59:34.244 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: crc 2024-09-19T11:59:34.244 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: secure 2024-09-19T11:59:34.244 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.244 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.245 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command rotate-key cmddesc rotate-key hook 0x55ff252f0698 EEXIST 2024-09-19T11:59:34.245 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:59:34.245 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T11:59:34.245 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff25312060 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:59:34.245 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff2533d8c0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:59:34.245 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff25342710 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:59:34.245 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.245 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.245 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.245 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:59:34.245 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): authenticate will time out at 2468.177954s 2024-09-19T11:59:34.245 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:59:33.861+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request con 0x55ff25312060 auth_method 0 2024-09-19T11:59:34.245 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:59:33.861+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.245 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:59:33.861+0000 7fb41d9e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.246 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:59:33.861+0000 7fb41d9e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.246 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): get_auth_request con 0x55ff25342710 auth_method 0 2024-09-19T11:59:34.246 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.246 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.246 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.246 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:59:33.861+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.246 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:59:33.861+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.246 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:59:33.861+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.246 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.246 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.246 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.246 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): handle_auth_done global_id 7517 payload 824 2024-09-19T11:59:34.246 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient: _finish_hunting 0 2024-09-19T11:59:34.247 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:59:33.861+0000 7fb4261e2640 1 monclient: found mon.noname-c 2024-09-19T11:59:34.247 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.247 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.247 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:59:34.247 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: dump: 2024-09-19T11:59:34.247 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.247 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.247 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.247 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.247 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.247 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.247 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.247 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.247 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.248 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.248 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: _finish_auth 0 2024-09-19T11:59:34.248 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: _check_auth_tickets 2024-09-19T11:59:34.248 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: handle_config config(0 keys) 2024-09-19T11:59:34.248 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.248 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:59:34.248 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: dump: 2024-09-19T11:59:34.248 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.248 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.248 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.248 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.248 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.248 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.248 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.248 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.249 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.249 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.249 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:59:33.861+0000 7fb309ffb640 4 set_mon_vals no callback set 2024-09-19T11:59:34.249 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 monclient: authenticate success, global_id 7517 2024-09-19T11:59:34.249 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: _renew_subs 2024-09-19T11:59:34.249 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.249 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: _renew_subs 2024-09-19T11:59:34.249 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.249 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 1 librados: init done 2024-09-19T11:59:34.249 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command cr dump hook 0x7fb410001d88 2024-09-19T11:59:34.249 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.249 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:59:33.865+0000 7fb2f7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:59:34.249 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:59:33.865+0000 7fb2f7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:59:34.249 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:59:33.865+0000 7fb2f7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:59:34.249 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:59:33.865+0000 7fb41d9e1640 10 monclient: get_auth_request con 0x7fb2f0071be0 auth_method 0 2024-09-19T11:59:34.250 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:59:33.865+0000 7fb4269e3640 10 monclient: get_auth_request con 0x55ff2535bcd0 auth_method 0 2024-09-19T11:59:34.250 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.250 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 realm 2024-09-19T11:59:34.250 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.250 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.250 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:34.250 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.250 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.250 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.250 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:59:33.865+0000 7fb41d9e1640 10 monclient: get_auth_request con 0x55ff2535fee0 auth_method 0 2024-09-19T11:59:34.250 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:59:33.869+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:34.250 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:59:33.869+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.250 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:59:33.869+0000 7fb4269e3640 10 monclient: get_auth_request con 0x55ff25363720 auth_method 0 2024-09-19T11:59:34.250 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:59:33.869+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:34.251 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:59:33.869+0000 7fb4286dc9c0 20 searching for the correct realm 2024-09-19T11:59:34.251 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:59:33.869+0000 7fb4261e2640 10 monclient: get_auth_request con 0x55ff253681d0 auth_method 0 2024-09-19T11:59:34.251 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:59:33.869+0000 7fb41d9e1640 10 monclient: get_auth_request con 0x7fb418025040 auth_method 0 2024-09-19T11:59:34.251 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:59:33.869+0000 7fb41d9e1640 0 -- 172.21.15.120:0/1756472305 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7fb418025040 msgr2=0x7fb418066820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:59:34.251 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:59:34.073+0000 7fb41d9e1640 10 monclient: get_auth_request con 0x7fb418025040 auth_method 0 2024-09-19T11:59:34.251 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:59:34.073+0000 7fb4269e3640 10 monclient: get_auth_request con 0x7fb4100a50d0 auth_method 0 2024-09-19T11:59:34.251 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:59:34.077+0000 7fb4261e2640 10 monclient: get_auth_request con 0x55ff250fbcf0 auth_method 0 2024-09-19T11:59:34.251 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:59:34.081+0000 7fb4269e3640 0 -- 172.21.15.120:0/1756472305 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fb4100a50d0 msgr2=0x7fb410100040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:34.251 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:59:34.081+0000 7fb2f7fff640 1 client.7517.objecter ms_handle_reset 0x7fb4100a50d0 session 0x7fb4100a7070 osd.2 2024-09-19T11:59:34.251 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:59:34.085+0000 7fb2f7fff640 10 monclient: _renew_subs 2024-09-19T11:59:34.251 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:59:34.085+0000 7fb2f7fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.251 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:59:34.085+0000 7fb4269e3640 10 monclient: get_auth_request con 0x7fb2f0082280 auth_method 0 2024-09-19T11:59:34.251 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:59:34.085+0000 7fb41d9e1640 10 monclient: get_auth_request con 0x7fb418017030 auth_method 0 2024-09-19T11:59:34.251 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:34.251 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:34.252 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:34.252 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:34.252 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:34.252 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:34.252 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.252 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.252 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.252 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:34.252 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.252 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:34.252 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 zone default found 2024-09-19T11:59:34.252 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 4 Realm: () 2024-09-19T11:59:34.252 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:34.252 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:34.253 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:34.253 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 zonegroup default 2024-09-19T11:59:34.253 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.253 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.253 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.253 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.253 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.253 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.253 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 started sync module instance, tier type = 2024-09-19T11:59:34.253 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:34.253 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=0 2024-09-19T11:59:34.253 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=1 2024-09-19T11:59:34.253 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=2 2024-09-19T11:59:34.253 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=3 2024-09-19T11:59:34.253 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=4 2024-09-19T11:59:34.254 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=5 2024-09-19T11:59:34.254 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=6 2024-09-19T11:59:34.254 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=7 2024-09-19T11:59:34.254 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:34.254 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding auth protocol: cephx 2024-09-19T11:59:34.254 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding auth protocol: cephx 2024-09-19T11:59:34.254 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding auth protocol: cephx 2024-09-19T11:59:34.254 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: secure 2024-09-19T11:59:34.254 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: crc 2024-09-19T11:59:34.254 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: secure 2024-09-19T11:59:34.254 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: crc 2024-09-19T11:59:34.254 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: secure 2024-09-19T11:59:34.254 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: crc 2024-09-19T11:59:34.254 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:59:34.133+0000 7fb2dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:34.255 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: crc 2024-09-19T11:59:34.255 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: secure 2024-09-19T11:59:34.255 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: crc 2024-09-19T11:59:34.255 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: secure 2024-09-19T11:59:34.255 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: crc 2024-09-19T11:59:34.255 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: secure 2024-09-19T11:59:34.255 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.255 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:34.255 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:34.255 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command cache list hook 0x55ff25337dd0 2024-09-19T11:59:34.255 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command cache inspect hook 0x55ff25337dd0 2024-09-19T11:59:34.255 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command cache erase hook 0x55ff25337dd0 2024-09-19T11:59:34.255 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command cache zap hook 0x55ff25337dd0 2024-09-19T11:59:34.256 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 note: GC not initialized 2024-09-19T11:59:34.256 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:59:34.137+0000 7fb2d77fe640 20 reqs_thread_entry: start 2024-09-19T11:59:34.256 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command sync trace show hook 0x7fb4200014a0 2024-09-19T11:59:34.256 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command sync trace history hook 0x7fb4200014a0 2024-09-19T11:59:34.256 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command sync trace active hook 0x7fb4200014a0 2024-09-19T11:59:34.256 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command sync trace active_short hook 0x7fb4200014a0 2024-09-19T11:59:34.256 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:34.256 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 Filter name: none 2024-09-19T11:59:34.256 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:59:34.137+0000 7fb2d57fa640 20 reqs_thread_entry: start 2024-09-19T11:59:34.256 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-19T11:59:34.256 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.256 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:34.256 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-19T11:59:34.256 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-19T11:59:34.257 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 : miss 2024-09-19T11:59:34.257 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.257 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:34.257 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T11:59:34.257 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T11:59:34.257 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:59:34.257 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:34.257 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 2024-09-19T11:59:34.257 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T11:59:34.257 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T11:59:34.257 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:34.257 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40, ofs0, ns] 2024-09-19T11:59:34.257 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:59:34.149+0000 7fb309ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 94554329376944 notifier 7517 bl.length()=1015 2024-09-19T11:59:34.257 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:59:34.149+0000 7fb309ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T11:59:34.258 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:59:34.149+0000 7fb309ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T11:59:34.258 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:59:34.149+0000 7fb309ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:34.258 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): orig_sources= new_sources= 2024-09-19T11:59:34.258 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): potential sources added=[] removed=[] 2024-09-19T11:59:34.258 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): orig_dests= new_dests= 2024-09-19T11:59:34.258 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): potential dests added=[] removed=[] 2024-09-19T11:59:34.258 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:59:34.153+0000 7fb4286dc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.1.0 2024-09-19T11:59:34.258 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:59:34.153+0000 7fb4286dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.1.0 2024-09-19T11:59:34.258 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:59:34.153+0000 7fb4286dc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.1.1 2024-09-19T11:59:34.258 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:59:34.153+0000 7fb4286dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.1.1 2024-09-19T11:59:34.258 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:59:34.153+0000 7fb4286dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.0 2024-09-19T11:59:34.258 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:59:34.161+0000 7fb4286dc9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb4286dc9c0 time 2024-09-19T11:59:34.162242+0000 2024-09-19T11:59:34.258 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:59:34.258 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.259 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:59:34.259 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb42bfb62eb] 2024-09-19T11:59:34.259 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb42bfb649f] 2024-09-19T11:59:34.259 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff2271c271] 2024-09-19T11:59:34.259 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ff2272b441] 2024-09-19T11:59:34.259 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ff2272ca94] 2024-09-19T11:59:34.259 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:59:34.259 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb42ae1cd90] 2024-09-19T11:59:34.259 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:59:34.259 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:59:34.259 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.259 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:59:34.165+0000 7fb4286dc9c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:59:34.259 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7fb4286dc9c0 thread_name:radosgw-admin 2024-09-19T11:59:34.259 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.260 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:59:34.260 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb42ae35520] 2024-09-19T11:59:34.260 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:59:34.260 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:59:34.260 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:59:34.260 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb42bfb6345] 2024-09-19T11:59:34.260 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb42bfb649f] 2024-09-19T11:59:34.260 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff2271c271] 2024-09-19T11:59:34.260 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ff2272b441] 2024-09-19T11:59:34.260 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ff2272ca94] 2024-09-19T11:59:34.260 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:59:34.260 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb42ae1cd90] 2024-09-19T11:59:34.260 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:59:34.261 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:59:34.261 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:59:34.261 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.261 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:59:34.261 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:59:34.261 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:59:34.261 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:59:34.261 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:59:34.261 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:59:34.261 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:59:34.261 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:59:34.261 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:59:34.261 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:59:34.262 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:59:34.262 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:59:34.262 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:59:34.262 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:59:34.262 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:59:34.262 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:59:34.262 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:59:34.262 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:59:34.262 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:59:34.262 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:59:34.262 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:59:34.262 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:59:34.262 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:59:34.262 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:59:34.262 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:59:34.263 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:59:34.263 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:59:34.263 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:59:34.263 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:59:34.263 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:59:34.263 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:59:34.263 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:59:34.263 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:59:34.263 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:59:34.263 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:59:34.263 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:59:34.263 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:59:34.263 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:59:34.263 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:59:34.264 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:59:34.264 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:59:34.264 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:59:34.264 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:59:34.264 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:59:34.264 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:59:34.264 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:59:34.264 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:59:34.264 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:59:34.264 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:59:34.264 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:59:34.264 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:59:34.264 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:59:34.264 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:59:34.265 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:59:34.265 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:59:34.265 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:59:34.265 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:59:34.265 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:59:34.265 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:59:34.265 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:59:34.265 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:59:34.265 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:59:34.265 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:59:34.265 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:59:34.265 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:59:34.265 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:59:34.265 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:59:34.265 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:59:34.266 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:59:34.266 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:59:34.266 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:59:34.266 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:59:34.266 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:59:34.266 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:59:34.266 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:59:34.266 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:59:34.266 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:59:34.266 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:59:34.266 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:59:34.266 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:59:34.266 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:59:34.266 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:59:34.267 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:59:34.267 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:59:34.267 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:59:34.267 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:59:34.267 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:59:34.267 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:59:34.267 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:59:34.267 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:59:34.267 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:59:34.267 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:59:34.267 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:59:34.267 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:59:34.267 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb2d57fa640 / http_manager 2024-09-19T11:59:34.267 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb2d77fe640 / http_manager 2024-09-19T11:59:34.267 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb2dd7e2640 / rgw_dt_lg_renew 2024-09-19T11:59:34.268 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb2f7fff640 / ms_dispatch 2024-09-19T11:59:34.268 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb309ffb640 / io_context_pool 2024-09-19T11:59:34.268 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb30bfff640 / ms_dispatch 2024-09-19T11:59:34.268 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb312e05640 / ms_dispatch 2024-09-19T11:59:34.268 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb314608640 / io_context_pool 2024-09-19T11:59:34.268 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb41d9e1640 / msgr-worker-2 2024-09-19T11:59:34.268 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb4261e2640 / msgr-worker-1 2024-09-19T11:59:34.268 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb4269e3640 / msgr-worker-0 2024-09-19T11:59:34.268 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb4271e4640 / io_context_pool 2024-09-19T11:59:34.268 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb4286dc9c0 / radosgw-admin 2024-09-19T11:59:34.268 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:59:34.268 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:59:34.268 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/log/ceph/ceph-client.admin.135233.log 2024-09-19T11:59:34.268 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:59:34.269 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T11:59:34.269 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T11:59:33.841+0000 7fb4269e3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.269 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.269 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:59:34.269 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: dump: 2024-09-19T11:59:34.269 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.269 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.269 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.269 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.269 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.269 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.269 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.269 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.269 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.270 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.270 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: _finish_auth 0 2024-09-19T11:59:34.270 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: _check_auth_tickets 2024-09-19T11:59:34.270 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 monclient: authenticate success, global_id 7505 2024-09-19T11:59:34.270 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: handle_config config(0 keys) 2024-09-19T11:59:34.270 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.270 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:59:34.270 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T11:59:33.841+0000 7fb314608640 10 monclient: dump: 2024-09-19T11:59:34.270 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.270 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.270 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.270 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.270 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.270 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.270 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.271 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.271 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.271 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.271 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 10 monclient: get_monmap_and_config success 2024-09-19T11:59:34.271 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 4 set_mon_vals no callback set 2024-09-19T11:59:34.271 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 10 monclient: shutdown 2024-09-19T11:59:34.271 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) unregister_commands rotate-key 2024-09-19T11:59:34.271 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:59:34.271 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:59:34.271 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 10 monclient: monmap: 2024-09-19T11:59:34.271 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:59:34.271 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:59:34.271 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:59:34.271 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:59:34.272 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:59:34.272 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.272 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:59:34.272 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:59:34.272 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:59:34.272 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.272 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding auth protocol: cephx 2024-09-19T11:59:34.272 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding auth protocol: cephx 2024-09-19T11:59:34.272 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding auth protocol: cephx 2024-09-19T11:59:34.272 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: secure 2024-09-19T11:59:34.272 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: crc 2024-09-19T11:59:34.272 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: secure 2024-09-19T11:59:34.272 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: crc 2024-09-19T11:59:34.272 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: secure 2024-09-19T11:59:34.272 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: crc 2024-09-19T11:59:34.273 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: crc 2024-09-19T11:59:34.273 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: secure 2024-09-19T11:59:34.273 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: crc 2024-09-19T11:59:34.273 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: secure 2024-09-19T11:59:34.273 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: crc 2024-09-19T11:59:34.273 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25274910) adding con mode: secure 2024-09-19T11:59:34.273 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.273 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 1 librados: starting msgr at 2024-09-19T11:59:34.273 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 1 librados: starting objecter 2024-09-19T11:59:34.273 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command objecter_requests hook 0x55ff2504da70 2024-09-19T11:59:34.273 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 1 librados: setting wanted keys 2024-09-19T11:59:34.273 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 1 librados: calling monclient init 2024-09-19T11:59:34.273 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 10 monclient: init 2024-09-19T11:59:34.273 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding auth protocol: cephx 2024-09-19T11:59:34.273 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding auth protocol: cephx 2024-09-19T11:59:34.274 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding auth protocol: cephx 2024-09-19T11:59:34.274 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: secure 2024-09-19T11:59:34.274 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: crc 2024-09-19T11:59:34.274 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: secure 2024-09-19T11:59:34.274 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: crc 2024-09-19T11:59:34.274 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: secure 2024-09-19T11:59:34.274 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: crc 2024-09-19T11:59:34.274 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: crc 2024-09-19T11:59:34.274 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: secure 2024-09-19T11:59:34.274 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: crc 2024-09-19T11:59:34.274 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: secure 2024-09-19T11:59:34.274 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: crc 2024-09-19T11:59:34.274 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T11:59:33.841+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2526f2d0) adding con mode: secure 2024-09-19T11:59:34.275 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.275 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.275 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command rotate-key hook 0x55ff2526f418 2024-09-19T11:59:34.275 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:59:34.275 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T11:59:34.275 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff25298710 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:59:34.275 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff2529dca0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:59:34.275 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-b con 0x7fb414003100 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:59:34.275 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.275 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.275 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.275 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:59:34.275 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient(hunting): authenticate will time out at 2468.160424s 2024-09-19T11:59:34.275 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request con 0x55ff2529dca0 auth_method 0 2024-09-19T11:59:34.276 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.276 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.276 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.276 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient(hunting): get_auth_request con 0x55ff25298710 auth_method 0 2024-09-19T11:59:34.276 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.276 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.276 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.276 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.276 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.276 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.276 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.276 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.276 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.276 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_done global_id 7508 payload 824 2024-09-19T11:59:34.277 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient: _finish_hunting 0 2024-09-19T11:59:34.277 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 1 monclient: found mon.noname-c 2024-09-19T11:59:34.277 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T11:59:33.845+0000 7fb41d9e1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.277 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.277 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:59:34.277 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: dump: 2024-09-19T11:59:34.277 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.277 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.277 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.277 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.277 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.277 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.277 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.277 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.277 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.278 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.278 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: _finish_auth 0 2024-09-19T11:59:34.278 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: _check_auth_tickets 2024-09-19T11:59:34.278 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: handle_config config(0 keys) 2024-09-19T11:59:34.278 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.278 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:59:34.278 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T11:59:33.845+0000 7fb312e05640 10 monclient: dump: 2024-09-19T11:59:34.278 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.278 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.278 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.278 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.278 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.278 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.279 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.279 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.279 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.279 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.279 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 5 monclient: authenticate success, global_id 7508 2024-09-19T11:59:34.279 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T11:59:33.845+0000 7fb314608640 4 set_mon_vals no callback set 2024-09-19T11:59:34.279 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient: _renew_subs 2024-09-19T11:59:34.279 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.279 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient: _renew_subs 2024-09-19T11:59:34.279 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.279 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T11:59:33.845+0000 7fb4286dc9c0 1 librados: init done 2024-09-19T11:59:34.280 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T11:59:33.845+0000 7fb312e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:59:34.280 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T11:59:33.845+0000 7fb312e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:59:34.280 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T11:59:33.845+0000 7fb312e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:59:34.280 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T11:59:33.845+0000 7fb4261e2640 10 monclient: get_auth_request con 0x7fb30c071be0 auth_method 0 2024-09-19T11:59:34.280 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T11:59:33.845+0000 7fb4269e3640 10 monclient: get_auth_request con 0x55ff252af280 auth_method 0 2024-09-19T11:59:34.280 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T11:59:33.849+0000 7fb4261e2640 10 monclient: get_auth_request con 0x55ff252ba770 auth_method 0 2024-09-19T11:59:34.280 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T11:59:33.849+0000 7fb41d9e1640 10 monclient: get_auth_request con 0x55ff252bead0 auth_method 0 2024-09-19T11:59:34.280 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient: get_auth_request con 0x55ff252be030 auth_method 0 2024-09-19T11:59:34.280 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:59:34.280 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:59:34.280 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient: monmap: 2024-09-19T11:59:34.280 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:59:34.280 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:59:34.280 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:59:34.281 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:59:34.281 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:59:34.281 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.281 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:59:34.281 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:59:34.281 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:59:34.281 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.281 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding auth protocol: cephx 2024-09-19T11:59:34.281 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding auth protocol: cephx 2024-09-19T11:59:34.281 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding auth protocol: cephx 2024-09-19T11:59:34.281 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: secure 2024-09-19T11:59:34.281 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: crc 2024-09-19T11:59:34.281 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: secure 2024-09-19T11:59:34.281 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: crc 2024-09-19T11:59:34.282 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: secure 2024-09-19T11:59:34.282 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: crc 2024-09-19T11:59:34.282 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: crc 2024-09-19T11:59:34.282 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: secure 2024-09-19T11:59:34.282 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: crc 2024-09-19T11:59:34.282 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: secure 2024-09-19T11:59:34.282 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: crc 2024-09-19T11:59:34.282 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c6c50) adding con mode: secure 2024-09-19T11:59:34.282 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.282 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command objecter_requests cmddesc objecter_requests hook 0x55ff252ca580 EEXIST 2024-09-19T11:59:34.282 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient: init 2024-09-19T11:59:34.282 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding auth protocol: cephx 2024-09-19T11:59:34.282 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding auth protocol: cephx 2024-09-19T11:59:34.282 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding auth protocol: cephx 2024-09-19T11:59:34.282 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: secure 2024-09-19T11:59:34.283 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: crc 2024-09-19T11:59:34.283 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: secure 2024-09-19T11:59:34.283 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: crc 2024-09-19T11:59:34.283 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: secure 2024-09-19T11:59:34.283 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: crc 2024-09-19T11:59:34.283 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: crc 2024-09-19T11:59:34.283 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: secure 2024-09-19T11:59:34.283 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: crc 2024-09-19T11:59:34.283 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: secure 2024-09-19T11:59:34.283 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: crc 2024-09-19T11:59:34.283 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252c5b48) adding con mode: secure 2024-09-19T11:59:34.283 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.283 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.283 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command rotate-key cmddesc rotate-key hook 0x55ff252c5c90 EEXIST 2024-09-19T11:59:34.284 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:59:34.284 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T11:59:34.284 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff252ee730 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:59:34.284 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff252ee060 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:59:34.284 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff252eca40 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:59:34.284 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.284 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.284 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.284 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:59:34.284 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T11:59:33.853+0000 7fb4286dc9c0 10 monclient(hunting): authenticate will time out at 2468.170671s 2024-09-19T11:59:34.284 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): get_auth_request con 0x55ff252ee060 auth_method 0 2024-09-19T11:59:34.284 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.284 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.284 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.285 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T11:59:33.853+0000 7fb4261e2640 10 monclient(hunting): get_auth_request con 0x55ff252eca40 auth_method 0 2024-09-19T11:59:34.285 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T11:59:33.853+0000 7fb4261e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.285 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T11:59:33.853+0000 7fb4261e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.285 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T11:59:33.853+0000 7fb4261e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.285 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.285 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.285 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.285 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T11:59:33.853+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.285 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T11:59:33.853+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.285 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T11:59:33.853+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.285 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T11:59:33.853+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request con 0x55ff252ee730 auth_method 0 2024-09-19T11:59:34.285 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T11:59:33.853+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.285 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T11:59:33.853+0000 7fb41d9e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.285 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T11:59:33.853+0000 7fb41d9e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.286 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient(hunting): handle_auth_done global_id 7511 payload 824 2024-09-19T11:59:34.286 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient: _finish_hunting 0 2024-09-19T11:59:34.286 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T11:59:33.853+0000 7fb4269e3640 1 monclient: found mon.noname-c 2024-09-19T11:59:34.286 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T11:59:33.853+0000 7fb4269e3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.286 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.286 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:59:34.286 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: dump: 2024-09-19T11:59:34.286 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.286 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.286 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.286 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.286 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.286 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.286 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.286 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.287 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.287 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.287 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: _finish_auth 0 2024-09-19T11:59:34.287 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: _check_auth_tickets 2024-09-19T11:59:34.287 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: handle_config config(0 keys) 2024-09-19T11:59:34.287 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.287 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:59:34.287 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T11:59:33.853+0000 7fb30bfff640 10 monclient: dump: 2024-09-19T11:59:34.287 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.287 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.287 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.287 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.287 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.287 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.288 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.288 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.288 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.288 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.288 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T11:59:33.853+0000 7fb4271e4640 4 set_mon_vals no callback set 2024-09-19T11:59:34.288 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 monclient: authenticate success, global_id 7511 2024-09-19T11:59:34.288 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: _renew_subs 2024-09-19T11:59:34.288 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.288 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: _renew_subs 2024-09-19T11:59:34.288 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.288 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T11:59:33.857+0000 7fb30bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:59:34.288 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T11:59:33.857+0000 7fb30bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:59:34.288 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T11:59:33.857+0000 7fb30bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:59:34.289 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: get_monmap_and_config 2024-09-19T11:59:34.289 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:59:34.289 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:59:34.289 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: monmap: 2024-09-19T11:59:34.289 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:59:34.289 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:59:34.289 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:59:34.289 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:59:34.289 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:59:34.289 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.289 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:59:34.289 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:59:34.289 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:59:34.289 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.289 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding auth protocol: cephx 2024-09-19T11:59:34.290 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding auth protocol: cephx 2024-09-19T11:59:34.290 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding auth protocol: cephx 2024-09-19T11:59:34.290 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: secure 2024-09-19T11:59:34.290 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: crc 2024-09-19T11:59:34.290 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: secure 2024-09-19T11:59:34.290 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: crc 2024-09-19T11:59:34.290 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: secure 2024-09-19T11:59:34.290 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: crc 2024-09-19T11:59:34.290 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: crc 2024-09-19T11:59:34.290 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: secure 2024-09-19T11:59:34.290 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: crc 2024-09-19T11:59:34.290 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: secure 2024-09-19T11:59:34.290 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: crc 2024-09-19T11:59:34.290 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff2530dfa0) adding con mode: secure 2024-09-19T11:59:34.291 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient: get_auth_request con 0x7fb300071b20 auth_method 0 2024-09-19T11:59:34.291 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.291 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: init 2024-09-19T11:59:34.291 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding auth protocol: cephx 2024-09-19T11:59:34.291 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding auth protocol: cephx 2024-09-19T11:59:34.291 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding auth protocol: cephx 2024-09-19T11:59:34.291 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: secure 2024-09-19T11:59:34.291 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: crc 2024-09-19T11:59:34.291 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: secure 2024-09-19T11:59:34.291 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: crc 2024-09-19T11:59:34.291 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: secure 2024-09-19T11:59:34.291 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: crc 2024-09-19T11:59:34.291 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: crc 2024-09-19T11:59:34.291 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: secure 2024-09-19T11:59:34.292 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: crc 2024-09-19T11:59:34.292 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: secure 2024-09-19T11:59:34.292 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: crc 2024-09-19T11:59:34.292 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe87676f20) adding con mode: secure 2024-09-19T11:59:34.292 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.292 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.292 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command rotate-key cmddesc rotate-key hook 0x7ffe87677068 EEXIST 2024-09-19T11:59:34.292 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:59:34.292 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T11:59:34.292 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff25312060 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:59:34.292 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff25342710 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:59:34.292 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff2533d8c0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:59:34.292 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.292 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.293 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.293 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:59:34.293 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T11:59:33.857+0000 7fb4286dc9c0 10 monclient(hunting): authenticate will time out at 2468.175330s 2024-09-19T11:59:34.293 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request con 0x55ff25312060 auth_method 0 2024-09-19T11:59:34.293 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.293 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.293 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.293 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T11:59:33.857+0000 7fb4261e2640 10 monclient(hunting): get_auth_request con 0x55ff2533d8c0 auth_method 0 2024-09-19T11:59:34.293 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T11:59:33.857+0000 7fb4261e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.293 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T11:59:33.857+0000 7fb4261e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.293 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T11:59:33.857+0000 7fb4261e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.293 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.293 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.293 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.294 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T11:59:33.857+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.294 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T11:59:33.857+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.294 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T11:59:33.857+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.294 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_done global_id 8091 payload 274 2024-09-19T11:59:34.294 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient: _finish_hunting 0 2024-09-19T11:59:34.294 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 1 monclient: found mon.noname-a 2024-09-19T11:59:34.294 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T11:59:33.857+0000 7fb41d9e1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T11:59:34.294 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T11:59:33.857+0000 7fb4269e3640 10 monclient: get_auth_request con 0x55ff25342710 auth_method 0 2024-09-19T11:59:34.294 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.294 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T11:59:34.294 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: dump: 2024-09-19T11:59:34.294 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.294 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.294 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.295 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.295 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.295 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.295 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.295 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.295 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.295 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.295 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: _finish_auth 0 2024-09-19T11:59:34.295 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: _check_auth_tickets 2024-09-19T11:59:34.295 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 monclient: authenticate success, global_id 8091 2024-09-19T11:59:34.295 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T11:59:34.295 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.295 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T11:59:34.295 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T11:59:33.861+0000 7fb309ffb640 10 monclient: dump: 2024-09-19T11:59:34.295 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.296 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.296 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.296 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.296 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.296 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.296 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.296 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.296 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.296 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.296 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: get_monmap_and_config success 2024-09-19T11:59:34.296 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 4 set_mon_vals no callback set 2024-09-19T11:59:34.296 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: shutdown 2024-09-19T11:59:34.296 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: build_initial_monmap 2024-09-19T11:59:34.297 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 1 build_initial for_mkfs: 0 2024-09-19T11:59:34.297 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: monmap: 2024-09-19T11:59:34.297 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T11:59:34.297 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T11:59:34.297 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T11:59:34.297 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T11:59:34.297 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T11:59:34.297 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.297 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T11:59:34.297 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T11:59:34.297 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T11:59:34.297 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.297 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding auth protocol: cephx 2024-09-19T11:59:34.297 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding auth protocol: cephx 2024-09-19T11:59:34.297 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding auth protocol: cephx 2024-09-19T11:59:34.298 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: secure 2024-09-19T11:59:34.298 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: crc 2024-09-19T11:59:34.298 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: secure 2024-09-19T11:59:34.298 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: crc 2024-09-19T11:59:34.298 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: secure 2024-09-19T11:59:34.298 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: crc 2024-09-19T11:59:34.298 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: crc 2024-09-19T11:59:34.298 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: secure 2024-09-19T11:59:34.298 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: crc 2024-09-19T11:59:34.298 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: secure 2024-09-19T11:59:34.298 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: crc 2024-09-19T11:59:34.298 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff25334910) adding con mode: secure 2024-09-19T11:59:34.298 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.298 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 1 librados: starting msgr at 2024-09-19T11:59:34.299 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 1 librados: starting objecter 2024-09-19T11:59:34.299 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command objecter_requests cmddesc objecter_requests hook 0x55ff25314120 EEXIST 2024-09-19T11:59:34.299 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 1 librados: setting wanted keys 2024-09-19T11:59:34.299 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 1 librados: calling monclient init 2024-09-19T11:59:34.299 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: init 2024-09-19T11:59:34.299 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding auth protocol: cephx 2024-09-19T11:59:34.299 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding auth protocol: cephx 2024-09-19T11:59:34.299 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding auth protocol: cephx 2024-09-19T11:59:34.299 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: secure 2024-09-19T11:59:34.299 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: crc 2024-09-19T11:59:34.299 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: secure 2024-09-19T11:59:34.299 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: crc 2024-09-19T11:59:34.299 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: secure 2024-09-19T11:59:34.299 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: crc 2024-09-19T11:59:34.300 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: crc 2024-09-19T11:59:34.300 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: secure 2024-09-19T11:59:34.300 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: crc 2024-09-19T11:59:34.300 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: secure 2024-09-19T11:59:34.300 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: crc 2024-09-19T11:59:34.300 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 AuthRegistry(0x55ff252f0550) adding con mode: secure 2024-09-19T11:59:34.300 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.300 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.300 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command rotate-key cmddesc rotate-key hook 0x55ff252f0698 EEXIST 2024-09-19T11:59:34.300 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: _reopen_session rank -1 2024-09-19T11:59:34.300 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T11:59:34.300 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff25312060 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T11:59:34.300 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff2533d8c0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T11:59:34.300 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff25342710 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T11:59:34.301 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.301 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.301 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): start opening mon connection 2024-09-19T11:59:34.301 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): _renew_subs 2024-09-19T11:59:34.301 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient(hunting): authenticate will time out at 2468.177954s 2024-09-19T11:59:34.301 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T11:59:33.861+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request con 0x55ff25312060 auth_method 0 2024-09-19T11:59:34.301 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T11:59:33.861+0000 7fb41d9e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.301 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T11:59:33.861+0000 7fb41d9e1640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.301 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T11:59:33.861+0000 7fb41d9e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.301 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): get_auth_request con 0x55ff25342710 auth_method 0 2024-09-19T11:59:34.301 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T11:59:34.301 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T11:59:34.301 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T11:59:34.301 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T11:59:33.861+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.302 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T11:59:33.861+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.302 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T11:59:33.861+0000 7fb41d9e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.302 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T11:59:34.302 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T11:59:34.302 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T11:59:34.302 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient(hunting): handle_auth_done global_id 7517 payload 824 2024-09-19T11:59:34.302 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient: _finish_hunting 0 2024-09-19T11:59:34.302 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T11:59:33.861+0000 7fb4261e2640 1 monclient: found mon.noname-c 2024-09-19T11:59:34.302 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T11:59:33.861+0000 7fb4261e2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.302 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.302 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T11:59:34.302 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: dump: 2024-09-19T11:59:34.302 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.302 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.303 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.303 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.303 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.303 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.303 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.303 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.303 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.303 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.303 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: _finish_auth 0 2024-09-19T11:59:34.303 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: _check_auth_tickets 2024-09-19T11:59:34.303 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: handle_config config(0 keys) 2024-09-19T11:59:34.303 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T11:59:34.303 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T11:59:34.303 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T11:59:33.861+0000 7fb2f7fff640 10 monclient: dump: 2024-09-19T11:59:34.303 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T11:59:34.304 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T11:59:34.304 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.304 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T11:59:34.304 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T11:59:34.304 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T11:59:34.304 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T11:59:34.304 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T11:59:34.304 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T11:59:34.304 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.304 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T11:59:33.861+0000 7fb309ffb640 4 set_mon_vals no callback set 2024-09-19T11:59:34.304 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 monclient: authenticate success, global_id 7517 2024-09-19T11:59:34.304 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: _renew_subs 2024-09-19T11:59:34.304 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.304 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: _renew_subs 2024-09-19T11:59:34.305 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.305 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 1 librados: init done 2024-09-19T11:59:34.305 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T11:59:33.861+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command cr dump hook 0x7fb410001d88 2024-09-19T11:59:34.305 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.305 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T11:59:33.865+0000 7fb2f7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T11:59:34.305 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T11:59:33.865+0000 7fb2f7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:59:34.305 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T11:59:33.865+0000 7fb2f7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T11:59:34.305 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T11:59:33.865+0000 7fb41d9e1640 10 monclient: get_auth_request con 0x7fb2f0071be0 auth_method 0 2024-09-19T11:59:34.305 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T11:59:33.865+0000 7fb4269e3640 10 monclient: get_auth_request con 0x55ff2535bcd0 auth_method 0 2024-09-19T11:59:34.305 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.305 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 realm 2024-09-19T11:59:34.305 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.305 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.305 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:34.306 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.306 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.306 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T11:59:33.865+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.306 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T11:59:33.865+0000 7fb41d9e1640 10 monclient: get_auth_request con 0x55ff2535fee0 auth_method 0 2024-09-19T11:59:34.306 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T11:59:33.869+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:34.306 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T11:59:33.869+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.306 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T11:59:33.869+0000 7fb4269e3640 10 monclient: get_auth_request con 0x55ff25363720 auth_method 0 2024-09-19T11:59:34.306 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T11:59:33.869+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:34.306 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T11:59:33.869+0000 7fb4286dc9c0 20 searching for the correct realm 2024-09-19T11:59:34.306 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T11:59:33.869+0000 7fb4261e2640 10 monclient: get_auth_request con 0x55ff253681d0 auth_method 0 2024-09-19T11:59:34.306 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T11:59:33.869+0000 7fb41d9e1640 10 monclient: get_auth_request con 0x7fb418025040 auth_method 0 2024-09-19T11:59:34.306 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T11:59:33.869+0000 7fb41d9e1640 0 -- 172.21.15.120:0/1756472305 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7fb418025040 msgr2=0x7fb418066820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:59:34.306 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T11:59:34.073+0000 7fb41d9e1640 10 monclient: get_auth_request con 0x7fb418025040 auth_method 0 2024-09-19T11:59:34.306 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T11:59:34.073+0000 7fb4269e3640 10 monclient: get_auth_request con 0x7fb4100a50d0 auth_method 0 2024-09-19T11:59:34.307 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T11:59:34.077+0000 7fb4261e2640 10 monclient: get_auth_request con 0x55ff250fbcf0 auth_method 0 2024-09-19T11:59:34.307 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T11:59:34.081+0000 7fb4269e3640 0 -- 172.21.15.120:0/1756472305 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fb4100a50d0 msgr2=0x7fb410100040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:34.307 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T11:59:34.081+0000 7fb2f7fff640 1 client.7517.objecter ms_handle_reset 0x7fb4100a50d0 session 0x7fb4100a7070 osd.2 2024-09-19T11:59:34.307 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T11:59:34.085+0000 7fb2f7fff640 10 monclient: _renew_subs 2024-09-19T11:59:34.307 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T11:59:34.085+0000 7fb2f7fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T11:59:34.307 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T11:59:34.085+0000 7fb4269e3640 10 monclient: get_auth_request con 0x7fb2f0082280 auth_method 0 2024-09-19T11:59:34.307 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T11:59:34.085+0000 7fb41d9e1640 10 monclient: get_auth_request con 0x7fb418017030 auth_method 0 2024-09-19T11:59:34.307 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:34.307 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:34.307 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:34.307 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:34.307 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:34.307 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:34.307 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.307 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.308 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T11:59:34.101+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.308 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:34.308 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.308 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:34.308 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 zone default found 2024-09-19T11:59:34.308 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 4 Realm: () 2024-09-19T11:59:34.308 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:34.308 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:34.308 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:34.308 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 zonegroup default 2024-09-19T11:59:34.308 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.308 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.308 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.308 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.309 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.309 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.309 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 started sync module instance, tier type = 2024-09-19T11:59:34.309 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T11:59:34.105+0000 7fb4286dc9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:34.309 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=0 2024-09-19T11:59:34.309 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=1 2024-09-19T11:59:34.309 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=2 2024-09-19T11:59:34.309 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=3 2024-09-19T11:59:34.309 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=4 2024-09-19T11:59:34.309 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=5 2024-09-19T11:59:34.309 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=6 2024-09-19T11:59:34.309 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 20 add_watcher() i=7 2024-09-19T11:59:34.309 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T11:59:34.129+0000 7fb4286dc9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:34.309 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding auth protocol: cephx 2024-09-19T11:59:34.310 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding auth protocol: cephx 2024-09-19T11:59:34.310 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding auth protocol: cephx 2024-09-19T11:59:34.310 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: secure 2024-09-19T11:59:34.310 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: crc 2024-09-19T11:59:34.310 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: secure 2024-09-19T11:59:34.310 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: crc 2024-09-19T11:59:34.310 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: secure 2024-09-19T11:59:34.310 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: crc 2024-09-19T11:59:34.310 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T11:59:34.133+0000 7fb2dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:34.310 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: crc 2024-09-19T11:59:34.310 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: secure 2024-09-19T11:59:34.310 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: crc 2024-09-19T11:59:34.310 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: secure 2024-09-19T11:59:34.310 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: crc 2024-09-19T11:59:34.310 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T11:59:34.133+0000 7fb4286dc9c0 5 AuthRegistry(0x7ffe876773f0) adding con mode: secure 2024-09-19T11:59:34.311 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T11:59:34.311 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:34.311 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:34.311 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command cache list hook 0x55ff25337dd0 2024-09-19T11:59:34.311 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command cache inspect hook 0x55ff25337dd0 2024-09-19T11:59:34.311 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command cache erase hook 0x55ff25337dd0 2024-09-19T11:59:34.311 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command cache zap hook 0x55ff25337dd0 2024-09-19T11:59:34.311 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 note: GC not initialized 2024-09-19T11:59:34.311 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T11:59:34.137+0000 7fb2d77fe640 20 reqs_thread_entry: start 2024-09-19T11:59:34.311 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command sync trace show hook 0x7fb4200014a0 2024-09-19T11:59:34.311 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command sync trace history hook 0x7fb4200014a0 2024-09-19T11:59:34.311 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command sync trace active hook 0x7fb4200014a0 2024-09-19T11:59:34.311 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 5 asok(0x55ff25061d90) register_command sync trace active_short hook 0x7fb4200014a0 2024-09-19T11:59:34.311 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:34.312 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 Filter name: none 2024-09-19T11:59:34.312 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T11:59:34.137+0000 7fb2d57fa640 20 reqs_thread_entry: start 2024-09-19T11:59:34.312 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-19T11:59:34.312 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.312 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:34.312 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-19T11:59:34.312 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-19T11:59:34.312 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 : miss 2024-09-19T11:59:34.312 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.312 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T11:59:34.312 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T11:59:34.312 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T11:59:34.312 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:59:34.312 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:34.313 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T11:59:34.137+0000 7fb4286dc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 2024-09-19T11:59:34.313 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T11:59:34.313 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T11:59:34.313 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:34.313 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40, ofs0, ns] 2024-09-19T11:59:34.313 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T11:59:34.149+0000 7fb309ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 94554329376944 notifier 7517 bl.length()=1015 2024-09-19T11:59:34.313 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T11:59:34.149+0000 7fb309ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T11:59:34.313 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T11:59:34.149+0000 7fb309ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T11:59:34.313 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T11:59:34.149+0000 7fb309ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:34.313 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): orig_sources= new_sources= 2024-09-19T11:59:34.313 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): potential sources added=[] removed=[] 2024-09-19T11:59:34.313 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): orig_dests= new_dests= 2024-09-19T11:59:34.313 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T11:59:34.149+0000 7fb4286dc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): potential dests added=[] removed=[] 2024-09-19T11:59:34.313 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T11:59:34.153+0000 7fb4286dc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.1.0 2024-09-19T11:59:34.314 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T11:59:34.153+0000 7fb4286dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.1.0 2024-09-19T11:59:34.314 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T11:59:34.153+0000 7fb4286dc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.1.1 2024-09-19T11:59:34.314 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T11:59:34.153+0000 7fb4286dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.1.1 2024-09-19T11:59:34.314 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T11:59:34.153+0000 7fb4286dc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.0 2024-09-19T11:59:34.314 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T11:59:34.161+0000 7fb4286dc9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb4286dc9c0 time 2024-09-19T11:59:34.162242+0000 2024-09-19T11:59:34.314 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T11:59:34.314 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.314 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:59:34.314 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb42bfb62eb] 2024-09-19T11:59:34.314 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb42bfb649f] 2024-09-19T11:59:34.314 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff2271c271] 2024-09-19T11:59:34.314 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ff2272b441] 2024-09-19T11:59:34.314 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ff2272ca94] 2024-09-19T11:59:34.314 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T11:59:34.315 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb42ae1cd90] 2024-09-19T11:59:34.315 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T11:59:34.315 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T11:59:34.315 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.315 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T11:59:34.165+0000 7fb4286dc9c0 -1 *** Caught signal (Aborted) ** 2024-09-19T11:59:34.315 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7fb4286dc9c0 thread_name:radosgw-admin 2024-09-19T11:59:34.315 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.315 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T11:59:34.315 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb42ae35520] 2024-09-19T11:59:34.315 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T11:59:34.315 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T11:59:34.315 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T11:59:34.315 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb42bfb6345] 2024-09-19T11:59:34.315 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb42bfb649f] 2024-09-19T11:59:34.316 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff2271c271] 2024-09-19T11:59:34.316 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55ff2272b441] 2024-09-19T11:59:34.316 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ff2272ca94] 2024-09-19T11:59:34.316 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T11:59:34.316 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb42ae1cd90] 2024-09-19T11:59:34.316 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T11:59:34.316 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T11:59:34.316 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T11:59:34.316 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.316 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T11:59:34.316 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T11:59:34.316 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T11:59:34.316 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T11:59:34.316 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T11:59:34.316 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T11:59:34.317 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T11:59:34.317 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T11:59:34.317 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T11:59:34.317 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T11:59:34.317 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T11:59:34.317 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T11:59:34.317 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T11:59:34.317 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T11:59:34.317 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T11:59:34.317 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T11:59:34.317 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T11:59:34.317 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T11:59:34.317 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T11:59:34.318 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T11:59:34.318 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T11:59:34.318 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T11:59:34.318 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T11:59:34.318 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T11:59:34.318 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T11:59:34.318 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T11:59:34.318 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T11:59:34.318 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T11:59:34.318 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T11:59:34.318 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T11:59:34.318 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T11:59:34.318 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T11:59:34.318 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T11:59:34.319 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T11:59:34.319 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T11:59:34.319 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T11:59:34.319 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T11:59:34.319 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T11:59:34.319 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T11:59:34.319 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T11:59:34.319 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T11:59:34.319 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T11:59:34.319 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T11:59:34.319 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T11:59:34.319 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T11:59:34.319 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T11:59:34.319 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T11:59:34.319 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T11:59:34.320 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T11:59:34.320 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T11:59:34.320 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T11:59:34.320 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T11:59:34.320 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T11:59:34.320 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T11:59:34.320 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T11:59:34.320 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T11:59:34.320 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T11:59:34.320 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T11:59:34.320 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T11:59:34.320 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T11:59:34.320 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T11:59:34.320 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T11:59:34.321 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T11:59:34.321 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T11:59:34.321 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T11:59:34.321 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T11:59:34.321 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T11:59:34.321 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T11:59:34.321 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T11:59:34.321 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T11:59:34.321 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T11:59:34.321 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T11:59:34.321 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T11:59:34.321 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T11:59:34.321 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T11:59:34.321 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T11:59:34.322 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T11:59:34.322 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T11:59:34.322 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T11:59:34.322 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T11:59:34.322 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T11:59:34.322 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T11:59:34.322 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T11:59:34.322 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T11:59:34.322 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T11:59:34.322 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T11:59:34.322 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T11:59:34.322 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T11:59:34.322 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T11:59:34.322 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T11:59:34.322 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T11:59:34.323 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T11:59:34.323 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T11:59:34.323 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T11:59:34.323 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb2d57fa640 / http_manager 2024-09-19T11:59:34.323 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb2d77fe640 / http_manager 2024-09-19T11:59:34.323 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb2dd7e2640 / rgw_dt_lg_renew 2024-09-19T11:59:34.323 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb2f7fff640 / ms_dispatch 2024-09-19T11:59:34.323 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb309ffb640 / io_context_pool 2024-09-19T11:59:34.323 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb30bfff640 / ms_dispatch 2024-09-19T11:59:34.323 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb312e05640 / ms_dispatch 2024-09-19T11:59:34.323 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb314608640 / io_context_pool 2024-09-19T11:59:34.323 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb41d9e1640 / msgr-worker-2 2024-09-19T11:59:34.323 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb4261e2640 / msgr-worker-1 2024-09-19T11:59:34.323 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb4269e3640 / msgr-worker-0 2024-09-19T11:59:34.324 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb4271e4640 / io_context_pool 2024-09-19T11:59:34.324 INFO:tasks.workunit.client.0.smithi120.stderr: 7fb4286dc9c0 / radosgw-admin 2024-09-19T11:59:34.324 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T11:59:34.324 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T11:59:34.324 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/lib/ceph/crash/2024-09-19T11:59:34.168827Z_aaf3a39e-7fba-44f2-9065-a15e17132a83/log 2024-09-19T11:59:34.324 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T11:59:34.324 INFO:tasks.workunit.client.0.smithi120.stderr:Aborted 2024-09-19T11:59:34.324 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-19T11:59:34.324 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:59:34.324 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:59:34.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.257+0000 7f2d5dc129c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.257+0000 7f2d5dc129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.257+0000 7f2d5dc129c0 20 realm 2024-09-19T11:59:34.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.257+0000 7f2d5dc129c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.257+0000 7f2d5dc129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.257+0000 7f2d5dc129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:34.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.257+0000 7f2d5dc129c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.257+0000 7f2d5dc129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.257+0000 7f2d5dc129c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.261+0000 7f2d5dc129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:34.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.261+0000 7f2d5dc129c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.261+0000 7f2d5dc129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:34.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.261+0000 7f2d5dc129c0 20 searching for the correct realm 2024-09-19T11:59:34.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.265+0000 7f2d5af17640 0 -- 172.21.15.120:0/212030260 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7f2d4c01ab40 msgr2=0x7f2d4c027970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T11:59:34.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.477+0000 7f2d5bf19640 0 -- 172.21.15.120:0/212030260 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f2d500ea070 msgr2=0x7f2d5010e310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:34.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.497+0000 7f2d5dc129c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:34.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.497+0000 7f2d5dc129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:34.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.497+0000 7f2d5dc129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:34.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.497+0000 7f2d5dc129c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:34.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.497+0000 7f2d5dc129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:34.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.497+0000 7f2d5dc129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:34.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.497+0000 7f2d5dc129c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.497+0000 7f2d5dc129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.497+0000 7f2d5dc129c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.497+0000 7f2d5dc129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:34.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.497+0000 7f2d5dc129c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.501+0000 7f2d5dc129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:34.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.501+0000 7f2d5dc129c0 20 zone default found 2024-09-19T11:59:34.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.501+0000 7f2d5dc129c0 4 Realm: () 2024-09-19T11:59:34.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.501+0000 7f2d5dc129c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:34.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.501+0000 7f2d5dc129c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:34.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.501+0000 7f2d5dc129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:34.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.501+0000 7f2d5dc129c0 20 zonegroup default 2024-09-19T11:59:34.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.501+0000 7f2d5dc129c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.501+0000 7f2d5dc129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.501+0000 7f2d5dc129c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.501+0000 7f2d5dc129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.501+0000 7f2d5dc129c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.501+0000 7f2d5dc129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.501+0000 7f2d5dc129c0 20 started sync module instance, tier type = 2024-09-19T11:59:34.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.501+0000 7f2d5dc129c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:34.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.521+0000 7f2d5dc129c0 20 add_watcher() i=0 2024-09-19T11:59:34.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.521+0000 7f2d5dc129c0 20 add_watcher() i=1 2024-09-19T11:59:34.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.521+0000 7f2d5dc129c0 20 add_watcher() i=2 2024-09-19T11:59:34.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.521+0000 7f2d5dc129c0 20 add_watcher() i=3 2024-09-19T11:59:34.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.521+0000 7f2d5dc129c0 20 add_watcher() i=4 2024-09-19T11:59:34.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.521+0000 7f2d5dc129c0 20 add_watcher() i=5 2024-09-19T11:59:34.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.521+0000 7f2d5dc129c0 20 add_watcher() i=6 2024-09-19T11:59:34.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.525+0000 7f2d5dc129c0 20 add_watcher() i=7 2024-09-19T11:59:34.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.525+0000 7f2d5dc129c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:34.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.529+0000 7f2c11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:34.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.529+0000 7f2d5dc129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:34.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.529+0000 7f2d5dc129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:34.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.529+0000 7f2d5dc129c0 5 note: GC not initialized 2024-09-19T11:59:34.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.529+0000 7f2c10fe1640 20 reqs_thread_entry: start 2024-09-19T11:59:34.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.529+0000 7f2d5dc129c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:34.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.529+0000 7f2d5dc129c0 20 Filter name: none 2024-09-19T11:59:34.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.529+0000 7f2b8a7fc640 20 reqs_thread_entry: start 2024-09-19T11:59:34.524 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.529+0000 7f2d5dc129c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.529+0000 7f2d5dc129c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:34.525 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.529+0000 7f2d5dc129c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.529+0000 7f2d5dc129c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T11:59:34.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.529+0000 7f2d5dc129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:34.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.529+0000 7f2d5dc129c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.533+0000 7f2d5dc129c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:34.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.533+0000 7f2d5dc129c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.533+0000 7f2d5dc129c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T11:59:34.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.533+0000 7f2d5dc129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:59:34.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.533+0000 7f2c11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:34.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.537+0000 7f2d5dc129c0 20 remove_watcher() i=0 2024-09-19T11:59:34.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.537+0000 7f2d5dc129c0 2 removed watcher, disabling cache 2024-09-19T11:59:34.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.541+0000 7f2d5dc129c0 20 remove_watcher() i=1 2024-09-19T11:59:34.539 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.545+0000 7f2d5dc129c0 20 remove_watcher() i=2 2024-09-19T11:59:34.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.545+0000 7f2d5dc129c0 20 remove_watcher() i=3 2024-09-19T11:59:34.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.549+0000 7f2d5dc129c0 20 remove_watcher() i=4 2024-09-19T11:59:34.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.549+0000 7f2d5dc129c0 20 remove_watcher() i=5 2024-09-19T11:59:34.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.549+0000 7f2d5dc129c0 20 remove_watcher() i=6 2024-09-19T11:59:34.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.553+0000 7f2d5dc129c0 20 remove_watcher() i=7 2024-09-19T11:59:34.561 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.561 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T11:59:34.561 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-change-reshard-state id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-19T11:59:34.561 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T11:59:34.620 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T11:59:34.656 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:59:34.656 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:59:34.912 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.917+0000 7f25afdcf9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.917+0000 7f25afdcf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.917+0000 7f25afdcf9c0 20 realm 2024-09-19T11:59:34.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.917+0000 7f25afdcf9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.917+0000 7f25afdcf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.917+0000 7f25afdcf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:59:34.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.917+0000 7f25afdcf9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.917+0000 7f25afdcf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:34.914 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.917+0000 7f25afdcf9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.921+0000 7f25afdcf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:34.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.921+0000 7f25afdcf9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:34.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:34.921+0000 7f25ae0d6640 0 -- 172.21.15.120:0/179002087 >> [v2:172.21.15.151:6808/4185618971,v1:172.21.15.151:6809/4185618971] conn(0x561ec9b6c720 msgr2=0x561ec9b6eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:35.121 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.125+0000 7f25afdcf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T11:59:35.121 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.125+0000 7f25afdcf9c0 20 searching for the correct realm 2024-09-19T11:59:35.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.133+0000 7f25ad8d5640 0 -- 172.21.15.120:0/179002087 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f25a802f020 msgr2=0x7f25a8067df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T11:59:35.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.361+0000 7f25afdcf9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T11:59:35.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.361+0000 7f25afdcf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:59:35.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.361+0000 7f25afdcf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:59:35.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.361+0000 7f25afdcf9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T11:59:35.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.361+0000 7f25afdcf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:59:35.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.361+0000 7f25afdcf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:59:35.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.361+0000 7f25afdcf9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:35.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.361+0000 7f25afdcf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:35.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.361+0000 7f25afdcf9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:35.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.361+0000 7f25afdcf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:59:35.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.361+0000 7f25afdcf9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:35.359 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.365+0000 7f25afdcf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T11:59:35.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.365+0000 7f25afdcf9c0 20 zone default found 2024-09-19T11:59:35.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.365+0000 7f25afdcf9c0 4 Realm: () 2024-09-19T11:59:35.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.365+0000 7f25afdcf9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T11:59:35.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.365+0000 7f25afdcf9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T11:59:35.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.365+0000 7f25afdcf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:59:35.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.365+0000 7f25afdcf9c0 20 zonegroup default 2024-09-19T11:59:35.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.365+0000 7f25afdcf9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:35.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.365+0000 7f25afdcf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:35.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.365+0000 7f25afdcf9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:35.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.365+0000 7f25afdcf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:35.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.365+0000 7f25afdcf9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:35.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.365+0000 7f25afdcf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:59:35.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.365+0000 7f25afdcf9c0 20 started sync module instance, tier type = 2024-09-19T11:59:35.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.365+0000 7f25afdcf9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T11:59:35.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.389+0000 7f25afdcf9c0 20 add_watcher() i=0 2024-09-19T11:59:35.386 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.389+0000 7f25afdcf9c0 20 add_watcher() i=1 2024-09-19T11:59:35.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.389+0000 7f25afdcf9c0 20 add_watcher() i=2 2024-09-19T11:59:35.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.389+0000 7f25afdcf9c0 20 add_watcher() i=3 2024-09-19T11:59:35.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.389+0000 7f25afdcf9c0 20 add_watcher() i=4 2024-09-19T11:59:35.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.389+0000 7f25afdcf9c0 20 add_watcher() i=5 2024-09-19T11:59:35.387 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.389+0000 7f25afdcf9c0 20 add_watcher() i=6 2024-09-19T11:59:35.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.393+0000 7f25afdcf9c0 20 add_watcher() i=7 2024-09-19T11:59:35.389 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.393+0000 7f25afdcf9c0 2 all 8 watchers are set, enabling cache 2024-09-19T11:59:35.393 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.397+0000 7f245f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:35.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.397+0000 7f25afdcf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:59:35.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.397+0000 7f25afdcf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:59:35.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.397+0000 7f25afdcf9c0 5 note: GC not initialized 2024-09-19T11:59:35.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.397+0000 7f245e7fc640 20 reqs_thread_entry: start 2024-09-19T11:59:35.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f25afdcf9c0 20 init_complete bucket index max shards: 1 2024-09-19T11:59:35.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f25afdcf9c0 20 Filter name: none 2024-09-19T11:59:35.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f23cffff640 20 reqs_thread_entry: start 2024-09-19T11:59:35.395 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f25afdcf9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-19T11:59:35.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f25afdcf9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:35.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f25afdcf9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T11:59:35.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f25afdcf9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-19T11:59:35.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f25afdcf9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-19T11:59:35.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f25afdcf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 : miss 2024-09-19T11:59:35.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f25afdcf9c0 20 rados->read ofs=0 len=0 2024-09-19T11:59:35.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f25afdcf9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T11:59:35.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f25afdcf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T11:59:35.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f25afdcf9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T11:59:35.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f25afdcf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:59:35.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f25afdcf9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T11:59:35.397 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.401+0000 7f25afdcf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 2024-09-19T11:59:35.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.405+0000 7f25afdcf9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to be held by another RGW process; skipping for now 2024-09-19T11:59:35.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.405+0000 7f245f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:59:35.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.409+0000 7f25afdcf9c0 20 remove_watcher() i=0 2024-09-19T11:59:35.405 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.409+0000 7f25afdcf9c0 2 removed watcher, disabling cache 2024-09-19T11:59:35.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.413+0000 7f25afdcf9c0 20 remove_watcher() i=1 2024-09-19T11:59:35.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.413+0000 7f25afdcf9c0 20 remove_watcher() i=2 2024-09-19T11:59:35.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.417+0000 7f25afdcf9c0 20 remove_watcher() i=3 2024-09-19T11:59:35.413 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.417+0000 7f25afdcf9c0 20 remove_watcher() i=4 2024-09-19T11:59:35.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.421+0000 7f25afdcf9c0 20 remove_watcher() i=5 2024-09-19T11:59:35.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.421+0000 7f25afdcf9c0 20 remove_watcher() i=6 2024-09-19T11:59:35.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T11:59:35.421+0000 7f25afdcf9c0 20 remove_watcher() i=7 2024-09-19T11:59:35.435 INFO:tasks.workunit.client.0.smithi120.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T12:00:05.463 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-19T12:00:05.500 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:00:05.500 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:00:05.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.549+0000 7fa64cf8c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.553+0000 7fa64cf8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:05.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.553+0000 7fa64cf8c9c0 20 realm 2024-09-19T12:00:05.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.553+0000 7fa64cf8c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.553+0000 7fa64cf8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:05.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.553+0000 7fa64cf8c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:05.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.553+0000 7fa64cf8c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.553+0000 7fa64cf8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:05.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.553+0000 7fa64cf8c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.553+0000 7fa64cf8c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:05.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.553+0000 7fa64cf8c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.551 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.557+0000 7fa64cf8c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:05.551 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.557+0000 7fa64cf8c9c0 20 searching for the correct realm 2024-09-19T12:00:05.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.557+0000 7fa64b293640 0 -- 172.21.15.120:0/23302676 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fa64011b070 msgr2=0x7fa640109a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:05.562 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.565+0000 7fa64a291640 0 -- 172.21.15.120:0/23302676 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fa63c01c430 msgr2=0x7fa63c01c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:05.777 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.781+0000 7fa64cf8c9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:05.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.781+0000 7fa64cf8c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:05.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.781+0000 7fa64cf8c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:05.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.781+0000 7fa64cf8c9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:05.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.781+0000 7fa64cf8c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:05.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.781+0000 7fa64cf8c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:05.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.781+0000 7fa64cf8c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.781+0000 7fa64cf8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:05.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.781+0000 7fa64cf8c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:05.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:05.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 20 zone default found 2024-09-19T12:00:05.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 4 Realm: () 2024-09-19T12:00:05.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:05.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:05.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:05.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 20 zonegroup default 2024-09-19T12:00:05.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:05.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:05.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:05.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 20 started sync module instance, tier type = 2024-09-19T12:00:05.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.785+0000 7fa64cf8c9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:05.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.809+0000 7fa64cf8c9c0 20 add_watcher() i=0 2024-09-19T12:00:05.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.809+0000 7fa64cf8c9c0 20 add_watcher() i=1 2024-09-19T12:00:05.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.809+0000 7fa64cf8c9c0 20 add_watcher() i=2 2024-09-19T12:00:05.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.809+0000 7fa64cf8c9c0 20 add_watcher() i=3 2024-09-19T12:00:05.803 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.809+0000 7fa64cf8c9c0 20 add_watcher() i=4 2024-09-19T12:00:05.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.809+0000 7fa64cf8c9c0 20 add_watcher() i=5 2024-09-19T12:00:05.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.809+0000 7fa64cf8c9c0 20 add_watcher() i=6 2024-09-19T12:00:05.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.809+0000 7fa64cf8c9c0 20 add_watcher() i=7 2024-09-19T12:00:05.804 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.809+0000 7fa64cf8c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:05.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.813+0000 7fa5017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:05.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.813+0000 7fa64cf8c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:05.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.813+0000 7fa64cf8c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:05.809 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.813+0000 7fa64cf8c9c0 5 note: GC not initialized 2024-09-19T12:00:05.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.813+0000 7fa47bfff640 20 reqs_thread_entry: start 2024-09-19T12:00:05.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.813+0000 7fa64cf8c9c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:05.810 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.813+0000 7fa64cf8c9c0 20 Filter name: none 2024-09-19T12:00:05.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.813+0000 7fa479ffb640 20 reqs_thread_entry: start 2024-09-19T12:00:05.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.813+0000 7fa64cf8c9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-19T12:00:05.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.813+0000 7fa64cf8c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.817+0000 7fa64cf8c9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T12:00:05.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.817+0000 7fa64cf8c9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-19T12:00:05.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.817+0000 7fa64cf8c9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-19T12:00:05.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.817+0000 7fa64cf8c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 : miss 2024-09-19T12:00:05.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.817+0000 7fa64cf8c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.817+0000 7fa64cf8c9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-19T12:00:05.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.817+0000 7fa64cf8c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T12:00:05.812 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.817+0000 7fa64cf8c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T12:00:05.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.817+0000 7fa64cf8c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:00:05.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.817+0000 7fa64cf8c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T12:00:05.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.817+0000 7fa64cf8c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 2024-09-19T12:00:05.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.817+0000 7fa64cf8c9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T12:00:05.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.829+0000 7fa64cf8c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T12:00:05.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.829+0000 7fa64cf8c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T12:00:05.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.829+0000 7fa64cf8c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T12:00:05.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.829+0000 7fa64cf8c9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40, ofs0, ns] 2024-09-19T12:00:05.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.829+0000 7fa52e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366174 cookie 94277715987600 notifier 8148 bl.length()=1015 2024-09-19T12:00:05.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.829+0000 7fa52e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T12:00:05.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.829+0000 7fa52e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T12:00:05.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.829+0000 7fa52e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T12:00:05.824 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.829+0000 7fa64cf8c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): orig_sources= new_sources= 2024-09-19T12:00:05.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.829+0000 7fa64cf8c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): potential sources added=[] removed=[] 2024-09-19T12:00:05.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.829+0000 7fa64cf8c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): orig_dests= new_dests= 2024-09-19T12:00:05.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.829+0000 7fa64cf8c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): potential dests added=[] removed=[] 2024-09-19T12:00:05.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.837+0000 7fa64cf8c9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.2.0 2024-09-19T12:00:05.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.837+0000 7fa64cf8c9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.2.0 2024-09-19T12:00:05.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.837+0000 7fa64cf8c9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.2.1 2024-09-19T12:00:05.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.837+0000 7fa64cf8c9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.2.1 2024-09-19T12:00:05.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.837+0000 7fa64cf8c9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.0 2024-09-19T12:00:05.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.841+0000 7fa64cf8c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 : hit (requested=0x17, cached=0x17) 2024-09-19T12:00:05.835 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.841+0000 7fa64cf8c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 2024-09-19T12:00:05.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.841+0000 7fa64cf8c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T12:00:05.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.841+0000 7fa64cf8c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T12:00:05.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.841+0000 7fa64cf8c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T12:00:05.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.841+0000 7fa64cf8c9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40, ofs0, ns] 2024-09-19T12:00:05.839 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.845+0000 7fa52e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94277715987600 notifier 8148 bl.length()=1015 2024-09-19T12:00:05.839 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.845+0000 7fa52e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T12:00:05.839 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.845+0000 7fa52e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T12:00:05.839 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.845+0000 7fa52e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T12:00:05.840 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.845+0000 7fa64cf8c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): orig_sources= new_sources= 2024-09-19T12:00:05.840 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.845+0000 7fa64cf8c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): potential sources added=[] removed=[] 2024-09-19T12:00:05.840 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.845+0000 7fa64cf8c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): orig_dests= new_dests= 2024-09-19T12:00:05.840 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.845+0000 7fa64cf8c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): potential dests added=[] removed=[] 2024-09-19T12:00:05.841 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.845+0000 7fa64cf8c9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40.0 2024-09-19T12:00:05.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.845+0000 7fa64cf8c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 : hit (requested=0x17, cached=0x17) 2024-09-19T12:00:05.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.845+0000 7fa64cf8c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 2024-09-19T12:00:05.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.849+0000 7fa64cf8c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T12:00:05.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.849+0000 7fa64cf8c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T12:00:05.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.849+0000 7fa64cf8c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T12:00:05.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.849+0000 7fa64cf8c9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40, ofs0, ns] 2024-09-19T12:00:05.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.849+0000 7fa52dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 94277715987600 notifier 8148 bl.length()=983 2024-09-19T12:00:05.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.849+0000 7fa52dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 info.flags=0x17 2024-09-19T12:00:05.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.849+0000 7fa52dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 to cache LRU end 2024-09-19T12:00:05.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.849+0000 7fa52dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-19T12:00:05.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.849+0000 7fa64cf8c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): orig_sources= new_sources= 2024-09-19T12:00:05.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.849+0000 7fa64cf8c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): potential sources added=[] removed=[] 2024-09-19T12:00:05.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.849+0000 7fa64cf8c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): orig_dests= new_dests= 2024-09-19T12:00:05.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.849+0000 7fa64cf8c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40]): potential dests added=[] removed=[] 2024-09-19T12:00:05.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.853+0000 7fa64cf8c9c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-19T12:00:05.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.857+0000 7fa5017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:05.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.861+0000 7fa64cf8c9c0 20 remove_watcher() i=0 2024-09-19T12:00:05.857 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.861+0000 7fa64cf8c9c0 2 removed watcher, disabling cache 2024-09-19T12:00:05.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.865+0000 7fa64cf8c9c0 20 remove_watcher() i=1 2024-09-19T12:00:05.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.865+0000 7fa64cf8c9c0 20 remove_watcher() i=2 2024-09-19T12:00:05.863 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.869+0000 7fa64cf8c9c0 20 remove_watcher() i=3 2024-09-19T12:00:05.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.869+0000 7fa64cf8c9c0 20 remove_watcher() i=4 2024-09-19T12:00:05.867 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.873+0000 7fa64cf8c9c0 20 remove_watcher() i=5 2024-09-19T12:00:05.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.873+0000 7fa64cf8c9c0 20 remove_watcher() i=6 2024-09-19T12:00:05.871 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.873+0000 7fa64cf8c9c0 20 remove_watcher() i=7 2024-09-19T12:00:05.887 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-19T12:00:05.914 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:00:05.914 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:00:05.958 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.961+0000 7f703df519c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.965+0000 7f703df519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:05.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.965+0000 7f703df519c0 20 realm 2024-09-19T12:00:05.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.965+0000 7f703df519c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.965+0000 7f703df519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:05.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.965+0000 7f703df519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:05.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.965+0000 7f703df519c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.965+0000 7f703df519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:05.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.965+0000 7f703df519c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.965+0000 7f703df519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:05.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.965+0000 7f703df519c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:05.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.969+0000 7f703df519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:05.964 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.969+0000 7f703df519c0 20 searching for the correct realm 2024-09-19T12:00:05.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.973+0000 7f703c258640 0 -- 172.21.15.120:0/2952838199 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f703006ecf0 msgr2=0x7f7030064570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:05.974 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:05.977+0000 7f703b256640 0 -- 172.21.15.120:0/2952838199 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f702c0dd040 msgr2=0x7f702c0de940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:06.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.193+0000 7f703df519c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:06.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.193+0000 7f703df519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:06.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.193+0000 7f703df519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:06.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.193+0000 7f703df519c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:06.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.193+0000 7f703df519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:06.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.193+0000 7f703df519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:06.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.193+0000 7f703df519c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:06.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:06.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.192 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:06.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 20 zone default found 2024-09-19T12:00:06.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 4 Realm: () 2024-09-19T12:00:06.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:06.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:06.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:06.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 20 zonegroup default 2024-09-19T12:00:06.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:06.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:06.194 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.197+0000 7f703df519c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.201+0000 7f703df519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:06.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.201+0000 7f703df519c0 20 started sync module instance, tier type = 2024-09-19T12:00:06.195 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.201+0000 7f703df519c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:06.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.225+0000 7f703df519c0 20 add_watcher() i=0 2024-09-19T12:00:06.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.225+0000 7f703df519c0 20 add_watcher() i=1 2024-09-19T12:00:06.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.225+0000 7f703df519c0 20 add_watcher() i=2 2024-09-19T12:00:06.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.225+0000 7f703df519c0 20 add_watcher() i=3 2024-09-19T12:00:06.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.225+0000 7f703df519c0 20 add_watcher() i=4 2024-09-19T12:00:06.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.225+0000 7f703df519c0 20 add_watcher() i=5 2024-09-19T12:00:06.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.225+0000 7f703df519c0 20 add_watcher() i=6 2024-09-19T12:00:06.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.225+0000 7f703df519c0 20 add_watcher() i=7 2024-09-19T12:00:06.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.225+0000 7f703df519c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:06.225 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.229+0000 7f6ef1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:06.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.229+0000 7f703df519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:06.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.229+0000 7f703df519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:06.230 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.233+0000 7f703df519c0 5 note: GC not initialized 2024-09-19T12:00:06.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.233+0000 7f6ef0fe1640 20 reqs_thread_entry: start 2024-09-19T12:00:06.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.233+0000 7f703df519c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:06.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.233+0000 7f703df519c0 20 Filter name: none 2024-09-19T12:00:06.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.233+0000 7f6e6a7fc640 20 reqs_thread_entry: start 2024-09-19T12:00:06.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.233+0000 7f703df519c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.233+0000 7f703df519c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T12:00:06.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.233+0000 7f703df519c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.233+0000 7f703df519c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T12:00:06.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.233+0000 7f703df519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:06.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.233+0000 7f703df519c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.233+0000 7f703df519c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-19T12:00:06.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.233+0000 7f703df519c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.232 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.237+0000 7f703df519c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T12:00:06.233 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.237+0000 7f703df519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:06.233 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.237+0000 7f6ef1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:06.238 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.241+0000 7f703df519c0 20 remove_watcher() i=0 2024-09-19T12:00:06.238 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.241+0000 7f703df519c0 2 removed watcher, disabling cache 2024-09-19T12:00:06.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.245+0000 7f703df519c0 20 remove_watcher() i=1 2024-09-19T12:00:06.243 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.249+0000 7f703df519c0 20 remove_watcher() i=2 2024-09-19T12:00:06.245 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.249+0000 7f703df519c0 20 remove_watcher() i=3 2024-09-19T12:00:06.248 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.253+0000 7f703df519c0 20 remove_watcher() i=4 2024-09-19T12:00:06.249 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.253+0000 7f703df519c0 20 remove_watcher() i=5 2024-09-19T12:00:06.252 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.257+0000 7f703df519c0 20 remove_watcher() i=6 2024-09-19T12:00:06.253 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.257+0000 7f703df519c0 20 remove_watcher() i=7 2024-09-19T12:00:06.270 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:06.270 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T12:00:06.270 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: abort-at-change-reshard-state id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-19T12:00:06.270 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:06.343 INFO:tasks.workunit.client.0.smithi120.stderr: test: logrecord could be stopped after reshard failed 2024-09-19T12:00:06.343 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T12:00:06.371 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:00:06.371 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:00:06.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.417+0000 7f409cf6d9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.421+0000 7f409cf6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:06.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.421+0000 7f409cf6d9c0 20 realm 2024-09-19T12:00:06.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.421+0000 7f409cf6d9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.421+0000 7f409cf6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:06.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.421+0000 7f409cf6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:06.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.421+0000 7f409cf6d9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.421+0000 7f409cf6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:06.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.421+0000 7f409cf6d9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.421+0000 7f409cf6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:06.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.421+0000 7f409cf6d9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.425+0000 7f409cf6d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:06.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.425+0000 7f409cf6d9c0 20 searching for the correct realm 2024-09-19T12:00:06.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.429+0000 7f409aa73640 0 -- 172.21.15.120:0/1560006416 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f4094023040 msgr2=0x7f4094014420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:00:06.641 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.645+0000 7f409aa73640 0 -- 172.21.15.120:0/1560006416 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f4094023040 msgr2=0x7f4094014420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:06.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.657+0000 7f409cf6d9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:06.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.657+0000 7f409cf6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:06.653 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.657+0000 7f409cf6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:06.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.657+0000 7f409cf6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:06.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.657+0000 7f409cf6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:06.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.657+0000 7f409cf6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:06.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.657+0000 7f409cf6d9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.657+0000 7f409cf6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:06.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.657+0000 7f409cf6d9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:06.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:06.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 20 zone default found 2024-09-19T12:00:06.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 4 Realm: () 2024-09-19T12:00:06.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:06.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:06.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:06.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 20 zonegroup default 2024-09-19T12:00:06.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:06.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:06.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:06.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 20 started sync module instance, tier type = 2024-09-19T12:00:06.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.661+0000 7f409cf6d9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:06.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.685+0000 7f409cf6d9c0 20 add_watcher() i=0 2024-09-19T12:00:06.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.685+0000 7f409cf6d9c0 20 add_watcher() i=1 2024-09-19T12:00:06.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.685+0000 7f409cf6d9c0 20 add_watcher() i=2 2024-09-19T12:00:06.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.685+0000 7f409cf6d9c0 20 add_watcher() i=3 2024-09-19T12:00:06.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.685+0000 7f409cf6d9c0 20 add_watcher() i=4 2024-09-19T12:00:06.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.685+0000 7f409cf6d9c0 20 add_watcher() i=5 2024-09-19T12:00:06.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.685+0000 7f409cf6d9c0 20 add_watcher() i=6 2024-09-19T12:00:06.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.689+0000 7f409cf6d9c0 20 add_watcher() i=7 2024-09-19T12:00:06.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.689+0000 7f409cf6d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:06.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.693+0000 7f3f517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:06.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.693+0000 7f409cf6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:06.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.693+0000 7f409cf6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:06.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.693+0000 7f409cf6d9c0 5 note: GC not initialized 2024-09-19T12:00:06.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.697+0000 7f3ecbfff640 20 reqs_thread_entry: start 2024-09-19T12:00:06.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.697+0000 7f409cf6d9c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:06.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.697+0000 7f409cf6d9c0 20 Filter name: none 2024-09-19T12:00:06.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.697+0000 7f3ec9ffb640 20 reqs_thread_entry: start 2024-09-19T12:00:06.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.697+0000 7f409cf6d9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.697+0000 7f409cf6d9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:06.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.697+0000 7f409cf6d9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.697+0000 7f409cf6d9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:00:06.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.697+0000 7f409cf6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:06.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.697+0000 7f409cf6d9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.701+0000 7f409cf6d9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:06.695 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.701+0000 7f409cf6d9c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.701+0000 7f409cf6d9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:00:06.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.701+0000 7f409cf6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:06.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.705+0000 7f3f517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:06.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.709+0000 7f409cf6d9c0 20 remove_watcher() i=0 2024-09-19T12:00:06.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.709+0000 7f409cf6d9c0 2 removed watcher, disabling cache 2024-09-19T12:00:06.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.713+0000 7f409cf6d9c0 20 remove_watcher() i=1 2024-09-19T12:00:06.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.713+0000 7f409cf6d9c0 20 remove_watcher() i=2 2024-09-19T12:00:06.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.717+0000 7f409cf6d9c0 20 remove_watcher() i=3 2024-09-19T12:00:06.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.717+0000 7f409cf6d9c0 20 remove_watcher() i=4 2024-09-19T12:00:06.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.721+0000 7f409cf6d9c0 20 remove_watcher() i=5 2024-09-19T12:00:06.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.725+0000 7f409cf6d9c0 20 remove_watcher() i=6 2024-09-19T12:00:06.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.725+0000 7f409cf6d9c0 20 remove_watcher() i=7 2024-09-19T12:00:06.740 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:06.741 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T12:00:06.741 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: a-bucket id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-19T12:00:06.741 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:06.741 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T12:00:06.771 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:00:06.771 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:00:06.814 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.817+0000 7ff1cd2869c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.821+0000 7ff1cd2869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:06.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.821+0000 7ff1cd2869c0 20 realm 2024-09-19T12:00:06.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.821+0000 7ff1cd2869c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.821+0000 7ff1cd2869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:06.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.821+0000 7ff1cd2869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:06.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.821+0000 7ff1cd2869c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.821+0000 7ff1cd2869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:06.817 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.821+0000 7ff1cd2869c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.821+0000 7ff1cd2869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:06.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.821+0000 7ff1cd2869c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:06.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.825+0000 7ff1cd2869c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:06.820 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.825+0000 7ff1cd2869c0 20 searching for the correct realm 2024-09-19T12:00:06.823 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:06.829+0000 7ff1cad8c640 0 -- 172.21.15.120:0/2434832628 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff1c40d6060 msgr2=0x7ff1c40fce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:07.041 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.045+0000 7ff1cad8c640 0 -- 172.21.15.120:0/2434832628 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff1c40d6060 msgr2=0x7ff1c40fce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:07.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.057+0000 7ff1cd2869c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:07.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.057+0000 7ff1cd2869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:07.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.057+0000 7ff1cd2869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:07.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.057+0000 7ff1cd2869c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:07.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.057+0000 7ff1cd2869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:07.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.057+0000 7ff1cd2869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:07.053 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.057+0000 7ff1cd2869c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.054 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.057+0000 7ff1cd2869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.054 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.057+0000 7ff1cd2869c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.054 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:07.054 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:07.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 20 zone default found 2024-09-19T12:00:07.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 4 Realm: () 2024-09-19T12:00:07.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:07.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:07.055 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:07.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 20 zonegroup default 2024-09-19T12:00:07.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.056 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.057 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.057 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 20 started sync module instance, tier type = 2024-09-19T12:00:07.058 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.061+0000 7ff1cd2869c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:07.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.089+0000 7ff1cd2869c0 20 add_watcher() i=0 2024-09-19T12:00:07.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.089+0000 7ff1cd2869c0 20 add_watcher() i=1 2024-09-19T12:00:07.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.089+0000 7ff1cd2869c0 20 add_watcher() i=2 2024-09-19T12:00:07.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.089+0000 7ff1cd2869c0 20 add_watcher() i=3 2024-09-19T12:00:07.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.089+0000 7ff1cd2869c0 20 add_watcher() i=4 2024-09-19T12:00:07.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.089+0000 7ff1cd2869c0 20 add_watcher() i=5 2024-09-19T12:00:07.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.089+0000 7ff1cd2869c0 20 add_watcher() i=6 2024-09-19T12:00:07.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.093+0000 7ff1cd2869c0 20 add_watcher() i=7 2024-09-19T12:00:07.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.093+0000 7ff1cd2869c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:07.092 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.097+0000 7ff0817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:07.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.097+0000 7ff1cd2869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:07.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.097+0000 7ff1cd2869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:07.093 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.097+0000 7ff1cd2869c0 5 note: GC not initialized 2024-09-19T12:00:07.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.097+0000 7feffbfff640 20 reqs_thread_entry: start 2024-09-19T12:00:07.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.097+0000 7ff1cd2869c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:07.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.097+0000 7ff1cd2869c0 20 Filter name: none 2024-09-19T12:00:07.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.097+0000 7feff9ffb640 20 reqs_thread_entry: start 2024-09-19T12:00:07.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.097+0000 7ff1cd2869c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.101+0000 7ff1cd2869c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:07.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.101+0000 7ff1cd2869c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.101+0000 7ff1cd2869c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:00:07.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.101+0000 7ff1cd2869c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:07.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.101+0000 7ff1cd2869c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.101+0000 7ff1cd2869c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:07.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.101+0000 7ff1cd2869c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.105+0000 7ff1cd2869c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:00:07.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.105+0000 7ff1cd2869c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:07.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.105+0000 7ff0817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:07.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.113+0000 7ff1cd2869c0 20 remove_watcher() i=0 2024-09-19T12:00:07.107 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.113+0000 7ff1cd2869c0 2 removed watcher, disabling cache 2024-09-19T12:00:07.109 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.113+0000 7ff1cd2869c0 20 remove_watcher() i=1 2024-09-19T12:00:07.112 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.117+0000 7ff1cd2869c0 20 remove_watcher() i=2 2024-09-19T12:00:07.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.117+0000 7ff1cd2869c0 20 remove_watcher() i=3 2024-09-19T12:00:07.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.121+0000 7ff1cd2869c0 20 remove_watcher() i=4 2024-09-19T12:00:07.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.121+0000 7ff1cd2869c0 20 remove_watcher() i=5 2024-09-19T12:00:07.119 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.125+0000 7ff1cd2869c0 20 remove_watcher() i=6 2024-09-19T12:00:07.121 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.125+0000 7ff1cd2869c0 20 remove_watcher() i=7 2024-09-19T12:00:07.137 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-19T12:00:07.174 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:00:07.174 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:00:07.219 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 realm 2024-09-19T12:00:07.221 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.225+0000 7f58f7f249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:07.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.222 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.223 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.229+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:07.223 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.229+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.225 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.229+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:07.225 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.229+0000 7f58f7f249c0 20 searching for the correct realm 2024-09-19T12:00:07.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.233+0000 7f58f622b640 0 -- 172.21.15.120:0/1752271843 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f58ec075040 msgr2=0x7f58ec05bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:00:07.445 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.449+0000 7f58f5229640 0 -- 172.21.15.120:0/1752271843 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f58e811b420 msgr2=0x7f58e8107df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:00:07.662 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:07.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:07.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:07.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:07.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:07.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:07.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.663 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.664 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:07.664 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.665 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:07.665 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 zone default found 2024-09-19T12:00:07.665 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.669+0000 7f58f7f249c0 4 Realm: () 2024-09-19T12:00:07.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.669+0000 7f58f7f249c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:07.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.669+0000 7f58f7f249c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:07.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.669+0000 7f58f7f249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:07.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 zonegroup default 2024-09-19T12:00:07.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.666 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.673+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.673+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.673+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.673+0000 7f58f7f249c0 20 started sync module instance, tier type = 2024-09-19T12:00:07.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.673+0000 7f58f7f249c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:07.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=0 2024-09-19T12:00:07.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=1 2024-09-19T12:00:07.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=2 2024-09-19T12:00:07.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=3 2024-09-19T12:00:07.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=4 2024-09-19T12:00:07.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=5 2024-09-19T12:00:07.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=6 2024-09-19T12:00:07.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.709+0000 7f58f7f249c0 20 add_watcher() i=7 2024-09-19T12:00:07.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.709+0000 7f58f7f249c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:07.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.713+0000 7f57a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:07.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:07.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:07.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 note: GC not initialized 2024-09-19T12:00:07.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.717+0000 7f57a67fc640 20 reqs_thread_entry: start 2024-09-19T12:00:07.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:07.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 Filter name: none 2024-09-19T12:00:07.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.717+0000 7f5717fff640 20 reqs_thread_entry: start 2024-09-19T12:00:07.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.717+0000 7f58f7f249c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:00:07.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:07.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.717+0000 7f58f7f249c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:00:07.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.717+0000 7f58f7f249c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:00:07.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.717+0000 7f58f7f249c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:00:07.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.721+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:00:07.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.721+0000 7f58f7f249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:07.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.721+0000 7f58f7f249c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:07.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.721+0000 7f58f7f249c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:00:07.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.721+0000 7f58f7f249c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:07.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.721+0000 7f58f7f249c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:00:07.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.729+0000 7f58f7f249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:07.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.729+0000 7f58f7f249c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:07.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.729+0000 7f58f7f249c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:07.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.729+0000 7f58f7f249c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T12:00:07.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.729+0000 7f57d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366215 cookie 93972516927632 notifier 8223 bl.length()=911 2024-09-19T12:00:07.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.729+0000 7f57d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:07.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.729+0000 7f57d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:07.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.729+0000 7f57d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:07.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.729+0000 7f58f7f249c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T12:00:07.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.729+0000 7f58f7f249c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T12:00:07.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.729+0000 7f58f7f249c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T12:00:07.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.729+0000 7f58f7f249c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T12:00:07.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.733+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.0 2024-09-19T12:00:07.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.733+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.0 2024-09-19T12:00:07.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.733+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.1 2024-09-19T12:00:07.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.733+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.1 2024-09-19T12:00:07.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.733+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.2 2024-09-19T12:00:07.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.733+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.2 2024-09-19T12:00:07.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.733+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.3 2024-09-19T12:00:07.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.733+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.3 2024-09-19T12:00:07.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.733+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:00:07.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.733+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:00:07.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.737+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:00:07.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.737+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:00:07.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.737+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:00:07.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.737+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:00:07.735 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58f7f249c0 time 2024-09-19T12:00:07.743394+0000 2024-09-19T12:00:07.735 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:00:07.737 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:07.737 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f58fb7fe2eb] 2024-09-19T12:00:07.737 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fb7fe49f] 2024-09-19T12:00:07.737 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577abc42271] 2024-09-19T12:00:07.737 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5577abc51441] 2024-09-19T12:00:07.737 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5577abc52a94] 2024-09-19T12:00:07.737 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T12:00:07.737 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fa664d90] 2024-09-19T12:00:07.737 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T12:00:07.737 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T12:00:07.737 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.741+0000 7f58f7f249c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58f7f249c0 time 2024-09-19T12:00:07.743394+0000 2024-09-19T12:00:07.737 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:00:07.738 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.738 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:07.738 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f58fb7fe2eb] 2024-09-19T12:00:07.738 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fb7fe49f] 2024-09-19T12:00:07.738 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577abc42271] 2024-09-19T12:00:07.738 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5577abc51441] 2024-09-19T12:00:07.738 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5577abc52a94] 2024-09-19T12:00:07.738 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T12:00:07.738 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fa664d90] 2024-09-19T12:00:07.738 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T12:00:07.738 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T12:00:07.738 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.738 INFO:tasks.workunit.client.0.smithi120.stderr:*** Caught signal (Aborted) ** 2024-09-19T12:00:07.738 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f58f7f249c0 thread_name:radosgw-admin 2024-09-19T12:00:07.752 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:07.752 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f58fa67d520] 2024-09-19T12:00:07.752 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:00:07.752 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:00:07.753 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:00:07.753 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f58fb7fe345] 2024-09-19T12:00:07.753 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fb7fe49f] 2024-09-19T12:00:07.753 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577abc42271] 2024-09-19T12:00:07.753 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5577abc51441] 2024-09-19T12:00:07.753 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5577abc52a94] 2024-09-19T12:00:07.753 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T12:00:07.753 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fa664d90] 2024-09-19T12:00:07.753 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T12:00:07.753 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T12:00:07.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.741+0000 7f58f7f249c0 -1 *** Caught signal (Aborted) ** 2024-09-19T12:00:07.753 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f58f7f249c0 thread_name:radosgw-admin 2024-09-19T12:00:07.753 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.754 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:07.754 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f58fa67d520] 2024-09-19T12:00:07.754 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:00:07.754 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:00:07.754 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:00:07.754 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f58fb7fe345] 2024-09-19T12:00:07.754 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fb7fe49f] 2024-09-19T12:00:07.754 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577abc42271] 2024-09-19T12:00:07.754 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5577abc51441] 2024-09-19T12:00:07.754 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5577abc52a94] 2024-09-19T12:00:07.754 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T12:00:07.754 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fa664d90] 2024-09-19T12:00:07.754 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T12:00:07.755 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T12:00:07.755 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T12:00:07.755 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.755 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T12:00:07.755 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 10 monclient: shutdown 2024-09-19T12:00:07.755 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) unregister_commands rotate-key 2024-09-19T12:00:07.755 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 10 monclient: build_initial_monmap 2024-09-19T12:00:07.755 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:07.755 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 10 monclient: monmap: 2024-09-19T12:00:07.755 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:07.755 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:07.755 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:07.756 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:07.756 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:07.756 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.756 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:07.756 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:07.756 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:07.756 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.756 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding auth protocol: cephx 2024-09-19T12:00:07.756 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding auth protocol: cephx 2024-09-19T12:00:07.756 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding auth protocol: cephx 2024-09-19T12:00:07.756 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: secure 2024-09-19T12:00:07.756 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: crc 2024-09-19T12:00:07.756 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: secure 2024-09-19T12:00:07.757 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: crc 2024-09-19T12:00:07.757 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: secure 2024-09-19T12:00:07.757 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: crc 2024-09-19T12:00:07.757 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: crc 2024-09-19T12:00:07.757 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: secure 2024-09-19T12:00:07.757 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: crc 2024-09-19T12:00:07.757 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: secure 2024-09-19T12:00:07.757 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: crc 2024-09-19T12:00:07.757 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: secure 2024-09-19T12:00:07.757 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.757 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 1 librados: starting msgr at 2024-09-19T12:00:07.757 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 1 librados: starting objecter 2024-09-19T12:00:07.757 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command objecter_requests hook 0x5577ae6d9d70 2024-09-19T12:00:07.758 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 1 librados: setting wanted keys 2024-09-19T12:00:07.758 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 1 librados: calling monclient init 2024-09-19T12:00:07.758 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 10 monclient: init 2024-09-19T12:00:07.758 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding auth protocol: cephx 2024-09-19T12:00:07.758 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding auth protocol: cephx 2024-09-19T12:00:07.758 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding auth protocol: cephx 2024-09-19T12:00:07.758 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: secure 2024-09-19T12:00:07.758 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: crc 2024-09-19T12:00:07.758 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: secure 2024-09-19T12:00:07.758 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: crc 2024-09-19T12:00:07.758 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: secure 2024-09-19T12:00:07.758 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: crc 2024-09-19T12:00:07.758 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: crc 2024-09-19T12:00:07.758 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: secure 2024-09-19T12:00:07.758 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: crc 2024-09-19T12:00:07.759 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: secure 2024-09-19T12:00:07.759 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: crc 2024-09-19T12:00:07.759 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: secure 2024-09-19T12:00:07.759 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.759 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.759 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command rotate-key hook 0x5577ae6d7228 2024-09-19T12:00:07.759 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:07.759 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T12:00:07.759 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-b con 0x5577ae5906b0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:07.759 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-a con 0x5577ae6231c0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:07.759 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-c con 0x5577ae6ddac0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:07.759 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.759 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.760 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.760 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:07.760 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): authenticate will time out at 2501.520540s 2024-09-19T12:00:07.760 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): get_auth_request con 0x5577ae6231c0 auth_method 0 2024-09-19T12:00:07.760 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.760 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.760 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.760 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient(hunting): get_auth_request con 0x5577ae6ddac0 auth_method 0 2024-09-19T12:00:07.760 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.760 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.760 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.760 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.760 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.761 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.761 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.761 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.761 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.761 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): handle_auth_done global_id 8214 payload 824 2024-09-19T12:00:07.761 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient: _finish_hunting 0 2024-09-19T12:00:07.761 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T12:00:07.205+0000 7f58f5229640 1 monclient: found mon.noname-a 2024-09-19T12:00:07.761 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:00:07.761 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T12:00:07.205+0000 7f58f5a2a640 10 monclient: get_auth_request con 0x5577ae5906b0 auth_method 0 2024-09-19T12:00:07.761 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.761 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:00:07.762 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: dump: 2024-09-19T12:00:07.762 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.762 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.762 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.762 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.762 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.762 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.762 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.762 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.762 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.762 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.762 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: _finish_auth 0 2024-09-19T12:00:07.762 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: _check_auth_tickets 2024-09-19T12:00:07.762 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:07.763 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.763 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:00:07.763 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: dump: 2024-09-19T12:00:07.763 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.763 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.763 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.763 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.763 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.763 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.763 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.763 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.763 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.763 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.764 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 5 monclient: authenticate success, global_id 8214 2024-09-19T12:00:07.764 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T12:00:07.205+0000 7f57e3e07640 4 set_mon_vals no callback set 2024-09-19T12:00:07.764 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient: _renew_subs 2024-09-19T12:00:07.764 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:00:07.764 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient: _renew_subs 2024-09-19T12:00:07.764 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:00:07.764 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 1 librados: init done 2024-09-19T12:00:07.764 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T12:00:07.205+0000 7f57e2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:00:07.764 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T12:00:07.205+0000 7f57e2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:07.764 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T12:00:07.205+0000 7f57e2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:07.764 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T12:00:07.205+0000 7f58f5a2a640 10 monclient: get_auth_request con 0x7f57dc071c10 auth_method 0 2024-09-19T12:00:07.764 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient: get_auth_request con 0x5577ae6ffb80 auth_method 0 2024-09-19T12:00:07.764 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T12:00:07.209+0000 7f58f5a2a640 10 monclient: get_auth_request con 0x5577ae722730 auth_method 0 2024-09-19T12:00:07.764 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T12:00:07.209+0000 7f58f5229640 10 monclient: get_auth_request con 0x5577ae726920 auth_method 0 2024-09-19T12:00:07.765 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient: get_auth_request con 0x5577ae725fe0 auth_method 0 2024-09-19T12:00:07.765 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient: build_initial_monmap 2024-09-19T12:00:07.765 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:07.765 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient: monmap: 2024-09-19T12:00:07.765 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:07.765 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:07.765 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:07.765 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:07.765 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:07.765 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.765 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:07.765 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:07.765 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:07.765 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.765 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding auth protocol: cephx 2024-09-19T12:00:07.766 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding auth protocol: cephx 2024-09-19T12:00:07.766 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding auth protocol: cephx 2024-09-19T12:00:07.766 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: secure 2024-09-19T12:00:07.766 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: crc 2024-09-19T12:00:07.766 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: secure 2024-09-19T12:00:07.766 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: crc 2024-09-19T12:00:07.766 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: secure 2024-09-19T12:00:07.766 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: crc 2024-09-19T12:00:07.766 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: crc 2024-09-19T12:00:07.766 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: secure 2024-09-19T12:00:07.766 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: crc 2024-09-19T12:00:07.766 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: secure 2024-09-19T12:00:07.766 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: crc 2024-09-19T12:00:07.766 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: secure 2024-09-19T12:00:07.767 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.767 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command objecter_requests cmddesc objecter_requests hook 0x5577ae732310 EEXIST 2024-09-19T12:00:07.767 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient: init 2024-09-19T12:00:07.767 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding auth protocol: cephx 2024-09-19T12:00:07.767 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding auth protocol: cephx 2024-09-19T12:00:07.767 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding auth protocol: cephx 2024-09-19T12:00:07.767 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: secure 2024-09-19T12:00:07.767 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: crc 2024-09-19T12:00:07.767 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: secure 2024-09-19T12:00:07.767 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: crc 2024-09-19T12:00:07.767 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: secure 2024-09-19T12:00:07.767 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: crc 2024-09-19T12:00:07.767 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: crc 2024-09-19T12:00:07.768 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: secure 2024-09-19T12:00:07.768 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: crc 2024-09-19T12:00:07.768 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: secure 2024-09-19T12:00:07.768 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: crc 2024-09-19T12:00:07.768 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: secure 2024-09-19T12:00:07.768 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.768 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.768 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command rotate-key cmddesc rotate-key hook 0x5577ae72d9e0 EEXIST 2024-09-19T12:00:07.768 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:07.768 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T12:00:07.768 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-b con 0x5577ae7564c0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:07.768 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-a con 0x5577ae755df0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:07.768 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-c con 0x5577ae7547d0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:07.768 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.769 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.769 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.769 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:07.769 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): authenticate will time out at 2501.531271s 2024-09-19T12:00:07.769 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): get_auth_request con 0x5577ae7547d0 auth_method 0 2024-09-19T12:00:07.769 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.769 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.769 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.769 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient(hunting): get_auth_request con 0x5577ae755df0 auth_method 0 2024-09-19T12:00:07.769 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.769 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.769 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.769 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.769 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.770 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.770 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.770 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.770 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.770 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T12:00:07.213+0000 7f58f5229640 10 monclient(hunting): get_auth_request con 0x5577ae7564c0 auth_method 0 2024-09-19T12:00:07.770 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T12:00:07.213+0000 7f58f5229640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.770 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T12:00:07.213+0000 7f58f5229640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.770 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T12:00:07.213+0000 7f58f5229640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.770 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_done global_id 7628 payload 824 2024-09-19T12:00:07.770 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient: _finish_hunting 0 2024-09-19T12:00:07.770 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 1 monclient: found mon.noname-c 2024-09-19T12:00:07.770 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:00:07.770 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.770 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:00:07.770 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: dump: 2024-09-19T12:00:07.771 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.771 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.771 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.771 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.771 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.771 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.771 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.771 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.771 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.771 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.771 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: _finish_auth 0 2024-09-19T12:00:07.771 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: _check_auth_tickets 2024-09-19T12:00:07.771 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:07.772 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.772 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:00:07.772 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: dump: 2024-09-19T12:00:07.772 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.772 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.772 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.772 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.772 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.772 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.772 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.772 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.772 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.772 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.773 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 monclient: authenticate success, global_id 7628 2024-09-19T12:00:07.773 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: _renew_subs 2024-09-19T12:00:07.773 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T12:00:07.217+0000 7f58f6a2c640 4 set_mon_vals no callback set 2024-09-19T12:00:07.773 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:00:07.773 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: _renew_subs 2024-09-19T12:00:07.773 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:00:07.773 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T12:00:07.217+0000 7f57db7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:00:07.774 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T12:00:07.217+0000 7f57db7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:07.774 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T12:00:07.217+0000 7f57db7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:07.774 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: get_monmap_and_config 2024-09-19T12:00:07.774 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: build_initial_monmap 2024-09-19T12:00:07.774 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:07.774 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: monmap: 2024-09-19T12:00:07.774 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:07.774 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:07.774 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:07.774 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:07.774 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:07.774 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.774 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:07.775 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:07.775 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:07.775 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.775 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding auth protocol: cephx 2024-09-19T12:00:07.775 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding auth protocol: cephx 2024-09-19T12:00:07.775 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding auth protocol: cephx 2024-09-19T12:00:07.775 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: secure 2024-09-19T12:00:07.775 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: crc 2024-09-19T12:00:07.775 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: secure 2024-09-19T12:00:07.775 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: crc 2024-09-19T12:00:07.775 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: secure 2024-09-19T12:00:07.775 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: crc 2024-09-19T12:00:07.775 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T12:00:07.217+0000 7f58f5229640 10 monclient: get_auth_request con 0x7f57d0071b20 auth_method 0 2024-09-19T12:00:07.775 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: crc 2024-09-19T12:00:07.776 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: secure 2024-09-19T12:00:07.776 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: crc 2024-09-19T12:00:07.776 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: secure 2024-09-19T12:00:07.776 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: crc 2024-09-19T12:00:07.776 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: secure 2024-09-19T12:00:07.776 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.776 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: init 2024-09-19T12:00:07.776 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding auth protocol: cephx 2024-09-19T12:00:07.776 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding auth protocol: cephx 2024-09-19T12:00:07.776 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding auth protocol: cephx 2024-09-19T12:00:07.776 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: secure 2024-09-19T12:00:07.776 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: crc 2024-09-19T12:00:07.777 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: secure 2024-09-19T12:00:07.777 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: crc 2024-09-19T12:00:07.777 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: secure 2024-09-19T12:00:07.777 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: crc 2024-09-19T12:00:07.777 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: crc 2024-09-19T12:00:07.777 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: secure 2024-09-19T12:00:07.777 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: crc 2024-09-19T12:00:07.777 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: secure 2024-09-19T12:00:07.777 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: crc 2024-09-19T12:00:07.777 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: secure 2024-09-19T12:00:07.777 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.777 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.777 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command rotate-key cmddesc rotate-key hook 0x7ffc11a124c8 EEXIST 2024-09-19T12:00:07.778 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:07.778 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T12:00:07.778 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-a con 0x5577ae779f10 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:07.778 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-c con 0x5577ae7aa130 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:07.778 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-b con 0x5577ae7a5e20 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:07.778 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.778 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.778 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.778 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:07.778 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): authenticate will time out at 2501.535806s 2024-09-19T12:00:07.778 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T12:00:07.217+0000 7f58f5229640 10 monclient(hunting): get_auth_request con 0x5577ae779f10 auth_method 0 2024-09-19T12:00:07.778 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T12:00:07.217+0000 7f58f5229640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.778 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T12:00:07.217+0000 7f58f5229640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.778 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T12:00:07.217+0000 7f58f5229640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.779 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T12:00:07.217+0000 7f58f622b640 10 monclient(hunting): get_auth_request con 0x5577ae7aa130 auth_method 0 2024-09-19T12:00:07.779 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T12:00:07.217+0000 7f58f622b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.779 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T12:00:07.217+0000 7f58f622b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.779 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T12:00:07.217+0000 7f58f622b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.779 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.779 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.779 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.779 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.779 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.779 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.779 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): get_auth_request con 0x5577ae7a5e20 auth_method 0 2024-09-19T12:00:07.779 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.779 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.779 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.780 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): handle_auth_done global_id 7631 payload 274 2024-09-19T12:00:07.780 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient: _finish_hunting 0 2024-09-19T12:00:07.780 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T12:00:07.221+0000 7f58f622b640 1 monclient: found mon.noname-c 2024-09-19T12:00:07.780 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:00:07.780 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.780 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:00:07.780 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: dump: 2024-09-19T12:00:07.780 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.780 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.780 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.780 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.780 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.780 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.780 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.781 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.781 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.781 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.781 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: _finish_auth 0 2024-09-19T12:00:07.781 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: _check_auth_tickets 2024-09-19T12:00:07.781 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:07.781 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 monclient: authenticate success, global_id 7631 2024-09-19T12:00:07.781 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: get_monmap_and_config success 2024-09-19T12:00:07.781 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 4 set_mon_vals no callback set 2024-09-19T12:00:07.781 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.781 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:00:07.781 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: dump: 2024-09-19T12:00:07.781 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.782 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.782 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.782 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.782 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.782 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.782 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.782 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.782 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.782 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.782 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: shutdown 2024-09-19T12:00:07.782 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: build_initial_monmap 2024-09-19T12:00:07.782 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:07.782 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: monmap: 2024-09-19T12:00:07.783 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:07.783 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:07.783 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:07.783 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:07.783 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:07.783 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.783 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:07.783 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:07.783 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:07.783 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.783 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding auth protocol: cephx 2024-09-19T12:00:07.783 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding auth protocol: cephx 2024-09-19T12:00:07.783 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding auth protocol: cephx 2024-09-19T12:00:07.783 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: secure 2024-09-19T12:00:07.783 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: crc 2024-09-19T12:00:07.784 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: secure 2024-09-19T12:00:07.784 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: crc 2024-09-19T12:00:07.784 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: secure 2024-09-19T12:00:07.784 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: crc 2024-09-19T12:00:07.784 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: crc 2024-09-19T12:00:07.784 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: secure 2024-09-19T12:00:07.784 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: crc 2024-09-19T12:00:07.784 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: secure 2024-09-19T12:00:07.784 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: crc 2024-09-19T12:00:07.784 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: secure 2024-09-19T12:00:07.784 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.784 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 1 librados: starting msgr at 2024-09-19T12:00:07.784 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 1 librados: starting objecter 2024-09-19T12:00:07.784 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command objecter_requests cmddesc objecter_requests hook 0x5577ae758130 EEXIST 2024-09-19T12:00:07.785 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 1 librados: setting wanted keys 2024-09-19T12:00:07.785 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 1 librados: calling monclient init 2024-09-19T12:00:07.785 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: init 2024-09-19T12:00:07.785 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding auth protocol: cephx 2024-09-19T12:00:07.785 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding auth protocol: cephx 2024-09-19T12:00:07.785 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding auth protocol: cephx 2024-09-19T12:00:07.785 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: secure 2024-09-19T12:00:07.785 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: crc 2024-09-19T12:00:07.785 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: secure 2024-09-19T12:00:07.785 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: crc 2024-09-19T12:00:07.785 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: secure 2024-09-19T12:00:07.785 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: crc 2024-09-19T12:00:07.785 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: crc 2024-09-19T12:00:07.786 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: secure 2024-09-19T12:00:07.786 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: crc 2024-09-19T12:00:07.786 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: secure 2024-09-19T12:00:07.786 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: crc 2024-09-19T12:00:07.786 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: secure 2024-09-19T12:00:07.786 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.786 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.786 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command rotate-key cmddesc rotate-key hook 0x5577ae758428 EEXIST 2024-09-19T12:00:07.786 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:07.786 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T12:00:07.786 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-c con 0x5577ae779f10 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:07.786 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-b con 0x5577ae7a5e20 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:07.786 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-a con 0x5577ae7aa130 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:07.786 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.787 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.787 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.787 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:07.787 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): authenticate will time out at 2501.538540s 2024-09-19T12:00:07.787 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): get_auth_request con 0x5577ae779f10 auth_method 0 2024-09-19T12:00:07.787 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.787 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.787 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.787 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): get_auth_request con 0x5577ae7aa130 auth_method 0 2024-09-19T12:00:07.787 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.787 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.787 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.787 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.787 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.788 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.788 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.788 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.788 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.788 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): get_auth_request con 0x5577ae7a5e20 auth_method 0 2024-09-19T12:00:07.788 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.788 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.788 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.788 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_done global_id 8223 payload 824 2024-09-19T12:00:07.788 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient: _finish_hunting 0 2024-09-19T12:00:07.788 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 1 monclient: found mon.noname-a 2024-09-19T12:00:07.788 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:00:07.788 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.788 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:00:07.789 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: dump: 2024-09-19T12:00:07.789 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.789 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.789 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.789 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.789 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.789 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.789 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.789 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.789 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.789 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.789 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: _finish_auth 0 2024-09-19T12:00:07.790 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: _check_auth_tickets 2024-09-19T12:00:07.790 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:07.790 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.790 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:00:07.790 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: dump: 2024-09-19T12:00:07.790 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.790 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.790 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.790 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.790 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.790 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.790 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.791 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.791 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.791 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.791 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 monclient: authenticate success, global_id 8223 2024-09-19T12:00:07.791 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: _renew_subs 2024-09-19T12:00:07.791 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T12:00:07.221+0000 7f57d97fa640 4 set_mon_vals no callback set 2024-09-19T12:00:07.791 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:00:07.791 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: _renew_subs 2024-09-19T12:00:07.791 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:00:07.791 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 1 librados: init done 2024-09-19T12:00:07.791 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command cr dump hook 0x5577ae79fd18 2024-09-19T12:00:07.791 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.791 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T12:00:07.225+0000 7f57c77fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:00:07.792 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T12:00:07.225+0000 7f57c77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:07.792 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T12:00:07.225+0000 7f57c77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:07.792 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T12:00:07.225+0000 7f58f5229640 10 monclient: get_auth_request con 0x7f57c0071be0 auth_method 0 2024-09-19T12:00:07.792 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T12:00:07.225+0000 7f58f622b640 10 monclient: get_auth_request con 0x5577ae7c3ef0 auth_method 0 2024-09-19T12:00:07.792 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.792 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 realm 2024-09-19T12:00:07.792 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.792 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.792 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:07.792 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.792 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.792 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.792 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T12:00:07.225+0000 7f58f5229640 10 monclient: get_auth_request con 0x5577ae7c8160 auth_method 0 2024-09-19T12:00:07.792 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T12:00:07.229+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:07.793 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T12:00:07.229+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.793 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T12:00:07.229+0000 7f58f622b640 10 monclient: get_auth_request con 0x5577ae7cb9c0 auth_method 0 2024-09-19T12:00:07.793 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T12:00:07.229+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:07.793 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T12:00:07.229+0000 7f58f7f249c0 20 searching for the correct realm 2024-09-19T12:00:07.793 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T12:00:07.229+0000 7f58f5a2a640 10 monclient: get_auth_request con 0x5577ae7d0710 auth_method 0 2024-09-19T12:00:07.793 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T12:00:07.229+0000 7f58f5229640 10 monclient: get_auth_request con 0x5577ae565500 auth_method 0 2024-09-19T12:00:07.793 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T12:00:07.233+0000 7f58f622b640 10 monclient: get_auth_request con 0x7f58ec075040 auth_method 0 2024-09-19T12:00:07.793 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T12:00:07.233+0000 7f58f622b640 0 -- 172.21.15.120:0/1752271843 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f58ec075040 msgr2=0x7f58ec05bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:00:07.793 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T12:00:07.437+0000 7f58f622b640 10 monclient: get_auth_request con 0x7f58ec075040 auth_method 0 2024-09-19T12:00:07.793 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T12:00:07.437+0000 7f58f5a2a640 10 monclient: get_auth_request con 0x7f58f0044040 auth_method 0 2024-09-19T12:00:07.793 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T12:00:07.449+0000 7f58f5229640 0 -- 172.21.15.120:0/1752271843 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f58e811b420 msgr2=0x7f58e8107df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:00:07.793 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T12:00:07.653+0000 7f58f5229640 10 monclient: get_auth_request con 0x7f58e811b420 auth_method 0 2024-09-19T12:00:07.793 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:07.794 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:07.794 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:07.794 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:07.794 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:07.794 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:07.794 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.794 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.794 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.794 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:07.794 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.794 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:07.794 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 zone default found 2024-09-19T12:00:07.794 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 4 Realm: () 2024-09-19T12:00:07.795 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:07.795 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:07.795 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:07.795 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 zonegroup default 2024-09-19T12:00:07.795 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.795 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.795 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.795 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T12:00:07.673+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.795 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T12:00:07.673+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.795 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T12:00:07.673+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.795 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T12:00:07.673+0000 7f58f7f249c0 20 started sync module instance, tier type = 2024-09-19T12:00:07.795 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T12:00:07.673+0000 7f58f7f249c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:07.795 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=0 2024-09-19T12:00:07.795 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=1 2024-09-19T12:00:07.796 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=2 2024-09-19T12:00:07.796 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=3 2024-09-19T12:00:07.796 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=4 2024-09-19T12:00:07.796 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=5 2024-09-19T12:00:07.796 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=6 2024-09-19T12:00:07.796 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T12:00:07.709+0000 7f58f7f249c0 20 add_watcher() i=7 2024-09-19T12:00:07.796 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T12:00:07.709+0000 7f58f7f249c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:07.796 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding auth protocol: cephx 2024-09-19T12:00:07.796 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding auth protocol: cephx 2024-09-19T12:00:07.796 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding auth protocol: cephx 2024-09-19T12:00:07.796 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: secure 2024-09-19T12:00:07.796 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: crc 2024-09-19T12:00:07.796 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: secure 2024-09-19T12:00:07.796 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: crc 2024-09-19T12:00:07.797 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: secure 2024-09-19T12:00:07.797 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T12:00:07.713+0000 7f57a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:07.797 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: crc 2024-09-19T12:00:07.797 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: crc 2024-09-19T12:00:07.797 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: secure 2024-09-19T12:00:07.797 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: crc 2024-09-19T12:00:07.797 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: secure 2024-09-19T12:00:07.797 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: crc 2024-09-19T12:00:07.797 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: secure 2024-09-19T12:00:07.797 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.797 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:07.797 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:07.797 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command cache list hook 0x5577ae79f0c0 2024-09-19T12:00:07.798 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command cache inspect hook 0x5577ae79f0c0 2024-09-19T12:00:07.798 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command cache erase hook 0x5577ae79f0c0 2024-09-19T12:00:07.798 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command cache zap hook 0x5577ae79f0c0 2024-09-19T12:00:07.798 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 note: GC not initialized 2024-09-19T12:00:07.798 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T12:00:07.717+0000 7f57a67fc640 20 reqs_thread_entry: start 2024-09-19T12:00:07.798 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command sync trace show hook 0x7f58f000d9d0 2024-09-19T12:00:07.798 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command sync trace history hook 0x7f58f000d9d0 2024-09-19T12:00:07.798 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command sync trace active hook 0x7f58f000d9d0 2024-09-19T12:00:07.798 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command sync trace active_short hook 0x7f58f000d9d0 2024-09-19T12:00:07.798 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:07.798 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 Filter name: none 2024-09-19T12:00:07.798 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T12:00:07.717+0000 7f5717fff640 20 reqs_thread_entry: start 2024-09-19T12:00:07.798 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:00:07.799 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.799 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:07.799 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:00:07.799 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:00:07.799 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:00:07.799 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.799 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T12:00:07.721+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:00:07.799 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T12:00:07.721+0000 7f58f7f249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:07.799 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T12:00:07.721+0000 7f58f7f249c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:07.799 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T12:00:07.721+0000 7f58f7f249c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:00:07.799 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T12:00:07.721+0000 7f58f7f249c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:07.799 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T12:00:07.721+0000 7f58f7f249c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:00:07.799 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:07.799 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:07.800 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:07.800 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T12:00:07.800 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T12:00:07.729+0000 7f57d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366215 cookie 93972516927632 notifier 8223 bl.length()=911 2024-09-19T12:00:07.800 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T12:00:07.729+0000 7f57d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:07.800 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T12:00:07.729+0000 7f57d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:07.800 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T12:00:07.729+0000 7f57d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:07.800 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T12:00:07.800 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T12:00:07.800 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T12:00:07.800 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T12:00:07.800 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.0 2024-09-19T12:00:07.800 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.0 2024-09-19T12:00:07.800 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.1 2024-09-19T12:00:07.801 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.1 2024-09-19T12:00:07.801 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.2 2024-09-19T12:00:07.801 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.2 2024-09-19T12:00:07.801 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.3 2024-09-19T12:00:07.801 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.3 2024-09-19T12:00:07.801 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:00:07.801 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:00:07.801 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T12:00:07.737+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:00:07.801 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T12:00:07.737+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:00:07.801 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T12:00:07.737+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:00:07.801 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T12:00:07.737+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:00:07.801 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T12:00:07.741+0000 7f58f7f249c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58f7f249c0 time 2024-09-19T12:00:07.743394+0000 2024-09-19T12:00:07.801 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:00:07.801 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.801 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:07.802 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f58fb7fe2eb] 2024-09-19T12:00:07.802 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fb7fe49f] 2024-09-19T12:00:07.802 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577abc42271] 2024-09-19T12:00:07.802 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5577abc51441] 2024-09-19T12:00:07.802 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5577abc52a94] 2024-09-19T12:00:07.802 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T12:00:07.802 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fa664d90] 2024-09-19T12:00:07.802 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T12:00:07.802 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T12:00:07.802 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.802 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T12:00:07.741+0000 7f58f7f249c0 -1 *** Caught signal (Aborted) ** 2024-09-19T12:00:07.802 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f58f7f249c0 thread_name:radosgw-admin 2024-09-19T12:00:07.802 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.802 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:07.803 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f58fa67d520] 2024-09-19T12:00:07.803 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:00:07.803 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:00:07.803 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:00:07.803 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f58fb7fe345] 2024-09-19T12:00:07.803 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fb7fe49f] 2024-09-19T12:00:07.803 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577abc42271] 2024-09-19T12:00:07.803 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5577abc51441] 2024-09-19T12:00:07.803 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5577abc52a94] 2024-09-19T12:00:07.803 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T12:00:07.803 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fa664d90] 2024-09-19T12:00:07.803 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T12:00:07.803 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T12:00:07.803 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T12:00:07.804 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.804 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T12:00:07.804 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T12:00:07.804 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T12:00:07.804 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T12:00:07.804 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T12:00:07.804 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T12:00:07.804 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T12:00:07.804 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T12:00:07.804 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T12:00:07.804 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T12:00:07.804 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T12:00:07.804 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T12:00:07.804 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T12:00:07.805 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T12:00:07.805 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T12:00:07.805 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T12:00:07.805 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T12:00:07.805 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T12:00:07.805 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T12:00:07.805 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T12:00:07.805 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T12:00:07.805 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T12:00:07.805 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T12:00:07.805 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T12:00:07.805 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T12:00:07.805 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T12:00:07.805 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T12:00:07.805 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T12:00:07.806 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T12:00:07.806 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T12:00:07.806 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T12:00:07.806 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T12:00:07.806 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T12:00:07.806 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T12:00:07.806 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T12:00:07.806 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T12:00:07.806 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T12:00:07.806 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T12:00:07.806 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T12:00:07.806 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T12:00:07.806 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T12:00:07.806 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T12:00:07.807 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T12:00:07.807 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T12:00:07.807 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T12:00:07.807 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T12:00:07.807 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T12:00:07.807 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T12:00:07.807 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T12:00:07.807 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T12:00:07.807 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T12:00:07.807 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T12:00:07.807 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T12:00:07.807 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T12:00:07.807 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T12:00:07.808 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T12:00:07.808 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T12:00:07.808 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T12:00:07.808 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T12:00:07.808 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T12:00:07.808 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T12:00:07.808 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T12:00:07.808 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T12:00:07.808 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T12:00:07.808 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T12:00:07.808 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T12:00:07.808 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T12:00:07.808 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T12:00:07.808 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T12:00:07.809 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T12:00:07.809 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T12:00:07.809 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T12:00:07.809 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T12:00:07.809 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T12:00:07.809 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T12:00:07.809 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T12:00:07.809 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T12:00:07.809 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T12:00:07.809 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T12:00:07.809 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T12:00:07.809 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T12:00:07.809 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T12:00:07.809 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T12:00:07.810 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T12:00:07.810 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T12:00:07.810 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T12:00:07.810 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T12:00:07.810 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T12:00:07.810 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T12:00:07.810 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T12:00:07.810 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T12:00:07.810 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T12:00:07.810 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T12:00:07.810 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T12:00:07.810 INFO:tasks.workunit.client.0.smithi120.stderr: 7f5717fff640 / http_manager 2024-09-19T12:00:07.810 INFO:tasks.workunit.client.0.smithi120.stderr: 7f57a67fc640 / http_manager 2024-09-19T12:00:07.810 INFO:tasks.workunit.client.0.smithi120.stderr: 7f57a77fe640 / rgw_dt_lg_renew 2024-09-19T12:00:07.811 INFO:tasks.workunit.client.0.smithi120.stderr: 7f57c77fe640 / ms_dispatch 2024-09-19T12:00:07.811 INFO:tasks.workunit.client.0.smithi120.stderr: 7f57d97fa640 / io_context_pool 2024-09-19T12:00:07.811 INFO:tasks.workunit.client.0.smithi120.stderr: 7f57db7fe640 / ms_dispatch 2024-09-19T12:00:07.811 INFO:tasks.workunit.client.0.smithi120.stderr: 7f57e2604640 / ms_dispatch 2024-09-19T12:00:07.811 INFO:tasks.workunit.client.0.smithi120.stderr: 7f57e3e07640 / io_context_pool 2024-09-19T12:00:07.811 INFO:tasks.workunit.client.0.smithi120.stderr: 7f58f5229640 / msgr-worker-2 2024-09-19T12:00:07.811 INFO:tasks.workunit.client.0.smithi120.stderr: 7f58f5a2a640 / msgr-worker-1 2024-09-19T12:00:07.811 INFO:tasks.workunit.client.0.smithi120.stderr: 7f58f622b640 / msgr-worker-0 2024-09-19T12:00:07.811 INFO:tasks.workunit.client.0.smithi120.stderr: 7f58f6a2c640 / io_context_pool 2024-09-19T12:00:07.811 INFO:tasks.workunit.client.0.smithi120.stderr: 7f58f7f249c0 / radosgw-admin 2024-09-19T12:00:07.811 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T12:00:07.811 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T12:00:07.811 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/log/ceph/ceph-client.admin.139363.log 2024-09-19T12:00:07.811 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T12:00:07.812 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T12:00:07.812 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 10 monclient: shutdown 2024-09-19T12:00:07.812 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) unregister_commands rotate-key 2024-09-19T12:00:07.812 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 10 monclient: build_initial_monmap 2024-09-19T12:00:07.812 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:07.812 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 10 monclient: monmap: 2024-09-19T12:00:07.812 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:07.812 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:07.812 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:07.812 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:07.812 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:07.812 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.812 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:07.812 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:07.813 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:07.813 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.813 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding auth protocol: cephx 2024-09-19T12:00:07.813 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding auth protocol: cephx 2024-09-19T12:00:07.813 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding auth protocol: cephx 2024-09-19T12:00:07.813 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: secure 2024-09-19T12:00:07.813 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: crc 2024-09-19T12:00:07.813 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: secure 2024-09-19T12:00:07.813 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: crc 2024-09-19T12:00:07.813 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: secure 2024-09-19T12:00:07.813 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: crc 2024-09-19T12:00:07.813 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: crc 2024-09-19T12:00:07.813 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: secure 2024-09-19T12:00:07.814 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: crc 2024-09-19T12:00:07.814 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: secure 2024-09-19T12:00:07.814 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: crc 2024-09-19T12:00:07.814 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6dd170) adding con mode: secure 2024-09-19T12:00:07.814 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.814 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 1 librados: starting msgr at 2024-09-19T12:00:07.814 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 1 librados: starting objecter 2024-09-19T12:00:07.814 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command objecter_requests hook 0x5577ae6d9d70 2024-09-19T12:00:07.814 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 1 librados: setting wanted keys 2024-09-19T12:00:07.814 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 1 librados: calling monclient init 2024-09-19T12:00:07.814 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 10 monclient: init 2024-09-19T12:00:07.814 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding auth protocol: cephx 2024-09-19T12:00:07.814 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding auth protocol: cephx 2024-09-19T12:00:07.814 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding auth protocol: cephx 2024-09-19T12:00:07.815 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: secure 2024-09-19T12:00:07.815 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: crc 2024-09-19T12:00:07.815 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: secure 2024-09-19T12:00:07.815 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: crc 2024-09-19T12:00:07.815 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: secure 2024-09-19T12:00:07.815 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: crc 2024-09-19T12:00:07.815 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: crc 2024-09-19T12:00:07.815 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: secure 2024-09-19T12:00:07.815 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: crc 2024-09-19T12:00:07.815 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: secure 2024-09-19T12:00:07.815 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: crc 2024-09-19T12:00:07.815 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T12:00:07.201+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae6d70e0) adding con mode: secure 2024-09-19T12:00:07.815 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.815 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.815 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command rotate-key hook 0x5577ae6d7228 2024-09-19T12:00:07.816 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:07.816 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T12:00:07.816 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-b con 0x5577ae5906b0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:07.816 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-a con 0x5577ae6231c0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:07.816 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-c con 0x5577ae6ddac0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:07.816 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.816 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.816 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.816 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:07.816 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient(hunting): authenticate will time out at 2501.520540s 2024-09-19T12:00:07.816 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): get_auth_request con 0x5577ae6231c0 auth_method 0 2024-09-19T12:00:07.816 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.816 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.816 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.817 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient(hunting): get_auth_request con 0x5577ae6ddac0 auth_method 0 2024-09-19T12:00:07.817 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.817 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.817 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.817 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.817 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.817 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.817 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.817 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.817 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.817 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient(hunting): handle_auth_done global_id 8214 payload 824 2024-09-19T12:00:07.817 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient: _finish_hunting 0 2024-09-19T12:00:07.817 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T12:00:07.205+0000 7f58f5229640 1 monclient: found mon.noname-a 2024-09-19T12:00:07.817 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T12:00:07.205+0000 7f58f5229640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:00:07.818 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T12:00:07.205+0000 7f58f5a2a640 10 monclient: get_auth_request con 0x5577ae5906b0 auth_method 0 2024-09-19T12:00:07.818 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.818 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:00:07.818 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: dump: 2024-09-19T12:00:07.818 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.818 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.818 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.818 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.818 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.818 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.818 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.818 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.818 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.819 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.819 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: _finish_auth 0 2024-09-19T12:00:07.819 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: _check_auth_tickets 2024-09-19T12:00:07.819 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:07.819 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.819 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:00:07.819 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T12:00:07.205+0000 7f57e2604640 10 monclient: dump: 2024-09-19T12:00:07.819 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.819 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.819 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.819 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.819 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.819 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.819 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.819 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.820 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.820 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.820 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 5 monclient: authenticate success, global_id 8214 2024-09-19T12:00:07.820 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T12:00:07.205+0000 7f57e3e07640 4 set_mon_vals no callback set 2024-09-19T12:00:07.820 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient: _renew_subs 2024-09-19T12:00:07.820 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:00:07.820 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient: _renew_subs 2024-09-19T12:00:07.820 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:00:07.820 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T12:00:07.205+0000 7f58f7f249c0 1 librados: init done 2024-09-19T12:00:07.820 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T12:00:07.205+0000 7f57e2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:00:07.820 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T12:00:07.205+0000 7f57e2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:07.820 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T12:00:07.205+0000 7f57e2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:07.820 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T12:00:07.205+0000 7f58f5a2a640 10 monclient: get_auth_request con 0x7f57dc071c10 auth_method 0 2024-09-19T12:00:07.820 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T12:00:07.205+0000 7f58f622b640 10 monclient: get_auth_request con 0x5577ae6ffb80 auth_method 0 2024-09-19T12:00:07.821 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T12:00:07.209+0000 7f58f5a2a640 10 monclient: get_auth_request con 0x5577ae722730 auth_method 0 2024-09-19T12:00:07.821 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T12:00:07.209+0000 7f58f5229640 10 monclient: get_auth_request con 0x5577ae726920 auth_method 0 2024-09-19T12:00:07.821 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient: get_auth_request con 0x5577ae725fe0 auth_method 0 2024-09-19T12:00:07.821 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient: build_initial_monmap 2024-09-19T12:00:07.821 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:07.821 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient: monmap: 2024-09-19T12:00:07.821 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:07.821 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:07.821 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:07.821 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:07.821 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:07.821 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.821 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:07.821 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:07.821 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:07.822 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.822 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding auth protocol: cephx 2024-09-19T12:00:07.822 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding auth protocol: cephx 2024-09-19T12:00:07.822 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding auth protocol: cephx 2024-09-19T12:00:07.822 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: secure 2024-09-19T12:00:07.822 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: crc 2024-09-19T12:00:07.822 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: secure 2024-09-19T12:00:07.822 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: crc 2024-09-19T12:00:07.822 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: secure 2024-09-19T12:00:07.822 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: crc 2024-09-19T12:00:07.822 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: crc 2024-09-19T12:00:07.822 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: secure 2024-09-19T12:00:07.822 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: crc 2024-09-19T12:00:07.822 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: secure 2024-09-19T12:00:07.823 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: crc 2024-09-19T12:00:07.823 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72e9a0) adding con mode: secure 2024-09-19T12:00:07.823 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.823 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command objecter_requests cmddesc objecter_requests hook 0x5577ae732310 EEXIST 2024-09-19T12:00:07.823 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient: init 2024-09-19T12:00:07.823 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding auth protocol: cephx 2024-09-19T12:00:07.823 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding auth protocol: cephx 2024-09-19T12:00:07.823 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding auth protocol: cephx 2024-09-19T12:00:07.823 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: secure 2024-09-19T12:00:07.823 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: crc 2024-09-19T12:00:07.823 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: secure 2024-09-19T12:00:07.823 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: crc 2024-09-19T12:00:07.823 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: secure 2024-09-19T12:00:07.824 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: crc 2024-09-19T12:00:07.824 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: crc 2024-09-19T12:00:07.824 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: secure 2024-09-19T12:00:07.824 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: crc 2024-09-19T12:00:07.824 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: secure 2024-09-19T12:00:07.824 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: crc 2024-09-19T12:00:07.824 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae72d898) adding con mode: secure 2024-09-19T12:00:07.824 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.824 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.824 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command rotate-key cmddesc rotate-key hook 0x5577ae72d9e0 EEXIST 2024-09-19T12:00:07.824 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:07.824 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T12:00:07.824 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-b con 0x5577ae7564c0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:07.825 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-a con 0x5577ae755df0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:07.825 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-c con 0x5577ae7547d0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:07.825 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.825 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.825 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.825 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:07.825 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T12:00:07.213+0000 7f58f7f249c0 10 monclient(hunting): authenticate will time out at 2501.531271s 2024-09-19T12:00:07.825 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): get_auth_request con 0x5577ae7547d0 auth_method 0 2024-09-19T12:00:07.825 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.825 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.825 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.825 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient(hunting): get_auth_request con 0x5577ae755df0 auth_method 0 2024-09-19T12:00:07.825 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.826 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.826 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.826 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.826 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.826 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.826 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.826 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.826 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T12:00:07.213+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.826 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T12:00:07.213+0000 7f58f5229640 10 monclient(hunting): get_auth_request con 0x5577ae7564c0 auth_method 0 2024-09-19T12:00:07.826 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T12:00:07.213+0000 7f58f5229640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.826 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T12:00:07.213+0000 7f58f5229640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.826 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T12:00:07.213+0000 7f58f5229640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.826 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_done global_id 7628 payload 824 2024-09-19T12:00:07.826 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient: _finish_hunting 0 2024-09-19T12:00:07.826 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 1 monclient: found mon.noname-c 2024-09-19T12:00:07.827 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T12:00:07.213+0000 7f58f5a2a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:00:07.827 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.827 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:00:07.827 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: dump: 2024-09-19T12:00:07.827 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.827 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.827 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.827 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.827 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.827 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.827 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.827 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.827 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.827 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.828 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: _finish_auth 0 2024-09-19T12:00:07.828 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: _check_auth_tickets 2024-09-19T12:00:07.828 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:07.828 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.828 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:00:07.828 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T12:00:07.217+0000 7f57db7fe640 10 monclient: dump: 2024-09-19T12:00:07.828 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.828 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.828 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.828 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.828 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.828 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.828 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.828 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.829 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.829 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.829 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 monclient: authenticate success, global_id 7628 2024-09-19T12:00:07.829 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: _renew_subs 2024-09-19T12:00:07.829 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T12:00:07.217+0000 7f58f6a2c640 4 set_mon_vals no callback set 2024-09-19T12:00:07.829 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:00:07.829 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: _renew_subs 2024-09-19T12:00:07.829 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:00:07.829 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T12:00:07.217+0000 7f57db7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:00:07.829 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T12:00:07.217+0000 7f57db7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:07.829 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T12:00:07.217+0000 7f57db7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:07.829 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: get_monmap_and_config 2024-09-19T12:00:07.829 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: build_initial_monmap 2024-09-19T12:00:07.829 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:07.830 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: monmap: 2024-09-19T12:00:07.830 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:07.830 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:07.830 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:07.830 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:07.830 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:07.830 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.830 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:07.830 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:07.830 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:07.830 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.830 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding auth protocol: cephx 2024-09-19T12:00:07.830 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding auth protocol: cephx 2024-09-19T12:00:07.830 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding auth protocol: cephx 2024-09-19T12:00:07.831 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: secure 2024-09-19T12:00:07.831 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: crc 2024-09-19T12:00:07.831 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: secure 2024-09-19T12:00:07.831 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: crc 2024-09-19T12:00:07.831 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: secure 2024-09-19T12:00:07.831 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: crc 2024-09-19T12:00:07.831 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T12:00:07.217+0000 7f58f5229640 10 monclient: get_auth_request con 0x7f57d0071b20 auth_method 0 2024-09-19T12:00:07.831 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: crc 2024-09-19T12:00:07.831 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: secure 2024-09-19T12:00:07.831 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: crc 2024-09-19T12:00:07.831 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: secure 2024-09-19T12:00:07.831 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: crc 2024-09-19T12:00:07.831 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae775e40) adding con mode: secure 2024-09-19T12:00:07.832 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.832 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: init 2024-09-19T12:00:07.832 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding auth protocol: cephx 2024-09-19T12:00:07.832 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding auth protocol: cephx 2024-09-19T12:00:07.832 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding auth protocol: cephx 2024-09-19T12:00:07.832 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: secure 2024-09-19T12:00:07.832 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: crc 2024-09-19T12:00:07.832 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: secure 2024-09-19T12:00:07.832 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: crc 2024-09-19T12:00:07.832 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: secure 2024-09-19T12:00:07.832 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: crc 2024-09-19T12:00:07.832 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: crc 2024-09-19T12:00:07.832 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: secure 2024-09-19T12:00:07.833 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: crc 2024-09-19T12:00:07.833 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: secure 2024-09-19T12:00:07.833 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: crc 2024-09-19T12:00:07.833 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12380) adding con mode: secure 2024-09-19T12:00:07.833 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.833 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.833 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command rotate-key cmddesc rotate-key hook 0x7ffc11a124c8 EEXIST 2024-09-19T12:00:07.833 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:07.833 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T12:00:07.833 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-a con 0x5577ae779f10 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:07.833 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-c con 0x5577ae7aa130 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:07.833 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-b con 0x5577ae7a5e20 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:07.833 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.833 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.834 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.834 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:07.834 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T12:00:07.217+0000 7f58f7f249c0 10 monclient(hunting): authenticate will time out at 2501.535806s 2024-09-19T12:00:07.834 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T12:00:07.217+0000 7f58f5229640 10 monclient(hunting): get_auth_request con 0x5577ae779f10 auth_method 0 2024-09-19T12:00:07.834 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T12:00:07.217+0000 7f58f5229640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.834 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T12:00:07.217+0000 7f58f5229640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.834 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T12:00:07.217+0000 7f58f5229640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.834 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T12:00:07.217+0000 7f58f622b640 10 monclient(hunting): get_auth_request con 0x5577ae7aa130 auth_method 0 2024-09-19T12:00:07.834 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T12:00:07.217+0000 7f58f622b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.835 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T12:00:07.217+0000 7f58f622b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.835 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T12:00:07.217+0000 7f58f622b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.835 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.835 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.835 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.835 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.835 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.835 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.835 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): get_auth_request con 0x5577ae7a5e20 auth_method 0 2024-09-19T12:00:07.835 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.835 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.835 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.835 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): handle_auth_done global_id 7631 payload 274 2024-09-19T12:00:07.835 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient: _finish_hunting 0 2024-09-19T12:00:07.836 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T12:00:07.221+0000 7f58f622b640 1 monclient: found mon.noname-c 2024-09-19T12:00:07.836 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:00:07.836 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.836 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:00:07.836 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: dump: 2024-09-19T12:00:07.836 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.836 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.836 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.836 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.836 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.836 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.836 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.836 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.836 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.837 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.837 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: _finish_auth 0 2024-09-19T12:00:07.837 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: _check_auth_tickets 2024-09-19T12:00:07.837 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:07.837 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 monclient: authenticate success, global_id 7631 2024-09-19T12:00:07.837 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: get_monmap_and_config success 2024-09-19T12:00:07.837 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 4 set_mon_vals no callback set 2024-09-19T12:00:07.837 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.837 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:00:07.837 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T12:00:07.221+0000 7f57d97fa640 10 monclient: dump: 2024-09-19T12:00:07.837 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.837 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.837 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.838 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.838 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.838 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.838 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.838 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.838 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.838 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.838 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: shutdown 2024-09-19T12:00:07.838 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: build_initial_monmap 2024-09-19T12:00:07.838 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:07.838 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: monmap: 2024-09-19T12:00:07.838 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:07.838 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:07.838 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:07.838 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:07.839 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:07.839 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.839 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:07.839 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:07.839 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:07.839 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.839 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding auth protocol: cephx 2024-09-19T12:00:07.839 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding auth protocol: cephx 2024-09-19T12:00:07.839 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding auth protocol: cephx 2024-09-19T12:00:07.839 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: secure 2024-09-19T12:00:07.839 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: crc 2024-09-19T12:00:07.839 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: secure 2024-09-19T12:00:07.839 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: crc 2024-09-19T12:00:07.839 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: secure 2024-09-19T12:00:07.840 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: crc 2024-09-19T12:00:07.840 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: crc 2024-09-19T12:00:07.840 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: secure 2024-09-19T12:00:07.840 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: crc 2024-09-19T12:00:07.840 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: secure 2024-09-19T12:00:07.840 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: crc 2024-09-19T12:00:07.840 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae79c800) adding con mode: secure 2024-09-19T12:00:07.840 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.840 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 1 librados: starting msgr at 2024-09-19T12:00:07.840 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 1 librados: starting objecter 2024-09-19T12:00:07.840 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command objecter_requests cmddesc objecter_requests hook 0x5577ae758130 EEXIST 2024-09-19T12:00:07.840 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 1 librados: setting wanted keys 2024-09-19T12:00:07.840 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 1 librados: calling monclient init 2024-09-19T12:00:07.841 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: init 2024-09-19T12:00:07.841 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding auth protocol: cephx 2024-09-19T12:00:07.841 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding auth protocol: cephx 2024-09-19T12:00:07.841 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding auth protocol: cephx 2024-09-19T12:00:07.841 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: secure 2024-09-19T12:00:07.841 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: crc 2024-09-19T12:00:07.841 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: secure 2024-09-19T12:00:07.841 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: crc 2024-09-19T12:00:07.841 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: secure 2024-09-19T12:00:07.841 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: crc 2024-09-19T12:00:07.841 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: crc 2024-09-19T12:00:07.841 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: secure 2024-09-19T12:00:07.841 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: crc 2024-09-19T12:00:07.842 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: secure 2024-09-19T12:00:07.842 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: crc 2024-09-19T12:00:07.842 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 AuthRegistry(0x5577ae7582e0) adding con mode: secure 2024-09-19T12:00:07.842 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.842 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.842 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command rotate-key cmddesc rotate-key hook 0x5577ae758428 EEXIST 2024-09-19T12:00:07.842 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:07.842 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T12:00:07.842 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-c con 0x5577ae779f10 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:07.842 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-b con 0x5577ae7a5e20 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:07.842 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): picked mon.noname-a con 0x5577ae7aa130 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:07.842 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.842 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.842 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:07.843 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:07.843 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient(hunting): authenticate will time out at 2501.538540s 2024-09-19T12:00:07.843 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): get_auth_request con 0x5577ae779f10 auth_method 0 2024-09-19T12:00:07.843 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.843 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.843 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.843 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): get_auth_request con 0x5577ae7aa130 auth_method 0 2024-09-19T12:00:07.843 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.843 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.843 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.843 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.843 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.843 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T12:00:07.221+0000 7f58f5229640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.844 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:07.844 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:07.844 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:07.844 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): get_auth_request con 0x5577ae7a5e20 auth_method 0 2024-09-19T12:00:07.844 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:07.844 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:07.844 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T12:00:07.221+0000 7f58f622b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:07.844 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient(hunting): handle_auth_done global_id 8223 payload 824 2024-09-19T12:00:07.844 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient: _finish_hunting 0 2024-09-19T12:00:07.844 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 1 monclient: found mon.noname-a 2024-09-19T12:00:07.844 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T12:00:07.221+0000 7f58f5a2a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:00:07.844 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.844 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:00:07.844 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: dump: 2024-09-19T12:00:07.845 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.845 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.845 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.845 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.845 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.845 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.845 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.845 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.845 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.845 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.845 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: _finish_auth 0 2024-09-19T12:00:07.845 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: _check_auth_tickets 2024-09-19T12:00:07.845 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:07.845 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:07.846 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:00:07.846 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T12:00:07.221+0000 7f57c77fe640 10 monclient: dump: 2024-09-19T12:00:07.846 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:07.846 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:07.846 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.846 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:07.846 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:07.846 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:07.846 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:07.846 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:07.846 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:07.846 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.846 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 monclient: authenticate success, global_id 8223 2024-09-19T12:00:07.847 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: _renew_subs 2024-09-19T12:00:07.847 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T12:00:07.221+0000 7f57d97fa640 4 set_mon_vals no callback set 2024-09-19T12:00:07.847 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:00:07.847 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: _renew_subs 2024-09-19T12:00:07.847 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:00:07.847 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 1 librados: init done 2024-09-19T12:00:07.847 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T12:00:07.221+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command cr dump hook 0x5577ae79fd18 2024-09-19T12:00:07.847 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.847 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T12:00:07.225+0000 7f57c77fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:00:07.847 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T12:00:07.225+0000 7f57c77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:07.847 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T12:00:07.225+0000 7f57c77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:07.847 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T12:00:07.225+0000 7f58f5229640 10 monclient: get_auth_request con 0x7f57c0071be0 auth_method 0 2024-09-19T12:00:07.847 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T12:00:07.225+0000 7f58f622b640 10 monclient: get_auth_request con 0x5577ae7c3ef0 auth_method 0 2024-09-19T12:00:07.847 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.848 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 realm 2024-09-19T12:00:07.848 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.848 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.848 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:07.848 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.848 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.848 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T12:00:07.225+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.848 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T12:00:07.225+0000 7f58f5229640 10 monclient: get_auth_request con 0x5577ae7c8160 auth_method 0 2024-09-19T12:00:07.848 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T12:00:07.229+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:07.848 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T12:00:07.229+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.848 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T12:00:07.229+0000 7f58f622b640 10 monclient: get_auth_request con 0x5577ae7cb9c0 auth_method 0 2024-09-19T12:00:07.848 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T12:00:07.229+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:07.848 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T12:00:07.229+0000 7f58f7f249c0 20 searching for the correct realm 2024-09-19T12:00:07.849 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T12:00:07.229+0000 7f58f5a2a640 10 monclient: get_auth_request con 0x5577ae7d0710 auth_method 0 2024-09-19T12:00:07.849 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T12:00:07.229+0000 7f58f5229640 10 monclient: get_auth_request con 0x5577ae565500 auth_method 0 2024-09-19T12:00:07.849 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T12:00:07.233+0000 7f58f622b640 10 monclient: get_auth_request con 0x7f58ec075040 auth_method 0 2024-09-19T12:00:07.849 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T12:00:07.233+0000 7f58f622b640 0 -- 172.21.15.120:0/1752271843 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f58ec075040 msgr2=0x7f58ec05bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:00:07.849 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T12:00:07.437+0000 7f58f622b640 10 monclient: get_auth_request con 0x7f58ec075040 auth_method 0 2024-09-19T12:00:07.849 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T12:00:07.437+0000 7f58f5a2a640 10 monclient: get_auth_request con 0x7f58f0044040 auth_method 0 2024-09-19T12:00:07.849 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T12:00:07.449+0000 7f58f5229640 0 -- 172.21.15.120:0/1752271843 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f58e811b420 msgr2=0x7f58e8107df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:00:07.849 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T12:00:07.653+0000 7f58f5229640 10 monclient: get_auth_request con 0x7f58e811b420 auth_method 0 2024-09-19T12:00:07.849 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:07.849 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:07.849 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:07.849 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:07.849 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:07.849 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:07.850 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T12:00:07.665+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.850 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.850 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.850 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:07.850 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.850 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:07.850 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 zone default found 2024-09-19T12:00:07.850 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 4 Realm: () 2024-09-19T12:00:07.850 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:07.850 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:07.850 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:07.850 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 zonegroup default 2024-09-19T12:00:07.850 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.850 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.851 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T12:00:07.669+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.851 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T12:00:07.673+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.851 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T12:00:07.673+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.851 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T12:00:07.673+0000 7f58f7f249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.851 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T12:00:07.673+0000 7f58f7f249c0 20 started sync module instance, tier type = 2024-09-19T12:00:07.851 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T12:00:07.673+0000 7f58f7f249c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:07.851 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=0 2024-09-19T12:00:07.851 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=1 2024-09-19T12:00:07.851 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=2 2024-09-19T12:00:07.851 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=3 2024-09-19T12:00:07.851 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=4 2024-09-19T12:00:07.851 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=5 2024-09-19T12:00:07.851 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T12:00:07.705+0000 7f58f7f249c0 20 add_watcher() i=6 2024-09-19T12:00:07.852 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T12:00:07.709+0000 7f58f7f249c0 20 add_watcher() i=7 2024-09-19T12:00:07.852 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T12:00:07.709+0000 7f58f7f249c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:07.852 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding auth protocol: cephx 2024-09-19T12:00:07.852 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding auth protocol: cephx 2024-09-19T12:00:07.852 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding auth protocol: cephx 2024-09-19T12:00:07.852 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: secure 2024-09-19T12:00:07.852 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: crc 2024-09-19T12:00:07.852 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: secure 2024-09-19T12:00:07.852 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: crc 2024-09-19T12:00:07.852 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: secure 2024-09-19T12:00:07.852 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T12:00:07.713+0000 7f57a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:07.852 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: crc 2024-09-19T12:00:07.852 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: crc 2024-09-19T12:00:07.853 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: secure 2024-09-19T12:00:07.853 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: crc 2024-09-19T12:00:07.853 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: secure 2024-09-19T12:00:07.853 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: crc 2024-09-19T12:00:07.853 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T12:00:07.713+0000 7f58f7f249c0 5 AuthRegistry(0x7ffc11a12850) adding con mode: secure 2024-09-19T12:00:07.853 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:07.853 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:07.853 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:07.853 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command cache list hook 0x5577ae79f0c0 2024-09-19T12:00:07.853 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command cache inspect hook 0x5577ae79f0c0 2024-09-19T12:00:07.853 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command cache erase hook 0x5577ae79f0c0 2024-09-19T12:00:07.853 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command cache zap hook 0x5577ae79f0c0 2024-09-19T12:00:07.853 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 note: GC not initialized 2024-09-19T12:00:07.853 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T12:00:07.717+0000 7f57a67fc640 20 reqs_thread_entry: start 2024-09-19T12:00:07.854 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command sync trace show hook 0x7f58f000d9d0 2024-09-19T12:00:07.854 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command sync trace history hook 0x7f58f000d9d0 2024-09-19T12:00:07.854 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command sync trace active hook 0x7f58f000d9d0 2024-09-19T12:00:07.854 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 5 asok(0x5577ae4cbd90) register_command sync trace active_short hook 0x7f58f000d9d0 2024-09-19T12:00:07.854 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:07.854 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 Filter name: none 2024-09-19T12:00:07.854 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T12:00:07.717+0000 7f5717fff640 20 reqs_thread_entry: start 2024-09-19T12:00:07.854 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:00:07.854 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.854 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:07.854 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:00:07.854 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:00:07.854 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:00:07.854 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T12:00:07.717+0000 7f58f7f249c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.854 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T12:00:07.721+0000 7f58f7f249c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:00:07.855 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T12:00:07.721+0000 7f58f7f249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:07.855 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T12:00:07.721+0000 7f58f7f249c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:07.855 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T12:00:07.721+0000 7f58f7f249c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:00:07.855 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T12:00:07.721+0000 7f58f7f249c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:07.855 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T12:00:07.721+0000 7f58f7f249c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:00:07.855 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:07.855 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:07.855 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:07.855 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T12:00:07.855 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T12:00:07.729+0000 7f57d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366215 cookie 93972516927632 notifier 8223 bl.length()=911 2024-09-19T12:00:07.855 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T12:00:07.729+0000 7f57d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:07.855 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T12:00:07.729+0000 7f57d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:07.855 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T12:00:07.729+0000 7f57d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:07.855 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T12:00:07.856 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T12:00:07.856 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T12:00:07.856 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T12:00:07.729+0000 7f58f7f249c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T12:00:07.856 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.0 2024-09-19T12:00:07.856 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.0 2024-09-19T12:00:07.856 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.1 2024-09-19T12:00:07.856 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.1 2024-09-19T12:00:07.856 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.2 2024-09-19T12:00:07.856 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.2 2024-09-19T12:00:07.856 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.3 2024-09-19T12:00:07.856 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.3 2024-09-19T12:00:07.856 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:00:07.856 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T12:00:07.733+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:00:07.856 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T12:00:07.737+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:00:07.857 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T12:00:07.737+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:00:07.857 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T12:00:07.737+0000 7f58f7f249c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:00:07.857 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T12:00:07.737+0000 7f58f7f249c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:00:07.857 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T12:00:07.741+0000 7f58f7f249c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f58f7f249c0 time 2024-09-19T12:00:07.743394+0000 2024-09-19T12:00:07.857 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:00:07.857 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.857 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:07.857 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f58fb7fe2eb] 2024-09-19T12:00:07.857 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fb7fe49f] 2024-09-19T12:00:07.857 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577abc42271] 2024-09-19T12:00:07.857 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5577abc51441] 2024-09-19T12:00:07.857 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5577abc52a94] 2024-09-19T12:00:07.857 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T12:00:07.858 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fa664d90] 2024-09-19T12:00:07.858 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T12:00:07.858 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T12:00:07.858 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.858 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T12:00:07.741+0000 7f58f7f249c0 -1 *** Caught signal (Aborted) ** 2024-09-19T12:00:07.858 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f58f7f249c0 thread_name:radosgw-admin 2024-09-19T12:00:07.858 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.858 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:07.858 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f58fa67d520] 2024-09-19T12:00:07.858 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:00:07.858 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:00:07.858 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:00:07.858 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f58fb7fe345] 2024-09-19T12:00:07.858 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f58fb7fe49f] 2024-09-19T12:00:07.859 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5577abc42271] 2024-09-19T12:00:07.859 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5577abc51441] 2024-09-19T12:00:07.859 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5577abc52a94] 2024-09-19T12:00:07.859 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T12:00:07.859 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f58fa664d90] 2024-09-19T12:00:07.859 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T12:00:07.859 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T12:00:07.859 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T12:00:07.859 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:07.859 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T12:00:07.859 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T12:00:07.859 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T12:00:07.860 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T12:00:07.860 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T12:00:07.860 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T12:00:07.860 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T12:00:07.860 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T12:00:07.860 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T12:00:07.860 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T12:00:07.860 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T12:00:07.860 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T12:00:07.860 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T12:00:07.860 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T12:00:07.860 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T12:00:07.860 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T12:00:07.860 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T12:00:07.861 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T12:00:07.861 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T12:00:07.861 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T12:00:07.861 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T12:00:07.861 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T12:00:07.861 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T12:00:07.861 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T12:00:07.861 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T12:00:07.861 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T12:00:07.861 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T12:00:07.861 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T12:00:07.861 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T12:00:07.861 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T12:00:07.861 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T12:00:07.862 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T12:00:07.862 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T12:00:07.862 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T12:00:07.862 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T12:00:07.862 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T12:00:07.862 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T12:00:07.862 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T12:00:07.862 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T12:00:07.862 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T12:00:07.862 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T12:00:07.862 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T12:00:07.862 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T12:00:07.862 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T12:00:07.862 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T12:00:07.863 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T12:00:07.863 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T12:00:07.863 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T12:00:07.863 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T12:00:07.863 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T12:00:07.863 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T12:00:07.863 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T12:00:07.863 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T12:00:07.863 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T12:00:07.863 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T12:00:07.863 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T12:00:07.863 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T12:00:07.863 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T12:00:07.863 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T12:00:07.864 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T12:00:07.864 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T12:00:07.864 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T12:00:07.864 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T12:00:07.864 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T12:00:07.864 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T12:00:07.864 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T12:00:07.864 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T12:00:07.864 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T12:00:07.864 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T12:00:07.864 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T12:00:07.864 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T12:00:07.864 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T12:00:07.864 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T12:00:07.865 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T12:00:07.865 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T12:00:07.865 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T12:00:07.865 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T12:00:07.865 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T12:00:07.865 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T12:00:07.865 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T12:00:07.865 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T12:00:07.865 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T12:00:07.865 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T12:00:07.865 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T12:00:07.865 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T12:00:07.865 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T12:00:07.865 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T12:00:07.866 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T12:00:07.866 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T12:00:07.866 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T12:00:07.866 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T12:00:07.866 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T12:00:07.866 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T12:00:07.866 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T12:00:07.866 INFO:tasks.workunit.client.0.smithi120.stderr: 7f5717fff640 / http_manager 2024-09-19T12:00:07.866 INFO:tasks.workunit.client.0.smithi120.stderr: 7f57a67fc640 / http_manager 2024-09-19T12:00:07.866 INFO:tasks.workunit.client.0.smithi120.stderr: 7f57a77fe640 / rgw_dt_lg_renew 2024-09-19T12:00:07.866 INFO:tasks.workunit.client.0.smithi120.stderr: 7f57c77fe640 / ms_dispatch 2024-09-19T12:00:07.866 INFO:tasks.workunit.client.0.smithi120.stderr: 7f57d97fa640 / io_context_pool 2024-09-19T12:00:07.866 INFO:tasks.workunit.client.0.smithi120.stderr: 7f57db7fe640 / ms_dispatch 2024-09-19T12:00:07.866 INFO:tasks.workunit.client.0.smithi120.stderr: 7f57e2604640 / ms_dispatch 2024-09-19T12:00:07.866 INFO:tasks.workunit.client.0.smithi120.stderr: 7f57e3e07640 / io_context_pool 2024-09-19T12:00:07.867 INFO:tasks.workunit.client.0.smithi120.stderr: 7f58f5229640 / msgr-worker-2 2024-09-19T12:00:07.867 INFO:tasks.workunit.client.0.smithi120.stderr: 7f58f5a2a640 / msgr-worker-1 2024-09-19T12:00:07.867 INFO:tasks.workunit.client.0.smithi120.stderr: 7f58f622b640 / msgr-worker-0 2024-09-19T12:00:07.867 INFO:tasks.workunit.client.0.smithi120.stderr: 7f58f6a2c640 / io_context_pool 2024-09-19T12:00:07.867 INFO:tasks.workunit.client.0.smithi120.stderr: 7f58f7f249c0 / radosgw-admin 2024-09-19T12:00:07.867 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T12:00:07.867 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T12:00:07.867 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/lib/ceph/crash/2024-09-19T12:00:07.745855Z_3fad4d95-6a59-4a9a-968c-cb1fbb93d75b/log 2024-09-19T12:00:07.867 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T12:00:07.867 INFO:tasks.workunit.client.0.smithi120.stderr:Aborted 2024-09-19T12:00:07.867 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T12:00:07.869 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:00:07.869 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:00:07.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.829+0000 7f2641c809c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.829+0000 7f2641c809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.829+0000 7f2641c809c0 20 realm 2024-09-19T12:00:07.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.829+0000 7f2641c809c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.829+0000 7f2641c809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.829+0000 7f2641c809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:07.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.829+0000 7f2641c809c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.829+0000 7f2641c809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:07.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.829+0000 7f2641c809c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.833+0000 7f2641c809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:07.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.833+0000 7f2641c809c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:07.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.833+0000 7f2641c809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:07.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.833+0000 7f2641c809c0 20 searching for the correct realm 2024-09-19T12:00:07.870 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:07.837+0000 7f263f786640 0 -- 172.21.15.120:0/2658734680 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f2638083040 msgr2=0x7f2638043a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:08.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.053+0000 7f263f786640 0 -- 172.21.15.120:0/2658734680 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f2638083040 msgr2=0x7f2638043a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:08.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.065+0000 7f2641c809c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:08.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.065+0000 7f2641c809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:08.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.065+0000 7f2641c809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:08.060 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.065+0000 7f2641c809c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:08.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.065+0000 7f2641c809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:08.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.065+0000 7f2641c809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:08.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.065+0000 7f2641c809c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.065+0000 7f2641c809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:08.061 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.065+0000 7f2641c809c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.065+0000 7f2641c809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:08.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.065+0000 7f2641c809c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.069+0000 7f2641c809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:08.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.069+0000 7f2641c809c0 20 zone default found 2024-09-19T12:00:08.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.069+0000 7f2641c809c0 4 Realm: () 2024-09-19T12:00:08.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.069+0000 7f2641c809c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:08.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.069+0000 7f2641c809c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:08.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.069+0000 7f2641c809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:08.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.069+0000 7f2641c809c0 20 zonegroup default 2024-09-19T12:00:08.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.069+0000 7f2641c809c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.069+0000 7f2641c809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:08.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.069+0000 7f2641c809c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.069+0000 7f2641c809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:08.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.069+0000 7f2641c809c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.069+0000 7f2641c809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:08.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.069+0000 7f2641c809c0 20 started sync module instance, tier type = 2024-09-19T12:00:08.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.069+0000 7f2641c809c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:08.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.093+0000 7f2641c809c0 20 add_watcher() i=0 2024-09-19T12:00:08.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.093+0000 7f2641c809c0 20 add_watcher() i=1 2024-09-19T12:00:08.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.093+0000 7f2641c809c0 20 add_watcher() i=2 2024-09-19T12:00:08.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.093+0000 7f2641c809c0 20 add_watcher() i=3 2024-09-19T12:00:08.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.093+0000 7f2641c809c0 20 add_watcher() i=4 2024-09-19T12:00:08.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.093+0000 7f2641c809c0 20 add_watcher() i=5 2024-09-19T12:00:08.088 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.093+0000 7f2641c809c0 20 add_watcher() i=6 2024-09-19T12:00:08.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.093+0000 7f2641c809c0 20 add_watcher() i=7 2024-09-19T12:00:08.090 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.093+0000 7f2641c809c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:08.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.097+0000 7f24f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:08.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.101+0000 7f2641c809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:08.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.101+0000 7f2641c809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:08.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.101+0000 7f2641c809c0 5 note: GC not initialized 2024-09-19T12:00:08.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.101+0000 7f24f4fe1640 20 reqs_thread_entry: start 2024-09-19T12:00:08.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.101+0000 7f2641c809c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:08.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.101+0000 7f2641c809c0 20 Filter name: none 2024-09-19T12:00:08.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.101+0000 7f246e7fc640 20 reqs_thread_entry: start 2024-09-19T12:00:08.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.101+0000 7f2641c809c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.101+0000 7f2641c809c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:08.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.101+0000 7f2641c809c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.105+0000 7f2641c809c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:00:08.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.105+0000 7f2641c809c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:08.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.105+0000 7f2641c809c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.105+0000 7f2641c809c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:08.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.105+0000 7f2641c809c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.105+0000 7f2641c809c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:00:08.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.105+0000 7f2641c809c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:08.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.109+0000 7f24f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:08.110 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.113+0000 7f2641c809c0 20 remove_watcher() i=0 2024-09-19T12:00:08.110 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.113+0000 7f2641c809c0 2 removed watcher, disabling cache 2024-09-19T12:00:08.112 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.117+0000 7f2641c809c0 20 remove_watcher() i=1 2024-09-19T12:00:08.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.121+0000 7f2641c809c0 20 remove_watcher() i=2 2024-09-19T12:00:08.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.121+0000 7f2641c809c0 20 remove_watcher() i=3 2024-09-19T12:00:08.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.125+0000 7f2641c809c0 20 remove_watcher() i=4 2024-09-19T12:00:08.120 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.125+0000 7f2641c809c0 20 remove_watcher() i=5 2024-09-19T12:00:08.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.125+0000 7f2641c809c0 20 remove_watcher() i=6 2024-09-19T12:00:08.123 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.129+0000 7f2641c809c0 20 remove_watcher() i=7 2024-09-19T12:00:08.153 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T12:00:08.181 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:00:08.181 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:00:08.226 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.229+0000 7f6c5d7a19c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.233+0000 7f6c5d7a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:08.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.233+0000 7f6c5d7a19c0 20 realm 2024-09-19T12:00:08.227 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.233+0000 7f6c5d7a19c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.233+0000 7f6c5d7a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:08.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.233+0000 7f6c5d7a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:08.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.233+0000 7f6c5d7a19c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.233+0000 7f6c5d7a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:08.228 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.233+0000 7f6c5d7a19c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.233+0000 7f6c5d7a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:08.229 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.233+0000 7f6c5d7a19c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.237+0000 7f6c5d7a19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:08.231 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.237+0000 7f6c5d7a19c0 20 searching for the correct realm 2024-09-19T12:00:08.235 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.241+0000 7f6c5b2a7640 0 -- 172.21.15.120:0/1874402909 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f6c5401c030 msgr2=0x7f6c540647a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:08.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.457+0000 7f6c5b2a7640 0 -- 172.21.15.120:0/1874402909 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f6c5401c030 msgr2=0x7f6c540647a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:08.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:08.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:08.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:08.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:08.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:08.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:08.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.464 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:08.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:08.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:08.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 20 zone default found 2024-09-19T12:00:08.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 4 Realm: () 2024-09-19T12:00:08.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:08.466 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:08.467 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:08.467 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 20 zonegroup default 2024-09-19T12:00:08.467 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.469+0000 7f6c5d7a19c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.467 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.473+0000 7f6c5d7a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:08.467 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.473+0000 7f6c5d7a19c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.467 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.473+0000 7f6c5d7a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:08.467 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.473+0000 7f6c5d7a19c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.473+0000 7f6c5d7a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:08.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.473+0000 7f6c5d7a19c0 20 started sync module instance, tier type = 2024-09-19T12:00:08.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.473+0000 7f6c5d7a19c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:08.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.493+0000 7f6c5d7a19c0 20 add_watcher() i=0 2024-09-19T12:00:08.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.493+0000 7f6c5d7a19c0 20 add_watcher() i=1 2024-09-19T12:00:08.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.493+0000 7f6c5d7a19c0 20 add_watcher() i=2 2024-09-19T12:00:08.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.493+0000 7f6c5d7a19c0 20 add_watcher() i=3 2024-09-19T12:00:08.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.493+0000 7f6c5d7a19c0 20 add_watcher() i=4 2024-09-19T12:00:08.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.493+0000 7f6c5d7a19c0 20 add_watcher() i=5 2024-09-19T12:00:08.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.493+0000 7f6c5d7a19c0 20 add_watcher() i=6 2024-09-19T12:00:08.492 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.497+0000 7f6c5d7a19c0 20 add_watcher() i=7 2024-09-19T12:00:08.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.497+0000 7f6c5d7a19c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:08.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.501+0000 7f6b11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:08.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.501+0000 7f6c5d7a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:08.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.501+0000 7f6c5d7a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:08.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.501+0000 7f6c5d7a19c0 5 note: GC not initialized 2024-09-19T12:00:08.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.501+0000 7f6b10fe1640 20 reqs_thread_entry: start 2024-09-19T12:00:08.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.501+0000 7f6c5d7a19c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:08.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.501+0000 7f6c5d7a19c0 20 Filter name: none 2024-09-19T12:00:08.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.501+0000 7f6a8a7fc640 20 reqs_thread_entry: start 2024-09-19T12:00:08.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.501+0000 7f6c5d7a19c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:00:08.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.501+0000 7f6c5d7a19c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:08.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:00:08.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:00:08.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:00:08.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:08.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:00:08.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:08.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:08.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:00:08.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:08.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:00:08.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:00:08.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:00:08.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:00:08.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:00:08.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:00:08.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.505+0000 7f6c5d7a19c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:00:08.503 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.509+0000 7f6b11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:08.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.513+0000 7f6c5d7a19c0 20 remove_watcher() i=0 2024-09-19T12:00:08.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.513+0000 7f6c5d7a19c0 2 removed watcher, disabling cache 2024-09-19T12:00:08.511 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.517+0000 7f6c5d7a19c0 20 remove_watcher() i=1 2024-09-19T12:00:08.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.517+0000 7f6c5d7a19c0 20 remove_watcher() i=2 2024-09-19T12:00:08.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.521+0000 7f6c5d7a19c0 20 remove_watcher() i=3 2024-09-19T12:00:08.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.521+0000 7f6c5d7a19c0 20 remove_watcher() i=4 2024-09-19T12:00:08.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.525+0000 7f6c5d7a19c0 20 remove_watcher() i=5 2024-09-19T12:00:08.520 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.525+0000 7f6c5d7a19c0 20 remove_watcher() i=6 2024-09-19T12:00:08.521 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:08.525+0000 7f6c5d7a19c0 20 remove_watcher() i=7 2024-09-19T12:00:38.549 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T12:00:38.581 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:00:38.581 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:00:38.626 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.632+0000 7fa8bd6589c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:38.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.632+0000 7fa8bd6589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:38.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.632+0000 7fa8bd6589c0 20 realm 2024-09-19T12:00:38.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.632+0000 7fa8bd6589c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:38.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.632+0000 7fa8bd6589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:38.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.632+0000 7fa8bd6589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:38.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.632+0000 7fa8bd6589c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:38.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.632+0000 7fa8bd6589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:38.629 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.632+0000 7fa8bd6589c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:38.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.636+0000 7fa8bd6589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:38.630 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.636+0000 7fa8bd6589c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:38.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.636+0000 7fa8bd6589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:38.632 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.636+0000 7fa8bd6589c0 20 searching for the correct realm 2024-09-19T12:00:38.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.640+0000 7fa8bb15e640 0 -- 172.21.15.120:0/1458155988 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fa8b4008040 msgr2=0x7fa8b4041910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:00:38.853 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.856+0000 7fa8bb15e640 0 -- 172.21.15.120:0/1458155988 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fa8b4008040 msgr2=0x7fa8b4041910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:38.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.868+0000 7fa8bd6589c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:38.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.868+0000 7fa8bd6589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:38.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.868+0000 7fa8bd6589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:38.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.868+0000 7fa8bd6589c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:38.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.868+0000 7fa8bd6589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:38.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.868+0000 7fa8bd6589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:38.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.868+0000 7fa8bd6589c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:38.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.868+0000 7fa8bd6589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:38.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.868+0000 7fa8bd6589c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:38.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.868+0000 7fa8bd6589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:38.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.868+0000 7fa8bd6589c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:38.866 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.872+0000 7fa8bd6589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:38.867 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.872+0000 7fa8bd6589c0 20 zone default found 2024-09-19T12:00:38.867 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.872+0000 7fa8bd6589c0 4 Realm: () 2024-09-19T12:00:38.867 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.872+0000 7fa8bd6589c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:38.867 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.872+0000 7fa8bd6589c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:38.867 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.872+0000 7fa8bd6589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:38.867 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.872+0000 7fa8bd6589c0 20 zonegroup default 2024-09-19T12:00:38.867 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.872+0000 7fa8bd6589c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:38.867 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.872+0000 7fa8bd6589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:38.867 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.872+0000 7fa8bd6589c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:38.868 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.872+0000 7fa8bd6589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:38.868 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.872+0000 7fa8bd6589c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:38.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.872+0000 7fa8bd6589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:38.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.872+0000 7fa8bd6589c0 20 started sync module instance, tier type = 2024-09-19T12:00:38.869 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.872+0000 7fa8bd6589c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:38.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.896+0000 7fa8bd6589c0 20 add_watcher() i=0 2024-09-19T12:00:38.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.896+0000 7fa8bd6589c0 20 add_watcher() i=1 2024-09-19T12:00:38.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.896+0000 7fa8bd6589c0 20 add_watcher() i=2 2024-09-19T12:00:38.891 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.896+0000 7fa8bd6589c0 20 add_watcher() i=3 2024-09-19T12:00:38.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.896+0000 7fa8bd6589c0 20 add_watcher() i=4 2024-09-19T12:00:38.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.896+0000 7fa8bd6589c0 20 add_watcher() i=5 2024-09-19T12:00:38.892 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.896+0000 7fa8bd6589c0 20 add_watcher() i=6 2024-09-19T12:00:38.893 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.896+0000 7fa8bd6589c0 20 add_watcher() i=7 2024-09-19T12:00:38.893 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.896+0000 7fa8bd6589c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:38.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.900+0000 7fa771fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:38.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.900+0000 7fa8bd6589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:38.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.900+0000 7fa8bd6589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:38.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.900+0000 7fa8bd6589c0 5 note: GC not initialized 2024-09-19T12:00:38.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.900+0000 7fa770fe1640 20 reqs_thread_entry: start 2024-09-19T12:00:38.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.900+0000 7fa8bd6589c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:38.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.900+0000 7fa8bd6589c0 20 Filter name: none 2024-09-19T12:00:38.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.900+0000 7fa6ea7fc640 20 reqs_thread_entry: start 2024-09-19T12:00:38.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.900+0000 7fa8bd6589c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:38.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.904+0000 7fa8bd6589c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:38.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.904+0000 7fa8bd6589c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:38.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.904+0000 7fa8bd6589c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:00:38.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.904+0000 7fa8bd6589c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:38.900 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.904+0000 7fa8bd6589c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:38.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.904+0000 7fa8bd6589c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:38.901 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.904+0000 7fa8bd6589c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:38.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.908+0000 7fa8bd6589c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:00:38.903 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.908+0000 7fa8bd6589c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:38.905 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.908+0000 7fa771fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:38.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.912+0000 7fa8bd6589c0 20 remove_watcher() i=0 2024-09-19T12:00:38.910 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.912+0000 7fa8bd6589c0 2 removed watcher, disabling cache 2024-09-19T12:00:38.911 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.916+0000 7fa8bd6589c0 20 remove_watcher() i=1 2024-09-19T12:00:38.913 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.916+0000 7fa8bd6589c0 20 remove_watcher() i=2 2024-09-19T12:00:38.916 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.920+0000 7fa8bd6589c0 20 remove_watcher() i=3 2024-09-19T12:00:38.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.920+0000 7fa8bd6589c0 20 remove_watcher() i=4 2024-09-19T12:00:38.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.924+0000 7fa8bd6589c0 20 remove_watcher() i=5 2024-09-19T12:00:38.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.924+0000 7fa8bd6589c0 20 remove_watcher() i=6 2024-09-19T12:00:38.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:38.924+0000 7fa8bd6589c0 20 remove_watcher() i=7 2024-09-19T12:00:38.970 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T12:00:39.000 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:00:39.000 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:00:39.045 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.048+0000 7fd571b159c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.052+0000 7fd571b159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.052+0000 7fd571b159c0 20 realm 2024-09-19T12:00:39.047 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.052+0000 7fd571b159c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.052+0000 7fd571b159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.052+0000 7fd571b159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:39.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.052+0000 7fd571b159c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.052+0000 7fd571b159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.052+0000 7fd571b159c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.052+0000 7fd571b159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:39.049 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.052+0000 7fd571b159c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.056+0000 7fd571b159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:39.051 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.056+0000 7fd571b159c0 20 searching for the correct realm 2024-09-19T12:00:39.052 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.056+0000 7fd56ee1a640 0 -- 172.21.15.120:0/1593655239 >> [v2:172.21.15.151:6816/2331670939,v1:172.21.15.151:6817/2331670939] conn(0x7fd560081c60 msgr2=0x7fd560088b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:39.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.268+0000 7fd56fe1c640 0 -- 172.21.15.120:0/1593655239 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fd55802c070 msgr2=0x7fd55801e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:39.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.288+0000 7fd571b159c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:39.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.288+0000 7fd571b159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:39.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.288+0000 7fd571b159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:39.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.288+0000 7fd571b159c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:39.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.288+0000 7fd571b159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:39.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.288+0000 7fd571b159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:39.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.288+0000 7fd571b159c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.288+0000 7fd571b159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.288+0000 7fd571b159c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.288+0000 7fd571b159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:39.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:39.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 20 zone default found 2024-09-19T12:00:39.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 4 Realm: () 2024-09-19T12:00:39.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:39.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:39.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:39.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 20 zonegroup default 2024-09-19T12:00:39.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.288 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.288 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.288 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 20 started sync module instance, tier type = 2024-09-19T12:00:39.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.292+0000 7fd571b159c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:39.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.316+0000 7fd571b159c0 20 add_watcher() i=0 2024-09-19T12:00:39.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.316+0000 7fd571b159c0 20 add_watcher() i=1 2024-09-19T12:00:39.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.316+0000 7fd571b159c0 20 add_watcher() i=2 2024-09-19T12:00:39.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.316+0000 7fd571b159c0 20 add_watcher() i=3 2024-09-19T12:00:39.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.316+0000 7fd571b159c0 20 add_watcher() i=4 2024-09-19T12:00:39.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.316+0000 7fd571b159c0 20 add_watcher() i=5 2024-09-19T12:00:39.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.316+0000 7fd571b159c0 20 add_watcher() i=6 2024-09-19T12:00:39.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.316+0000 7fd571b159c0 20 add_watcher() i=7 2024-09-19T12:00:39.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.316+0000 7fd571b159c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:39.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.320+0000 7fd425fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:39.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.320+0000 7fd571b159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:39.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.320+0000 7fd571b159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:39.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.320+0000 7fd571b159c0 5 note: GC not initialized 2024-09-19T12:00:39.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.320+0000 7fd424fe1640 20 reqs_thread_entry: start 2024-09-19T12:00:39.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:39.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 20 Filter name: none 2024-09-19T12:00:39.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd39e7fc640 20 reqs_thread_entry: start 2024-09-19T12:00:39.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:00:39.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:39.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:00:39.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:00:39.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:00:39.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:00:39.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:39.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:39.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:00:39.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:39.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:00:39.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:00:39.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.324+0000 7fd571b159c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:00:39.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.328+0000 7fd571b159c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:00:39.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.328+0000 7fd571b159c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:00:39.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.328+0000 7fd571b159c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:00:39.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.328+0000 7fd571b159c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:00:39.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.328+0000 7fd425fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:39.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.336+0000 7fd571b159c0 20 remove_watcher() i=0 2024-09-19T12:00:39.331 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.336+0000 7fd571b159c0 2 removed watcher, disabling cache 2024-09-19T12:00:39.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.336+0000 7fd571b159c0 20 remove_watcher() i=1 2024-09-19T12:00:39.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.340+0000 7fd571b159c0 20 remove_watcher() i=2 2024-09-19T12:00:39.337 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.340+0000 7fd571b159c0 20 remove_watcher() i=3 2024-09-19T12:00:39.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.344+0000 7fd571b159c0 20 remove_watcher() i=4 2024-09-19T12:00:39.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.344+0000 7fd571b159c0 20 remove_watcher() i=5 2024-09-19T12:00:39.342 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.348+0000 7fd571b159c0 20 remove_watcher() i=6 2024-09-19T12:00:39.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.348+0000 7fd571b159c0 20 remove_watcher() i=7 2024-09-19T12:00:39.366 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T12:00:39.399 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:00:39.399 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:00:39.444 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.448+0000 7f7a0f7b09c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.452+0000 7f7a0f7b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.452+0000 7f7a0f7b09c0 20 realm 2024-09-19T12:00:39.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.452+0000 7f7a0f7b09c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.452+0000 7f7a0f7b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.452+0000 7f7a0f7b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:39.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.452+0000 7f7a0f7b09c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.452+0000 7f7a0f7b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.448 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.452+0000 7f7a0f7b09c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.452+0000 7f7a0f7b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:39.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.452+0000 7f7a0f7b09c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.456+0000 7f7a0f7b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:39.451 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.456+0000 7f7a0f7b09c0 20 searching for the correct realm 2024-09-19T12:00:39.454 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.456+0000 7f7a0dab7640 0 -- 172.21.15.120:0/49580775 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f7a04067c10 msgr2=0x7f7a04066e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:39.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.464+0000 7f7a0cab5640 0 -- 172.21.15.120:0/49580775 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f7a00083040 msgr2=0x7f7a00087190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:39.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:39.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:39.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:39.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:39.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:39.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:39.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.680 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:39.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:39.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 zone default found 2024-09-19T12:00:39.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 4 Realm: () 2024-09-19T12:00:39.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:39.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:39.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:39.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 zonegroup default 2024-09-19T12:00:39.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.684+0000 7f7a0f7b09c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.688+0000 7f7a0f7b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.688+0000 7f7a0f7b09c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.688+0000 7f7a0f7b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.688+0000 7f7a0f7b09c0 20 started sync module instance, tier type = 2024-09-19T12:00:39.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.688+0000 7f7a0f7b09c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:39.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.708+0000 7f7a0f7b09c0 20 add_watcher() i=0 2024-09-19T12:00:39.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.708+0000 7f7a0f7b09c0 20 add_watcher() i=1 2024-09-19T12:00:39.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.708+0000 7f7a0f7b09c0 20 add_watcher() i=2 2024-09-19T12:00:39.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.708+0000 7f7a0f7b09c0 20 add_watcher() i=3 2024-09-19T12:00:39.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.708+0000 7f7a0f7b09c0 20 add_watcher() i=4 2024-09-19T12:00:39.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.708+0000 7f7a0f7b09c0 20 add_watcher() i=5 2024-09-19T12:00:39.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.708+0000 7f7a0f7b09c0 20 add_watcher() i=6 2024-09-19T12:00:39.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.708+0000 7f7a0f7b09c0 20 add_watcher() i=7 2024-09-19T12:00:39.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.708+0000 7f7a0f7b09c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:39.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.712+0000 7f78c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:39.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.712+0000 7f7a0f7b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:39.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.712+0000 7f7a0f7b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:39.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.712+0000 7f7a0f7b09c0 5 note: GC not initialized 2024-09-19T12:00:39.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.716+0000 7f78c27e4640 20 reqs_thread_entry: start 2024-09-19T12:00:39.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.716+0000 7f7a0f7b09c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:39.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.716+0000 7f7a0f7b09c0 20 Filter name: none 2024-09-19T12:00:39.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.716+0000 7f7833fff640 20 reqs_thread_entry: start 2024-09-19T12:00:39.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.716+0000 7f7a0f7b09c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.716+0000 7f7a0f7b09c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:39.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.716+0000 7f7a0f7b09c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.716+0000 7f7a0f7b09c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:00:39.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.716+0000 7f7a0f7b09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:39.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.716+0000 7f7a0f7b09c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.720+0000 7f7a0f7b09c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:39.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.720+0000 7f7a0f7b09c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.720+0000 7f7a0f7b09c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:00:39.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.720+0000 7f7a0f7b09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:39.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.720+0000 7f78c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:39.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.728+0000 7f7a0f7b09c0 20 remove_watcher() i=0 2024-09-19T12:00:39.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.728+0000 7f7a0f7b09c0 2 removed watcher, disabling cache 2024-09-19T12:00:39.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.728+0000 7f7a0f7b09c0 20 remove_watcher() i=1 2024-09-19T12:00:39.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.732+0000 7f7a0f7b09c0 20 remove_watcher() i=2 2024-09-19T12:00:39.729 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.732+0000 7f7a0f7b09c0 20 remove_watcher() i=3 2024-09-19T12:00:39.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.736+0000 7f7a0f7b09c0 20 remove_watcher() i=4 2024-09-19T12:00:39.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.736+0000 7f7a0f7b09c0 20 remove_watcher() i=5 2024-09-19T12:00:39.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.740+0000 7f7a0f7b09c0 20 remove_watcher() i=6 2024-09-19T12:00:39.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.740+0000 7f7a0f7b09c0 20 remove_watcher() i=7 2024-09-19T12:00:39.750 INFO:tasks.workunit.client.0.smithi120.stderr: test: duplicated entries should be purged before reshard 2024-09-19T12:00:39.751 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T12:00:39.778 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:00:39.778 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:00:39.822 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.824+0000 7fef6b1819c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.824 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.828+0000 7fef6b1819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.824 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.828+0000 7fef6b1819c0 20 realm 2024-09-19T12:00:39.824 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.828+0000 7fef6b1819c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.828+0000 7fef6b1819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.828+0000 7fef6b1819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:39.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.828+0000 7fef6b1819c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.828+0000 7fef6b1819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:39.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.828+0000 7fef6b1819c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.828+0000 7fef6b1819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:39.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.828+0000 7fef6b1819c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:39.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.832+0000 7fef6b1819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:39.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.832+0000 7fef6b1819c0 20 searching for the correct realm 2024-09-19T12:00:39.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:39.836+0000 7fef69488640 0 -- 172.21.15.120:0/3151939278 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fef5c107050 msgr2=0x7fef5c0c3040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:40.048 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.052+0000 7fef68486640 0 -- 172.21.15.120:0/3151939278 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fef5805d5f0 msgr2=0x7fef580770c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:00:40.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.268+0000 7fef6b1819c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:40.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.268+0000 7fef6b1819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:40.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.268+0000 7fef6b1819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:40.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.268+0000 7fef6b1819c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:40.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.268+0000 7fef6b1819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:40.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.268+0000 7fef6b1819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:40.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.268+0000 7fef6b1819c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.268+0000 7fef6b1819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.268+0000 7fef6b1819c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:40.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 20 zone default found 2024-09-19T12:00:40.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 4 Realm: () 2024-09-19T12:00:40.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:40.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:40.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:40.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 20 zonegroup default 2024-09-19T12:00:40.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.268 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 20 started sync module instance, tier type = 2024-09-19T12:00:40.269 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.272+0000 7fef6b1819c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:40.293 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.296+0000 7fef6b1819c0 20 add_watcher() i=0 2024-09-19T12:00:40.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.296+0000 7fef6b1819c0 20 add_watcher() i=1 2024-09-19T12:00:40.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.296+0000 7fef6b1819c0 20 add_watcher() i=2 2024-09-19T12:00:40.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.296+0000 7fef6b1819c0 20 add_watcher() i=3 2024-09-19T12:00:40.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.296+0000 7fef6b1819c0 20 add_watcher() i=4 2024-09-19T12:00:40.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.296+0000 7fef6b1819c0 20 add_watcher() i=5 2024-09-19T12:00:40.294 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.296+0000 7fef6b1819c0 20 add_watcher() i=6 2024-09-19T12:00:40.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.300+0000 7fef6b1819c0 20 add_watcher() i=7 2024-09-19T12:00:40.296 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.300+0000 7fef6b1819c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:40.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.304+0000 7fee1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:40.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.304+0000 7fef6b1819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:40.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.304+0000 7fef6b1819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:40.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.304+0000 7fef6b1819c0 5 note: GC not initialized 2024-09-19T12:00:40.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.304+0000 7fee1e7e4640 20 reqs_thread_entry: start 2024-09-19T12:00:40.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.304+0000 7fef6b1819c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:40.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.304+0000 7fef6b1819c0 20 Filter name: none 2024-09-19T12:00:40.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.308+0000 7fee177fe640 20 reqs_thread_entry: start 2024-09-19T12:00:40.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.308+0000 7fef6b1819c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.308+0000 7fef6b1819c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:40.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.308+0000 7fef6b1819c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.308+0000 7fef6b1819c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:00:40.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.308+0000 7fef6b1819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:40.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.308+0000 7fef6b1819c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.308+0000 7fef6b1819c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:40.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.308+0000 7fef6b1819c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.312+0000 7fef6b1819c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:00:40.307 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.312+0000 7fef6b1819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:40.309 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.312+0000 7fee1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:40.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.316+0000 7fef6b1819c0 20 remove_watcher() i=0 2024-09-19T12:00:40.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.316+0000 7fef6b1819c0 2 removed watcher, disabling cache 2024-09-19T12:00:40.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.320+0000 7fef6b1819c0 20 remove_watcher() i=1 2024-09-19T12:00:40.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.324+0000 7fef6b1819c0 20 remove_watcher() i=2 2024-09-19T12:00:40.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.324+0000 7fef6b1819c0 20 remove_watcher() i=3 2024-09-19T12:00:40.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.328+0000 7fef6b1819c0 20 remove_watcher() i=4 2024-09-19T12:00:40.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.328+0000 7fef6b1819c0 20 remove_watcher() i=5 2024-09-19T12:00:40.326 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.332+0000 7fef6b1819c0 20 remove_watcher() i=6 2024-09-19T12:00:40.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.332+0000 7fef6b1819c0 20 remove_watcher() i=7 2024-09-19T12:00:40.342 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.342 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T12:00:40.342 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: a-bucket id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 num_objects: 10 size_kb: 1 num_shards: 3 2024-09-19T12:00:40.342 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.342 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-19T12:00:40.374 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:00:40.375 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:00:40.418 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 realm 2024-09-19T12:00:40.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.424+0000 7ff5d7db79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:40.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.421 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:40.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.428+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:40.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.428+0000 7ff5d7db79c0 20 searching for the correct realm 2024-09-19T12:00:40.428 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.432+0000 7ff5d58bd640 0 -- 172.21.15.120:0/2496266365 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff5d0029070 msgr2=0x7ff5d0067010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:40.644 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.648+0000 7ff5d58bd640 0 -- 172.21.15.120:0/2496266365 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff5d0029070 msgr2=0x7ff5d0067010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:40.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:40.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:40.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:40.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:40.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:40.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:40.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:40.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:40.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 zone default found 2024-09-19T12:00:40.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 4 Realm: () 2024-09-19T12:00:40.657 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:40.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:40.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:40.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 zonegroup default 2024-09-19T12:00:40.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.664+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.664+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.664+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.664+0000 7ff5d7db79c0 20 started sync module instance, tier type = 2024-09-19T12:00:40.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.664+0000 7ff5d7db79c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:40.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=0 2024-09-19T12:00:40.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=1 2024-09-19T12:00:40.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=2 2024-09-19T12:00:40.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=3 2024-09-19T12:00:40.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=4 2024-09-19T12:00:40.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=5 2024-09-19T12:00:40.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=6 2024-09-19T12:00:40.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=7 2024-09-19T12:00:40.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.688+0000 7ff5d7db79c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:40.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.692+0000 7ff4877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:40.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.692+0000 7ff5d7db79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:40.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.692+0000 7ff5d7db79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:40.690 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 5 note: GC not initialized 2024-09-19T12:00:40.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff4867fc640 20 reqs_thread_entry: start 2024-09-19T12:00:40.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:40.691 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 Filter name: none 2024-09-19T12:00:40.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff3f7fff640 20 reqs_thread_entry: start 2024-09-19T12:00:40.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:00:40.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:40.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:00:40.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:00:40.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:00:40.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.693 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:00:40.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:40.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:40.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:00:40.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:40.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:00:40.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.704+0000 7ff5d7db79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:40.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.704+0000 7ff5d7db79c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:40.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.704+0000 7ff5d7db79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:40.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.704+0000 7ff5d7db79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T12:00:40.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.704+0000 7ff4b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366217 cookie 94128137113200 notifier 7748 bl.length()=911 2024-09-19T12:00:40.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.704+0000 7ff4b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:40.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.704+0000 7ff4b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:40.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.704+0000 7ff4b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:40.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.704+0000 7ff5d7db79c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T12:00:40.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.704+0000 7ff5d7db79c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T12:00:40.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.704+0000 7ff5d7db79c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T12:00:40.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.704+0000 7ff5d7db79c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T12:00:40.707 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff5d7db79c0 time 2024-09-19T12:00:40.715663+0000 2024-09-19T12:00:40.707 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:00:40.708 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:40.709 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff5db6912eb] 2024-09-19T12:00:40.709 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff5db69149f] 2024-09-19T12:00:40.709 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559be82c2271] 2024-09-19T12:00:40.709 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559be82d214a] 2024-09-19T12:00:40.709 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T12:00:40.709 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff5da4f7d90] 2024-09-19T12:00:40.709 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T12:00:40.709 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T12:00:40.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.712+0000 7ff5d7db79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff5d7db79c0 time 2024-09-19T12:00:40.715663+0000 2024-09-19T12:00:40.709 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:00:40.709 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.709 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:40.710 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff5db6912eb] 2024-09-19T12:00:40.710 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff5db69149f] 2024-09-19T12:00:40.710 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559be82c2271] 2024-09-19T12:00:40.710 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559be82d214a] 2024-09-19T12:00:40.710 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T12:00:40.710 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff5da4f7d90] 2024-09-19T12:00:40.710 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T12:00:40.710 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T12:00:40.710 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.710 INFO:tasks.workunit.client.0.smithi120.stderr:*** Caught signal (Aborted) ** 2024-09-19T12:00:40.710 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7ff5d7db79c0 thread_name:radosgw-admin 2024-09-19T12:00:40.726 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:40.726 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff5da510520] 2024-09-19T12:00:40.727 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:00:40.727 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:00:40.727 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:00:40.727 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff5db691345] 2024-09-19T12:00:40.727 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff5db69149f] 2024-09-19T12:00:40.727 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559be82c2271] 2024-09-19T12:00:40.727 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559be82d214a] 2024-09-19T12:00:40.727 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T12:00:40.727 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff5da4f7d90] 2024-09-19T12:00:40.727 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T12:00:40.727 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T12:00:40.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.712+0000 7ff5d7db79c0 -1 *** Caught signal (Aborted) ** 2024-09-19T12:00:40.728 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7ff5d7db79c0 thread_name:radosgw-admin 2024-09-19T12:00:40.728 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.728 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:40.728 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff5da510520] 2024-09-19T12:00:40.728 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:00:40.728 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:00:40.728 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:00:40.728 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff5db691345] 2024-09-19T12:00:40.728 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff5db69149f] 2024-09-19T12:00:40.728 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559be82c2271] 2024-09-19T12:00:40.728 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559be82d214a] 2024-09-19T12:00:40.728 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T12:00:40.728 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff5da4f7d90] 2024-09-19T12:00:40.728 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T12:00:40.729 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T12:00:40.729 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T12:00:40.729 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.729 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T12:00:40.729 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T12:00:40.400+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.729 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T12:00:40.400+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.729 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T12:00:40.400+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_done global_id 8340 payload 274 2024-09-19T12:00:40.729 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T12:00:40.400+0000 7ff5d50bc640 10 monclient: _finish_hunting 0 2024-09-19T12:00:40.729 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T12:00:40.400+0000 7ff5d50bc640 1 monclient: found mon.noname-a 2024-09-19T12:00:40.729 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T12:00:40.400+0000 7ff5d50bc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:00:40.729 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.729 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:00:40.729 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: dump: 2024-09-19T12:00:40.730 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.730 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.730 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.730 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.730 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.730 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.730 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.730 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.730 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.730 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.730 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: _finish_auth 0 2024-09-19T12:00:40.730 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: _check_auth_tickets 2024-09-19T12:00:40.730 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:40.730 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.730 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: dump: 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 monclient: authenticate success, global_id 8340 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 10 monclient: get_monmap_and_config success 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 4 set_mon_vals no callback set 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 10 monclient: shutdown 2024-09-19T12:00:40.731 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) unregister_commands rotate-key 2024-09-19T12:00:40.732 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 10 monclient: build_initial_monmap 2024-09-19T12:00:40.732 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:40.732 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 10 monclient: monmap: 2024-09-19T12:00:40.732 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:40.732 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:40.732 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:40.732 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:40.732 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:40.732 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.732 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:40.732 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:40.732 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:40.732 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.733 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding auth protocol: cephx 2024-09-19T12:00:40.733 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding auth protocol: cephx 2024-09-19T12:00:40.733 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding auth protocol: cephx 2024-09-19T12:00:40.733 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: secure 2024-09-19T12:00:40.733 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: crc 2024-09-19T12:00:40.733 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: secure 2024-09-19T12:00:40.733 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: crc 2024-09-19T12:00:40.733 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: secure 2024-09-19T12:00:40.733 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: crc 2024-09-19T12:00:40.733 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: crc 2024-09-19T12:00:40.734 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: secure 2024-09-19T12:00:40.734 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: crc 2024-09-19T12:00:40.734 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: secure 2024-09-19T12:00:40.734 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: crc 2024-09-19T12:00:40.734 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: secure 2024-09-19T12:00:40.734 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.734 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 1 librados: starting msgr at 2024-09-19T12:00:40.734 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 1 librados: starting objecter 2024-09-19T12:00:40.734 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command objecter_requests hook 0x559bea200f70 2024-09-19T12:00:40.734 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 1 librados: setting wanted keys 2024-09-19T12:00:40.734 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 1 librados: calling monclient init 2024-09-19T12:00:40.734 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 10 monclient: init 2024-09-19T12:00:40.734 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding auth protocol: cephx 2024-09-19T12:00:40.734 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding auth protocol: cephx 2024-09-19T12:00:40.735 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding auth protocol: cephx 2024-09-19T12:00:40.735 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: secure 2024-09-19T12:00:40.735 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: crc 2024-09-19T12:00:40.735 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: secure 2024-09-19T12:00:40.735 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: crc 2024-09-19T12:00:40.735 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: secure 2024-09-19T12:00:40.735 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: crc 2024-09-19T12:00:40.735 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: crc 2024-09-19T12:00:40.735 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: secure 2024-09-19T12:00:40.735 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: crc 2024-09-19T12:00:40.735 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: secure 2024-09-19T12:00:40.735 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: crc 2024-09-19T12:00:40.735 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: secure 2024-09-19T12:00:40.736 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.736 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.736 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command rotate-key hook 0x559bea1d25d8 2024-09-19T12:00:40.736 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:40.736 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T12:00:40.736 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-a con 0x559bea05fce0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:40.736 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-b con 0x559bea08c590 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:40.736 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-c con 0x559bea117bd0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:40.736 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.736 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.736 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.737 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:40.737 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): authenticate will time out at 2534.720476s 2024-09-19T12:00:40.737 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request con 0x559bea05fce0 auth_method 0 2024-09-19T12:00:40.737 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.737 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.737 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.737 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient(hunting): get_auth_request con 0x559bea117bd0 auth_method 0 2024-09-19T12:00:40.737 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.737 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.737 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.737 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.737 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.737 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.738 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.738 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.738 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.738 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_done global_id 8343 payload 824 2024-09-19T12:00:40.738 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient: _finish_hunting 0 2024-09-19T12:00:40.738 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 1 monclient: found mon.noname-a 2024-09-19T12:00:40.738 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:00:40.738 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T12:00:40.404+0000 7ff5d50bc640 10 monclient: get_auth_request con 0x559bea08c590 auth_method 0 2024-09-19T12:00:40.738 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.738 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:00:40.738 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: dump: 2024-09-19T12:00:40.738 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.738 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.738 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.739 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.739 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.739 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.739 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.739 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.739 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.739 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.739 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: _finish_auth 0 2024-09-19T12:00:40.739 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: _check_auth_tickets 2024-09-19T12:00:40.739 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:40.739 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.739 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:00:40.739 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: dump: 2024-09-19T12:00:40.739 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.740 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.740 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.740 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.740 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.740 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.740 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.740 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.740 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.740 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.740 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 5 monclient: authenticate success, global_id 8343 2024-09-19T12:00:40.740 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T12:00:40.404+0000 7ff4c3e07640 4 set_mon_vals no callback set 2024-09-19T12:00:40.740 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient: _renew_subs 2024-09-19T12:00:40.740 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:00:40.740 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient: _renew_subs 2024-09-19T12:00:40.741 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:00:40.741 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 1 librados: init done 2024-09-19T12:00:40.741 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T12:00:40.404+0000 7ff4c2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:00:40.741 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T12:00:40.404+0000 7ff4c2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:40.741 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T12:00:40.404+0000 7ff4c2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:40.741 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T12:00:40.404+0000 7ff5d50bc640 10 monclient: get_auth_request con 0x7ff4bc071be0 auth_method 0 2024-09-19T12:00:40.741 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient: get_auth_request con 0x559bea1fe360 auth_method 0 2024-09-19T12:00:40.741 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T12:00:40.408+0000 7ff5d58bd640 10 monclient: get_auth_request con 0x559bea21d040 auth_method 0 2024-09-19T12:00:40.741 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T12:00:40.408+0000 7ff5d50bc640 10 monclient: get_auth_request con 0x559bea2216e0 auth_method 0 2024-09-19T12:00:40.741 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient: get_auth_request con 0x559bea220dc0 auth_method 0 2024-09-19T12:00:40.741 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: build_initial_monmap 2024-09-19T12:00:40.741 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:40.741 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: monmap: 2024-09-19T12:00:40.742 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:40.742 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:40.742 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:40.742 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:40.742 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:40.742 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.742 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:40.742 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:40.742 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:40.742 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.742 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding auth protocol: cephx 2024-09-19T12:00:40.742 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding auth protocol: cephx 2024-09-19T12:00:40.742 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding auth protocol: cephx 2024-09-19T12:00:40.743 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: secure 2024-09-19T12:00:40.743 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: crc 2024-09-19T12:00:40.743 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: secure 2024-09-19T12:00:40.743 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: crc 2024-09-19T12:00:40.743 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: secure 2024-09-19T12:00:40.743 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: crc 2024-09-19T12:00:40.743 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: crc 2024-09-19T12:00:40.743 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: secure 2024-09-19T12:00:40.743 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: crc 2024-09-19T12:00:40.743 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: secure 2024-09-19T12:00:40.743 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: crc 2024-09-19T12:00:40.743 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: secure 2024-09-19T12:00:40.743 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.743 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command objecter_requests cmddesc objecter_requests hook 0x559bea22d090 EEXIST 2024-09-19T12:00:40.744 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: init 2024-09-19T12:00:40.744 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding auth protocol: cephx 2024-09-19T12:00:40.744 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding auth protocol: cephx 2024-09-19T12:00:40.744 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding auth protocol: cephx 2024-09-19T12:00:40.744 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: secure 2024-09-19T12:00:40.744 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: crc 2024-09-19T12:00:40.744 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: secure 2024-09-19T12:00:40.744 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: crc 2024-09-19T12:00:40.744 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: secure 2024-09-19T12:00:40.744 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: crc 2024-09-19T12:00:40.744 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: crc 2024-09-19T12:00:40.744 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: secure 2024-09-19T12:00:40.745 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: crc 2024-09-19T12:00:40.745 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: secure 2024-09-19T12:00:40.745 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: crc 2024-09-19T12:00:40.745 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: secure 2024-09-19T12:00:40.745 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.745 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.745 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command rotate-key cmddesc rotate-key hook 0x559bea228780 EEXIST 2024-09-19T12:00:40.745 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:40.745 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T12:00:40.745 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-c con 0x559bea251240 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:40.745 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-a con 0x559bea250b70 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:40.745 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-b con 0x559bea24f550 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:40.745 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.746 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.746 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.746 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:40.746 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): authenticate will time out at 2534.730817s 2024-09-19T12:00:40.746 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): get_auth_request con 0x559bea251240 auth_method 0 2024-09-19T12:00:40.746 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.746 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.746 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.746 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient(hunting): get_auth_request con 0x559bea250b70 auth_method 0 2024-09-19T12:00:40.746 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.746 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.746 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.746 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.746 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.747 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.747 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.747 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.747 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.747 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T12:00:40.412+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request con 0x559bea24f550 auth_method 0 2024-09-19T12:00:40.747 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T12:00:40.412+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.747 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T12:00:40.412+0000 7ff5d58bd640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.747 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T12:00:40.412+0000 7ff5d58bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.747 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_done global_id 7742 payload 824 2024-09-19T12:00:40.747 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient: _finish_hunting 0 2024-09-19T12:00:40.747 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 1 monclient: found mon.noname-c 2024-09-19T12:00:40.747 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.747 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.748 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:00:40.748 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: dump: 2024-09-19T12:00:40.748 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.748 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.748 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.748 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.748 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.748 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.748 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.748 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.748 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.748 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.748 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: _finish_auth 0 2024-09-19T12:00:40.748 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: _check_auth_tickets 2024-09-19T12:00:40.749 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:40.749 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.749 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:00:40.749 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: dump: 2024-09-19T12:00:40.749 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.749 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.749 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.749 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.749 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.749 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.749 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.749 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.749 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.749 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.750 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 monclient: authenticate success, global_id 7742 2024-09-19T12:00:40.750 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: _renew_subs 2024-09-19T12:00:40.750 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T12:00:40.412+0000 7ff5d68bf640 4 set_mon_vals no callback set 2024-09-19T12:00:40.750 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.750 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: _renew_subs 2024-09-19T12:00:40.750 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.750 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T12:00:40.416+0000 7ff4bb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:00:40.750 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T12:00:40.416+0000 7ff4bb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:40.750 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T12:00:40.416+0000 7ff4bb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:40.750 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient: get_monmap_and_config 2024-09-19T12:00:40.750 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient: build_initial_monmap 2024-09-19T12:00:40.750 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:40.750 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient: monmap: 2024-09-19T12:00:40.750 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:40.751 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:40.751 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:40.751 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:40.751 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:40.751 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.751 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:40.751 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:40.751 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:40.751 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.751 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding auth protocol: cephx 2024-09-19T12:00:40.751 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding auth protocol: cephx 2024-09-19T12:00:40.751 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding auth protocol: cephx 2024-09-19T12:00:40.751 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: secure 2024-09-19T12:00:40.751 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: crc 2024-09-19T12:00:40.752 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: secure 2024-09-19T12:00:40.752 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: crc 2024-09-19T12:00:40.752 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: secure 2024-09-19T12:00:40.752 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: crc 2024-09-19T12:00:40.752 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: crc 2024-09-19T12:00:40.752 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: secure 2024-09-19T12:00:40.752 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: crc 2024-09-19T12:00:40.752 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: secure 2024-09-19T12:00:40.752 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: crc 2024-09-19T12:00:40.752 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: secure 2024-09-19T12:00:40.752 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T12:00:40.416+0000 7ff5d60be640 10 monclient: get_auth_request con 0x7ff4b0071b20 auth_method 0 2024-09-19T12:00:40.752 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.752 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient: init 2024-09-19T12:00:40.752 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding auth protocol: cephx 2024-09-19T12:00:40.753 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding auth protocol: cephx 2024-09-19T12:00:40.753 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding auth protocol: cephx 2024-09-19T12:00:40.753 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: secure 2024-09-19T12:00:40.753 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: crc 2024-09-19T12:00:40.753 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: secure 2024-09-19T12:00:40.753 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: crc 2024-09-19T12:00:40.753 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: secure 2024-09-19T12:00:40.753 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: crc 2024-09-19T12:00:40.753 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: crc 2024-09-19T12:00:40.753 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: secure 2024-09-19T12:00:40.753 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: crc 2024-09-19T12:00:40.753 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: secure 2024-09-19T12:00:40.753 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: crc 2024-09-19T12:00:40.753 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: secure 2024-09-19T12:00:40.754 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.754 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.754 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command rotate-key cmddesc rotate-key hook 0x7ffcf90925a8 EEXIST 2024-09-19T12:00:40.754 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:40.754 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T12:00:40.754 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-a con 0x559bea2a4ff0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:40.754 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-b con 0x559bea275ff0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:40.754 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-c con 0x559bea29f5a0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:40.754 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.754 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.754 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.754 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:40.754 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): authenticate will time out at 2534.735094s 2024-09-19T12:00:40.755 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T12:00:40.416+0000 7ff5d50bc640 10 monclient(hunting): get_auth_request con 0x559bea2a4ff0 auth_method 0 2024-09-19T12:00:40.755 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T12:00:40.416+0000 7ff5d50bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.755 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T12:00:40.416+0000 7ff5d50bc640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.755 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T12:00:40.416+0000 7ff5d50bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.755 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request con 0x559bea29f5a0 auth_method 0 2024-09-19T12:00:40.755 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.755 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.755 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.755 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.755 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.755 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.755 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T12:00:40.416+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.755 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T12:00:40.416+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.755 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T12:00:40.416+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.756 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_done global_id 7745 payload 274 2024-09-19T12:00:40.756 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient: _finish_hunting 0 2024-09-19T12:00:40.756 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 1 monclient: found mon.noname-c 2024-09-19T12:00:40.756 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.756 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.756 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:00:40.756 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: dump: 2024-09-19T12:00:40.756 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.756 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.756 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.756 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.756 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.756 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.757 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.757 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.757 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.757 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.757 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: _finish_auth 0 2024-09-19T12:00:40.757 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: _check_auth_tickets 2024-09-19T12:00:40.757 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:40.757 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 monclient: authenticate success, global_id 7745 2024-09-19T12:00:40.757 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient: get_monmap_and_config success 2024-09-19T12:00:40.758 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 4 set_mon_vals no callback set 2024-09-19T12:00:40.758 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.758 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:00:40.758 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: dump: 2024-09-19T12:00:40.758 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.758 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.758 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.758 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.758 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.758 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.758 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.758 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.758 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.758 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.759 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: shutdown 2024-09-19T12:00:40.759 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: build_initial_monmap 2024-09-19T12:00:40.759 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:40.759 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: monmap: 2024-09-19T12:00:40.759 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:40.759 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:40.759 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:40.759 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:40.759 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:40.759 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.759 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:40.759 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:40.759 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:40.760 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.760 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding auth protocol: cephx 2024-09-19T12:00:40.760 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding auth protocol: cephx 2024-09-19T12:00:40.760 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding auth protocol: cephx 2024-09-19T12:00:40.760 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: secure 2024-09-19T12:00:40.760 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: crc 2024-09-19T12:00:40.760 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: secure 2024-09-19T12:00:40.760 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: crc 2024-09-19T12:00:40.760 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: secure 2024-09-19T12:00:40.760 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: crc 2024-09-19T12:00:40.760 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: crc 2024-09-19T12:00:40.760 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: secure 2024-09-19T12:00:40.760 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: crc 2024-09-19T12:00:40.760 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: secure 2024-09-19T12:00:40.760 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: crc 2024-09-19T12:00:40.761 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: secure 2024-09-19T12:00:40.761 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.761 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 1 librados: starting msgr at 2024-09-19T12:00:40.761 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 1 librados: starting objecter 2024-09-19T12:00:40.761 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command objecter_requests cmddesc objecter_requests hook 0x559bea29b670 EEXIST 2024-09-19T12:00:40.761 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 1 librados: setting wanted keys 2024-09-19T12:00:40.761 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 1 librados: calling monclient init 2024-09-19T12:00:40.761 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: init 2024-09-19T12:00:40.761 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding auth protocol: cephx 2024-09-19T12:00:40.761 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding auth protocol: cephx 2024-09-19T12:00:40.761 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding auth protocol: cephx 2024-09-19T12:00:40.761 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: secure 2024-09-19T12:00:40.761 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: crc 2024-09-19T12:00:40.761 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: secure 2024-09-19T12:00:40.762 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: crc 2024-09-19T12:00:40.762 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: secure 2024-09-19T12:00:40.762 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: crc 2024-09-19T12:00:40.762 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: crc 2024-09-19T12:00:40.762 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: secure 2024-09-19T12:00:40.762 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: crc 2024-09-19T12:00:40.762 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: secure 2024-09-19T12:00:40.762 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: crc 2024-09-19T12:00:40.762 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: secure 2024-09-19T12:00:40.762 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.762 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.762 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command rotate-key cmddesc rotate-key hook 0x559bea2531a8 EEXIST 2024-09-19T12:00:40.762 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:40.762 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T12:00:40.763 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-b con 0x559bea275ff0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:40.763 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-c con 0x559bea29f5a0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:40.763 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-a con 0x559bea2a4ff0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:40.763 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.763 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.763 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.763 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:40.763 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): authenticate will time out at 2534.737613s 2024-09-19T12:00:40.763 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): get_auth_request con 0x559bea29f5a0 auth_method 0 2024-09-19T12:00:40.763 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.763 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.763 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.763 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T12:00:40.420+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request con 0x559bea2a4ff0 auth_method 0 2024-09-19T12:00:40.763 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T12:00:40.420+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.764 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T12:00:40.420+0000 7ff5d58bd640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.764 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T12:00:40.420+0000 7ff5d58bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.764 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.764 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.764 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.764 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T12:00:40.420+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.764 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T12:00:40.420+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.764 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T12:00:40.420+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.764 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): handle_auth_done global_id 7748 payload 824 2024-09-19T12:00:40.764 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient: _finish_hunting 0 2024-09-19T12:00:40.764 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T12:00:40.420+0000 7ff5d60be640 1 monclient: found mon.noname-c 2024-09-19T12:00:40.764 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.764 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.764 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:00:40.765 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: dump: 2024-09-19T12:00:40.765 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.765 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.765 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.765 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.765 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.765 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.765 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.765 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.765 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.765 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.765 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: _finish_auth 0 2024-09-19T12:00:40.765 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: _check_auth_tickets 2024-09-19T12:00:40.766 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:40.766 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.766 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:00:40.766 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: dump: 2024-09-19T12:00:40.766 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.766 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.766 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.766 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.766 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.766 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.766 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.766 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.766 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.766 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.767 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 monclient: authenticate success, global_id 7748 2024-09-19T12:00:40.767 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: _renew_subs 2024-09-19T12:00:40.767 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T12:00:40.420+0000 7ff4b97fa640 4 set_mon_vals no callback set 2024-09-19T12:00:40.767 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.767 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: _renew_subs 2024-09-19T12:00:40.767 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.767 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 1 librados: init done 2024-09-19T12:00:40.767 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command cr dump hook 0x559bea29c2d8 2024-09-19T12:00:40.767 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.767 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T12:00:40.424+0000 7ff4a77fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:00:40.767 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T12:00:40.424+0000 7ff4a77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:40.767 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T12:00:40.424+0000 7ff4a77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:40.767 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T12:00:40.424+0000 7ff5d58bd640 10 monclient: get_auth_request con 0x559bea2be960 auth_method 0 2024-09-19T12:00:40.767 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T12:00:40.424+0000 7ff5d50bc640 10 monclient: get_auth_request con 0x7ff4a0071be0 auth_method 0 2024-09-19T12:00:40.767 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.768 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 realm 2024-09-19T12:00:40.768 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.768 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.768 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:40.768 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.768 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.768 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.768 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T12:00:40.424+0000 7ff5d50bc640 10 monclient: get_auth_request con 0x559bea2c2a30 auth_method 0 2024-09-19T12:00:40.768 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:40.768 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.768 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T12:00:40.428+0000 7ff5d60be640 10 monclient: get_auth_request con 0x559bea2c6320 auth_method 0 2024-09-19T12:00:40.768 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T12:00:40.428+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:40.768 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T12:00:40.428+0000 7ff5d7db79c0 20 searching for the correct realm 2024-09-19T12:00:40.768 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T12:00:40.428+0000 7ff5d58bd640 10 monclient: get_auth_request con 0x559bea2cb0e0 auth_method 0 2024-09-19T12:00:40.769 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T12:00:40.428+0000 7ff5d50bc640 10 monclient: get_auth_request con 0x7ff5c810ea50 auth_method 0 2024-09-19T12:00:40.769 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T12:00:40.432+0000 7ff5d60be640 10 monclient: get_auth_request con 0x7ff5cc008050 auth_method 0 2024-09-19T12:00:40.769 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T12:00:40.432+0000 7ff5d58bd640 10 monclient: get_auth_request con 0x7ff5d0029070 auth_method 0 2024-09-19T12:00:40.769 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T12:00:40.432+0000 7ff5d58bd640 0 -- 172.21.15.120:0/2496266365 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff5d0029070 msgr2=0x7ff5d0067010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:40.769 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T12:00:40.636+0000 7ff5d58bd640 10 monclient: get_auth_request con 0x7ff5d0029070 auth_method 0 2024-09-19T12:00:40.769 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T12:00:40.644+0000 7ff5d50bc640 10 monclient: get_auth_request con 0x7ff5c812d970 auth_method 0 2024-09-19T12:00:40.769 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T12:00:40.648+0000 7ff5d58bd640 0 -- 172.21.15.120:0/2496266365 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff5d0029070 msgr2=0x7ff5d0067010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:40.769 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T12:00:40.648+0000 7ff4a77fe640 1 client.7748.objecter ms_handle_reset 0x7ff5d0029070 session 0x7ff5d0016040 osd.4 2024-09-19T12:00:40.769 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T12:00:40.648+0000 7ff4a77fe640 10 monclient: _renew_subs 2024-09-19T12:00:40.769 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T12:00:40.648+0000 7ff4a77fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.769 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T12:00:40.648+0000 7ff5d58bd640 10 monclient: get_auth_request con 0x7ff4a0082280 auth_method 0 2024-09-19T12:00:40.769 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:40.769 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:40.769 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:40.770 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:40.770 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:40.770 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:40.770 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.770 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.770 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.770 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:40.770 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.770 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:40.770 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 zone default found 2024-09-19T12:00:40.770 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 4 Realm: () 2024-09-19T12:00:40.770 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:40.772 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:40.772 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:40.772 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 zonegroup default 2024-09-19T12:00:40.772 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.772 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.772 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.772 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T12:00:40.664+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.772 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T12:00:40.664+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.772 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T12:00:40.664+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.772 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T12:00:40.664+0000 7ff5d7db79c0 20 started sync module instance, tier type = 2024-09-19T12:00:40.772 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T12:00:40.664+0000 7ff5d7db79c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:40.773 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=0 2024-09-19T12:00:40.773 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=1 2024-09-19T12:00:40.773 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=2 2024-09-19T12:00:40.773 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=3 2024-09-19T12:00:40.773 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=4 2024-09-19T12:00:40.773 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=5 2024-09-19T12:00:40.773 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=6 2024-09-19T12:00:40.773 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=7 2024-09-19T12:00:40.773 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:40.773 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding auth protocol: cephx 2024-09-19T12:00:40.773 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding auth protocol: cephx 2024-09-19T12:00:40.773 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding auth protocol: cephx 2024-09-19T12:00:40.773 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: secure 2024-09-19T12:00:40.773 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: crc 2024-09-19T12:00:40.774 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: secure 2024-09-19T12:00:40.774 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: crc 2024-09-19T12:00:40.774 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: secure 2024-09-19T12:00:40.774 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: crc 2024-09-19T12:00:40.774 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T12:00:40.692+0000 7ff4877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:40.774 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: crc 2024-09-19T12:00:40.774 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: secure 2024-09-19T12:00:40.774 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: crc 2024-09-19T12:00:40.774 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: secure 2024-09-19T12:00:40.774 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: crc 2024-09-19T12:00:40.774 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: secure 2024-09-19T12:00:40.774 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.774 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:40.774 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:40.775 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command cache list hook 0x559bea29dab0 2024-09-19T12:00:40.775 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command cache inspect hook 0x559bea29dab0 2024-09-19T12:00:40.775 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command cache erase hook 0x559bea29dab0 2024-09-19T12:00:40.775 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command cache zap hook 0x559bea29dab0 2024-09-19T12:00:40.775 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 5 note: GC not initialized 2024-09-19T12:00:40.775 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T12:00:40.696+0000 7ff4867fc640 20 reqs_thread_entry: start 2024-09-19T12:00:40.775 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command sync trace show hook 0x7ff5c80c3020 2024-09-19T12:00:40.775 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command sync trace history hook 0x7ff5c80c3020 2024-09-19T12:00:40.775 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command sync trace active hook 0x7ff5c80c3020 2024-09-19T12:00:40.775 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command sync trace active_short hook 0x7ff5c80c3020 2024-09-19T12:00:40.775 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:40.775 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 Filter name: none 2024-09-19T12:00:40.775 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T12:00:40.696+0000 7ff3f7fff640 20 reqs_thread_entry: start 2024-09-19T12:00:40.775 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:00:40.776 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.776 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:40.776 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:00:40.776 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:00:40.776 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:00:40.776 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.776 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:00:40.776 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:40.776 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:40.776 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:00:40.776 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:40.776 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:00:40.776 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:40.777 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:40.777 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:40.777 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T12:00:40.777 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T12:00:40.704+0000 7ff4b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366217 cookie 94128137113200 notifier 7748 bl.length()=911 2024-09-19T12:00:40.777 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T12:00:40.704+0000 7ff4b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:40.777 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T12:00:40.704+0000 7ff4b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:40.777 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T12:00:40.704+0000 7ff4b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:40.777 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T12:00:40.777 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T12:00:40.777 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T12:00:40.777 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T12:00:40.777 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T12:00:40.712+0000 7ff5d7db79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff5d7db79c0 time 2024-09-19T12:00:40.715663+0000 2024-09-19T12:00:40.777 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:00:40.777 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.778 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:40.778 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff5db6912eb] 2024-09-19T12:00:40.778 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff5db69149f] 2024-09-19T12:00:40.778 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559be82c2271] 2024-09-19T12:00:40.778 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559be82d214a] 2024-09-19T12:00:40.778 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T12:00:40.778 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff5da4f7d90] 2024-09-19T12:00:40.778 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T12:00:40.778 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T12:00:40.778 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.778 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T12:00:40.712+0000 7ff5d7db79c0 -1 *** Caught signal (Aborted) ** 2024-09-19T12:00:40.778 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7ff5d7db79c0 thread_name:radosgw-admin 2024-09-19T12:00:40.778 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.778 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:40.778 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff5da510520] 2024-09-19T12:00:40.779 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:00:40.779 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:00:40.779 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:00:40.779 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff5db691345] 2024-09-19T12:00:40.779 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff5db69149f] 2024-09-19T12:00:40.779 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559be82c2271] 2024-09-19T12:00:40.779 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559be82d214a] 2024-09-19T12:00:40.779 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T12:00:40.779 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff5da4f7d90] 2024-09-19T12:00:40.779 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T12:00:40.779 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T12:00:40.779 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T12:00:40.779 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.779 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T12:00:40.780 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T12:00:40.780 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T12:00:40.780 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T12:00:40.780 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T12:00:40.780 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T12:00:40.780 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T12:00:40.780 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T12:00:40.780 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T12:00:40.780 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T12:00:40.780 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T12:00:40.780 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T12:00:40.780 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T12:00:40.780 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T12:00:40.780 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T12:00:40.781 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T12:00:40.781 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T12:00:40.781 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T12:00:40.781 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T12:00:40.781 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T12:00:40.781 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T12:00:40.781 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T12:00:40.781 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T12:00:40.781 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T12:00:40.781 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T12:00:40.781 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T12:00:40.781 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T12:00:40.781 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T12:00:40.781 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T12:00:40.781 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T12:00:40.782 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T12:00:40.782 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T12:00:40.782 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T12:00:40.782 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T12:00:40.782 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T12:00:40.782 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T12:00:40.782 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T12:00:40.782 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T12:00:40.782 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T12:00:40.782 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T12:00:40.782 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T12:00:40.782 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T12:00:40.782 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T12:00:40.782 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T12:00:40.782 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T12:00:40.783 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T12:00:40.783 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T12:00:40.783 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T12:00:40.783 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T12:00:40.783 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T12:00:40.783 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T12:00:40.783 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T12:00:40.783 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T12:00:40.783 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T12:00:40.783 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T12:00:40.783 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T12:00:40.783 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T12:00:40.783 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T12:00:40.783 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T12:00:40.784 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T12:00:40.784 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T12:00:40.784 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T12:00:40.784 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T12:00:40.784 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T12:00:40.784 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T12:00:40.784 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T12:00:40.784 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T12:00:40.784 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T12:00:40.784 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T12:00:40.784 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T12:00:40.784 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T12:00:40.784 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T12:00:40.784 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T12:00:40.785 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T12:00:40.785 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T12:00:40.785 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T12:00:40.785 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T12:00:40.785 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T12:00:40.785 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T12:00:40.785 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T12:00:40.785 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T12:00:40.785 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T12:00:40.785 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T12:00:40.785 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T12:00:40.785 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T12:00:40.785 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T12:00:40.785 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T12:00:40.785 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T12:00:40.786 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T12:00:40.786 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T12:00:40.786 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T12:00:40.786 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T12:00:40.786 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T12:00:40.786 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T12:00:40.786 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff3f7fff640 / http_manager 2024-09-19T12:00:40.786 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4867fc640 / http_manager 2024-09-19T12:00:40.786 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4877fe640 / rgw_dt_lg_renew 2024-09-19T12:00:40.786 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4a77fe640 / ms_dispatch 2024-09-19T12:00:40.786 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4b97fa640 / io_context_pool 2024-09-19T12:00:40.786 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4bb7fe640 / ms_dispatch 2024-09-19T12:00:40.786 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4c2604640 / ms_dispatch 2024-09-19T12:00:40.786 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4c3e07640 / io_context_pool 2024-09-19T12:00:40.787 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff5d50bc640 / msgr-worker-2 2024-09-19T12:00:40.787 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff5d58bd640 / msgr-worker-1 2024-09-19T12:00:40.787 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff5d60be640 / msgr-worker-0 2024-09-19T12:00:40.787 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff5d68bf640 / io_context_pool 2024-09-19T12:00:40.787 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff5d7db79c0 / radosgw-admin 2024-09-19T12:00:40.787 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T12:00:40.787 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T12:00:40.787 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/log/ceph/ceph-client.admin.143493.log 2024-09-19T12:00:40.787 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T12:00:40.787 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T12:00:40.787 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T12:00:40.400+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.787 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T12:00:40.400+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.787 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T12:00:40.400+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_done global_id 8340 payload 274 2024-09-19T12:00:40.787 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T12:00:40.400+0000 7ff5d50bc640 10 monclient: _finish_hunting 0 2024-09-19T12:00:40.787 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T12:00:40.400+0000 7ff5d50bc640 1 monclient: found mon.noname-a 2024-09-19T12:00:40.788 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T12:00:40.400+0000 7ff5d50bc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:00:40.788 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.788 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:00:40.788 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: dump: 2024-09-19T12:00:40.788 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.788 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.788 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.788 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.788 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.788 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.788 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.788 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.788 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.788 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.789 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: _finish_auth 0 2024-09-19T12:00:40.789 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: _check_auth_tickets 2024-09-19T12:00:40.789 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:40.789 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.789 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:00:40.789 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T12:00:40.400+0000 7ff4c3e07640 10 monclient: dump: 2024-09-19T12:00:40.789 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.789 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.789 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.789 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.789 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.789 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.789 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.789 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.790 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.790 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.790 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 monclient: authenticate success, global_id 8340 2024-09-19T12:00:40.790 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 10 monclient: get_monmap_and_config success 2024-09-19T12:00:40.790 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 4 set_mon_vals no callback set 2024-09-19T12:00:40.790 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 10 monclient: shutdown 2024-09-19T12:00:40.790 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) unregister_commands rotate-key 2024-09-19T12:00:40.790 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 10 monclient: build_initial_monmap 2024-09-19T12:00:40.790 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:40.790 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 10 monclient: monmap: 2024-09-19T12:00:40.790 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:40.790 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:40.790 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:40.791 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:40.791 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:40.791 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.791 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:40.791 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:40.791 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:40.791 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.791 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding auth protocol: cephx 2024-09-19T12:00:40.791 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding auth protocol: cephx 2024-09-19T12:00:40.791 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding auth protocol: cephx 2024-09-19T12:00:40.791 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: secure 2024-09-19T12:00:40.791 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: crc 2024-09-19T12:00:40.791 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: secure 2024-09-19T12:00:40.791 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: crc 2024-09-19T12:00:40.792 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: secure 2024-09-19T12:00:40.792 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: crc 2024-09-19T12:00:40.792 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: crc 2024-09-19T12:00:40.792 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: secure 2024-09-19T12:00:40.792 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: crc 2024-09-19T12:00:40.792 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: secure 2024-09-19T12:00:40.792 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: crc 2024-09-19T12:00:40.792 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d7c70) adding con mode: secure 2024-09-19T12:00:40.792 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.792 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 1 librados: starting msgr at 2024-09-19T12:00:40.792 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 1 librados: starting objecter 2024-09-19T12:00:40.792 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command objecter_requests hook 0x559bea200f70 2024-09-19T12:00:40.792 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 1 librados: setting wanted keys 2024-09-19T12:00:40.792 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 1 librados: calling monclient init 2024-09-19T12:00:40.793 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 10 monclient: init 2024-09-19T12:00:40.793 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding auth protocol: cephx 2024-09-19T12:00:40.793 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding auth protocol: cephx 2024-09-19T12:00:40.793 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding auth protocol: cephx 2024-09-19T12:00:40.793 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: secure 2024-09-19T12:00:40.793 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: crc 2024-09-19T12:00:40.793 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: secure 2024-09-19T12:00:40.793 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: crc 2024-09-19T12:00:40.793 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: secure 2024-09-19T12:00:40.793 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: crc 2024-09-19T12:00:40.793 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: crc 2024-09-19T12:00:40.793 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: secure 2024-09-19T12:00:40.793 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: crc 2024-09-19T12:00:40.793 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: secure 2024-09-19T12:00:40.793 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: crc 2024-09-19T12:00:40.794 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T12:00:40.400+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea1d2490) adding con mode: secure 2024-09-19T12:00:40.794 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.794 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.794 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command rotate-key hook 0x559bea1d25d8 2024-09-19T12:00:40.794 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:40.794 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T12:00:40.794 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-a con 0x559bea05fce0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:40.794 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-b con 0x559bea08c590 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:40.794 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-c con 0x559bea117bd0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:40.794 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.794 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.794 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.794 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:40.794 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient(hunting): authenticate will time out at 2534.720476s 2024-09-19T12:00:40.795 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request con 0x559bea05fce0 auth_method 0 2024-09-19T12:00:40.795 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.795 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.795 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.795 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient(hunting): get_auth_request con 0x559bea117bd0 auth_method 0 2024-09-19T12:00:40.795 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.795 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.795 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.795 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.795 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.795 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.795 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.795 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.795 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.795 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_done global_id 8343 payload 824 2024-09-19T12:00:40.796 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient: _finish_hunting 0 2024-09-19T12:00:40.796 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 1 monclient: found mon.noname-a 2024-09-19T12:00:40.796 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T12:00:40.404+0000 7ff5d58bd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:00:40.796 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T12:00:40.404+0000 7ff5d50bc640 10 monclient: get_auth_request con 0x559bea08c590 auth_method 0 2024-09-19T12:00:40.796 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.796 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:00:40.796 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: dump: 2024-09-19T12:00:40.796 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.796 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.796 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.796 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.796 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.796 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.797 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.797 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.797 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.797 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.797 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: _finish_auth 0 2024-09-19T12:00:40.797 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: _check_auth_tickets 2024-09-19T12:00:40.797 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:40.797 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.797 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:00:40.797 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T12:00:40.404+0000 7ff4c2604640 10 monclient: dump: 2024-09-19T12:00:40.797 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.797 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.797 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.797 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.797 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.798 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.798 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.798 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.798 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.798 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.798 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 5 monclient: authenticate success, global_id 8343 2024-09-19T12:00:40.798 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T12:00:40.404+0000 7ff4c3e07640 4 set_mon_vals no callback set 2024-09-19T12:00:40.798 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient: _renew_subs 2024-09-19T12:00:40.798 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:00:40.798 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient: _renew_subs 2024-09-19T12:00:40.798 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:00:40.798 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T12:00:40.404+0000 7ff5d7db79c0 1 librados: init done 2024-09-19T12:00:40.798 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T12:00:40.404+0000 7ff4c2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:00:40.798 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T12:00:40.404+0000 7ff4c2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:40.798 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T12:00:40.404+0000 7ff4c2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:40.799 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T12:00:40.404+0000 7ff5d50bc640 10 monclient: get_auth_request con 0x7ff4bc071be0 auth_method 0 2024-09-19T12:00:40.799 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T12:00:40.404+0000 7ff5d60be640 10 monclient: get_auth_request con 0x559bea1fe360 auth_method 0 2024-09-19T12:00:40.799 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T12:00:40.408+0000 7ff5d58bd640 10 monclient: get_auth_request con 0x559bea21d040 auth_method 0 2024-09-19T12:00:40.799 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T12:00:40.408+0000 7ff5d50bc640 10 monclient: get_auth_request con 0x559bea2216e0 auth_method 0 2024-09-19T12:00:40.799 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient: get_auth_request con 0x559bea220dc0 auth_method 0 2024-09-19T12:00:40.799 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: build_initial_monmap 2024-09-19T12:00:40.799 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:40.799 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: monmap: 2024-09-19T12:00:40.799 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:40.799 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:40.799 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:40.799 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:40.799 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:40.799 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.800 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:40.800 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:40.800 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:40.800 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.800 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding auth protocol: cephx 2024-09-19T12:00:40.800 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding auth protocol: cephx 2024-09-19T12:00:40.800 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding auth protocol: cephx 2024-09-19T12:00:40.800 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: secure 2024-09-19T12:00:40.800 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: crc 2024-09-19T12:00:40.800 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: secure 2024-09-19T12:00:40.800 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: crc 2024-09-19T12:00:40.800 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: secure 2024-09-19T12:00:40.800 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: crc 2024-09-19T12:00:40.800 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: crc 2024-09-19T12:00:40.801 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: secure 2024-09-19T12:00:40.801 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: crc 2024-09-19T12:00:40.801 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: secure 2024-09-19T12:00:40.801 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: crc 2024-09-19T12:00:40.801 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2296f0) adding con mode: secure 2024-09-19T12:00:40.801 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.801 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command objecter_requests cmddesc objecter_requests hook 0x559bea22d090 EEXIST 2024-09-19T12:00:40.801 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: init 2024-09-19T12:00:40.801 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding auth protocol: cephx 2024-09-19T12:00:40.801 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding auth protocol: cephx 2024-09-19T12:00:40.801 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding auth protocol: cephx 2024-09-19T12:00:40.801 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: secure 2024-09-19T12:00:40.801 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: crc 2024-09-19T12:00:40.801 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: secure 2024-09-19T12:00:40.802 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: crc 2024-09-19T12:00:40.802 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: secure 2024-09-19T12:00:40.802 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: crc 2024-09-19T12:00:40.802 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: crc 2024-09-19T12:00:40.802 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: secure 2024-09-19T12:00:40.802 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: crc 2024-09-19T12:00:40.802 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: secure 2024-09-19T12:00:40.802 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: crc 2024-09-19T12:00:40.802 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea228638) adding con mode: secure 2024-09-19T12:00:40.802 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.802 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.802 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command rotate-key cmddesc rotate-key hook 0x559bea228780 EEXIST 2024-09-19T12:00:40.802 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:40.802 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T12:00:40.803 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-c con 0x559bea251240 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:40.803 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-a con 0x559bea250b70 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:40.803 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-b con 0x559bea24f550 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:40.803 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.803 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.803 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.803 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:40.803 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient(hunting): authenticate will time out at 2534.730817s 2024-09-19T12:00:40.803 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): get_auth_request con 0x559bea251240 auth_method 0 2024-09-19T12:00:40.803 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.803 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.803 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.803 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient(hunting): get_auth_request con 0x559bea250b70 auth_method 0 2024-09-19T12:00:40.803 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.804 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.804 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.804 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.804 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.804 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.804 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.804 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.804 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T12:00:40.412+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.804 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T12:00:40.412+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request con 0x559bea24f550 auth_method 0 2024-09-19T12:00:40.804 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T12:00:40.412+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.804 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T12:00:40.412+0000 7ff5d58bd640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.804 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T12:00:40.412+0000 7ff5d58bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.804 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_done global_id 7742 payload 824 2024-09-19T12:00:40.804 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient: _finish_hunting 0 2024-09-19T12:00:40.805 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 1 monclient: found mon.noname-c 2024-09-19T12:00:40.805 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T12:00:40.412+0000 7ff5d50bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.805 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.805 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:00:40.805 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: dump: 2024-09-19T12:00:40.805 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.805 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.805 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.805 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.805 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.805 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.805 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.805 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.805 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.806 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.806 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: _finish_auth 0 2024-09-19T12:00:40.806 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: _check_auth_tickets 2024-09-19T12:00:40.806 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:40.806 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.806 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:00:40.806 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T12:00:40.412+0000 7ff4bb7fe640 10 monclient: dump: 2024-09-19T12:00:40.806 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.806 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.806 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.806 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.806 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.806 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.806 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.806 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.807 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.807 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.807 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 5 monclient: authenticate success, global_id 7742 2024-09-19T12:00:40.807 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: _renew_subs 2024-09-19T12:00:40.807 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T12:00:40.412+0000 7ff5d68bf640 4 set_mon_vals no callback set 2024-09-19T12:00:40.807 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.807 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: _renew_subs 2024-09-19T12:00:40.807 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T12:00:40.412+0000 7ff5d7db79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.807 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T12:00:40.416+0000 7ff4bb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:00:40.807 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T12:00:40.416+0000 7ff4bb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:40.807 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T12:00:40.416+0000 7ff4bb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:40.807 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient: get_monmap_and_config 2024-09-19T12:00:40.807 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient: build_initial_monmap 2024-09-19T12:00:40.807 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:40.808 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient: monmap: 2024-09-19T12:00:40.808 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:40.808 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:40.808 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:40.808 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:40.808 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:40.808 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.808 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:40.808 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:40.808 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:40.808 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.808 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding auth protocol: cephx 2024-09-19T12:00:40.808 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding auth protocol: cephx 2024-09-19T12:00:40.809 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding auth protocol: cephx 2024-09-19T12:00:40.809 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: secure 2024-09-19T12:00:40.809 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: crc 2024-09-19T12:00:40.809 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: secure 2024-09-19T12:00:40.809 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: crc 2024-09-19T12:00:40.809 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: secure 2024-09-19T12:00:40.809 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: crc 2024-09-19T12:00:40.809 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: crc 2024-09-19T12:00:40.809 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: secure 2024-09-19T12:00:40.809 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: crc 2024-09-19T12:00:40.809 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: secure 2024-09-19T12:00:40.809 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: crc 2024-09-19T12:00:40.809 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea270a80) adding con mode: secure 2024-09-19T12:00:40.809 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T12:00:40.416+0000 7ff5d60be640 10 monclient: get_auth_request con 0x7ff4b0071b20 auth_method 0 2024-09-19T12:00:40.810 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.810 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient: init 2024-09-19T12:00:40.810 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding auth protocol: cephx 2024-09-19T12:00:40.810 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding auth protocol: cephx 2024-09-19T12:00:40.810 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding auth protocol: cephx 2024-09-19T12:00:40.810 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: secure 2024-09-19T12:00:40.810 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: crc 2024-09-19T12:00:40.810 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: secure 2024-09-19T12:00:40.810 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: crc 2024-09-19T12:00:40.810 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: secure 2024-09-19T12:00:40.810 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: crc 2024-09-19T12:00:40.810 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: crc 2024-09-19T12:00:40.810 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: secure 2024-09-19T12:00:40.810 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: crc 2024-09-19T12:00:40.810 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: secure 2024-09-19T12:00:40.811 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: crc 2024-09-19T12:00:40.811 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092460) adding con mode: secure 2024-09-19T12:00:40.811 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.811 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.811 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command rotate-key cmddesc rotate-key hook 0x7ffcf90925a8 EEXIST 2024-09-19T12:00:40.811 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:40.811 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T12:00:40.811 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-a con 0x559bea2a4ff0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:40.811 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-b con 0x559bea275ff0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:40.811 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-c con 0x559bea29f5a0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:40.811 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.811 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.811 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.811 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:40.812 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient(hunting): authenticate will time out at 2534.735094s 2024-09-19T12:00:40.812 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T12:00:40.416+0000 7ff5d50bc640 10 monclient(hunting): get_auth_request con 0x559bea2a4ff0 auth_method 0 2024-09-19T12:00:40.812 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T12:00:40.416+0000 7ff5d50bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.812 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T12:00:40.416+0000 7ff5d50bc640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.812 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T12:00:40.416+0000 7ff5d50bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.812 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request con 0x559bea29f5a0 auth_method 0 2024-09-19T12:00:40.812 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.812 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.812 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.812 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.812 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.812 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.812 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T12:00:40.416+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.812 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T12:00:40.416+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.813 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T12:00:40.416+0000 7ff5d50bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.813 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_done global_id 7745 payload 274 2024-09-19T12:00:40.813 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient: _finish_hunting 0 2024-09-19T12:00:40.813 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 1 monclient: found mon.noname-c 2024-09-19T12:00:40.813 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T12:00:40.416+0000 7ff5d58bd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.813 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.813 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:00:40.813 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: dump: 2024-09-19T12:00:40.813 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.813 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.813 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.813 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.813 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.813 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.814 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.814 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.814 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.814 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.814 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: _finish_auth 0 2024-09-19T12:00:40.814 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: _check_auth_tickets 2024-09-19T12:00:40.814 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:40.814 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 5 monclient: authenticate success, global_id 7745 2024-09-19T12:00:40.814 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 10 monclient: get_monmap_and_config success 2024-09-19T12:00:40.814 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T12:00:40.416+0000 7ff5d7db79c0 4 set_mon_vals no callback set 2024-09-19T12:00:40.814 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.814 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:00:40.814 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T12:00:40.416+0000 7ff4b97fa640 10 monclient: dump: 2024-09-19T12:00:40.814 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.814 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.815 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.815 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.815 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.815 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.815 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.815 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.815 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.815 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.815 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: shutdown 2024-09-19T12:00:40.815 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: build_initial_monmap 2024-09-19T12:00:40.815 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 1 build_initial for_mkfs: 0 2024-09-19T12:00:40.815 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: monmap: 2024-09-19T12:00:40.815 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:00:40.815 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:00:40.816 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:00:40.816 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:00:40.816 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:00:40.816 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.816 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:00:40.816 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:00:40.816 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:00:40.816 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.816 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding auth protocol: cephx 2024-09-19T12:00:40.816 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding auth protocol: cephx 2024-09-19T12:00:40.816 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding auth protocol: cephx 2024-09-19T12:00:40.816 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: secure 2024-09-19T12:00:40.816 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: crc 2024-09-19T12:00:40.816 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: secure 2024-09-19T12:00:40.817 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: crc 2024-09-19T12:00:40.817 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: secure 2024-09-19T12:00:40.817 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: crc 2024-09-19T12:00:40.817 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: crc 2024-09-19T12:00:40.817 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: secure 2024-09-19T12:00:40.817 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: crc 2024-09-19T12:00:40.817 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: secure 2024-09-19T12:00:40.817 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: crc 2024-09-19T12:00:40.817 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea2a0580) adding con mode: secure 2024-09-19T12:00:40.817 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.817 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 1 librados: starting msgr at 2024-09-19T12:00:40.817 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 1 librados: starting objecter 2024-09-19T12:00:40.817 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command objecter_requests cmddesc objecter_requests hook 0x559bea29b670 EEXIST 2024-09-19T12:00:40.817 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 1 librados: setting wanted keys 2024-09-19T12:00:40.817 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 1 librados: calling monclient init 2024-09-19T12:00:40.818 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: init 2024-09-19T12:00:40.818 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding auth protocol: cephx 2024-09-19T12:00:40.818 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding auth protocol: cephx 2024-09-19T12:00:40.818 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding auth protocol: cephx 2024-09-19T12:00:40.818 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: secure 2024-09-19T12:00:40.818 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: crc 2024-09-19T12:00:40.818 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: secure 2024-09-19T12:00:40.818 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: crc 2024-09-19T12:00:40.818 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: secure 2024-09-19T12:00:40.818 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: crc 2024-09-19T12:00:40.818 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: crc 2024-09-19T12:00:40.818 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: secure 2024-09-19T12:00:40.818 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: crc 2024-09-19T12:00:40.818 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: secure 2024-09-19T12:00:40.819 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: crc 2024-09-19T12:00:40.819 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 AuthRegistry(0x559bea253060) adding con mode: secure 2024-09-19T12:00:40.819 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.819 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.819 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command rotate-key cmddesc rotate-key hook 0x559bea2531a8 EEXIST 2024-09-19T12:00:40.819 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: _reopen_session rank -1 2024-09-19T12:00:40.819 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T12:00:40.819 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-b con 0x559bea275ff0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:00:40.819 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-c con 0x559bea29f5a0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:00:40.819 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): picked mon.noname-a con 0x559bea2a4ff0 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:00:40.819 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.819 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.819 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:00:40.819 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): _renew_subs 2024-09-19T12:00:40.820 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient(hunting): authenticate will time out at 2534.737613s 2024-09-19T12:00:40.820 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): get_auth_request con 0x559bea29f5a0 auth_method 0 2024-09-19T12:00:40.820 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.820 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.820 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.820 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T12:00:40.420+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request con 0x559bea2a4ff0 auth_method 0 2024-09-19T12:00:40.820 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T12:00:40.420+0000 7ff5d58bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:00:40.820 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T12:00:40.420+0000 7ff5d58bd640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:00:40.820 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T12:00:40.420+0000 7ff5d58bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:00:40.820 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.820 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.820 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.820 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T12:00:40.420+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:00:40.820 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T12:00:40.420+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:00:40.821 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T12:00:40.420+0000 7ff5d58bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:00:40.821 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient(hunting): handle_auth_done global_id 7748 payload 824 2024-09-19T12:00:40.821 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient: _finish_hunting 0 2024-09-19T12:00:40.821 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T12:00:40.420+0000 7ff5d60be640 1 monclient: found mon.noname-c 2024-09-19T12:00:40.821 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T12:00:40.420+0000 7ff5d60be640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.821 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.821 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:00:40.821 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: dump: 2024-09-19T12:00:40.821 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.821 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.821 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.821 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.821 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.821 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.822 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.822 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.822 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.822 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.822 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: _finish_auth 0 2024-09-19T12:00:40.822 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: _check_auth_tickets 2024-09-19T12:00:40.822 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: handle_config config(0 keys) 2024-09-19T12:00:40.822 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:00:40.822 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:00:40.822 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T12:00:40.420+0000 7ff4a77fe640 10 monclient: dump: 2024-09-19T12:00:40.822 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:00:40.822 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:00:40.822 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.823 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:00:40.823 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:00:40.823 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:00:40.823 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:00:40.823 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:00:40.823 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:00:40.823 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.823 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 monclient: authenticate success, global_id 7748 2024-09-19T12:00:40.823 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: _renew_subs 2024-09-19T12:00:40.823 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T12:00:40.420+0000 7ff4b97fa640 4 set_mon_vals no callback set 2024-09-19T12:00:40.823 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.823 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: _renew_subs 2024-09-19T12:00:40.823 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.823 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 1 librados: init done 2024-09-19T12:00:40.824 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T12:00:40.420+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command cr dump hook 0x559bea29c2d8 2024-09-19T12:00:40.824 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.824 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T12:00:40.424+0000 7ff4a77fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:00:40.824 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T12:00:40.424+0000 7ff4a77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:40.824 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T12:00:40.424+0000 7ff4a77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:00:40.824 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T12:00:40.424+0000 7ff5d58bd640 10 monclient: get_auth_request con 0x559bea2be960 auth_method 0 2024-09-19T12:00:40.824 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T12:00:40.424+0000 7ff5d50bc640 10 monclient: get_auth_request con 0x7ff4a0071be0 auth_method 0 2024-09-19T12:00:40.824 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.824 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 realm 2024-09-19T12:00:40.824 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.824 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.824 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:40.824 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.824 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.825 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.825 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T12:00:40.424+0000 7ff5d50bc640 10 monclient: get_auth_request con 0x559bea2c2a30 auth_method 0 2024-09-19T12:00:40.825 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:40.825 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T12:00:40.424+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.825 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T12:00:40.428+0000 7ff5d60be640 10 monclient: get_auth_request con 0x559bea2c6320 auth_method 0 2024-09-19T12:00:40.825 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T12:00:40.428+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:40.825 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T12:00:40.428+0000 7ff5d7db79c0 20 searching for the correct realm 2024-09-19T12:00:40.825 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T12:00:40.428+0000 7ff5d58bd640 10 monclient: get_auth_request con 0x559bea2cb0e0 auth_method 0 2024-09-19T12:00:40.825 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T12:00:40.428+0000 7ff5d50bc640 10 monclient: get_auth_request con 0x7ff5c810ea50 auth_method 0 2024-09-19T12:00:40.825 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T12:00:40.432+0000 7ff5d60be640 10 monclient: get_auth_request con 0x7ff5cc008050 auth_method 0 2024-09-19T12:00:40.825 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T12:00:40.432+0000 7ff5d58bd640 10 monclient: get_auth_request con 0x7ff5d0029070 auth_method 0 2024-09-19T12:00:40.825 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T12:00:40.432+0000 7ff5d58bd640 0 -- 172.21.15.120:0/2496266365 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff5d0029070 msgr2=0x7ff5d0067010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:40.825 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T12:00:40.636+0000 7ff5d58bd640 10 monclient: get_auth_request con 0x7ff5d0029070 auth_method 0 2024-09-19T12:00:40.825 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T12:00:40.644+0000 7ff5d50bc640 10 monclient: get_auth_request con 0x7ff5c812d970 auth_method 0 2024-09-19T12:00:40.825 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T12:00:40.648+0000 7ff5d58bd640 0 -- 172.21.15.120:0/2496266365 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7ff5d0029070 msgr2=0x7ff5d0067010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:40.826 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T12:00:40.648+0000 7ff4a77fe640 1 client.7748.objecter ms_handle_reset 0x7ff5d0029070 session 0x7ff5d0016040 osd.4 2024-09-19T12:00:40.826 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T12:00:40.648+0000 7ff4a77fe640 10 monclient: _renew_subs 2024-09-19T12:00:40.826 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T12:00:40.648+0000 7ff4a77fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:00:40.826 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T12:00:40.648+0000 7ff5d58bd640 10 monclient: get_auth_request con 0x7ff4a0082280 auth_method 0 2024-09-19T12:00:40.826 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:40.826 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:40.826 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:40.826 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:40.826 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:40.826 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:40.826 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.826 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.826 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.826 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:40.827 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.827 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:40.827 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 zone default found 2024-09-19T12:00:40.827 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 4 Realm: () 2024-09-19T12:00:40.827 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:40.827 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:40.827 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:40.827 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 zonegroup default 2024-09-19T12:00:40.827 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.827 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.827 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T12:00:40.660+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.827 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T12:00:40.664+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.827 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T12:00:40.664+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.827 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T12:00:40.664+0000 7ff5d7db79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.828 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T12:00:40.664+0000 7ff5d7db79c0 20 started sync module instance, tier type = 2024-09-19T12:00:40.828 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T12:00:40.664+0000 7ff5d7db79c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:40.828 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=0 2024-09-19T12:00:40.828 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=1 2024-09-19T12:00:40.828 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=2 2024-09-19T12:00:40.828 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=3 2024-09-19T12:00:40.828 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=4 2024-09-19T12:00:40.828 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=5 2024-09-19T12:00:40.828 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=6 2024-09-19T12:00:40.828 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 20 add_watcher() i=7 2024-09-19T12:00:40.828 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T12:00:40.688+0000 7ff5d7db79c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:40.828 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding auth protocol: cephx 2024-09-19T12:00:40.828 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding auth protocol: cephx 2024-09-19T12:00:40.828 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding auth protocol: cephx 2024-09-19T12:00:40.829 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: secure 2024-09-19T12:00:40.829 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: crc 2024-09-19T12:00:40.829 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: secure 2024-09-19T12:00:40.829 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: crc 2024-09-19T12:00:40.829 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: secure 2024-09-19T12:00:40.829 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: crc 2024-09-19T12:00:40.829 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T12:00:40.692+0000 7ff4877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:40.829 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: crc 2024-09-19T12:00:40.829 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: secure 2024-09-19T12:00:40.829 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: crc 2024-09-19T12:00:40.829 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: secure 2024-09-19T12:00:40.829 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: crc 2024-09-19T12:00:40.829 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 AuthRegistry(0x7ffcf9092930) adding con mode: secure 2024-09-19T12:00:40.829 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:00:40.830 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:40.830 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:40.830 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command cache list hook 0x559bea29dab0 2024-09-19T12:00:40.830 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command cache inspect hook 0x559bea29dab0 2024-09-19T12:00:40.830 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command cache erase hook 0x559bea29dab0 2024-09-19T12:00:40.830 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T12:00:40.692+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command cache zap hook 0x559bea29dab0 2024-09-19T12:00:40.830 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 5 note: GC not initialized 2024-09-19T12:00:40.830 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T12:00:40.696+0000 7ff4867fc640 20 reqs_thread_entry: start 2024-09-19T12:00:40.830 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command sync trace show hook 0x7ff5c80c3020 2024-09-19T12:00:40.830 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command sync trace history hook 0x7ff5c80c3020 2024-09-19T12:00:40.830 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command sync trace active hook 0x7ff5c80c3020 2024-09-19T12:00:40.830 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 5 asok(0x559be9fc6d90) register_command sync trace active_short hook 0x7ff5c80c3020 2024-09-19T12:00:40.830 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:40.830 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 Filter name: none 2024-09-19T12:00:40.830 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T12:00:40.696+0000 7ff3f7fff640 20 reqs_thread_entry: start 2024-09-19T12:00:40.831 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:00:40.831 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.831 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:40.831 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:00:40.831 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:00:40.831 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:00:40.831 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.831 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:00:40.831 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:40.831 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:40.831 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:00:40.831 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:40.831 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T12:00:40.696+0000 7ff5d7db79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:00:40.831 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:40.832 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:40.832 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:40.832 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T12:00:40.832 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T12:00:40.704+0000 7ff4b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366217 cookie 94128137113200 notifier 7748 bl.length()=911 2024-09-19T12:00:40.832 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T12:00:40.704+0000 7ff4b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:40.832 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T12:00:40.704+0000 7ff4b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:40.832 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T12:00:40.704+0000 7ff4b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:40.832 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T12:00:40.832 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T12:00:40.832 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T12:00:40.832 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T12:00:40.704+0000 7ff5d7db79c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T12:00:40.832 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T12:00:40.712+0000 7ff5d7db79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff5d7db79c0 time 2024-09-19T12:00:40.715663+0000 2024-09-19T12:00:40.832 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:00:40.832 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.833 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:40.833 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff5db6912eb] 2024-09-19T12:00:40.833 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff5db69149f] 2024-09-19T12:00:40.833 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559be82c2271] 2024-09-19T12:00:40.833 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559be82d214a] 2024-09-19T12:00:40.833 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T12:00:40.833 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff5da4f7d90] 2024-09-19T12:00:40.833 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T12:00:40.833 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T12:00:40.833 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.834 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T12:00:40.712+0000 7ff5d7db79c0 -1 *** Caught signal (Aborted) ** 2024-09-19T12:00:40.834 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7ff5d7db79c0 thread_name:radosgw-admin 2024-09-19T12:00:40.834 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.834 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:00:40.834 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff5da510520] 2024-09-19T12:00:40.834 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:00:40.834 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:00:40.834 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:00:40.834 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff5db691345] 2024-09-19T12:00:40.834 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff5db69149f] 2024-09-19T12:00:40.834 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559be82c2271] 2024-09-19T12:00:40.834 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559be82d214a] 2024-09-19T12:00:40.834 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T12:00:40.835 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff5da4f7d90] 2024-09-19T12:00:40.835 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T12:00:40.835 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T12:00:40.835 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T12:00:40.835 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:00:40.835 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T12:00:40.835 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T12:00:40.835 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T12:00:40.835 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T12:00:40.835 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T12:00:40.835 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T12:00:40.835 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T12:00:40.835 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T12:00:40.835 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T12:00:40.835 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T12:00:40.836 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T12:00:40.836 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T12:00:40.836 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T12:00:40.836 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T12:00:40.836 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T12:00:40.836 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T12:00:40.836 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T12:00:40.836 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T12:00:40.836 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T12:00:40.836 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T12:00:40.837 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T12:00:40.837 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T12:00:40.837 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T12:00:40.837 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T12:00:40.837 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T12:00:40.837 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T12:00:40.837 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T12:00:40.837 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T12:00:40.837 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T12:00:40.837 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T12:00:40.837 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T12:00:40.837 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T12:00:40.837 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T12:00:40.837 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T12:00:40.837 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T12:00:40.838 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T12:00:40.838 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T12:00:40.838 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T12:00:40.838 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T12:00:40.838 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T12:00:40.838 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T12:00:40.838 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T12:00:40.838 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T12:00:40.838 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T12:00:40.838 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T12:00:40.838 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T12:00:40.838 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T12:00:40.838 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T12:00:40.838 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T12:00:40.839 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T12:00:40.839 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T12:00:40.839 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T12:00:40.839 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T12:00:40.839 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T12:00:40.839 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T12:00:40.839 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T12:00:40.839 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T12:00:40.839 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T12:00:40.839 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T12:00:40.839 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T12:00:40.839 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T12:00:40.839 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T12:00:40.839 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T12:00:40.840 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T12:00:40.840 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T12:00:40.840 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T12:00:40.840 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T12:00:40.840 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T12:00:40.840 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T12:00:40.840 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T12:00:40.840 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T12:00:40.840 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T12:00:40.840 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T12:00:40.840 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T12:00:40.840 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T12:00:40.840 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T12:00:40.840 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T12:00:40.841 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T12:00:40.841 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T12:00:40.841 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T12:00:40.841 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T12:00:40.841 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T12:00:40.841 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T12:00:40.841 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T12:00:40.841 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T12:00:40.841 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T12:00:40.841 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T12:00:40.841 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T12:00:40.841 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T12:00:40.841 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T12:00:40.841 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T12:00:40.841 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T12:00:40.842 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T12:00:40.842 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T12:00:40.842 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff3f7fff640 / http_manager 2024-09-19T12:00:40.842 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4867fc640 / http_manager 2024-09-19T12:00:40.842 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4877fe640 / rgw_dt_lg_renew 2024-09-19T12:00:40.842 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4a77fe640 / ms_dispatch 2024-09-19T12:00:40.842 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4b97fa640 / io_context_pool 2024-09-19T12:00:40.842 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4bb7fe640 / ms_dispatch 2024-09-19T12:00:40.842 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4c2604640 / ms_dispatch 2024-09-19T12:00:40.842 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff4c3e07640 / io_context_pool 2024-09-19T12:00:40.842 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff5d50bc640 / msgr-worker-2 2024-09-19T12:00:40.842 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff5d58bd640 / msgr-worker-1 2024-09-19T12:00:40.842 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff5d60be640 / msgr-worker-0 2024-09-19T12:00:40.842 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff5d68bf640 / io_context_pool 2024-09-19T12:00:40.843 INFO:tasks.workunit.client.0.smithi120.stderr: 7ff5d7db79c0 / radosgw-admin 2024-09-19T12:00:40.843 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T12:00:40.843 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T12:00:40.843 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/lib/ceph/crash/2024-09-19T12:00:40.717796Z_6269f0d7-4ef7-4347-afd4-7f4d3cca25a3/log 2024-09-19T12:00:40.843 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T12:00:40.843 INFO:tasks.workunit.client.0.smithi120.stderr:Aborted 2024-09-19T12:00:40.843 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T12:00:40.845 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:00:40.845 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:00:40.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.796+0000 7f835cdc49c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.800+0000 7f835cdc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.800+0000 7f835cdc49c0 20 realm 2024-09-19T12:00:40.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.800+0000 7f835cdc49c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.800+0000 7f835cdc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.800+0000 7f835cdc49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:40.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.800+0000 7f835cdc49c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.800+0000 7f835cdc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:40.845 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.800+0000 7f835cdc49c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.800+0000 7f835cdc49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:40.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.800+0000 7f835cdc49c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:40.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.804+0000 7f835cdc49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:40.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.804+0000 7f835cdc49c0 20 searching for the correct realm 2024-09-19T12:00:40.846 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:40.808+0000 7f835a8ca640 0 -- 172.21.15.120:0/2444662799 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f835404e060 msgr2=0x7f835404fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:41.021 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.024+0000 7f835a8ca640 0 -- 172.21.15.120:0/2444662799 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f835404e060 msgr2=0x7f835404fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:41.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.036+0000 7f835cdc49c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:41.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.036+0000 7f835cdc49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:41.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.036+0000 7f835cdc49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:41.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.036+0000 7f835cdc49c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:41.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.036+0000 7f835cdc49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:41.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.036+0000 7f835cdc49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:41.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.036+0000 7f835cdc49c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.036+0000 7f835cdc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:41.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.036+0000 7f835cdc49c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:41.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:41.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 20 zone default found 2024-09-19T12:00:41.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 4 Realm: () 2024-09-19T12:00:41.036 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:41.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:41.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:41.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 20 zonegroup default 2024-09-19T12:00:41.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:41.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:41.037 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:41.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 20 started sync module instance, tier type = 2024-09-19T12:00:41.038 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.040+0000 7f835cdc49c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:41.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.064+0000 7f835cdc49c0 20 add_watcher() i=0 2024-09-19T12:00:41.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.064+0000 7f835cdc49c0 20 add_watcher() i=1 2024-09-19T12:00:41.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.064+0000 7f835cdc49c0 20 add_watcher() i=2 2024-09-19T12:00:41.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.064+0000 7f835cdc49c0 20 add_watcher() i=3 2024-09-19T12:00:41.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.064+0000 7f835cdc49c0 20 add_watcher() i=4 2024-09-19T12:00:41.062 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.064+0000 7f835cdc49c0 20 add_watcher() i=5 2024-09-19T12:00:41.063 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.068+0000 7f835cdc49c0 20 add_watcher() i=6 2024-09-19T12:00:41.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.068+0000 7f835cdc49c0 20 add_watcher() i=7 2024-09-19T12:00:41.064 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.068+0000 7f835cdc49c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:41.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.072+0000 7f82117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:41.069 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.072+0000 7f835cdc49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:41.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.072+0000 7f835cdc49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:41.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.072+0000 7f835cdc49c0 5 note: GC not initialized 2024-09-19T12:00:41.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.072+0000 7f818bfff640 20 reqs_thread_entry: start 2024-09-19T12:00:41.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.076+0000 7f835cdc49c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:41.070 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.076+0000 7f835cdc49c0 20 Filter name: none 2024-09-19T12:00:41.071 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.076+0000 7f8189ffb640 20 reqs_thread_entry: start 2024-09-19T12:00:41.071 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.076+0000 7f835cdc49c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.076+0000 7f835cdc49c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:41.072 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.076+0000 7f835cdc49c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.073 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.076+0000 7f835cdc49c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:00:41.074 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.076+0000 7f835cdc49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:41.074 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.076+0000 7f835cdc49c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.075 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.076+0000 7f835cdc49c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:41.075 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.076+0000 7f835cdc49c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.075 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.080+0000 7f835cdc49c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:00:41.076 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.080+0000 7f835cdc49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:00:41.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.080+0000 7f82117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:41.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.088+0000 7f835cdc49c0 20 remove_watcher() i=0 2024-09-19T12:00:41.083 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.088+0000 7f835cdc49c0 2 removed watcher, disabling cache 2024-09-19T12:00:41.085 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.088+0000 7f835cdc49c0 20 remove_watcher() i=1 2024-09-19T12:00:41.087 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.092+0000 7f835cdc49c0 20 remove_watcher() i=2 2024-09-19T12:00:41.089 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.092+0000 7f835cdc49c0 20 remove_watcher() i=3 2024-09-19T12:00:41.091 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.096+0000 7f835cdc49c0 20 remove_watcher() i=4 2024-09-19T12:00:41.092 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.096+0000 7f835cdc49c0 20 remove_watcher() i=5 2024-09-19T12:00:41.094 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.096+0000 7f835cdc49c0 20 remove_watcher() i=6 2024-09-19T12:00:41.095 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.100+0000 7f835cdc49c0 20 remove_watcher() i=7 2024-09-19T12:00:41.125 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T12:00:41.156 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:00:41.156 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:00:41.200 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.204+0000 7fbf529399c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.204+0000 7fbf529399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:41.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.204+0000 7fbf529399c0 20 realm 2024-09-19T12:00:41.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.204+0000 7fbf529399c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.204+0000 7fbf529399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:41.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.204+0000 7fbf529399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:00:41.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.204+0000 7fbf529399c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.204+0000 7fbf529399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:41.202 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.204+0000 7fbf529399c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.208+0000 7fbf529399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:41.204 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.208+0000 7fbf529399c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.208+0000 7fbf529399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:00:41.205 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.208+0000 7fbf529399c0 20 searching for the correct realm 2024-09-19T12:00:41.208 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.212+0000 7fbf50c40640 0 -- 172.21.15.120:0/3642728602 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fbf44040060 msgr2=0x7fbf44066590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:41.215 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.220+0000 7fbf4fc3e640 0 -- 172.21.15.120:0/3642728602 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fbf4005ecd0 msgr2=0x7fbf40065640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:00:41.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.436+0000 7fbf529399c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:00:41.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.436+0000 7fbf529399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:00:41.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.436+0000 7fbf529399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:00:41.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.436+0000 7fbf529399c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:00:41.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.436+0000 7fbf529399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:00:41.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.436+0000 7fbf529399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:00:41.434 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.436+0000 7fbf529399c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.436+0000 7fbf529399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:41.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.436+0000 7fbf529399c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.440+0000 7fbf529399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:00:41.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.440+0000 7fbf529399c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.440+0000 7fbf529399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:00:41.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.440+0000 7fbf529399c0 20 zone default found 2024-09-19T12:00:41.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.440+0000 7fbf529399c0 4 Realm: () 2024-09-19T12:00:41.436 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.440+0000 7fbf529399c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:00:41.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.440+0000 7fbf529399c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:00:41.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.440+0000 7fbf529399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:00:41.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.440+0000 7fbf529399c0 20 zonegroup default 2024-09-19T12:00:41.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.440+0000 7fbf529399c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.440+0000 7fbf529399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:41.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.440+0000 7fbf529399c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.440+0000 7fbf529399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:41.438 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.440+0000 7fbf529399c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.444+0000 7fbf529399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:00:41.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.444+0000 7fbf529399c0 20 started sync module instance, tier type = 2024-09-19T12:00:41.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.444+0000 7fbf529399c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:00:41.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.464+0000 7fbf529399c0 20 add_watcher() i=0 2024-09-19T12:00:41.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.464+0000 7fbf529399c0 20 add_watcher() i=1 2024-09-19T12:00:41.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.464+0000 7fbf529399c0 20 add_watcher() i=2 2024-09-19T12:00:41.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.464+0000 7fbf529399c0 20 add_watcher() i=3 2024-09-19T12:00:41.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.464+0000 7fbf529399c0 20 add_watcher() i=4 2024-09-19T12:00:41.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.464+0000 7fbf529399c0 20 add_watcher() i=5 2024-09-19T12:00:41.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.464+0000 7fbf529399c0 20 add_watcher() i=6 2024-09-19T12:00:41.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.468+0000 7fbf529399c0 20 add_watcher() i=7 2024-09-19T12:00:41.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.468+0000 7fbf529399c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:00:41.469 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.472+0000 7fbe06fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:41.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.472+0000 7fbf529399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:00:41.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.472+0000 7fbf529399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:00:41.470 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.472+0000 7fbf529399c0 5 note: GC not initialized 2024-09-19T12:00:41.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbe05fdb640 20 reqs_thread_entry: start 2024-09-19T12:00:41.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 20 init_complete bucket index max shards: 1 2024-09-19T12:00:41.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 20 Filter name: none 2024-09-19T12:00:41.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbd777fe640 20 reqs_thread_entry: start 2024-09-19T12:00:41.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:00:41.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:00:41.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:00:41.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:00:41.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:00:41.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 20 rados->read ofs=0 len=0 2024-09-19T12:00:41.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:00:41.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:00:41.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:00:41.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:00:41.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:00:41.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:00:41.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:00:41.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:00:41.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:00:41.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.476+0000 7fbf529399c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:00:41.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.480+0000 7fbf529399c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:00:41.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.480+0000 7fbf529399c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:00:41.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.480+0000 7fbe06fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:00:41.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.488+0000 7fbf529399c0 20 remove_watcher() i=0 2024-09-19T12:00:41.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.488+0000 7fbf529399c0 2 removed watcher, disabling cache 2024-09-19T12:00:41.485 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.488+0000 7fbf529399c0 20 remove_watcher() i=1 2024-09-19T12:00:41.487 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.492+0000 7fbf529399c0 20 remove_watcher() i=2 2024-09-19T12:00:41.489 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.492+0000 7fbf529399c0 20 remove_watcher() i=3 2024-09-19T12:00:41.491 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.496+0000 7fbf529399c0 20 remove_watcher() i=4 2024-09-19T12:00:41.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.500+0000 7fbf529399c0 20 remove_watcher() i=5 2024-09-19T12:00:41.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.500+0000 7fbf529399c0 20 remove_watcher() i=6 2024-09-19T12:00:41.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:00:41.504+0000 7fbf529399c0 20 remove_watcher() i=7 2024-09-19T12:01:11.549 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-19T12:01:11.588 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:01:11.588 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:01:11.635 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:11.635+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:11.636 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:11.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:11.639+0000 7f12372069c0 20 realm 2024-09-19T12:01:11.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:11.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:11.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:11.639+0000 7f12372069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:01:11.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:11.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:11.637 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:11.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:11.638 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:11.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:11.643+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:01:11.640 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:11.643+0000 7f12372069c0 20 searching for the correct realm 2024-09-19T12:01:11.643 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:11.647+0000 7f123550d640 0 -- 172.21.15.120:0/1735176089 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f1228040060 msgr2=0x7f12280677a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:01:11.861 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:11.863+0000 7f123450b640 0 -- 172.21.15.120:0/1735176089 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f1224066250 msgr2=0x7f1224087a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:01:12.078 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:01:12.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:01:12.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:01:12.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:01:12.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:01:12.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:01:12.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.079+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.079+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.079+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.080 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:12.080 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:01:12.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 20 zone default found 2024-09-19T12:01:12.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 4 Realm: () 2024-09-19T12:01:12.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:01:12.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:01:12.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:01:12.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 20 zonegroup default 2024-09-19T12:01:12.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.081 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 20 started sync module instance, tier type = 2024-09-19T12:01:12.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.083+0000 7f12372069c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:01:12.103 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=0 2024-09-19T12:01:12.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=1 2024-09-19T12:01:12.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=2 2024-09-19T12:01:12.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=3 2024-09-19T12:01:12.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=4 2024-09-19T12:01:12.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=5 2024-09-19T12:01:12.104 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=6 2024-09-19T12:01:12.105 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=7 2024-09-19T12:01:12.106 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.107+0000 7f12372069c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:01:12.110 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.111+0000 7f10eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:01:12.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.111+0000 7f12372069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:01:12.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:01:12.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 5 note: GC not initialized 2024-09-19T12:01:12.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f10e9fe3640 20 reqs_thread_entry: start 2024-09-19T12:01:12.111 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 20 init_complete bucket index max shards: 1 2024-09-19T12:01:12.112 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 20 Filter name: none 2024-09-19T12:01:12.112 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f105b7fe640 20 reqs_thread_entry: start 2024-09-19T12:01:12.112 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:01:12.112 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:01:12.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:01:12.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:01:12.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:01:12.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:01:12.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:12.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:12.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:01:12.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:12.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.115+0000 7f12372069c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:01:12.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.119+0000 7f12372069c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T12:01:12.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.127+0000 7f12372069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:12.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.127+0000 7f12372069c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:12.126 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.127+0000 7f12372069c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:12.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.127+0000 7f12372069c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T12:01:12.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.127+0000 7f110bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366218 cookie 93959865971984 notifier 7802 bl.length()=911 2024-09-19T12:01:12.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.127+0000 7f110bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:12.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.127+0000 7f110bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:12.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.127+0000 7f110bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:12.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.131+0000 7f12372069c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T12:01:12.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.131+0000 7f12372069c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T12:01:12.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.131+0000 7f12372069c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T12:01:12.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.131+0000 7f12372069c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T12:01:12.132 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f12372069c0 time 2024-09-19T12:01:12.139628+0000 2024-09-19T12:01:12.132 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:01:12.133 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:12.133 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f123aae02eb] 2024-09-19T12:01:12.133 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f123aae049f] 2024-09-19T12:01:12.133 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574baba1271] 2024-09-19T12:01:12.134 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x141057c) [0x5574bb5f257c] 2024-09-19T12:01:12.134 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574babb10dd] 2024-09-19T12:01:12.134 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T12:01:12.134 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1239946d90] 2024-09-19T12:01:12.134 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T12:01:12.134 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T12:01:12.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.135+0000 7f12372069c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f12372069c0 time 2024-09-19T12:01:12.139628+0000 2024-09-19T12:01:12.134 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:01:12.134 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.134 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:12.134 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f123aae02eb] 2024-09-19T12:01:12.135 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f123aae049f] 2024-09-19T12:01:12.135 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574baba1271] 2024-09-19T12:01:12.135 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x141057c) [0x5574bb5f257c] 2024-09-19T12:01:12.135 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574babb10dd] 2024-09-19T12:01:12.135 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T12:01:12.135 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1239946d90] 2024-09-19T12:01:12.135 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T12:01:12.135 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T12:01:12.135 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.135 INFO:tasks.workunit.client.0.smithi120.stderr:*** Caught signal (Aborted) ** 2024-09-19T12:01:12.135 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f12372069c0 thread_name:radosgw-admin 2024-09-19T12:01:12.150 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:12.150 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f123995f520] 2024-09-19T12:01:12.150 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:01:12.150 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:01:12.150 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:01:12.150 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f123aae0345] 2024-09-19T12:01:12.150 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f123aae049f] 2024-09-19T12:01:12.150 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574baba1271] 2024-09-19T12:01:12.150 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x141057c) [0x5574bb5f257c] 2024-09-19T12:01:12.151 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574babb10dd] 2024-09-19T12:01:12.151 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T12:01:12.151 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1239946d90] 2024-09-19T12:01:12.151 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T12:01:12.151 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T12:01:12.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.135+0000 7f12372069c0 -1 *** Caught signal (Aborted) ** 2024-09-19T12:01:12.151 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f12372069c0 thread_name:radosgw-admin 2024-09-19T12:01:12.151 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.151 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:12.151 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f123995f520] 2024-09-19T12:01:12.151 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:01:12.152 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:01:12.152 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:01:12.152 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f123aae0345] 2024-09-19T12:01:12.152 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f123aae049f] 2024-09-19T12:01:12.152 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574baba1271] 2024-09-19T12:01:12.152 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x141057c) [0x5574bb5f257c] 2024-09-19T12:01:12.152 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574babb10dd] 2024-09-19T12:01:12.152 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T12:01:12.152 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1239946d90] 2024-09-19T12:01:12.152 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T12:01:12.153 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T12:01:12.153 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T12:01:12.153 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.153 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T12:01:12.153 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T12:01:11.611+0000 7f123450b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.153 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T12:01:11.611+0000 7f123450b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.153 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T12:01:11.611+0000 7f123450b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.153 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T12:01:11.611+0000 7f123550d640 10 monclient(hunting): handle_auth_done global_id 8394 payload 274 2024-09-19T12:01:12.153 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T12:01:11.611+0000 7f123550d640 10 monclient: _finish_hunting 0 2024-09-19T12:01:12.153 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T12:01:11.611+0000 7f123550d640 1 monclient: found mon.noname-a 2024-09-19T12:01:12.154 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T12:01:11.611+0000 7f123550d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:01:12.154 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.154 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:01:12.154 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: dump: 2024-09-19T12:01:12.154 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.154 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.154 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.154 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.154 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.154 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.154 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.154 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.154 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.155 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.155 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: _finish_auth 0 2024-09-19T12:01:12.155 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: _check_auth_tickets 2024-09-19T12:01:12.155 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:12.155 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.155 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:01:12.155 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T12:01:11.615+0000 7f1122e0d640 10 monclient: dump: 2024-09-19T12:01:12.155 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.155 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.155 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.155 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.156 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.156 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.156 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.156 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.156 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.156 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.156 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 monclient: authenticate success, global_id 8394 2024-09-19T12:01:12.156 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: get_monmap_and_config success 2024-09-19T12:01:12.156 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T12:01:11.615+0000 7f12372069c0 4 set_mon_vals no callback set 2024-09-19T12:01:12.156 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: shutdown 2024-09-19T12:01:12.156 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 asok(0x5574bc3e5d90) unregister_commands rotate-key 2024-09-19T12:01:12.156 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: build_initial_monmap 2024-09-19T12:01:12.157 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T12:01:11.615+0000 7f12372069c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:12.157 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: monmap: 2024-09-19T12:01:12.157 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:12.157 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:12.157 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:12.157 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:12.157 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:12.157 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.157 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:12.157 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:12.157 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:12.158 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.158 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding auth protocol: cephx 2024-09-19T12:01:12.158 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding auth protocol: cephx 2024-09-19T12:01:12.158 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding auth protocol: cephx 2024-09-19T12:01:12.158 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: secure 2024-09-19T12:01:12.158 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: crc 2024-09-19T12:01:12.158 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: secure 2024-09-19T12:01:12.158 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: crc 2024-09-19T12:01:12.158 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: secure 2024-09-19T12:01:12.158 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: crc 2024-09-19T12:01:12.158 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: crc 2024-09-19T12:01:12.158 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: secure 2024-09-19T12:01:12.159 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: crc 2024-09-19T12:01:12.159 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: secure 2024-09-19T12:01:12.159 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: crc 2024-09-19T12:01:12.159 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: secure 2024-09-19T12:01:12.159 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T12:01:11.615+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.159 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T12:01:11.615+0000 7f12372069c0 1 librados: starting msgr at 2024-09-19T12:01:12.159 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T12:01:11.615+0000 7f12372069c0 1 librados: starting objecter 2024-09-19T12:01:12.159 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command objecter_requests hook 0x5574bc61e230 2024-09-19T12:01:12.159 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T12:01:11.615+0000 7f12372069c0 1 librados: setting wanted keys 2024-09-19T12:01:12.159 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T12:01:11.615+0000 7f12372069c0 1 librados: calling monclient init 2024-09-19T12:01:12.159 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: init 2024-09-19T12:01:12.160 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding auth protocol: cephx 2024-09-19T12:01:12.160 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding auth protocol: cephx 2024-09-19T12:01:12.160 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding auth protocol: cephx 2024-09-19T12:01:12.160 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: secure 2024-09-19T12:01:12.160 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: crc 2024-09-19T12:01:12.160 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: secure 2024-09-19T12:01:12.160 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: crc 2024-09-19T12:01:12.160 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: secure 2024-09-19T12:01:12.160 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: crc 2024-09-19T12:01:12.160 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: crc 2024-09-19T12:01:12.160 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: secure 2024-09-19T12:01:12.161 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: crc 2024-09-19T12:01:12.161 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: secure 2024-09-19T12:01:12.161 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: crc 2024-09-19T12:01:12.161 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: secure 2024-09-19T12:01:12.161 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T12:01:11.615+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.161 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T12:01:11.615+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.161 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command rotate-key hook 0x5574bc5f34e8 2024-09-19T12:01:12.161 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:12.161 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T12:01:12.161 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-b con 0x5574bc47f500 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:12.161 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-a con 0x5574bc47fd90 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:12.161 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-c con 0x5574bc538fa0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:12.162 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.162 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.162 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.162 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:12.162 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): authenticate will time out at 2565.934141s 2024-09-19T12:01:12.162 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T12:01:11.615+0000 7f123450b640 10 monclient(hunting): get_auth_request con 0x5574bc47fd90 auth_method 0 2024-09-19T12:01:12.162 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T12:01:11.615+0000 7f123450b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.162 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T12:01:11.615+0000 7f123450b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.162 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T12:01:11.615+0000 7f123450b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.162 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): get_auth_request con 0x5574bc538fa0 auth_method 0 2024-09-19T12:01:12.162 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.162 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.163 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.163 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.163 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.163 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.163 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T12:01:11.615+0000 7f123450b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.163 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T12:01:11.615+0000 7f123450b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.163 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T12:01:11.615+0000 7f123450b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.163 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): handle_auth_done global_id 7793 payload 824 2024-09-19T12:01:12.163 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient: _finish_hunting 0 2024-09-19T12:01:12.163 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T12:01:11.615+0000 7f123550d640 1 monclient: found mon.noname-c 2024-09-19T12:01:12.163 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.164 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T12:01:11.615+0000 7f1234d0c640 10 monclient: get_auth_request con 0x5574bc47f500 auth_method 0 2024-09-19T12:01:12.164 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.164 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:01:12.164 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: dump: 2024-09-19T12:01:12.164 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.164 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.164 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.164 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.164 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.164 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.164 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.165 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.165 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.165 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.165 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: _finish_auth 0 2024-09-19T12:01:12.165 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: _check_auth_tickets 2024-09-19T12:01:12.165 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:12.165 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.165 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:01:12.165 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: dump: 2024-09-19T12:01:12.165 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.165 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.165 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.166 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.166 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.166 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.166 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.166 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.166 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.166 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.166 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 monclient: authenticate success, global_id 7793 2024-09-19T12:01:12.166 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: _renew_subs 2024-09-19T12:01:12.166 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T12:01:11.615+0000 7f1122e0d640 4 set_mon_vals no callback set 2024-09-19T12:01:12.166 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.167 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: _renew_subs 2024-09-19T12:01:12.167 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.167 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T12:01:11.615+0000 7f12372069c0 1 librados: init done 2024-09-19T12:01:12.167 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T12:01:11.619+0000 7f112160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:01:12.167 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T12:01:11.619+0000 7f112160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:12.167 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T12:01:11.619+0000 7f112160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:12.167 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T12:01:11.619+0000 7f1234d0c640 10 monclient: get_auth_request con 0x7f111c071be0 auth_method 0 2024-09-19T12:01:12.167 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T12:01:11.619+0000 7f123450b640 10 monclient: get_auth_request con 0x5574bc61ebd0 auth_method 0 2024-09-19T12:01:12.167 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T12:01:11.619+0000 7f1234d0c640 10 monclient: get_auth_request con 0x5574bc63d960 auth_method 0 2024-09-19T12:01:12.167 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T12:01:11.623+0000 7f123450b640 10 monclient: get_auth_request con 0x5574bc641b50 auth_method 0 2024-09-19T12:01:12.167 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T12:01:11.623+0000 7f123550d640 10 monclient: get_auth_request con 0x5574bc645e10 auth_method 0 2024-09-19T12:01:12.168 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T12:01:11.623+0000 7f12372069c0 10 monclient: build_initial_monmap 2024-09-19T12:01:12.168 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T12:01:11.623+0000 7f12372069c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:12.168 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T12:01:11.623+0000 7f12372069c0 10 monclient: monmap: 2024-09-19T12:01:12.168 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:12.168 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:12.168 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:12.168 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:12.168 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:12.168 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.168 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:12.168 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:12.169 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:12.169 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.169 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding auth protocol: cephx 2024-09-19T12:01:12.169 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding auth protocol: cephx 2024-09-19T12:01:12.169 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding auth protocol: cephx 2024-09-19T12:01:12.169 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: secure 2024-09-19T12:01:12.169 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: crc 2024-09-19T12:01:12.169 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: secure 2024-09-19T12:01:12.169 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: crc 2024-09-19T12:01:12.169 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: secure 2024-09-19T12:01:12.169 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: crc 2024-09-19T12:01:12.170 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: crc 2024-09-19T12:01:12.170 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: secure 2024-09-19T12:01:12.170 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: crc 2024-09-19T12:01:12.170 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: secure 2024-09-19T12:01:12.170 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: crc 2024-09-19T12:01:12.170 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: secure 2024-09-19T12:01:12.170 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T12:01:11.627+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.170 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command objecter_requests cmddesc objecter_requests hook 0x5574bc64d640 EEXIST 2024-09-19T12:01:12.170 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient: init 2024-09-19T12:01:12.170 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding auth protocol: cephx 2024-09-19T12:01:12.170 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding auth protocol: cephx 2024-09-19T12:01:12.170 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding auth protocol: cephx 2024-09-19T12:01:12.171 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: secure 2024-09-19T12:01:12.171 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: crc 2024-09-19T12:01:12.171 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: secure 2024-09-19T12:01:12.171 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: crc 2024-09-19T12:01:12.171 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: secure 2024-09-19T12:01:12.171 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: crc 2024-09-19T12:01:12.171 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: crc 2024-09-19T12:01:12.171 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: secure 2024-09-19T12:01:12.171 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: crc 2024-09-19T12:01:12.171 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: secure 2024-09-19T12:01:12.171 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: crc 2024-09-19T12:01:12.171 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: secure 2024-09-19T12:01:12.172 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T12:01:11.627+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.172 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T12:01:11.627+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.172 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command rotate-key cmddesc rotate-key hook 0x5574bc648cd0 EEXIST 2024-09-19T12:01:12.172 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:12.172 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T12:01:12.172 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-b con 0x5574bc6717f0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:12.172 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-a con 0x5574bc671120 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:12.172 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-c con 0x5574bc66fb00 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:12.172 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.172 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.172 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.172 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:12.173 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): authenticate will time out at 2565.945177s 2024-09-19T12:01:12.173 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): get_auth_request con 0x5574bc66fb00 auth_method 0 2024-09-19T12:01:12.173 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.173 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.173 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.173 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T12:01:11.627+0000 7f123550d640 10 monclient(hunting): get_auth_request con 0x5574bc671120 auth_method 0 2024-09-19T12:01:12.173 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T12:01:11.627+0000 7f123550d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.173 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T12:01:11.627+0000 7f123550d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.173 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T12:01:11.627+0000 7f123550d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.173 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.173 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.173 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.174 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T12:01:11.627+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.174 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T12:01:11.627+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.174 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T12:01:11.627+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.174 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): handle_auth_done global_id 7796 payload 824 2024-09-19T12:01:12.174 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient: _finish_hunting 0 2024-09-19T12:01:12.174 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T12:01:11.627+0000 7f1234d0c640 1 monclient: found mon.noname-c 2024-09-19T12:01:12.174 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.174 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T12:01:11.627+0000 7f123450b640 10 monclient: get_auth_request con 0x5574bc6717f0 auth_method 0 2024-09-19T12:01:12.175 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.175 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:01:12.175 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: dump: 2024-09-19T12:01:12.175 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.175 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.175 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.175 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.175 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.175 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.175 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.175 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.175 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.176 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.176 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: _finish_auth 0 2024-09-19T12:01:12.176 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: _check_auth_tickets 2024-09-19T12:01:12.176 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:12.176 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.176 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:01:12.176 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: dump: 2024-09-19T12:01:12.176 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.176 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.176 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.177 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.177 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.177 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.177 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.177 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.177 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.177 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.177 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T12:01:11.627+0000 7f1235d0e640 4 set_mon_vals no callback set 2024-09-19T12:01:12.177 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 monclient: authenticate success, global_id 7796 2024-09-19T12:01:12.177 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient: _renew_subs 2024-09-19T12:01:12.177 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.178 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient: _renew_subs 2024-09-19T12:01:12.178 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.178 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T12:01:11.631+0000 7f111a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:01:12.178 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T12:01:11.631+0000 7f111a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:12.178 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T12:01:11.631+0000 7f111a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:12.178 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: get_monmap_and_config 2024-09-19T12:01:12.178 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: build_initial_monmap 2024-09-19T12:01:12.178 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T12:01:11.631+0000 7f12372069c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:12.178 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: monmap: 2024-09-19T12:01:12.178 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:12.178 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:12.178 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:12.179 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:12.179 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:12.179 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.179 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:12.179 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:12.179 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:12.179 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.179 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding auth protocol: cephx 2024-09-19T12:01:12.179 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding auth protocol: cephx 2024-09-19T12:01:12.179 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding auth protocol: cephx 2024-09-19T12:01:12.179 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: secure 2024-09-19T12:01:12.179 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: crc 2024-09-19T12:01:12.180 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: secure 2024-09-19T12:01:12.180 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: crc 2024-09-19T12:01:12.180 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: secure 2024-09-19T12:01:12.180 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: crc 2024-09-19T12:01:12.180 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: crc 2024-09-19T12:01:12.180 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: secure 2024-09-19T12:01:12.180 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: crc 2024-09-19T12:01:12.180 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: secure 2024-09-19T12:01:12.180 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: crc 2024-09-19T12:01:12.180 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: secure 2024-09-19T12:01:12.180 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T12:01:11.631+0000 7f123450b640 10 monclient: get_auth_request con 0x7f110c071b20 auth_method 0 2024-09-19T12:01:12.180 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T12:01:11.631+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.181 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: init 2024-09-19T12:01:12.181 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding auth protocol: cephx 2024-09-19T12:01:12.181 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding auth protocol: cephx 2024-09-19T12:01:12.181 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding auth protocol: cephx 2024-09-19T12:01:12.181 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: secure 2024-09-19T12:01:12.181 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: crc 2024-09-19T12:01:12.181 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: secure 2024-09-19T12:01:12.181 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: crc 2024-09-19T12:01:12.181 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: secure 2024-09-19T12:01:12.181 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: crc 2024-09-19T12:01:12.181 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: crc 2024-09-19T12:01:12.182 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: secure 2024-09-19T12:01:12.182 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: crc 2024-09-19T12:01:12.182 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: secure 2024-09-19T12:01:12.182 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: crc 2024-09-19T12:01:12.182 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: secure 2024-09-19T12:01:12.182 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T12:01:11.631+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.182 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T12:01:11.631+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.182 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command rotate-key cmddesc rotate-key hook 0x7fffc0b69b78 EEXIST 2024-09-19T12:01:12.182 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:12.182 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T12:01:12.182 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-b con 0x5574bc6c56b0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:12.182 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-c con 0x5574bc6951e0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:12.183 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-a con 0x5574bc6b7230 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:12.183 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.183 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.183 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.183 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:12.183 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): authenticate will time out at 2565.950335s 2024-09-19T12:01:12.183 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): get_auth_request con 0x5574bc6951e0 auth_method 0 2024-09-19T12:01:12.183 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.183 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.183 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.183 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T12:01:11.631+0000 7f1234d0c640 10 monclient(hunting): get_auth_request con 0x5574bc6b7230 auth_method 0 2024-09-19T12:01:12.184 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T12:01:11.631+0000 7f1234d0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.184 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T12:01:11.631+0000 7f1234d0c640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.184 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T12:01:11.631+0000 7f1234d0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.184 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.184 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.184 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.184 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T12:01:11.631+0000 7f1234d0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.184 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T12:01:11.631+0000 7f1234d0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.184 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T12:01:11.631+0000 7f1234d0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.184 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T12:01:11.631+0000 7f123450b640 10 monclient(hunting): get_auth_request con 0x5574bc6c56b0 auth_method 0 2024-09-19T12:01:12.184 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T12:01:11.631+0000 7f123450b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.184 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T12:01:11.631+0000 7f123450b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.185 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T12:01:11.631+0000 7f123450b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.185 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): handle_auth_done global_id 7799 payload 274 2024-09-19T12:01:12.185 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient: _finish_hunting 0 2024-09-19T12:01:12.185 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T12:01:11.631+0000 7f123550d640 1 monclient: found mon.noname-c 2024-09-19T12:01:12.185 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.185 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.185 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:01:12.185 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: dump: 2024-09-19T12:01:12.185 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.185 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.185 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.185 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.186 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.186 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.186 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.186 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.186 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.186 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.186 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: _finish_auth 0 2024-09-19T12:01:12.186 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: _check_auth_tickets 2024-09-19T12:01:12.186 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:12.186 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.186 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:01:12.186 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: dump: 2024-09-19T12:01:12.187 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.187 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.187 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.187 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.187 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.187 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.187 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.187 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.187 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.187 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.187 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 monclient: authenticate success, global_id 7799 2024-09-19T12:01:12.188 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: get_monmap_and_config success 2024-09-19T12:01:12.188 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T12:01:11.631+0000 7f12372069c0 4 set_mon_vals no callback set 2024-09-19T12:01:12.188 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: shutdown 2024-09-19T12:01:12.188 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: build_initial_monmap 2024-09-19T12:01:12.188 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T12:01:11.631+0000 7f12372069c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:12.188 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: monmap: 2024-09-19T12:01:12.188 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:12.188 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:12.188 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:12.188 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:12.188 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:12.188 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.189 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:12.189 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:12.189 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:12.189 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.189 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding auth protocol: cephx 2024-09-19T12:01:12.189 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding auth protocol: cephx 2024-09-19T12:01:12.189 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding auth protocol: cephx 2024-09-19T12:01:12.189 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: secure 2024-09-19T12:01:12.189 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: crc 2024-09-19T12:01:12.189 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: secure 2024-09-19T12:01:12.189 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: crc 2024-09-19T12:01:12.189 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: secure 2024-09-19T12:01:12.190 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: crc 2024-09-19T12:01:12.190 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: crc 2024-09-19T12:01:12.190 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: secure 2024-09-19T12:01:12.190 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: crc 2024-09-19T12:01:12.190 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: secure 2024-09-19T12:01:12.190 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: crc 2024-09-19T12:01:12.190 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: secure 2024-09-19T12:01:12.190 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T12:01:11.635+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.190 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T12:01:11.635+0000 7f12372069c0 1 librados: starting msgr at 2024-09-19T12:01:12.190 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T12:01:11.635+0000 7f12372069c0 1 librados: starting objecter 2024-09-19T12:01:12.190 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command objecter_requests cmddesc objecter_requests hook 0x5574bc68a0b0 EEXIST 2024-09-19T12:01:12.191 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T12:01:11.635+0000 7f12372069c0 1 librados: setting wanted keys 2024-09-19T12:01:12.191 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T12:01:11.635+0000 7f12372069c0 1 librados: calling monclient init 2024-09-19T12:01:12.191 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient: init 2024-09-19T12:01:12.191 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding auth protocol: cephx 2024-09-19T12:01:12.191 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding auth protocol: cephx 2024-09-19T12:01:12.191 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding auth protocol: cephx 2024-09-19T12:01:12.191 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: secure 2024-09-19T12:01:12.191 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: crc 2024-09-19T12:01:12.191 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: secure 2024-09-19T12:01:12.191 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: crc 2024-09-19T12:01:12.191 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: secure 2024-09-19T12:01:12.191 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: crc 2024-09-19T12:01:12.191 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: crc 2024-09-19T12:01:12.192 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: secure 2024-09-19T12:01:12.192 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: crc 2024-09-19T12:01:12.192 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: secure 2024-09-19T12:01:12.192 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: crc 2024-09-19T12:01:12.192 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: secure 2024-09-19T12:01:12.192 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T12:01:11.635+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.192 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T12:01:11.635+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.192 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command rotate-key cmddesc rotate-key hook 0x5574bc673758 EEXIST 2024-09-19T12:01:12.192 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:12.192 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T12:01:12.192 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-c con 0x5574bc6951e0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:12.193 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-a con 0x5574bc6b7230 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:12.193 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-b con 0x5574bc6c56b0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:12.193 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.193 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.193 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.193 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:12.193 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): authenticate will time out at 2565.952946s 2024-09-19T12:01:12.193 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): get_auth_request con 0x5574bc6951e0 auth_method 0 2024-09-19T12:01:12.193 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.193 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.193 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.193 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T12:01:11.635+0000 7f123550d640 10 monclient(hunting): get_auth_request con 0x5574bc6b7230 auth_method 0 2024-09-19T12:01:12.194 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T12:01:11.635+0000 7f123550d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.194 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T12:01:11.635+0000 7f123550d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.194 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T12:01:11.635+0000 7f123550d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.194 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.194 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.194 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.194 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T12:01:11.635+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.194 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T12:01:11.635+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.194 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T12:01:11.635+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.194 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): handle_auth_done global_id 7802 payload 824 2024-09-19T12:01:12.194 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient: _finish_hunting 0 2024-09-19T12:01:12.194 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T12:01:11.635+0000 7f123450b640 1 monclient: found mon.noname-c 2024-09-19T12:01:12.195 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.195 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T12:01:11.635+0000 7f1234d0c640 10 monclient: get_auth_request con 0x5574bc6c56b0 auth_method 0 2024-09-19T12:01:12.195 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.195 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:01:12.195 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: dump: 2024-09-19T12:01:12.195 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.195 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.195 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.195 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.195 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.195 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.195 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.195 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.196 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.196 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.196 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: _finish_auth 0 2024-09-19T12:01:12.196 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: _check_auth_tickets 2024-09-19T12:01:12.196 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:12.196 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.196 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:01:12.196 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: dump: 2024-09-19T12:01:12.196 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.196 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.196 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.196 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.197 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.197 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.197 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.197 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.197 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.197 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.197 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 monclient: authenticate success, global_id 7802 2024-09-19T12:01:12.197 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient: _renew_subs 2024-09-19T12:01:12.197 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T12:01:11.635+0000 7f110bfff640 4 set_mon_vals no callback set 2024-09-19T12:01:12.197 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.197 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient: _renew_subs 2024-09-19T12:01:12.197 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.198 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T12:01:11.635+0000 7f12372069c0 1 librados: init done 2024-09-19T12:01:12.198 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command cr dump hook 0x5574bc6b4c78 2024-09-19T12:01:12.198 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T12:01:11.635+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.198 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T12:01:11.639+0000 7f110a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:01:12.198 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T12:01:11.639+0000 7f110a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:12.198 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T12:01:11.639+0000 7f110a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:12.198 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T12:01:11.639+0000 7f1234d0c640 10 monclient: get_auth_request con 0x5574bc6def30 auth_method 0 2024-09-19T12:01:12.198 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T12:01:11.639+0000 7f123550d640 10 monclient: get_auth_request con 0x7f1100071c10 auth_method 0 2024-09-19T12:01:12.198 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.198 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 realm 2024-09-19T12:01:12.198 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.199 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.199 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T12:01:11.639+0000 7f12372069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:01:12.199 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.199 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.199 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.199 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T12:01:11.639+0000 7f123450b640 10 monclient: get_auth_request con 0x5574bc6e3240 auth_method 0 2024-09-19T12:01:12.199 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:12.199 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.199 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T12:01:11.643+0000 7f123550d640 10 monclient: get_auth_request con 0x5574bc6e6960 auth_method 0 2024-09-19T12:01:12.199 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T12:01:11.643+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:01:12.199 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T12:01:11.643+0000 7f12372069c0 20 searching for the correct realm 2024-09-19T12:01:12.199 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T12:01:11.643+0000 7f1234d0c640 10 monclient: get_auth_request con 0x5574bc6eb720 auth_method 0 2024-09-19T12:01:12.200 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T12:01:11.643+0000 7f123450b640 10 monclient: get_auth_request con 0x7f1224008040 auth_method 0 2024-09-19T12:01:12.200 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T12:01:11.643+0000 7f123550d640 10 monclient: get_auth_request con 0x7f1228040060 auth_method 0 2024-09-19T12:01:12.200 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T12:01:11.647+0000 7f123550d640 0 -- 172.21.15.120:0/1735176089 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f1228040060 msgr2=0x7f12280677a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:01:12.200 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T12:01:11.851+0000 7f123550d640 10 monclient: get_auth_request con 0x7f1228040060 auth_method 0 2024-09-19T12:01:12.200 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T12:01:11.851+0000 7f1234d0c640 10 monclient: get_auth_request con 0x7f122c0cb030 auth_method 0 2024-09-19T12:01:12.200 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T12:01:11.863+0000 7f123450b640 0 -- 172.21.15.120:0/1735176089 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f1224066250 msgr2=0x7f1224087a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:01:12.200 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T12:01:12.067+0000 7f123450b640 10 monclient: get_auth_request con 0x7f1224066250 auth_method 0 2024-09-19T12:01:12.200 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:01:12.200 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:01:12.200 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:01:12.200 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:01:12.201 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:01:12.201 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:01:12.201 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.201 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.201 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.201 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:12.201 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.201 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:01:12.201 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 zone default found 2024-09-19T12:01:12.201 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T12:01:12.083+0000 7f12372069c0 4 Realm: () 2024-09-19T12:01:12.201 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T12:01:12.083+0000 7f12372069c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:01:12.202 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T12:01:12.083+0000 7f12372069c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:01:12.202 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T12:01:12.083+0000 7f12372069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:01:12.202 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 zonegroup default 2024-09-19T12:01:12.202 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.202 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.202 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.202 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.202 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.202 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.202 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 started sync module instance, tier type = 2024-09-19T12:01:12.202 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:01:12.202 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=0 2024-09-19T12:01:12.203 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=1 2024-09-19T12:01:12.203 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=2 2024-09-19T12:01:12.203 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=3 2024-09-19T12:01:12.203 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=4 2024-09-19T12:01:12.203 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=5 2024-09-19T12:01:12.203 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=6 2024-09-19T12:01:12.203 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=7 2024-09-19T12:01:12.203 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T12:01:12.107+0000 7f12372069c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:01:12.203 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding auth protocol: cephx 2024-09-19T12:01:12.203 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding auth protocol: cephx 2024-09-19T12:01:12.203 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding auth protocol: cephx 2024-09-19T12:01:12.203 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: secure 2024-09-19T12:01:12.204 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: crc 2024-09-19T12:01:12.204 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: secure 2024-09-19T12:01:12.204 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: crc 2024-09-19T12:01:12.204 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: secure 2024-09-19T12:01:12.204 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: crc 2024-09-19T12:01:12.204 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: crc 2024-09-19T12:01:12.204 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: secure 2024-09-19T12:01:12.204 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: crc 2024-09-19T12:01:12.204 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: secure 2024-09-19T12:01:12.204 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: crc 2024-09-19T12:01:12.204 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: secure 2024-09-19T12:01:12.204 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T12:01:12.111+0000 7f10eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:01:12.205 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T12:01:12.111+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.205 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T12:01:12.111+0000 7f12372069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:01:12.205 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T12:01:12.115+0000 7f12372069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:01:12.205 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command cache list hook 0x5574bc6bed10 2024-09-19T12:01:12.205 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command cache inspect hook 0x5574bc6bed10 2024-09-19T12:01:12.205 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command cache erase hook 0x5574bc6bed10 2024-09-19T12:01:12.205 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command cache zap hook 0x5574bc6bed10 2024-09-19T12:01:12.205 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 note: GC not initialized 2024-09-19T12:01:12.205 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T12:01:12.115+0000 7f10e9fe3640 20 reqs_thread_entry: start 2024-09-19T12:01:12.205 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command sync trace show hook 0x7f1228004170 2024-09-19T12:01:12.205 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command sync trace history hook 0x7f1228004170 2024-09-19T12:01:12.206 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command sync trace active hook 0x7f1228004170 2024-09-19T12:01:12.206 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command sync trace active_short hook 0x7f1228004170 2024-09-19T12:01:12.206 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T12:01:12.115+0000 7f12372069c0 20 init_complete bucket index max shards: 1 2024-09-19T12:01:12.206 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T12:01:12.115+0000 7f12372069c0 20 Filter name: none 2024-09-19T12:01:12.206 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T12:01:12.115+0000 7f105b7fe640 20 reqs_thread_entry: start 2024-09-19T12:01:12.206 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:01:12.206 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T12:01:12.115+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.206 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T12:01:12.115+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:01:12.206 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:01:12.206 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:01:12.206 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:01:12.206 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T12:01:12.115+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.207 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T12:01:12.115+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:01:12.207 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:12.207 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:12.207 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:01:12.207 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:12.207 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:01:12.207 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T12:01:12.119+0000 7f12372069c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T12:01:12.207 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T12:01:12.127+0000 7f12372069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:12.207 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T12:01:12.127+0000 7f12372069c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:12.207 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T12:01:12.127+0000 7f12372069c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:12.207 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T12:01:12.127+0000 7f12372069c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T12:01:12.208 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T12:01:12.127+0000 7f110bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366218 cookie 93959865971984 notifier 7802 bl.length()=911 2024-09-19T12:01:12.208 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T12:01:12.127+0000 7f110bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:12.208 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T12:01:12.127+0000 7f110bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:12.208 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T12:01:12.127+0000 7f110bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:12.208 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T12:01:12.131+0000 7f12372069c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T12:01:12.208 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T12:01:12.131+0000 7f12372069c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T12:01:12.208 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T12:01:12.131+0000 7f12372069c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T12:01:12.208 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T12:01:12.131+0000 7f12372069c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T12:01:12.208 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T12:01:12.135+0000 7f12372069c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f12372069c0 time 2024-09-19T12:01:12.139628+0000 2024-09-19T12:01:12.208 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:01:12.208 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.209 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:12.209 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f123aae02eb] 2024-09-19T12:01:12.209 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f123aae049f] 2024-09-19T12:01:12.209 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574baba1271] 2024-09-19T12:01:12.209 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x141057c) [0x5574bb5f257c] 2024-09-19T12:01:12.209 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574babb10dd] 2024-09-19T12:01:12.209 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T12:01:12.209 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1239946d90] 2024-09-19T12:01:12.209 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T12:01:12.209 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T12:01:12.209 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.209 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T12:01:12.135+0000 7f12372069c0 -1 *** Caught signal (Aborted) ** 2024-09-19T12:01:12.210 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f12372069c0 thread_name:radosgw-admin 2024-09-19T12:01:12.210 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.210 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:12.210 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f123995f520] 2024-09-19T12:01:12.210 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:01:12.210 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:01:12.210 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:01:12.210 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f123aae0345] 2024-09-19T12:01:12.210 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f123aae049f] 2024-09-19T12:01:12.210 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574baba1271] 2024-09-19T12:01:12.210 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x141057c) [0x5574bb5f257c] 2024-09-19T12:01:12.210 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574babb10dd] 2024-09-19T12:01:12.211 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T12:01:12.211 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1239946d90] 2024-09-19T12:01:12.211 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T12:01:12.211 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T12:01:12.211 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T12:01:12.211 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.211 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T12:01:12.211 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T12:01:12.211 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T12:01:12.211 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T12:01:12.211 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T12:01:12.211 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T12:01:12.212 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T12:01:12.212 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T12:01:12.212 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T12:01:12.212 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T12:01:12.212 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T12:01:12.212 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T12:01:12.212 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T12:01:12.212 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T12:01:12.212 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T12:01:12.212 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T12:01:12.212 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T12:01:12.213 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T12:01:12.213 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T12:01:12.213 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T12:01:12.213 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T12:01:12.213 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T12:01:12.213 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T12:01:12.213 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T12:01:12.213 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T12:01:12.213 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T12:01:12.213 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T12:01:12.213 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T12:01:12.214 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T12:01:12.214 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T12:01:12.214 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T12:01:12.214 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T12:01:12.214 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T12:01:12.214 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T12:01:12.214 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T12:01:12.214 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T12:01:12.214 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T12:01:12.214 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T12:01:12.214 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T12:01:12.214 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T12:01:12.214 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T12:01:12.215 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T12:01:12.215 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T12:01:12.215 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T12:01:12.215 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T12:01:12.215 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T12:01:12.215 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T12:01:12.215 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T12:01:12.215 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T12:01:12.215 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T12:01:12.215 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T12:01:12.215 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T12:01:12.216 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T12:01:12.216 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T12:01:12.216 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T12:01:12.216 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T12:01:12.216 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T12:01:12.216 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T12:01:12.216 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T12:01:12.216 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T12:01:12.216 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T12:01:12.216 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T12:01:12.216 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T12:01:12.217 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T12:01:12.217 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T12:01:12.217 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T12:01:12.217 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T12:01:12.217 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T12:01:12.217 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T12:01:12.217 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T12:01:12.217 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T12:01:12.217 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T12:01:12.217 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T12:01:12.217 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T12:01:12.217 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T12:01:12.218 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T12:01:12.218 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T12:01:12.218 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T12:01:12.218 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T12:01:12.218 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T12:01:12.218 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T12:01:12.218 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T12:01:12.218 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T12:01:12.218 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T12:01:12.218 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T12:01:12.218 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T12:01:12.218 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T12:01:12.218 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T12:01:12.219 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T12:01:12.219 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T12:01:12.219 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T12:01:12.219 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T12:01:12.219 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T12:01:12.219 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T12:01:12.219 INFO:tasks.workunit.client.0.smithi120.stderr: 7f105b7fe640 / http_manager 2024-09-19T12:01:12.219 INFO:tasks.workunit.client.0.smithi120.stderr: 7f10e9fe3640 / http_manager 2024-09-19T12:01:12.219 INFO:tasks.workunit.client.0.smithi120.stderr: 7f10eafe5640 / rgw_dt_lg_renew 2024-09-19T12:01:12.219 INFO:tasks.workunit.client.0.smithi120.stderr: 7f110a7fc640 / ms_dispatch 2024-09-19T12:01:12.219 INFO:tasks.workunit.client.0.smithi120.stderr: 7f110bfff640 / io_context_pool 2024-09-19T12:01:12.219 INFO:tasks.workunit.client.0.smithi120.stderr: 7f111a7fc640 / ms_dispatch 2024-09-19T12:01:12.219 INFO:tasks.workunit.client.0.smithi120.stderr: 7f112160a640 / ms_dispatch 2024-09-19T12:01:12.220 INFO:tasks.workunit.client.0.smithi120.stderr: 7f1122e0d640 / io_context_pool 2024-09-19T12:01:12.220 INFO:tasks.workunit.client.0.smithi120.stderr: 7f123450b640 / msgr-worker-2 2024-09-19T12:01:12.220 INFO:tasks.workunit.client.0.smithi120.stderr: 7f1234d0c640 / msgr-worker-1 2024-09-19T12:01:12.220 INFO:tasks.workunit.client.0.smithi120.stderr: 7f123550d640 / msgr-worker-0 2024-09-19T12:01:12.220 INFO:tasks.workunit.client.0.smithi120.stderr: 7f1235d0e640 / io_context_pool 2024-09-19T12:01:12.220 INFO:tasks.workunit.client.0.smithi120.stderr: 7f12372069c0 / radosgw-admin 2024-09-19T12:01:12.220 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T12:01:12.220 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T12:01:12.220 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/log/ceph/ceph-client.admin.145263.log 2024-09-19T12:01:12.220 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T12:01:12.220 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T12:01:12.220 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T12:01:11.611+0000 7f123450b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.220 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T12:01:11.611+0000 7f123450b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.221 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T12:01:11.611+0000 7f123450b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.221 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T12:01:11.611+0000 7f123550d640 10 monclient(hunting): handle_auth_done global_id 8394 payload 274 2024-09-19T12:01:12.221 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T12:01:11.611+0000 7f123550d640 10 monclient: _finish_hunting 0 2024-09-19T12:01:12.221 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T12:01:11.611+0000 7f123550d640 1 monclient: found mon.noname-a 2024-09-19T12:01:12.221 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T12:01:11.611+0000 7f123550d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:01:12.221 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.221 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:01:12.221 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: dump: 2024-09-19T12:01:12.221 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.221 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.221 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.222 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.222 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.222 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.222 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.222 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.222 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.222 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.222 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: _finish_auth 0 2024-09-19T12:01:12.222 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: _check_auth_tickets 2024-09-19T12:01:12.222 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:12.222 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.222 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T12:01:11.611+0000 7f1122e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:01:12.223 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T12:01:11.615+0000 7f1122e0d640 10 monclient: dump: 2024-09-19T12:01:12.223 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.223 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.223 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.223 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.223 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.223 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.223 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.223 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.223 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.223 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.224 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 monclient: authenticate success, global_id 8394 2024-09-19T12:01:12.224 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: get_monmap_and_config success 2024-09-19T12:01:12.224 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T12:01:11.615+0000 7f12372069c0 4 set_mon_vals no callback set 2024-09-19T12:01:12.224 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: shutdown 2024-09-19T12:01:12.224 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 asok(0x5574bc3e5d90) unregister_commands rotate-key 2024-09-19T12:01:12.224 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: build_initial_monmap 2024-09-19T12:01:12.224 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T12:01:11.615+0000 7f12372069c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:12.224 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: monmap: 2024-09-19T12:01:12.224 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:12.224 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:12.224 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:12.224 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:12.225 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:12.225 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.225 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:12.225 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:12.225 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:12.225 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.225 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding auth protocol: cephx 2024-09-19T12:01:12.225 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding auth protocol: cephx 2024-09-19T12:01:12.225 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding auth protocol: cephx 2024-09-19T12:01:12.225 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: secure 2024-09-19T12:01:12.225 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: crc 2024-09-19T12:01:12.226 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: secure 2024-09-19T12:01:12.226 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: crc 2024-09-19T12:01:12.226 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: secure 2024-09-19T12:01:12.226 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: crc 2024-09-19T12:01:12.226 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: crc 2024-09-19T12:01:12.226 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: secure 2024-09-19T12:01:12.226 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: crc 2024-09-19T12:01:12.226 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: secure 2024-09-19T12:01:12.226 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: crc 2024-09-19T12:01:12.226 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f8720) adding con mode: secure 2024-09-19T12:01:12.226 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T12:01:11.615+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.226 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T12:01:11.615+0000 7f12372069c0 1 librados: starting msgr at 2024-09-19T12:01:12.227 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T12:01:11.615+0000 7f12372069c0 1 librados: starting objecter 2024-09-19T12:01:12.227 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command objecter_requests hook 0x5574bc61e230 2024-09-19T12:01:12.227 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T12:01:11.615+0000 7f12372069c0 1 librados: setting wanted keys 2024-09-19T12:01:12.227 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T12:01:11.615+0000 7f12372069c0 1 librados: calling monclient init 2024-09-19T12:01:12.227 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: init 2024-09-19T12:01:12.227 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding auth protocol: cephx 2024-09-19T12:01:12.227 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding auth protocol: cephx 2024-09-19T12:01:12.227 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding auth protocol: cephx 2024-09-19T12:01:12.227 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: secure 2024-09-19T12:01:12.227 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: crc 2024-09-19T12:01:12.227 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: secure 2024-09-19T12:01:12.227 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: crc 2024-09-19T12:01:12.228 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: secure 2024-09-19T12:01:12.228 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: crc 2024-09-19T12:01:12.228 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: crc 2024-09-19T12:01:12.228 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: secure 2024-09-19T12:01:12.228 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: crc 2024-09-19T12:01:12.228 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: secure 2024-09-19T12:01:12.228 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: crc 2024-09-19T12:01:12.228 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 AuthRegistry(0x5574bc5f33a0) adding con mode: secure 2024-09-19T12:01:12.228 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T12:01:11.615+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.228 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T12:01:11.615+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.229 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command rotate-key hook 0x5574bc5f34e8 2024-09-19T12:01:12.229 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:12.229 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T12:01:12.229 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-b con 0x5574bc47f500 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:12.229 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-a con 0x5574bc47fd90 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:12.229 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-c con 0x5574bc538fa0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:12.229 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.229 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.229 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.229 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:12.229 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient(hunting): authenticate will time out at 2565.934141s 2024-09-19T12:01:12.229 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T12:01:11.615+0000 7f123450b640 10 monclient(hunting): get_auth_request con 0x5574bc47fd90 auth_method 0 2024-09-19T12:01:12.230 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T12:01:11.615+0000 7f123450b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.230 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T12:01:11.615+0000 7f123450b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.230 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T12:01:11.615+0000 7f123450b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.230 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): get_auth_request con 0x5574bc538fa0 auth_method 0 2024-09-19T12:01:12.230 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.230 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.230 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.230 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.230 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.230 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.230 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T12:01:11.615+0000 7f123450b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.231 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T12:01:11.615+0000 7f123450b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.231 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T12:01:11.615+0000 7f123450b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.231 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient(hunting): handle_auth_done global_id 7793 payload 824 2024-09-19T12:01:12.231 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient: _finish_hunting 0 2024-09-19T12:01:12.231 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T12:01:11.615+0000 7f123550d640 1 monclient: found mon.noname-c 2024-09-19T12:01:12.231 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T12:01:11.615+0000 7f123550d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.231 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T12:01:11.615+0000 7f1234d0c640 10 monclient: get_auth_request con 0x5574bc47f500 auth_method 0 2024-09-19T12:01:12.231 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.231 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:01:12.231 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: dump: 2024-09-19T12:01:12.231 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.231 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.232 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.232 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.232 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.232 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.232 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.232 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.232 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.232 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.232 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: _finish_auth 0 2024-09-19T12:01:12.232 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: _check_auth_tickets 2024-09-19T12:01:12.232 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:12.233 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.233 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:01:12.233 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T12:01:11.615+0000 7f112160a640 10 monclient: dump: 2024-09-19T12:01:12.233 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.233 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.233 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.233 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.233 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.233 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.233 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.233 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.233 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.234 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.234 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T12:01:11.615+0000 7f12372069c0 5 monclient: authenticate success, global_id 7793 2024-09-19T12:01:12.234 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: _renew_subs 2024-09-19T12:01:12.234 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T12:01:11.615+0000 7f1122e0d640 4 set_mon_vals no callback set 2024-09-19T12:01:12.234 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.234 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: _renew_subs 2024-09-19T12:01:12.234 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T12:01:11.615+0000 7f12372069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.234 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T12:01:11.615+0000 7f12372069c0 1 librados: init done 2024-09-19T12:01:12.234 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T12:01:11.619+0000 7f112160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:01:12.234 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T12:01:11.619+0000 7f112160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:12.234 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T12:01:11.619+0000 7f112160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:12.235 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T12:01:11.619+0000 7f1234d0c640 10 monclient: get_auth_request con 0x7f111c071be0 auth_method 0 2024-09-19T12:01:12.235 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T12:01:11.619+0000 7f123450b640 10 monclient: get_auth_request con 0x5574bc61ebd0 auth_method 0 2024-09-19T12:01:12.235 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T12:01:11.619+0000 7f1234d0c640 10 monclient: get_auth_request con 0x5574bc63d960 auth_method 0 2024-09-19T12:01:12.235 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T12:01:11.623+0000 7f123450b640 10 monclient: get_auth_request con 0x5574bc641b50 auth_method 0 2024-09-19T12:01:12.235 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T12:01:11.623+0000 7f123550d640 10 monclient: get_auth_request con 0x5574bc645e10 auth_method 0 2024-09-19T12:01:12.235 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T12:01:11.623+0000 7f12372069c0 10 monclient: build_initial_monmap 2024-09-19T12:01:12.235 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T12:01:11.623+0000 7f12372069c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:12.235 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T12:01:11.623+0000 7f12372069c0 10 monclient: monmap: 2024-09-19T12:01:12.235 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:12.235 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:12.235 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:12.235 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:12.236 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:12.236 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.236 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:12.236 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:12.236 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:12.236 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.236 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding auth protocol: cephx 2024-09-19T12:01:12.236 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding auth protocol: cephx 2024-09-19T12:01:12.236 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding auth protocol: cephx 2024-09-19T12:01:12.236 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: secure 2024-09-19T12:01:12.236 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: crc 2024-09-19T12:01:12.237 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: secure 2024-09-19T12:01:12.237 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: crc 2024-09-19T12:01:12.237 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: secure 2024-09-19T12:01:12.237 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: crc 2024-09-19T12:01:12.237 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: crc 2024-09-19T12:01:12.237 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: secure 2024-09-19T12:01:12.237 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: crc 2024-09-19T12:01:12.237 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: secure 2024-09-19T12:01:12.237 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: crc 2024-09-19T12:01:12.237 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc649c90) adding con mode: secure 2024-09-19T12:01:12.237 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T12:01:11.627+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.238 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command objecter_requests cmddesc objecter_requests hook 0x5574bc64d640 EEXIST 2024-09-19T12:01:12.238 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient: init 2024-09-19T12:01:12.238 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding auth protocol: cephx 2024-09-19T12:01:12.238 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding auth protocol: cephx 2024-09-19T12:01:12.238 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding auth protocol: cephx 2024-09-19T12:01:12.238 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: secure 2024-09-19T12:01:12.238 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: crc 2024-09-19T12:01:12.238 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: secure 2024-09-19T12:01:12.238 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: crc 2024-09-19T12:01:12.238 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: secure 2024-09-19T12:01:12.238 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: crc 2024-09-19T12:01:12.239 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: crc 2024-09-19T12:01:12.239 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: secure 2024-09-19T12:01:12.239 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: crc 2024-09-19T12:01:12.239 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: secure 2024-09-19T12:01:12.239 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: crc 2024-09-19T12:01:12.239 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 AuthRegistry(0x5574bc648b88) adding con mode: secure 2024-09-19T12:01:12.239 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T12:01:11.627+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.239 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T12:01:11.627+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.239 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command rotate-key cmddesc rotate-key hook 0x5574bc648cd0 EEXIST 2024-09-19T12:01:12.239 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:12.239 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T12:01:12.239 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-b con 0x5574bc6717f0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:12.240 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-a con 0x5574bc671120 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:12.240 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-c con 0x5574bc66fb00 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:12.240 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.240 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.240 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.240 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:12.240 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient(hunting): authenticate will time out at 2565.945177s 2024-09-19T12:01:12.240 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): get_auth_request con 0x5574bc66fb00 auth_method 0 2024-09-19T12:01:12.240 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.240 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.240 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.240 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T12:01:11.627+0000 7f123550d640 10 monclient(hunting): get_auth_request con 0x5574bc671120 auth_method 0 2024-09-19T12:01:12.241 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T12:01:11.627+0000 7f123550d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.241 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T12:01:11.627+0000 7f123550d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.241 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T12:01:11.627+0000 7f123550d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.241 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.241 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.241 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.241 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T12:01:11.627+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.241 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T12:01:11.627+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.241 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T12:01:11.627+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.241 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient(hunting): handle_auth_done global_id 7796 payload 824 2024-09-19T12:01:12.241 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient: _finish_hunting 0 2024-09-19T12:01:12.242 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T12:01:11.627+0000 7f1234d0c640 1 monclient: found mon.noname-c 2024-09-19T12:01:12.242 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T12:01:11.627+0000 7f1234d0c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.242 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T12:01:11.627+0000 7f123450b640 10 monclient: get_auth_request con 0x5574bc6717f0 auth_method 0 2024-09-19T12:01:12.242 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.242 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:01:12.242 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: dump: 2024-09-19T12:01:12.242 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.242 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.242 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.242 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.242 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.242 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.243 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.243 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.243 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.243 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.243 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: _finish_auth 0 2024-09-19T12:01:12.243 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: _check_auth_tickets 2024-09-19T12:01:12.243 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:12.243 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.243 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:01:12.243 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T12:01:11.627+0000 7f111a7fc640 10 monclient: dump: 2024-09-19T12:01:12.243 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.243 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.244 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.244 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.244 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.244 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.244 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.244 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.244 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.244 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.244 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T12:01:11.627+0000 7f1235d0e640 4 set_mon_vals no callback set 2024-09-19T12:01:12.244 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T12:01:11.627+0000 7f12372069c0 5 monclient: authenticate success, global_id 7796 2024-09-19T12:01:12.244 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient: _renew_subs 2024-09-19T12:01:12.244 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.245 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient: _renew_subs 2024-09-19T12:01:12.245 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T12:01:11.627+0000 7f12372069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.245 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T12:01:11.631+0000 7f111a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:01:12.245 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T12:01:11.631+0000 7f111a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:12.245 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T12:01:11.631+0000 7f111a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:12.245 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: get_monmap_and_config 2024-09-19T12:01:12.245 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: build_initial_monmap 2024-09-19T12:01:12.245 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T12:01:11.631+0000 7f12372069c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:12.245 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: monmap: 2024-09-19T12:01:12.245 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:12.245 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:12.246 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:12.246 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:12.246 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:12.246 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.246 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:12.246 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:12.246 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:12.246 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.246 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding auth protocol: cephx 2024-09-19T12:01:12.246 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding auth protocol: cephx 2024-09-19T12:01:12.246 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding auth protocol: cephx 2024-09-19T12:01:12.246 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: secure 2024-09-19T12:01:12.247 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: crc 2024-09-19T12:01:12.247 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: secure 2024-09-19T12:01:12.247 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: crc 2024-09-19T12:01:12.247 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: secure 2024-09-19T12:01:12.247 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: crc 2024-09-19T12:01:12.247 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: crc 2024-09-19T12:01:12.247 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: secure 2024-09-19T12:01:12.247 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: crc 2024-09-19T12:01:12.247 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: secure 2024-09-19T12:01:12.247 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: crc 2024-09-19T12:01:12.247 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6911c0) adding con mode: secure 2024-09-19T12:01:12.247 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T12:01:11.631+0000 7f123450b640 10 monclient: get_auth_request con 0x7f110c071b20 auth_method 0 2024-09-19T12:01:12.247 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T12:01:11.631+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.248 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: init 2024-09-19T12:01:12.248 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding auth protocol: cephx 2024-09-19T12:01:12.248 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding auth protocol: cephx 2024-09-19T12:01:12.248 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding auth protocol: cephx 2024-09-19T12:01:12.248 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: secure 2024-09-19T12:01:12.248 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: crc 2024-09-19T12:01:12.248 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: secure 2024-09-19T12:01:12.248 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: crc 2024-09-19T12:01:12.248 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: secure 2024-09-19T12:01:12.248 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: crc 2024-09-19T12:01:12.248 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: crc 2024-09-19T12:01:12.248 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: secure 2024-09-19T12:01:12.249 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: crc 2024-09-19T12:01:12.249 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: secure 2024-09-19T12:01:12.249 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: crc 2024-09-19T12:01:12.249 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69a30) adding con mode: secure 2024-09-19T12:01:12.249 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T12:01:11.631+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.249 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T12:01:11.631+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.249 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command rotate-key cmddesc rotate-key hook 0x7fffc0b69b78 EEXIST 2024-09-19T12:01:12.249 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:12.249 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T12:01:12.249 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-b con 0x5574bc6c56b0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:12.249 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-c con 0x5574bc6951e0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:12.249 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-a con 0x5574bc6b7230 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:12.250 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.250 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.250 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.250 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:12.250 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient(hunting): authenticate will time out at 2565.950335s 2024-09-19T12:01:12.250 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): get_auth_request con 0x5574bc6951e0 auth_method 0 2024-09-19T12:01:12.250 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.250 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.250 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.250 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T12:01:11.631+0000 7f1234d0c640 10 monclient(hunting): get_auth_request con 0x5574bc6b7230 auth_method 0 2024-09-19T12:01:12.250 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T12:01:11.631+0000 7f1234d0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.250 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T12:01:11.631+0000 7f1234d0c640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.251 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T12:01:11.631+0000 7f1234d0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.251 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.251 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.251 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.251 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T12:01:11.631+0000 7f1234d0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.251 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T12:01:11.631+0000 7f1234d0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.251 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T12:01:11.631+0000 7f1234d0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.251 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T12:01:11.631+0000 7f123450b640 10 monclient(hunting): get_auth_request con 0x5574bc6c56b0 auth_method 0 2024-09-19T12:01:12.251 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T12:01:11.631+0000 7f123450b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.251 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T12:01:11.631+0000 7f123450b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.251 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T12:01:11.631+0000 7f123450b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.251 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient(hunting): handle_auth_done global_id 7799 payload 274 2024-09-19T12:01:12.252 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient: _finish_hunting 0 2024-09-19T12:01:12.252 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T12:01:11.631+0000 7f123550d640 1 monclient: found mon.noname-c 2024-09-19T12:01:12.252 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T12:01:11.631+0000 7f123550d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.252 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.252 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:01:12.252 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: dump: 2024-09-19T12:01:12.252 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.252 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.252 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.252 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.252 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.252 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.253 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.253 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.253 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.253 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.253 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: _finish_auth 0 2024-09-19T12:01:12.253 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: _check_auth_tickets 2024-09-19T12:01:12.253 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:12.253 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.253 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:01:12.253 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T12:01:11.631+0000 7f110bfff640 10 monclient: dump: 2024-09-19T12:01:12.253 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.253 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.254 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.254 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.254 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.254 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.254 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.254 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.254 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.254 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.254 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 monclient: authenticate success, global_id 7799 2024-09-19T12:01:12.254 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: get_monmap_and_config success 2024-09-19T12:01:12.254 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T12:01:11.631+0000 7f12372069c0 4 set_mon_vals no callback set 2024-09-19T12:01:12.254 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: shutdown 2024-09-19T12:01:12.255 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: build_initial_monmap 2024-09-19T12:01:12.255 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T12:01:11.631+0000 7f12372069c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:12.255 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T12:01:11.631+0000 7f12372069c0 10 monclient: monmap: 2024-09-19T12:01:12.255 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:12.255 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:12.255 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:12.255 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:12.255 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:12.255 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.255 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:12.255 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:12.255 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:12.256 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.256 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding auth protocol: cephx 2024-09-19T12:01:12.256 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding auth protocol: cephx 2024-09-19T12:01:12.256 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding auth protocol: cephx 2024-09-19T12:01:12.256 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: secure 2024-09-19T12:01:12.256 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: crc 2024-09-19T12:01:12.256 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: secure 2024-09-19T12:01:12.256 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: crc 2024-09-19T12:01:12.256 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: secure 2024-09-19T12:01:12.256 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: crc 2024-09-19T12:01:12.256 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: crc 2024-09-19T12:01:12.257 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: secure 2024-09-19T12:01:12.257 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: crc 2024-09-19T12:01:12.257 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: secure 2024-09-19T12:01:12.257 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: crc 2024-09-19T12:01:12.257 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T12:01:11.631+0000 7f12372069c0 5 AuthRegistry(0x5574bc6b7780) adding con mode: secure 2024-09-19T12:01:12.257 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T12:01:11.635+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.257 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T12:01:11.635+0000 7f12372069c0 1 librados: starting msgr at 2024-09-19T12:01:12.257 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T12:01:11.635+0000 7f12372069c0 1 librados: starting objecter 2024-09-19T12:01:12.257 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command objecter_requests cmddesc objecter_requests hook 0x5574bc68a0b0 EEXIST 2024-09-19T12:01:12.257 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T12:01:11.635+0000 7f12372069c0 1 librados: setting wanted keys 2024-09-19T12:01:12.257 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T12:01:11.635+0000 7f12372069c0 1 librados: calling monclient init 2024-09-19T12:01:12.257 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient: init 2024-09-19T12:01:12.258 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding auth protocol: cephx 2024-09-19T12:01:12.258 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding auth protocol: cephx 2024-09-19T12:01:12.258 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding auth protocol: cephx 2024-09-19T12:01:12.258 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: secure 2024-09-19T12:01:12.258 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: crc 2024-09-19T12:01:12.258 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: secure 2024-09-19T12:01:12.258 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: crc 2024-09-19T12:01:12.258 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: secure 2024-09-19T12:01:12.258 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: crc 2024-09-19T12:01:12.258 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: crc 2024-09-19T12:01:12.258 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: secure 2024-09-19T12:01:12.258 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: crc 2024-09-19T12:01:12.259 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: secure 2024-09-19T12:01:12.259 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: crc 2024-09-19T12:01:12.259 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 AuthRegistry(0x5574bc673610) adding con mode: secure 2024-09-19T12:01:12.259 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T12:01:11.635+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.259 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T12:01:11.635+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.259 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command rotate-key cmddesc rotate-key hook 0x5574bc673758 EEXIST 2024-09-19T12:01:12.259 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:12.259 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T12:01:12.259 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-c con 0x5574bc6951e0 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:12.259 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-a con 0x5574bc6b7230 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:12.259 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): picked mon.noname-b con 0x5574bc6c56b0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:12.260 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.260 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.260 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:12.260 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:12.260 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient(hunting): authenticate will time out at 2565.952946s 2024-09-19T12:01:12.260 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): get_auth_request con 0x5574bc6951e0 auth_method 0 2024-09-19T12:01:12.260 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.260 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.260 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.260 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T12:01:11.635+0000 7f123550d640 10 monclient(hunting): get_auth_request con 0x5574bc6b7230 auth_method 0 2024-09-19T12:01:12.260 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T12:01:11.635+0000 7f123550d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:12.261 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T12:01:11.635+0000 7f123550d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:12.261 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T12:01:11.635+0000 7f123550d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:12.261 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.261 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.261 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.261 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T12:01:11.635+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:12.261 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T12:01:11.635+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:12.261 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T12:01:11.635+0000 7f123550d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:12.261 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient(hunting): handle_auth_done global_id 7802 payload 824 2024-09-19T12:01:12.261 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient: _finish_hunting 0 2024-09-19T12:01:12.261 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T12:01:11.635+0000 7f123450b640 1 monclient: found mon.noname-c 2024-09-19T12:01:12.262 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T12:01:11.635+0000 7f123450b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.262 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T12:01:11.635+0000 7f1234d0c640 10 monclient: get_auth_request con 0x5574bc6c56b0 auth_method 0 2024-09-19T12:01:12.262 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.262 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:01:12.262 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: dump: 2024-09-19T12:01:12.262 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.262 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.262 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.262 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.262 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.262 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.262 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.263 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.263 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.263 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.263 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: _finish_auth 0 2024-09-19T12:01:12.263 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: _check_auth_tickets 2024-09-19T12:01:12.263 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:12.263 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:12.263 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:01:12.263 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T12:01:11.635+0000 7f110a7fc640 10 monclient: dump: 2024-09-19T12:01:12.263 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:12.263 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:12.264 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.264 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:12.264 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:12.264 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:12.264 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:12.264 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:12.264 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:12.264 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.264 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 monclient: authenticate success, global_id 7802 2024-09-19T12:01:12.264 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient: _renew_subs 2024-09-19T12:01:12.264 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T12:01:11.635+0000 7f110bfff640 4 set_mon_vals no callback set 2024-09-19T12:01:12.265 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.265 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient: _renew_subs 2024-09-19T12:01:12.265 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T12:01:11.635+0000 7f12372069c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:12.265 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T12:01:11.635+0000 7f12372069c0 1 librados: init done 2024-09-19T12:01:12.265 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T12:01:11.635+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command cr dump hook 0x5574bc6b4c78 2024-09-19T12:01:12.265 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T12:01:11.635+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.265 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T12:01:11.639+0000 7f110a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:01:12.265 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T12:01:11.639+0000 7f110a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:12.265 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T12:01:11.639+0000 7f110a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:12.265 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T12:01:11.639+0000 7f1234d0c640 10 monclient: get_auth_request con 0x5574bc6def30 auth_method 0 2024-09-19T12:01:12.265 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T12:01:11.639+0000 7f123550d640 10 monclient: get_auth_request con 0x7f1100071c10 auth_method 0 2024-09-19T12:01:12.265 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.266 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 realm 2024-09-19T12:01:12.266 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.266 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.266 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T12:01:11.639+0000 7f12372069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:01:12.266 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.266 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.266 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.266 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T12:01:11.639+0000 7f123450b640 10 monclient: get_auth_request con 0x5574bc6e3240 auth_method 0 2024-09-19T12:01:12.266 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:12.266 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T12:01:11.639+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.266 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T12:01:11.643+0000 7f123550d640 10 monclient: get_auth_request con 0x5574bc6e6960 auth_method 0 2024-09-19T12:01:12.267 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T12:01:11.643+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:01:12.267 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T12:01:11.643+0000 7f12372069c0 20 searching for the correct realm 2024-09-19T12:01:12.267 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T12:01:11.643+0000 7f1234d0c640 10 monclient: get_auth_request con 0x5574bc6eb720 auth_method 0 2024-09-19T12:01:12.267 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T12:01:11.643+0000 7f123450b640 10 monclient: get_auth_request con 0x7f1224008040 auth_method 0 2024-09-19T12:01:12.267 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T12:01:11.643+0000 7f123550d640 10 monclient: get_auth_request con 0x7f1228040060 auth_method 0 2024-09-19T12:01:12.267 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T12:01:11.647+0000 7f123550d640 0 -- 172.21.15.120:0/1735176089 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f1228040060 msgr2=0x7f12280677a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:01:12.267 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T12:01:11.851+0000 7f123550d640 10 monclient: get_auth_request con 0x7f1228040060 auth_method 0 2024-09-19T12:01:12.267 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T12:01:11.851+0000 7f1234d0c640 10 monclient: get_auth_request con 0x7f122c0cb030 auth_method 0 2024-09-19T12:01:12.267 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T12:01:11.863+0000 7f123450b640 0 -- 172.21.15.120:0/1735176089 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f1224066250 msgr2=0x7f1224087a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:01:12.267 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T12:01:12.067+0000 7f123450b640 10 monclient: get_auth_request con 0x7f1224066250 auth_method 0 2024-09-19T12:01:12.267 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:01:12.268 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:01:12.268 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:01:12.268 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:01:12.268 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:01:12.268 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:01:12.268 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.268 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.268 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T12:01:12.079+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.268 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:12.268 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.268 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:01:12.268 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 zone default found 2024-09-19T12:01:12.269 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T12:01:12.083+0000 7f12372069c0 4 Realm: () 2024-09-19T12:01:12.269 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T12:01:12.083+0000 7f12372069c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:01:12.269 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T12:01:12.083+0000 7f12372069c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:01:12.269 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T12:01:12.083+0000 7f12372069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:01:12.269 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 zonegroup default 2024-09-19T12:01:12.269 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.269 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.269 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.269 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.269 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.269 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.269 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 started sync module instance, tier type = 2024-09-19T12:01:12.270 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T12:01:12.083+0000 7f12372069c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:01:12.270 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=0 2024-09-19T12:01:12.270 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=1 2024-09-19T12:01:12.270 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=2 2024-09-19T12:01:12.270 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=3 2024-09-19T12:01:12.270 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=4 2024-09-19T12:01:12.270 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=5 2024-09-19T12:01:12.270 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=6 2024-09-19T12:01:12.270 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T12:01:12.107+0000 7f12372069c0 20 add_watcher() i=7 2024-09-19T12:01:12.270 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T12:01:12.107+0000 7f12372069c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:01:12.270 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding auth protocol: cephx 2024-09-19T12:01:12.271 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding auth protocol: cephx 2024-09-19T12:01:12.271 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding auth protocol: cephx 2024-09-19T12:01:12.271 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: secure 2024-09-19T12:01:12.271 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: crc 2024-09-19T12:01:12.271 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: secure 2024-09-19T12:01:12.271 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: crc 2024-09-19T12:01:12.271 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: secure 2024-09-19T12:01:12.271 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: crc 2024-09-19T12:01:12.271 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: crc 2024-09-19T12:01:12.271 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: secure 2024-09-19T12:01:12.271 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: crc 2024-09-19T12:01:12.272 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: secure 2024-09-19T12:01:12.272 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: crc 2024-09-19T12:01:12.272 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T12:01:12.111+0000 7f12372069c0 5 AuthRegistry(0x7fffc0b69f00) adding con mode: secure 2024-09-19T12:01:12.272 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T12:01:12.111+0000 7f10eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:01:12.272 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T12:01:12.111+0000 7f12372069c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:12.272 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T12:01:12.111+0000 7f12372069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:01:12.272 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T12:01:12.115+0000 7f12372069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:01:12.272 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command cache list hook 0x5574bc6bed10 2024-09-19T12:01:12.272 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command cache inspect hook 0x5574bc6bed10 2024-09-19T12:01:12.272 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command cache erase hook 0x5574bc6bed10 2024-09-19T12:01:12.272 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command cache zap hook 0x5574bc6bed10 2024-09-19T12:01:12.272 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 note: GC not initialized 2024-09-19T12:01:12.273 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T12:01:12.115+0000 7f10e9fe3640 20 reqs_thread_entry: start 2024-09-19T12:01:12.273 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command sync trace show hook 0x7f1228004170 2024-09-19T12:01:12.273 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command sync trace history hook 0x7f1228004170 2024-09-19T12:01:12.273 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command sync trace active hook 0x7f1228004170 2024-09-19T12:01:12.273 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T12:01:12.115+0000 7f12372069c0 5 asok(0x5574bc3e5d90) register_command sync trace active_short hook 0x7f1228004170 2024-09-19T12:01:12.273 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T12:01:12.115+0000 7f12372069c0 20 init_complete bucket index max shards: 1 2024-09-19T12:01:12.273 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T12:01:12.115+0000 7f12372069c0 20 Filter name: none 2024-09-19T12:01:12.273 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T12:01:12.115+0000 7f105b7fe640 20 reqs_thread_entry: start 2024-09-19T12:01:12.273 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:01:12.273 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T12:01:12.115+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.273 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T12:01:12.115+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:01:12.273 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:01:12.274 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:01:12.274 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:01:12.274 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T12:01:12.115+0000 7f12372069c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.274 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T12:01:12.115+0000 7f12372069c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:01:12.274 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:12.274 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:12.274 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:01:12.274 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:12.274 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T12:01:12.115+0000 7f12372069c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:01:12.274 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T12:01:12.119+0000 7f12372069c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T12:01:12.274 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T12:01:12.127+0000 7f12372069c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:12.274 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T12:01:12.127+0000 7f12372069c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:12.275 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T12:01:12.127+0000 7f12372069c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:12.275 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T12:01:12.127+0000 7f12372069c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T12:01:12.275 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T12:01:12.127+0000 7f110bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366218 cookie 93959865971984 notifier 7802 bl.length()=911 2024-09-19T12:01:12.275 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T12:01:12.127+0000 7f110bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:12.275 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T12:01:12.127+0000 7f110bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:12.275 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T12:01:12.127+0000 7f110bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:12.275 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T12:01:12.131+0000 7f12372069c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T12:01:12.275 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T12:01:12.131+0000 7f12372069c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T12:01:12.275 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T12:01:12.131+0000 7f12372069c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T12:01:12.275 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T12:01:12.131+0000 7f12372069c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T12:01:12.276 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T12:01:12.135+0000 7f12372069c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f12372069c0 time 2024-09-19T12:01:12.139628+0000 2024-09-19T12:01:12.276 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:01:12.276 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.276 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:12.276 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f123aae02eb] 2024-09-19T12:01:12.276 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f123aae049f] 2024-09-19T12:01:12.276 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574baba1271] 2024-09-19T12:01:12.276 INFO:tasks.workunit.client.0.smithi120.stderr: 4: radosgw-admin(+0x141057c) [0x5574bb5f257c] 2024-09-19T12:01:12.276 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574babb10dd] 2024-09-19T12:01:12.276 INFO:tasks.workunit.client.0.smithi120.stderr: 6: main() 2024-09-19T12:01:12.277 INFO:tasks.workunit.client.0.smithi120.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1239946d90] 2024-09-19T12:01:12.277 INFO:tasks.workunit.client.0.smithi120.stderr: 8: __libc_start_main() 2024-09-19T12:01:12.277 INFO:tasks.workunit.client.0.smithi120.stderr: 9: _start() 2024-09-19T12:01:12.277 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.277 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T12:01:12.135+0000 7f12372069c0 -1 *** Caught signal (Aborted) ** 2024-09-19T12:01:12.277 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f12372069c0 thread_name:radosgw-admin 2024-09-19T12:01:12.277 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.277 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:12.277 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f123995f520] 2024-09-19T12:01:12.277 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:01:12.277 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:01:12.278 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:01:12.278 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f123aae0345] 2024-09-19T12:01:12.278 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f123aae049f] 2024-09-19T12:01:12.278 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5574baba1271] 2024-09-19T12:01:12.278 INFO:tasks.workunit.client.0.smithi120.stderr: 8: radosgw-admin(+0x141057c) [0x5574bb5f257c] 2024-09-19T12:01:12.278 INFO:tasks.workunit.client.0.smithi120.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5574babb10dd] 2024-09-19T12:01:12.278 INFO:tasks.workunit.client.0.smithi120.stderr: 10: main() 2024-09-19T12:01:12.278 INFO:tasks.workunit.client.0.smithi120.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1239946d90] 2024-09-19T12:01:12.278 INFO:tasks.workunit.client.0.smithi120.stderr: 12: __libc_start_main() 2024-09-19T12:01:12.278 INFO:tasks.workunit.client.0.smithi120.stderr: 13: _start() 2024-09-19T12:01:12.278 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T12:01:12.278 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:12.279 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T12:01:12.279 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T12:01:12.279 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T12:01:12.279 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T12:01:12.279 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T12:01:12.279 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T12:01:12.279 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T12:01:12.279 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T12:01:12.279 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T12:01:12.279 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T12:01:12.279 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T12:01:12.279 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T12:01:12.280 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T12:01:12.280 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T12:01:12.280 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T12:01:12.280 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T12:01:12.280 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T12:01:12.280 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T12:01:12.280 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T12:01:12.280 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T12:01:12.280 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T12:01:12.280 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T12:01:12.280 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T12:01:12.280 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T12:01:12.281 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T12:01:12.281 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T12:01:12.281 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T12:01:12.281 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T12:01:12.281 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T12:01:12.281 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T12:01:12.281 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T12:01:12.281 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T12:01:12.281 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T12:01:12.281 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T12:01:12.281 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T12:01:12.282 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T12:01:12.282 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T12:01:12.282 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T12:01:12.282 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T12:01:12.282 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T12:01:12.282 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T12:01:12.282 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T12:01:12.282 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T12:01:12.282 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T12:01:12.282 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T12:01:12.282 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T12:01:12.283 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T12:01:12.283 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T12:01:12.283 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T12:01:12.283 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T12:01:12.283 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T12:01:12.283 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T12:01:12.283 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T12:01:12.283 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T12:01:12.283 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T12:01:12.283 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T12:01:12.283 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T12:01:12.283 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T12:01:12.284 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T12:01:12.284 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T12:01:12.284 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T12:01:12.284 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T12:01:12.284 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T12:01:12.284 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T12:01:12.284 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T12:01:12.284 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T12:01:12.284 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T12:01:12.284 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T12:01:12.284 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T12:01:12.284 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T12:01:12.285 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T12:01:12.285 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T12:01:12.285 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T12:01:12.285 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T12:01:12.285 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T12:01:12.285 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T12:01:12.285 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T12:01:12.285 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T12:01:12.285 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T12:01:12.285 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T12:01:12.285 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T12:01:12.285 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T12:01:12.286 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T12:01:12.286 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T12:01:12.286 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T12:01:12.286 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T12:01:12.286 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T12:01:12.286 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T12:01:12.286 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T12:01:12.286 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T12:01:12.286 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T12:01:12.286 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T12:01:12.286 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T12:01:12.286 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T12:01:12.286 INFO:tasks.workunit.client.0.smithi120.stderr: 7f105b7fe640 / http_manager 2024-09-19T12:01:12.287 INFO:tasks.workunit.client.0.smithi120.stderr: 7f10e9fe3640 / http_manager 2024-09-19T12:01:12.287 INFO:tasks.workunit.client.0.smithi120.stderr: 7f10eafe5640 / rgw_dt_lg_renew 2024-09-19T12:01:12.287 INFO:tasks.workunit.client.0.smithi120.stderr: 7f110a7fc640 / ms_dispatch 2024-09-19T12:01:12.287 INFO:tasks.workunit.client.0.smithi120.stderr: 7f110bfff640 / io_context_pool 2024-09-19T12:01:12.287 INFO:tasks.workunit.client.0.smithi120.stderr: 7f111a7fc640 / ms_dispatch 2024-09-19T12:01:12.287 INFO:tasks.workunit.client.0.smithi120.stderr: 7f112160a640 / ms_dispatch 2024-09-19T12:01:12.287 INFO:tasks.workunit.client.0.smithi120.stderr: 7f1122e0d640 / io_context_pool 2024-09-19T12:01:12.287 INFO:tasks.workunit.client.0.smithi120.stderr: 7f123450b640 / msgr-worker-2 2024-09-19T12:01:12.287 INFO:tasks.workunit.client.0.smithi120.stderr: 7f1234d0c640 / msgr-worker-1 2024-09-19T12:01:12.287 INFO:tasks.workunit.client.0.smithi120.stderr: 7f123550d640 / msgr-worker-0 2024-09-19T12:01:12.287 INFO:tasks.workunit.client.0.smithi120.stderr: 7f1235d0e640 / io_context_pool 2024-09-19T12:01:12.287 INFO:tasks.workunit.client.0.smithi120.stderr: 7f12372069c0 / radosgw-admin 2024-09-19T12:01:12.288 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T12:01:12.288 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T12:01:12.288 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/lib/ceph/crash/2024-09-19T12:01:12.142104Z_717ed734-d77b-41d3-8f05-06d44fbb037f/log 2024-09-19T12:01:12.288 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T12:01:12.288 INFO:tasks.workunit.client.0.smithi120.stderr:Aborted 2024-09-19T12:01:12.288 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T12:01:12.290 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:01:12.290 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:01:12.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.223+0000 7fa2873b69c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.227+0000 7fa2873b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.227+0000 7fa2873b69c0 20 realm 2024-09-19T12:01:12.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.227+0000 7fa2873b69c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.227+0000 7fa2873b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.227+0000 7fa2873b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:01:12.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.227+0000 7fa2873b69c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.290 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.227+0000 7fa2873b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.227+0000 7fa2873b69c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.227+0000 7fa2873b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:12.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.227+0000 7fa2873b69c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.231+0000 7fa2873b69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:01:12.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.231+0000 7fa2873b69c0 20 searching for the correct realm 2024-09-19T12:01:12.291 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.231+0000 7fa2856bd640 0 -- 172.21.15.120:0/1311710615 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fa278070020 msgr2=0x7fa2780574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:01:12.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.451+0000 7fa2846bb640 0 -- 172.21.15.120:0/1311710615 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fa274022070 msgr2=0x7fa27403e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:01:12.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:01:12.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:01:12.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:01:12.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:01:12.667 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:01:12.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:01:12.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.668 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:12.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:01:12.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 zone default found 2024-09-19T12:01:12.669 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 4 Realm: () 2024-09-19T12:01:12.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:01:12.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:01:12.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:01:12.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 zonegroup default 2024-09-19T12:01:12.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.670 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.671+0000 7fa2873b69c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.675+0000 7fa2873b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.675+0000 7fa2873b69c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.675+0000 7fa2873b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:12.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.675+0000 7fa2873b69c0 20 started sync module instance, tier type = 2024-09-19T12:01:12.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.675+0000 7fa2873b69c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:01:12.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.695+0000 7fa2873b69c0 20 add_watcher() i=0 2024-09-19T12:01:12.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.695+0000 7fa2873b69c0 20 add_watcher() i=1 2024-09-19T12:01:12.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.695+0000 7fa2873b69c0 20 add_watcher() i=2 2024-09-19T12:01:12.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.695+0000 7fa2873b69c0 20 add_watcher() i=3 2024-09-19T12:01:12.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.695+0000 7fa2873b69c0 20 add_watcher() i=4 2024-09-19T12:01:12.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.695+0000 7fa2873b69c0 20 add_watcher() i=5 2024-09-19T12:01:12.694 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.695+0000 7fa2873b69c0 20 add_watcher() i=6 2024-09-19T12:01:12.696 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.699+0000 7fa2873b69c0 20 add_watcher() i=7 2024-09-19T12:01:12.696 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.699+0000 7fa2873b69c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:01:12.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.703+0000 7fa13afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:01:12.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.703+0000 7fa2873b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:01:12.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.703+0000 7fa2873b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:01:12.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.703+0000 7fa2873b69c0 5 note: GC not initialized 2024-09-19T12:01:12.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.703+0000 7fa139fe3640 20 reqs_thread_entry: start 2024-09-19T12:01:12.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.703+0000 7fa2873b69c0 20 init_complete bucket index max shards: 1 2024-09-19T12:01:12.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.703+0000 7fa2873b69c0 20 Filter name: none 2024-09-19T12:01:12.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.703+0000 7fa0ab7fe640 20 reqs_thread_entry: start 2024-09-19T12:01:12.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.703+0000 7fa2873b69c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:01:12.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.703+0000 7fa2873b69c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:01:12.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:01:12.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:01:12.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:01:12.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:12.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:01:12.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:12.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:12.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:01:12.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:12.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:01:12.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:01:12.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:01:12.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:01:12.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:01:12.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:01:12.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.707+0000 7fa2873b69c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:01:12.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.711+0000 7fa13afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:01:12.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.715+0000 7fa2873b69c0 20 remove_watcher() i=0 2024-09-19T12:01:12.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.715+0000 7fa2873b69c0 2 removed watcher, disabling cache 2024-09-19T12:01:12.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.719+0000 7fa2873b69c0 20 remove_watcher() i=1 2024-09-19T12:01:12.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.719+0000 7fa2873b69c0 20 remove_watcher() i=2 2024-09-19T12:01:12.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.723+0000 7fa2873b69c0 20 remove_watcher() i=3 2024-09-19T12:01:12.723 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.727+0000 7fa2873b69c0 20 remove_watcher() i=4 2024-09-19T12:01:12.725 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.727+0000 7fa2873b69c0 20 remove_watcher() i=5 2024-09-19T12:01:12.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.727+0000 7fa2873b69c0 20 remove_watcher() i=6 2024-09-19T12:01:12.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:12.731+0000 7fa2873b69c0 20 remove_watcher() i=7 2024-09-19T12:01:12.747 INFO:tasks.workunit.client.0.smithi120.stderr: test: duplicated entries can be purged manually 2024-09-19T12:01:42.777 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T12:01:42.809 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:01:42.809 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:01:42.856 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:42.862+0000 7fd0d98959c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:42.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:42.862+0000 7fd0d98959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:42.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:42.862+0000 7fd0d98959c0 20 realm 2024-09-19T12:01:42.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:42.862+0000 7fd0d98959c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:42.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:42.862+0000 7fd0d98959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:42.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:42.862+0000 7fd0d98959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:01:42.858 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:42.862+0000 7fd0d98959c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:42.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:42.862+0000 7fd0d98959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:42.859 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:42.862+0000 7fd0d98959c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:42.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:42.866+0000 7fd0d98959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:42.860 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:42.866+0000 7fd0d98959c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:42.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:42.866+0000 7fd0d98959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:01:42.862 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:42.866+0000 7fd0d98959c0 20 searching for the correct realm 2024-09-19T12:01:42.865 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:42.870+0000 7fd0d7b9c640 0 -- 172.21.15.120:0/964968271 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fd0cc018070 msgr2=0x7fd0cc092a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:01:43.080 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.086+0000 7fd0d6b9a640 0 -- 172.21.15.120:0/964968271 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fd0c80cf040 msgr2=0x7fd0c80b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:01:43.299 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.302+0000 7fd0d98959c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:01:43.299 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.302+0000 7fd0d98959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:01:43.299 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.302+0000 7fd0d98959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:01:43.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.302+0000 7fd0d98959c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:01:43.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.302+0000 7fd0d98959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:01:43.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.302+0000 7fd0d98959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:01:43.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.302+0000 7fd0d98959c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:43.300 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:43.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:01:43.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 20 zone default found 2024-09-19T12:01:43.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 4 Realm: () 2024-09-19T12:01:43.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:01:43.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:01:43.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:01:43.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 20 zonegroup default 2024-09-19T12:01:43.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.302 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:43.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:43.303 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.306+0000 7fd0d98959c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.310+0000 7fd0d98959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:43.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.310+0000 7fd0d98959c0 20 started sync module instance, tier type = 2024-09-19T12:01:43.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.310+0000 7fd0d98959c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:01:43.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.334+0000 7fd0d98959c0 20 add_watcher() i=0 2024-09-19T12:01:43.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.334+0000 7fd0d98959c0 20 add_watcher() i=1 2024-09-19T12:01:43.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.334+0000 7fd0d98959c0 20 add_watcher() i=2 2024-09-19T12:01:43.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.334+0000 7fd0d98959c0 20 add_watcher() i=3 2024-09-19T12:01:43.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.334+0000 7fd0d98959c0 20 add_watcher() i=4 2024-09-19T12:01:43.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.334+0000 7fd0d98959c0 20 add_watcher() i=5 2024-09-19T12:01:43.328 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.334+0000 7fd0d98959c0 20 add_watcher() i=6 2024-09-19T12:01:43.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.334+0000 7fd0d98959c0 20 add_watcher() i=7 2024-09-19T12:01:43.330 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.334+0000 7fd0d98959c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:01:43.335 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.338+0000 7fcf8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:01:43.336 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.342+0000 7fd0d98959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:01:43.336 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.342+0000 7fd0d98959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:01:43.336 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.342+0000 7fd0d98959c0 5 note: GC not initialized 2024-09-19T12:01:43.337 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.342+0000 7fcf8cfe1640 20 reqs_thread_entry: start 2024-09-19T12:01:43.337 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.342+0000 7fd0d98959c0 20 init_complete bucket index max shards: 1 2024-09-19T12:01:43.337 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.342+0000 7fd0d98959c0 20 Filter name: none 2024-09-19T12:01:43.337 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.342+0000 7fcf067fc640 20 reqs_thread_entry: start 2024-09-19T12:01:43.337 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.342+0000 7fd0d98959c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.342+0000 7fd0d98959c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:01:43.338 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.342+0000 7fd0d98959c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.346+0000 7fd0d98959c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:01:43.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.346+0000 7fd0d98959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:01:43.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.346+0000 7fd0d98959c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.346+0000 7fd0d98959c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:01:43.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.346+0000 7fd0d98959c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.346+0000 7fd0d98959c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:01:43.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.346+0000 7fd0d98959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:01:43.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.350+0000 7fcf8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:01:43.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.354+0000 7fd0d98959c0 20 remove_watcher() i=0 2024-09-19T12:01:43.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.354+0000 7fd0d98959c0 2 removed watcher, disabling cache 2024-09-19T12:01:43.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.358+0000 7fd0d98959c0 20 remove_watcher() i=1 2024-09-19T12:01:43.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.358+0000 7fd0d98959c0 20 remove_watcher() i=2 2024-09-19T12:01:43.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.362+0000 7fd0d98959c0 20 remove_watcher() i=3 2024-09-19T12:01:43.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.362+0000 7fd0d98959c0 20 remove_watcher() i=4 2024-09-19T12:01:43.359 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.366+0000 7fd0d98959c0 20 remove_watcher() i=5 2024-09-19T12:01:43.361 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.366+0000 7fd0d98959c0 20 remove_watcher() i=6 2024-09-19T12:01:43.362 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.366+0000 7fd0d98959c0 20 remove_watcher() i=7 2024-09-19T12:01:43.377 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:43.378 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T12:01:43.378 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: a-bucket id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 num_objects: 11 size_kb: 1 num_shards: 3 2024-09-19T12:01:43.378 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:43.378 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-19T12:01:43.410 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:01:43.410 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:01:43.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.458+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:43.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 realm 2024-09-19T12:01:43.455 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:43.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.462+0000 7f09c0b589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:01:43.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:43.456 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.457 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:43.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.466+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:01:43.459 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.466+0000 7f09c0b589c0 20 searching for the correct realm 2024-09-19T12:01:43.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.466+0000 7f09bee5f640 0 -- 172.21.15.120:0/3537482390 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f09b40b9b20 msgr2=0x7f09b40f7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:01:43.677 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.682+0000 7f09bde5d640 0 -- 172.21.15.120:0/3537482390 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f09b0038040 msgr2=0x7f09b0038420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:01:43.894 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:01:43.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:01:43.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:01:43.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:01:43.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:01:43.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:01:43.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:43.895 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:43.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.896 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:01:43.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 zone default found 2024-09-19T12:01:43.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 4 Realm: () 2024-09-19T12:01:43.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:01:43.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:01:43.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:01:43.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 zonegroup default 2024-09-19T12:01:43.897 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:43.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:43.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:43.898 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 started sync module instance, tier type = 2024-09-19T12:01:43.899 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:01:43.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=0 2024-09-19T12:01:43.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=1 2024-09-19T12:01:43.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=2 2024-09-19T12:01:43.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=3 2024-09-19T12:01:43.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=4 2024-09-19T12:01:43.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=5 2024-09-19T12:01:43.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=6 2024-09-19T12:01:43.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.930+0000 7f09c0b589c0 20 add_watcher() i=7 2024-09-19T12:01:43.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.930+0000 7f09c0b589c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:01:43.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.934+0000 7f0874fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:01:43.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.934+0000 7f09c0b589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:01:43.929 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.934+0000 7f09c0b589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:01:43.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 note: GC not initialized 2024-09-19T12:01:43.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.934+0000 7f07ef7fe640 20 reqs_thread_entry: start 2024-09-19T12:01:43.930 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.934+0000 7f09c0b589c0 20 init_complete bucket index max shards: 1 2024-09-19T12:01:43.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.934+0000 7f09c0b589c0 20 Filter name: none 2024-09-19T12:01:43.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.934+0000 7f07ed7fa640 20 reqs_thread_entry: start 2024-09-19T12:01:43.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.934+0000 7f09c0b589c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:01:43.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.934+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.931 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.938+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:01:43.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:01:43.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:01:43.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:01:43.932 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.938+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:43.933 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.938+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:01:43.933 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:43.933 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:43.933 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:01:43.933 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:43.933 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:01:43.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T12:01:43.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.950+0000 7f09c0b589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:43.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.950+0000 7f09c0b589c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:43.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.950+0000 7f09c0b589c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:43.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.950+0000 7f09c0b589c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T12:01:43.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.950+0000 7f08a17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366219 cookie 94611485579856 notifier 8463 bl.length()=911 2024-09-19T12:01:43.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.950+0000 7f08a17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:43.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.950+0000 7f08a17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:43.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.950+0000 7f08a17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:43.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.950+0000 7f09c0b589c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T12:01:43.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.950+0000 7f09c0b589c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T12:01:43.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.950+0000 7f09c0b589c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T12:01:43.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.950+0000 7f09c0b589c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T12:01:43.951 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f09c0b589c0 time 2024-09-19T12:01:43.958668+0000 2024-09-19T12:01:43.951 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:01:43.953 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:43.953 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f09c44322eb] 2024-09-19T12:01:43.953 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f09c443249f] 2024-09-19T12:01:43.953 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c72a1c271] 2024-09-19T12:01:43.953 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560c72a2c14a] 2024-09-19T12:01:43.953 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T12:01:43.954 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f09c3298d90] 2024-09-19T12:01:43.954 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T12:01:43.954 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T12:01:43.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.958+0000 7f09c0b589c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f09c0b589c0 time 2024-09-19T12:01:43.958668+0000 2024-09-19T12:01:43.954 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:01:43.954 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:43.954 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:43.954 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f09c44322eb] 2024-09-19T12:01:43.954 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f09c443249f] 2024-09-19T12:01:43.954 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c72a1c271] 2024-09-19T12:01:43.954 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560c72a2c14a] 2024-09-19T12:01:43.954 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T12:01:43.955 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f09c3298d90] 2024-09-19T12:01:43.955 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T12:01:43.955 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T12:01:43.955 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:43.955 INFO:tasks.workunit.client.0.smithi120.stderr:*** Caught signal (Aborted) ** 2024-09-19T12:01:43.955 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f09c0b589c0 thread_name:radosgw-admin 2024-09-19T12:01:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f09c32b1520] 2024-09-19T12:01:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:01:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:01:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:01:43.979 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f09c4432345] 2024-09-19T12:01:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f09c443249f] 2024-09-19T12:01:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c72a1c271] 2024-09-19T12:01:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560c72a2c14a] 2024-09-19T12:01:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T12:01:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f09c3298d90] 2024-09-19T12:01:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T12:01:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T12:01:43.980 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:43.958+0000 7f09c0b589c0 -1 *** Caught signal (Aborted) ** 2024-09-19T12:01:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f09c0b589c0 thread_name:radosgw-admin 2024-09-19T12:01:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:43.980 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f09c32b1520] 2024-09-19T12:01:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:01:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:01:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:01:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f09c4432345] 2024-09-19T12:01:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f09c443249f] 2024-09-19T12:01:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c72a1c271] 2024-09-19T12:01:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560c72a2c14a] 2024-09-19T12:01:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T12:01:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f09c3298d90] 2024-09-19T12:01:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T12:01:43.981 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T12:01:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T12:01:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:43.982 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T12:01:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): get_auth_request con 0x560c73ed7ba0 auth_method 0 2024-09-19T12:01:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T12:01:43.438+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T12:01:43.438+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T12:01:43.438+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:43.982 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_done global_id 8451 payload 274 2024-09-19T12:01:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient: _finish_hunting 0 2024-09-19T12:01:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T12:01:43.438+0000 7f09bde5d640 1 monclient: found mon.noname-a 2024-09-19T12:01:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:01:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:01:43.983 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: dump: 2024-09-19T12:01:43.983 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:43.983 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:43.983 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:43.983 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:43.983 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:43.983 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:43.984 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:43.984 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:43.984 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: _finish_auth 0 2024-09-19T12:01:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: _check_auth_tickets 2024-09-19T12:01:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 monclient: authenticate success, global_id 8451 2024-09-19T12:01:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient: get_monmap_and_config success 2024-09-19T12:01:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 4 set_mon_vals no callback set 2024-09-19T12:01:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:43.984 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:01:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: dump: 2024-09-19T12:01:43.985 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:43.985 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:43.985 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:43.985 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:43.985 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:43.985 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:43.985 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:43.985 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:43.985 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient: shutdown 2024-09-19T12:01:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) unregister_commands rotate-key 2024-09-19T12:01:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient: build_initial_monmap 2024-09-19T12:01:43.985 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:43.986 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient: monmap: 2024-09-19T12:01:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:43.986 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:43.986 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:43.986 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding auth protocol: cephx 2024-09-19T12:01:43.986 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding auth protocol: cephx 2024-09-19T12:01:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding auth protocol: cephx 2024-09-19T12:01:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: secure 2024-09-19T12:01:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: crc 2024-09-19T12:01:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: secure 2024-09-19T12:01:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: crc 2024-09-19T12:01:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: secure 2024-09-19T12:01:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: crc 2024-09-19T12:01:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: crc 2024-09-19T12:01:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: secure 2024-09-19T12:01:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: crc 2024-09-19T12:01:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: secure 2024-09-19T12:01:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: crc 2024-09-19T12:01:43.987 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: secure 2024-09-19T12:01:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 1 librados: starting msgr at 2024-09-19T12:01:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 1 librados: starting objecter 2024-09-19T12:01:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command objecter_requests hook 0x560c73c8a3d0 2024-09-19T12:01:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 1 librados: setting wanted keys 2024-09-19T12:01:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 1 librados: calling monclient init 2024-09-19T12:01:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient: init 2024-09-19T12:01:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding auth protocol: cephx 2024-09-19T12:01:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding auth protocol: cephx 2024-09-19T12:01:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding auth protocol: cephx 2024-09-19T12:01:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: secure 2024-09-19T12:01:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: crc 2024-09-19T12:01:43.988 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: secure 2024-09-19T12:01:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: crc 2024-09-19T12:01:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: secure 2024-09-19T12:01:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: crc 2024-09-19T12:01:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: crc 2024-09-19T12:01:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: secure 2024-09-19T12:01:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: crc 2024-09-19T12:01:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: secure 2024-09-19T12:01:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: crc 2024-09-19T12:01:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: secure 2024-09-19T12:01:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command rotate-key hook 0x560c73ed4908 2024-09-19T12:01:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:43.989 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T12:01:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-b con 0x560c73ed7ba0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-c con 0x560c73f01180 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-a con 0x7f09a8003100 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): authenticate will time out at 2597.755117s 2024-09-19T12:01:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): get_auth_request con 0x560c73f01180 auth_method 0 2024-09-19T12:01:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T12:01:43.438+0000 7f09bee5f640 10 monclient(hunting): get_auth_request con 0x7f09a8003100 auth_method 0 2024-09-19T12:01:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T12:01:43.438+0000 7f09bee5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:43.990 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T12:01:43.438+0000 7f09bee5f640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T12:01:43.438+0000 7f09bee5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T12:01:43.438+0000 7f09bee5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T12:01:43.438+0000 7f09bee5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T12:01:43.438+0000 7f09bee5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_done global_id 7844 payload 824 2024-09-19T12:01:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient: _finish_hunting 0 2024-09-19T12:01:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T12:01:43.438+0000 7f09bde5d640 1 monclient: found mon.noname-c 2024-09-19T12:01:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:01:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:01:43.991 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: dump: 2024-09-19T12:01:43.992 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:43.992 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:43.992 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:43.992 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:43.992 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:43.992 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:43.992 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:43.992 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:43.992 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: _finish_auth 0 2024-09-19T12:01:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: _check_auth_tickets 2024-09-19T12:01:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:43.992 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:01:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: dump: 2024-09-19T12:01:43.993 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:43.993 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:43.993 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:43.993 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:43.993 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:43.993 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:43.993 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:43.993 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:43.993 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T12:01:43.438+0000 7f08ac608640 4 set_mon_vals no callback set 2024-09-19T12:01:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T12:01:43.442+0000 7f09c0b589c0 5 monclient: authenticate success, global_id 7844 2024-09-19T12:01:43.993 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T12:01:43.442+0000 7f09c0b589c0 10 monclient: _renew_subs 2024-09-19T12:01:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T12:01:43.442+0000 7f09c0b589c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T12:01:43.442+0000 7f09c0b589c0 10 monclient: _renew_subs 2024-09-19T12:01:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T12:01:43.442+0000 7f09c0b589c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T12:01:43.442+0000 7f09c0b589c0 1 librados: init done 2024-09-19T12:01:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T12:01:43.442+0000 7f08aae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:01:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T12:01:43.442+0000 7f08aae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T12:01:43.442+0000 7f08aae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T12:01:43.442+0000 7f09be65e640 10 monclient: get_auth_request con 0x7f08a4071be0 auth_method 0 2024-09-19T12:01:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T12:01:43.442+0000 7f09bee5f640 10 monclient: get_auth_request con 0x560c73effb00 auth_method 0 2024-09-19T12:01:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T12:01:43.442+0000 7f09be65e640 10 monclient: get_auth_request con 0x560c73f1fab0 auth_method 0 2024-09-19T12:01:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T12:01:43.446+0000 7f09bde5d640 10 monclient: get_auth_request con 0x560c73f23ca0 auth_method 0 2024-09-19T12:01:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T12:01:43.446+0000 7f09bee5f640 10 monclient: get_auth_request con 0x560c73f23380 auth_method 0 2024-09-19T12:01:43.994 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: build_initial_monmap 2024-09-19T12:01:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: monmap: 2024-09-19T12:01:43.995 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:43.995 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:43.995 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:43.995 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:43.995 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:43.995 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:43.995 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:43.995 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:43.995 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding auth protocol: cephx 2024-09-19T12:01:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding auth protocol: cephx 2024-09-19T12:01:43.995 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding auth protocol: cephx 2024-09-19T12:01:43.996 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: secure 2024-09-19T12:01:43.996 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: crc 2024-09-19T12:01:43.996 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: secure 2024-09-19T12:01:43.996 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: crc 2024-09-19T12:01:43.996 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: secure 2024-09-19T12:01:43.996 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: crc 2024-09-19T12:01:43.996 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: crc 2024-09-19T12:01:43.996 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: secure 2024-09-19T12:01:43.996 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: crc 2024-09-19T12:01:43.996 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: secure 2024-09-19T12:01:43.996 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: crc 2024-09-19T12:01:43.996 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: secure 2024-09-19T12:01:43.996 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command objecter_requests cmddesc objecter_requests hook 0x560c73f2f860 EEXIST 2024-09-19T12:01:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: init 2024-09-19T12:01:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding auth protocol: cephx 2024-09-19T12:01:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding auth protocol: cephx 2024-09-19T12:01:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding auth protocol: cephx 2024-09-19T12:01:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: secure 2024-09-19T12:01:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: crc 2024-09-19T12:01:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: secure 2024-09-19T12:01:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: crc 2024-09-19T12:01:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: secure 2024-09-19T12:01:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: crc 2024-09-19T12:01:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: crc 2024-09-19T12:01:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: secure 2024-09-19T12:01:43.997 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: crc 2024-09-19T12:01:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: secure 2024-09-19T12:01:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: crc 2024-09-19T12:01:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: secure 2024-09-19T12:01:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command rotate-key cmddesc rotate-key hook 0x560c73f2af30 EEXIST 2024-09-19T12:01:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T12:01:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-b con 0x560c73f53a10 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-c con 0x560c73f53340 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-a con 0x560c73f51d20 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:43.998 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): authenticate will time out at 2597.765619s 2024-09-19T12:01:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): get_auth_request con 0x560c73f53340 auth_method 0 2024-09-19T12:01:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T12:01:43.450+0000 7f09be65e640 10 monclient(hunting): get_auth_request con 0x560c73f51d20 auth_method 0 2024-09-19T12:01:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T12:01:43.450+0000 7f09be65e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T12:01:43.450+0000 7f09be65e640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T12:01:43.450+0000 7f09be65e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:43.999 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T12:01:43.450+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T12:01:43.450+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T12:01:43.450+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): handle_auth_done global_id 7847 payload 824 2024-09-19T12:01:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient: _finish_hunting 0 2024-09-19T12:01:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T12:01:43.450+0000 7f09bee5f640 1 monclient: found mon.noname-c 2024-09-19T12:01:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:01:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:01:44.000 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: dump: 2024-09-19T12:01:44.000 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.000 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.000 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.000 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.000 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.000 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.001 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.001 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.001 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: _finish_auth 0 2024-09-19T12:01:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: _check_auth_tickets 2024-09-19T12:01:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:01:44.001 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: dump: 2024-09-19T12:01:44.001 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.001 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.001 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 monclient: authenticate success, global_id 7847 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T12:01:43.450+0000 7f09bf660640 4 set_mon_vals no callback set 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: _renew_subs 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: _renew_subs 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T12:01:43.454+0000 7f08a3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T12:01:43.454+0000 7f08a3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:44.002 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T12:01:43.454+0000 7f08a3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: get_monmap_and_config 2024-09-19T12:01:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: build_initial_monmap 2024-09-19T12:01:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:44.003 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: monmap: 2024-09-19T12:01:44.003 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:44.003 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:44.003 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:44.003 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:44.003 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:44.003 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.003 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:44.003 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:44.004 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding auth protocol: cephx 2024-09-19T12:01:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding auth protocol: cephx 2024-09-19T12:01:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding auth protocol: cephx 2024-09-19T12:01:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: secure 2024-09-19T12:01:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: crc 2024-09-19T12:01:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: secure 2024-09-19T12:01:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: crc 2024-09-19T12:01:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: secure 2024-09-19T12:01:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: crc 2024-09-19T12:01:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: crc 2024-09-19T12:01:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: secure 2024-09-19T12:01:44.004 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: crc 2024-09-19T12:01:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: secure 2024-09-19T12:01:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: crc 2024-09-19T12:01:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: secure 2024-09-19T12:01:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient: get_auth_request con 0x7f0898071b20 auth_method 0 2024-09-19T12:01:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: init 2024-09-19T12:01:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding auth protocol: cephx 2024-09-19T12:01:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding auth protocol: cephx 2024-09-19T12:01:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding auth protocol: cephx 2024-09-19T12:01:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: secure 2024-09-19T12:01:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: crc 2024-09-19T12:01:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: secure 2024-09-19T12:01:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: crc 2024-09-19T12:01:44.005 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: secure 2024-09-19T12:01:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: crc 2024-09-19T12:01:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: crc 2024-09-19T12:01:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: secure 2024-09-19T12:01:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: crc 2024-09-19T12:01:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: secure 2024-09-19T12:01:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: crc 2024-09-19T12:01:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: secure 2024-09-19T12:01:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command rotate-key cmddesc rotate-key hook 0x7ffdb10077e8 EEXIST 2024-09-19T12:01:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:44.006 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T12:01:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-a con 0x560c73fa1b00 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-b con 0x560c73fa76b0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-c con 0x560c73f98870 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): authenticate will time out at 2597.769994s 2024-09-19T12:01:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): get_auth_request con 0x560c73fa1b00 auth_method 0 2024-09-19T12:01:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:44.007 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T12:01:43.454+0000 7f09be65e640 10 monclient(hunting): get_auth_request con 0x560c73f98870 auth_method 0 2024-09-19T12:01:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T12:01:43.454+0000 7f09be65e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T12:01:43.454+0000 7f09be65e640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T12:01:43.454+0000 7f09be65e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T12:01:43.454+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T12:01:43.454+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T12:01:43.454+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): handle_auth_done global_id 8460 payload 274 2024-09-19T12:01:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient: _finish_hunting 0 2024-09-19T12:01:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T12:01:43.454+0000 7f09bde5d640 1 monclient: found mon.noname-a 2024-09-19T12:01:44.008 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:01:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:01:44.009 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: dump: 2024-09-19T12:01:44.009 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.009 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.009 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.009 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.009 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.009 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.009 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.009 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.009 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: _finish_auth 0 2024-09-19T12:01:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: _check_auth_tickets 2024-09-19T12:01:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:01:44.010 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: dump: 2024-09-19T12:01:44.010 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.010 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.010 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.010 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.010 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.010 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.010 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.011 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.011 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 monclient: authenticate success, global_id 8460 2024-09-19T12:01:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: get_monmap_and_config success 2024-09-19T12:01:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 4 set_mon_vals no callback set 2024-09-19T12:01:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: shutdown 2024-09-19T12:01:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: build_initial_monmap 2024-09-19T12:01:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:44.011 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: monmap: 2024-09-19T12:01:44.011 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:44.011 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:44.011 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:44.012 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:44.012 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:44.012 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.012 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:44.012 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:44.012 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding auth protocol: cephx 2024-09-19T12:01:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding auth protocol: cephx 2024-09-19T12:01:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding auth protocol: cephx 2024-09-19T12:01:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: secure 2024-09-19T12:01:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: crc 2024-09-19T12:01:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: secure 2024-09-19T12:01:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: crc 2024-09-19T12:01:44.012 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: secure 2024-09-19T12:01:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: crc 2024-09-19T12:01:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: crc 2024-09-19T12:01:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: secure 2024-09-19T12:01:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: crc 2024-09-19T12:01:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: secure 2024-09-19T12:01:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: crc 2024-09-19T12:01:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: secure 2024-09-19T12:01:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 1 librados: starting msgr at 2024-09-19T12:01:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 1 librados: starting objecter 2024-09-19T12:01:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command objecter_requests cmddesc objecter_requests hook 0x560c73edecc0 EEXIST 2024-09-19T12:01:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 1 librados: setting wanted keys 2024-09-19T12:01:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 1 librados: calling monclient init 2024-09-19T12:01:44.013 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: init 2024-09-19T12:01:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding auth protocol: cephx 2024-09-19T12:01:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding auth protocol: cephx 2024-09-19T12:01:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding auth protocol: cephx 2024-09-19T12:01:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: secure 2024-09-19T12:01:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: crc 2024-09-19T12:01:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: secure 2024-09-19T12:01:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: crc 2024-09-19T12:01:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: secure 2024-09-19T12:01:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: crc 2024-09-19T12:01:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: crc 2024-09-19T12:01:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: secure 2024-09-19T12:01:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: crc 2024-09-19T12:01:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: secure 2024-09-19T12:01:44.014 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: crc 2024-09-19T12:01:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: secure 2024-09-19T12:01:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command rotate-key cmddesc rotate-key hook 0x560c73f55978 EEXIST 2024-09-19T12:01:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T12:01:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-a con 0x560c73f98870 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-b con 0x560c73fa1b00 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-c con 0x560c73fa0480 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): authenticate will time out at 2597.772454s 2024-09-19T12:01:44.015 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): get_auth_request con 0x560c73f98870 auth_method 0 2024-09-19T12:01:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient(hunting): get_auth_request con 0x560c73fa0480 auth_method 0 2024-09-19T12:01:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): handle_auth_done global_id 8463 payload 824 2024-09-19T12:01:44.016 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient: _finish_hunting 0 2024-09-19T12:01:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T12:01:43.458+0000 7f09bde5d640 1 monclient: found mon.noname-a 2024-09-19T12:01:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:01:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:01:44.017 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: dump: 2024-09-19T12:01:44.017 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.017 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.017 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.017 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.017 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.017 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.017 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.017 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.017 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: _finish_auth 0 2024-09-19T12:01:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: _check_auth_tickets 2024-09-19T12:01:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:01:44.018 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: dump: 2024-09-19T12:01:44.018 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.018 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.018 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.018 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.018 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.018 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.018 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 5 monclient: authenticate success, global_id 8463 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T12:01:43.458+0000 7f08a1ffb640 4 set_mon_vals no callback set 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient: _renew_subs 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient: _renew_subs 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 1 librados: init done 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command cr dump hook 0x560c73fa1ef8 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T12:01:43.458+0000 7f088ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T12:01:43.458+0000 7f088ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T12:01:43.458+0000 7f088ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.019 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T12:01:43.458+0000 7f09bee5f640 10 monclient: get_auth_request con 0x7f0888071be0 auth_method 0 2024-09-19T12:01:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient: get_auth_request con 0x560c73fc0b60 auth_method 0 2024-09-19T12:01:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 realm 2024-09-19T12:01:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:01:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T12:01:43.462+0000 7f09bde5d640 10 monclient: get_auth_request con 0x560c73fc4cf0 auth_method 0 2024-09-19T12:01:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T12:01:43.462+0000 7f09bee5f640 10 monclient: get_auth_request con 0x560c73fc85c0 auth_method 0 2024-09-19T12:01:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T12:01:43.466+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:01:44.020 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T12:01:43.466+0000 7f09c0b589c0 20 searching for the correct realm 2024-09-19T12:01:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T12:01:43.466+0000 7f09be65e640 10 monclient: get_auth_request con 0x560c73fcd380 auth_method 0 2024-09-19T12:01:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T12:01:43.466+0000 7f09bde5d640 10 monclient: get_auth_request con 0x7f09b0008040 auth_method 0 2024-09-19T12:01:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T12:01:43.466+0000 7f09bee5f640 0 -- 172.21.15.120:0/3537482390 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f09b40b9b20 msgr2=0x7f09b40f7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:01:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T12:01:43.670+0000 7f09bee5f640 10 monclient: get_auth_request con 0x7f09b40b9b20 auth_method 0 2024-09-19T12:01:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T12:01:43.670+0000 7f09be65e640 10 monclient: get_auth_request con 0x7f09b8027070 auth_method 0 2024-09-19T12:01:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T12:01:43.682+0000 7f09bde5d640 0 -- 172.21.15.120:0/3537482390 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f09b0038040 msgr2=0x7f09b0038420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:01:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T12:01:43.682+0000 7f09bde5d640 10 monclient: get_auth_request con 0x7f09b0038040 auth_method 0 2024-09-19T12:01:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T12:01:43.886+0000 7f09bde5d640 10 monclient: get_auth_request con 0x7f09b0038040 auth_method 0 2024-09-19T12:01:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:01:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:01:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:01:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:01:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:01:44.021 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 zone default found 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 4 Realm: () 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 zonegroup default 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.022 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 started sync module instance, tier type = 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=0 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=1 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=2 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=3 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=4 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=5 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=6 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T12:01:43.930+0000 7f09c0b589c0 20 add_watcher() i=7 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T12:01:43.930+0000 7f09c0b589c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding auth protocol: cephx 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding auth protocol: cephx 2024-09-19T12:01:44.023 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding auth protocol: cephx 2024-09-19T12:01:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: secure 2024-09-19T12:01:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: crc 2024-09-19T12:01:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: secure 2024-09-19T12:01:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: crc 2024-09-19T12:01:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: secure 2024-09-19T12:01:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: crc 2024-09-19T12:01:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: crc 2024-09-19T12:01:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: secure 2024-09-19T12:01:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: crc 2024-09-19T12:01:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: secure 2024-09-19T12:01:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: crc 2024-09-19T12:01:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: secure 2024-09-19T12:01:44.024 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T12:01:43.934+0000 7f0874fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:01:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:01:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:01:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command cache list hook 0x560c73fa0880 2024-09-19T12:01:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command cache inspect hook 0x560c73fa0880 2024-09-19T12:01:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command cache erase hook 0x560c73fa0880 2024-09-19T12:01:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command cache zap hook 0x560c73fa0880 2024-09-19T12:01:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 note: GC not initialized 2024-09-19T12:01:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T12:01:43.934+0000 7f07ef7fe640 20 reqs_thread_entry: start 2024-09-19T12:01:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command sync trace show hook 0x7f09a8001d40 2024-09-19T12:01:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command sync trace history hook 0x7f09a8001d40 2024-09-19T12:01:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command sync trace active hook 0x7f09a8001d40 2024-09-19T12:01:44.025 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command sync trace active_short hook 0x7f09a8001d40 2024-09-19T12:01:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 20 init_complete bucket index max shards: 1 2024-09-19T12:01:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 20 Filter name: none 2024-09-19T12:01:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T12:01:43.934+0000 7f07ed7fa640 20 reqs_thread_entry: start 2024-09-19T12:01:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:01:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:01:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:01:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:01:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:01:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:01:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:44.026 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:01:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:01:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T12:01:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T12:01:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T12:01:43.950+0000 7f08a17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366219 cookie 94611485579856 notifier 8463 bl.length()=911 2024-09-19T12:01:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T12:01:43.950+0000 7f08a17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T12:01:43.950+0000 7f08a17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T12:01:43.950+0000 7f08a17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T12:01:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T12:01:44.027 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T12:01:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T12:01:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T12:01:43.958+0000 7f09c0b589c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f09c0b589c0 time 2024-09-19T12:01:43.958668+0000 2024-09-19T12:01:44.028 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:01:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f09c44322eb] 2024-09-19T12:01:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f09c443249f] 2024-09-19T12:01:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c72a1c271] 2024-09-19T12:01:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560c72a2c14a] 2024-09-19T12:01:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T12:01:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f09c3298d90] 2024-09-19T12:01:44.028 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T12:01:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T12:01:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T12:01:43.958+0000 7f09c0b589c0 -1 *** Caught signal (Aborted) ** 2024-09-19T12:01:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f09c0b589c0 thread_name:radosgw-admin 2024-09-19T12:01:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f09c32b1520] 2024-09-19T12:01:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:01:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:01:44.029 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:01:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f09c4432345] 2024-09-19T12:01:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f09c443249f] 2024-09-19T12:01:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c72a1c271] 2024-09-19T12:01:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560c72a2c14a] 2024-09-19T12:01:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T12:01:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f09c3298d90] 2024-09-19T12:01:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T12:01:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T12:01:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T12:01:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.030 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T12:01:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T12:01:44.030 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T12:01:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T12:01:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T12:01:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T12:01:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T12:01:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T12:01:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T12:01:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T12:01:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T12:01:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T12:01:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T12:01:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T12:01:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T12:01:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T12:01:44.031 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T12:01:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T12:01:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T12:01:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T12:01:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T12:01:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T12:01:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T12:01:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T12:01:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T12:01:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T12:01:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T12:01:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T12:01:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T12:01:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T12:01:44.032 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T12:01:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T12:01:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T12:01:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T12:01:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T12:01:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T12:01:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T12:01:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T12:01:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T12:01:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T12:01:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T12:01:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T12:01:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T12:01:44.033 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T12:01:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T12:01:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T12:01:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T12:01:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T12:01:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T12:01:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T12:01:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T12:01:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T12:01:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T12:01:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T12:01:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T12:01:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T12:01:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T12:01:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T12:01:44.034 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T12:01:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T12:01:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T12:01:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T12:01:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T12:01:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T12:01:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T12:01:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T12:01:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T12:01:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T12:01:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T12:01:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T12:01:44.035 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T12:01:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T12:01:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T12:01:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T12:01:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T12:01:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T12:01:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T12:01:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T12:01:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T12:01:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T12:01:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T12:01:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T12:01:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T12:01:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T12:01:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T12:01:44.036 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T12:01:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T12:01:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T12:01:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T12:01:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T12:01:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T12:01:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T12:01:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T12:01:44.037 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T12:01:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: 7f07ed7fa640 / http_manager 2024-09-19T12:01:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: 7f07ef7fe640 / http_manager 2024-09-19T12:01:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0874fe1640 / rgw_dt_lg_renew 2024-09-19T12:01:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: 7f088ffff640 / ms_dispatch 2024-09-19T12:01:44.037 INFO:tasks.workunit.client.0.smithi120.stderr: 7f08a17fa640 / io_context_pool 2024-09-19T12:01:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f08a1ffb640 / io_context_pool 2024-09-19T12:01:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f08a3fff640 / ms_dispatch 2024-09-19T12:01:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f08aae05640 / ms_dispatch 2024-09-19T12:01:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f08ac608640 / io_context_pool 2024-09-19T12:01:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f09bde5d640 / msgr-worker-2 2024-09-19T12:01:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f09be65e640 / msgr-worker-1 2024-09-19T12:01:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f09bee5f640 / msgr-worker-0 2024-09-19T12:01:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f09bf660640 / io_context_pool 2024-09-19T12:01:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: 7f09c0b589c0 / radosgw-admin 2024-09-19T12:01:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T12:01:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T12:01:44.038 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/log/ceph/ceph-client.admin.147033.log 2024-09-19T12:01:44.038 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T12:01:44.038 INFO:tasks.workunit.client.0.smithi120.stderr:--- begin dump of recent events --- 2024-09-19T12:01:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -499> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): get_auth_request con 0x560c73ed7ba0 auth_method 0 2024-09-19T12:01:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -498> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -497> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -496> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -495> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -494> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -493> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -492> 2024-09-19T12:01:43.438+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -491> 2024-09-19T12:01:43.438+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -490> 2024-09-19T12:01:43.438+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -489> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_done global_id 8451 payload 274 2024-09-19T12:01:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -488> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient: _finish_hunting 0 2024-09-19T12:01:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -487> 2024-09-19T12:01:43.438+0000 7f09bde5d640 1 monclient: found mon.noname-a 2024-09-19T12:01:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -486> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:01:44.039 INFO:tasks.workunit.client.0.smithi120.stderr: -485> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: -484> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:01:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: -483> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: dump: 2024-09-19T12:01:44.040 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.040 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.040 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.040 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.040 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.040 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.040 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.040 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.040 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: -482> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: _finish_auth 0 2024-09-19T12:01:44.040 INFO:tasks.workunit.client.0.smithi120.stderr: -481> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: _check_auth_tickets 2024-09-19T12:01:44.041 INFO:tasks.workunit.client.0.smithi120.stderr: -480> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:44.041 INFO:tasks.workunit.client.0.smithi120.stderr: -479> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 monclient: authenticate success, global_id 8451 2024-09-19T12:01:44.041 INFO:tasks.workunit.client.0.smithi120.stderr: -478> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient: get_monmap_and_config success 2024-09-19T12:01:44.041 INFO:tasks.workunit.client.0.smithi120.stderr: -477> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 4 set_mon_vals no callback set 2024-09-19T12:01:44.041 INFO:tasks.workunit.client.0.smithi120.stderr: -476> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.041 INFO:tasks.workunit.client.0.smithi120.stderr: -475> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:01:44.041 INFO:tasks.workunit.client.0.smithi120.stderr: -474> 2024-09-19T12:01:43.438+0000 7f08ac608640 10 monclient: dump: 2024-09-19T12:01:44.041 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.041 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.041 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.041 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.041 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.041 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.042 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.042 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.042 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -473> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient: shutdown 2024-09-19T12:01:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -472> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) unregister_commands rotate-key 2024-09-19T12:01:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -471> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient: build_initial_monmap 2024-09-19T12:01:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -470> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:44.042 INFO:tasks.workunit.client.0.smithi120.stderr: -469> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient: monmap: 2024-09-19T12:01:44.042 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:44.042 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:44.042 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:44.042 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:44.042 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:44.043 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.043 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:44.043 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:44.043 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -468> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding auth protocol: cephx 2024-09-19T12:01:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -467> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding auth protocol: cephx 2024-09-19T12:01:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -466> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding auth protocol: cephx 2024-09-19T12:01:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -465> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: secure 2024-09-19T12:01:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -464> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: crc 2024-09-19T12:01:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -463> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: secure 2024-09-19T12:01:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -462> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: crc 2024-09-19T12:01:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -461> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: secure 2024-09-19T12:01:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -460> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: crc 2024-09-19T12:01:44.043 INFO:tasks.workunit.client.0.smithi120.stderr: -459> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: crc 2024-09-19T12:01:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -458> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: secure 2024-09-19T12:01:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -457> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: crc 2024-09-19T12:01:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -456> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: secure 2024-09-19T12:01:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -455> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: crc 2024-09-19T12:01:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -454> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f01660) adding con mode: secure 2024-09-19T12:01:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -453> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -452> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 1 librados: starting msgr at 2024-09-19T12:01:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -451> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 1 librados: starting objecter 2024-09-19T12:01:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -450> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command objecter_requests hook 0x560c73c8a3d0 2024-09-19T12:01:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -449> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 1 librados: setting wanted keys 2024-09-19T12:01:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -448> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 1 librados: calling monclient init 2024-09-19T12:01:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -447> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient: init 2024-09-19T12:01:44.044 INFO:tasks.workunit.client.0.smithi120.stderr: -446> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding auth protocol: cephx 2024-09-19T12:01:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -445> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding auth protocol: cephx 2024-09-19T12:01:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -444> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding auth protocol: cephx 2024-09-19T12:01:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -443> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: secure 2024-09-19T12:01:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -442> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: crc 2024-09-19T12:01:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -441> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: secure 2024-09-19T12:01:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -440> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: crc 2024-09-19T12:01:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -439> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: secure 2024-09-19T12:01:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -438> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: crc 2024-09-19T12:01:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -437> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: crc 2024-09-19T12:01:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -436> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: secure 2024-09-19T12:01:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -435> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: crc 2024-09-19T12:01:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -434> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: secure 2024-09-19T12:01:44.045 INFO:tasks.workunit.client.0.smithi120.stderr: -433> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: crc 2024-09-19T12:01:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -432> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 AuthRegistry(0x560c73ed47c0) adding con mode: secure 2024-09-19T12:01:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -431> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -430> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -429> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command rotate-key hook 0x560c73ed4908 2024-09-19T12:01:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -428> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -427> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T12:01:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -426> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-b con 0x560c73ed7ba0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -425> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-c con 0x560c73f01180 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -424> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-a con 0x7f09a8003100 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -423> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -422> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -421> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -420> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:44.046 INFO:tasks.workunit.client.0.smithi120.stderr: -419> 2024-09-19T12:01:43.438+0000 7f09c0b589c0 10 monclient(hunting): authenticate will time out at 2597.755117s 2024-09-19T12:01:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -418> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): get_auth_request con 0x560c73f01180 auth_method 0 2024-09-19T12:01:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -417> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -416> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -415> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -414> 2024-09-19T12:01:43.438+0000 7f09bee5f640 10 monclient(hunting): get_auth_request con 0x7f09a8003100 auth_method 0 2024-09-19T12:01:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -413> 2024-09-19T12:01:43.438+0000 7f09bee5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -412> 2024-09-19T12:01:43.438+0000 7f09bee5f640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -411> 2024-09-19T12:01:43.438+0000 7f09bee5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -410> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -409> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -408> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -407> 2024-09-19T12:01:43.438+0000 7f09bee5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -406> 2024-09-19T12:01:43.438+0000 7f09bee5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -405> 2024-09-19T12:01:43.438+0000 7f09bee5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:44.047 INFO:tasks.workunit.client.0.smithi120.stderr: -404> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient(hunting): handle_auth_done global_id 7844 payload 824 2024-09-19T12:01:44.048 INFO:tasks.workunit.client.0.smithi120.stderr: -403> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient: _finish_hunting 0 2024-09-19T12:01:44.048 INFO:tasks.workunit.client.0.smithi120.stderr: -402> 2024-09-19T12:01:43.438+0000 7f09bde5d640 1 monclient: found mon.noname-c 2024-09-19T12:01:44.048 INFO:tasks.workunit.client.0.smithi120.stderr: -401> 2024-09-19T12:01:43.438+0000 7f09bde5d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:01:44.048 INFO:tasks.workunit.client.0.smithi120.stderr: -400> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.048 INFO:tasks.workunit.client.0.smithi120.stderr: -399> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:01:44.048 INFO:tasks.workunit.client.0.smithi120.stderr: -398> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: dump: 2024-09-19T12:01:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.048 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.049 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -397> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: _finish_auth 0 2024-09-19T12:01:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -396> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: _check_auth_tickets 2024-09-19T12:01:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -395> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -394> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -393> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:01:44.049 INFO:tasks.workunit.client.0.smithi120.stderr: -392> 2024-09-19T12:01:43.438+0000 7f08aae05640 10 monclient: dump: 2024-09-19T12:01:44.049 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.049 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.049 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.049 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.049 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.049 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.050 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.050 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.050 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -391> 2024-09-19T12:01:43.438+0000 7f08ac608640 4 set_mon_vals no callback set 2024-09-19T12:01:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -390> 2024-09-19T12:01:43.442+0000 7f09c0b589c0 5 monclient: authenticate success, global_id 7844 2024-09-19T12:01:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -389> 2024-09-19T12:01:43.442+0000 7f09c0b589c0 10 monclient: _renew_subs 2024-09-19T12:01:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -388> 2024-09-19T12:01:43.442+0000 7f09c0b589c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -387> 2024-09-19T12:01:43.442+0000 7f09c0b589c0 10 monclient: _renew_subs 2024-09-19T12:01:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -386> 2024-09-19T12:01:43.442+0000 7f09c0b589c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -385> 2024-09-19T12:01:43.442+0000 7f09c0b589c0 1 librados: init done 2024-09-19T12:01:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -384> 2024-09-19T12:01:43.442+0000 7f08aae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:01:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -383> 2024-09-19T12:01:43.442+0000 7f08aae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -382> 2024-09-19T12:01:43.442+0000 7f08aae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:44.050 INFO:tasks.workunit.client.0.smithi120.stderr: -381> 2024-09-19T12:01:43.442+0000 7f09be65e640 10 monclient: get_auth_request con 0x7f08a4071be0 auth_method 0 2024-09-19T12:01:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -380> 2024-09-19T12:01:43.442+0000 7f09bee5f640 10 monclient: get_auth_request con 0x560c73effb00 auth_method 0 2024-09-19T12:01:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -379> 2024-09-19T12:01:43.442+0000 7f09be65e640 10 monclient: get_auth_request con 0x560c73f1fab0 auth_method 0 2024-09-19T12:01:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -378> 2024-09-19T12:01:43.446+0000 7f09bde5d640 10 monclient: get_auth_request con 0x560c73f23ca0 auth_method 0 2024-09-19T12:01:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -377> 2024-09-19T12:01:43.446+0000 7f09bee5f640 10 monclient: get_auth_request con 0x560c73f23380 auth_method 0 2024-09-19T12:01:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -376> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: build_initial_monmap 2024-09-19T12:01:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -375> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:44.051 INFO:tasks.workunit.client.0.smithi120.stderr: -374> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: monmap: 2024-09-19T12:01:44.051 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:44.051 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:44.051 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:44.051 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:44.051 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:44.051 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.051 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:44.052 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:44.052 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -373> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding auth protocol: cephx 2024-09-19T12:01:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -372> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding auth protocol: cephx 2024-09-19T12:01:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -371> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding auth protocol: cephx 2024-09-19T12:01:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -370> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: secure 2024-09-19T12:01:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -369> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: crc 2024-09-19T12:01:44.052 INFO:tasks.workunit.client.0.smithi120.stderr: -368> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: secure 2024-09-19T12:01:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -367> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: crc 2024-09-19T12:01:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -366> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: secure 2024-09-19T12:01:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -365> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: crc 2024-09-19T12:01:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -364> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: crc 2024-09-19T12:01:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -363> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: secure 2024-09-19T12:01:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -362> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: crc 2024-09-19T12:01:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -361> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: secure 2024-09-19T12:01:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -360> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: crc 2024-09-19T12:01:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -359> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2bef0) adding con mode: secure 2024-09-19T12:01:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -358> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -357> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command objecter_requests cmddesc objecter_requests hook 0x560c73f2f860 EEXIST 2024-09-19T12:01:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -356> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: init 2024-09-19T12:01:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -355> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding auth protocol: cephx 2024-09-19T12:01:44.053 INFO:tasks.workunit.client.0.smithi120.stderr: -354> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding auth protocol: cephx 2024-09-19T12:01:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -353> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding auth protocol: cephx 2024-09-19T12:01:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -352> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: secure 2024-09-19T12:01:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -351> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: crc 2024-09-19T12:01:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -350> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: secure 2024-09-19T12:01:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -349> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: crc 2024-09-19T12:01:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -348> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: secure 2024-09-19T12:01:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -347> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: crc 2024-09-19T12:01:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -346> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: crc 2024-09-19T12:01:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -345> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: secure 2024-09-19T12:01:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -344> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: crc 2024-09-19T12:01:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -343> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: secure 2024-09-19T12:01:44.054 INFO:tasks.workunit.client.0.smithi120.stderr: -342> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: crc 2024-09-19T12:01:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -341> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f2ade8) adding con mode: secure 2024-09-19T12:01:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -340> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -339> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -338> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command rotate-key cmddesc rotate-key hook 0x560c73f2af30 EEXIST 2024-09-19T12:01:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -337> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -336> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T12:01:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -335> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-b con 0x560c73f53a10 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -334> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-c con 0x560c73f53340 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -333> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-a con 0x560c73f51d20 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -332> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -331> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -330> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -329> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:44.055 INFO:tasks.workunit.client.0.smithi120.stderr: -328> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient(hunting): authenticate will time out at 2597.765619s 2024-09-19T12:01:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -327> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): get_auth_request con 0x560c73f53340 auth_method 0 2024-09-19T12:01:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -326> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -325> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -324> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -323> 2024-09-19T12:01:43.450+0000 7f09be65e640 10 monclient(hunting): get_auth_request con 0x560c73f51d20 auth_method 0 2024-09-19T12:01:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -322> 2024-09-19T12:01:43.450+0000 7f09be65e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -321> 2024-09-19T12:01:43.450+0000 7f09be65e640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -320> 2024-09-19T12:01:43.450+0000 7f09be65e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -319> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -318> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -317> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -316> 2024-09-19T12:01:43.450+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -315> 2024-09-19T12:01:43.450+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:44.056 INFO:tasks.workunit.client.0.smithi120.stderr: -314> 2024-09-19T12:01:43.450+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:44.057 INFO:tasks.workunit.client.0.smithi120.stderr: -313> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient(hunting): handle_auth_done global_id 7847 payload 824 2024-09-19T12:01:44.057 INFO:tasks.workunit.client.0.smithi120.stderr: -312> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient: _finish_hunting 0 2024-09-19T12:01:44.057 INFO:tasks.workunit.client.0.smithi120.stderr: -311> 2024-09-19T12:01:43.450+0000 7f09bee5f640 1 monclient: found mon.noname-c 2024-09-19T12:01:44.057 INFO:tasks.workunit.client.0.smithi120.stderr: -310> 2024-09-19T12:01:43.450+0000 7f09bee5f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.120:3301/0 2024-09-19T12:01:44.057 INFO:tasks.workunit.client.0.smithi120.stderr: -309> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.057 INFO:tasks.workunit.client.0.smithi120.stderr: -308> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T12:01:44.057 INFO:tasks.workunit.client.0.smithi120.stderr: -307> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: dump: 2024-09-19T12:01:44.057 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.057 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.057 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.057 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.057 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.058 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.058 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.058 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.058 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.058 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.058 INFO:tasks.workunit.client.0.smithi120.stderr: -306> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: _finish_auth 0 2024-09-19T12:01:44.058 INFO:tasks.workunit.client.0.smithi120.stderr: -305> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: _check_auth_tickets 2024-09-19T12:01:44.058 INFO:tasks.workunit.client.0.smithi120.stderr: -304> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:44.058 INFO:tasks.workunit.client.0.smithi120.stderr: -303> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.058 INFO:tasks.workunit.client.0.smithi120.stderr: -302> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T12:01:44.058 INFO:tasks.workunit.client.0.smithi120.stderr: -301> 2024-09-19T12:01:43.450+0000 7f08a3fff640 10 monclient: dump: 2024-09-19T12:01:44.058 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.058 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.059 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.059 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.059 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.059 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.059 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.059 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.059 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -300> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 5 monclient: authenticate success, global_id 7847 2024-09-19T12:01:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -299> 2024-09-19T12:01:43.450+0000 7f09bf660640 4 set_mon_vals no callback set 2024-09-19T12:01:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -298> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: _renew_subs 2024-09-19T12:01:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -297> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:44.059 INFO:tasks.workunit.client.0.smithi120.stderr: -296> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: _renew_subs 2024-09-19T12:01:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -295> 2024-09-19T12:01:43.450+0000 7f09c0b589c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.120:3301/0 2024-09-19T12:01:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -294> 2024-09-19T12:01:43.454+0000 7f08a3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:01:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -293> 2024-09-19T12:01:43.454+0000 7f08a3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -292> 2024-09-19T12:01:43.454+0000 7f08a3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -291> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: get_monmap_and_config 2024-09-19T12:01:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -290> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: build_initial_monmap 2024-09-19T12:01:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -289> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:44.060 INFO:tasks.workunit.client.0.smithi120.stderr: -288> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: monmap: 2024-09-19T12:01:44.060 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:44.060 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:44.060 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:44.060 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:44.060 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:44.060 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.060 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:44.061 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:44.061 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -287> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding auth protocol: cephx 2024-09-19T12:01:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -286> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding auth protocol: cephx 2024-09-19T12:01:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -285> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding auth protocol: cephx 2024-09-19T12:01:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -284> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: secure 2024-09-19T12:01:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -283> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: crc 2024-09-19T12:01:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -282> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: secure 2024-09-19T12:01:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -281> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: crc 2024-09-19T12:01:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -280> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: secure 2024-09-19T12:01:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -279> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: crc 2024-09-19T12:01:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -278> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: crc 2024-09-19T12:01:44.061 INFO:tasks.workunit.client.0.smithi120.stderr: -277> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: secure 2024-09-19T12:01:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -276> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: crc 2024-09-19T12:01:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -275> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: secure 2024-09-19T12:01:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -274> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: crc 2024-09-19T12:01:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -273> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f73390) adding con mode: secure 2024-09-19T12:01:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -272> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient: get_auth_request con 0x7f0898071b20 auth_method 0 2024-09-19T12:01:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -271> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -270> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: init 2024-09-19T12:01:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -269> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding auth protocol: cephx 2024-09-19T12:01:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -268> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding auth protocol: cephx 2024-09-19T12:01:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -267> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding auth protocol: cephx 2024-09-19T12:01:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -266> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: secure 2024-09-19T12:01:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -265> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: crc 2024-09-19T12:01:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -264> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: secure 2024-09-19T12:01:44.062 INFO:tasks.workunit.client.0.smithi120.stderr: -263> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: crc 2024-09-19T12:01:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -262> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: secure 2024-09-19T12:01:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -261> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: crc 2024-09-19T12:01:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -260> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: crc 2024-09-19T12:01:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -259> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: secure 2024-09-19T12:01:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -258> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: crc 2024-09-19T12:01:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -257> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: secure 2024-09-19T12:01:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -256> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: crc 2024-09-19T12:01:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -255> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb10076a0) adding con mode: secure 2024-09-19T12:01:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -254> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -253> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -252> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command rotate-key cmddesc rotate-key hook 0x7ffdb10077e8 EEXIST 2024-09-19T12:01:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -251> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -250> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T12:01:44.063 INFO:tasks.workunit.client.0.smithi120.stderr: -249> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-a con 0x560c73fa1b00 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -248> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-b con 0x560c73fa76b0 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -247> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-c con 0x560c73f98870 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -246> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -245> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -244> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -243> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -242> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient(hunting): authenticate will time out at 2597.769994s 2024-09-19T12:01:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -241> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): get_auth_request con 0x560c73fa1b00 auth_method 0 2024-09-19T12:01:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -240> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -239> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -238> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -237> 2024-09-19T12:01:43.454+0000 7f09be65e640 10 monclient(hunting): get_auth_request con 0x560c73f98870 auth_method 0 2024-09-19T12:01:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -236> 2024-09-19T12:01:43.454+0000 7f09be65e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:44.064 INFO:tasks.workunit.client.0.smithi120.stderr: -235> 2024-09-19T12:01:43.454+0000 7f09be65e640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -234> 2024-09-19T12:01:43.454+0000 7f09be65e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -233> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -232> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -231> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -230> 2024-09-19T12:01:43.454+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -229> 2024-09-19T12:01:43.454+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -228> 2024-09-19T12:01:43.454+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -227> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient(hunting): handle_auth_done global_id 8460 payload 274 2024-09-19T12:01:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -226> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient: _finish_hunting 0 2024-09-19T12:01:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -225> 2024-09-19T12:01:43.454+0000 7f09bde5d640 1 monclient: found mon.noname-a 2024-09-19T12:01:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -224> 2024-09-19T12:01:43.454+0000 7f09bde5d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:01:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -223> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -222> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:01:44.065 INFO:tasks.workunit.client.0.smithi120.stderr: -221> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: dump: 2024-09-19T12:01:44.066 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.066 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.066 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.066 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.066 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.066 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.066 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.066 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.066 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -220> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: _finish_auth 0 2024-09-19T12:01:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -219> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: _check_auth_tickets 2024-09-19T12:01:44.066 INFO:tasks.workunit.client.0.smithi120.stderr: -218> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -217> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -216> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:01:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: -215> 2024-09-19T12:01:43.454+0000 7f08a1ffb640 10 monclient: dump: 2024-09-19T12:01:44.067 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.067 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.067 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.067 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.067 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.067 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.067 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.067 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.067 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.067 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -214> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 monclient: authenticate success, global_id 8460 2024-09-19T12:01:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -213> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: get_monmap_and_config success 2024-09-19T12:01:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -212> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 4 set_mon_vals no callback set 2024-09-19T12:01:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -211> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: shutdown 2024-09-19T12:01:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -210> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: build_initial_monmap 2024-09-19T12:01:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -209> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 1 build_initial for_mkfs: 0 2024-09-19T12:01:44.068 INFO:tasks.workunit.client.0.smithi120.stderr: -208> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: monmap: 2024-09-19T12:01:44.068 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 0 2024-09-19T12:01:44.068 INFO:tasks.workunit.client.0.smithi120.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T12:01:44.068 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 0.000000 2024-09-19T12:01:44.068 INFO:tasks.workunit.client.0.smithi120.stderr:created 0.000000 2024-09-19T12:01:44.068 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 0 (unknown) 2024-09-19T12:01:44.068 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.069 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.noname-a 2024-09-19T12:01:44.069 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.noname-b 2024-09-19T12:01:44.069 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.noname-c 2024-09-19T12:01:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -207> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding auth protocol: cephx 2024-09-19T12:01:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -206> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding auth protocol: cephx 2024-09-19T12:01:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -205> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding auth protocol: cephx 2024-09-19T12:01:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -204> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: secure 2024-09-19T12:01:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -203> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: crc 2024-09-19T12:01:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -202> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: secure 2024-09-19T12:01:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -201> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: crc 2024-09-19T12:01:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -200> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: secure 2024-09-19T12:01:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -199> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: crc 2024-09-19T12:01:44.069 INFO:tasks.workunit.client.0.smithi120.stderr: -198> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: crc 2024-09-19T12:01:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -197> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: secure 2024-09-19T12:01:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -196> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: crc 2024-09-19T12:01:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -195> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: secure 2024-09-19T12:01:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -194> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: crc 2024-09-19T12:01:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -193> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f980b0) adding con mode: secure 2024-09-19T12:01:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -192> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -191> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 1 librados: starting msgr at 2024-09-19T12:01:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -190> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 1 librados: starting objecter 2024-09-19T12:01:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -189> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command objecter_requests cmddesc objecter_requests hook 0x560c73edecc0 EEXIST 2024-09-19T12:01:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -188> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 1 librados: setting wanted keys 2024-09-19T12:01:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -187> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 1 librados: calling monclient init 2024-09-19T12:01:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -186> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 10 monclient: init 2024-09-19T12:01:44.070 INFO:tasks.workunit.client.0.smithi120.stderr: -185> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding auth protocol: cephx 2024-09-19T12:01:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -184> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding auth protocol: cephx 2024-09-19T12:01:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -183> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding auth protocol: cephx 2024-09-19T12:01:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -182> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: secure 2024-09-19T12:01:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -181> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: crc 2024-09-19T12:01:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -180> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: secure 2024-09-19T12:01:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -179> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: crc 2024-09-19T12:01:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -178> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: secure 2024-09-19T12:01:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -177> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: crc 2024-09-19T12:01:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -176> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: crc 2024-09-19T12:01:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -175> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: secure 2024-09-19T12:01:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -174> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: crc 2024-09-19T12:01:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -173> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: secure 2024-09-19T12:01:44.071 INFO:tasks.workunit.client.0.smithi120.stderr: -172> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: crc 2024-09-19T12:01:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -171> 2024-09-19T12:01:43.454+0000 7f09c0b589c0 5 AuthRegistry(0x560c73f55830) adding con mode: secure 2024-09-19T12:01:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -170> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -169> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -168> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command rotate-key cmddesc rotate-key hook 0x560c73f55978 EEXIST 2024-09-19T12:01:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -167> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient: _reopen_session rank -1 2024-09-19T12:01:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -166> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T12:01:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -165> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-a con 0x560c73f98870 addr [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] 2024-09-19T12:01:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -164> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-b con 0x560c73fa1b00 addr [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-19T12:01:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -163> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): picked mon.noname-c con 0x560c73fa0480 addr [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] 2024-09-19T12:01:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -162> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -161> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.072 INFO:tasks.workunit.client.0.smithi120.stderr: -160> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): start opening mon connection 2024-09-19T12:01:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -159> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): _renew_subs 2024-09-19T12:01:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -158> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient(hunting): authenticate will time out at 2597.772454s 2024-09-19T12:01:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -157> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): get_auth_request con 0x560c73f98870 auth_method 0 2024-09-19T12:01:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -156> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -155> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -154> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -153> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient(hunting): get_auth_request con 0x560c73fa0480 auth_method 0 2024-09-19T12:01:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -152> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T12:01:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -151> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient(hunting): _init_auth method 2 2024-09-19T12:01:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -150> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T12:01:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -149> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -148> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -147> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:44.073 INFO:tasks.workunit.client.0.smithi120.stderr: -146> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T12:01:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -145> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T12:01:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -144> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T12:01:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -143> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient(hunting): handle_auth_done global_id 8463 payload 824 2024-09-19T12:01:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -142> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient: _finish_hunting 0 2024-09-19T12:01:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -141> 2024-09-19T12:01:43.458+0000 7f09bde5d640 1 monclient: found mon.noname-a 2024-09-19T12:01:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -140> 2024-09-19T12:01:43.458+0000 7f09bde5d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.120:3300/0 2024-09-19T12:01:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -139> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -138> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T12:01:44.074 INFO:tasks.workunit.client.0.smithi120.stderr: -137> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: dump: 2024-09-19T12:01:44.074 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.074 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.074 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.075 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.075 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.075 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.075 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.075 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.075 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -136> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: _finish_auth 0 2024-09-19T12:01:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -135> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: _check_auth_tickets 2024-09-19T12:01:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -134> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: handle_config config(0 keys) 2024-09-19T12:01:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -133> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T12:01:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -132> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T12:01:44.075 INFO:tasks.workunit.client.0.smithi120.stderr: -131> 2024-09-19T12:01:43.458+0000 7f088ffff640 10 monclient: dump: 2024-09-19T12:01:44.076 INFO:tasks.workunit.client.0.smithi120.stderr:epoch 1 2024-09-19T12:01:44.076 INFO:tasks.workunit.client.0.smithi120.stderr:fsid e4647c72-93bd-41bc-8102-6ca42f6edad4 2024-09-19T12:01:44.076 INFO:tasks.workunit.client.0.smithi120.stderr:last_changed 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.076 INFO:tasks.workunit.client.0.smithi120.stderr:created 2024-09-19T11:34:19.265074+0000 2024-09-19T12:01:44.076 INFO:tasks.workunit.client.0.smithi120.stderr:min_mon_release 19 (squid) 2024-09-19T12:01:44.076 INFO:tasks.workunit.client.0.smithi120.stderr:election_strategy: 1 2024-09-19T12:01:44.076 INFO:tasks.workunit.client.0.smithi120.stderr:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T12:01:44.076 INFO:tasks.workunit.client.0.smithi120.stderr:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-09-19T12:01:44.076 INFO:tasks.workunit.client.0.smithi120.stderr:2: [v2:172.21.15.120:3301/0,v1:172.21.15.120:6790/0] mon.c 2024-09-19T12:01:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: -130> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 5 monclient: authenticate success, global_id 8463 2024-09-19T12:01:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: -129> 2024-09-19T12:01:43.458+0000 7f08a1ffb640 4 set_mon_vals no callback set 2024-09-19T12:01:44.076 INFO:tasks.workunit.client.0.smithi120.stderr: -128> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient: _renew_subs 2024-09-19T12:01:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: -127> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:01:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: -126> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient: _renew_subs 2024-09-19T12:01:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: -125> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.120:3300/0 2024-09-19T12:01:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: -124> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 1 librados: init done 2024-09-19T12:01:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: -123> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command cr dump hook 0x560c73fa1ef8 2024-09-19T12:01:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: -122> 2024-09-19T12:01:43.458+0000 7f088ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T12:01:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: -121> 2024-09-19T12:01:43.458+0000 7f088ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: -120> 2024-09-19T12:01:43.458+0000 7f088ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.151:6832/1252307159,v1:172.21.15.151:6833/1252307159] 2024-09-19T12:01:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: -119> 2024-09-19T12:01:43.458+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: -118> 2024-09-19T12:01:43.458+0000 7f09bee5f640 10 monclient: get_auth_request con 0x7f0888071be0 auth_method 0 2024-09-19T12:01:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: -117> 2024-09-19T12:01:43.458+0000 7f09be65e640 10 monclient: get_auth_request con 0x560c73fc0b60 auth_method 0 2024-09-19T12:01:44.077 INFO:tasks.workunit.client.0.smithi120.stderr: -116> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: -115> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 realm 2024-09-19T12:01:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: -114> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: -113> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: -112> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:01:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: -111> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: -110> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: -109> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: -108> 2024-09-19T12:01:43.462+0000 7f09bde5d640 10 monclient: get_auth_request con 0x560c73fc4cf0 auth_method 0 2024-09-19T12:01:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: -107> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: -106> 2024-09-19T12:01:43.462+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: -105> 2024-09-19T12:01:43.462+0000 7f09bee5f640 10 monclient: get_auth_request con 0x560c73fc85c0 auth_method 0 2024-09-19T12:01:44.078 INFO:tasks.workunit.client.0.smithi120.stderr: -104> 2024-09-19T12:01:43.466+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:01:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: -103> 2024-09-19T12:01:43.466+0000 7f09c0b589c0 20 searching for the correct realm 2024-09-19T12:01:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: -102> 2024-09-19T12:01:43.466+0000 7f09be65e640 10 monclient: get_auth_request con 0x560c73fcd380 auth_method 0 2024-09-19T12:01:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: -101> 2024-09-19T12:01:43.466+0000 7f09bde5d640 10 monclient: get_auth_request con 0x7f09b0008040 auth_method 0 2024-09-19T12:01:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: -100> 2024-09-19T12:01:43.466+0000 7f09bee5f640 0 -- 172.21.15.120:0/3537482390 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f09b40b9b20 msgr2=0x7f09b40f7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:01:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: -99> 2024-09-19T12:01:43.670+0000 7f09bee5f640 10 monclient: get_auth_request con 0x7f09b40b9b20 auth_method 0 2024-09-19T12:01:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: -98> 2024-09-19T12:01:43.670+0000 7f09be65e640 10 monclient: get_auth_request con 0x7f09b8027070 auth_method 0 2024-09-19T12:01:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: -97> 2024-09-19T12:01:43.682+0000 7f09bde5d640 0 -- 172.21.15.120:0/3537482390 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f09b0038040 msgr2=0x7f09b0038420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:01:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: -96> 2024-09-19T12:01:43.682+0000 7f09bde5d640 10 monclient: get_auth_request con 0x7f09b0038040 auth_method 0 2024-09-19T12:01:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: -95> 2024-09-19T12:01:43.886+0000 7f09bde5d640 10 monclient: get_auth_request con 0x7f09b0038040 auth_method 0 2024-09-19T12:01:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: -94> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:01:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: -93> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:01:44.079 INFO:tasks.workunit.client.0.smithi120.stderr: -92> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:01:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: -91> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:01:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: -90> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:01:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: -89> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:01:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: -88> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: -87> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: -86> 2024-09-19T12:01:43.898+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: -85> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: -84> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: -83> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:01:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: -82> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 zone default found 2024-09-19T12:01:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: -81> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 4 Realm: () 2024-09-19T12:01:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: -80> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:01:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: -79> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:01:44.080 INFO:tasks.workunit.client.0.smithi120.stderr: -78> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:01:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: -77> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 zonegroup default 2024-09-19T12:01:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: -76> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: -75> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: -74> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: -73> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: -72> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: -71> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: -70> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 started sync module instance, tier type = 2024-09-19T12:01:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: -69> 2024-09-19T12:01:43.902+0000 7f09c0b589c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:01:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: -68> 2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=0 2024-09-19T12:01:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: -67> 2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=1 2024-09-19T12:01:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: -66> 2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=2 2024-09-19T12:01:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: -65> 2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=3 2024-09-19T12:01:44.081 INFO:tasks.workunit.client.0.smithi120.stderr: -64> 2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=4 2024-09-19T12:01:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: -63> 2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=5 2024-09-19T12:01:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: -62> 2024-09-19T12:01:43.926+0000 7f09c0b589c0 20 add_watcher() i=6 2024-09-19T12:01:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: -61> 2024-09-19T12:01:43.930+0000 7f09c0b589c0 20 add_watcher() i=7 2024-09-19T12:01:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: -60> 2024-09-19T12:01:43.930+0000 7f09c0b589c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:01:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: -59> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding auth protocol: cephx 2024-09-19T12:01:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: -58> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding auth protocol: cephx 2024-09-19T12:01:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: -57> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding auth protocol: cephx 2024-09-19T12:01:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: -56> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: secure 2024-09-19T12:01:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: -55> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: crc 2024-09-19T12:01:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: -54> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: secure 2024-09-19T12:01:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: -53> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: crc 2024-09-19T12:01:44.082 INFO:tasks.workunit.client.0.smithi120.stderr: -52> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: secure 2024-09-19T12:01:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: -51> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: crc 2024-09-19T12:01:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: -50> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: crc 2024-09-19T12:01:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: -49> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: secure 2024-09-19T12:01:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: -48> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: crc 2024-09-19T12:01:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: -47> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: secure 2024-09-19T12:01:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: -46> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: crc 2024-09-19T12:01:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: -45> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 AuthRegistry(0x7ffdb1007b70) adding con mode: secure 2024-09-19T12:01:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: -44> 2024-09-19T12:01:43.934+0000 7f0874fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:01:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: -43> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T12:01:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: -42> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:01:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: -41> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:01:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: -40> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command cache list hook 0x560c73fa0880 2024-09-19T12:01:44.083 INFO:tasks.workunit.client.0.smithi120.stderr: -39> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command cache inspect hook 0x560c73fa0880 2024-09-19T12:01:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: -38> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command cache erase hook 0x560c73fa0880 2024-09-19T12:01:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: -37> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command cache zap hook 0x560c73fa0880 2024-09-19T12:01:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: -36> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 note: GC not initialized 2024-09-19T12:01:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: -35> 2024-09-19T12:01:43.934+0000 7f07ef7fe640 20 reqs_thread_entry: start 2024-09-19T12:01:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: -34> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command sync trace show hook 0x7f09a8001d40 2024-09-19T12:01:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: -33> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command sync trace history hook 0x7f09a8001d40 2024-09-19T12:01:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: -32> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command sync trace active hook 0x7f09a8001d40 2024-09-19T12:01:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: -31> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 5 asok(0x560c73cc9d90) register_command sync trace active_short hook 0x7f09a8001d40 2024-09-19T12:01:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: -30> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 20 init_complete bucket index max shards: 1 2024-09-19T12:01:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: -29> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 20 Filter name: none 2024-09-19T12:01:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: -28> 2024-09-19T12:01:43.934+0000 7f07ed7fa640 20 reqs_thread_entry: start 2024-09-19T12:01:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: -27> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:01:44.084 INFO:tasks.workunit.client.0.smithi120.stderr: -26> 2024-09-19T12:01:43.934+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: -25> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:01:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: -24> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:01:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: -23> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:01:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: -22> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:01:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: -21> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: -20> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:01:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: -19> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: -18> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: -17> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:01:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: -16> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: -15> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:01:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: -14> 2024-09-19T12:01:43.938+0000 7f09c0b589c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T12:01:44.085 INFO:tasks.workunit.client.0.smithi120.stderr: -13> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: -12> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: -11> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: -10> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T12:01:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: -9> 2024-09-19T12:01:43.950+0000 7f08a17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366219 cookie 94611485579856 notifier 8463 bl.length()=911 2024-09-19T12:01:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: -8> 2024-09-19T12:01:43.950+0000 7f08a17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: -7> 2024-09-19T12:01:43.950+0000 7f08a17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: -6> 2024-09-19T12:01:43.950+0000 7f08a17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: -5> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T12:01:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: -4> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T12:01:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: -3> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T12:01:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: -2> 2024-09-19T12:01:43.950+0000 7f09c0b589c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T12:01:44.086 INFO:tasks.workunit.client.0.smithi120.stderr: -1> 2024-09-19T12:01:43.958+0000 7f09c0b589c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f09c0b589c0 time 2024-09-19T12:01:43.958668+0000 2024-09-19T12:01:44.086 INFO:tasks.workunit.client.0.smithi120.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T12:01:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f09c44322eb] 2024-09-19T12:01:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f09c443249f] 2024-09-19T12:01:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c72a1c271] 2024-09-19T12:01:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560c72a2c14a] 2024-09-19T12:01:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: 5: main() 2024-09-19T12:01:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f09c3298d90] 2024-09-19T12:01:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: 7: __libc_start_main() 2024-09-19T12:01:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: 8: _start() 2024-09-19T12:01:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: 0> 2024-09-19T12:01:43.958+0000 7f09c0b589c0 -1 *** Caught signal (Aborted) ** 2024-09-19T12:01:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: in thread 7f09c0b589c0 thread_name:radosgw-admin 2024-09-19T12:01:44.087 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.088 INFO:tasks.workunit.client.0.smithi120.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T12:01:44.088 INFO:tasks.workunit.client.0.smithi120.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f09c32b1520] 2024-09-19T12:01:44.088 INFO:tasks.workunit.client.0.smithi120.stderr: 2: pthread_kill() 2024-09-19T12:01:44.088 INFO:tasks.workunit.client.0.smithi120.stderr: 3: raise() 2024-09-19T12:01:44.088 INFO:tasks.workunit.client.0.smithi120.stderr: 4: abort() 2024-09-19T12:01:44.088 INFO:tasks.workunit.client.0.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f09c4432345] 2024-09-19T12:01:44.088 INFO:tasks.workunit.client.0.smithi120.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f09c443249f] 2024-09-19T12:01:44.088 INFO:tasks.workunit.client.0.smithi120.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c72a1c271] 2024-09-19T12:01:44.088 INFO:tasks.workunit.client.0.smithi120.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560c72a2c14a] 2024-09-19T12:01:44.088 INFO:tasks.workunit.client.0.smithi120.stderr: 9: main() 2024-09-19T12:01:44.088 INFO:tasks.workunit.client.0.smithi120.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f09c3298d90] 2024-09-19T12:01:44.089 INFO:tasks.workunit.client.0.smithi120.stderr: 11: __libc_start_main() 2024-09-19T12:01:44.089 INFO:tasks.workunit.client.0.smithi120.stderr: 12: _start() 2024-09-19T12:01:44.089 INFO:tasks.workunit.client.0.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T12:01:44.089 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:01:44.089 INFO:tasks.workunit.client.0.smithi120.stderr:--- logging levels --- 2024-09-19T12:01:44.089 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 none 2024-09-19T12:01:44.089 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 lockdep 2024-09-19T12:01:44.089 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 context 2024-09-19T12:01:44.089 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 crush 2024-09-19T12:01:44.089 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds 2024-09-19T12:01:44.089 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_balancer 2024-09-19T12:01:44.089 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_locker 2024-09-19T12:01:44.089 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log 2024-09-19T12:01:44.090 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_log_expire 2024-09-19T12:01:44.090 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mds_migrator 2024-09-19T12:01:44.090 INFO:tasks.workunit.client.0.smithi120.stderr: 3/ 5 mds_quiesce 2024-09-19T12:01:44.090 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 buffer 2024-09-19T12:01:44.090 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 timer 2024-09-19T12:01:44.090 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 filer 2024-09-19T12:01:44.090 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 striper 2024-09-19T12:01:44.090 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 1 objecter 2024-09-19T12:01:44.090 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rados 2024-09-19T12:01:44.090 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd 2024-09-19T12:01:44.090 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_mirror 2024-09-19T12:01:44.090 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_replay 2024-09-19T12:01:44.090 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 rbd_pwl 2024-09-19T12:01:44.091 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 journaler 2024-09-19T12:01:44.091 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objectcacher 2024-09-19T12:01:44.091 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 immutable_obj_cache 2024-09-19T12:01:44.091 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 client 2024-09-19T12:01:44.091 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 osd 2024-09-19T12:01:44.091 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 optracker 2024-09-19T12:01:44.091 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 objclass 2024-09-19T12:01:44.091 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 filestore 2024-09-19T12:01:44.091 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 journal 2024-09-19T12:01:44.091 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 ms 2024-09-19T12:01:44.091 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mon 2024-09-19T12:01:44.091 INFO:tasks.workunit.client.0.smithi120.stderr: 0/10 monc 2024-09-19T12:01:44.091 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 paxos 2024-09-19T12:01:44.092 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 tp 2024-09-19T12:01:44.092 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 auth 2024-09-19T12:01:44.092 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 crypto 2024-09-19T12:01:44.092 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 finisher 2024-09-19T12:01:44.092 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 reserver 2024-09-19T12:01:44.092 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 heartbeatmap 2024-09-19T12:01:44.092 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 perfcounter 2024-09-19T12:01:44.092 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw 2024-09-19T12:01:44.092 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_sync 2024-09-19T12:01:44.092 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_datacache 2024-09-19T12:01:44.092 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_access 2024-09-19T12:01:44.092 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_dbstore 2024-09-19T12:01:44.093 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_flight 2024-09-19T12:01:44.093 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 rgw_lifecycle 2024-09-19T12:01:44.093 INFO:tasks.workunit.client.0.smithi120.stderr: 20/20 rgw_notification 2024-09-19T12:01:44.093 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 javaclient 2024-09-19T12:01:44.093 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 asok 2024-09-19T12:01:44.093 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 1 throttle 2024-09-19T12:01:44.093 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 0 refs 2024-09-19T12:01:44.093 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 compressor 2024-09-19T12:01:44.093 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluestore 2024-09-19T12:01:44.093 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 bluefs 2024-09-19T12:01:44.093 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 3 bdev 2024-09-19T12:01:44.093 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 kstore 2024-09-19T12:01:44.093 INFO:tasks.workunit.client.0.smithi120.stderr: 4/ 5 rocksdb 2024-09-19T12:01:44.093 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 fuse 2024-09-19T12:01:44.094 INFO:tasks.workunit.client.0.smithi120.stderr: 2/ 5 mgr 2024-09-19T12:01:44.094 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mgrc 2024-09-19T12:01:44.094 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 dpdk 2024-09-19T12:01:44.094 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 eventtrace 2024-09-19T12:01:44.094 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 prioritycache 2024-09-19T12:01:44.094 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 test 2024-09-19T12:01:44.094 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephfs_mirror 2024-09-19T12:01:44.094 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cephsqlite 2024-09-19T12:01:44.094 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 crimson_interrupt 2024-09-19T12:01:44.094 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore 2024-09-19T12:01:44.094 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_onode 2024-09-19T12:01:44.094 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_odata 2024-09-19T12:01:44.094 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_omap 2024-09-19T12:01:44.094 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_tm 2024-09-19T12:01:44.095 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_t 2024-09-19T12:01:44.095 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cleaner 2024-09-19T12:01:44.095 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_epm 2024-09-19T12:01:44.095 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_lba 2024-09-19T12:01:44.095 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T12:01:44.095 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_cache 2024-09-19T12:01:44.095 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_journal 2024-09-19T12:01:44.095 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_device 2024-09-19T12:01:44.095 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 seastore_backref 2024-09-19T12:01:44.095 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 alienstore 2024-09-19T12:01:44.095 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 mclock 2024-09-19T12:01:44.095 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 cyanstore 2024-09-19T12:01:44.095 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 ceph_exporter 2024-09-19T12:01:44.095 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 memstore 2024-09-19T12:01:44.096 INFO:tasks.workunit.client.0.smithi120.stderr: 1/ 5 trace 2024-09-19T12:01:44.096 INFO:tasks.workunit.client.0.smithi120.stderr: 0/ 5 ceph_dedup 2024-09-19T12:01:44.096 INFO:tasks.workunit.client.0.smithi120.stderr: -2/-2 (syslog threshold) 2024-09-19T12:01:44.096 INFO:tasks.workunit.client.0.smithi120.stderr: 99/99 (stderr threshold) 2024-09-19T12:01:44.096 INFO:tasks.workunit.client.0.smithi120.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T12:01:44.096 INFO:tasks.workunit.client.0.smithi120.stderr: 7f07ed7fa640 / http_manager 2024-09-19T12:01:44.096 INFO:tasks.workunit.client.0.smithi120.stderr: 7f07ef7fe640 / http_manager 2024-09-19T12:01:44.096 INFO:tasks.workunit.client.0.smithi120.stderr: 7f0874fe1640 / rgw_dt_lg_renew 2024-09-19T12:01:44.096 INFO:tasks.workunit.client.0.smithi120.stderr: 7f088ffff640 / ms_dispatch 2024-09-19T12:01:44.096 INFO:tasks.workunit.client.0.smithi120.stderr: 7f08a17fa640 / io_context_pool 2024-09-19T12:01:44.096 INFO:tasks.workunit.client.0.smithi120.stderr: 7f08a1ffb640 / io_context_pool 2024-09-19T12:01:44.096 INFO:tasks.workunit.client.0.smithi120.stderr: 7f08a3fff640 / ms_dispatch 2024-09-19T12:01:44.096 INFO:tasks.workunit.client.0.smithi120.stderr: 7f08aae05640 / ms_dispatch 2024-09-19T12:01:44.097 INFO:tasks.workunit.client.0.smithi120.stderr: 7f08ac608640 / io_context_pool 2024-09-19T12:01:44.097 INFO:tasks.workunit.client.0.smithi120.stderr: 7f09bde5d640 / msgr-worker-2 2024-09-19T12:01:44.097 INFO:tasks.workunit.client.0.smithi120.stderr: 7f09be65e640 / msgr-worker-1 2024-09-19T12:01:44.097 INFO:tasks.workunit.client.0.smithi120.stderr: 7f09bee5f640 / msgr-worker-0 2024-09-19T12:01:44.097 INFO:tasks.workunit.client.0.smithi120.stderr: 7f09bf660640 / io_context_pool 2024-09-19T12:01:44.097 INFO:tasks.workunit.client.0.smithi120.stderr: 7f09c0b589c0 / radosgw-admin 2024-09-19T12:01:44.097 INFO:tasks.workunit.client.0.smithi120.stderr: max_recent 500 2024-09-19T12:01:44.097 INFO:tasks.workunit.client.0.smithi120.stderr: max_new 1000 2024-09-19T12:01:44.097 INFO:tasks.workunit.client.0.smithi120.stderr: log_file /var/lib/ceph/crash/2024-09-19T12:01:43.961921Z_478cfd42-a54f-46d9-a070-fef9b0aa829d/log 2024-09-19T12:01:44.097 INFO:tasks.workunit.client.0.smithi120.stderr:--- end dump of recent events --- 2024-09-19T12:01:44.097 INFO:tasks.workunit.client.0.smithi120.stderr:Aborted 2024-09-19T12:01:44.097 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T12:01:44.099 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:01:44.099 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:01:44.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.046+0000 7f5fc47529c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.046+0000 7f5fc47529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.046+0000 7f5fc47529c0 20 realm 2024-09-19T12:01:44.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.046+0000 7f5fc47529c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.046+0000 7f5fc47529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.046+0000 7f5fc47529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:01:44.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.046+0000 7f5fc47529c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.046+0000 7f5fc47529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.046+0000 7f5fc47529c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.050+0000 7f5fc47529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:44.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.050+0000 7f5fc47529c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.050+0000 7f5fc47529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:01:44.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.050+0000 7f5fc47529c0 20 searching for the correct realm 2024-09-19T12:01:44.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.054+0000 7f5fc2258640 0 -- 172.21.15.120:0/2206595832 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f5fbc057070 msgr2=0x7f5fbc04e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:01:44.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.270+0000 7f5fc2258640 0 -- 172.21.15.120:0/2206595832 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f5fbc057070 msgr2=0x7f5fbc04e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:01:44.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.282+0000 7f5fc47529c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:01:44.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.282+0000 7f5fc47529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:01:44.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.282+0000 7f5fc47529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:01:44.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.282+0000 7f5fc47529c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:01:44.277 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.282+0000 7f5fc47529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:01:44.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.282+0000 7f5fc47529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:01:44.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.282+0000 7f5fc47529c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.282+0000 7f5fc47529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.282+0000 7f5fc47529c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.278 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.282+0000 7f5fc47529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:44.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.282+0000 7f5fc47529c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.286+0000 7f5fc47529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:01:44.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.286+0000 7f5fc47529c0 20 zone default found 2024-09-19T12:01:44.279 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.286+0000 7f5fc47529c0 4 Realm: () 2024-09-19T12:01:44.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.286+0000 7f5fc47529c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:01:44.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.286+0000 7f5fc47529c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:01:44.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.286+0000 7f5fc47529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:01:44.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.286+0000 7f5fc47529c0 20 zonegroup default 2024-09-19T12:01:44.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.286+0000 7f5fc47529c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.286+0000 7f5fc47529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.280 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.286+0000 7f5fc47529c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.286+0000 7f5fc47529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.281 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.286+0000 7f5fc47529c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.286+0000 7f5fc47529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.286+0000 7f5fc47529c0 20 started sync module instance, tier type = 2024-09-19T12:01:44.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.286+0000 7f5fc47529c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:01:44.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.310+0000 7f5fc47529c0 20 add_watcher() i=0 2024-09-19T12:01:44.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.310+0000 7f5fc47529c0 20 add_watcher() i=1 2024-09-19T12:01:44.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.310+0000 7f5fc47529c0 20 add_watcher() i=2 2024-09-19T12:01:44.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.310+0000 7f5fc47529c0 20 add_watcher() i=3 2024-09-19T12:01:44.304 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.310+0000 7f5fc47529c0 20 add_watcher() i=4 2024-09-19T12:01:44.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.310+0000 7f5fc47529c0 20 add_watcher() i=5 2024-09-19T12:01:44.305 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.310+0000 7f5fc47529c0 20 add_watcher() i=6 2024-09-19T12:01:44.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.310+0000 7f5fc47529c0 20 add_watcher() i=7 2024-09-19T12:01:44.306 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.310+0000 7f5fc47529c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:01:44.309 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.314+0000 7f5e78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:01:44.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.314+0000 7f5fc47529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:01:44.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.314+0000 7f5fc47529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:01:44.310 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.314+0000 7f5fc47529c0 5 note: GC not initialized 2024-09-19T12:01:44.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.314+0000 7f5df37fe640 20 reqs_thread_entry: start 2024-09-19T12:01:44.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.314+0000 7f5fc47529c0 20 init_complete bucket index max shards: 1 2024-09-19T12:01:44.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.314+0000 7f5fc47529c0 20 Filter name: none 2024-09-19T12:01:44.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.314+0000 7f5df17fa640 20 reqs_thread_entry: start 2024-09-19T12:01:44.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.314+0000 7f5fc47529c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.318+0000 7f5fc47529c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:01:44.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.318+0000 7f5fc47529c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.318+0000 7f5fc47529c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:01:44.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.318+0000 7f5fc47529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:01:44.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.318+0000 7f5fc47529c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.318+0000 7f5fc47529c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:01:44.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.318+0000 7f5fc47529c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.322+0000 7f5fc47529c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:01:44.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.322+0000 7f5fc47529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:01:44.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.322+0000 7f5e78fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:01:44.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.326+0000 7f5fc47529c0 20 remove_watcher() i=0 2024-09-19T12:01:44.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.326+0000 7f5fc47529c0 2 removed watcher, disabling cache 2024-09-19T12:01:44.325 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.330+0000 7f5fc47529c0 20 remove_watcher() i=1 2024-09-19T12:01:44.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.334+0000 7f5fc47529c0 20 remove_watcher() i=2 2024-09-19T12:01:44.329 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.334+0000 7f5fc47529c0 20 remove_watcher() i=3 2024-09-19T12:01:44.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.338+0000 7f5fc47529c0 20 remove_watcher() i=4 2024-09-19T12:01:44.333 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.338+0000 7f5fc47529c0 20 remove_watcher() i=5 2024-09-19T12:01:44.334 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.338+0000 7f5fc47529c0 20 remove_watcher() i=6 2024-09-19T12:01:44.336 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.342+0000 7f5fc47529c0 20 remove_watcher() i=7 2024-09-19T12:01:44.365 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T12:01:44.392 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:01:44.392 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:01:44.437 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.442+0000 7f3233fad9c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.442+0000 7f3233fad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.442+0000 7f3233fad9c0 20 realm 2024-09-19T12:01:44.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.442+0000 7f3233fad9c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.446+0000 7f3233fad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.446+0000 7f3233fad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:01:44.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.446+0000 7f3233fad9c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.446+0000 7f3233fad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:44.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.446+0000 7f3233fad9c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.446+0000 7f3233fad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:44.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.446+0000 7f3233fad9c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:44.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.446+0000 7f3233fad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:01:44.442 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.446+0000 7f3233fad9c0 20 searching for the correct realm 2024-09-19T12:01:44.648 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:44.654+0000 7f32322b4640 0 -- 172.21.15.120:0/1897040341 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f3228044070 msgr2=0x7f32280727d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:01:45.065 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.070+0000 7f32312b2640 0 -- 172.21.15.120:0/1897040341 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f322403f060 msgr2=0x7f3224099990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:01:45.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.286+0000 7f3233fad9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:01:45.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.286+0000 7f3233fad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:01:45.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.286+0000 7f3233fad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:01:45.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.286+0000 7f3233fad9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:01:45.282 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.286+0000 7f3233fad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:01:45.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.286+0000 7f3233fad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:01:45.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.286+0000 7f3233fad9c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:45.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.286+0000 7f3233fad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:45.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.286+0000 7f3233fad9c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:45.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:01:45.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:45.284 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:01:45.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 20 zone default found 2024-09-19T12:01:45.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 4 Realm: () 2024-09-19T12:01:45.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:01:45.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:01:45.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:01:45.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 20 zonegroup default 2024-09-19T12:01:45.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:45.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:45.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:45.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:45.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:45.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:01:45.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 20 started sync module instance, tier type = 2024-09-19T12:01:45.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.290+0000 7f3233fad9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:01:45.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.318+0000 7f3233fad9c0 20 add_watcher() i=0 2024-09-19T12:01:45.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.318+0000 7f3233fad9c0 20 add_watcher() i=1 2024-09-19T12:01:45.311 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.318+0000 7f3233fad9c0 20 add_watcher() i=2 2024-09-19T12:01:45.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.318+0000 7f3233fad9c0 20 add_watcher() i=3 2024-09-19T12:01:45.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.318+0000 7f3233fad9c0 20 add_watcher() i=4 2024-09-19T12:01:45.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.318+0000 7f3233fad9c0 20 add_watcher() i=5 2024-09-19T12:01:45.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.318+0000 7f3233fad9c0 20 add_watcher() i=6 2024-09-19T12:01:45.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.318+0000 7f3233fad9c0 20 add_watcher() i=7 2024-09-19T12:01:45.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.318+0000 7f3233fad9c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:01:45.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.322+0000 7f30e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:01:45.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.322+0000 7f3233fad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:01:45.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.322+0000 7f3233fad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:01:45.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.322+0000 7f3233fad9c0 5 note: GC not initialized 2024-09-19T12:01:45.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f30e27fc640 20 reqs_thread_entry: start 2024-09-19T12:01:45.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 20 init_complete bucket index max shards: 1 2024-09-19T12:01:45.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 20 Filter name: none 2024-09-19T12:01:45.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3053fff640 20 reqs_thread_entry: start 2024-09-19T12:01:45.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:01:45.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:45.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:01:45.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:01:45.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:01:45.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:01:45.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 20 rados->read ofs=0 len=0 2024-09-19T12:01:45.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:01:45.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:01:45.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:01:45.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:01:45.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:01:45.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:01:45.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:01:45.323 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.326+0000 7f3233fad9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:01:45.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.330+0000 7f3233fad9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:01:45.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.330+0000 7f3233fad9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:01:45.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.330+0000 7f3233fad9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:01:45.324 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.330+0000 7f3233fad9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:01:45.327 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.330+0000 7f30e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:01:45.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.338+0000 7f3233fad9c0 20 remove_watcher() i=0 2024-09-19T12:01:45.332 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.338+0000 7f3233fad9c0 2 removed watcher, disabling cache 2024-09-19T12:01:45.334 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.338+0000 7f3233fad9c0 20 remove_watcher() i=1 2024-09-19T12:01:45.337 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.342+0000 7f3233fad9c0 20 remove_watcher() i=2 2024-09-19T12:01:45.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.346+0000 7f3233fad9c0 20 remove_watcher() i=3 2024-09-19T12:01:45.341 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.346+0000 7f3233fad9c0 20 remove_watcher() i=4 2024-09-19T12:01:45.343 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.350+0000 7f3233fad9c0 20 remove_watcher() i=5 2024-09-19T12:01:45.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.350+0000 7f3233fad9c0 20 remove_watcher() i=6 2024-09-19T12:01:45.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:01:45.350+0000 7f3233fad9c0 20 remove_watcher() i=7 2024-09-19T12:02:15.403 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-19T12:02:15.435 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:15.435 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:15.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.485+0000 7fd0d0a849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.485+0000 7fd0d0a849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:15.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.485+0000 7fd0d0a849c0 20 realm 2024-09-19T12:02:15.482 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.485+0000 7fd0d0a849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.485+0000 7fd0d0a849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:15.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.485+0000 7fd0d0a849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:15.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.485+0000 7fd0d0a849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.485+0000 7fd0d0a849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:15.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.485+0000 7fd0d0a849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.489+0000 7fd0d0a849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:15.484 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.489+0000 7fd0d0a849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.489+0000 7fd0d0a849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:15.486 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.489+0000 7fd0d0a849c0 20 searching for the correct realm 2024-09-19T12:02:15.490 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.493+0000 7fd0ced8b640 0 -- 172.21.15.120:0/3766291153 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fd0b813b040 msgr2=0x7fd0b80033c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:15.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.501+0000 7fd0cdd89640 0 -- 172.21.15.120:0/3766291153 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fd0c0038400 msgr2=0x7fd0c0038880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:15.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.717+0000 7fd0d0a849c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:15.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.717+0000 7fd0d0a849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:15.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.717+0000 7fd0d0a849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:15.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.717+0000 7fd0d0a849c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:15.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.717+0000 7fd0d0a849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:15.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.717+0000 7fd0d0a849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:15.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.717+0000 7fd0d0a849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.717+0000 7fd0d0a849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:15.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.717+0000 7fd0d0a849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.717+0000 7fd0d0a849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:15.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:15.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 20 zone default found 2024-09-19T12:02:15.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 4 Realm: () 2024-09-19T12:02:15.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:15.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:15.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:15.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 20 zonegroup default 2024-09-19T12:02:15.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:15.717 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:15.718 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:15.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 20 started sync module instance, tier type = 2024-09-19T12:02:15.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.721+0000 7fd0d0a849c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:15.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.745+0000 7fd0d0a849c0 20 add_watcher() i=0 2024-09-19T12:02:15.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.745+0000 7fd0d0a849c0 20 add_watcher() i=1 2024-09-19T12:02:15.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.745+0000 7fd0d0a849c0 20 add_watcher() i=2 2024-09-19T12:02:15.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.745+0000 7fd0d0a849c0 20 add_watcher() i=3 2024-09-19T12:02:15.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.745+0000 7fd0d0a849c0 20 add_watcher() i=4 2024-09-19T12:02:15.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.745+0000 7fd0d0a849c0 20 add_watcher() i=5 2024-09-19T12:02:15.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.745+0000 7fd0d0a849c0 20 add_watcher() i=6 2024-09-19T12:02:15.744 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.749+0000 7fd0d0a849c0 20 add_watcher() i=7 2024-09-19T12:02:15.745 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.749+0000 7fd0d0a849c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:15.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.757+0000 7fcf84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:15.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.757+0000 7fd0d0a849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:15.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.757+0000 7fd0d0a849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:15.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.757+0000 7fd0d0a849c0 5 note: GC not initialized 2024-09-19T12:02:15.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.757+0000 7fceff7fe640 20 reqs_thread_entry: start 2024-09-19T12:02:15.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.757+0000 7fd0d0a849c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:15.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.757+0000 7fd0d0a849c0 20 Filter name: none 2024-09-19T12:02:15.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.757+0000 7fcefd7fa640 20 reqs_thread_entry: start 2024-09-19T12:02:15.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.757+0000 7fd0d0a849c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:02:15.754 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.757+0000 7fd0d0a849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.757+0000 7fd0d0a849c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:02:15.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.757+0000 7fd0d0a849c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:02:15.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.757+0000 7fd0d0a849c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:02:15.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.757+0000 7fd0d0a849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:02:15.755 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.757+0000 7fd0d0a849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.761+0000 7fd0d0a849c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:02:15.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.761+0000 7fd0d0a849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:02:15.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.761+0000 7fd0d0a849c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:02:15.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.761+0000 7fd0d0a849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:02:15.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.761+0000 7fd0d0a849c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:15.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.761+0000 7fd0d0a849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:02:15.763 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.769+0000 7fcf84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:15.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.773+0000 7fd0d0a849c0 20 remove_watcher() i=0 2024-09-19T12:02:15.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.773+0000 7fd0d0a849c0 2 removed watcher, disabling cache 2024-09-19T12:02:15.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.777+0000 7fd0d0a849c0 20 remove_watcher() i=1 2024-09-19T12:02:15.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.777+0000 7fd0d0a849c0 20 remove_watcher() i=2 2024-09-19T12:02:15.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.781+0000 7fd0d0a849c0 20 remove_watcher() i=3 2024-09-19T12:02:15.779 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.781+0000 7fd0d0a849c0 20 remove_watcher() i=4 2024-09-19T12:02:15.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.785+0000 7fd0d0a849c0 20 remove_watcher() i=5 2024-09-19T12:02:15.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.785+0000 7fd0d0a849c0 20 remove_watcher() i=6 2024-09-19T12:02:15.783 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.789+0000 7fd0d0a849c0 20 remove_watcher() i=7 2024-09-19T12:02:15.799 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T12:02:15.830 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:15.830 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:15.875 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.877+0000 7f571d2739c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.881+0000 7f571d2739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:15.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.881+0000 7f571d2739c0 20 realm 2024-09-19T12:02:15.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.881+0000 7f571d2739c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.881+0000 7f571d2739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:15.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.881+0000 7f571d2739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:15.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.881+0000 7f571d2739c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.881+0000 7f571d2739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:15.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.881+0000 7f571d2739c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.881+0000 7f571d2739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:15.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.881+0000 7f571d2739c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:15.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.885+0000 7f571d2739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:15.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.885+0000 7f571d2739c0 20 searching for the correct realm 2024-09-19T12:02:15.883 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:15.889+0000 7f571ad79640 0 -- 172.21.15.120:0/4110672831 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f571405cdf0 msgr2=0x7f5714066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:16.102 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.105+0000 7f571ad79640 0 -- 172.21.15.120:0/4110672831 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f571405cdf0 msgr2=0x7f5714066f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:16.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.117+0000 7f571d2739c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:16.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.117+0000 7f571d2739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:16.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.117+0000 7f571d2739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:16.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.117+0000 7f571d2739c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:16.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.117+0000 7f571d2739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:16.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.117+0000 7f571d2739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:16.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.117+0000 7f571d2739c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.117+0000 7f571d2739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:16.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.117+0000 7f571d2739c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.117+0000 7f571d2739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:16.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.117+0000 7f571d2739c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.121+0000 7f571d2739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:16.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.121+0000 7f571d2739c0 20 zone default found 2024-09-19T12:02:16.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.121+0000 7f571d2739c0 4 Realm: () 2024-09-19T12:02:16.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.121+0000 7f571d2739c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:16.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.121+0000 7f571d2739c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:16.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.121+0000 7f571d2739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:16.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.121+0000 7f571d2739c0 20 zonegroup default 2024-09-19T12:02:16.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.121+0000 7f571d2739c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.121+0000 7f571d2739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:16.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.121+0000 7f571d2739c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.121+0000 7f571d2739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:16.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.121+0000 7f571d2739c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.121+0000 7f571d2739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:16.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.121+0000 7f571d2739c0 20 started sync module instance, tier type = 2024-09-19T12:02:16.118 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.121+0000 7f571d2739c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:16.140 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.145+0000 7f571d2739c0 20 add_watcher() i=0 2024-09-19T12:02:16.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.145+0000 7f571d2739c0 20 add_watcher() i=1 2024-09-19T12:02:16.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.145+0000 7f571d2739c0 20 add_watcher() i=2 2024-09-19T12:02:16.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.145+0000 7f571d2739c0 20 add_watcher() i=3 2024-09-19T12:02:16.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.145+0000 7f571d2739c0 20 add_watcher() i=4 2024-09-19T12:02:16.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.145+0000 7f571d2739c0 20 add_watcher() i=5 2024-09-19T12:02:16.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.145+0000 7f571d2739c0 20 add_watcher() i=6 2024-09-19T12:02:16.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.145+0000 7f571d2739c0 20 add_watcher() i=7 2024-09-19T12:02:16.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.145+0000 7f571d2739c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:16.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.149+0000 7f55d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:16.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:16.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:16.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 5 note: GC not initialized 2024-09-19T12:02:16.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f55d0fe1640 20 reqs_thread_entry: start 2024-09-19T12:02:16.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:16.149 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 20 Filter name: none 2024-09-19T12:02:16.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f55c9ffb640 20 reqs_thread_entry: start 2024-09-19T12:02:16.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:02:16.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:02:16.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:02:16.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:02:16.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:02:16.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-19T12:02:16.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:02:16.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:02:16.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:02:16.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.153+0000 7f571d2739c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:16.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.157+0000 7f571d2739c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:02:16.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.157+0000 7f571d2739c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:02:16.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.157+0000 7f571d2739c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:02:16.152 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.157+0000 7f571d2739c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:02:16.153 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.157+0000 7f571d2739c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:02:16.153 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.157+0000 7f571d2739c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:02:16.153 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.157+0000 7f571d2739c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:02:16.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.157+0000 7f55d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:16.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.165+0000 7f571d2739c0 20 remove_watcher() i=0 2024-09-19T12:02:16.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.165+0000 7f571d2739c0 2 removed watcher, disabling cache 2024-09-19T12:02:16.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.165+0000 7f571d2739c0 20 remove_watcher() i=1 2024-09-19T12:02:16.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.169+0000 7f571d2739c0 20 remove_watcher() i=2 2024-09-19T12:02:16.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.169+0000 7f571d2739c0 20 remove_watcher() i=3 2024-09-19T12:02:16.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.173+0000 7f571d2739c0 20 remove_watcher() i=4 2024-09-19T12:02:16.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.173+0000 7f571d2739c0 20 remove_watcher() i=5 2024-09-19T12:02:16.171 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.177+0000 7f571d2739c0 20 remove_watcher() i=6 2024-09-19T12:02:16.173 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.177+0000 7f571d2739c0 20 remove_watcher() i=7 2024-09-19T12:02:16.188 INFO:tasks.workunit.client.0.smithi120.stderr:check reshard logrecord successfully 2024-09-19T12:02:16.189 INFO:tasks.workunit.client.0.smithi120.stderr: test: reshard versioned bucket 2024-09-19T12:02:16.189 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket myver 2024-09-19T12:02:16.217 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:16.217 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:16.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.265+0000 7f25d98229c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.265+0000 7f25d98229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:16.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.265+0000 7f25d98229c0 20 realm 2024-09-19T12:02:16.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.265+0000 7f25d98229c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.265+0000 7f25d98229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:16.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.265+0000 7f25d98229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:16.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.265+0000 7f25d98229c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.265+0000 7f25d98229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:16.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.265+0000 7f25d98229c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.264 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.269+0000 7f25d98229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:16.265 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.269+0000 7f25d98229c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.269+0000 7f25d98229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:16.267 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.269+0000 7f25d98229c0 20 searching for the correct realm 2024-09-19T12:02:16.270 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.273+0000 7f25d7328640 0 -- 172.21.15.120:0/2314003384 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f25c8042c20 msgr2=0x7f25c8039990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:02:16.485 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.489+0000 7f25d7328640 0 -- 172.21.15.120:0/2314003384 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f25c8042c20 msgr2=0x7f25c8039990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:16.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:16.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:16.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:16.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:16.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:16.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:16.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:16.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:16.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:16.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 20 zone default found 2024-09-19T12:02:16.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 4 Realm: () 2024-09-19T12:02:16.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:16.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:16.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:16.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 20 zonegroup default 2024-09-19T12:02:16.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.501+0000 7f25d98229c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.505+0000 7f25d98229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:16.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.505+0000 7f25d98229c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.505+0000 7f25d98229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:16.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.505+0000 7f25d98229c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.505+0000 7f25d98229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:16.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.505+0000 7f25d98229c0 20 started sync module instance, tier type = 2024-09-19T12:02:16.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.505+0000 7f25d98229c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:16.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.529+0000 7f25d98229c0 20 add_watcher() i=0 2024-09-19T12:02:16.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.529+0000 7f25d98229c0 20 add_watcher() i=1 2024-09-19T12:02:16.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.529+0000 7f25d98229c0 20 add_watcher() i=2 2024-09-19T12:02:16.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.529+0000 7f25d98229c0 20 add_watcher() i=3 2024-09-19T12:02:16.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.529+0000 7f25d98229c0 20 add_watcher() i=4 2024-09-19T12:02:16.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.529+0000 7f25d98229c0 20 add_watcher() i=5 2024-09-19T12:02:16.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.529+0000 7f25d98229c0 20 add_watcher() i=6 2024-09-19T12:02:16.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.533+0000 7f25d98229c0 20 add_watcher() i=7 2024-09-19T12:02:16.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.533+0000 7f25d98229c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:16.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.537+0000 7f248e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:16.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.537+0000 7f25d98229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:16.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.537+0000 7f25d98229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:16.533 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.537+0000 7f25d98229c0 5 note: GC not initialized 2024-09-19T12:02:16.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.537+0000 7f248d7e2640 20 reqs_thread_entry: start 2024-09-19T12:02:16.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.537+0000 7f25d98229c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:16.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.537+0000 7f25d98229c0 20 Filter name: none 2024-09-19T12:02:16.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.537+0000 7f24867fc640 20 reqs_thread_entry: start 2024-09-19T12:02:16.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.537+0000 7f25d98229c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.537+0000 7f25d98229c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T12:02:16.535 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.537+0000 7f25d98229c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.541+0000 7f25d98229c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T12:02:16.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.541+0000 7f25d98229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:16.537 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.541+0000 7f25d98229c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.541+0000 7f25d98229c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T12:02:16.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.541+0000 7f25d98229c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.541+0000 7f25d98229c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T12:02:16.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.541+0000 7f25d98229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:16.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.545+0000 7f248e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:16.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.549+0000 7f25d98229c0 20 remove_watcher() i=0 2024-09-19T12:02:16.546 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.549+0000 7f25d98229c0 2 removed watcher, disabling cache 2024-09-19T12:02:16.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.553+0000 7f25d98229c0 20 remove_watcher() i=1 2024-09-19T12:02:16.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.553+0000 7f25d98229c0 20 remove_watcher() i=2 2024-09-19T12:02:16.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.557+0000 7f25d98229c0 20 remove_watcher() i=3 2024-09-19T12:02:16.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.557+0000 7f25d98229c0 20 remove_watcher() i=4 2024-09-19T12:02:16.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.561+0000 7f25d98229c0 20 remove_watcher() i=5 2024-09-19T12:02:16.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.561+0000 7f25d98229c0 20 remove_watcher() i=6 2024-09-19T12:02:16.559 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.561+0000 7f25d98229c0 20 remove_watcher() i=7 2024-09-19T12:02:16.573 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:02:16.574 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T12:02:16.574 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: myver id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-19T12:02:16.574 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:02:16.574 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-09-19T12:02:16.607 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:16.607 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:16.652 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.657+0000 7efffd0109c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.657+0000 7efffd0109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:16.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.657+0000 7efffd0109c0 20 realm 2024-09-19T12:02:16.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.657+0000 7efffd0109c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.654 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.657+0000 7efffd0109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:16.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.657+0000 7efffd0109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:16.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.657+0000 7efffd0109c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.657+0000 7efffd0109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:16.655 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.657+0000 7efffd0109c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.661+0000 7efffd0109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:16.656 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.661+0000 7efffd0109c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:16.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.661+0000 7efffd0109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:16.658 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.661+0000 7efffd0109c0 20 searching for the correct realm 2024-09-19T12:02:16.661 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.665+0000 7efffb317640 0 -- 172.21.15.120:0/939764426 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7efff0033060 msgr2=0x7efff0063a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:16.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:16.881+0000 7efffa315640 0 -- 172.21.15.120:0/939764426 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7effec0e5030 msgr2=0x7effec0e4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:17.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.097+0000 7efffd0109c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:17.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.097+0000 7efffd0109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:17.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.097+0000 7efffd0109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:17.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.097+0000 7efffd0109c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:17.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.097+0000 7efffd0109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:17.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.097+0000 7efffd0109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:17.096 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.097+0000 7efffd0109c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:17.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:17.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.097 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:17.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 20 zone default found 2024-09-19T12:02:17.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 4 Realm: () 2024-09-19T12:02:17.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:17.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:17.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:17.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 20 zonegroup default 2024-09-19T12:02:17.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:17.098 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:17.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.101+0000 7efffd0109c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.099 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.105+0000 7efffd0109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:17.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.105+0000 7efffd0109c0 20 started sync module instance, tier type = 2024-09-19T12:02:17.100 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.105+0000 7efffd0109c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:17.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.125+0000 7efffd0109c0 20 add_watcher() i=0 2024-09-19T12:02:17.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.125+0000 7efffd0109c0 20 add_watcher() i=1 2024-09-19T12:02:17.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.125+0000 7efffd0109c0 20 add_watcher() i=2 2024-09-19T12:02:17.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.125+0000 7efffd0109c0 20 add_watcher() i=3 2024-09-19T12:02:17.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.125+0000 7efffd0109c0 20 add_watcher() i=4 2024-09-19T12:02:17.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.125+0000 7efffd0109c0 20 add_watcher() i=5 2024-09-19T12:02:17.122 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.125+0000 7efffd0109c0 20 add_watcher() i=6 2024-09-19T12:02:17.125 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.129+0000 7efffd0109c0 20 add_watcher() i=7 2024-09-19T12:02:17.125 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.129+0000 7efffd0109c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:17.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.133+0000 7efeb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:17.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.133+0000 7efffd0109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:17.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.133+0000 7efffd0109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:17.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.133+0000 7efffd0109c0 5 note: GC not initialized 2024-09-19T12:02:17.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.133+0000 7efe2bfff640 20 reqs_thread_entry: start 2024-09-19T12:02:17.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.133+0000 7efffd0109c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:17.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.133+0000 7efffd0109c0 20 Filter name: none 2024-09-19T12:02:17.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.133+0000 7efe29ffb640 20 reqs_thread_entry: start 2024-09-19T12:02:17.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.133+0000 7efffd0109c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-19T12:02:17.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.133+0000 7efffd0109c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.137+0000 7efffd0109c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T12:02:17.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.137+0000 7efffd0109c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-19T12:02:17.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.137+0000 7efffd0109c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-19T12:02:17.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.137+0000 7efffd0109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 : miss 2024-09-19T12:02:17.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.137+0000 7efffd0109c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.137+0000 7efffd0109c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T12:02:17.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.137+0000 7efffd0109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:17.133 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.137+0000 7efffd0109c0 10 adding default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:17.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.137+0000 7efffd0109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:02:17.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.137+0000 7efffd0109c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:17.134 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.137+0000 7efffd0109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 2024-09-19T12:02:17.141 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.145+0000 7efffd0109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:17.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.145+0000 7efffd0109c0 10 moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:17.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.145+0000 7efffd0109c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:17.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.145+0000 7efffd0109c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19, ofs0, ns] 2024-09-19T12:02:17.142 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.145+0000 7efede7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366273 cookie 94536715289216 notifier 7955 bl.length()=905 2024-09-19T12:02:17.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.145+0000 7efede7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:17.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.145+0000 7efede7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:17.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.145+0000 7efede7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:17.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.149+0000 7efffd0109c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_sources= new_sources= 2024-09-19T12:02:17.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.149+0000 7efffd0109c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential sources added=[] removed=[] 2024-09-19T12:02:17.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.149+0000 7efffd0109c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_dests= new_dests= 2024-09-19T12:02:17.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.149+0000 7efffd0109c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential dests added=[] removed=[] 2024-09-19T12:02:17.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.153+0000 7efffd0109c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.1.0 2024-09-19T12:02:17.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.153+0000 7efffd0109c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.1.0 2024-09-19T12:02:17.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.153+0000 7efffd0109c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.1.1 2024-09-19T12:02:17.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.153+0000 7efffd0109c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.1.1 2024-09-19T12:02:17.150 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.153+0000 7efffd0109c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.0 2024-09-19T12:02:17.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.153+0000 7efffd0109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 : hit (requested=0x17, cached=0x17) 2024-09-19T12:02:17.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.153+0000 7efffd0109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 2024-09-19T12:02:17.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.157+0000 7efffd0109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:17.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.157+0000 7efffd0109c0 10 moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:17.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.157+0000 7efffd0109c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:17.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.157+0000 7efffd0109c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19, ofs0, ns] 2024-09-19T12:02:17.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.157+0000 7efede7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366274 cookie 94536715289216 notifier 7955 bl.length()=905 2024-09-19T12:02:17.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.157+0000 7efede7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:17.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.157+0000 7efede7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:17.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.157+0000 7efede7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:17.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.161+0000 7efffd0109c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_sources= new_sources= 2024-09-19T12:02:17.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.161+0000 7efffd0109c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential sources added=[] removed=[] 2024-09-19T12:02:17.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.161+0000 7efffd0109c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_dests= new_dests= 2024-09-19T12:02:17.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.161+0000 7efffd0109c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential dests added=[] removed=[] 2024-09-19T12:02:17.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.165+0000 7efffd0109c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.0 2024-09-19T12:02:17.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.165+0000 7efffd0109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 : hit (requested=0x17, cached=0x17) 2024-09-19T12:02:17.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.165+0000 7efffd0109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 2024-09-19T12:02:17.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.169+0000 7efffd0109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:17.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.169+0000 7efffd0109c0 10 moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:17.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.169+0000 7efffd0109c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:17.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.169+0000 7efffd0109c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19, ofs0, ns] 2024-09-19T12:02:17.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.169+0000 7efeddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366275 cookie 94536715289216 notifier 7955 bl.length()=873 2024-09-19T12:02:17.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.169+0000 7efeddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:17.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.169+0000 7efeddffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:17.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.169+0000 7efeddffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:17.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.169+0000 7efffd0109c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_sources= new_sources= 2024-09-19T12:02:17.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.169+0000 7efffd0109c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential sources added=[] removed=[] 2024-09-19T12:02:17.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.169+0000 7efffd0109c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_dests= new_dests= 2024-09-19T12:02:17.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.169+0000 7efffd0109c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential dests added=[] removed=[] 2024-09-19T12:02:17.170 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.173+0000 7efffd0109c0 1 execute INFO: reshard of bucket "myver" from 1 shards to 2 shards completed successfully 2024-09-19T12:02:17.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.177+0000 7efeb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:17.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.181+0000 7efffd0109c0 20 remove_watcher() i=0 2024-09-19T12:02:17.179 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.181+0000 7efffd0109c0 2 removed watcher, disabling cache 2024-09-19T12:02:17.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.185+0000 7efffd0109c0 20 remove_watcher() i=1 2024-09-19T12:02:17.184 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.189+0000 7efffd0109c0 20 remove_watcher() i=2 2024-09-19T12:02:17.187 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.189+0000 7efffd0109c0 20 remove_watcher() i=3 2024-09-19T12:02:17.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.193+0000 7efffd0109c0 20 remove_watcher() i=4 2024-09-19T12:02:17.190 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.193+0000 7efffd0109c0 20 remove_watcher() i=5 2024-09-19T12:02:17.191 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.193+0000 7efffd0109c0 20 remove_watcher() i=6 2024-09-19T12:02:17.193 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.197+0000 7efffd0109c0 20 remove_watcher() i=7 2024-09-19T12:02:17.208 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket myver 2024-09-19T12:02:17.239 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:17.239 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:17.283 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.285+0000 7f0bf8f309c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.285 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.289+0000 7f0bf8f309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:17.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.289+0000 7f0bf8f309c0 20 realm 2024-09-19T12:02:17.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.289+0000 7f0bf8f309c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.289+0000 7f0bf8f309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:17.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.289+0000 7f0bf8f309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:17.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.289+0000 7f0bf8f309c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.289+0000 7f0bf8f309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:17.286 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.289+0000 7f0bf8f309c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.289+0000 7f0bf8f309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:17.287 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.289+0000 7f0bf8f309c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.293+0000 7f0bf8f309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:17.289 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.293+0000 7f0bf8f309c0 20 searching for the correct realm 2024-09-19T12:02:17.292 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.297+0000 7f0bf7237640 0 -- 172.21.15.120:0/830496473 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f0bec113970 msgr2=0x7f0bec12eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:17.299 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.301+0000 7f0bf6235640 0 -- 172.21.15.120:0/830496473 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f0bf0008960 msgr2=0x7f0bf0043410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:17.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.517+0000 7f0bf8f309c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:17.513 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.517+0000 7f0bf8f309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:17.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.517+0000 7f0bf8f309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:17.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.517+0000 7f0bf8f309c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:17.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.517+0000 7f0bf8f309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:17.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.517+0000 7f0bf8f309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:17.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.517+0000 7f0bf8f309c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.514 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.517+0000 7f0bf8f309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:17.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.517+0000 7f0bf8f309c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.517+0000 7f0bf8f309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:17.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.517+0000 7f0bf8f309c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.521+0000 7f0bf8f309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:17.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.521+0000 7f0bf8f309c0 20 zone default found 2024-09-19T12:02:17.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.521+0000 7f0bf8f309c0 4 Realm: () 2024-09-19T12:02:17.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.521+0000 7f0bf8f309c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:17.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.521+0000 7f0bf8f309c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:17.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.521+0000 7f0bf8f309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:17.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.521+0000 7f0bf8f309c0 20 zonegroup default 2024-09-19T12:02:17.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.521+0000 7f0bf8f309c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.521+0000 7f0bf8f309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:17.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.521+0000 7f0bf8f309c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.521+0000 7f0bf8f309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:17.517 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.521+0000 7f0bf8f309c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.521+0000 7f0bf8f309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:17.518 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.521+0000 7f0bf8f309c0 20 started sync module instance, tier type = 2024-09-19T12:02:17.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.521+0000 7f0bf8f309c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:17.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.545+0000 7f0bf8f309c0 20 add_watcher() i=0 2024-09-19T12:02:17.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.545+0000 7f0bf8f309c0 20 add_watcher() i=1 2024-09-19T12:02:17.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.545+0000 7f0bf8f309c0 20 add_watcher() i=2 2024-09-19T12:02:17.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.545+0000 7f0bf8f309c0 20 add_watcher() i=3 2024-09-19T12:02:17.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.545+0000 7f0bf8f309c0 20 add_watcher() i=4 2024-09-19T12:02:17.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.545+0000 7f0bf8f309c0 20 add_watcher() i=5 2024-09-19T12:02:17.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.545+0000 7f0bf8f309c0 20 add_watcher() i=6 2024-09-19T12:02:17.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.549+0000 7f0bf8f309c0 20 add_watcher() i=7 2024-09-19T12:02:17.544 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.549+0000 7f0bf8f309c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:17.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.553+0000 7f0aad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:17.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.553+0000 7f0bf8f309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:17.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.553+0000 7f0bf8f309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:17.549 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.553+0000 7f0bf8f309c0 5 note: GC not initialized 2024-09-19T12:02:17.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.553+0000 7f0a27fff640 20 reqs_thread_entry: start 2024-09-19T12:02:17.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.553+0000 7f0bf8f309c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:17.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.553+0000 7f0bf8f309c0 20 Filter name: none 2024-09-19T12:02:17.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.553+0000 7f0a25ffb640 20 reqs_thread_entry: start 2024-09-19T12:02:17.551 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.553+0000 7f0bf8f309c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.557+0000 7f0bf8f309c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T12:02:17.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.557+0000 7f0bf8f309c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.557+0000 7f0bf8f309c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T12:02:17.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.557+0000 7f0bf8f309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:17.553 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.557+0000 7f0bf8f309c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.557+0000 7f0bf8f309c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T12:02:17.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.557+0000 7f0bf8f309c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.557+0000 7f0bf8f309c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T12:02:17.555 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.557+0000 7f0bf8f309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:17.557 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.561+0000 7f0aad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:17.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.565+0000 7f0bf8f309c0 20 remove_watcher() i=0 2024-09-19T12:02:17.563 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.565+0000 7f0bf8f309c0 2 removed watcher, disabling cache 2024-09-19T12:02:17.565 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.569+0000 7f0bf8f309c0 20 remove_watcher() i=1 2024-09-19T12:02:17.567 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.573+0000 7f0bf8f309c0 20 remove_watcher() i=2 2024-09-19T12:02:17.569 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.573+0000 7f0bf8f309c0 20 remove_watcher() i=3 2024-09-19T12:02:17.571 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.577+0000 7f0bf8f309c0 20 remove_watcher() i=4 2024-09-19T12:02:17.573 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.577+0000 7f0bf8f309c0 20 remove_watcher() i=5 2024-09-19T12:02:17.574 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.577+0000 7f0bf8f309c0 20 remove_watcher() i=6 2024-09-19T12:02:17.576 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.581+0000 7f0bf8f309c0 20 remove_watcher() i=7 2024-09-19T12:02:17.594 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:02:17.594 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T12:02:17.594 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: myver id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-19T12:02:17.594 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:02:17.644 INFO:tasks.workunit.client.0.smithi120.stderr: test: reshard removes olh entries with empty name 2024-09-19T12:02:17.799 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T12:02:17.831 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:17.831 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:17.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.881+0000 7f8e34f0c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.878 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.881+0000 7f8e34f0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:17.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.881+0000 7f8e34f0c9c0 20 realm 2024-09-19T12:02:17.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.881+0000 7f8e34f0c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.881+0000 7f8e34f0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:17.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.881+0000 7f8e34f0c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:17.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.881+0000 7f8e34f0c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.881+0000 7f8e34f0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:17.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.881+0000 7f8e34f0c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.885+0000 7f8e34f0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:17.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.885+0000 7f8e34f0c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:17.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.885+0000 7f8e34f0c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:17.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.885+0000 7f8e34f0c9c0 20 searching for the correct realm 2024-09-19T12:02:17.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:17.889+0000 7f8e32a12640 0 -- 172.21.15.120:0/1392136390 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f8e2c017410 msgr2=0x7f8e2c017830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:02:18.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.105+0000 7f8e32a12640 0 -- 172.21.15.120:0/1392136390 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f8e2c017410 msgr2=0x7f8e2c017830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:18.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:18.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:18.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:18.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:18.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:18.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:18.113 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:18.114 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:18.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 zone default found 2024-09-19T12:02:18.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 4 Realm: () 2024-09-19T12:02:18.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:18.115 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:18.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:18.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 zonegroup default 2024-09-19T12:02:18.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.117+0000 7f8e34f0c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.116 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.121+0000 7f8e34f0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.121+0000 7f8e34f0c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.121+0000 7f8e34f0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.121+0000 7f8e34f0c9c0 20 started sync module instance, tier type = 2024-09-19T12:02:18.117 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.121+0000 7f8e34f0c9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:18.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.141+0000 7f8e34f0c9c0 20 add_watcher() i=0 2024-09-19T12:02:18.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.141+0000 7f8e34f0c9c0 20 add_watcher() i=1 2024-09-19T12:02:18.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.141+0000 7f8e34f0c9c0 20 add_watcher() i=2 2024-09-19T12:02:18.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.141+0000 7f8e34f0c9c0 20 add_watcher() i=3 2024-09-19T12:02:18.138 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.141+0000 7f8e34f0c9c0 20 add_watcher() i=4 2024-09-19T12:02:18.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.141+0000 7f8e34f0c9c0 20 add_watcher() i=5 2024-09-19T12:02:18.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.141+0000 7f8e34f0c9c0 20 add_watcher() i=6 2024-09-19T12:02:18.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.145+0000 7f8e34f0c9c0 20 add_watcher() i=7 2024-09-19T12:02:18.139 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.145+0000 7f8e34f0c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:18.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.145+0000 7f8ce97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:18.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.149+0000 7f8e34f0c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:18.143 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.149+0000 7f8e34f0c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:18.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.149+0000 7f8e34f0c9c0 5 note: GC not initialized 2024-09-19T12:02:18.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.149+0000 7f8c63fff640 20 reqs_thread_entry: start 2024-09-19T12:02:18.144 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.149+0000 7f8e34f0c9c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:18.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.149+0000 7f8e34f0c9c0 20 Filter name: none 2024-09-19T12:02:18.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.149+0000 7f8c61ffb640 20 reqs_thread_entry: start 2024-09-19T12:02:18.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.149+0000 7f8e34f0c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.149+0000 7f8e34f0c9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:02:18.145 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.149+0000 7f8e34f0c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.146 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.149+0000 7f8e34f0c9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:02:18.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.149+0000 7f8e34f0c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:18.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.149+0000 7f8e34f0c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.153+0000 7f8e34f0c9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:02:18.147 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.153+0000 7f8e34f0c9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.153+0000 7f8e34f0c9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:02:18.148 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.153+0000 7f8e34f0c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:18.151 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.153+0000 7f8ce97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:18.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.161+0000 7f8e34f0c9c0 20 remove_watcher() i=0 2024-09-19T12:02:18.156 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.161+0000 7f8e34f0c9c0 2 removed watcher, disabling cache 2024-09-19T12:02:18.157 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.161+0000 7f8e34f0c9c0 20 remove_watcher() i=1 2024-09-19T12:02:18.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.165+0000 7f8e34f0c9c0 20 remove_watcher() i=2 2024-09-19T12:02:18.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.165+0000 7f8e34f0c9c0 20 remove_watcher() i=3 2024-09-19T12:02:18.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.169+0000 7f8e34f0c9c0 20 remove_watcher() i=4 2024-09-19T12:02:18.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.169+0000 7f8e34f0c9c0 20 remove_watcher() i=5 2024-09-19T12:02:18.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.169+0000 7f8e34f0c9c0 20 remove_watcher() i=6 2024-09-19T12:02:18.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.173+0000 7f8e34f0c9c0 20 remove_watcher() i=7 2024-09-19T12:02:18.182 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:02:18.182 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T12:02:18.182 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: a-bucket id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 num_objects: 0 size_kb: 0 num_shards: 3 2024-09-19T12:02:18.182 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:02:18.184 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-19T12:02:18.213 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:18.213 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:18.257 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.261+0000 7f16ea3849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.261+0000 7f16ea3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.261+0000 7f16ea3849c0 20 realm 2024-09-19T12:02:18.258 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.261+0000 7f16ea3849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.261+0000 7f16ea3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.261+0000 7f16ea3849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:18.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.261+0000 7f16ea3849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.261+0000 7f16ea3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.259 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.261+0000 7f16ea3849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.265+0000 7f16ea3849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:18.261 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.265+0000 7f16ea3849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.262 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.265+0000 7f16ea3849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:18.263 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.265+0000 7f16ea3849c0 20 searching for the correct realm 2024-09-19T12:02:18.266 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.269+0000 7f16e7e8a640 0 -- 172.21.15.120:0/2222859000 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f16e012eb60 msgr2=0x7f16e00ff060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:18.481 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.485+0000 7f16e7e8a640 0 -- 172.21.15.120:0/2222859000 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f16e012eb60 msgr2=0x7f16e00ff060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:18.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:18.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:18.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:18.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:18.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:18.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:18.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:18.494 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:18.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 20 zone default found 2024-09-19T12:02:18.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 4 Realm: () 2024-09-19T12:02:18.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:18.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:18.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:18.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 20 zonegroup default 2024-09-19T12:02:18.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.497+0000 7f16ea3849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.501+0000 7f16ea3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.501+0000 7f16ea3849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.496 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.501+0000 7f16ea3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.501+0000 7f16ea3849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.501+0000 7f16ea3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.501+0000 7f16ea3849c0 20 started sync module instance, tier type = 2024-09-19T12:02:18.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.501+0000 7f16ea3849c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:18.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.521+0000 7f16ea3849c0 20 add_watcher() i=0 2024-09-19T12:02:18.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.521+0000 7f16ea3849c0 20 add_watcher() i=1 2024-09-19T12:02:18.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.521+0000 7f16ea3849c0 20 add_watcher() i=2 2024-09-19T12:02:18.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.521+0000 7f16ea3849c0 20 add_watcher() i=3 2024-09-19T12:02:18.520 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.521+0000 7f16ea3849c0 20 add_watcher() i=4 2024-09-19T12:02:18.520 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.521+0000 7f16ea3849c0 20 add_watcher() i=5 2024-09-19T12:02:18.520 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.521+0000 7f16ea3849c0 20 add_watcher() i=6 2024-09-19T12:02:18.521 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.525+0000 7f16ea3849c0 20 add_watcher() i=7 2024-09-19T12:02:18.521 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.525+0000 7f16ea3849c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:18.526 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.529+0000 7f159dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:18.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.529+0000 7f16ea3849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:18.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.529+0000 7f16ea3849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:18.527 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.529+0000 7f16ea3849c0 5 note: GC not initialized 2024-09-19T12:02:18.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.533+0000 7f159cfe1640 20 reqs_thread_entry: start 2024-09-19T12:02:18.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.533+0000 7f16ea3849c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:18.528 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.533+0000 7f16ea3849c0 20 Filter name: none 2024-09-19T12:02:18.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.533+0000 7f15167fc640 20 reqs_thread_entry: start 2024-09-19T12:02:18.529 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.533+0000 7f16ea3849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.533+0000 7f16ea3849c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:02:18.530 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.533+0000 7f16ea3849c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.533+0000 7f16ea3849c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:02:18.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.533+0000 7f16ea3849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:18.532 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.537+0000 7f159dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:18.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.541+0000 7f16ea3849c0 20 remove_watcher() i=0 2024-09-19T12:02:18.538 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.541+0000 7f16ea3849c0 2 removed watcher, disabling cache 2024-09-19T12:02:18.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.545+0000 7f16ea3849c0 20 remove_watcher() i=1 2024-09-19T12:02:18.542 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.545+0000 7f16ea3849c0 20 remove_watcher() i=2 2024-09-19T12:02:18.545 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.549+0000 7f16ea3849c0 20 remove_watcher() i=3 2024-09-19T12:02:18.547 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.549+0000 7f16ea3849c0 20 remove_watcher() i=4 2024-09-19T12:02:18.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.553+0000 7f16ea3849c0 20 remove_watcher() i=5 2024-09-19T12:02:18.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.553+0000 7f16ea3849c0 20 remove_watcher() i=6 2024-09-19T12:02:18.551 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.557+0000 7f16ea3849c0 20 remove_watcher() i=7 2024-09-19T12:02:18.566 INFO:tasks.workunit.client.0.smithi120.stderr:rados -p default.rgw.buckets.index setomapval .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-19T12:02:18.593 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:18.593 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:18.612 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-19T12:02:18.640 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:18.640 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:18.679 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.681+0000 7f4dac4499c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.685+0000 7f4dac4499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.685+0000 7f4dac4499c0 20 realm 2024-09-19T12:02:18.681 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.685+0000 7f4dac4499c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.685+0000 7f4dac4499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.685+0000 7f4dac4499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:18.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.685+0000 7f4dac4499c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.685+0000 7f4dac4499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.682 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.685+0000 7f4dac4499c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.685+0000 7f4dac4499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:18.683 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.685+0000 7f4dac4499c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.689+0000 7f4dac4499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:18.685 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.689+0000 7f4dac4499c0 20 searching for the correct realm 2024-09-19T12:02:18.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.693+0000 7f4da9f4f640 0 -- 172.21.15.120:0/4257756449 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f4da4100560 msgr2=0x7f4da41091d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:18.906 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.909+0000 7f4da9f4f640 0 -- 172.21.15.120:0/4257756449 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f4da4100560 msgr2=0x7f4da41091d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:18.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.921+0000 7f4dac4499c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:18.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.921+0000 7f4dac4499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:18.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.921+0000 7f4dac4499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:18.918 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.921+0000 7f4dac4499c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:18.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.921+0000 7f4dac4499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:18.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.921+0000 7f4dac4499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:18.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.921+0000 7f4dac4499c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.921+0000 7f4dac4499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.919 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.921+0000 7f4dac4499c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.925+0000 7f4dac4499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:18.920 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.925+0000 7f4dac4499c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.925+0000 7f4dac4499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:18.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.925+0000 7f4dac4499c0 20 zone default found 2024-09-19T12:02:18.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.925+0000 7f4dac4499c0 4 Realm: () 2024-09-19T12:02:18.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.925+0000 7f4dac4499c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:18.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.925+0000 7f4dac4499c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:18.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.925+0000 7f4dac4499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:18.921 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.925+0000 7f4dac4499c0 20 zonegroup default 2024-09-19T12:02:18.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.925+0000 7f4dac4499c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.925+0000 7f4dac4499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.922 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.925+0000 7f4dac4499c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.925+0000 7f4dac4499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.923 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.925+0000 7f4dac4499c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.929+0000 7f4dac4499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:18.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.929+0000 7f4dac4499c0 20 started sync module instance, tier type = 2024-09-19T12:02:18.924 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.929+0000 7f4dac4499c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:18.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.949+0000 7f4dac4499c0 20 add_watcher() i=0 2024-09-19T12:02:18.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.949+0000 7f4dac4499c0 20 add_watcher() i=1 2024-09-19T12:02:18.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.949+0000 7f4dac4499c0 20 add_watcher() i=2 2024-09-19T12:02:18.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.949+0000 7f4dac4499c0 20 add_watcher() i=3 2024-09-19T12:02:18.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.949+0000 7f4dac4499c0 20 add_watcher() i=4 2024-09-19T12:02:18.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.949+0000 7f4dac4499c0 20 add_watcher() i=5 2024-09-19T12:02:18.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.949+0000 7f4dac4499c0 20 add_watcher() i=6 2024-09-19T12:02:18.950 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.953+0000 7f4dac4499c0 20 add_watcher() i=7 2024-09-19T12:02:18.950 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.953+0000 7f4dac4499c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:18.954 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.957+0000 7f4c5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:18.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.957+0000 7f4dac4499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:18.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.957+0000 7f4dac4499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:18.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.957+0000 7f4dac4499c0 5 note: GC not initialized 2024-09-19T12:02:18.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.957+0000 7f4c5a7fc640 20 reqs_thread_entry: start 2024-09-19T12:02:18.955 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.961+0000 7f4dac4499c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:18.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.961+0000 7f4dac4499c0 20 Filter name: none 2024-09-19T12:02:18.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.961+0000 7f4bcbfff640 20 reqs_thread_entry: start 2024-09-19T12:02:18.956 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.961+0000 7f4dac4499c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.961+0000 7f4dac4499c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:02:18.957 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.961+0000 7f4dac4499c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:18.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.961+0000 7f4dac4499c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:02:18.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.961+0000 7f4dac4499c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:18.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.961+0000 7f4dac4499c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-19T12:02:18.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.961+0000 7f4dac4499c0 20 INFO: main: starting shard=0 2024-09-19T12:02:18.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.961+0000 7f4dac4499c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:02:18.959 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.961+0000 7f4dac4499c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:02:18.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.965+0000 7f4dac4499c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T12:02:18.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.965+0000 7f4dac4499c0 20 INFO: main: starting shard=1 2024-09-19T12:02:18.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.965+0000 7f4dac4499c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:02:18.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.965+0000 7f4dac4499c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:02:18.960 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.965+0000 7f4dac4499c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T12:02:18.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.965+0000 7f4dac4499c0 20 INFO: main: starting shard=2 2024-09-19T12:02:18.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.965+0000 7f4dac4499c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:02:18.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.965+0000 7f4dac4499c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:02:18.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.965+0000 7f4dac4499c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T12:02:18.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.965+0000 7f4dac4499c0 20 INFO: main: done 2024-09-19T12:02:18.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.965+0000 7f4c5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:18.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.973+0000 7f4dac4499c0 20 remove_watcher() i=0 2024-09-19T12:02:18.968 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.973+0000 7f4dac4499c0 2 removed watcher, disabling cache 2024-09-19T12:02:18.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.973+0000 7f4dac4499c0 20 remove_watcher() i=1 2024-09-19T12:02:18.973 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.977+0000 7f4dac4499c0 20 remove_watcher() i=2 2024-09-19T12:02:18.976 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.981+0000 7f4dac4499c0 20 remove_watcher() i=3 2024-09-19T12:02:18.978 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.981+0000 7f4dac4499c0 20 remove_watcher() i=4 2024-09-19T12:02:18.979 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.985+0000 7f4dac4499c0 20 remove_watcher() i=5 2024-09-19T12:02:18.981 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.985+0000 7f4dac4499c0 20 remove_watcher() i=6 2024-09-19T12:02:18.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:18.985+0000 7f4dac4499c0 20 remove_watcher() i=7 2024-09-19T12:02:19.000 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-19T12:02:19.032 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:19.032 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:19.077 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.081+0000 7fe912bfc9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.081+0000 7fe912bfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.081+0000 7fe912bfc9c0 20 realm 2024-09-19T12:02:19.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.081+0000 7fe912bfc9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.081+0000 7fe912bfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.081+0000 7fe912bfc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:19.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.081+0000 7fe912bfc9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.081+0000 7fe912bfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.079 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.081+0000 7fe912bfc9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.080 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.085+0000 7fe912bfc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:19.080 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.085+0000 7fe912bfc9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.085+0000 7fe912bfc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:19.082 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.085+0000 7fe912bfc9c0 20 searching for the correct realm 2024-09-19T12:02:19.086 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.089+0000 7fe910702640 0 -- 172.21.15.120:0/3049477405 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fe9080de040 msgr2=0x7fe9080de420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:02:19.301 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.305+0000 7fe910702640 0 -- 172.21.15.120:0/3049477405 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fe9080de040 msgr2=0x7fe9080de420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:19.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:19.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:19.312 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:19.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:19.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:19.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:19.313 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:19.314 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.315 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:19.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 zone default found 2024-09-19T12:02:19.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 4 Realm: () 2024-09-19T12:02:19.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:19.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:19.316 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:19.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 zonegroup default 2024-09-19T12:02:19.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.317 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.317+0000 7fe912bfc9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.321+0000 7fe912bfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.321+0000 7fe912bfc9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.321+0000 7fe912bfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.321+0000 7fe912bfc9c0 20 started sync module instance, tier type = 2024-09-19T12:02:19.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.321+0000 7fe912bfc9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:19.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.341+0000 7fe912bfc9c0 20 add_watcher() i=0 2024-09-19T12:02:19.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.341+0000 7fe912bfc9c0 20 add_watcher() i=1 2024-09-19T12:02:19.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.341+0000 7fe912bfc9c0 20 add_watcher() i=2 2024-09-19T12:02:19.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.341+0000 7fe912bfc9c0 20 add_watcher() i=3 2024-09-19T12:02:19.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.341+0000 7fe912bfc9c0 20 add_watcher() i=4 2024-09-19T12:02:19.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.341+0000 7fe912bfc9c0 20 add_watcher() i=5 2024-09-19T12:02:19.339 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.341+0000 7fe912bfc9c0 20 add_watcher() i=6 2024-09-19T12:02:19.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.345+0000 7fe912bfc9c0 20 add_watcher() i=7 2024-09-19T12:02:19.340 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.345+0000 7fe912bfc9c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:19.344 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.349+0000 7fe7c77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:19.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.349+0000 7fe912bfc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:19.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.349+0000 7fe912bfc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:19.345 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.349+0000 7fe912bfc9c0 5 note: GC not initialized 2024-09-19T12:02:19.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.349+0000 7fe7c67dc640 20 reqs_thread_entry: start 2024-09-19T12:02:19.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.349+0000 7fe912bfc9c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:19.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.349+0000 7fe912bfc9c0 20 Filter name: none 2024-09-19T12:02:19.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.349+0000 7fe7bf7fe640 20 reqs_thread_entry: start 2024-09-19T12:02:19.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.349+0000 7fe912bfc9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T12:02:19.347 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.349+0000 7fe912bfc9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.353+0000 7fe912bfc9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:02:19.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.353+0000 7fe912bfc9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T12:02:19.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.353+0000 7fe912bfc9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T12:02:19.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.353+0000 7fe912bfc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : miss 2024-09-19T12:02:19.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.353+0000 7fe912bfc9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.353+0000 7fe912bfc9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:02:19.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.353+0000 7fe912bfc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:02:19.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.353+0000 7fe912bfc9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:02:19.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.353+0000 7fe912bfc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:02:19.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.353+0000 7fe912bfc9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:19.350 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.353+0000 7fe912bfc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:02:19.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.361+0000 7fe912bfc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:02:19.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.361+0000 7fe912bfc9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:02:19.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.361+0000 7fe912bfc9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:19.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.361+0000 7fe912bfc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T12:02:19.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.361+0000 7fe7e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366221 cookie 93838237318096 notifier 8042 bl.length()=911 2024-09-19T12:02:19.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.361+0000 7fe7e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:02:19.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.361+0000 7fe7e6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:02:19.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.361+0000 7fe7e6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:19.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.361+0000 7fe912bfc9c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T12:02:19.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.361+0000 7fe912bfc9c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T12:02:19.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.361+0000 7fe912bfc9c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T12:02:19.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.361+0000 7fe912bfc9c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T12:02:19.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.365+0000 7fe912bfc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.0 2024-09-19T12:02:19.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.365+0000 7fe912bfc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.0 2024-09-19T12:02:19.364 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.365+0000 7fe912bfc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:02:19.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.365+0000 7fe912bfc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:02:19.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.369+0000 7fe912bfc9c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-19T12:02:19.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.369+0000 7fe912bfc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:02:19.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.369+0000 7fe912bfc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:02:19.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.369+0000 7fe912bfc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:02:19.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.369+0000 7fe912bfc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:02:19.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.369+0000 7fe912bfc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : hit (requested=0x17, cached=0x17) 2024-09-19T12:02:19.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.369+0000 7fe912bfc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:02:19.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.373+0000 7fe912bfc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:02:19.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.373+0000 7fe912bfc9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:02:19.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.373+0000 7fe912bfc9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:19.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.373+0000 7fe912bfc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T12:02:19.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.373+0000 7fe7e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366222 cookie 93838237318096 notifier 8042 bl.length()=911 2024-09-19T12:02:19.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.373+0000 7fe7e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:02:19.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.373+0000 7fe7e6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:02:19.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.373+0000 7fe7e6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:19.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.373+0000 7fe912bfc9c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T12:02:19.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.373+0000 7fe912bfc9c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T12:02:19.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.373+0000 7fe912bfc9c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T12:02:19.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.373+0000 7fe912bfc9c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T12:02:19.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.377+0000 7fe912bfc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:02:19.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.377+0000 7fe912bfc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.0 2024-09-19T12:02:19.373 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.377+0000 7fe912bfc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:02:19.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.377+0000 7fe912bfc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.1 2024-09-19T12:02:19.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.377+0000 7fe912bfc9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:02:19.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.377+0000 7fe912bfc9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.2.2 2024-09-19T12:02:19.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.377+0000 7fe912bfc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 : hit (requested=0x17, cached=0x17) 2024-09-19T12:02:19.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.377+0000 7fe912bfc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 2024-09-19T12:02:19.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.381+0000 7fe912bfc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:02:19.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.381+0000 7fe912bfc9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:02:19.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.381+0000 7fe912bfc9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:19.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.381+0000 7fe912bfc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18, ofs0, ns] 2024-09-19T12:02:19.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.381+0000 7fe7e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366223 cookie 93838237318096 notifier 8042 bl.length()=879 2024-09-19T12:02:19.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.381+0000 7fe7e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 info.flags=0x17 2024-09-19T12:02:19.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.381+0000 7fe7e6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18 to cache LRU end 2024-09-19T12:02:19.379 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.381+0000 7fe7e6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:19.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.381+0000 7fe912bfc9c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_sources= new_sources= 2024-09-19T12:02:19.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.381+0000 7fe912bfc9c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential sources added=[] removed=[] 2024-09-19T12:02:19.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.381+0000 7fe912bfc9c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): orig_dests= new_dests= 2024-09-19T12:02:19.380 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.381+0000 7fe912bfc9c0 20 handle_bi_update(): bucket=:a-bucket[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18]): potential dests added=[] removed=[] 2024-09-19T12:02:19.382 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.385+0000 7fe912bfc9c0 1 execute INFO: reshard of bucket "a-bucket" from 3 shards to 1 shards completed successfully 2024-09-19T12:02:19.385 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.389+0000 7fe7c77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:19.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.393+0000 7fe912bfc9c0 20 remove_watcher() i=0 2024-09-19T12:02:19.390 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.393+0000 7fe912bfc9c0 2 removed watcher, disabling cache 2024-09-19T12:02:19.392 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.397+0000 7fe912bfc9c0 20 remove_watcher() i=1 2024-09-19T12:02:19.394 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.397+0000 7fe912bfc9c0 20 remove_watcher() i=2 2024-09-19T12:02:19.396 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.401+0000 7fe912bfc9c0 20 remove_watcher() i=3 2024-09-19T12:02:19.399 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.401+0000 7fe912bfc9c0 20 remove_watcher() i=4 2024-09-19T12:02:19.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.405+0000 7fe912bfc9c0 20 remove_watcher() i=5 2024-09-19T12:02:19.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.405+0000 7fe912bfc9c0 20 remove_watcher() i=6 2024-09-19T12:02:19.403 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.405+0000 7fe912bfc9c0 20 remove_watcher() i=7 2024-09-19T12:02:19.421 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-19T12:02:19.451 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:19.451 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:19.495 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.497+0000 7f392febb9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.501+0000 7f392febb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.501+0000 7f392febb9c0 20 realm 2024-09-19T12:02:19.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.501+0000 7f392febb9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.501+0000 7f392febb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.501+0000 7f392febb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:19.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.501+0000 7f392febb9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.501+0000 7f392febb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.501+0000 7f392febb9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.501+0000 7f392febb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:19.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.501+0000 7f392febb9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.505+0000 7f392febb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:19.501 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.505+0000 7f392febb9c0 20 searching for the correct realm 2024-09-19T12:02:19.504 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.509+0000 7f392e1c2640 0 -- 172.21.15.120:0/1483560477 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f392413c190 msgr2=0x7f39240ff970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:19.512 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.517+0000 7f392d1c0640 0 -- 172.21.15.120:0/1483560477 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f3920008960 msgr2=0x7f392004e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:19.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.733+0000 7f392febb9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:19.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:19.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:19.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:19.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:19.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:19.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:19.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:19.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 zone default found 2024-09-19T12:02:19.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 4 Realm: () 2024-09-19T12:02:19.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:19.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:19.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:19.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 zonegroup default 2024-09-19T12:02:19.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.735 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.737+0000 7f392febb9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.741+0000 7f392febb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.741+0000 7f392febb9c0 20 started sync module instance, tier type = 2024-09-19T12:02:19.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.741+0000 7f392febb9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:19.756 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.761+0000 7f392febb9c0 20 add_watcher() i=0 2024-09-19T12:02:19.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.761+0000 7f392febb9c0 20 add_watcher() i=1 2024-09-19T12:02:19.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.761+0000 7f392febb9c0 20 add_watcher() i=2 2024-09-19T12:02:19.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.761+0000 7f392febb9c0 20 add_watcher() i=3 2024-09-19T12:02:19.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.761+0000 7f392febb9c0 20 add_watcher() i=4 2024-09-19T12:02:19.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.761+0000 7f392febb9c0 20 add_watcher() i=5 2024-09-19T12:02:19.757 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.761+0000 7f392febb9c0 20 add_watcher() i=6 2024-09-19T12:02:19.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.761+0000 7f392febb9c0 20 add_watcher() i=7 2024-09-19T12:02:19.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.761+0000 7f392febb9c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:19.762 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.765+0000 7f37df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:19.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.765+0000 7f392febb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:19.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.765+0000 7f392febb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:19.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.765+0000 7f392febb9c0 5 note: GC not initialized 2024-09-19T12:02:19.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.765+0000 7f37de7fc640 20 reqs_thread_entry: start 2024-09-19T12:02:19.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.765+0000 7f392febb9c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:19.764 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.765+0000 7f392febb9c0 20 Filter name: none 2024-09-19T12:02:19.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.765+0000 7f374ffff640 20 reqs_thread_entry: start 2024-09-19T12:02:19.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.765+0000 7f392febb9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.769+0000 7f392febb9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-19T12:02:19.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.769+0000 7f392febb9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.769+0000 7f392febb9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-19T12:02:19.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.769+0000 7f392febb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:19.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.769+0000 7f392febb9c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-19T12:02:19.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.769+0000 7f392febb9c0 20 INFO: main: starting shard=0 2024-09-19T12:02:19.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.769+0000 7f392febb9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.0 2024-09-19T12:02:19.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.769+0000 7f392febb9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18.3.0 2024-09-19T12:02:19.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.769+0000 7f392febb9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T12:02:19.766 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.769+0000 7f392febb9c0 20 INFO: main: done 2024-09-19T12:02:19.767 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.773+0000 7f37df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:19.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.777+0000 7f392febb9c0 20 remove_watcher() i=0 2024-09-19T12:02:19.772 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.777+0000 7f392febb9c0 2 removed watcher, disabling cache 2024-09-19T12:02:19.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.777+0000 7f392febb9c0 20 remove_watcher() i=1 2024-09-19T12:02:19.776 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.781+0000 7f392febb9c0 20 remove_watcher() i=2 2024-09-19T12:02:19.778 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.781+0000 7f392febb9c0 20 remove_watcher() i=3 2024-09-19T12:02:19.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.785+0000 7f392febb9c0 20 remove_watcher() i=4 2024-09-19T12:02:19.782 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.785+0000 7f392febb9c0 20 remove_watcher() i=5 2024-09-19T12:02:19.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.789+0000 7f392febb9c0 20 remove_watcher() i=6 2024-09-19T12:02:19.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.789+0000 7f392febb9c0 20 remove_watcher() i=7 2024-09-19T12:02:19.800 INFO:tasks.workunit.client.0.smithi120.stderr: test: PUT succeeds during reshard 2024-09-19T12:02:19.800 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket myver 2024-09-19T12:02:19.832 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:19.832 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:19.877 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.881+0000 7f612e5dd9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.881+0000 7f612e5dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.881+0000 7f612e5dd9c0 20 realm 2024-09-19T12:02:19.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.881+0000 7f612e5dd9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.881+0000 7f612e5dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.879 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.881+0000 7f612e5dd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:19.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.881+0000 7f612e5dd9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.881+0000 7f612e5dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:19.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.881+0000 7f612e5dd9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.885+0000 7f612e5dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:19.880 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.885+0000 7f612e5dd9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:19.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.885+0000 7f612e5dd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:19.882 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.885+0000 7f612e5dd9c0 20 searching for the correct realm 2024-09-19T12:02:19.885 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:19.889+0000 7f612c8e4640 0 -- 172.21.15.120:0/2986948958 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f6120089330 msgr2=0x7f6120003740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:02:20.101 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.104+0000 7f612b8e2640 0 -- 172.21.15.120:0/2986948958 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f611c0f4400 msgr2=0x7f611c0f4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:20.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.320+0000 7f612e5dd9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:20.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.320+0000 7f612e5dd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:20.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.320+0000 7f612e5dd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:20.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.320+0000 7f612e5dd9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:20.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.320+0000 7f612e5dd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:20.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.320+0000 7f612e5dd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:20.318 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.320+0000 7f612e5dd9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.320+0000 7f612e5dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:20.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.320+0000 7f612e5dd9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.320+0000 7f612e5dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:20.319 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.320+0000 7f612e5dd9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.324+0000 7f612e5dd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:20.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.324+0000 7f612e5dd9c0 20 zone default found 2024-09-19T12:02:20.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.324+0000 7f612e5dd9c0 4 Realm: () 2024-09-19T12:02:20.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.324+0000 7f612e5dd9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:20.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.324+0000 7f612e5dd9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:20.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.324+0000 7f612e5dd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:20.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.324+0000 7f612e5dd9c0 20 zonegroup default 2024-09-19T12:02:20.320 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.324+0000 7f612e5dd9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.324+0000 7f612e5dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:20.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.324+0000 7f612e5dd9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.324+0000 7f612e5dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:20.321 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.324+0000 7f612e5dd9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.324+0000 7f612e5dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:20.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.324+0000 7f612e5dd9c0 20 started sync module instance, tier type = 2024-09-19T12:02:20.322 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.324+0000 7f612e5dd9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:20.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.348+0000 7f612e5dd9c0 20 add_watcher() i=0 2024-09-19T12:02:20.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.348+0000 7f612e5dd9c0 20 add_watcher() i=1 2024-09-19T12:02:20.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.348+0000 7f612e5dd9c0 20 add_watcher() i=2 2024-09-19T12:02:20.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.348+0000 7f612e5dd9c0 20 add_watcher() i=3 2024-09-19T12:02:20.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.348+0000 7f612e5dd9c0 20 add_watcher() i=4 2024-09-19T12:02:20.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.348+0000 7f612e5dd9c0 20 add_watcher() i=5 2024-09-19T12:02:20.346 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.348+0000 7f612e5dd9c0 20 add_watcher() i=6 2024-09-19T12:02:20.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.352+0000 7f612e5dd9c0 20 add_watcher() i=7 2024-09-19T12:02:20.348 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.352+0000 7f612e5dd9c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:20.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.356+0000 7f5fe2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:20.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.356+0000 7f612e5dd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:20.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.356+0000 7f612e5dd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:20.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.356+0000 7f612e5dd9c0 5 note: GC not initialized 2024-09-19T12:02:20.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.356+0000 7f5fe1fdb640 20 reqs_thread_entry: start 2024-09-19T12:02:20.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.356+0000 7f612e5dd9c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:20.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.356+0000 7f612e5dd9c0 20 Filter name: none 2024-09-19T12:02:20.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.356+0000 7f5f537fe640 20 reqs_thread_entry: start 2024-09-19T12:02:20.354 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.356+0000 7f612e5dd9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.356+0000 7f612e5dd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T12:02:20.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.356+0000 7f612e5dd9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.360+0000 7f612e5dd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T12:02:20.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.360+0000 7f612e5dd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:20.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.360+0000 7f612e5dd9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.360+0000 7f612e5dd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T12:02:20.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.360+0000 7f612e5dd9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.360+0000 7f612e5dd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T12:02:20.357 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.360+0000 7f612e5dd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:20.360 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.364+0000 7f5fe2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:20.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.368+0000 7f612e5dd9c0 20 remove_watcher() i=0 2024-09-19T12:02:20.365 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.368+0000 7f612e5dd9c0 2 removed watcher, disabling cache 2024-09-19T12:02:20.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.368+0000 7f612e5dd9c0 20 remove_watcher() i=1 2024-09-19T12:02:20.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.372+0000 7f612e5dd9c0 20 remove_watcher() i=2 2024-09-19T12:02:20.371 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.376+0000 7f612e5dd9c0 20 remove_watcher() i=3 2024-09-19T12:02:20.374 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.376+0000 7f612e5dd9c0 20 remove_watcher() i=4 2024-09-19T12:02:20.375 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.376+0000 7f612e5dd9c0 20 remove_watcher() i=5 2024-09-19T12:02:20.377 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.380+0000 7f612e5dd9c0 20 remove_watcher() i=6 2024-09-19T12:02:20.378 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.380+0000 7f612e5dd9c0 20 remove_watcher() i=7 2024-09-19T12:02:20.395 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:02:20.395 INFO:tasks.workunit.client.0.smithi120.stderr:BUCKET_STATS: 2024-09-19T12:02:20.395 INFO:tasks.workunit.client.0.smithi120.stderr:bucket: myver id: cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-19T12:02:20.395 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:02:20.396 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-09-19T12:02:20.428 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:20.428 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:20.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.476+0000 7ff922daf9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.476+0000 7ff922daf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:20.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.476+0000 7ff922daf9c0 20 realm 2024-09-19T12:02:20.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.476+0000 7ff922daf9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.476+0000 7ff922daf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:20.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.476+0000 7ff922daf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:20.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.476+0000 7ff922daf9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.476+0000 7ff922daf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:20.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.476+0000 7ff922daf9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.475 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.480+0000 7ff922daf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:20.476 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.480+0000 7ff922daf9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.480+0000 7ff922daf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:20.477 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.480+0000 7ff922daf9c0 20 searching for the correct realm 2024-09-19T12:02:20.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.484+0000 7ff9210b6640 0 -- 172.21.15.120:0/2753226864 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7ff91404abe0 msgr2=0x7ff914047940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:20.487 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.488+0000 7ff9200b4640 0 -- 172.21.15.120:0/2753226864 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7ff9100f1b60 msgr2=0x7ff91010caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:20.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.704+0000 7ff922daf9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:20.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.704+0000 7ff922daf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:20.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.704+0000 7ff922daf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:20.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.704+0000 7ff922daf9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:20.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.704+0000 7ff922daf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:20.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.704+0000 7ff922daf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:20.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.704+0000 7ff922daf9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.704+0000 7ff922daf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:20.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.704+0000 7ff922daf9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.708+0000 7ff922daf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:20.704 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.708+0000 7ff922daf9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.708+0000 7ff922daf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:20.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.708+0000 7ff922daf9c0 20 zone default found 2024-09-19T12:02:20.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.708+0000 7ff922daf9c0 4 Realm: () 2024-09-19T12:02:20.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.708+0000 7ff922daf9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:20.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.708+0000 7ff922daf9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:20.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.708+0000 7ff922daf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:20.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.708+0000 7ff922daf9c0 20 zonegroup default 2024-09-19T12:02:20.705 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.708+0000 7ff922daf9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.708+0000 7ff922daf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:20.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.708+0000 7ff922daf9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.708+0000 7ff922daf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:20.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.708+0000 7ff922daf9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.712+0000 7ff922daf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:20.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.712+0000 7ff922daf9c0 20 started sync module instance, tier type = 2024-09-19T12:02:20.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.712+0000 7ff922daf9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:20.731 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.732+0000 7ff922daf9c0 20 add_watcher() i=0 2024-09-19T12:02:20.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.732+0000 7ff922daf9c0 20 add_watcher() i=1 2024-09-19T12:02:20.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.732+0000 7ff922daf9c0 20 add_watcher() i=2 2024-09-19T12:02:20.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.732+0000 7ff922daf9c0 20 add_watcher() i=3 2024-09-19T12:02:20.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.732+0000 7ff922daf9c0 20 add_watcher() i=4 2024-09-19T12:02:20.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.732+0000 7ff922daf9c0 20 add_watcher() i=5 2024-09-19T12:02:20.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.732+0000 7ff922daf9c0 20 add_watcher() i=6 2024-09-19T12:02:20.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.736+0000 7ff922daf9c0 20 add_watcher() i=7 2024-09-19T12:02:20.734 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.736+0000 7ff922daf9c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:20.738 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.740+0000 7ff7d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:20.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.740+0000 7ff922daf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:20.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.740+0000 7ff922daf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:20.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.740+0000 7ff922daf9c0 5 note: GC not initialized 2024-09-19T12:02:20.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff7d5fe3640 20 reqs_thread_entry: start 2024-09-19T12:02:20.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff922daf9c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:20.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff922daf9c0 20 Filter name: none 2024-09-19T12:02:20.740 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff7477fe640 20 reqs_thread_entry: start 2024-09-19T12:02:20.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff922daf9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-19T12:02:20.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff922daf9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.741 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff922daf9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T12:02:20.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff922daf9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-19T12:02:20.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff922daf9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-19T12:02:20.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff922daf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 : miss 2024-09-19T12:02:20.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff922daf9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:20.742 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff922daf9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T12:02:20.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff922daf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:20.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff922daf9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:20.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff922daf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:02:20.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff922daf9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:20.743 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.744+0000 7ff922daf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 2024-09-19T12:02:20.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.752+0000 7ff922daf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:20.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.752+0000 7ff922daf9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:20.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.752+0000 7ff922daf9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:20.751 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.752+0000 7ff922daf9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19, ofs0, ns] 2024-09-19T12:02:20.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.756+0000 7ff7f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366276 cookie 93953648901376 notifier 8093 bl.length()=905 2024-09-19T12:02:20.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.756+0000 7ff7f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:20.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.756+0000 7ff7f77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:20.752 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.756+0000 7ff7f77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:20.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.756+0000 7ff922daf9c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_sources= new_sources= 2024-09-19T12:02:20.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.756+0000 7ff922daf9c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential sources added=[] removed=[] 2024-09-19T12:02:20.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.756+0000 7ff922daf9c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_dests= new_dests= 2024-09-19T12:02:20.753 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.756+0000 7ff922daf9c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential dests added=[] removed=[] 2024-09-19T12:02:20.758 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:20.760+0000 7ff922daf9c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-19T12:02:21.435 INFO:tasks.workunit.client.0.smithi120.stderr:put object successful 2024-09-19T12:02:25.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.760+0000 7ff922daf9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.0 2024-09-19T12:02:25.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.760+0000 7ff922daf9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.0 2024-09-19T12:02:25.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.760+0000 7ff922daf9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.1 2024-09-19T12:02:25.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.760+0000 7ff922daf9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.1 2024-09-19T12:02:25.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.760+0000 7ff922daf9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.2 2024-09-19T12:02:25.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.760+0000 7ff922daf9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.2 2024-09-19T12:02:25.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.760+0000 7ff922daf9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.1.0 2024-09-19T12:02:25.759 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.760+0000 7ff922daf9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.1.0 2024-09-19T12:02:25.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.764+0000 7ff922daf9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.1.1 2024-09-19T12:02:25.761 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.764+0000 7ff922daf9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.1.1 2024-09-19T12:02:25.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.768+0000 7ff922daf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 : hit (requested=0x17, cached=0x17) 2024-09-19T12:02:25.765 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.768+0000 7ff922daf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 2024-09-19T12:02:25.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.772+0000 7ff922daf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:25.769 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.772+0000 7ff922daf9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:25.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.772+0000 7ff922daf9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:25.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.772+0000 7ff922daf9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19, ofs0, ns] 2024-09-19T12:02:25.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.772+0000 7ff7f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366277 cookie 93953648901376 notifier 8093 bl.length()=905 2024-09-19T12:02:25.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.772+0000 7ff7f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:25.770 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.772+0000 7ff7f77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:25.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.772+0000 7ff7f77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:25.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.772+0000 7ff922daf9c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_sources= new_sources= 2024-09-19T12:02:25.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.772+0000 7ff922daf9c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential sources added=[] removed=[] 2024-09-19T12:02:25.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.772+0000 7ff922daf9c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_dests= new_dests= 2024-09-19T12:02:25.771 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.772+0000 7ff922daf9c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential dests added=[] removed=[] 2024-09-19T12:02:25.774 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.776+0000 7ff922daf9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.1.0 2024-09-19T12:02:25.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.776+0000 7ff922daf9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.1.0 2024-09-19T12:02:25.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.780+0000 7ff922daf9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.1.1 2024-09-19T12:02:25.775 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.780+0000 7ff922daf9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.1.1 2024-09-19T12:02:25.780 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.784+0000 7ff922daf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 : hit (requested=0x17, cached=0x17) 2024-09-19T12:02:25.781 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.784+0000 7ff922daf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 2024-09-19T12:02:25.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.788+0000 7ff922daf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:25.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.788+0000 7ff922daf9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:25.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.788+0000 7ff922daf9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:25.784 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.788+0000 7ff922daf9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19, ofs0, ns] 2024-09-19T12:02:25.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.788+0000 7ff7f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366278 cookie 93953648901376 notifier 8093 bl.length()=873 2024-09-19T12:02:25.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.788+0000 7ff7f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:25.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.788+0000 7ff7f77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:25.785 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.788+0000 7ff7f77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:25.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.788+0000 7ff922daf9c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_sources= new_sources= 2024-09-19T12:02:25.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.788+0000 7ff922daf9c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential sources added=[] removed=[] 2024-09-19T12:02:25.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.788+0000 7ff922daf9c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_dests= new_dests= 2024-09-19T12:02:25.786 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.788+0000 7ff922daf9c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential dests added=[] removed=[] 2024-09-19T12:02:25.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.792+0000 7ff922daf9c0 1 execute INFO: reshard of bucket "myver" from 2 shards to 3 shards completed successfully 2024-09-19T12:02:25.796 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.800+0000 7ff7d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:25.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.804+0000 7ff922daf9c0 20 remove_watcher() i=0 2024-09-19T12:02:25.802 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.804+0000 7ff922daf9c0 2 removed watcher, disabling cache 2024-09-19T12:02:25.805 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.808+0000 7ff922daf9c0 20 remove_watcher() i=1 2024-09-19T12:02:25.808 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.812+0000 7ff922daf9c0 20 remove_watcher() i=2 2024-09-19T12:02:25.811 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.812+0000 7ff922daf9c0 20 remove_watcher() i=3 2024-09-19T12:02:25.813 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.816+0000 7ff922daf9c0 20 remove_watcher() i=4 2024-09-19T12:02:25.816 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.820+0000 7ff922daf9c0 20 remove_watcher() i=5 2024-09-19T12:02:25.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.820+0000 7ff922daf9c0 20 remove_watcher() i=6 2024-09-19T12:02:25.821 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:25.824+0000 7ff922daf9c0 20 remove_watcher() i=7 2024-09-19T12:02:26.440 INFO:tasks.workunit.client.0.smithi120.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-19T12:02:26.440 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T12:02:26.638 INFO:tasks.workunit.client.0.smithi120.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-19T12:02:27.081 INFO:tasks.workunit.client.0.smithi120.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-19T12:02:28.601 INFO:tasks.workunit.client.0.smithi120.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T12:02:28.601 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-19T12:02:28.638 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:28.638 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:28.684 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:28.684+0000 7fad6d2fa9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:28.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:28.688+0000 7fad6d2fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:28.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:28.688+0000 7fad6d2fa9c0 20 realm 2024-09-19T12:02:28.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:28.688+0000 7fad6d2fa9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:28.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:28.688+0000 7fad6d2fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:28.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:28.688+0000 7fad6d2fa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:28.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:28.688+0000 7fad6d2fa9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:28.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:28.688+0000 7fad6d2fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:28.686 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:28.688+0000 7fad6d2fa9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:28.687 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:28.692+0000 7fad6d2fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:28.688 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:28.692+0000 7fad6d2fa9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:28.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:28.692+0000 7fad6d2fa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:28.689 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:28.692+0000 7fad6d2fa9c0 20 searching for the correct realm 2024-09-19T12:02:28.692 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:28.696+0000 7fad6b601640 0 -- 172.21.15.120:0/2489014408 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7fad6004d040 msgr2=0x7fad60041410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:28.909 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:28.912+0000 7fad6a5ff640 0 -- 172.21.15.120:0/2489014408 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7fad5c088080 msgr2=0x7fad5c090c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:02:29.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.128+0000 7fad6d2fa9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:29.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.128+0000 7fad6d2fa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:29.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.128+0000 7fad6d2fa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:29.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.128+0000 7fad6d2fa9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:29.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.128+0000 7fad6d2fa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:29.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.128+0000 7fad6d2fa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:29.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.128+0000 7fad6d2fa9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:29.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:29.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:29.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 20 zone default found 2024-09-19T12:02:29.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 4 Realm: () 2024-09-19T12:02:29.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:29.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:29.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:29.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 20 zonegroup default 2024-09-19T12:02:29.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:29.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:29.131 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.132+0000 7fad6d2fa9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.136+0000 7fad6d2fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:29.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.136+0000 7fad6d2fa9c0 20 started sync module instance, tier type = 2024-09-19T12:02:29.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.136+0000 7fad6d2fa9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:29.153 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.156+0000 7fad6d2fa9c0 20 add_watcher() i=0 2024-09-19T12:02:29.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.156+0000 7fad6d2fa9c0 20 add_watcher() i=1 2024-09-19T12:02:29.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.156+0000 7fad6d2fa9c0 20 add_watcher() i=2 2024-09-19T12:02:29.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.156+0000 7fad6d2fa9c0 20 add_watcher() i=3 2024-09-19T12:02:29.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.156+0000 7fad6d2fa9c0 20 add_watcher() i=4 2024-09-19T12:02:29.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.156+0000 7fad6d2fa9c0 20 add_watcher() i=5 2024-09-19T12:02:29.154 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.156+0000 7fad6d2fa9c0 20 add_watcher() i=6 2024-09-19T12:02:29.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.156+0000 7fad6d2fa9c0 20 add_watcher() i=7 2024-09-19T12:02:29.155 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.156+0000 7fad6d2fa9c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:29.159 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.160+0000 7fac217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:29.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.164+0000 7fad6d2fa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:29.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.164+0000 7fad6d2fa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:29.160 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.164+0000 7fad6d2fa9c0 5 note: GC not initialized 2024-09-19T12:02:29.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.164+0000 7fab9bfff640 20 reqs_thread_entry: start 2024-09-19T12:02:29.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.164+0000 7fad6d2fa9c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:29.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.164+0000 7fad6d2fa9c0 20 Filter name: none 2024-09-19T12:02:29.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.164+0000 7fab99ffb640 20 reqs_thread_entry: start 2024-09-19T12:02:29.161 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.164+0000 7fad6d2fa9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.164+0000 7fad6d2fa9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T12:02:29.162 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.164+0000 7fad6d2fa9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.163 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.164+0000 7fad6d2fa9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T12:02:29.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.168+0000 7fad6d2fa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:29.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.168+0000 7fad6d2fa9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-19T12:02:29.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.168+0000 7fad6d2fa9c0 20 INFO: main: starting shard=0 2024-09-19T12:02:29.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.168+0000 7fad6d2fa9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.0 2024-09-19T12:02:29.164 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.168+0000 7fad6d2fa9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.0 2024-09-19T12:02:29.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.168+0000 7fad6d2fa9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T12:02:29.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.168+0000 7fad6d2fa9c0 20 INFO: main: starting shard=1 2024-09-19T12:02:29.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.168+0000 7fad6d2fa9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.1 2024-09-19T12:02:29.165 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.168+0000 7fad6d2fa9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.1 2024-09-19T12:02:29.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.168+0000 7fad6d2fa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T12:02:29.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.168+0000 7fad6d2fa9c0 20 INFO: main: starting shard=2 2024-09-19T12:02:29.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.168+0000 7fad6d2fa9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.2 2024-09-19T12:02:29.166 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.168+0000 7fad6d2fa9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.2 2024-09-19T12:02:29.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.172+0000 7fad6d2fa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T12:02:29.168 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.172+0000 7fad6d2fa9c0 20 INFO: main: done 2024-09-19T12:02:29.169 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.172+0000 7fac217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:29.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.176+0000 7fad6d2fa9c0 20 remove_watcher() i=0 2024-09-19T12:02:29.174 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.176+0000 7fad6d2fa9c0 2 removed watcher, disabling cache 2024-09-19T12:02:29.176 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.180+0000 7fad6d2fa9c0 20 remove_watcher() i=1 2024-09-19T12:02:29.178 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.180+0000 7fad6d2fa9c0 20 remove_watcher() i=2 2024-09-19T12:02:29.181 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.184+0000 7fad6d2fa9c0 20 remove_watcher() i=3 2024-09-19T12:02:29.183 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.184+0000 7fad6d2fa9c0 20 remove_watcher() i=4 2024-09-19T12:02:29.185 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.188+0000 7fad6d2fa9c0 20 remove_watcher() i=5 2024-09-19T12:02:29.186 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.188+0000 7fad6d2fa9c0 20 remove_watcher() i=6 2024-09-19T12:02:29.188 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.192+0000 7fad6d2fa9c0 20 remove_watcher() i=7 2024-09-19T12:02:29.269 INFO:tasks.workunit.client.0.smithi120.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T12:02:29.269 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-19T12:02:29.304 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:29.304 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:29.349 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.352+0000 7f4883cb49c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.352+0000 7f4883cb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:29.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.352+0000 7f4883cb49c0 20 realm 2024-09-19T12:02:29.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.352+0000 7f4883cb49c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.351 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.352+0000 7f4883cb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:29.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.352+0000 7f4883cb49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:29.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.352+0000 7f4883cb49c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.352+0000 7f4883cb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:29.352 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.352+0000 7f4883cb49c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.356+0000 7f4883cb49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:29.353 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.356+0000 7f4883cb49c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.356+0000 7f4883cb49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:29.355 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.356+0000 7f4883cb49c0 20 searching for the correct realm 2024-09-19T12:02:29.358 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.360+0000 7f4881fbb640 0 -- 172.21.15.120:0/1090013423 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f487803c020 msgr2=0x7f4878067e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:29.573 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.576+0000 7f4880fb9640 0 -- 172.21.15.120:0/1090013423 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f4874109c00 msgr2=0x7f48741023a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T12:02:29.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.792+0000 7f4883cb49c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:29.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.792+0000 7f4883cb49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:29.791 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.792+0000 7f4883cb49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:29.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.792+0000 7f4883cb49c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:29.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.792+0000 7f4883cb49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:29.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.792+0000 7f4883cb49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:29.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.792+0000 7f4883cb49c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.792+0000 7f4883cb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:29.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.792+0000 7f4883cb49c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.792 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.796+0000 7f4883cb49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:29.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.796+0000 7f4883cb49c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.796+0000 7f4883cb49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:29.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.796+0000 7f4883cb49c0 20 zone default found 2024-09-19T12:02:29.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.796+0000 7f4883cb49c0 4 Realm: () 2024-09-19T12:02:29.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.796+0000 7f4883cb49c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:29.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.796+0000 7f4883cb49c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:29.793 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.796+0000 7f4883cb49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:29.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.796+0000 7f4883cb49c0 20 zonegroup default 2024-09-19T12:02:29.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.796+0000 7f4883cb49c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.796+0000 7f4883cb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:29.794 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.796+0000 7f4883cb49c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.796+0000 7f4883cb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:29.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.796+0000 7f4883cb49c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.796+0000 7f4883cb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:29.795 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.800+0000 7f4883cb49c0 20 started sync module instance, tier type = 2024-09-19T12:02:29.796 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.800+0000 7f4883cb49c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:29.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.820+0000 7f4883cb49c0 20 add_watcher() i=0 2024-09-19T12:02:29.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.820+0000 7f4883cb49c0 20 add_watcher() i=1 2024-09-19T12:02:29.818 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.820+0000 7f4883cb49c0 20 add_watcher() i=2 2024-09-19T12:02:29.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.820+0000 7f4883cb49c0 20 add_watcher() i=3 2024-09-19T12:02:29.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.820+0000 7f4883cb49c0 20 add_watcher() i=4 2024-09-19T12:02:29.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.820+0000 7f4883cb49c0 20 add_watcher() i=5 2024-09-19T12:02:29.819 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.820+0000 7f4883cb49c0 20 add_watcher() i=6 2024-09-19T12:02:29.820 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.824+0000 7f4883cb49c0 20 add_watcher() i=7 2024-09-19T12:02:29.820 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.824+0000 7f4883cb49c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:29.824 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.828+0000 7f4737fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:29.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.828+0000 7f4883cb49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:29.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.828+0000 7f4883cb49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:29.825 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.828+0000 7f4883cb49c0 5 note: GC not initialized 2024-09-19T12:02:29.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.828+0000 7f4736fe5640 20 reqs_thread_entry: start 2024-09-19T12:02:29.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.828+0000 7f4883cb49c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:29.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.828+0000 7f4883cb49c0 20 Filter name: none 2024-09-19T12:02:29.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.828+0000 7f4734fe1640 20 reqs_thread_entry: start 2024-09-19T12:02:29.826 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.828+0000 7f4883cb49c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.828+0000 7f4883cb49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T12:02:29.827 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.828+0000 7f4883cb49c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:29.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.832+0000 7f4883cb49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T12:02:29.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.832+0000 7f4883cb49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:29.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.832+0000 7f4883cb49c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-19T12:02:29.828 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.832+0000 7f4883cb49c0 20 INFO: main: starting shard=0 2024-09-19T12:02:29.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.832+0000 7f4883cb49c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.0 2024-09-19T12:02:29.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.832+0000 7f4883cb49c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.0 2024-09-19T12:02:29.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.832+0000 7f4883cb49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T12:02:29.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.832+0000 7f4883cb49c0 20 INFO: main: starting shard=1 2024-09-19T12:02:29.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.832+0000 7f4883cb49c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.1 2024-09-19T12:02:29.829 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.832+0000 7f4883cb49c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.1 2024-09-19T12:02:29.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.832+0000 7f4883cb49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T12:02:29.830 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.832+0000 7f4883cb49c0 20 INFO: main: starting shard=2 2024-09-19T12:02:29.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.832+0000 7f4883cb49c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.2 2024-09-19T12:02:29.831 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.832+0000 7f4883cb49c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.2 2024-09-19T12:02:29.832 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.836+0000 7f4883cb49c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T12:02:29.832 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.836+0000 7f4883cb49c0 20 INFO: main: done 2024-09-19T12:02:29.833 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.836+0000 7f4737fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:29.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.840+0000 7f4883cb49c0 20 remove_watcher() i=0 2024-09-19T12:02:29.838 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.840+0000 7f4883cb49c0 2 removed watcher, disabling cache 2024-09-19T12:02:29.840 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.844+0000 7f4883cb49c0 20 remove_watcher() i=1 2024-09-19T12:02:29.842 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.844+0000 7f4883cb49c0 20 remove_watcher() i=2 2024-09-19T12:02:29.844 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.848+0000 7f4883cb49c0 20 remove_watcher() i=3 2024-09-19T12:02:29.847 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.848+0000 7f4883cb49c0 20 remove_watcher() i=4 2024-09-19T12:02:29.848 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.852+0000 7f4883cb49c0 20 remove_watcher() i=5 2024-09-19T12:02:29.850 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.852+0000 7f4883cb49c0 20 remove_watcher() i=6 2024-09-19T12:02:29.852 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:29.856+0000 7f4883cb49c0 20 remove_watcher() i=7 2024-09-19T12:02:29.944 INFO:tasks.workunit.client.0.smithi120.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T12:02:29.945 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-19T12:02:29.980 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:29.980 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:30.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.028+0000 7f8493d5a9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:30.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.032+0000 7f8493d5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:30.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.032+0000 7f8493d5a9c0 20 realm 2024-09-19T12:02:30.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.032+0000 7f8493d5a9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:30.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.032+0000 7f8493d5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:30.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.032+0000 7f8493d5a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:30.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.032+0000 7f8493d5a9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:30.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.032+0000 7f8493d5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:30.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.032+0000 7f8493d5a9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:30.030 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.032+0000 7f8493d5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:30.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.032+0000 7f8493d5a9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:30.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.036+0000 7f8493d5a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:30.033 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.036+0000 7f8493d5a9c0 20 searching for the correct realm 2024-09-19T12:02:30.241 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.244+0000 7f8491860640 0 -- 172.21.15.120:0/2476575913 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f848c03c070 msgr2=0x7f848c03c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:30.659 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.660+0000 7f8491860640 0 -- 172.21.15.120:0/2476575913 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f848c03c070 msgr2=0x7f848c03c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:30.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.672+0000 7f8493d5a9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:30.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.672+0000 7f8493d5a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:30.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.672+0000 7f8493d5a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:30.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.672+0000 7f8493d5a9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:30.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.672+0000 7f8493d5a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:30.671 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.672+0000 7f8493d5a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:30.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.672+0000 7f8493d5a9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:30.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.672+0000 7f8493d5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:30.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.672+0000 7f8493d5a9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:30.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:30.672 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:30.673 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:30.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 20 zone default found 2024-09-19T12:02:30.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 4 Realm: () 2024-09-19T12:02:30.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:30.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:30.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:30.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 20 zonegroup default 2024-09-19T12:02:30.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:30.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:30.674 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:30.675 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:30.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:30.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:30.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 20 started sync module instance, tier type = 2024-09-19T12:02:30.676 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.676+0000 7f8493d5a9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:30.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.700+0000 7f8493d5a9c0 20 add_watcher() i=0 2024-09-19T12:02:30.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.700+0000 7f8493d5a9c0 20 add_watcher() i=1 2024-09-19T12:02:30.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.700+0000 7f8493d5a9c0 20 add_watcher() i=2 2024-09-19T12:02:30.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.700+0000 7f8493d5a9c0 20 add_watcher() i=3 2024-09-19T12:02:30.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.700+0000 7f8493d5a9c0 20 add_watcher() i=4 2024-09-19T12:02:30.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.700+0000 7f8493d5a9c0 20 add_watcher() i=5 2024-09-19T12:02:30.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.700+0000 7f8493d5a9c0 20 add_watcher() i=6 2024-09-19T12:02:30.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.704+0000 7f8493d5a9c0 20 add_watcher() i=7 2024-09-19T12:02:30.702 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.704+0000 7f8493d5a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:30.706 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.708+0000 7f83437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:30.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.708+0000 7f8493d5a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:30.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.708+0000 7f8493d5a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:30.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.708+0000 7f8493d5a9c0 5 note: GC not initialized 2024-09-19T12:02:30.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f83427fc640 20 reqs_thread_entry: start 2024-09-19T12:02:30.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f8493d5a9c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:30.708 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f8493d5a9c0 20 Filter name: none 2024-09-19T12:02:30.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f82b3fff640 20 reqs_thread_entry: start 2024-09-19T12:02:30.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f8493d5a9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:30.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f8493d5a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T12:02:30.709 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f8493d5a9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:30.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f8493d5a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T12:02:30.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f8493d5a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:30.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f8493d5a9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-19T12:02:30.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f8493d5a9c0 20 INFO: main: starting shard=0 2024-09-19T12:02:30.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f8493d5a9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.0 2024-09-19T12:02:30.711 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f8493d5a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.0 2024-09-19T12:02:30.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f8493d5a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T12:02:30.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f8493d5a9c0 20 INFO: main: starting shard=1 2024-09-19T12:02:30.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f8493d5a9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.1 2024-09-19T12:02:30.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.712+0000 7f8493d5a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.1 2024-09-19T12:02:30.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.716+0000 7f8493d5a9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T12:02:30.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.716+0000 7f8493d5a9c0 20 INFO: main: starting shard=2 2024-09-19T12:02:30.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.716+0000 7f8493d5a9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.2 2024-09-19T12:02:30.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.716+0000 7f8493d5a9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.2 2024-09-19T12:02:30.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.716+0000 7f8493d5a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T12:02:30.715 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.716+0000 7f8493d5a9c0 20 INFO: main: done 2024-09-19T12:02:30.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.720+0000 7f83437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:30.721 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.724+0000 7f8493d5a9c0 20 remove_watcher() i=0 2024-09-19T12:02:30.722 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.724+0000 7f8493d5a9c0 2 removed watcher, disabling cache 2024-09-19T12:02:30.724 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.728+0000 7f8493d5a9c0 20 remove_watcher() i=1 2024-09-19T12:02:30.726 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.728+0000 7f8493d5a9c0 20 remove_watcher() i=2 2024-09-19T12:02:30.728 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.732+0000 7f8493d5a9c0 20 remove_watcher() i=3 2024-09-19T12:02:30.730 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.732+0000 7f8493d5a9c0 20 remove_watcher() i=4 2024-09-19T12:02:30.732 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.736+0000 7f8493d5a9c0 20 remove_watcher() i=5 2024-09-19T12:02:30.733 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.736+0000 7f8493d5a9c0 20 remove_watcher() i=6 2024-09-19T12:02:30.736 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:30.740+0000 7f8493d5a9c0 20 remove_watcher() i=7 2024-09-19T12:02:30.759 INFO:tasks.workunit.client.0.smithi120.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-19T12:02:31.198 INFO:tasks.workunit.client.0.smithi120.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-19T12:02:31.621 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-19T12:02:31.654 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:31.655 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:31.697 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.700+0000 7faa80d909c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:31.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.700+0000 7faa80d909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:31.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.700+0000 7faa80d909c0 20 realm 2024-09-19T12:02:31.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.700+0000 7faa80d909c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:31.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.700+0000 7faa80d909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:31.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.700+0000 7faa80d909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:31.699 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.700+0000 7faa80d909c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:31.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.704+0000 7faa80d909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:31.700 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.704+0000 7faa80d909c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:31.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.704+0000 7faa80d909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:31.701 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.704+0000 7faa80d909c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:31.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.704+0000 7faa7f097640 0 -- 172.21.15.120:0/3664353840 >> [v2:172.21.15.151:6808/4185618971,v1:172.21.15.151:6809/4185618971] conn(0x56484c0027c0 msgr2=0x56484c004bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:31.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.704+0000 7faa80d909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:31.703 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.704+0000 7faa80d909c0 20 searching for the correct realm 2024-09-19T12:02:31.707 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.708+0000 7faa7e896640 0 -- 172.21.15.120:0/3664353840 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7faa6c003be0 msgr2=0x7faa780691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:31.935 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.936+0000 7faa80d909c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:31.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.936+0000 7faa80d909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:31.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.936+0000 7faa80d909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:31.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.936+0000 7faa80d909c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:31.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.936+0000 7faa80d909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:31.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.936+0000 7faa80d909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:31.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.936+0000 7faa80d909c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:31.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:31.936 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:31.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:31.937 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:31.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:31.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 20 zone default found 2024-09-19T12:02:31.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 4 Realm: () 2024-09-19T12:02:31.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:31.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:31.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:31.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 20 zonegroup default 2024-09-19T12:02:31.938 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:31.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:31.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:31.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:31.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.940+0000 7faa80d909c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:31.939 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.944+0000 7faa80d909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:31.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.944+0000 7faa80d909c0 20 started sync module instance, tier type = 2024-09-19T12:02:31.940 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.944+0000 7faa80d909c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:31.961 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.964+0000 7faa80d909c0 20 add_watcher() i=0 2024-09-19T12:02:31.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.964+0000 7faa80d909c0 20 add_watcher() i=1 2024-09-19T12:02:31.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.964+0000 7faa80d909c0 20 add_watcher() i=2 2024-09-19T12:02:31.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.964+0000 7faa80d909c0 20 add_watcher() i=3 2024-09-19T12:02:31.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.964+0000 7faa80d909c0 20 add_watcher() i=4 2024-09-19T12:02:31.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.964+0000 7faa80d909c0 20 add_watcher() i=5 2024-09-19T12:02:31.962 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.964+0000 7faa80d909c0 20 add_watcher() i=6 2024-09-19T12:02:31.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.964+0000 7faa80d909c0 20 add_watcher() i=7 2024-09-19T12:02:31.963 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.964+0000 7faa80d909c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:31.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.968+0000 7fa9317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:31.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.968+0000 7faa80d909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:31.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.968+0000 7faa80d909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:31.967 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.968+0000 7faa80d909c0 5 note: GC not initialized 2024-09-19T12:02:31.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7fa8abfff640 20 reqs_thread_entry: start 2024-09-19T12:02:31.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7faa80d909c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:31.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7faa80d909c0 20 Filter name: none 2024-09-19T12:02:31.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7fa8a9ffb640 20 reqs_thread_entry: start 2024-09-19T12:02:31.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7faa80d909c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-19T12:02:31.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7faa80d909c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:31.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7faa80d909c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T12:02:31.969 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7faa80d909c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-19T12:02:31.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7faa80d909c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-19T12:02:31.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7faa80d909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 : miss 2024-09-19T12:02:31.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7faa80d909c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:31.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7faa80d909c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T12:02:31.970 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7faa80d909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:31.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7faa80d909c0 10 adding default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:31.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7faa80d909c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:02:31.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7faa80d909c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:31.971 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.972+0000 7faa80d909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 2024-09-19T12:02:31.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.984+0000 7faa80d909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:31.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.984+0000 7faa80d909c0 10 moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:31.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.984+0000 7faa80d909c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:31.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.984+0000 7faa80d909c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19, ofs0, ns] 2024-09-19T12:02:31.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.984+0000 7fa959ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366279 cookie 94868512755168 notifier 8183 bl.length()=905 2024-09-19T12:02:31.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.984+0000 7fa959ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:31.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.984+0000 7fa959ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:31.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.984+0000 7fa959ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:31.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.988+0000 7faa80d909c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_sources= new_sources= 2024-09-19T12:02:31.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.988+0000 7faa80d909c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential sources added=[] removed=[] 2024-09-19T12:02:31.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.988+0000 7faa80d909c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_dests= new_dests= 2024-09-19T12:02:31.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.988+0000 7faa80d909c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential dests added=[] removed=[] 2024-09-19T12:02:31.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.0 2024-09-19T12:02:31.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.0 2024-09-19T12:02:31.990 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.1 2024-09-19T12:02:31.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.1 2024-09-19T12:02:31.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.2 2024-09-19T12:02:31.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.2 2024-09-19T12:02:31.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.3 2024-09-19T12:02:31.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.3 2024-09-19T12:02:31.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.4 2024-09-19T12:02:31.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.4 2024-09-19T12:02:31.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.5 2024-09-19T12:02:31.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.5 2024-09-19T12:02:31.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.6 2024-09-19T12:02:31.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.6 2024-09-19T12:02:31.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.7 2024-09-19T12:02:31.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.7 2024-09-19T12:02:31.991 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.8 2024-09-19T12:02:31.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.8 2024-09-19T12:02:31.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:31.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:31.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.10 2024-09-19T12:02:31.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.10 2024-09-19T12:02:31.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.11 2024-09-19T12:02:31.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.11 2024-09-19T12:02:31.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.12 2024-09-19T12:02:31.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.12 2024-09-19T12:02:31.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.13 2024-09-19T12:02:31.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.13 2024-09-19T12:02:31.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.14 2024-09-19T12:02:31.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.14 2024-09-19T12:02:31.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.15 2024-09-19T12:02:31.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.15 2024-09-19T12:02:31.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.16 2024-09-19T12:02:31.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.16 2024-09-19T12:02:31.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.0 2024-09-19T12:02:31.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.0 2024-09-19T12:02:31.993 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.1 2024-09-19T12:02:31.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.992+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.1 2024-09-19T12:02:31.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.996+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.2 2024-09-19T12:02:31.994 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:31.996+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.2 2024-09-19T12:02:31.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.000+0000 7faa80d909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 : hit (requested=0x17, cached=0x17) 2024-09-19T12:02:31.998 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.000+0000 7faa80d909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 2024-09-19T12:02:32.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.004+0000 7faa80d909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:32.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.004+0000 7faa80d909c0 10 moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:32.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.004+0000 7faa80d909c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:32.001 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.004+0000 7faa80d909c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19, ofs0, ns] 2024-09-19T12:02:32.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.004+0000 7fa959ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366280 cookie 94868512755168 notifier 8183 bl.length()=905 2024-09-19T12:02:32.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.004+0000 7fa959ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:32.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.004+0000 7fa959ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:32.002 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.004+0000 7fa959ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:32.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.004+0000 7faa80d909c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_sources= new_sources= 2024-09-19T12:02:32.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.004+0000 7faa80d909c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential sources added=[] removed=[] 2024-09-19T12:02:32.003 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.004+0000 7faa80d909c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_dests= new_dests= 2024-09-19T12:02:32.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.004+0000 7faa80d909c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential dests added=[] removed=[] 2024-09-19T12:02:32.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.008+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.0 2024-09-19T12:02:32.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.008+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.0 2024-09-19T12:02:32.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.008+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.1 2024-09-19T12:02:32.006 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.008+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.1 2024-09-19T12:02:32.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.008+0000 7faa80d909c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.2 2024-09-19T12:02:32.007 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.008+0000 7faa80d909c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.2.2 2024-09-19T12:02:32.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.012+0000 7faa80d909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 : hit (requested=0x17, cached=0x17) 2024-09-19T12:02:32.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.012+0000 7faa80d909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 2024-09-19T12:02:32.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.012+0000 7faa80d909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:32.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.012+0000 7faa80d909c0 10 moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:32.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.012+0000 7faa80d909c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:32.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.012+0000 7faa80d909c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19, ofs0, ns] 2024-09-19T12:02:32.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.016+0000 7fa95a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366281 cookie 94868512755168 notifier 8183 bl.length()=873 2024-09-19T12:02:32.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.016+0000 7fa95a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:32.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.016+0000 7fa95a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:32.012 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.016+0000 7fa95a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:32.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.016+0000 7faa80d909c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_sources= new_sources= 2024-09-19T12:02:32.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.016+0000 7faa80d909c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential sources added=[] removed=[] 2024-09-19T12:02:32.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.016+0000 7faa80d909c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): orig_dests= new_dests= 2024-09-19T12:02:32.013 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.016+0000 7faa80d909c0 20 handle_bi_update(): bucket=:myver[cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19]): potential dests added=[] removed=[] 2024-09-19T12:02:32.016 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.020+0000 7faa80d909c0 1 execute INFO: reshard of bucket "myver" from 3 shards to 17 shards completed successfully 2024-09-19T12:02:32.019 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.020+0000 7fa9317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:32.023 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.024+0000 7faa80d909c0 20 remove_watcher() i=0 2024-09-19T12:02:32.023 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.024+0000 7faa80d909c0 2 removed watcher, disabling cache 2024-09-19T12:02:32.025 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.028+0000 7faa80d909c0 20 remove_watcher() i=1 2024-09-19T12:02:32.027 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.028+0000 7faa80d909c0 20 remove_watcher() i=2 2024-09-19T12:02:32.029 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.032+0000 7faa80d909c0 20 remove_watcher() i=3 2024-09-19T12:02:32.031 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.032+0000 7faa80d909c0 20 remove_watcher() i=4 2024-09-19T12:02:32.032 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.036+0000 7faa80d909c0 20 remove_watcher() i=5 2024-09-19T12:02:32.034 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.036+0000 7faa80d909c0 20 remove_watcher() i=6 2024-09-19T12:02:32.035 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.036+0000 7faa80d909c0 20 remove_watcher() i=7 2024-09-19T12:02:32.049 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-19T12:02:32.083 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:32.083 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:32.127 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.128+0000 7f3c9faed9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.132+0000 7f3c9faed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:32.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.132+0000 7f3c9faed9c0 20 realm 2024-09-19T12:02:32.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.132+0000 7f3c9faed9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.128 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.132+0000 7f3c9faed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:32.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.132+0000 7f3c9faed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:32.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.132+0000 7f3c9faed9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.132+0000 7f3c9faed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:32.129 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.132+0000 7f3c9faed9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.132+0000 7f3c9faed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:32.130 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.132+0000 7f3c9faed9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.136+0000 7f3c9faed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:32.132 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.136+0000 7f3c9faed9c0 20 searching for the correct realm 2024-09-19T12:02:32.135 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.136+0000 7f3c9d5f3640 0 -- 172.21.15.120:0/725605891 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f3c98023450 msgr2=0x7f3c98023870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:32.356 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.356+0000 7f3c9d5f3640 0 -- 172.21.15.120:0/725605891 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7f3c98023450 msgr2=0x7f3c98023870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:32.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.368+0000 7f3c9faed9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:32.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.368+0000 7f3c9faed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:32.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.368+0000 7f3c9faed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:32.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.368+0000 7f3c9faed9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:32.366 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.368+0000 7f3c9faed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:32.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.368+0000 7f3c9faed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:32.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.368+0000 7f3c9faed9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.368+0000 7f3c9faed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:32.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.368+0000 7f3c9faed9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:32.367 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.368 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:32.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 20 zone default found 2024-09-19T12:02:32.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 4 Realm: () 2024-09-19T12:02:32.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:32.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:32.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:32.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 20 zonegroup default 2024-09-19T12:02:32.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:32.369 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:32.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:32.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 20 started sync module instance, tier type = 2024-09-19T12:02:32.370 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.372+0000 7f3c9faed9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:32.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.404+0000 7f3c9faed9c0 20 add_watcher() i=0 2024-09-19T12:02:32.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.404+0000 7f3c9faed9c0 20 add_watcher() i=1 2024-09-19T12:02:32.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.404+0000 7f3c9faed9c0 20 add_watcher() i=2 2024-09-19T12:02:32.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.404+0000 7f3c9faed9c0 20 add_watcher() i=3 2024-09-19T12:02:32.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.404+0000 7f3c9faed9c0 20 add_watcher() i=4 2024-09-19T12:02:32.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.404+0000 7f3c9faed9c0 20 add_watcher() i=5 2024-09-19T12:02:32.400 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.404+0000 7f3c9faed9c0 20 add_watcher() i=6 2024-09-19T12:02:32.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.404+0000 7f3c9faed9c0 20 add_watcher() i=7 2024-09-19T12:02:32.402 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.404+0000 7f3c9faed9c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:32.406 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.408+0000 7f3b537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:32.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.408+0000 7f3c9faed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:32.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.408+0000 7f3c9faed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:32.407 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.408+0000 7f3c9faed9c0 5 note: GC not initialized 2024-09-19T12:02:32.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3b527e4640 20 reqs_thread_entry: start 2024-09-19T12:02:32.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:32.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 20 Filter name: none 2024-09-19T12:02:32.408 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3ac3fff640 20 reqs_thread_entry: start 2024-09-19T12:02:32.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-19T12:02:32.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T12:02:32.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-19T12:02:32.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-19T12:02:32.409 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 : miss 2024-09-19T12:02:32.410 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T12:02:32.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 info.flags=0x17 2024-09-19T12:02:32.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 to cache LRU end 2024-09-19T12:02:32.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T12:02:32.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T12:02:32.411 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19 2024-09-19T12:02:32.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.0 2024-09-19T12:02:32.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.412+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.0 2024-09-19T12:02:32.412 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.416+0000 7f3c9faed9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-19T12:02:32.413 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.416+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.1 2024-09-19T12:02:32.413 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.416+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.1 2024-09-19T12:02:32.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.416+0000 7f3c9faed9c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-19T12:02:32.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.416+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.2 2024-09-19T12:02:32.414 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.416+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.2 2024-09-19T12:02:32.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.416+0000 7f3c9faed9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-19T12:02:32.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.416+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.3 2024-09-19T12:02:32.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.416+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.3 2024-09-19T12:02:32.415 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.420+0000 7f3c9faed9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-19T12:02:32.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.420+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.4 2024-09-19T12:02:32.416 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.420+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.4 2024-09-19T12:02:32.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.420+0000 7f3c9faed9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-19T12:02:32.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.420+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.5 2024-09-19T12:02:32.417 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.420+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.5 2024-09-19T12:02:32.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.420+0000 7f3c9faed9c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-19T12:02:32.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.420+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.6 2024-09-19T12:02:32.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.420+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.6 2024-09-19T12:02:32.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.420+0000 7f3c9faed9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-19T12:02:32.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.420+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.7 2024-09-19T12:02:32.419 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.420+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.7 2024-09-19T12:02:32.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.424+0000 7f3c9faed9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-19T12:02:32.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.424+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.8 2024-09-19T12:02:32.420 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.424+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.8 2024-09-19T12:02:32.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.424+0000 7f3c9faed9c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-19T12:02:32.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.424+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.422 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.424+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.424+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.10 2024-09-19T12:02:32.423 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.424+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.10 2024-09-19T12:02:32.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.428+0000 7f3c9faed9c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-19T12:02:32.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.428+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.11 2024-09-19T12:02:32.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.428+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.11 2024-09-19T12:02:32.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.428+0000 7f3c9faed9c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-19T12:02:32.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.428+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.12 2024-09-19T12:02:32.424 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.428+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.12 2024-09-19T12:02:32.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.428+0000 7f3c9faed9c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-19T12:02:32.425 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.428+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.13 2024-09-19T12:02:32.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.428+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.13 2024-09-19T12:02:32.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.428+0000 7f3c9faed9c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-19T12:02:32.426 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.428+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.14 2024-09-19T12:02:32.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.428+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.14 2024-09-19T12:02:32.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.428+0000 7f3c9faed9c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-19T12:02:32.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.428+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.15 2024-09-19T12:02:32.427 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.428+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.15 2024-09-19T12:02:32.428 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.432+0000 7f3c9faed9c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-19T12:02:32.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.432+0000 7f3c9faed9c0 10 bucket_obj is .dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.16 2024-09-19T12:02:32.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.432+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.16 2024-09-19T12:02:32.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.432+0000 7f3c9faed9c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-19T12:02:32.429 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.432+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.430 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.432+0000 7f3c9faed9c0 20 get_obj_state: octx=0x563d7f12aea0 obj=myver:x state=0x563d7f3e04e8 s->prefetch_data=0 2024-09-19T12:02:32.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.436+0000 7f3c9faed9c0 20 get_obj_state: setting s->obj_tag to b37oc6kpct3kzuxw1qixuc84tmqsie0z 2024-09-19T12:02:32.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.436+0000 7f3c9faed9c0 20 get_obj_state_impl: setting s->olh_tag to xaht24cn9qjtccn8xioh6p25iv8wnqyn 2024-09-19T12:02:32.432 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.436+0000 7f3c9faed9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xaht24cn9qjtccn8xioh6p25iv8wnqyn 2024-09-19T12:02:32.435 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.436+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.439 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.440+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.444+0000 7f3c9faed9c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-19T12:02:32.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.444+0000 7f3c9faed9c0 20 olh_log_entry: epoch=2 op=3 key=x[Z-L9NkspqsLZWJJ4LYoZco0OaBboJIO] 2024-09-19T12:02:32.440 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.444+0000 7f3c9faed9c0 20 get_obj_state: octx=0x563d7f12aea0 obj=myver:_:Z-L9NkspqsLZWJJ4LYoZco0OaBboJIO_x state=0x563d7f3d9a38 s->prefetch_data=0 2024-09-19T12:02:32.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.444+0000 7f3c9faed9c0 10 manifest: total_size = 9 2024-09-19T12:02:32.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.444+0000 7f3c9faed9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10089601198557868988 2024-09-19T12:02:32.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.444+0000 7f3c9faed9c0 20 get_obj_state: octx=0x563d7f12aea0 obj=myver:_:Z-L9NkspqsLZWJJ4LYoZco0OaBboJIO_x state=0x563d7f3d9a38 s->prefetch_data=0 2024-09-19T12:02:32.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.444+0000 7f3c9faed9c0 20 prepare_atomic_modification: state is not atomic. state=0x563d7f3d9a38 2024-09-19T12:02:32.441 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.444+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.448+0000 7f3c9faed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T12:02:32.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.448+0000 7f3c9faed9c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-19T12:02:32.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.448+0000 7f3c9faed9c0 0 deleting objects inline since gc isn't initialized 2024-09-19T12:02:32.447 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.448+0000 7f3c9faed9c0 5 delete_objs_inline: removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19__shadow:Z-L9NkspqsLZWJJ4LYoZco0OaBboJIO_.x2e_OVr5qU6564-OOtRBQwqcCvvO8yh_0 2024-09-19T12:02:32.449 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.452+0000 7f3c9faed9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T12:02:32.450 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.452+0000 7f3b6ffff640 20 handle_completion(): completion ok for obj=x[Z-L9NkspqsLZWJJ4LYoZco0OaBboJIO] 2024-09-19T12:02:32.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.456+0000 7f3c9faed9c0 20 get_obj_state: octx=0x563d7f12aea0 obj=myver:x state=0x563d7f3e04e8 s->prefetch_data=0 2024-09-19T12:02:32.452 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.456+0000 7f3c9faed9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xaht24cn9qjtccn8xioh6p25iv8wnqyn 2024-09-19T12:02:32.458 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.460+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.462 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.464+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.464+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.463 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.468+0000 7f3c9faed9c0 20 get_obj_state: octx=0x563d7f12aea0 obj=myver:y state=0x563d7f3e04e8 s->prefetch_data=0 2024-09-19T12:02:32.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.468+0000 7f3c9faed9c0 20 get_obj_state: setting s->obj_tag to jcbgzaqr658gyg9im8ubzvdq9ky8yq3t 2024-09-19T12:02:32.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.468+0000 7f3c9faed9c0 20 get_obj_state_impl: setting s->olh_tag to aa9l6iyrcbn0s1h0staq2gk9shf0inpd 2024-09-19T12:02:32.465 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.468+0000 7f3c9faed9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=aa9l6iyrcbn0s1h0staq2gk9shf0inpd 2024-09-19T12:02:32.468 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.472+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.471 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.476+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.472 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.476+0000 7f3c9faed9c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-19T12:02:32.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.476+0000 7f3c9faed9c0 20 olh_log_entry: epoch=2 op=3 key=y[PVtE3g8Pvc8wJUsN23l0n2GfYcI--1l] 2024-09-19T12:02:32.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.476+0000 7f3c9faed9c0 20 get_obj_state: octx=0x563d7f12aea0 obj=myver:_:PVtE3g8Pvc8wJUsN23l0n2GfYcI--1l_y state=0x563d7f3a8da8 s->prefetch_data=0 2024-09-19T12:02:32.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.476+0000 7f3c9faed9c0 10 manifest: total_size = 12 2024-09-19T12:02:32.473 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.476+0000 7f3c9faed9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5256806111095494046 2024-09-19T12:02:32.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.476+0000 7f3c9faed9c0 20 get_obj_state: octx=0x563d7f12aea0 obj=myver:_:PVtE3g8Pvc8wJUsN23l0n2GfYcI--1l_y state=0x563d7f3a8da8 s->prefetch_data=0 2024-09-19T12:02:32.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.476+0000 7f3c9faed9c0 20 prepare_atomic_modification: state is not atomic. state=0x563d7f3a8da8 2024-09-19T12:02:32.474 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.476+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.484+0000 7f3c9faed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T12:02:32.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.484+0000 7f3c9faed9c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-19T12:02:32.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.484+0000 7f3c9faed9c0 0 deleting objects inline since gc isn't initialized 2024-09-19T12:02:32.480 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.484+0000 7f3c9faed9c0 5 delete_objs_inline: removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19__shadow:PVtE3g8Pvc8wJUsN23l0n2GfYcI--1l_.caT2kUpmdpn3gOepBg3NzoBh10BYJy0_0 2024-09-19T12:02:32.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.484+0000 7f3c9faed9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T12:02:32.483 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.484+0000 7f3b6ffff640 20 handle_completion(): completion ok for obj=y[PVtE3g8Pvc8wJUsN23l0n2GfYcI--1l] 2024-09-19T12:02:32.487 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.488+0000 7f3c9faed9c0 20 get_obj_state: octx=0x563d7f12aea0 obj=myver:y state=0x563d7f3e04e8 s->prefetch_data=0 2024-09-19T12:02:32.487 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.488+0000 7f3c9faed9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=aa9l6iyrcbn0s1h0staq2gk9shf0inpd 2024-09-19T12:02:32.493 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.496+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.497 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.500+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.500+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.498 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.500+0000 7f3c9faed9c0 20 get_obj_state: octx=0x563d7f12aea0 obj=myver:z state=0x563d7f3e04e8 s->prefetch_data=0 2024-09-19T12:02:32.499 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.504+0000 7f3c9faed9c0 20 get_obj_state: setting s->obj_tag to rlyih0owqox36tk1xpt20uu281u8y3tp 2024-09-19T12:02:32.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.504+0000 7f3c9faed9c0 20 get_obj_state_impl: setting s->olh_tag to 4o38v4lymnyo035ld5j2si0xseiah6lh 2024-09-19T12:02:32.500 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.504+0000 7f3c9faed9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4o38v4lymnyo035ld5j2si0xseiah6lh 2024-09-19T12:02:32.502 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.504+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.506 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.508+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.508+0000 7f3c9faed9c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-19T12:02:32.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.508+0000 7f3c9faed9c0 20 olh_log_entry: epoch=2 op=3 key=z[RjC-.v2SKRRKpyqDZSG9CdbWgXOfGOM] 2024-09-19T12:02:32.507 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.508+0000 7f3c9faed9c0 20 get_obj_state: octx=0x563d7f12aea0 obj=myver:_:RjC-.v2SKRRKpyqDZSG9CdbWgXOfGOM_z state=0x563d7f3a8c48 s->prefetch_data=0 2024-09-19T12:02:32.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.512+0000 7f3c9faed9c0 10 manifest: total_size = 22 2024-09-19T12:02:32.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.512+0000 7f3c9faed9c0 20 get_obj_state: setting s->obj_tag to cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17101868835420537897 2024-09-19T12:02:32.508 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.512+0000 7f3c9faed9c0 20 get_obj_state: octx=0x563d7f12aea0 obj=myver:_:RjC-.v2SKRRKpyqDZSG9CdbWgXOfGOM_z state=0x563d7f3a8c48 s->prefetch_data=0 2024-09-19T12:02:32.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.512+0000 7f3c9faed9c0 20 prepare_atomic_modification: state is not atomic. state=0x563d7f3a8c48 2024-09-19T12:02:32.509 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.512+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.516+0000 7f3c9faed9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T12:02:32.515 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.516+0000 7f3c9faed9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-19T12:02:32.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.516+0000 7f3c9faed9c0 0 deleting objects inline since gc isn't initialized 2024-09-19T12:02:32.516 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.516+0000 7f3c9faed9c0 5 delete_objs_inline: removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19__shadow:RjC-.v2SKRRKpyqDZSG9CdbWgXOfGOM_.uFF6kmlcSPLhpIGfScgDaMe_6NU7ab3_0 2024-09-19T12:02:32.519 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.524+0000 7f3b80ff9640 20 handle_completion(): completion ok for obj=z[RjC-.v2SKRRKpyqDZSG9CdbWgXOfGOM] 2024-09-19T12:02:32.520 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.524+0000 7f3c9faed9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T12:02:32.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.528+0000 7f3c9faed9c0 20 get_obj_state: octx=0x563d7f12aea0 obj=myver:z state=0x563d7f3e04e8 s->prefetch_data=0 2024-09-19T12:02:32.523 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.528+0000 7f3c9faed9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4o38v4lymnyo035ld5j2si0xseiah6lh 2024-09-19T12:02:32.531 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.532+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.536+0000 7f3c9faed9c0 20 bucket index object: :.dir.cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19.3.9 2024-09-19T12:02:32.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.536+0000 7f3c9faed9c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-19T12:02:32.534 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.536+0000 7f3c9faed9c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-19T12:02:32.536 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.540+0000 7f3b537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:32.540 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.544+0000 7f3c9faed9c0 20 remove_watcher() i=0 2024-09-19T12:02:32.541 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.544+0000 7f3c9faed9c0 2 removed watcher, disabling cache 2024-09-19T12:02:32.543 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.544+0000 7f3c9faed9c0 20 remove_watcher() i=1 2024-09-19T12:02:32.545 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.548+0000 7f3c9faed9c0 20 remove_watcher() i=2 2024-09-19T12:02:32.548 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.552+0000 7f3c9faed9c0 20 remove_watcher() i=3 2024-09-19T12:02:32.550 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.552+0000 7f3c9faed9c0 20 remove_watcher() i=4 2024-09-19T12:02:32.552 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.556+0000 7f3c9faed9c0 20 remove_watcher() i=5 2024-09-19T12:02:32.554 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.556+0000 7f3c9faed9c0 20 remove_watcher() i=6 2024-09-19T12:02:32.556 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.560+0000 7f3c9faed9c0 20 remove_watcher() i=7 2024-09-19T12:02:32.633 INFO:tasks.workunit.client.0.smithi120.stderr:radosgw-admin bucket stats --bucket myver 2024-09-19T12:02:32.663 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:02:32.663 INFO:tasks.workunit.client.0.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:02:32.710 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.712+0000 7f30104999c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.712 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.716+0000 7f30104999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:32.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.716+0000 7f30104999c0 20 realm 2024-09-19T12:02:32.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.716+0000 7f30104999c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.716+0000 7f30104999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:32.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.716+0000 7f30104999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:02:32.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.716+0000 7f30104999c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.716+0000 7f30104999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:32.713 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.716+0000 7f30104999c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.716+0000 7f30104999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:32.714 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.716+0000 7f30104999c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.720+0000 7f30104999c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:02:32.716 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.720+0000 7f30104999c0 20 searching for the correct realm 2024-09-19T12:02:32.719 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.724+0000 7f300e7a0640 0 -- 172.21.15.120:0/296924731 >> [v2:172.21.15.120:6800/1864022726,v1:172.21.15.120:6801/1864022726] conn(0x7f3004129040 msgr2=0x7f3004003960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:32.727 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.728+0000 7f300d79e640 0 -- 172.21.15.120:0/296924731 >> [v2:172.21.15.120:6808/1940228464,v1:172.21.15.120:6809/1940228464] conn(0x7f3000049040 msgr2=0x7f3000038930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:02:32.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:02:32.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:02:32.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:02:32.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:02:32.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:02:32.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:02:32.944 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:32.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:02:32.945 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:02:32.946 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 zone default found 2024-09-19T12:02:32.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 4 Realm: () 2024-09-19T12:02:32.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:02:32.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:02:32.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:02:32.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 zonegroup default 2024-09-19T12:02:32.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:32.947 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.948+0000 7f30104999c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.952+0000 7f30104999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:32.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.952+0000 7f30104999c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.948 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.952+0000 7f30104999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:02:32.949 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.952+0000 7f30104999c0 20 started sync module instance, tier type = 2024-09-19T12:02:32.949 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.952+0000 7f30104999c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:02:32.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.976+0000 7f30104999c0 20 add_watcher() i=0 2024-09-19T12:02:32.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.976+0000 7f30104999c0 20 add_watcher() i=1 2024-09-19T12:02:32.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.976+0000 7f30104999c0 20 add_watcher() i=2 2024-09-19T12:02:32.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.976+0000 7f30104999c0 20 add_watcher() i=3 2024-09-19T12:02:32.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.976+0000 7f30104999c0 20 add_watcher() i=4 2024-09-19T12:02:32.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.976+0000 7f30104999c0 20 add_watcher() i=5 2024-09-19T12:02:32.975 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.976+0000 7f30104999c0 20 add_watcher() i=6 2024-09-19T12:02:32.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.980+0000 7f30104999c0 20 add_watcher() i=7 2024-09-19T12:02:32.977 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.980+0000 7f30104999c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:02:32.982 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.984+0000 7f2ebf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:32.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.984+0000 7f30104999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:02:32.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.984+0000 7f30104999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:02:32.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.984+0000 7f30104999c0 5 note: GC not initialized 2024-09-19T12:02:32.983 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.984+0000 7f2ebe7fc640 20 reqs_thread_entry: start 2024-09-19T12:02:32.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.988+0000 7f30104999c0 20 init_complete bucket index max shards: 1 2024-09-19T12:02:32.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.988+0000 7f30104999c0 20 Filter name: none 2024-09-19T12:02:32.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.988+0000 7f2e2ffff640 20 reqs_thread_entry: start 2024-09-19T12:02:32.984 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.988+0000 7f30104999c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.988+0000 7f30104999c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T12:02:32.985 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.988+0000 7f30104999c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.988+0000 7f30104999c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T12:02:32.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.988+0000 7f30104999c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:32.986 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.988+0000 7f30104999c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.988+0000 7f30104999c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T12:02:32.987 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.988+0000 7f30104999c0 20 rados->read ofs=0 len=0 2024-09-19T12:02:32.988 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.992+0000 7f30104999c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T12:02:32.988 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.992+0000 7f30104999c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T12:02:32.992 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:32.996+0000 7f2ebf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:02:32.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:33.000+0000 7f30104999c0 20 remove_watcher() i=0 2024-09-19T12:02:32.997 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:33.000+0000 7f30104999c0 2 removed watcher, disabling cache 2024-09-19T12:02:32.999 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:33.000+0000 7f30104999c0 20 remove_watcher() i=1 2024-09-19T12:02:33.004 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:33.008+0000 7f30104999c0 20 remove_watcher() i=2 2024-09-19T12:02:33.005 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:33.008+0000 7f30104999c0 20 remove_watcher() i=3 2024-09-19T12:02:33.008 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:33.012+0000 7f30104999c0 20 remove_watcher() i=4 2024-09-19T12:02:33.009 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:33.012+0000 7f30104999c0 20 remove_watcher() i=5 2024-09-19T12:02:33.011 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:33.012+0000 7f30104999c0 20 remove_watcher() i=6 2024-09-19T12:02:33.014 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19T12:02:33.016+0000 7f30104999c0 20 remove_watcher() i=7 2024-09-19T12:02:33.031 INFO:tasks.workunit.client.0.smithi120.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-19T12:02:33.031 INFO:tasks.workunit.client.0.smithi120.stderr:Deleting bucket a-bucket 2024-09-19T12:02:33.058 INFO:tasks.workunit.client.0.smithi120.stderr:Deleting bucket myver 2024-09-19T12:02:33.201 INFO:tasks.workunit.client.0.smithi120.stderr:Completed resharding tests 2024-09-19T12:02:33.201 INFO:tasks.workunit.client.0.smithi120.stdout:connected to http://localhost:80 2024-09-19T12:02:33.318 INFO:tasks.workunit.client.0.smithi120.stderr:+ deactivate 2024-09-19T12:02:33.318 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-19T12:02:33.318 INFO:tasks.workunit.client.0.smithi120.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T12:02:33.319 INFO:tasks.workunit.client.0.smithi120.stderr:+ export PATH 2024-09-19T12:02:33.319 INFO:tasks.workunit.client.0.smithi120.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-19T12:02:33.319 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' -n '' ']' 2024-09-19T12:02:33.319 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T12:02:33.319 INFO:tasks.workunit.client.0.smithi120.stderr:+ hash -r 2024-09-19T12:02:33.319 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' -n '' ']' 2024-09-19T12:02:33.319 INFO:tasks.workunit.client.0.smithi120.stderr:+ unset VIRTUAL_ENV 2024-09-19T12:02:33.319 INFO:tasks.workunit.client.0.smithi120.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-19T12:02:33.320 INFO:tasks.workunit.client.0.smithi120.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-19T12:02:33.320 INFO:tasks.workunit.client.0.smithi120.stderr:+ unset -f deactivate 2024-09-19T12:02:33.320 INFO:tasks.workunit.client.0.smithi120.stderr:+ echo OK. 2024-09-19T12:02:33.321 INFO:tasks.workunit.client.0.smithi120.stdout:OK. 2024-09-19T12:02:33.321 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T12:02:33.321 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T12:02:33.376 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-19T12:02:33.376 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T12:02:33.809 DEBUG:teuthology.parallel:result is None 2024-09-19T12:02:33.810 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T12:02:33.823 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T12:02:33.823 DEBUG:teuthology.orchestra.run.smithi120:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T12:02:33.872 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T12:02:33.872 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-19T12:02:33.885 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 82, in run_one_task task = get_task(taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 35, in get_task module = _import('tasks', module_name, task_name, fail_on_import_error=True) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 54, in _import module = __import__( ModuleNotFoundError: No module named 'tasks.s3tests_java' 2024-09-19T12:02:34.156 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5a1cd85ca0874691bb403346754af2ce Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 82, in run_one_task task = get_task(taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 35, in get_task module = _import('tasks', module_name, task_name, fail_on_import_error=True) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 54, in _import module = __import__( ModuleNotFoundError: No module named 'tasks.s3tests_java' 2024-09-19T12:02:34.158 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-19T12:02:34.167 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-19T12:02:34.241 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-19T12:02:34.297 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-19T12:02:34.306 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-19T12:02:34.306 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T12:02:34.340 INFO:tasks.rgw.client.0.smithi120.stdout:2024-09-19T12:02:34.344+0000 7f50e454f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 38390) UID: 0 2024-09-19T12:02:34.340 INFO:tasks.rgw.client.0.smithi120.stdout:2024-09-19T12:02:34.344+0000 7f50e7d97a40 -1 shutting down 2024-09-19T12:03:02.860 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-19T12:03:04.814 INFO:tasks.rgw.client.0:Stopped 2024-09-19T12:03:04.815 DEBUG:teuthology.orchestra.run.smithi120:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-19T12:03:04.821 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f /etc/ceph/vault-root-token 2024-09-19T12:03:04.877 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-19T12:03:04.932 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-19T12:03:04.933 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-19T12:03:04.933 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-19T12:03:05.012 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setuser ceph since I am not root 2024-09-19T12:03:05.013 INFO:teuthology.orchestra.run.smithi120.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T12:03:05.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.055+0000 7fd4729af9c0 20 rados->read ofs=0 len=0 2024-09-19T12:03:05.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.059+0000 7fd4729af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:03:05.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.059+0000 7fd4729af9c0 20 realm 2024-09-19T12:03:05.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.059+0000 7fd4729af9c0 20 rados->read ofs=0 len=0 2024-09-19T12:03:05.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.059+0000 7fd4729af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:03:05.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.059+0000 7fd4729af9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T12:03:05.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.059+0000 7fd4729af9c0 20 rados->read ofs=0 len=0 2024-09-19T12:03:05.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.059+0000 7fd4729af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:03:05.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.059+0000 7fd4729af9c0 20 rados->read ofs=0 len=0 2024-09-19T12:03:05.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.059+0000 7fd4729af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:03:05.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.059+0000 7fd4729af9c0 20 rados->read ofs=0 len=0 2024-09-19T12:03:05.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.063+0000 7fd4729af9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T12:03:05.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.063+0000 7fd4729af9c0 20 searching for the correct realm 2024-09-19T12:03:05.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.063+0000 7fd4704b5640 0 -- 172.21.15.120:0/2273320217 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fd46801a210 msgr2=0x7fd468033910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:03:05.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.279+0000 7fd4704b5640 0 -- 172.21.15.120:0/2273320217 >> [v2:172.21.15.151:6800/4207680840,v1:172.21.15.151:6801/4207680840] conn(0x7fd46801a210 msgr2=0x7fd468033910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T12:03:05.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.291+0000 7fd4729af9c0 20 RGWRados::pool_iterate: got zone_info.cd83c2b8-48ff-443f-8733-529022aeb2cf 2024-09-19T12:03:05.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.291+0000 7fd4729af9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T12:03:05.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.291+0000 7fd4729af9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T12:03:05.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.291+0000 7fd4729af9c0 20 RGWRados::pool_iterate: got zonegroup_info.7b63d916-6b98-4518-8659-8ef37b84217b 2024-09-19T12:03:05.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.291+0000 7fd4729af9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T12:03:05.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.291+0000 7fd4729af9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T12:03:05.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.291+0000 7fd4729af9c0 20 rados->read ofs=0 len=0 2024-09-19T12:03:05.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.291+0000 7fd4729af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:03:05.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.291+0000 7fd4729af9c0 20 rados->read ofs=0 len=0 2024-09-19T12:03:05.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.291+0000 7fd4729af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T12:03:05.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.291+0000 7fd4729af9c0 20 rados->read ofs=0 len=0 2024-09-19T12:03:05.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.295+0000 7fd4729af9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T12:03:05.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.295+0000 7fd4729af9c0 20 zone default found 2024-09-19T12:03:05.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.295+0000 7fd4729af9c0 4 Realm: () 2024-09-19T12:03:05.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.295+0000 7fd4729af9c0 4 ZoneGroup: default (7b63d916-6b98-4518-8659-8ef37b84217b) 2024-09-19T12:03:05.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.295+0000 7fd4729af9c0 4 Zone: default (cd83c2b8-48ff-443f-8733-529022aeb2cf) 2024-09-19T12:03:05.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.295+0000 7fd4729af9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T12:03:05.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.295+0000 7fd4729af9c0 20 zonegroup default 2024-09-19T12:03:05.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.295+0000 7fd4729af9c0 20 rados->read ofs=0 len=0 2024-09-19T12:03:05.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.295+0000 7fd4729af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:03:05.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.295+0000 7fd4729af9c0 20 rados->read ofs=0 len=0 2024-09-19T12:03:05.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.295+0000 7fd4729af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:03:05.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.295+0000 7fd4729af9c0 20 rados->read ofs=0 len=0 2024-09-19T12:03:05.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.295+0000 7fd4729af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T12:03:05.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.295+0000 7fd4729af9c0 20 started sync module instance, tier type = 2024-09-19T12:03:05.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.295+0000 7fd4729af9c0 20 started zone id=cd83c2b8-48ff-443f-8733-529022aeb2cf (name=default) with tier type = 2024-09-19T12:03:05.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.319+0000 7fd4729af9c0 20 add_watcher() i=0 2024-09-19T12:03:05.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.319+0000 7fd4729af9c0 20 add_watcher() i=1 2024-09-19T12:03:05.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.319+0000 7fd4729af9c0 20 add_watcher() i=2 2024-09-19T12:03:05.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.319+0000 7fd4729af9c0 20 add_watcher() i=3 2024-09-19T12:03:05.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.319+0000 7fd4729af9c0 20 add_watcher() i=4 2024-09-19T12:03:05.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.319+0000 7fd4729af9c0 20 add_watcher() i=5 2024-09-19T12:03:05.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.319+0000 7fd4729af9c0 20 add_watcher() i=6 2024-09-19T12:03:05.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.323+0000 7fd4729af9c0 20 add_watcher() i=7 2024-09-19T12:03:05.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.323+0000 7fd4729af9c0 2 all 8 watchers are set, enabling cache 2024-09-19T12:03:05.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.327+0000 7fd326fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:03:05.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.327+0000 7fd4729af9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T12:03:05.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.327+0000 7fd4729af9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T12:03:05.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.415+0000 7fd325fdb640 20 reqs_thread_entry: start 2024-09-19T12:03:05.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.415+0000 7fd4729af9c0 20 init_complete bucket index max shards: 1 2024-09-19T12:03:05.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.415+0000 7fd4729af9c0 20 Filter name: none 2024-09-19T12:03:05.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.415+0000 7fd2977fe640 20 reqs_thread_entry: start 2024-09-19T12:03:05.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.415+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T12:03:05.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.419+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.419+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-19T12:03:05.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7176774585479327363', time=2024-09-19T13:53:48.187524+0000, chain.objs.size()=4 2024-09-19T12:03:05.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13__multipart_foo.2~xRXyI8JTTc8lq3u3huscJdAuinNhrR0.1 2024-09-19T12:03:05.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13__multipart_foo.2~xRXyI8JTTc8lq3u3huscJdAuinNhrR0.2 2024-09-19T12:03:05.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13__multipart_foo.2~xRXyI8JTTc8lq3u3huscJdAuinNhrR0.3 2024-09-19T12:03:05.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13__multipart_foo.2~xRXyI8JTTc8lq3u3huscJdAuinNhrR0.4 2024-09-19T12:03:05.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5222089996730241412', time=2024-09-19T13:55:47.730785+0000, chain.objs.size()=1 2024-09-19T12:03:05.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.0OrNUFAKBtasHKRDRJeQLpqiIHxLIWr_0 2024-09-19T12:03:05.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14735192149561913283', time=2024-09-19T13:56:25.401040+0000, chain.objs.size()=1 2024-09-19T12:03:05.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.8k1svsAIQiG5afeLklD_QUFi6C0k3Ta_0 2024-09-19T12:03:05.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5500713130840891684', time=2024-09-19T13:56:27.380765+0000, chain.objs.size()=1 2024-09-19T12:03:05.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.De6pc5WWhzDkpkoxWyPU4blvU5TzVG3_0 2024-09-19T12:03:05.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9465952753877966511', time=2024-09-19T13:57:01.472407+0000, chain.objs.size()=1 2024-09-19T12:03:05.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.Tu_oOyvXrbvSiDt51v9mdfic6crkpjW_0 2024-09-19T12:03:05.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7157969748651420701', time=2024-09-19T13:57:01.476900+0000, chain.objs.size()=1 2024-09-19T12:03:05.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.p1u0rLdVVPy_nIhI9HbXLRBuxLB8FvO_0 2024-09-19T12:03:05.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4649450202593361349', time=2024-09-19T13:57:04.537140+0000, chain.objs.size()=1 2024-09-19T12:03:05.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.35-Zvjs-A0F38_ynPCxKAq2xdJRDvnQ_0 2024-09-19T12:03:05.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17995002207072896020', time=2024-09-19T13:57:40.911502+0000, chain.objs.size()=1 2024-09-19T12:03:05.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.423+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.92kM4L3SsDY3YAGLIM7vWqBZ6JrV_Gm_0 2024-09-19T12:03:05.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.427+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13689874255612964665', time=2024-09-19T13:58:14.425883+0000, chain.objs.size()=1 2024-09-19T12:03:05.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.427+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.4WsHf8x6RwPmr9ae27cRuvTCeYjgxQd_0 2024-09-19T12:03:05.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.427+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6727562315461171410', time=2024-09-19T13:58:54.777483+0000, chain.objs.size()=1 2024-09-19T12:03:05.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.427+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.mWlY0t0cFsmnPswIjfVpxPqIaSJH9WL_0 2024-09-19T12:03:05.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.431+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1510560685762104273', time=2024-09-19T13:59:27.988572+0000, chain.objs.size()=1 2024-09-19T12:03:05.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.431+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.gaiRFakWflcWVh9Dqw70lLbZgspI028_0 2024-09-19T12:03:05.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.431+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1838908490632346494', time=2024-09-19T13:59:32.859948+0000, chain.objs.size()=1 2024-09-19T12:03:05.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.431+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.VCv926no_T6Qt_ZUSzNTZrLoSRwbFWc_0 2024-09-19T12:03:05.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.435+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6072155358465069549', time=2024-09-19T14:00:06.316257+0000, chain.objs.size()=1 2024-09-19T12:03:05.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.435+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.ojPMGmfFRmczkqoI0nOVVXdIPEnD2sf_0 2024-09-19T12:03:05.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.443+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.447+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T12:03:05.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-19T12:03:05.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2535313492596699458', time=2024-09-19T13:55:47.703839+0000, chain.objs.size()=1 2024-09-19T12:03:05.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.UvReJqMzWCH_X6SF8bBvXiO68BtMHcO_0 2024-09-19T12:03:05.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16966129946756562424', time=2024-09-19T13:55:47.714247+0000, chain.objs.size()=1 2024-09-19T12:03:05.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.WatCJQLymjtPa23O9lXdMF7kAKUtjQm_0 2024-09-19T12:03:05.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12102341883644539856', time=2024-09-19T13:56:22.531463+0000, chain.objs.size()=1 2024-09-19T12:03:05.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.UmNWX-RuYg2bJcJMcnfA9fv2WjKVbPj_0 2024-09-19T12:03:05.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5551263002272121090', time=2024-09-19T13:56:22.538434+0000, chain.objs.size()=1 2024-09-19T12:03:05.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.M3qKNzN2rYa9fgF_kYhIl3AvuhXXExd_0 2024-09-19T12:03:05.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8911152153662713552', time=2024-09-19T13:56:22.555850+0000, chain.objs.size()=1 2024-09-19T12:03:05.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.LnifdVsjjnwXA4HVLw0Q5v7wJSDUv8E_0 2024-09-19T12:03:05.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12270259193978291615', time=2024-09-19T13:56:22.562397+0000, chain.objs.size()=1 2024-09-19T12:03:05.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.rC5YQ8hwkj4NxWJOETJ1WjJOaj8BjqP_0 2024-09-19T12:03:05.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2577827949912427834', time=2024-09-19T13:56:25.405447+0000, chain.objs.size()=1 2024-09-19T12:03:05.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.wU2YMDsOSOJy5EYH27Ck_Ohj_i7ANXb_0 2024-09-19T12:03:05.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.202113469741789968', time=2024-09-19T13:56:27.403049+0000, chain.objs.size()=1 2024-09-19T12:03:05.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.q702YXQei6fNkGarUUNen8rfGEkGvWe_0 2024-09-19T12:03:05.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8400029416986185297', time=2024-09-19T13:57:04.542152+0000, chain.objs.size()=1 2024-09-19T12:03:05.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.451+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.k7nTeFwM-jnM_03yQJ8JBE8mrjRvIqk_0 2024-09-19T12:03:05.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.455+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8956006819532226784', time=2024-09-19T13:57:04.545277+0000, chain.objs.size()=1 2024-09-19T12:03:05.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.455+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.F_jAOu6oc9iCHNOFOlBj4osSWErD82a_0 2024-09-19T12:03:05.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.455+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5082273004705783655', time=2024-09-19T13:57:37.984174+0000, chain.objs.size()=1 2024-09-19T12:03:05.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.455+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.KLQYvIfGs9fqnyCjECfGh7vk_1BvBpl_0 2024-09-19T12:03:05.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.455+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5605137515792361853', time=2024-09-19T13:57:40.887798+0000, chain.objs.size()=1 2024-09-19T12:03:05.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.455+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.bLU5Y4TZiYdR8w5D2rOTY2mkvOLoPPL_0 2024-09-19T12:03:05.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.463+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7587186098632869013', time=2024-09-19T13:57:40.921268+0000, chain.objs.size()=1 2024-09-19T12:03:05.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.463+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.cvIDCKnOLI2hcmgaalnhhzyxE6_I1IH_0 2024-09-19T12:03:05.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17269371469859299909', time=2024-09-19T13:57:42.656176+0000, chain.objs.size()=1 2024-09-19T12:03:05.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.qRN1XOPx3tZEJjPNSafZK70HkSpNRc6_0 2024-09-19T12:03:05.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9156053665835442737', time=2024-09-19T13:58:15.751195+0000, chain.objs.size()=1 2024-09-19T12:03:05.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.j5f4NdHwW3iSq6r0gfLI20CBPhtyorn_0 2024-09-19T12:03:05.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7239257942981080540', time=2024-09-19T13:58:15.758219+0000, chain.objs.size()=1 2024-09-19T12:03:05.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.FcntuqCOmM_q-pBeDl5rWwdP65JFQOy_0 2024-09-19T12:03:05.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11547053137248799115', time=2024-09-19T13:58:18.484618+0000, chain.objs.size()=1 2024-09-19T12:03:05.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.zsvzeQCN2yCFV7-GhHXsrQYQRTS5u8g_0 2024-09-19T12:03:05.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.831642956082626233', time=2024-09-19T13:58:51.934069+0000, chain.objs.size()=1 2024-09-19T12:03:05.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.qL3sxzuc1zQt0qOa4a-7JFwzBF0Txbn_0 2024-09-19T12:03:05.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7471212838499522820', time=2024-09-19T13:58:54.767779+0000, chain.objs.size()=1 2024-09-19T12:03:05.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.7-aAa7WVT6SxJ22i2MDzIhp-njDYSfj_0 2024-09-19T12:03:05.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4222530799769072207', time=2024-09-19T13:58:54.774489+0000, chain.objs.size()=1 2024-09-19T12:03:05.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.YNhc7oyVoklkN1EushHDKwWJ93fwS2c_0 2024-09-19T12:03:05.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10330085351691035502', time=2024-09-19T13:58:54.784285+0000, chain.objs.size()=1 2024-09-19T12:03:05.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.WasgF7aPrczXo3-z6in2aw-OK8Aq6WR_0 2024-09-19T12:03:05.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12259233142814252030', time=2024-09-19T14:02:17.784511+0000, chain.objs.size()=1 2024-09-19T12:03:05.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.467+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18__shadow_.hamBY5M3DvEZan8BLRotlo-Ph-mCLJv_0 2024-09-19T12:03:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.483+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.487+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T12:03:05.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.491+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.491+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-19T12:03:05.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16961460971531389490', time=2024-09-19T13:55:10.170039+0000, chain.objs.size()=1 2024-09-19T12:03:05.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.v61lBjEW8jIZl172uO1bRGuTvy7gbT5_0 2024-09-19T12:03:05.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8224890195773585668', time=2024-09-19T13:55:11.902754+0000, chain.objs.size()=1 2024-09-19T12:03:05.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.RFTRFxW83jJhDGr_tSTAIQIrMTTMTXQ_0 2024-09-19T12:03:05.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.475352680628903675', time=2024-09-19T13:55:44.859426+0000, chain.objs.size()=1 2024-09-19T12:03:05.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.xbl6bZYuvDwvaFvSwDcB5lfhWmwzhZw_0 2024-09-19T12:03:05.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12284040655728733594', time=2024-09-19T13:57:38.023981+0000, chain.objs.size()=1 2024-09-19T12:03:05.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.GOvo7sTLl0S2d2ZPMNkiuNR5_dFIyh3_0 2024-09-19T12:03:05.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15474190465058628783', time=2024-09-19T13:57:40.919085+0000, chain.objs.size()=1 2024-09-19T12:03:05.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.gKorCdQa9neWSY-tJ3gr29sC38ildie_0 2024-09-19T12:03:05.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6851267255835931319', time=2024-09-19T13:58:51.935543+0000, chain.objs.size()=1 2024-09-19T12:03:05.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.aZiIHchwM0m9QOgNk3LQ8JRTmuSHRD4_0 2024-09-19T12:03:05.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10352102346681709028', time=2024-09-19T13:59:28.020808+0000, chain.objs.size()=1 2024-09-19T12:03:05.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.KMhk2KMZSfiLzQO6tOFQlHBBRMP11LY_0 2024-09-19T12:03:05.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8079809415995933072', time=2024-09-19T13:59:30.663427+0000, chain.objs.size()=1 2024-09-19T12:03:05.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.WBYgAztCRfeicukNtDA_mAzinbw5WAZ_0 2024-09-19T12:03:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9994606730763644412', time=2024-09-19T13:59:32.857886+0000, chain.objs.size()=1 2024-09-19T12:03:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.WC0l5ulk0mzR4U0n0PA92ERW6QCQPSt_0 2024-09-19T12:03:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16162982539261618025', time=2024-09-19T14:02:17.793395+0000, chain.objs.size()=1 2024-09-19T12:03:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18__shadow_.dlVGF1COcvtCRKLtvCBmP_8ckFp68bI_0 2024-09-19T12:03:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8219031756554919705', time=2024-09-19T14:02:26.480624+0000, chain.objs.size()=1 2024-09-19T12:03:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.495+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19__shadow:yLDAtasI5leS102oYYosai3ATOYXk03_.R2sadwjVFn8KsA9YW8axZtZ3HbygGy2_0 2024-09-19T12:03:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.507+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.515+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T12:03:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-19T12:03:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7434898766899608403', time=2024-09-19T13:53:48.125520+0000, chain.objs.size()=1 2024-09-19T12:03:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.8_XPaKs7N26lVL2XIFV9jXscDJHJ688_0 2024-09-19T12:03:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='_AoT2aBkxOEmXmbm1MH_9zPvPJK2Qg-V', time=2024-09-19T13:53:48.403282+0000, chain.objs.size()=1 2024-09-19T12:03:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.FGiRIswP3n63kY7mZy8RjSpZ4AuTcEP_0 2024-09-19T12:03:05.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12175492348347082321', time=2024-09-19T13:55:11.910862+0000, chain.objs.size()=1 2024-09-19T12:03:05.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.VbqV9hWf-USm87nNpZYL1-ep3n96x0z_0 2024-09-19T12:03:05.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5479163013186219429', time=2024-09-19T13:55:44.861792+0000, chain.objs.size()=1 2024-09-19T12:03:05.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.wUUjZngtkUytJT0DTnsl32Tkmd1Ipwp_0 2024-09-19T12:03:05.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5441793550341110485', time=2024-09-19T13:55:47.706218+0000, chain.objs.size()=1 2024-09-19T12:03:05.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.LIERpa9H-d1wuMKpO9eJLSpzlMEgiw1_0 2024-09-19T12:03:05.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2356090584522422939', time=2024-09-19T13:55:49.473692+0000, chain.objs.size()=1 2024-09-19T12:03:05.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.NokXdDCNwNZMpycRhxgf4qderQSgRVI_0 2024-09-19T12:03:05.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17956970231748001152', time=2024-09-19T13:56:22.523159+0000, chain.objs.size()=1 2024-09-19T12:03:05.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.ZILjJknUmpkeGHMsV3xOaU_oPHV-osf_0 2024-09-19T12:03:05.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15835859408802279415', time=2024-09-19T13:56:25.383502+0000, chain.objs.size()=1 2024-09-19T12:03:05.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.6pZ05eOqQbSCAn50AtwLd01aDKcqafo_0 2024-09-19T12:03:05.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10109503947139939577', time=2024-09-19T13:56:25.402139+0000, chain.objs.size()=1 2024-09-19T12:03:05.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.qSsN_PftlQlrfB1JtvpJx8EM1_-aw3t_0 2024-09-19T12:03:05.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13910646319549312449', time=2024-09-19T13:58:18.480450+0000, chain.objs.size()=1 2024-09-19T12:03:05.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.6YvI9J9b6o6km-EGp1yPiUEPqxPEwcL_0 2024-09-19T12:03:05.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8439347914735046982', time=2024-09-19T13:58:51.934063+0000, chain.objs.size()=1 2024-09-19T12:03:05.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.F3ExcH_EbPv1MOgibnChCeh9PoP88z8_0 2024-09-19T12:03:05.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11540827610745181885', time=2024-09-19T13:58:51.955534+0000, chain.objs.size()=1 2024-09-19T12:03:05.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.519+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.mLXPvNnjIQWIkWFAGQ9_cDg02w7DovG_0 2024-09-19T12:03:05.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.527+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4567933235040426613', time=2024-09-19T13:58:54.788086+0000, chain.objs.size()=1 2024-09-19T12:03:05.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.527+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.7PvtWt39fLNI2sIgMUcLbLTy6OYSjmt_0 2024-09-19T12:03:05.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.527+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5197666607221804764', time=2024-09-19T13:59:27.994639+0000, chain.objs.size()=1 2024-09-19T12:03:05.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.527+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.co8gPK7IqJSXoPGjTmAhNPrq6jzWJKK_0 2024-09-19T12:03:05.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.527+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3797952728641338453', time=2024-09-19T14:00:06.309400+0000, chain.objs.size()=1 2024-09-19T12:03:05.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.527+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.0DyWCSk6a7icccEuFwGuE4fKP_SBph2_0 2024-09-19T12:03:05.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.531+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1253408490964407340', time=2024-09-19T14:00:06.311315+0000, chain.objs.size()=1 2024-09-19T12:03:05.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.531+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.4IdOeyFphWRqy_GFCCrfYUJ0m1K6TAK_0 2024-09-19T12:03:05.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.535+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T12:03:05.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-19T12:03:05.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15616635576727637812', time=2024-09-19T13:53:48.122913+0000, chain.objs.size()=1 2024-09-19T12:03:05.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.nXPAsrRB6EObHtIXkxohvZAZLAnRMjL_0 2024-09-19T12:03:05.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1712527367405413526', time=2024-09-19T13:53:48.355676+0000, chain.objs.size()=1 2024-09-19T12:03:05.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.HjZmBj6lWS6WujM-K3HdexKBGbheY5C_0 2024-09-19T12:03:05.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17762274316618845519', time=2024-09-19T13:53:48.578170+0000, chain.objs.size()=3 2024-09-19T12:03:05.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-STANDARD.2~XuLcG68F642Z3TfjR-MH_5k6ZdGj8Av.1 2024-09-19T12:03:05.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-STANDARD.2~XuLcG68F642Z3TfjR-MH_5k6ZdGj8Av.2 2024-09-19T12:03:05.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-STANDARD.2~XuLcG68F642Z3TfjR-MH_5k6ZdGj8Av.3 2024-09-19T12:03:05.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11028624745765757802', time=2024-09-19T13:55:10.159869+0000, chain.objs.size()=1 2024-09-19T12:03:05.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.-45Q5HKfKbq2_oeevR_FFJ2aE1eU0jE_0 2024-09-19T12:03:05.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17507321078532654173', time=2024-09-19T13:55:46.592978+0000, chain.objs.size()=1 2024-09-19T12:03:05.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.6prdVVoRuGzRSQ98Jz8JZyCvEVK3JrC_0 2024-09-19T12:03:05.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.539+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16019413559000469658', time=2024-09-19T13:55:47.707627+0000, chain.objs.size()=1 2024-09-19T12:03:05.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.543+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.IcuVWcRWjUCHocWSHf_9AWKUvHuYRJQ_0 2024-09-19T12:03:05.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.543+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11127677534146308432', time=2024-09-19T13:55:49.455293+0000, chain.objs.size()=1 2024-09-19T12:03:05.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.543+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.JV576O05JKj21KU6UOVYjEOWFJcOaPX_0 2024-09-19T12:03:05.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.543+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9898116013503712586', time=2024-09-19T13:55:49.498004+0000, chain.objs.size()=1 2024-09-19T12:03:05.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.543+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.A6WDzvPZY3AW7R9RZVV424P880aFjWo_0 2024-09-19T12:03:05.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.543+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7955256913027335423', time=2024-09-19T13:57:03.437110+0000, chain.objs.size()=1 2024-09-19T12:03:05.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.543+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.yCNRisxO0vT6whdyC9RiCXkIQ6CTDDy_0 2024-09-19T12:03:05.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.543+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15653047477710705450', time=2024-09-19T13:57:04.527891+0000, chain.objs.size()=1 2024-09-19T12:03:05.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.543+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.O85KAOkiMTSE6M4CaiNLJOarSDHvjSR_0 2024-09-19T12:03:05.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.547+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4215324091045931124', time=2024-09-19T13:57:04.530820+0000, chain.objs.size()=1 2024-09-19T12:03:05.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.547+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.Pv7mCRbMD-6b2-S1nuAxujwHU2wpThd_0 2024-09-19T12:03:05.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.547+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10835898234582151615', time=2024-09-19T13:57:42.672654+0000, chain.objs.size()=1 2024-09-19T12:03:05.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.547+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.qGk7Av7Fn7YuVLGpDUJca1psKMiUAbo_0 2024-09-19T12:03:05.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.547+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10648549526245790943', time=2024-09-19T13:58:15.746652+0000, chain.objs.size()=1 2024-09-19T12:03:05.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.547+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.dmX4dz_UQ4xBtH3HVYfNUhynA7V60bM_0 2024-09-19T12:03:05.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.547+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14096112114520868250', time=2024-09-19T13:58:51.933157+0000, chain.objs.size()=1 2024-09-19T12:03:05.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.547+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.bai6CR9rTUhWzl9qAkDyuvIa4ZCHq8b_0 2024-09-19T12:03:05.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.547+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10969636606314014578', time=2024-09-19T13:58:54.772751+0000, chain.objs.size()=1 2024-09-19T12:03:05.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.547+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.vroc0M7Kdo55dW8gqe1RrCTfZvlogk0_0 2024-09-19T12:03:05.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.547+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17975141004034605975', time=2024-09-19T13:59:27.990405+0000, chain.objs.size()=1 2024-09-19T12:03:05.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.551+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.yE7plz6exmqu2emyLRaYCkSNh4xxCuD_0 2024-09-19T12:03:05.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.551+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8160777009982930929', time=2024-09-19T13:59:28.029865+0000, chain.objs.size()=1 2024-09-19T12:03:05.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.551+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.wp0-ZaHemqryToRRSfyamfHQZhz7_5-_0 2024-09-19T12:03:05.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.555+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T12:03:05.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-19T12:03:05.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='_DvsO34dhc9OJ_m_Ndb8vrPel7XarTZd', time=2024-09-19T13:53:48.481935+0000, chain.objs.size()=2 2024-09-19T12:03:05.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.PyBcx8G81s7PMPlETejnvo0J2yoCaaH_0 2024-09-19T12:03:05.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.PyBcx8G81s7PMPlETejnvo0J2yoCaaH_1 2024-09-19T12:03:05.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='_y8symLAxYaV7jdYcM4gOn6ofNT2y62b', time=2024-09-19T13:53:48.533648+0000, chain.objs.size()=2 2024-09-19T12:03:05.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.JGgCgkX3X4n5cZfVsi8chEq1kUXd9a7_0 2024-09-19T12:03:05.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.JGgCgkX3X4n5cZfVsi8chEq1kUXd9a7_1 2024-09-19T12:03:05.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7186688755398756256', time=2024-09-19T13:53:48.881477+0000, chain.objs.size()=1 2024-09-19T12:03:05.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9__shadow_.JdiDWS_0FgUuy89NYTyCph6SiZT3zpT_0 2024-09-19T12:03:05.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10931651835196560297', time=2024-09-19T13:55:10.161782+0000, chain.objs.size()=1 2024-09-19T12:03:05.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.QCr5M2un_b_8G3EgMDmRN7O91AvZ4KF_0 2024-09-19T12:03:05.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2343120311003145786', time=2024-09-19T13:55:10.179395+0000, chain.objs.size()=1 2024-09-19T12:03:05.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.FuyUCKBSMMUF3pCksvv3q8rMlcnQD_7_0 2024-09-19T12:03:05.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17565817004438034826', time=2024-09-19T13:55:11.910196+0000, chain.objs.size()=1 2024-09-19T12:03:05.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.S1mKVXtwzXQQyNQ3ovqy_uOY-TL4gw2_0 2024-09-19T12:03:05.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9714277540688029696', time=2024-09-19T13:55:49.481653+0000, chain.objs.size()=1 2024-09-19T12:03:05.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.559+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.wCBPQutnU_0QAogchStIa1p5xP2n-Kz_0 2024-09-19T12:03:05.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.563+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13428155184204165389', time=2024-09-19T13:55:51.204544+0000, chain.objs.size()=1 2024-09-19T12:03:05.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.563+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.52weO6VV-2XlW_BaBgbVRSv4vS4jhbZ_0 2024-09-19T12:03:05.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.563+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6364858688819194530', time=2024-09-19T13:56:22.560458+0000, chain.objs.size()=1 2024-09-19T12:03:05.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.563+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.m98ArbgaCR83mVZpMZPfLXodTyjXfve_0 2024-09-19T12:03:05.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.563+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4151637647955328345', time=2024-09-19T13:56:25.396679+0000, chain.objs.size()=1 2024-09-19T12:03:05.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.563+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.ZdmZ6CNyCD3cFQNQdLi83h-Jc9gz1DP_0 2024-09-19T12:03:05.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.567+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12527670559868158853', time=2024-09-19T13:56:25.400534+0000, chain.objs.size()=1 2024-09-19T12:03:05.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.567+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.rdCvMAn171OWFIWRUlOLYNabwTrA-US_0 2024-09-19T12:03:05.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.567+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.441725471400915086', time=2024-09-19T13:57:01.465216+0000, chain.objs.size()=1 2024-09-19T12:03:05.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.567+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.izCiw_wUR4ZxOc3ISHpOH63Lcs4_FtZ_0 2024-09-19T12:03:05.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.567+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12769845266160519604', time=2024-09-19T13:59:28.012746+0000, chain.objs.size()=1 2024-09-19T12:03:05.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.567+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.FhBdgejvA6Wm0z5gkFerqfFdnn9h3wm_0 2024-09-19T12:03:05.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.567+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1316998474777162718', time=2024-09-19T13:59:30.662809+0000, chain.objs.size()=1 2024-09-19T12:03:05.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.567+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.opPnYIA2vp_2SdGjSssfIG_bQ7Ctcb7_0 2024-09-19T12:03:05.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.571+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9857378088822832014', time=2024-09-19T13:59:32.863867+0000, chain.objs.size()=1 2024-09-19T12:03:05.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.571+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.dPyVIUydBajD1W_rmAZF6U6aYzwcbLl_0 2024-09-19T12:03:05.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.575+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T12:03:05.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-19T12:03:05.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3523703269116052732', time=2024-09-19T13:55:11.903114+0000, chain.objs.size()=1 2024-09-19T12:03:05.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.t8BAUCVyPyLctse93gXvK2F_tIjL3Ue_0 2024-09-19T12:03:05.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11918998186343259966', time=2024-09-19T13:55:11.915619+0000, chain.objs.size()=1 2024-09-19T12:03:05.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.2wh7sWB9RTGsQc_t8TTc6BRTeFG1k86_0 2024-09-19T12:03:05.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9717674991632399565', time=2024-09-19T13:55:47.701658+0000, chain.objs.size()=1 2024-09-19T12:03:05.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.ngZbwjAj4a0sLe2USnhShnh6rCOPdrF_0 2024-09-19T12:03:05.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.236335530152791810', time=2024-09-19T13:56:22.536547+0000, chain.objs.size()=1 2024-09-19T12:03:05.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.jiBuDn-j2eB6uDJ8YAeSLKoevmw5ynB_0 2024-09-19T12:03:05.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16117838029550947483', time=2024-09-19T13:57:04.527287+0000, chain.objs.size()=1 2024-09-19T12:03:05.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.FBkN2s8HyOGJwS-5mXO9n7xXyFlHtAI_0 2024-09-19T12:03:05.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15455363341471037693', time=2024-09-19T13:57:40.906093+0000, chain.objs.size()=1 2024-09-19T12:03:05.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.-LILsF3D_UjwLG2yAFv6vg-d-x4UqOQ_0 2024-09-19T12:03:05.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5987536698025186623', time=2024-09-19T13:57:40.907555+0000, chain.objs.size()=1 2024-09-19T12:03:05.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.lSoGOfIU0qMUDbof08hfT2Rxzvp-Pmc_0 2024-09-19T12:03:05.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10561535341935437981', time=2024-09-19T13:57:40.915803+0000, chain.objs.size()=1 2024-09-19T12:03:05.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.MniAXf2HHfuyveQcId1qWm8F51eGCna_0 2024-09-19T12:03:05.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9927470515027634872', time=2024-09-19T13:57:42.671745+0000, chain.objs.size()=1 2024-09-19T12:03:05.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.uNLoE4NlZk2kDyr3mnTwonjp8TaeCUn_0 2024-09-19T12:03:05.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5342129914046672205', time=2024-09-19T13:58:20.415175+0000, chain.objs.size()=1 2024-09-19T12:03:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.vl844xt9qcbbi_ikfuoKadI2O7zEHX1_0 2024-09-19T12:03:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4196524204206568627', time=2024-09-19T13:58:54.787898+0000, chain.objs.size()=1 2024-09-19T12:03:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.ddW_Fi9-M1NlIMIqsORrqYrkg3JlYdu_0 2024-09-19T12:03:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13384464360500206831', time=2024-09-19T13:59:27.994604+0000, chain.objs.size()=1 2024-09-19T12:03:05.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.579+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.hJlCqGl8qgHc8fNSTGQwK-jTurfkxr6_0 2024-09-19T12:03:05.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.587+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2704908125339371327', time=2024-09-19T13:59:28.003929+0000, chain.objs.size()=1 2024-09-19T12:03:05.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.587+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.Ni9bBjYSrprG0fjPHqO4TegkxGbkU1z_0 2024-09-19T12:03:05.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.591+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.591+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T12:03:05.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-19T12:03:05.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13906377838126137650', time=2024-09-19T13:53:48.793853+0000, chain.objs.size()=1 2024-09-19T12:03:05.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8__shadow_.Ry1sGTWPfA2BHjkeAuEkEDB5OaPgvhV_0 2024-09-19T12:03:05.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5507369203267846331', time=2024-09-19T13:55:11.913242+0000, chain.objs.size()=1 2024-09-19T12:03:05.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.SVK8MvICHOyITRcWivu5nsemRrCbbqa_0 2024-09-19T12:03:05.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1606608712983636967', time=2024-09-19T13:55:11.923636+0000, chain.objs.size()=1 2024-09-19T12:03:05.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.HHw4kt5e1BNDtqGkSh9xjf-h6tgAkqZ_0 2024-09-19T12:03:05.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2972889643079592615', time=2024-09-19T13:55:49.468973+0000, chain.objs.size()=1 2024-09-19T12:03:05.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.F8VEMz3zuRyW92U-a1WkbUp0g2fAthK_0 2024-09-19T12:03:05.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10609952023856568537', time=2024-09-19T13:55:49.471533+0000, chain.objs.size()=1 2024-09-19T12:03:05.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.cOJMj_IFrcR3IupS7jJhtUNSbXh2L4H_0 2024-09-19T12:03:05.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7449103150946779649', time=2024-09-19T13:56:25.398261+0000, chain.objs.size()=1 2024-09-19T12:03:05.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.j8d8TRd1FsbwVNpH7QDfFx8PNkoFWzl_0 2024-09-19T12:03:05.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7741918956637130505', time=2024-09-19T13:56:27.372856+0000, chain.objs.size()=1 2024-09-19T12:03:05.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.jZnGp9dTpdgunQmgkTm09P6w9zYJSID_0 2024-09-19T12:03:05.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9603005532711665027', time=2024-09-19T13:56:27.379738+0000, chain.objs.size()=1 2024-09-19T12:03:05.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.2aACoJHKMJm9ubg5XU_pKp2Gb5WUz1P_0 2024-09-19T12:03:05.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5632889741458194567', time=2024-09-19T13:57:01.467464+0000, chain.objs.size()=1 2024-09-19T12:03:05.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.r8mOJtggNVnn1StQyuXwLcUmz6ApZPD_0 2024-09-19T12:03:05.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12216073443217363950', time=2024-09-19T13:57:04.526761+0000, chain.objs.size()=1 2024-09-19T12:03:05.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.gJpqHod2AYBiGNqxt7zWSZRgUdJU9J5_0 2024-09-19T12:03:05.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8710556429866182170', time=2024-09-19T13:57:38.002356+0000, chain.objs.size()=1 2024-09-19T12:03:05.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.gPDdGRteVQpuv8pg1yToT2Toky-HibY_0 2024-09-19T12:03:05.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7700668642643148233', time=2024-09-19T13:57:40.931011+0000, chain.objs.size()=1 2024-09-19T12:03:05.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.595+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.00UtMU-YpLgy1hCj6SKXSis7ANZsqiq_0 2024-09-19T12:03:05.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.599+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13630655532595081472', time=2024-09-19T13:58:56.683836+0000, chain.objs.size()=1 2024-09-19T12:03:05.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.599+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.qY_RhVL5FQRe0kNuql9QN-hX2EPKIN1_0 2024-09-19T12:03:05.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.599+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3967515799569852581', time=2024-09-19T13:59:32.837784+0000, chain.objs.size()=1 2024-09-19T12:03:05.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.599+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.Toj_5il-_-O8uWQO7_jj-GAP2A1Qr5Q_0 2024-09-19T12:03:05.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.599+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6082744174241860622', time=2024-09-19T14:00:06.319252+0000, chain.objs.size()=1 2024-09-19T12:03:05.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.599+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.ADGWKf94NWKc3065p4OkGDLIiRQnDoK_0 2024-09-19T12:03:05.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.603+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.607+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T12:03:05.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.607+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.607+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.607+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-19T12:03:05.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.607+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8170570713716948334', time=2024-09-19T13:55:10.184781+0000, chain.objs.size()=1 2024-09-19T12:03:05.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.607+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.GumG9IUtg32GoL1Tl1rFBluQbFghXXh_0 2024-09-19T12:03:05.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.607+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5015568790898401860', time=2024-09-19T13:55:49.457132+0000, chain.objs.size()=1 2024-09-19T12:03:05.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.607+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.QrENdHjRsfOYJ2TnrlGm7CbStau65zi_0 2024-09-19T12:03:05.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.607+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.53326731265702', time=2024-09-19T13:55:49.482470+0000, chain.objs.size()=1 2024-09-19T12:03:05.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.607+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.fTRc3ojNZYiRz3b_nDoQEBezXZdjWBR_0 2024-09-19T12:03:05.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.607+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3986333117670375273', time=2024-09-19T13:56:22.561202+0000, chain.objs.size()=1 2024-09-19T12:03:05.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.607+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.qQdlVcq8jJfIFkMEh3wfdiONmN9ZklJ_0 2024-09-19T12:03:05.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7489360544483761970', time=2024-09-19T13:56:25.415109+0000, chain.objs.size()=1 2024-09-19T12:03:05.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.xP3WxLZc8RRLyy0OQyVNdABn9qzqBCP_0 2024-09-19T12:03:05.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10689650861690847246', time=2024-09-19T13:56:27.379312+0000, chain.objs.size()=1 2024-09-19T12:03:05.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.6sKUmoymNYM7v0bGEAxQc_7KZaZEfoQ_0 2024-09-19T12:03:05.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18288687649514241003', time=2024-09-19T13:57:04.519316+0000, chain.objs.size()=1 2024-09-19T12:03:05.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.dso0q_AQNV8ouuetNHWWlqZ1jwUxibK_0 2024-09-19T12:03:05.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11671372503273201372', time=2024-09-19T13:57:40.915670+0000, chain.objs.size()=1 2024-09-19T12:03:05.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.4Um05wwtcKe1yb9Bwua352CknVnKM3w_0 2024-09-19T12:03:05.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.626645642342341753', time=2024-09-19T13:58:18.466910+0000, chain.objs.size()=1 2024-09-19T12:03:05.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.x9SnG0Ce59vqb2_i-ObfTFpDPLPQt-a_0 2024-09-19T12:03:05.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6081325217612457748', time=2024-09-19T13:58:54.767158+0000, chain.objs.size()=1 2024-09-19T12:03:05.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.5HBUkE1YNtmvSKn_3KVaQA2LgkU5QPv_0 2024-09-19T12:03:05.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17760050148252038518', time=2024-09-19T13:58:54.786925+0000, chain.objs.size()=1 2024-09-19T12:03:05.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.n7muJRSeSRZ2MfbEIHMOkc-8oWFwQgE_0 2024-09-19T12:03:05.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5274728228599630099', time=2024-09-19T13:58:54.789065+0000, chain.objs.size()=1 2024-09-19T12:03:05.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.611+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.FBHEKZgxCuRl7jkJ6lFHYw8AU9mIRSL_0 2024-09-19T12:03:05.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.615+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1769060157919067040', time=2024-09-19T13:59:28.000695+0000, chain.objs.size()=1 2024-09-19T12:03:05.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.615+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.D_FV6E8e2F0f227VNl3E6hiIyqcVfzR_0 2024-09-19T12:03:05.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.615+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17068031482535720993', time=2024-09-19T13:59:28.019180+0000, chain.objs.size()=1 2024-09-19T12:03:05.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.615+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.JqvuFvI4uaw4PVQmMg4hXdUzUwsunmH_0 2024-09-19T12:03:05.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.615+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17825467287727820269', time=2024-09-19T13:59:28.027376+0000, chain.objs.size()=1 2024-09-19T12:03:05.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.615+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.995bbZdoSiq73_UyGm6Usyp89kE1ldU_0 2024-09-19T12:03:05.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.619+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T12:03:05.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-19T12:03:05.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10776783807071268820', time=2024-09-19T13:53:48.308509+0000, chain.objs.size()=1 2024-09-19T12:03:05.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.sCLAP6VMHBMougbWQGLiCwC3am6Dx9w_0 2024-09-19T12:03:05.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5001852003271602429', time=2024-09-19T13:55:11.904090+0000, chain.objs.size()=1 2024-09-19T12:03:05.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.EKWIbBsUKeZB0GHMbDo90G6Hfowfxv3_0 2024-09-19T12:03:05.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14973005241631470337', time=2024-09-19T13:55:11.923432+0000, chain.objs.size()=1 2024-09-19T12:03:05.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.0YO8DA8OEdgZ3Qcd1DVRgg3bq6CmSjt_0 2024-09-19T12:03:05.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12688926388221298052', time=2024-09-19T13:56:22.547072+0000, chain.objs.size()=1 2024-09-19T12:03:05.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.qbLmmEJStBhaFewzyvX0OfHd-7-V69R_0 2024-09-19T12:03:05.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9890172458720088631', time=2024-09-19T13:56:27.390224+0000, chain.objs.size()=1 2024-09-19T12:03:05.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.Wz8Xb7Y7Xk4S-g8iBtOUax0vYq3HWd__0 2024-09-19T12:03:05.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2460446971019549316', time=2024-09-19T13:57:01.470588+0000, chain.objs.size()=1 2024-09-19T12:03:05.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.GQYcgiyPjVf6bQwHyyTBfOO5solCcUn_0 2024-09-19T12:03:05.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17949188903443597723', time=2024-09-19T13:57:42.670751+0000, chain.objs.size()=1 2024-09-19T12:03:05.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.DPPSng5vRKQsZ6ATvt3YKPDutj5CzbN_0 2024-09-19T12:03:05.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10061389401352576109', time=2024-09-19T13:57:42.680954+0000, chain.objs.size()=1 2024-09-19T12:03:05.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.VVmweLGD_P0-4u746CQ8XCTtnRKpyVa_0 2024-09-19T12:03:05.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17734713349490874244', time=2024-09-19T13:58:15.739225+0000, chain.objs.size()=1 2024-09-19T12:03:05.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.5Xzrr7tn_QnZM7zGPZcXQSOOhvG2GUF_0 2024-09-19T12:03:05.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.691092695733440302', time=2024-09-19T14:00:06.315467+0000, chain.objs.size()=1 2024-09-19T12:03:05.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.623+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.auBncpFrytKYTKPv0DrlvTfN7QwHeV1_0 2024-09-19T12:03:05.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.627+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.631+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T12:03:05.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-19T12:03:05.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8752321149676208315', time=2024-09-19T13:53:48.323398+0000, chain.objs.size()=1 2024-09-19T12:03:05.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.sCLAP6VMHBMougbWQGLiCwC3am6Dx9w_0 2024-09-19T12:03:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15089475212177110877', time=2024-09-19T13:55:10.164200+0000, chain.objs.size()=1 2024-09-19T12:03:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.V8Vc2Ro6Jy_oLcr9ZxCgF0oMNVHGnCB_0 2024-09-19T12:03:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.96299546769605766', time=2024-09-19T13:55:11.900948+0000, chain.objs.size()=1 2024-09-19T12:03:05.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.5mIZgf5_M4TyVMFlMoFL-482mNBtst8_0 2024-09-19T12:03:05.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16847622747758565339', time=2024-09-19T13:55:44.881529+0000, chain.objs.size()=1 2024-09-19T12:03:05.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.oVEE1Gsj0onuMivTGQPqV-3QNdz1Toz_0 2024-09-19T12:03:05.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15492796475557077634', time=2024-09-19T13:57:01.461800+0000, chain.objs.size()=1 2024-09-19T12:03:05.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.MF0d79w5ccedVaoXuZw_ewKwOYDtc6q_0 2024-09-19T12:03:05.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2182489295759323290', time=2024-09-19T13:57:01.481388+0000, chain.objs.size()=1 2024-09-19T12:03:05.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.vEA49JNwaIzE8vqGHa0AZ2pnMRZckQu_0 2024-09-19T12:03:05.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12348031146228489825', time=2024-09-19T13:57:37.990416+0000, chain.objs.size()=1 2024-09-19T12:03:05.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.AriwlwJfymZd_3Dw0SmVQNbjb7tXx6I_0 2024-09-19T12:03:05.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12551628446440867344', time=2024-09-19T13:57:37.997523+0000, chain.objs.size()=1 2024-09-19T12:03:05.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.hQvvayfPY9ZDUS75zBHvnXOd7nES722_0 2024-09-19T12:03:05.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15360757865466384984', time=2024-09-19T13:57:40.923166+0000, chain.objs.size()=1 2024-09-19T12:03:05.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.b0_Ax9RodqTSJP3V_oRSNJP_wFFOWr6_0 2024-09-19T12:03:05.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12767542522899637786', time=2024-09-19T13:57:42.679232+0000, chain.objs.size()=1 2024-09-19T12:03:05.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.WYftw2_4EMIRvNKVCVQUMov9JpXQ2IS_0 2024-09-19T12:03:05.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11260288049377674030', time=2024-09-19T13:59:30.671285+0000, chain.objs.size()=1 2024-09-19T12:03:05.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.OhZ5oVKGvWJAM1yvMmuO_Sir_IEb1mY_0 2024-09-19T12:03:05.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17152810982169548613', time=2024-09-19T13:59:30.682119+0000, chain.objs.size()=1 2024-09-19T12:03:05.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.635+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.sXt-Bp2_Vf3n0a9FyZ4-NKFddAf28-Z_0 2024-09-19T12:03:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.639+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2337409484523134490', time=2024-09-19T13:59:32.864218+0000, chain.objs.size()=1 2024-09-19T12:03:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.639+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.qDwDkR_TiZe_dfpnUM798Iu6nR8jP5S_0 2024-09-19T12:03:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.643+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T12:03:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-19T12:03:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17211878138900459972', time=2024-09-19T13:53:48.069553+0000, chain.objs.size()=1 2024-09-19T12:03:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.z4y_Q7QQ7WIh2X4y5xNPsluL3pf31tZ_0 2024-09-19T12:03:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9894666824978412235', time=2024-09-19T13:53:48.868719+0000, chain.objs.size()=1 2024-09-19T12:03:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9__shadow_.c1-GcVxBAZkaPbKiJ-PgnTH9RTVte9P_0 2024-09-19T12:03:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14856024576150551902', time=2024-09-19T13:53:48.893707+0000, chain.objs.size()=1 2024-09-19T12:03:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9__shadow_.SUgfTJy5t0uTc6f_RuGu6uWlysswMF1_0 2024-09-19T12:03:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5464181102977467326', time=2024-09-19T13:55:10.157838+0000, chain.objs.size()=1 2024-09-19T12:03:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.ATqBdRqcG_SdGnhI7H-dMF_M6iJDTaH_0 2024-09-19T12:03:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13150701293222725892', time=2024-09-19T13:55:10.181562+0000, chain.objs.size()=1 2024-09-19T12:03:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.0Gol8cb2Bnopbws7ds_gXdZlLxxsXzF_0 2024-09-19T12:03:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13813311954588835089', time=2024-09-19T13:55:44.869179+0000, chain.objs.size()=1 2024-09-19T12:03:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.yM1GbACco-5KiNomwiuk1cE3JLyYMXD_0 2024-09-19T12:03:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12685457910846945661', time=2024-09-19T13:55:44.872654+0000, chain.objs.size()=1 2024-09-19T12:03:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.u0zKyeEfLUOR10PXKzArNc9_dVF_Nm3_0 2024-09-19T12:03:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7451549005785366646', time=2024-09-19T13:56:22.549283+0000, chain.objs.size()=1 2024-09-19T12:03:05.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.eWCYkg4Y3iJdLMKs3ouon-Zx5BY5r3k_0 2024-09-19T12:03:05.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13404269788656748366', time=2024-09-19T13:57:01.487707+0000, chain.objs.size()=1 2024-09-19T12:03:05.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.osY9YrQlVXfJ6KZYcvlro__Kd013TkW_0 2024-09-19T12:03:05.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17203594140870005121', time=2024-09-19T13:57:38.031872+0000, chain.objs.size()=1 2024-09-19T12:03:05.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.8HOT0aadUuCzmBrlnBePQJkkEpIG29d_0 2024-09-19T12:03:05.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14583928181252091158', time=2024-09-19T13:59:30.666743+0000, chain.objs.size()=1 2024-09-19T12:03:05.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.647+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.4d2VD7AZlUUF1NqY2-dfAfldDtSuXnz_0 2024-09-19T12:03:05.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.655+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.655+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T12:03:05.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-19T12:03:05.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='_23ai2yN19tr2cHIWJx0JxUIct5ghR_e', time=2024-09-19T13:53:48.344734+0000, chain.objs.size()=1 2024-09-19T12:03:05.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.LwPmFQxrMqR7velArccMGHK2bkx_LjY_0 2024-09-19T12:03:05.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14051904962987977190', time=2024-09-19T13:55:11.911982+0000, chain.objs.size()=1 2024-09-19T12:03:05.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.cYPuKUKZmv8CoYRhhlzPelJrX0qeDMu_0 2024-09-19T12:03:05.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9203938087621763178', time=2024-09-19T13:55:49.467839+0000, chain.objs.size()=1 2024-09-19T12:03:05.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.tWzY0qGRb7B7j38mn2yynysYG_2rfeY_0 2024-09-19T12:03:05.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17913444112738802688', time=2024-09-19T13:56:27.378312+0000, chain.objs.size()=1 2024-09-19T12:03:05.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.xbVhAMFP9ZQPoya-n_lsvbekVhnbgLs_0 2024-09-19T12:03:05.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15319098351703551309', time=2024-09-19T13:57:42.667441+0000, chain.objs.size()=1 2024-09-19T12:03:05.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.azsiN3IXdkjZD1uoNMC6n8_2mlZtDEt_0 2024-09-19T12:03:05.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17477054065411193615', time=2024-09-19T13:58:18.473159+0000, chain.objs.size()=1 2024-09-19T12:03:05.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.Ah4641pnOb0hC8ujp33uWdz_90GckZY_0 2024-09-19T12:03:05.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1744578502428339596', time=2024-09-19T13:58:51.928889+0000, chain.objs.size()=1 2024-09-19T12:03:05.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.i7bWa878wuGPoZNVKciCtX2kWVXxwJw_0 2024-09-19T12:03:05.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15059592653176764997', time=2024-09-19T13:59:30.682422+0000, chain.objs.size()=1 2024-09-19T12:03:05.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.zzFxUfo2_XVq_-tgCR5XPeSYIUCjb4F_0 2024-09-19T12:03:05.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8755412996273596307', time=2024-09-19T13:59:30.688085+0000, chain.objs.size()=1 2024-09-19T12:03:05.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.gauod9RrzOjWpQ_fPcdIDpO79o4mv-f_0 2024-09-19T12:03:05.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11360139959184344079', time=2024-09-19T14:00:06.299572+0000, chain.objs.size()=1 2024-09-19T12:03:05.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.B_Cdx3nUSk3rKWLXJ4VDlcBkxytDQ_J_0 2024-09-19T12:03:05.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8671780661316822169', time=2024-09-19T14:02:17.790998+0000, chain.objs.size()=1 2024-09-19T12:03:05.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18__shadow_.Lk4nYu7Eb5_EEUZha-4BlV8ATw0BJMq_0 2024-09-19T12:03:05.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2839261008620894758', time=2024-09-19T14:02:32.614701+0000, chain.objs.size()=1 2024-09-19T12:03:05.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.659+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19__shadow:mFn-GwUryEfcXoeUAsddM6Z4LTK8tUT_.bW8Dx79-k4e90DBzOTnPIn69lVFv6S1_0 2024-09-19T12:03:05.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.667+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T12:03:05.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-19T12:03:05.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7858973728063681064', time=2024-09-19T13:53:48.822006+0000, chain.objs.size()=1 2024-09-19T12:03:05.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8__shadow_.rOgMAZs_yQQ8MPTIr5aju2o7n-MilnB_0 2024-09-19T12:03:05.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13994774608998238284', time=2024-09-19T13:55:11.903407+0000, chain.objs.size()=1 2024-09-19T12:03:05.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.v83mibjrGo0GgtbcUTPNy8KsOF6w311_0 2024-09-19T12:03:05.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17556109666729752528', time=2024-09-19T13:55:44.895338+0000, chain.objs.size()=1 2024-09-19T12:03:05.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.JYmXex3I-NV_fWc8OKDN8aRQsM5dG4S_0 2024-09-19T12:03:05.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12950711078653972808', time=2024-09-19T13:55:49.470095+0000, chain.objs.size()=1 2024-09-19T12:03:05.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.dITPH0-ZNTq_0Ohf7IcDdT2V-IPDHQT_0 2024-09-19T12:03:05.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3478960898192727323', time=2024-09-19T13:56:22.557307+0000, chain.objs.size()=1 2024-09-19T12:03:05.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.iuJwEDaeKfebbOtrIZTDWQTqTqxD1tD_0 2024-09-19T12:03:05.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16491988039768163703', time=2024-09-19T13:56:27.404963+0000, chain.objs.size()=1 2024-09-19T12:03:05.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.4JGMyygP8EWqZaHwG8ceBC4WIQ6lIgT_0 2024-09-19T12:03:05.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13960559068398611750', time=2024-09-19T13:57:01.487371+0000, chain.objs.size()=1 2024-09-19T12:03:05.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.oPa2pkT0d51rJuWXSXFUmOCreM-reAt_0 2024-09-19T12:03:05.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5948923568275150930', time=2024-09-19T13:57:04.535624+0000, chain.objs.size()=1 2024-09-19T12:03:05.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.CDfIyi-HFITRNNJMYxtLYGQJ9bNGMIB_0 2024-09-19T12:03:05.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1272131205227490829', time=2024-09-19T13:57:38.025225+0000, chain.objs.size()=1 2024-09-19T12:03:05.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.jTsnvm7bx6RkJc3H0Ff53cOdRGr_89n_0 2024-09-19T12:03:05.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4714157958244469998', time=2024-09-19T13:58:15.759412+0000, chain.objs.size()=1 2024-09-19T12:03:05.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.hgNQT5Hav-eakHxtYACVA43aU7qDLKl_0 2024-09-19T12:03:05.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3271108091754928837', time=2024-09-19T13:58:18.446848+0000, chain.objs.size()=1 2024-09-19T12:03:05.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.5Ns6_p8WFP5HFlaJdCtqQoibet57b3j_0 2024-09-19T12:03:05.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2125601572813282489', time=2024-09-19T13:58:18.469395+0000, chain.objs.size()=1 2024-09-19T12:03:05.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.671+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.QYctEz15RRKMGUH0GMKBlQNq7VwN8ti_0 2024-09-19T12:03:05.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.675+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10727597164632686938', time=2024-09-19T13:58:51.925562+0000, chain.objs.size()=1 2024-09-19T12:03:05.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.675+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.i6juOSFNsbf1PxoAQPhk63lONsqXbyx_0 2024-09-19T12:03:05.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.675+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18228460541888579000', time=2024-09-19T13:59:32.842469+0000, chain.objs.size()=1 2024-09-19T12:03:05.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.675+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.L6QkqRq214xK7H2muEw5fyfsowK_TJb_0 2024-09-19T12:03:05.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.675+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2032924610198053653', time=2024-09-19T13:59:32.854828+0000, chain.objs.size()=1 2024-09-19T12:03:05.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.675+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.Cjee54tXegwIJ0jRe4k61LoB7PQWzHj_0 2024-09-19T12:03:05.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.679+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10974777606433774624', time=2024-09-19T14:00:06.300229+0000, chain.objs.size()=1 2024-09-19T12:03:05.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.679+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.441L0YGfGZSnYexKemup6XPUIHyzIum_0 2024-09-19T12:03:05.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.679+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5045328764130389141', time=2024-09-19T14:00:06.302152+0000, chain.objs.size()=1 2024-09-19T12:03:05.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.679+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.jM57MN21c5DRGAk0rHL6qQO1qTiyblU_0 2024-09-19T12:03:05.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.683+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T12:03:05.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-19T12:03:05.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11139671296259530201', time=2024-09-19T13:53:48.523838+0000, chain.objs.size()=3 2024-09-19T12:03:05.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-LUKEWARM.2~HMaHS1yrkg-dPeOgovydO5e43SdsNSD.1 2024-09-19T12:03:05.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-LUKEWARM.2~HMaHS1yrkg-dPeOgovydO5e43SdsNSD.2 2024-09-19T12:03:05.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-LUKEWARM.2~HMaHS1yrkg-dPeOgovydO5e43SdsNSD.3 2024-09-19T12:03:05.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17585342308340452523', time=2024-09-19T13:55:47.691094+0000, chain.objs.size()=1 2024-09-19T12:03:05.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.D4hpkMWUgklHmV3uAEdZVpdzzdZnXn6_0 2024-09-19T12:03:05.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3534686295108516462', time=2024-09-19T13:55:47.701894+0000, chain.objs.size()=1 2024-09-19T12:03:05.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.p0ZtAuUlZmzZebi9PTcnYx3wIZBrbrX_0 2024-09-19T12:03:05.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9524432633659962348', time=2024-09-19T13:55:49.458146+0000, chain.objs.size()=1 2024-09-19T12:03:05.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.a07A7PMTdyipQbU6_gpZjK-WvFG1NgK_0 2024-09-19T12:03:05.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16289555563129064685', time=2024-09-19T13:55:49.473690+0000, chain.objs.size()=1 2024-09-19T12:03:05.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.VDjgB3cUqxsrWuWUVLZyZBmlfGM1vC5_0 2024-09-19T12:03:05.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12579630847319489552', time=2024-09-19T13:56:22.528497+0000, chain.objs.size()=1 2024-09-19T12:03:05.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.yNOS-DePSHqeFob81s63g8BpHD5eeI9_0 2024-09-19T12:03:05.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17003909706743254254', time=2024-09-19T13:56:22.543344+0000, chain.objs.size()=1 2024-09-19T12:03:05.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.e4E5SE0WdlJ5YsfLLNLLHosLIS2oR8F_0 2024-09-19T12:03:05.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.193468236365118275', time=2024-09-19T13:56:27.378607+0000, chain.objs.size()=1 2024-09-19T12:03:05.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.zCgiSpYQLPE-Xrr8wwRdq971O-ptB7A_0 2024-09-19T12:03:05.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8695699830603863523', time=2024-09-19T13:57:37.985431+0000, chain.objs.size()=1 2024-09-19T12:03:05.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.1B5IRL5wPxrnAo8JCZJzkxVnGt4jBa7_0 2024-09-19T12:03:05.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12673284503878295471', time=2024-09-19T13:57:42.676976+0000, chain.objs.size()=1 2024-09-19T12:03:05.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.687+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.pItMyUG-MfTjG6rLdYMzQKSoaMZ5O77_0 2024-09-19T12:03:05.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.691+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15212476264180840105', time=2024-09-19T13:58:15.761393+0000, chain.objs.size()=1 2024-09-19T12:03:05.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.691+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.-a9niprk4w3qUXD13mcwYC9rKdFKPUS_0 2024-09-19T12:03:05.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.691+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10013602218386767508', time=2024-09-19T13:58:51.941475+0000, chain.objs.size()=1 2024-09-19T12:03:05.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.691+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.NY7r_wnIa7Nz4Xy1NVyIHWQ461EMpkN_0 2024-09-19T12:03:05.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.695+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17253952489620817369', time=2024-09-19T13:59:28.013563+0000, chain.objs.size()=1 2024-09-19T12:03:05.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.695+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.DPx1bNSEQ_T2L-LTaG9bzhahBi02Jzu_0 2024-09-19T12:03:05.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.695+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.699+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T12:03:05.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-19T12:03:05.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8236562369693953881', time=2024-09-19T13:53:48.083493+0000, chain.objs.size()=1 2024-09-19T12:03:05.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.Jsd6hyDAaECy6Q3WlBGpjDQyLffhPei_0 2024-09-19T12:03:05.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1307120017790267215', time=2024-09-19T13:53:48.099909+0000, chain.objs.size()=1 2024-09-19T12:03:05.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.FoWJYzMFQzOcEipL6teuTGaCLTpRLBa_0 2024-09-19T12:03:05.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='_4XBjDffPZnwR0K8-3xHC4arcXXDzHQc', time=2024-09-19T13:53:48.419206+0000, chain.objs.size()=1 2024-09-19T12:03:05.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.KnhJrUUsuKrSV-0OlMYyIdXoHP4lG9d_0 2024-09-19T12:03:05.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3753043501227799044', time=2024-09-19T13:53:48.697729+0000, chain.objs.size()=2 2024-09-19T12:03:05.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14__shadow_.un1yzyEsIKhTxJSNgr1_eKHidJja6Jm_0 2024-09-19T12:03:05.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14__shadow_.un1yzyEsIKhTxJSNgr1_eKHidJja6Jm_1 2024-09-19T12:03:05.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18050979561626850643', time=2024-09-19T13:55:44.883406+0000, chain.objs.size()=1 2024-09-19T12:03:05.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.dVkReciKsBtEF6rKEkMDgv-nwHJ7bqA_0 2024-09-19T12:03:05.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1892197752296598914', time=2024-09-19T13:55:47.699802+0000, chain.objs.size()=1 2024-09-19T12:03:05.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.cCxtnxzClH2gkqQV8QCB9BOMgfmqaKh_0 2024-09-19T12:03:05.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15893528841240766711', time=2024-09-19T13:55:47.713397+0000, chain.objs.size()=1 2024-09-19T12:03:05.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.RNBb9hBEXPSsaA3R32Fb3ltbb48TmS9_0 2024-09-19T12:03:05.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9879797325680889223', time=2024-09-19T13:57:04.543920+0000, chain.objs.size()=1 2024-09-19T12:03:05.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.VyjSfBF4pafkLi4rc3IOq60iP-5rVRh_0 2024-09-19T12:03:05.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15414542613467690347', time=2024-09-19T13:57:38.025003+0000, chain.objs.size()=1 2024-09-19T12:03:05.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.WbtmRKVBCzPnSuyHH5iCQXmsf1Mq0g4_0 2024-09-19T12:03:05.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2782766467237809627', time=2024-09-19T13:57:40.906696+0000, chain.objs.size()=1 2024-09-19T12:03:05.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.rZDv9QzAgJO9ajvZ7RQhgM4toxxYFXR_0 2024-09-19T12:03:05.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6337124222982108126', time=2024-09-19T13:57:42.662434+0000, chain.objs.size()=1 2024-09-19T12:03:05.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.703+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.wPFxffw3fFOvDZ5TFfm_EH2GVnUdTez_0 2024-09-19T12:03:05.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.707+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1881728389085022319', time=2024-09-19T13:57:42.665789+0000, chain.objs.size()=1 2024-09-19T12:03:05.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.707+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.e3rFKC7OW5yvOgCoAHVg85tVYrpA2S-_0 2024-09-19T12:03:05.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.707+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1053775538866033048', time=2024-09-19T13:58:18.455123+0000, chain.objs.size()=1 2024-09-19T12:03:05.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.707+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.WaZ3ZX7H4kYXL0JlLLY-NHTXiwLvmAT_0 2024-09-19T12:03:05.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.707+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10365874907042773322', time=2024-09-19T13:58:51.934500+0000, chain.objs.size()=1 2024-09-19T12:03:05.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.707+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.LCoHzAnzNpY7-I1I7qxeb8Xk3BKfsLU_0 2024-09-19T12:03:05.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.707+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8027667692673812956', time=2024-09-19T13:58:54.785805+0000, chain.objs.size()=1 2024-09-19T12:03:05.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.707+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.dUr3ny9PAwRzWGkTT6rhLwEQGEnnxa7_0 2024-09-19T12:03:05.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.707+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16407686593062694766', time=2024-09-19T13:58:54.792999+0000, chain.objs.size()=1 2024-09-19T12:03:05.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.707+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.Z0m4k1ffPFhOFHaMpm2P27nMYbgmP1P_0 2024-09-19T12:03:05.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.707+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4191885946827892211', time=2024-09-19T13:59:30.697550+0000, chain.objs.size()=1 2024-09-19T12:03:05.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.707+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.6NYxa0zknyOttgajCJB1tfoPc0y2585_0 2024-09-19T12:03:05.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.711+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15292700631883526033', time=2024-09-19T14:00:06.308653+0000, chain.objs.size()=1 2024-09-19T12:03:05.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.711+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.Rd3iS291QWnmaXzfZalC-aIIhqjgFdf_0 2024-09-19T12:03:05.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.715+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.715+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T12:03:05.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-19T12:03:05.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1352402708417602848', time=2024-09-19T13:53:48.609589+0000, chain.objs.size()=3 2024-09-19T12:03:05.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-FROZEN.2~tWV1KYcW1lmhFoxy9X6py72XiZ_oDBO.1 2024-09-19T12:03:05.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-FROZEN.2~tWV1KYcW1lmhFoxy9X6py72XiZ_oDBO.2 2024-09-19T12:03:05.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-FROZEN.2~tWV1KYcW1lmhFoxy9X6py72XiZ_oDBO.3 2024-09-19T12:03:05.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6639842939247012796', time=2024-09-19T13:55:10.156720+0000, chain.objs.size()=1 2024-09-19T12:03:05.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.YynIhZ996Gm_WHfn4M5x1nFOB2OoKez_0 2024-09-19T12:03:05.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10020324882655286038', time=2024-09-19T13:55:10.179281+0000, chain.objs.size()=1 2024-09-19T12:03:05.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.UtJ7fmbul9kL3XEth50ko6PpVoGMX_c_0 2024-09-19T12:03:05.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3228812353065354411', time=2024-09-19T13:55:47.714198+0000, chain.objs.size()=1 2024-09-19T12:03:05.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.m6VzkcMxPr-Tmxz7bW_40JqzKj5nZPQ_0 2024-09-19T12:03:05.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.830885786077872975', time=2024-09-19T13:56:25.387633+0000, chain.objs.size()=1 2024-09-19T12:03:05.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.jpZ8uV4UkN8vTVvIUsYdfohDitL1RPy_0 2024-09-19T12:03:05.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3140907602464575578', time=2024-09-19T13:56:25.398791+0000, chain.objs.size()=1 2024-09-19T12:03:05.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.Wtb-TB-Ore_5y7meQ9qE4oDBLGWwGtv_0 2024-09-19T12:03:05.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3027129689094473479', time=2024-09-19T13:56:27.402885+0000, chain.objs.size()=1 2024-09-19T12:03:05.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.OrOulw6m5T4Yf2jetow4ArKsT3drEZD_0 2024-09-19T12:03:05.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8840942022958081764', time=2024-09-19T13:57:40.887008+0000, chain.objs.size()=1 2024-09-19T12:03:05.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.t3knINbzFCjd7xvQGHpcYcE34fLzbhc_0 2024-09-19T12:03:05.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6333414922759422250', time=2024-09-19T13:57:40.894222+0000, chain.objs.size()=1 2024-09-19T12:03:05.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.ImY_x3xF4mcnddDxtX96E8jTayglCmQ_0 2024-09-19T12:03:05.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10143758978125396328', time=2024-09-19T13:58:18.439201+0000, chain.objs.size()=1 2024-09-19T12:03:05.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.719+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.30-OnX3RdXv9VEbuQE3-nCxcE5ROvE7_0 2024-09-19T12:03:05.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.723+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12376243551176427709', time=2024-09-19T13:59:28.002321+0000, chain.objs.size()=1 2024-09-19T12:03:05.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.723+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.cE1ICEwNYCJkqv-QhefqZSuPRU98p6-_0 2024-09-19T12:03:05.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.723+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9842677812561022208', time=2024-09-19T13:59:30.688635+0000, chain.objs.size()=1 2024-09-19T12:03:05.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.723+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.bFWH2AspIXa1lEZVh0abNbffmqc8EdL_0 2024-09-19T12:03:05.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.723+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2925780093144276317', time=2024-09-19T14:02:17.786762+0000, chain.objs.size()=1 2024-09-19T12:03:05.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.723+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18__shadow_.d6Cch5mnzbodlrcjJzZX_a1yuHoRuV7_0 2024-09-19T12:03:05.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.727+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T12:03:05.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-19T12:03:05.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3956694997909108924', time=2024-09-19T13:53:48.108351+0000, chain.objs.size()=1 2024-09-19T12:03:05.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.n51e8Xxo99g7b8OmWbi6hWBs0Ux5TAx_0 2024-09-19T12:03:05.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17504625535963880513', time=2024-09-19T13:55:44.882106+0000, chain.objs.size()=1 2024-09-19T12:03:05.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.EHwPDzTR0lcXWTfB-PCRY7LdtIucc_2_0 2024-09-19T12:03:05.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4857816882267108170', time=2024-09-19T13:55:44.888100+0000, chain.objs.size()=1 2024-09-19T12:03:05.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.IqerH0hdTzTTZN3REH9s5cAcEGnsLOU_0 2024-09-19T12:03:05.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6178029559627469008', time=2024-09-19T13:55:47.699659+0000, chain.objs.size()=1 2024-09-19T12:03:05.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.pFA8eemBjgcj7cnIe1Xvv_6Yto3Dnk7_0 2024-09-19T12:03:05.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17744740928909226067', time=2024-09-19T13:55:49.475774+0000, chain.objs.size()=1 2024-09-19T12:03:05.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.THwN1MSAIBDMHupCrlUxAoHZZoB5ycd_0 2024-09-19T12:03:05.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16288345702176269062', time=2024-09-19T13:56:22.559459+0000, chain.objs.size()=1 2024-09-19T12:03:05.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.q_h9fUNxqT4oEs2AZAaSng29VzIwQR-_0 2024-09-19T12:03:05.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13067847126530151252', time=2024-09-19T13:57:01.464552+0000, chain.objs.size()=1 2024-09-19T12:03:05.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.qPX1ioHq0VuDmVB8WbR8RROsYqv273i_0 2024-09-19T12:03:05.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6959125569174482821', time=2024-09-19T13:57:42.656922+0000, chain.objs.size()=1 2024-09-19T12:03:05.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.0oa8mAsTT1lDXjsK7mwA8S1jW-Zlua2_0 2024-09-19T12:03:05.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14415776518488887609', time=2024-09-19T13:58:51.926631+0000, chain.objs.size()=1 2024-09-19T12:03:05.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.cnv-HROWvIV8qswKnX7A1h604kTCPYD_0 2024-09-19T12:03:05.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6270058662158485933', time=2024-09-19T13:59:30.683671+0000, chain.objs.size()=1 2024-09-19T12:03:05.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.3rnAeVDAY9IoRRZeWyQYOR4Drevkr-L_0 2024-09-19T12:03:05.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17251289990641530826', time=2024-09-19T13:59:30.703007+0000, chain.objs.size()=1 2024-09-19T12:03:05.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.PHAqr0qEWVo2k8DBs458aeFTKCZ8Jf1_0 2024-09-19T12:03:05.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.196178300331938315', time=2024-09-19T13:59:32.840382+0000, chain.objs.size()=1 2024-09-19T12:03:05.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.731+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.yarHtnWlMK-sBeZhM_yRY97KsgD_9hd_0 2024-09-19T12:03:05.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.735+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7896219396097676370', time=2024-09-19T14:02:17.791799+0000, chain.objs.size()=1 2024-09-19T12:03:05.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.735+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18__shadow_.lGmqJ57eH8FvQ55UNBI_oUEKM2IM5Xp_0 2024-09-19T12:03:05.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.739+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.739+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T12:03:05.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-19T12:03:05.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='_DwsAK_aOIJYoJ76l_qc_dFHB2ngJQkr', time=2024-09-19T13:53:48.518190+0000, chain.objs.size()=2 2024-09-19T12:03:05.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.KG55moEV7uHKaHgQPwUu0zp8TJfhyPl_0 2024-09-19T12:03:05.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.KG55moEV7uHKaHgQPwUu0zp8TJfhyPl_1 2024-09-19T12:03:05.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15586398448222481202', time=2024-09-19T13:53:48.861933+0000, chain.objs.size()=1 2024-09-19T12:03:05.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9__shadow_.SAW3nvCph_BD5avQ3Vys_CvzizdP_xS_0 2024-09-19T12:03:05.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10408368780566659693', time=2024-09-19T13:55:44.863224+0000, chain.objs.size()=1 2024-09-19T12:03:05.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.5n_9ldas6KvuDpAc4X6oTWzeipslazm_0 2024-09-19T12:03:05.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15830045525923029102', time=2024-09-19T13:56:27.379435+0000, chain.objs.size()=1 2024-09-19T12:03:05.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.oTi5BnWZ2m2g6SxgnXK5AqNHiQZKgp4_0 2024-09-19T12:03:05.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14950164398894444744', time=2024-09-19T13:56:27.413467+0000, chain.objs.size()=1 2024-09-19T12:03:05.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_._azdCxd9rOtM85JlX18gYDJ8pw2PDRu_0 2024-09-19T12:03:05.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5220899596426567681', time=2024-09-19T13:56:29.545026+0000, chain.objs.size()=1 2024-09-19T12:03:05.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.bPaDqVRsUFdfjGAs328Tk1_eUDGJZQx_0 2024-09-19T12:03:05.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3493600181146687829', time=2024-09-19T13:57:06.448081+0000, chain.objs.size()=1 2024-09-19T12:03:05.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.6a2ORZ1SZMI9hnTtwC0JAN3QQzuKnlw_0 2024-09-19T12:03:05.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1793522719983266861', time=2024-09-19T13:57:38.010560+0000, chain.objs.size()=1 2024-09-19T12:03:05.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.j5rlfbWmRD_SKahE0J0TsUJvuf2Zty9_0 2024-09-19T12:03:05.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11131392995547777159', time=2024-09-19T13:57:40.895875+0000, chain.objs.size()=1 2024-09-19T12:03:05.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.7Ir_GCsyXFb2tlZRcQAf8D7grdFzBnF_0 2024-09-19T12:03:05.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15953131633977217107', time=2024-09-19T13:58:15.749295+0000, chain.objs.size()=1 2024-09-19T12:03:05.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.NGzJC9JTrsPR3VfkO_TW7d95WaRXsd1_0 2024-09-19T12:03:05.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7855725298618246224', time=2024-09-19T13:58:15.752065+0000, chain.objs.size()=1 2024-09-19T12:03:05.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.743+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.OEEPpTvtoFiUiMx6uRLsG850gV6dm0t_0 2024-09-19T12:03:05.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.747+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7076472737820212501', time=2024-09-19T13:59:28.023570+0000, chain.objs.size()=1 2024-09-19T12:03:05.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.747+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.XIUqGuTJC5B1qNu8YPgUWlLuJ7IdBY2_0 2024-09-19T12:03:05.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.747+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12320263933156995624', time=2024-09-19T13:59:30.687938+0000, chain.objs.size()=1 2024-09-19T12:03:05.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.747+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.D5oo0sdfu1eJwgRxLB35tAfwNdISsFP_0 2024-09-19T12:03:05.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.747+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16846961004083924783', time=2024-09-19T13:59:32.840290+0000, chain.objs.size()=1 2024-09-19T12:03:05.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.747+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.RLBWwRpozudG_bB-LXzNxuYjmAHfpW9_0 2024-09-19T12:03:05.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.751+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.755+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T12:03:05.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.755+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.755+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.755+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-19T12:03:05.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.755+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16994008310156519805', time=2024-09-19T13:53:48.092040+0000, chain.objs.size()=1 2024-09-19T12:03:05.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.755+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.2gZi6wpaz1jNjbzIWQ3099J6SFdlGaJ_0 2024-09-19T12:03:05.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.755+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='_miNxIV6Ep8u551wIVyMq0ORQd3-1mvD', time=2024-09-19T13:53:48.558180+0000, chain.objs.size()=2 2024-09-19T12:03:05.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.755+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.HDYaWnfoTA37C9kBxfsH2vYknDt_6wl_0 2024-09-19T12:03:05.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.755+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.HDYaWnfoTA37C9kBxfsH2vYknDt_6wl_1 2024-09-19T12:03:05.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4639692969859554049', time=2024-09-19T13:55:47.698682+0000, chain.objs.size()=1 2024-09-19T12:03:05.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.oXB29Morr4Xx5KpnEbZiiH3NsXld4a6_0 2024-09-19T12:03:05.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16858246767510265635', time=2024-09-19T13:56:25.385798+0000, chain.objs.size()=1 2024-09-19T12:03:05.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.lfZ06TnzGiwMRobdM03BSChTkAL9Mqv_0 2024-09-19T12:03:05.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7363056819320655575', time=2024-09-19T13:56:25.402278+0000, chain.objs.size()=1 2024-09-19T12:03:05.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.8vJPZZ3AjQJjs6OslgxjIqKirPa0rme_0 2024-09-19T12:03:05.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18329476996093468660', time=2024-09-19T13:57:01.467082+0000, chain.objs.size()=1 2024-09-19T12:03:05.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.fhW4G7T_cCxxSOiuojsTwMyOiz4CNWH_0 2024-09-19T12:03:05.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12831940572477899328', time=2024-09-19T13:57:04.524162+0000, chain.objs.size()=1 2024-09-19T12:03:05.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.PPucLHvs7LqZQ9yt0j_SiqvdrxtcN-E_0 2024-09-19T12:03:05.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10378758101566181778', time=2024-09-19T13:57:04.525764+0000, chain.objs.size()=1 2024-09-19T12:03:05.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.-yZGohF5VU-ZFkGgbDRB-v4WqrJw2tK_0 2024-09-19T12:03:05.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14261057589172547469', time=2024-09-19T13:57:04.537462+0000, chain.objs.size()=1 2024-09-19T12:03:05.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.HcgZlln8JpqqsjV_LfJGT92BpCGpAQQ_0 2024-09-19T12:03:05.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15971106975132580312', time=2024-09-19T13:57:38.024689+0000, chain.objs.size()=1 2024-09-19T12:03:05.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.oeWhSMbQVrlKE1NZO9fuE3eZklR8ezq_0 2024-09-19T12:03:05.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13988579366546009260', time=2024-09-19T13:58:15.749096+0000, chain.objs.size()=1 2024-09-19T12:03:05.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.Dgbhja79GLudskAkol6Ib47I6bvPCQU_0 2024-09-19T12:03:05.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8605932522795090612', time=2024-09-19T13:58:18.479352+0000, chain.objs.size()=1 2024-09-19T12:03:05.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.759+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.SjfHh-B5YPmFhJVEOgjAXztYmmnNq1__0 2024-09-19T12:03:05.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.763+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18108332562021072036', time=2024-09-19T13:58:18.493702+0000, chain.objs.size()=1 2024-09-19T12:03:05.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.763+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.WlUvACAClA_ZFCr6vQOU-EPyFwlTvJM_0 2024-09-19T12:03:05.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.763+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12463018183958732168', time=2024-09-19T13:58:54.762575+0000, chain.objs.size()=1 2024-09-19T12:03:05.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.763+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.__4aGWfUCzEFQcBAdnMjigtlp-J1DnE_0 2024-09-19T12:03:05.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.763+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15225871744937345323', time=2024-09-19T13:59:32.834045+0000, chain.objs.size()=1 2024-09-19T12:03:05.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.763+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.mr22cI-ky7CWoVmU3094lxX5g6fNVre_0 2024-09-19T12:03:05.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.763+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4915662379677735124', time=2024-09-19T13:59:32.845633+0000, chain.objs.size()=1 2024-09-19T12:03:05.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.763+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.62mjFUADioDiCorcMmRLvXqUriiZ8JD_0 2024-09-19T12:03:05.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.767+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T12:03:05.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-19T12:03:05.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16256782547976312700', time=2024-09-19T13:53:48.425183+0000, chain.objs.size()=1 2024-09-19T12:03:05.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.7gRvL7cqoLzqUy3hEo2_WrXsYZ11nkv_0 2024-09-19T12:03:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9736289759637695750', time=2024-09-19T13:55:10.160306+0000, chain.objs.size()=1 2024-09-19T12:03:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.phOMWxHzMQY7Yr8t9iT3ZOVxhFqMkHa_0 2024-09-19T12:03:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14997615111489243693', time=2024-09-19T13:55:11.920386+0000, chain.objs.size()=1 2024-09-19T12:03:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.sp5LAQ0c8ZSegrPCjNE-4rzYbQ_OtF__0 2024-09-19T12:03:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14639562595016171240', time=2024-09-19T13:55:47.714610+0000, chain.objs.size()=1 2024-09-19T12:03:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.sr3DoK5VGUk4rmOqUNe2913jMPdqkSw_0 2024-09-19T12:03:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15758926061921529482', time=2024-09-19T13:57:04.531395+0000, chain.objs.size()=1 2024-09-19T12:03:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.8ZgwXUTXYZQhbNn8ukUA_ZonJ0LmtpO_0 2024-09-19T12:03:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5092519957737927593', time=2024-09-19T13:58:18.463011+0000, chain.objs.size()=1 2024-09-19T12:03:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.Zf3Cekndea-uQipL2D679DpvejdXxZk_0 2024-09-19T12:03:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.860058078630842764', time=2024-09-19T13:58:51.947292+0000, chain.objs.size()=1 2024-09-19T12:03:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.KKkl6On9xhBfWZhSBS82eRtRHqYNdoC_0 2024-09-19T12:03:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13829303207190568040', time=2024-09-19T13:58:54.760102+0000, chain.objs.size()=1 2024-09-19T12:03:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.41YdBZN1-fRfSA_xv7VUXqMspCrIUUo_0 2024-09-19T12:03:05.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14603399052460526664', time=2024-09-19T13:58:54.770976+0000, chain.objs.size()=1 2024-09-19T12:03:05.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.aFvYGAL7zmIeNo7wC06MqoHD-w_oBFx_0 2024-09-19T12:03:05.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11859644888061955463', time=2024-09-19T13:58:54.793076+0000, chain.objs.size()=1 2024-09-19T12:03:05.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.OJiwqyH3hzYvNrY1JqKR4Nq8g79TmOS_0 2024-09-19T12:03:05.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5469493432830901777', time=2024-09-19T13:59:28.001607+0000, chain.objs.size()=1 2024-09-19T12:03:05.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.WxCt1t_6Dg_ORt59Kfu4JMb72Ohvpgd_0 2024-09-19T12:03:05.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1650810003987791790', time=2024-09-19T13:59:32.855495+0000, chain.objs.size()=1 2024-09-19T12:03:05.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.771+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.MUVchI_s5naw3VEdDNNE6BwIdDGQJoo_0 2024-09-19T12:03:05.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.775+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11076023950562174740', time=2024-09-19T14:00:06.297489+0000, chain.objs.size()=1 2024-09-19T12:03:05.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.775+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.hIzu8Cr_dbBsDQ6GenTNiwzXpcvAb9M_0 2024-09-19T12:03:05.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.779+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14057950805981174651', time=2024-09-19T14:02:32.610649+0000, chain.objs.size()=1 2024-09-19T12:03:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.779+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19__shadow:n5HC3A9.Q0NqM6NdPW1YrrAZHsG7HPc_.PVWk8qGOBMKaem4Q7GgD3a6HW1aZISk_0 2024-09-19T12:03:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.783+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.783+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T12:03:05.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-19T12:03:05.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3960075691907460840', time=2024-09-19T13:53:48.275548+0000, chain.objs.size()=4 2024-09-19T12:03:05.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10__multipart_foo.2~QtC77vYnYB_1UBIY23nmLo8YRSQS5VT.1 2024-09-19T12:03:05.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10__multipart_foo.2~QtC77vYnYB_1UBIY23nmLo8YRSQS5VT.2 2024-09-19T12:03:05.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10__multipart_foo.2~QtC77vYnYB_1UBIY23nmLo8YRSQS5VT.3 2024-09-19T12:03:05.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10__multipart_foo.2~QtC77vYnYB_1UBIY23nmLo8YRSQS5VT.4 2024-09-19T12:03:05.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='_qmKG9AyrWaD7zjlxQ8yUUzolBIMBe9j', time=2024-09-19T13:53:48.387888+0000, chain.objs.size()=1 2024-09-19T12:03:05.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.hcF2YRdzi_EjbFKluzqniUBMzOc6jZN_0 2024-09-19T12:03:05.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11809946693835431745', time=2024-09-19T13:55:47.725639+0000, chain.objs.size()=1 2024-09-19T12:03:05.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.-f_0Dy-VkuXJ3P4oNh7ea1XgLbZqY7r_0 2024-09-19T12:03:05.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4796501434296784455', time=2024-09-19T13:55:49.494083+0000, chain.objs.size()=1 2024-09-19T12:03:05.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.HEw4xOLWaXGtO264sYKRcKQGt5GMgz1_0 2024-09-19T12:03:05.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12703569025570966144', time=2024-09-19T13:57:01.483686+0000, chain.objs.size()=1 2024-09-19T12:03:05.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.l9KdGocvouRM32Ray9RlhZFRWqESQkR_0 2024-09-19T12:03:05.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13813765781564600285', time=2024-09-19T13:57:37.999383+0000, chain.objs.size()=1 2024-09-19T12:03:05.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.MzHc8Zm3Ts14g3TYxh-_S4ElVi0wPiL_0 2024-09-19T12:03:05.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16513462009204256225', time=2024-09-19T13:57:38.014849+0000, chain.objs.size()=1 2024-09-19T12:03:05.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.pSOijYesQ7pnHz8FUBv6Ys73FIgbFbv_0 2024-09-19T12:03:05.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17557347200373368703', time=2024-09-19T13:57:40.928583+0000, chain.objs.size()=1 2024-09-19T12:03:05.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.17k20_Q5ImV5FRDSvHQy-WVX2X2KK6T_0 2024-09-19T12:03:05.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5010134360611727994', time=2024-09-19T13:57:42.662554+0000, chain.objs.size()=1 2024-09-19T12:03:05.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.787+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.BwHnlgnWkGYOqqy8ktpdjAP5LPdNCVl_0 2024-09-19T12:03:05.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.791+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1195364347614360627', time=2024-09-19T13:58:15.740884+0000, chain.objs.size()=1 2024-09-19T12:03:05.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.791+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.JWSleSsiAb2Pi2Fb4eH8kURXQ8DuD_n_0 2024-09-19T12:03:05.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.795+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1201919371554999812', time=2024-09-19T13:58:15.742025+0000, chain.objs.size()=1 2024-09-19T12:03:05.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.795+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_._gcbtvY7jhrp9aCqvBhKdq6oB4vTDZM_0 2024-09-19T12:03:05.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.795+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15584714118519582953', time=2024-09-19T13:58:15.770331+0000, chain.objs.size()=1 2024-09-19T12:03:05.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.795+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.IS6LWKSah3PoI58aoxk020qYVmUcNP1_0 2024-09-19T12:03:05.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.795+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5047438301070515455', time=2024-09-19T13:58:18.447067+0000, chain.objs.size()=1 2024-09-19T12:03:05.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.795+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.4TnVkh8b-tIZzLfDT0e1vkGaEPQExGJ_0 2024-09-19T12:03:05.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.795+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1646309064230564747', time=2024-09-19T13:58:18.456059+0000, chain.objs.size()=1 2024-09-19T12:03:05.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.795+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.YgRMeUSgJJyrccic0o7vj6HZZtxCRHb_0 2024-09-19T12:03:05.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.795+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8303787668043771573', time=2024-09-19T13:58:18.463150+0000, chain.objs.size()=1 2024-09-19T12:03:05.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.795+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.4nh_Rf5X7-KwlxPYsZh1FVoiKAhmjo2_0 2024-09-19T12:03:05.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.795+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2266063079116246383', time=2024-09-19T14:00:06.319063+0000, chain.objs.size()=1 2024-09-19T12:03:05.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.795+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.6vEedrGPXzbmVfsTlX15YXez-Nmm7-V_0 2024-09-19T12:03:05.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.799+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T12:03:05.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-19T12:03:05.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.855828761173446132', time=2024-09-19T13:53:48.111395+0000, chain.objs.size()=1 2024-09-19T12:03:05.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.sP035ckI2ECP7wb7SEMn7srrsG-scRF_0 2024-09-19T12:03:05.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15480549555352920348', time=2024-09-19T13:55:10.166362+0000, chain.objs.size()=1 2024-09-19T12:03:05.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.6Sb0L7MYPoQXN6ZHJcJ-VJO_qbRUulh_0 2024-09-19T12:03:05.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13167981284468876350', time=2024-09-19T13:55:10.173614+0000, chain.objs.size()=1 2024-09-19T12:03:05.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.DSNtrSY94AS4JWrMIdl5yP2ly2TQRwj_0 2024-09-19T12:03:05.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17317855022797019626', time=2024-09-19T13:55:44.889631+0000, chain.objs.size()=1 2024-09-19T12:03:05.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.amVGV6HH3HWG28j7LJrRF_R07PP6lju_0 2024-09-19T12:03:05.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6963629216929764291', time=2024-09-19T13:55:47.704729+0000, chain.objs.size()=1 2024-09-19T12:03:05.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.DkN2M6RESNzfmEVMEsU84UGiDC7tOhN_0 2024-09-19T12:03:05.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12381408455123746904', time=2024-09-19T13:56:22.526128+0000, chain.objs.size()=1 2024-09-19T12:03:05.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.5d8Uls33qLOH0iixkRU1z4iWg0T7ZDy_0 2024-09-19T12:03:05.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9524863317023328757', time=2024-09-19T13:56:22.532824+0000, chain.objs.size()=1 2024-09-19T12:03:05.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.RtuAcOWmLfI_F-W8itNy4DZ2jIgcs21_0 2024-09-19T12:03:05.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9125712121563260361', time=2024-09-19T13:56:24.487756+0000, chain.objs.size()=1 2024-09-19T12:03:05.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.8DahJpCYWNJdlMvXic9vharhI-TQktA_0 2024-09-19T12:03:05.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7255765336579206582', time=2024-09-19T13:56:25.413424+0000, chain.objs.size()=1 2024-09-19T12:03:05.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.2t9YAOQmYfZdYgiTVLARq6KsEEmVLVT_0 2024-09-19T12:03:05.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14923419952241263094', time=2024-09-19T13:56:27.388858+0000, chain.objs.size()=1 2024-09-19T12:03:05.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.--DDd5PVBwOVPGFLAoUSwk7x5SRBVxq_0 2024-09-19T12:03:05.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10629776566914625419', time=2024-09-19T13:57:40.908405+0000, chain.objs.size()=1 2024-09-19T12:03:05.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.JPGg2671C5mUg1_kwSDPL_oi-aXw_zH_0 2024-09-19T12:03:05.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2067206334614141194', time=2024-09-19T13:58:18.453576+0000, chain.objs.size()=1 2024-09-19T12:03:05.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.803+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_._NTIuBVMZFdsrLeh5rEFkrRbU71r3FM_0 2024-09-19T12:03:05.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.811+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17127186029650066734', time=2024-09-19T13:58:18.476391+0000, chain.objs.size()=1 2024-09-19T12:03:05.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.811+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.wLWRlRjTxHOSFSZPiyJZ5X4CGnDQLQV_0 2024-09-19T12:03:05.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.811+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13319308627664583764', time=2024-09-19T13:58:51.935971+0000, chain.objs.size()=1 2024-09-19T12:03:05.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.811+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.FdRWod3QXbjaXJdt3h_pDWkQDjBBctu_0 2024-09-19T12:03:05.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.811+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9292789273884736325', time=2024-09-19T13:59:30.685044+0000, chain.objs.size()=1 2024-09-19T12:03:05.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.811+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.VqoIMoGsrEBtEFnUqQkeTEjpqZ23Lzj_0 2024-09-19T12:03:05.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.811+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10868581729031003036', time=2024-09-19T14:00:06.292629+0000, chain.objs.size()=1 2024-09-19T12:03:05.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.811+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.FG3ZVCk7N0jNVxewilZ_jYTiEgvuImW_0 2024-09-19T12:03:05.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.811+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18037169911785462586', time=2024-09-19T14:00:06.320237+0000, chain.objs.size()=1 2024-09-19T12:03:05.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.811+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.9vl3HVhGzqZw6YsY5ZRyErYCqb5bJ0m_0 2024-09-19T12:03:05.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.815+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T12:03:05.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-19T12:03:05.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1540627880408897734', time=2024-09-19T13:55:10.162191+0000, chain.objs.size()=1 2024-09-19T12:03:05.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.xtBV7RIeqcHw2dndtV72lEVbxTltgjT_0 2024-09-19T12:03:05.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4134659359047836663', time=2024-09-19T13:55:11.911457+0000, chain.objs.size()=1 2024-09-19T12:03:05.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.jrKOD74i6wzFwSIOHUBJxXWnL8yof2Y_0 2024-09-19T12:03:05.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.306991499131486828', time=2024-09-19T13:55:11.913456+0000, chain.objs.size()=1 2024-09-19T12:03:05.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.8TfmbFS5vFHyunFeGWJAjSIpwQiih8d_0 2024-09-19T12:03:05.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15728598950999874913', time=2024-09-19T13:55:11.926568+0000, chain.objs.size()=1 2024-09-19T12:03:05.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.283uPynlf1MyhFlvZcnQnlJaTgoJR1W_0 2024-09-19T12:03:05.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3335321314559185675', time=2024-09-19T13:55:44.867275+0000, chain.objs.size()=1 2024-09-19T12:03:05.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.ypHIJpOeq3XetGa6RE7658UlQFXA9Cg_0 2024-09-19T12:03:05.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3420139003193568994', time=2024-09-19T13:55:44.879173+0000, chain.objs.size()=1 2024-09-19T12:03:05.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.-3e9ESBTcCBQh1ooW3PDmkgHvFzIBvj_0 2024-09-19T12:03:05.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13636020482652098976', time=2024-09-19T13:55:49.463344+0000, chain.objs.size()=1 2024-09-19T12:03:05.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.b8CRWDH9GG9AcmUaz8-PMei--9ZAbLP_0 2024-09-19T12:03:05.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4003206406690717973', time=2024-09-19T13:56:27.370348+0000, chain.objs.size()=1 2024-09-19T12:03:05.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.2Y97qIUfn1SyMkDbUd9UtNhCd76PmKp_0 2024-09-19T12:03:05.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7826317461773073230', time=2024-09-19T13:56:27.376972+0000, chain.objs.size()=1 2024-09-19T12:03:05.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.LAmHEeV3ncGvl-hYlbS7nNbo5HY-Aoi_0 2024-09-19T12:03:05.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11796830729590405360', time=2024-09-19T13:57:01.479865+0000, chain.objs.size()=1 2024-09-19T12:03:05.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.NAYg4wgCnjMP1nGrQbpvlLZeuTyBF0v_0 2024-09-19T12:03:05.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.599650683318799488', time=2024-09-19T13:57:37.996361+0000, chain.objs.size()=1 2024-09-19T12:03:05.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.q6xVmaA59M7wTsEJ02JBS_ugeulTnA__0 2024-09-19T12:03:05.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9644622614013047875', time=2024-09-19T13:57:38.024438+0000, chain.objs.size()=1 2024-09-19T12:03:05.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.819+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.TtBlzZih_9JXq9xifB3dyaFwP-DZhrF_0 2024-09-19T12:03:05.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.827+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16388093093135891601', time=2024-09-19T13:58:15.738593+0000, chain.objs.size()=1 2024-09-19T12:03:05.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.827+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.BlAcmbDApD3V0azcVFN7dln4FFXnaD7_0 2024-09-19T12:03:05.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.827+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17897214358736759557', time=2024-09-19T13:59:32.855746+0000, chain.objs.size()=1 2024-09-19T12:03:05.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.827+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.2PH9m8dn5E7XzppRPMleew-QJcTMyYS_0 2024-09-19T12:03:05.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.827+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9093895334674785175', time=2024-09-19T14:02:17.793413+0000, chain.objs.size()=1 2024-09-19T12:03:05.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.827+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18__shadow_.pcrzdJ8Wnp1rSHZX-_Ir7pFDYiPXeP__0 2024-09-19T12:03:05.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.827+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.831+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T12:03:05.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.831+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-19T12:03:05.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5105768412023401813', time=2024-09-19T13:53:48.157462+0000, chain.objs.size()=4 2024-09-19T12:03:05.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12__multipart_foo.2~_xe-mtA55tufKPxwu9otRa5bkyOiRSr.1 2024-09-19T12:03:05.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12__multipart_foo.2~_xe-mtA55tufKPxwu9otRa5bkyOiRSr.2 2024-09-19T12:03:05.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12__multipart_foo.2~_xe-mtA55tufKPxwu9otRa5bkyOiRSr.3 2024-09-19T12:03:05.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12__multipart_foo.2~_xe-mtA55tufKPxwu9otRa5bkyOiRSr.4 2024-09-19T12:03:05.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3547212482714100033', time=2024-09-19T13:53:48.232694+0000, chain.objs.size()=4 2024-09-19T12:03:05.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11__multipart_foo.2~WIWcT5jjK_roEX87kQddpqpufxQHpZL.1 2024-09-19T12:03:05.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11__multipart_foo.2~WIWcT5jjK_roEX87kQddpqpufxQHpZL.2 2024-09-19T12:03:05.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11__multipart_foo.2~WIWcT5jjK_roEX87kQddpqpufxQHpZL.3 2024-09-19T12:03:05.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11__multipart_foo.2~WIWcT5jjK_roEX87kQddpqpufxQHpZL.4 2024-09-19T12:03:05.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8624146391120803045', time=2024-09-19T13:53:48.637807+0000, chain.objs.size()=3 2024-09-19T12:03:05.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-STANDARD.2~AEJljSd5RHWia_kvtOGI-3qkdS53q0b.1 2024-09-19T12:03:05.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-STANDARD.2~AEJljSd5RHWia_kvtOGI-3qkdS53q0b.2 2024-09-19T12:03:05.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-STANDARD.2~AEJljSd5RHWia_kvtOGI-3qkdS53q0b.3 2024-09-19T12:03:05.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17158755969951471382', time=2024-09-19T13:56:25.383956+0000, chain.objs.size()=1 2024-09-19T12:03:05.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.835+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.Vh-mcE5JRCnjoD2Gro_eFpXYMA_wgxF_0 2024-09-19T12:03:05.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5181262113255384670', time=2024-09-19T13:56:25.398946+0000, chain.objs.size()=1 2024-09-19T12:03:05.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.Ys0PTpfUXhGuveUfYiQz-CjgpD-HHqK_0 2024-09-19T12:03:05.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5046994691901905633', time=2024-09-19T13:56:27.390864+0000, chain.objs.size()=1 2024-09-19T12:03:05.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.pna9xQJQ4tNnWXvkWyfNsoNSzLeovt8_0 2024-09-19T12:03:05.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2090469025897669554', time=2024-09-19T13:57:04.527660+0000, chain.objs.size()=1 2024-09-19T12:03:05.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.3TXJwhk_pH2CgNJixtj1WdQ-DUDQ0Xy_0 2024-09-19T12:03:05.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5788284789817207645', time=2024-09-19T13:57:38.030680+0000, chain.objs.size()=1 2024-09-19T12:03:05.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.U3yQsIrdbmsSwlQ_eECr9FnVs1GZDuP_0 2024-09-19T12:03:05.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4721482300599941868', time=2024-09-19T13:57:42.666807+0000, chain.objs.size()=1 2024-09-19T12:03:05.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.AJfTsrvFOuEjegSs6RLeksywiMN6SLG_0 2024-09-19T12:03:05.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2888951665120828446', time=2024-09-19T13:57:42.667577+0000, chain.objs.size()=1 2024-09-19T12:03:05.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_._f_NQuq3HK2Vyqm-PYut05eVY-IOyLv_0 2024-09-19T12:03:05.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9339443474266483056', time=2024-09-19T13:58:15.758293+0000, chain.objs.size()=1 2024-09-19T12:03:05.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.TzIYphe3NWfYh_DRptEteI_RPxxKUOI_0 2024-09-19T12:03:05.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14762433424739931001', time=2024-09-19T13:58:18.452891+0000, chain.objs.size()=1 2024-09-19T12:03:05.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.6VW7zI4to2UIBhw82IMYdUpqcgSwrwN_0 2024-09-19T12:03:05.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10237578735254256791', time=2024-09-19T13:59:28.006495+0000, chain.objs.size()=1 2024-09-19T12:03:05.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.Rg64JYMALaLSM7_Shm2lO9HNdAi4QrK_0 2024-09-19T12:03:05.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7642481731315468821', time=2024-09-19T13:59:29.771992+0000, chain.objs.size()=1 2024-09-19T12:03:05.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.L7k8mHFl9Vse9c7blvwwP7LPbRJhf4D_0 2024-09-19T12:03:05.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1330352227452365693', time=2024-09-19T13:59:32.861704+0000, chain.objs.size()=1 2024-09-19T12:03:05.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.839+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.rYGo0M5zaU2tBOas8HbyEZfHTLXc6A6_0 2024-09-19T12:03:05.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.843+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.476236467260382619', time=2024-09-19T13:59:32.872501+0000, chain.objs.size()=1 2024-09-19T12:03:05.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.843+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.tlR73pgz5WO1u8j3L_TMxjgdLRuhQqp_0 2024-09-19T12:03:05.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.843+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.936894940463739860', time=2024-09-19T14:02:17.788281+0000, chain.objs.size()=1 2024-09-19T12:03:05.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.843+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18__shadow_.3j63Fxhrgno9TftHxrOacH4nwCyoXI9_0 2024-09-19T12:03:05.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.843+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13731869526776640790', time=2024-09-19T14:02:32.616481+0000, chain.objs.size()=1 2024-09-19T12:03:05.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.843+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.19__shadow:4KZRdCZaFGXoN3orXqw1bh8FA36coa0_.0tKgOjuU5C7i5f0AMpjs9Cddf_b9Hcf_0 2024-09-19T12:03:05.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.847+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.851+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T12:03:05.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.851+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-19T12:03:05.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12298013352394532029', time=2024-09-19T13:53:48.058364+0000, chain.objs.size()=1 2024-09-19T12:03:05.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5__shadow_.yPjvx_--69IaV2bLLO577e0IB3lOMCN_0 2024-09-19T12:03:05.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12760055848837423193', time=2024-09-19T13:55:10.175241+0000, chain.objs.size()=1 2024-09-19T12:03:05.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.iCPiHV0B0DIXr6KW-qNEcvRRSme3p1D_0 2024-09-19T12:03:05.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7881250832604239662', time=2024-09-19T13:55:44.869270+0000, chain.objs.size()=1 2024-09-19T12:03:05.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.9-7TrAJRUtdkfOX1z3VJ3u5xSBWtVub_0 2024-09-19T12:03:05.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15914665352455658007', time=2024-09-19T13:55:47.702857+0000, chain.objs.size()=1 2024-09-19T12:03:05.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.6esMVfrA1IkmjDP2GZ4-GcvP0IzZRek_0 2024-09-19T12:03:05.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1098751602936171176', time=2024-09-19T13:55:49.474515+0000, chain.objs.size()=1 2024-09-19T12:03:05.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.q8AVwruGyBwOgoaHWGFu4-rp1nLHSr9_0 2024-09-19T12:03:05.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17299795695046440044', time=2024-09-19T13:55:49.476351+0000, chain.objs.size()=1 2024-09-19T12:03:05.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.gNCvnbvMQgIvTTAecpDlD1iNoeoCX0r_0 2024-09-19T12:03:05.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18189108214565081206', time=2024-09-19T13:56:22.518890+0000, chain.objs.size()=1 2024-09-19T12:03:05.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.HIWffZDHjEc_OX_RuWS00mcyD_ayPal_0 2024-09-19T12:03:05.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10735905480958271561', time=2024-09-19T13:56:27.375089+0000, chain.objs.size()=1 2024-09-19T12:03:05.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.SwYV-xf1c1y-HfRJpMJ2zmmN5cKujh3_0 2024-09-19T12:03:05.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9767138309439360961', time=2024-09-19T13:57:01.474505+0000, chain.objs.size()=1 2024-09-19T12:03:05.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.xxQgVA9chvx3M5mv9WfUQ0K0DoayYGf_0 2024-09-19T12:03:05.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8118505963253565097', time=2024-09-19T13:57:40.906043+0000, chain.objs.size()=1 2024-09-19T12:03:05.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.bAyViCb2t6g98KYbLWqSCkNqB7ReRH2_0 2024-09-19T12:03:05.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4619431200004233661', time=2024-09-19T13:57:42.657246+0000, chain.objs.size()=1 2024-09-19T12:03:05.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.7zxu3cirtEQY3M7rVwjuNIZWJ5mxVOD_0 2024-09-19T12:03:05.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15368275109197548032', time=2024-09-19T13:57:42.686026+0000, chain.objs.size()=1 2024-09-19T12:03:05.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.855+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.mfszMrCL5R6tN10vIeWLhE8zjwthvER_0 2024-09-19T12:03:05.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.859+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12209193502458169059', time=2024-09-19T13:58:51.946468+0000, chain.objs.size()=1 2024-09-19T12:03:05.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.859+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.jxjEreB4imL6jiSGrSV1GECarXqlqLB_0 2024-09-19T12:03:05.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.859+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1544633602266628459', time=2024-09-19T13:59:30.677151+0000, chain.objs.size()=1 2024-09-19T12:03:05.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.859+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.Ju1PTUMTPaOUfWoKwbCirK6LDWEWBLM_0 2024-09-19T12:03:05.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.859+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5267665911364447377', time=2024-09-19T13:59:32.837004+0000, chain.objs.size()=1 2024-09-19T12:03:05.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.859+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.GnPgreiY_VXOCiYmyG72IIJ1VT4kA1t_0 2024-09-19T12:03:05.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.859+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6277409285624501617', time=2024-09-19T14:00:06.303755+0000, chain.objs.size()=1 2024-09-19T12:03:05.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.859+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.5iVZirqHCL8f1-UwaFMC46I_Ry9xT_L_0 2024-09-19T12:03:05.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.859+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17710931993897903712', time=2024-09-19T14:00:06.317120+0000, chain.objs.size()=1 2024-09-19T12:03:05.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.859+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.HK68i6wJjef1dxu5aELVdvDlZ4F_zuL_0 2024-09-19T12:03:05.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.859+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16011771794603023052', time=2024-09-19T14:02:17.788587+0000, chain.objs.size()=1 2024-09-19T12:03:05.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.859+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18__shadow_.lRGPh-Q49Coov4sIrKl5lw_dBEPE9tY_0 2024-09-19T12:03:05.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.863+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.867+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T12:03:05.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.867+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.867+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-19T12:03:05.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5597613352814739239', time=2024-09-19T13:53:48.398262+0000, chain.objs.size()=1 2024-09-19T12:03:05.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.7gRvL7cqoLzqUy3hEo2_WrXsYZ11nkv_0 2024-09-19T12:03:05.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.154871758333595144', time=2024-09-19T13:53:48.548063+0000, chain.objs.size()=3 2024-09-19T12:03:05.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-STANDARD.2~XuLcG68F642Z3TfjR-MH_5k6ZdGj8Av.1 2024-09-19T12:03:05.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-STANDARD.2~XuLcG68F642Z3TfjR-MH_5k6ZdGj8Av.2 2024-09-19T12:03:05.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-STANDARD.2~XuLcG68F642Z3TfjR-MH_5k6ZdGj8Av.3 2024-09-19T12:03:05.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16284991007965918423', time=2024-09-19T13:53:48.625168+0000, chain.objs.size()=3 2024-09-19T12:03:05.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-LUKEWARM.2~5_Efmd7Aj1aHUgAEiFbmB51mtJ_7yO0.1 2024-09-19T12:03:05.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-LUKEWARM.2~5_Efmd7Aj1aHUgAEiFbmB51mtJ_7yO0.2 2024-09-19T12:03:05.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15__multipart_foo-LUKEWARM.2~5_Efmd7Aj1aHUgAEiFbmB51mtJ_7yO0.3 2024-09-19T12:03:05.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14031975559630283965', time=2024-09-19T13:53:48.815604+0000, chain.objs.size()=1 2024-09-19T12:03:05.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8__shadow_.f-QlHMN1-NWJXpvAuTJW0gmg359pRor_0 2024-09-19T12:03:05.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.488611752156617527', time=2024-09-19T13:55:08.842974+0000, chain.objs.size()=1 2024-09-19T12:03:05.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.1WKk6Fm_Fqeu1aNUTUA8X8WpM2fPioe_0 2024-09-19T12:03:05.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1550535940689537842', time=2024-09-19T13:55:13.378500+0000, chain.objs.size()=1 2024-09-19T12:03:05.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.z0oC60eOpqj1xcMcLjEzYoVgNfyrG42_0 2024-09-19T12:03:05.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12956104390749473083', time=2024-09-19T13:57:04.524129+0000, chain.objs.size()=1 2024-09-19T12:03:05.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.kpiDeQuyZsYX1XxeuyixDL2XeZ30zqC_0 2024-09-19T12:03:05.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11388321427240756045', time=2024-09-19T13:57:38.001017+0000, chain.objs.size()=1 2024-09-19T12:03:05.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.871+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.0a4m0-Xp-pirYnzmLWOQwkzmPkBWDFA_0 2024-09-19T12:03:05.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.875+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.6936087057610760390', time=2024-09-19T13:57:40.935156+0000, chain.objs.size()=1 2024-09-19T12:03:05.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.875+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.Y8eZRQ7QFY-hvHiyxG6QhcSPy5JCGfk_0 2024-09-19T12:03:05.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.875+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8456823521797478016', time=2024-09-19T13:58:51.945852+0000, chain.objs.size()=1 2024-09-19T12:03:05.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.875+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.40_SXMAgL-p2tuAQAihoDf9oXhTwhgP_0 2024-09-19T12:03:05.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.875+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3795121590746461920', time=2024-09-19T13:59:30.680306+0000, chain.objs.size()=1 2024-09-19T12:03:05.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.875+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.ikjPn9plZcrrwfF3qAtWXj7GeUuop3T_0 2024-09-19T12:03:05.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.875+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9039137990160750247', time=2024-09-19T13:59:32.842513+0000, chain.objs.size()=1 2024-09-19T12:03:05.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.875+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.ee88q0HS6NHV8mXpjFQeorDMMtaCJWA_0 2024-09-19T12:03:05.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.875+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2973623229234387833', time=2024-09-19T13:59:32.873043+0000, chain.objs.size()=1 2024-09-19T12:03:05.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.875+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.lcORNMRGv0lQ8guQAPppIIwiWMS9bJ__0 2024-09-19T12:03:05.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.875+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11412613213626415141', time=2024-09-19T13:59:34.579142+0000, chain.objs.size()=1 2024-09-19T12:03:05.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.875+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.h11uiNNvhp5e-vfb-Twb06vlw_D4j4J_0 2024-09-19T12:03:05.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.879+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T12:03:05.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-19T12:03:05.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='_aj8mg77Mx0slP_n8IOowL6zy4lDMR5x', time=2024-09-19T13:53:48.365982+0000, chain.objs.size()=1 2024-09-19T12:03:05.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.--vdrXYNKGXb_Gr4RWQx8g0VtZth4K0_0 2024-09-19T12:03:05.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.675613783052332244', time=2024-09-19T13:53:48.465538+0000, chain.objs.size()=3 2024-09-19T12:03:05.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-FROZEN.2~9jza5Jxf8exQnHeolZvL9SOhVSsi8ym.1 2024-09-19T12:03:05.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-FROZEN.2~9jza5Jxf8exQnHeolZvL9SOhVSsi8ym.2 2024-09-19T12:03:05.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-FROZEN.2~9jza5Jxf8exQnHeolZvL9SOhVSsi8ym.3 2024-09-19T12:03:05.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3278760952287216094', time=2024-09-19T13:53:48.674993+0000, chain.objs.size()=2 2024-09-19T12:03:05.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14__shadow_.Z5CHCofhSAf0X9-uUaL8J4Cp04YxKoj_0 2024-09-19T12:03:05.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14__shadow_.Z5CHCofhSAf0X9-uUaL8J4Cp04YxKoj_1 2024-09-19T12:03:05.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9733746796976124546', time=2024-09-19T13:53:48.804525+0000, chain.objs.size()=1 2024-09-19T12:03:05.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8__shadow_.L7qI776uDoJfz_9849sIpaifEN5pUuW_0 2024-09-19T12:03:05.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14965604935742474498', time=2024-09-19T13:55:10.160684+0000, chain.objs.size()=1 2024-09-19T12:03:05.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.CzDgcWf25dzU3Upb6bBO6y_bDySql7q_0 2024-09-19T12:03:05.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13503329217108699672', time=2024-09-19T13:55:10.169178+0000, chain.objs.size()=1 2024-09-19T12:03:05.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.Bx8EVnrGovT37jlzovDuaIgGgFM6Ssh_0 2024-09-19T12:03:05.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9946035609199935908', time=2024-09-19T13:55:10.179139+0000, chain.objs.size()=1 2024-09-19T12:03:05.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.P5pHAwLBaQiY9tlphwhgmE20m3b_RKI_0 2024-09-19T12:03:05.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3804202410230051027', time=2024-09-19T13:55:11.907023+0000, chain.objs.size()=1 2024-09-19T12:03:05.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.irhotVCWRHxv3er3Ct8Vr8POqJCnLVz_0 2024-09-19T12:03:05.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3311827311706846973', time=2024-09-19T13:55:44.860512+0000, chain.objs.size()=1 2024-09-19T12:03:05.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.883+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.AWCzuuIfeba1SBtKeXlEqg0gd798avx_0 2024-09-19T12:03:05.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.887+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5223985359155172324', time=2024-09-19T13:55:44.873965+0000, chain.objs.size()=1 2024-09-19T12:03:05.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.887+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.nVduJavcIKOz0Qlt340QX8L6LHds5TH_0 2024-09-19T12:03:05.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.887+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8694568387777626454', time=2024-09-19T13:55:47.721292+0000, chain.objs.size()=1 2024-09-19T12:03:05.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.887+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.1DGFWCoLIAjO3Kt3z_28yN1GMeXCwyz_0 2024-09-19T12:03:05.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.887+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8633609826465119062', time=2024-09-19T13:57:01.478723+0000, chain.objs.size()=1 2024-09-19T12:03:05.888 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.887+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.gfEAPaPkWZmGfqd5meohseYvcc6hZwK_0 2024-09-19T12:03:05.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.887+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14546514181395070641', time=2024-09-19T13:57:04.549926+0000, chain.objs.size()=1 2024-09-19T12:03:05.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.887+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.a106UyaKlV3Vb2tHgT_t2c_3qOlkb1t_0 2024-09-19T12:03:05.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9205690987014125717', time=2024-09-19T13:57:40.889412+0000, chain.objs.size()=1 2024-09-19T12:03:05.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.O5U-AhX7YGVrpSgaQuht54IHRLKNNdv_0 2024-09-19T12:03:05.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14077038988313851039', time=2024-09-19T13:57:42.672785+0000, chain.objs.size()=1 2024-09-19T12:03:05.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.uBcuOzWHhtvfC5bQDPfgpRchkckQHzM_0 2024-09-19T12:03:05.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13576950688790631333', time=2024-09-19T13:58:15.750604+0000, chain.objs.size()=1 2024-09-19T12:03:05.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.AwW2A7kcrCEJcNNPj0DPgd8FWzIXSex_0 2024-09-19T12:03:05.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12973583987867745791', time=2024-09-19T13:58:18.472076+0000, chain.objs.size()=1 2024-09-19T12:03:05.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.UTVqPnrR4ufbs5qd9jSfUHomf6dLFeV_0 2024-09-19T12:03:05.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.511141200885423149', time=2024-09-19T13:59:30.672091+0000, chain.objs.size()=1 2024-09-19T12:03:05.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.np9yJaGyPr6lv2c7lOLCDyosbGJMfdh_0 2024-09-19T12:03:05.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7811499826758990621', time=2024-09-19T13:59:30.682288+0000, chain.objs.size()=1 2024-09-19T12:03:05.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.JmZ8T5ajnd3p_UeZ7BajpfafER0vDvO_0 2024-09-19T12:03:05.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10686146972034008079', time=2024-09-19T13:59:32.876121+0000, chain.objs.size()=1 2024-09-19T12:03:05.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.Tuknhcx5GwGz1AJEtlCWH7wpJz6yRzq_0 2024-09-19T12:03:05.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12556343195638195973', time=2024-09-19T14:00:06.296003+0000, chain.objs.size()=1 2024-09-19T12:03:05.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.asRtc7U0vGNUmHXqPGKOGosyf9VIl7E_0 2024-09-19T12:03:05.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15849540139896472976', time=2024-09-19T14:00:06.308466+0000, chain.objs.size()=1 2024-09-19T12:03:05.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.BjQUwPp3ujr69zTqt6i3RVVLoS9jGbB_0 2024-09-19T12:03:05.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15978275346677634439', time=2024-09-19T14:02:17.789136+0000, chain.objs.size()=1 2024-09-19T12:03:05.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.891+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18__shadow_.T7jkuXumTv3Jg45UCO9scjxnKz-gyNV_0 2024-09-19T12:03:05.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.895+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.899+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T12:03:05.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.899+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.899+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-19T12:03:05.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7990499832876230746', time=2024-09-19T13:53:48.507311+0000, chain.objs.size()=3 2024-09-19T12:03:05.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-LUKEWARM.2~HMaHS1yrkg-dPeOgovydO5e43SdsNSD.1 2024-09-19T12:03:05.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-LUKEWARM.2~HMaHS1yrkg-dPeOgovydO5e43SdsNSD.2 2024-09-19T12:03:05.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-LUKEWARM.2~HMaHS1yrkg-dPeOgovydO5e43SdsNSD.3 2024-09-19T12:03:05.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5036393519407507998', time=2024-09-19T13:55:44.861506+0000, chain.objs.size()=1 2024-09-19T12:03:05.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.8Dn5Ib-qndgJ0xsQOlzP9ZGTTSTbrGD_0 2024-09-19T12:03:05.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12369439773668298916', time=2024-09-19T13:55:44.889313+0000, chain.objs.size()=1 2024-09-19T12:03:05.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.To7nIciDUG-xFiFPUAKXjoO_7YwDrRe_0 2024-09-19T12:03:05.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10938113322607468614', time=2024-09-19T13:55:49.454380+0000, chain.objs.size()=1 2024-09-19T12:03:05.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.GBC7rOlizBTm-m_CmdA2FBVzXcmH4nr_0 2024-09-19T12:03:05.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2397535324617434825', time=2024-09-19T13:56:25.386801+0000, chain.objs.size()=1 2024-09-19T12:03:05.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.nSh9eZLOZP_Aknu0IhA-9srmhlcZO3b_0 2024-09-19T12:03:05.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15815371481379252691', time=2024-09-19T13:56:27.404187+0000, chain.objs.size()=1 2024-09-19T12:03:05.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.5MVBvZRtNch29hIeUJWCaR6z36_v4cd_0 2024-09-19T12:03:05.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15951662086532125653', time=2024-09-19T13:57:01.497316+0000, chain.objs.size()=1 2024-09-19T12:03:05.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.-iLCr7UM7E4vzmpdYzbhX6eneRg6J2J_0 2024-09-19T12:03:05.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.280049085149028567', time=2024-09-19T13:57:04.539754+0000, chain.objs.size()=1 2024-09-19T12:03:05.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.qqcIKYUaYOOXcMqecJpn6vuXgh8fMLX_0 2024-09-19T12:03:05.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11114677217095677003', time=2024-09-19T13:57:42.687010+0000, chain.objs.size()=1 2024-09-19T12:03:05.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.ata9wd04ZTOO09ehbgDaWsVS1pxCr7q_0 2024-09-19T12:03:05.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2183510775824864494', time=2024-09-19T13:58:15.762180+0000, chain.objs.size()=1 2024-09-19T12:03:05.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.903+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.WxikibEhvtL87sMZCryEuS3OY7MmCFP_0 2024-09-19T12:03:05.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.907+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3719072737024823162', time=2024-09-19T13:58:17.536687+0000, chain.objs.size()=1 2024-09-19T12:03:05.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.907+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.OXEJhhqWwZWLPQ0Or_sJ8eZTVyTe46b_0 2024-09-19T12:03:05.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.907+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.12005860488684057697', time=2024-09-19T13:58:51.923726+0000, chain.objs.size()=1 2024-09-19T12:03:05.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.907+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.HAQlCb-Ck_UFx9-OIvQiQwnxMukUYPY_0 2024-09-19T12:03:05.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.907+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13097172866580506509', time=2024-09-19T13:58:51.957319+0000, chain.objs.size()=1 2024-09-19T12:03:05.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.907+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.jcPrVWCtNQ5mxJSbcvBJSU81rsHD1o-_0 2024-09-19T12:03:05.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.911+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.911+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T12:03:05.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-19T12:03:05.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='_ragrJiQN_ltiGJDiriHZ7y5Jl8hpdhu', time=2024-09-19T13:53:48.329223+0000, chain.objs.size()=1 2024-09-19T12:03:05.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.iKwXgcZ1iTxpFOVJTOGID5vzrgSKr4A_0 2024-09-19T12:03:05.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.432478025209677256', time=2024-09-19T13:53:48.372375+0000, chain.objs.size()=1 2024-09-19T12:03:05.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16__shadow_.HjZmBj6lWS6WujM-K3HdexKBGbheY5C_0 2024-09-19T12:03:05.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10882590046286815382', time=2024-09-19T13:53:48.470200+0000, chain.objs.size()=3 2024-09-19T12:03:05.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-FROZEN.2~9jza5Jxf8exQnHeolZvL9SOhVSsi8ym.1 2024-09-19T12:03:05.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-FROZEN.2~9jza5Jxf8exQnHeolZvL9SOhVSsi8ym.2 2024-09-19T12:03:05.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__multipart_foo-FROZEN.2~9jza5Jxf8exQnHeolZvL9SOhVSsi8ym.3 2024-09-19T12:03:05.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='_-0me1qKuYxgu8_n9D-IsyGObFt2GCX5', time=2024-09-19T13:53:48.492603+0000, chain.objs.size()=2 2024-09-19T12:03:05.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.FinKlMOz_A3O7W04bo2TNtGeqlCYYqq_0 2024-09-19T12:03:05.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.FinKlMOz_A3O7W04bo2TNtGeqlCYYqq_1 2024-09-19T12:03:05.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10077747107726609886', time=2024-09-19T13:55:11.902841+0000, chain.objs.size()=1 2024-09-19T12:03:05.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.ru4uhf3IsHzep4wVm0uKm1hwXo5Z_PE_0 2024-09-19T12:03:05.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.8257393227169352881', time=2024-09-19T13:55:44.892186+0000, chain.objs.size()=1 2024-09-19T12:03:05.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.22__shadow_.j1vpDfHNDjvcNLwDRJMmYWuyYdTaIuc_0 2024-09-19T12:03:05.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11774636563664842075', time=2024-09-19T13:55:49.460328+0000, chain.objs.size()=1 2024-09-19T12:03:05.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.ACiWLqOrZGwjP8Xbc_PNJPWuhfyvaos_0 2024-09-19T12:03:05.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7683197324139121840', time=2024-09-19T13:55:49.470974+0000, chain.objs.size()=1 2024-09-19T12:03:05.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.24__shadow_.KoOh-2qe9nXip8LdViOdhQhKAeUHZTg_0 2024-09-19T12:03:05.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16820653865833007047', time=2024-09-19T13:56:22.531464+0000, chain.objs.size()=1 2024-09-19T12:03:05.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.915+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.WqyP-_IHcOxEeRHpTiUFTxbtKKzJHB6_0 2024-09-19T12:03:05.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.55593579042983093', time=2024-09-19T13:56:25.399007+0000, chain.objs.size()=1 2024-09-19T12:03:05.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.hOvsbow-TUvlAj33NHtWKpyCQVK5XQ-_0 2024-09-19T12:03:05.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5808878750075118050', time=2024-09-19T13:56:25.410649+0000, chain.objs.size()=1 2024-09-19T12:03:05.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_.mRZPZf_ggkMKoVNTE7XHeTzMY77FgxA_0 2024-09-19T12:03:05.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17012983581210378359', time=2024-09-19T13:56:27.378369+0000, chain.objs.size()=1 2024-09-19T12:03:05.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.X84AW8n73Ac8FmEP8YbsJHYi98u5RSd_0 2024-09-19T12:03:05.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16633930097308523417', time=2024-09-19T13:57:01.491563+0000, chain.objs.size()=1 2024-09-19T12:03:05.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.G-2qTd9s5dZ0h9OJC7M56fciXv1OV3t_0 2024-09-19T12:03:05.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2998580766530532783', time=2024-09-19T13:57:37.993482+0000, chain.objs.size()=1 2024-09-19T12:03:05.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.sQJpLMNo2u3XiW8cSQCqVMEG9WtcSsG_0 2024-09-19T12:03:05.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9045174948944573647', time=2024-09-19T13:57:38.009862+0000, chain.objs.size()=1 2024-09-19T12:03:05.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.30__shadow_.sF7IbmZCqq_XEzhuzYforbMvJWknFGn_0 2024-09-19T12:03:05.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9952487870948898137', time=2024-09-19T13:57:39.768666+0000, chain.objs.size()=1 2024-09-19T12:03:05.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.31__shadow_.q1hq0lZws2C4W4CsuLfLPrLgg8-zBDq_0 2024-09-19T12:03:05.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15640101303441511863', time=2024-09-19T13:58:15.741399+0000, chain.objs.size()=1 2024-09-19T12:03:05.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.919+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.bjsH6teDFuy1tHLoiW2wFZf4nhrsKGF_0 2024-09-19T12:03:05.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.923+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16279365679921459222', time=2024-09-19T13:58:15.756736+0000, chain.objs.size()=1 2024-09-19T12:03:05.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.923+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.gqITR1wxE6T8sMapxI0CvOWe_BqDMTP_0 2024-09-19T12:03:05.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.923+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16088588053316574066', time=2024-09-19T13:58:51.951393+0000, chain.objs.size()=1 2024-09-19T12:03:05.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.923+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.O4AR7oBpi7mm6pTYJSMpLIxPsmrmZsj_0 2024-09-19T12:03:05.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.923+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1359880846165533572', time=2024-09-19T13:58:54.754354+0000, chain.objs.size()=1 2024-09-19T12:03:05.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.923+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.ERCMhMr30KaMQ1whC-dD0sI3ov20Li-_0 2024-09-19T12:03:05.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.923+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13998785289434498180', time=2024-09-19T13:59:27.984496+0000, chain.objs.size()=1 2024-09-19T12:03:05.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.923+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.S7UGipNn6QtK2FONAFB3jxoz1KOqlnj_0 2024-09-19T12:03:05.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.923+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14575637246795156311', time=2024-09-19T13:59:28.009625+0000, chain.objs.size()=1 2024-09-19T12:03:05.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.923+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.fKoR4SzWJf08wCqhDWpMAYUlI-Ei9UH_0 2024-09-19T12:03:05.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.923+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2601614560439006857', time=2024-09-19T14:00:06.313336+0000, chain.objs.size()=1 2024-09-19T12:03:05.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.923+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.76aeZxzf7pddkt1xev2OPIOUZy4vBRR_0 2024-09-19T12:03:05.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.923+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2923824512659142832', time=2024-09-19T14:02:17.785078+0000, chain.objs.size()=1 2024-09-19T12:03:05.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.923+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18__shadow_.ygOXukmOT_2ymrvSulwvECnwnq_iOY-_0 2024-09-19T12:03:05.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.931+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.931+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T12:03:05.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.935 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-19T12:03:05.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.3698351116454983719', time=2024-09-19T13:53:48.685504+0000, chain.objs.size()=2 2024-09-19T12:03:05.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14__shadow_.MWCEPCrT8G4Agi1dv34ZvCMaaJhjhMl_0 2024-09-19T12:03:05.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.14__shadow_.MWCEPCrT8G4Agi1dv34ZvCMaaJhjhMl_1 2024-09-19T12:03:05.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.1857616762954866752', time=2024-09-19T13:55:10.197692+0000, chain.objs.size()=1 2024-09-19T12:03:05.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.20__shadow_.Dn_1JerD_yqaQHpmUJ6VQqaPg4a37d7_0 2024-09-19T12:03:05.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7451973540854952922', time=2024-09-19T13:55:11.916019+0000, chain.objs.size()=1 2024-09-19T12:03:05.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.xkuJCWS328_HPOXVAQwiSsZs2St7-i4_0 2024-09-19T12:03:05.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7164189509116321626', time=2024-09-19T13:55:47.693041+0000, chain.objs.size()=1 2024-09-19T12:03:05.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.23__shadow_.xr8yu2vVjgupCVTDhvzZsCYK00kd1l6_0 2024-09-19T12:03:05.938 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9411755726592160143', time=2024-09-19T13:56:22.549541+0000, chain.objs.size()=1 2024-09-19T12:03:05.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.25__shadow_.hHpJJskix9EUDNdS2TUV1cX5KDDOl-y_0 2024-09-19T12:03:05.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16370134521811549067', time=2024-09-19T13:56:25.399982+0000, chain.objs.size()=1 2024-09-19T12:03:05.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.26__shadow_._iBU60MSLLkJTFm24FLVUupnzDGOypB_0 2024-09-19T12:03:05.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7339335774130407095', time=2024-09-19T13:57:01.488399+0000, chain.objs.size()=1 2024-09-19T12:03:05.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.Ht8GUUHBpPICxPSb7NWgJLoBzC2BedW_0 2024-09-19T12:03:05.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7819446641448302230', time=2024-09-19T13:57:04.534083+0000, chain.objs.size()=1 2024-09-19T12:03:05.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.29__shadow_.e-PhQQ9uzPa82HRR5O2g4ixiZywC4zJ_0 2024-09-19T12:03:05.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.2153649747664060392', time=2024-09-19T13:57:42.666211+0000, chain.objs.size()=1 2024-09-19T12:03:05.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.lmhuAO0QC8RFhz9q16L03vMMQzB56kb_0 2024-09-19T12:03:05.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13553221122318585349', time=2024-09-19T13:57:42.679931+0000, chain.objs.size()=1 2024-09-19T12:03:05.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.32__shadow_.BGLs59LJTTIql3zIAQwpf6qcYxzYy7O_0 2024-09-19T12:03:05.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.102131966872783181', time=2024-09-19T13:58:15.750065+0000, chain.objs.size()=1 2024-09-19T12:03:05.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.935+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.33__shadow_.yNGekg49MdGSkHqN27XpdU0SuXF_L_3_0 2024-09-19T12:03:05.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.939+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7888840728423244959', time=2024-09-19T13:58:53.661554+0000, chain.objs.size()=1 2024-09-19T12:03:05.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.939+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.B5LL5x3oLKimFvReB9LZOihGvuAPPdk_0 2024-09-19T12:03:05.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.939+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10079775806307183921', time=2024-09-19T13:58:54.778690+0000, chain.objs.size()=1 2024-09-19T12:03:05.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.939+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.36EnhVPNFmSUYGG-VkMPxy5qSJVOdyb_0 2024-09-19T12:03:05.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.939+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.13222239002264984951', time=2024-09-19T13:59:28.009230+0000, chain.objs.size()=1 2024-09-19T12:03:05.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.939+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.37__shadow_.dv3aETsVzsc5yv18i4tOO5sDbhb0tuS_0 2024-09-19T12:03:05.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.939+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.7426221963118760351', time=2024-09-19T13:59:30.682605+0000, chain.objs.size()=1 2024-09-19T12:03:05.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.939+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.QrC6J4XPoUNRA8n5jfUuEP-sGd5dhnG_0 2024-09-19T12:03:05.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.939+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5400536381525665431', time=2024-09-19T14:02:17.799569+0000, chain.objs.size()=1 2024-09-19T12:03:05.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.939+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18__shadow_.eUDMOpDzCxu-HbXjooHsN5B6mEgcsRy_0 2024-09-19T12:03:05.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.943+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T12:03:05.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T12:03:05.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T12:03:05.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-19T12:03:05.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='_6e4PodiyzudaZP6EX6GFZbL6TEKGPqi', time=2024-09-19T13:53:48.563647+0000, chain.objs.size()=2 2024-09-19T12:03:05.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.EXsOzV3UFrqZrdwsym1HpzK0oEMEq4a_0 2024-09-19T12:03:05.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17__shadow_.EXsOzV3UFrqZrdwsym1HpzK0oEMEq4a_1 2024-09-19T12:03:05.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.9309219275861537153', time=2024-09-19T13:55:11.915067+0000, chain.objs.size()=1 2024-09-19T12:03:05.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.21__shadow_.P-kvR3ZXOC96w4h9CX5ktJlSiLr-yfy_0 2024-09-19T12:03:05.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.17721646494286207063', time=2024-09-19T13:56:27.395656+0000, chain.objs.size()=1 2024-09-19T12:03:05.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.27__shadow_.nXup7YFeG-GaFQPzfMqAAnlxGqgyQaQ_0 2024-09-19T12:03:05.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.16105888435079525759', time=2024-09-19T13:57:01.481068+0000, chain.objs.size()=1 2024-09-19T12:03:05.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.28__shadow_.5Tfg-KivyEJtn_r1_6SOfe4bT2Z9OLD_0 2024-09-19T12:03:05.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.5214716452991890859', time=2024-09-19T13:58:18.460363+0000, chain.objs.size()=1 2024-09-19T12:03:05.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.34__shadow_.x4Eh0_yVqW6qrZ5R9LPfr3shTMX8ZTe_0 2024-09-19T12:03:05.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.412441974831987598', time=2024-09-19T13:58:51.932965+0000, chain.objs.size()=1 2024-09-19T12:03:05.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.4s95FjXLB9Bv4KKhwXtVYTODtz3rP9e_0 2024-09-19T12:03:05.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15199561632398300182', time=2024-09-19T13:58:51.938815+0000, chain.objs.size()=1 2024-09-19T12:03:05.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.35__shadow_.w1hU4ZUSwkP1PJv1INaESNQ9M26idff_0 2024-09-19T12:03:05.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.10609241321466600487', time=2024-09-19T13:58:54.756320+0000, chain.objs.size()=1 2024-09-19T12:03:05.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.36__shadow_.9JZqlm-Ygi6vgVwPDptIjlFId8u9LwU_0 2024-09-19T12:03:05.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.11257684821410873481', time=2024-09-19T13:59:30.688936+0000, chain.objs.size()=1 2024-09-19T12:03:05.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.38__shadow_.SBt7aaQtoLBNWq3k3dXwbyQyR-Fhb2Q_0 2024-09-19T12:03:05.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.15085062103040927887', time=2024-09-19T13:59:32.833896+0000, chain.objs.size()=1 2024-09-19T12:03:05.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.39__shadow_.5acvtnE9BoyAaSVFEWQv-IRHsgcorc2_0 2024-09-19T12:03:05.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.189872233971331773', time=2024-09-19T14:00:06.288950+0000, chain.objs.size()=1 2024-09-19T12:03:05.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.947+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.40__shadow_.7JMJi6ye0xAf8XSsWqSm2FBia6SXXxw_0 2024-09-19T12:03:05.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.955+0000 7fd4729af9c0 20 garbage collection: RGWGC::process iterating over entry tag='cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.4669562066179543266', time=2024-09-19T14:02:17.783648+0000, chain.objs.size()=1 2024-09-19T12:03:05.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.955+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:cd83c2b8-48ff-443f-8733-529022aeb2cf.4556.18__shadow_.GIDvp9QEIG0qROSDrdEVKWfXQTkPdZA_0 2024-09-19T12:03:05.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.955+0000 7fd4729af9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T12:03:05.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.959+0000 7fd326fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T12:03:05.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.963+0000 7fd4729af9c0 20 remove_watcher() i=0 2024-09-19T12:03:05.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.963+0000 7fd4729af9c0 2 removed watcher, disabling cache 2024-09-19T12:03:05.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.963+0000 7fd4729af9c0 20 remove_watcher() i=1 2024-09-19T12:03:05.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.963+0000 7fd4729af9c0 20 remove_watcher() i=2 2024-09-19T12:03:05.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.963+0000 7fd4729af9c0 20 remove_watcher() i=3 2024-09-19T12:03:05.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.967+0000 7fd4729af9c0 20 remove_watcher() i=4 2024-09-19T12:03:05.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.967+0000 7fd4729af9c0 20 remove_watcher() i=5 2024-09-19T12:03:05.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.967+0000 7fd4729af9c0 20 remove_watcher() i=6 2024-09-19T12:03:05.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T12:03:05.967+0000 7fd4729af9c0 20 remove_watcher() i=7 2024-09-19T12:03:05.979 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-19T12:03:05.990 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-19T12:03:06.003 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T12:03:06.003 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T12:03:06.365 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T12:03:06.376 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T12:03:06.383 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":1094,"stamp":"2024-09-19T12:03:05.384692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":260082274,"num_objects":1039,"num_object_clones":0,"num_object_copies":3596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1039,"num_whiteouts":0,"num_read":29217,"num_read_kb":495654,"num_write":20190,"num_write_kb":408755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7769,"ondisk_log_size":7769,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1480008,"kb_used_data":468488,"kb_used_omap":12,"kb_used_meta":1011379,"kb_avail":753494712,"statfs":{"total":773094113280,"available":771578585088,"internally_reserved":0,"allocated":479731712,"data_stored":464002278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1035652656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008657"},"pg_stats":[{"pgid":"67.1d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.590975+0000","last_change":"2024-09-19T11:53:37.745334+0000","last_active":"2024-09-19T11:58:36.590975+0000","last_peered":"2024-09-19T11:58:36.590975+0000","last_clean":"2024-09-19T11:58:36.590975+0000","last_became_active":"2024-09-19T11:53:37.744679+0000","last_became_peered":"2024-09-19T11:53:37.744679+0000","last_unstale":"2024-09-19T11:58:36.590975+0000","last_undegraded":"2024-09-19T11:58:36.590975+0000","last_fullsized":"2024-09-19T11:58:36.590975+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:29.888364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.586691+0000","last_change":"2024-09-19T11:53:34.715828+0000","last_active":"2024-09-19T11:58:36.586691+0000","last_peered":"2024-09-19T11:58:36.586691+0000","last_clean":"2024-09-19T11:58:36.586691+0000","last_became_active":"2024-09-19T11:53:34.714946+0000","last_became_peered":"2024-09-19T11:53:34.714946+0000","last_unstale":"2024-09-19T11:58:36.586691+0000","last_undegraded":"2024-09-19T11:58:36.586691+0000","last_fullsized":"2024-09-19T11:58:36.586691+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:46.457012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"256'14","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.615105+0000","last_change":"2024-09-19T11:51:53.494561+0000","last_active":"2024-09-19T12:00:16.615105+0000","last_peered":"2024-09-19T12:00:16.615105+0000","last_clean":"2024-09-19T12:00:16.615105+0000","last_became_active":"2024-09-19T11:51:53.493294+0000","last_became_peered":"2024-09-19T11:51:53.493294+0000","last_unstale":"2024-09-19T12:00:16.615105+0000","last_undegraded":"2024-09-19T12:00:16.615105+0000","last_fullsized":"2024-09-19T12:00:16.615105+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:25.608106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":86,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.785305+0000","last_change":"2024-09-19T11:53:37.715171+0000","last_active":"2024-09-19T11:58:41.785305+0000","last_peered":"2024-09-19T11:58:41.785305+0000","last_clean":"2024-09-19T11:58:41.785305+0000","last_became_active":"2024-09-19T11:53:37.714526+0000","last_became_peered":"2024-09-19T11:53:37.714526+0000","last_unstale":"2024-09-19T11:58:41.785305+0000","last_undegraded":"2024-09-19T11:58:41.785305+0000","last_fullsized":"2024-09-19T11:58:41.785305+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:47:00.837259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.579334+0000","last_change":"2024-09-19T11:53:34.730623+0000","last_active":"2024-09-19T11:58:36.579334+0000","last_peered":"2024-09-19T11:58:36.579334+0000","last_clean":"2024-09-19T11:58:36.579334+0000","last_became_active":"2024-09-19T11:53:34.730025+0000","last_became_peered":"2024-09-19T11:53:34.730025+0000","last_unstale":"2024-09-19T11:58:36.579334+0000","last_undegraded":"2024-09-19T11:58:36.579334+0000","last_fullsized":"2024-09-19T11:58:36.579334+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:52.233686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.596619+0000","last_change":"2024-09-19T11:51:53.495233+0000","last_active":"2024-09-19T11:59:56.596619+0000","last_peered":"2024-09-19T11:59:56.596619+0000","last_clean":"2024-09-19T11:59:56.596619+0000","last_became_active":"2024-09-19T11:51:53.494552+0000","last_became_peered":"2024-09-19T11:51:53.494552+0000","last_unstale":"2024-09-19T11:59:56.596619+0000","last_undegraded":"2024-09-19T11:59:56.596619+0000","last_fullsized":"2024-09-19T11:59:56.596619+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:17.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.610306+0000","last_change":"2024-09-19T11:53:37.760242+0000","last_active":"2024-09-19T11:59:56.610306+0000","last_peered":"2024-09-19T11:59:56.610306+0000","last_clean":"2024-09-19T11:59:56.610306+0000","last_became_active":"2024-09-19T11:53:37.757767+0000","last_became_peered":"2024-09-19T11:53:37.757767+0000","last_unstale":"2024-09-19T11:59:56.610306+0000","last_undegraded":"2024-09-19T11:59:56.610306+0000","last_fullsized":"2024-09-19T11:59:56.610306+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:53:27.455399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.592459+0000","last_change":"2024-09-19T11:53:34.712290+0000","last_active":"2024-09-19T11:59:36.592459+0000","last_peered":"2024-09-19T11:59:36.592459+0000","last_clean":"2024-09-19T11:59:36.592459+0000","last_became_active":"2024-09-19T11:53:34.711510+0000","last_became_peered":"2024-09-19T11:53:34.711510+0000","last_unstale":"2024-09-19T11:59:36.592459+0000","last_undegraded":"2024-09-19T11:59:36.592459+0000","last_fullsized":"2024-09-19T11:59:36.592459+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:51.007502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.603011+0000","last_change":"2024-09-19T11:51:53.480345+0000","last_active":"2024-09-19T11:59:26.603011+0000","last_peered":"2024-09-19T11:59:26.603011+0000","last_clean":"2024-09-19T11:59:26.603011+0000","last_became_active":"2024-09-19T11:51:53.479659+0000","last_became_peered":"2024-09-19T11:51:53.479659+0000","last_unstale":"2024-09-19T11:59:26.603011+0000","last_undegraded":"2024-09-19T11:59:26.603011+0000","last_fullsized":"2024-09-19T11:59:26.603011+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:02.230797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.601507+0000","last_change":"2024-09-19T11:53:37.758685+0000","last_active":"2024-09-19T11:59:41.601507+0000","last_peered":"2024-09-19T11:59:41.601507+0000","last_clean":"2024-09-19T11:59:41.601507+0000","last_became_active":"2024-09-19T11:53:37.756047+0000","last_became_peered":"2024-09-19T11:53:37.756047+0000","last_unstale":"2024-09-19T11:59:41.601507+0000","last_undegraded":"2024-09-19T11:59:41.601507+0000","last_fullsized":"2024-09-19T11:59:41.601507+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:44.645097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.800925+0000","last_change":"2024-09-19T11:53:34.706109+0000","last_active":"2024-09-19T11:59:51.800925+0000","last_peered":"2024-09-19T11:59:51.800925+0000","last_clean":"2024-09-19T11:59:51.800925+0000","last_became_active":"2024-09-19T11:53:34.705364+0000","last_became_peered":"2024-09-19T11:53:34.705364+0000","last_unstale":"2024-09-19T11:59:51.800925+0000","last_undegraded":"2024-09-19T11:59:51.800925+0000","last_fullsized":"2024-09-19T11:59:51.800925+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:58:24.677448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.597881+0000","last_change":"2024-09-19T11:51:53.477170+0000","last_active":"2024-09-19T11:59:26.597881+0000","last_peered":"2024-09-19T11:59:26.597881+0000","last_clean":"2024-09-19T11:59:26.597881+0000","last_became_active":"2024-09-19T11:51:53.475807+0000","last_became_peered":"2024-09-19T11:51:53.475807+0000","last_unstale":"2024-09-19T11:59:26.597881+0000","last_undegraded":"2024-09-19T11:59:26.597881+0000","last_fullsized":"2024-09-19T11:59:26.597881+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:44.084226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.589586+0000","last_change":"2024-09-19T11:53:37.733871+0000","last_active":"2024-09-19T11:58:31.589586+0000","last_peered":"2024-09-19T11:58:31.589586+0000","last_clean":"2024-09-19T11:58:31.589586+0000","last_became_active":"2024-09-19T11:53:37.733244+0000","last_became_peered":"2024-09-19T11:53:37.733244+0000","last_unstale":"2024-09-19T11:58:31.589586+0000","last_undegraded":"2024-09-19T11:58:31.589586+0000","last_fullsized":"2024-09-19T11:58:31.589586+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:59.898211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.589239+0000","last_change":"2024-09-19T11:53:34.723027+0000","last_active":"2024-09-19T11:58:26.589239+0000","last_peered":"2024-09-19T11:58:26.589239+0000","last_clean":"2024-09-19T11:58:26.589239+0000","last_became_active":"2024-09-19T11:53:34.722143+0000","last_became_peered":"2024-09-19T11:53:34.722143+0000","last_unstale":"2024-09-19T11:58:26.589239+0000","last_undegraded":"2024-09-19T11:58:26.589239+0000","last_fullsized":"2024-09-19T11:58:26.589239+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:35.362037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"256'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.597786+0000","last_change":"2024-09-19T11:51:53.497903+0000","last_active":"2024-09-19T11:59:26.597786+0000","last_peered":"2024-09-19T11:59:26.597786+0000","last_clean":"2024-09-19T11:59:26.597786+0000","last_became_active":"2024-09-19T11:51:53.496828+0000","last_became_peered":"2024-09-19T11:51:53.496828+0000","last_unstale":"2024-09-19T11:59:26.597786+0000","last_undegraded":"2024-09-19T11:59:26.597786+0000","last_fullsized":"2024-09-19T11:59:26.597786+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:33:53.888475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.18","version":"262'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.590468+0000","last_change":"2024-09-19T11:53:37.752259+0000","last_active":"2024-09-19T11:58:31.590468+0000","last_peered":"2024-09-19T11:58:31.590468+0000","last_clean":"2024-09-19T11:58:31.590468+0000","last_became_active":"2024-09-19T11:53:37.751550+0000","last_became_peered":"2024-09-19T11:53:37.751550+0000","last_unstale":"2024-09-19T11:58:31.590468+0000","last_undegraded":"2024-09-19T11:58:31.590468+0000","last_fullsized":"2024-09-19T11:58:31.590468+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:24.886099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":20480,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'1","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.781501+0000","last_change":"2024-09-19T11:53:34.700220+0000","last_active":"2024-09-19T11:58:26.781501+0000","last_peered":"2024-09-19T11:58:26.781501+0000","last_clean":"2024-09-19T11:58:26.781501+0000","last_became_active":"2024-09-19T11:53:34.699476+0000","last_became_peered":"2024-09-19T11:53:34.699476+0000","last_unstale":"2024-09-19T11:58:26.781501+0000","last_undegraded":"2024-09-19T11:58:26.781501+0000","last_fullsized":"2024-09-19T11:58:26.781501+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:31.463060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2046,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.602602+0000","last_change":"2024-09-19T11:51:53.469668+0000","last_active":"2024-09-19T11:59:26.602602+0000","last_peered":"2024-09-19T11:59:26.602602+0000","last_clean":"2024-09-19T11:59:26.602602+0000","last_became_active":"2024-09-19T11:51:53.468220+0000","last_became_peered":"2024-09-19T11:51:53.468220+0000","last_unstale":"2024-09-19T11:59:26.602602+0000","last_undegraded":"2024-09-19T11:59:26.602602+0000","last_fullsized":"2024-09-19T11:59:26.602602+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:15.153859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.592905+0000","last_change":"2024-09-19T11:53:37.734780+0000","last_active":"2024-09-19T11:58:41.592905+0000","last_peered":"2024-09-19T11:58:41.592905+0000","last_clean":"2024-09-19T11:58:41.592905+0000","last_became_active":"2024-09-19T11:53:37.733461+0000","last_became_peered":"2024-09-19T11:53:37.733461+0000","last_unstale":"2024-09-19T11:58:41.592905+0000","last_undegraded":"2024-09-19T11:58:41.592905+0000","last_fullsized":"2024-09-19T11:58:41.592905+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:09.138836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.784017+0000","last_change":"2024-09-19T11:53:34.711700+0000","last_active":"2024-09-19T11:58:36.784017+0000","last_peered":"2024-09-19T11:58:36.784017+0000","last_clean":"2024-09-19T11:58:36.784017+0000","last_became_active":"2024-09-19T11:53:34.711125+0000","last_became_peered":"2024-09-19T11:53:34.711125+0000","last_unstale":"2024-09-19T11:58:36.784017+0000","last_undegraded":"2024-09-19T11:58:36.784017+0000","last_fullsized":"2024-09-19T11:58:36.784017+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:23.766743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.599515+0000","last_change":"2024-09-19T11:51:53.498330+0000","last_active":"2024-09-19T11:59:11.599515+0000","last_peered":"2024-09-19T11:59:11.599515+0000","last_clean":"2024-09-19T11:59:11.599515+0000","last_became_active":"2024-09-19T11:51:53.497559+0000","last_became_peered":"2024-09-19T11:51:53.497559+0000","last_unstale":"2024-09-19T11:59:11.599515+0000","last_undegraded":"2024-09-19T11:59:11.599515+0000","last_fullsized":"2024-09-19T11:59:11.599515+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:57.123428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.587788+0000","last_change":"2024-09-19T11:53:37.760079+0000","last_active":"2024-09-19T11:58:41.587788+0000","last_peered":"2024-09-19T11:58:41.587788+0000","last_clean":"2024-09-19T11:58:41.587788+0000","last_became_active":"2024-09-19T11:53:37.759079+0000","last_became_peered":"2024-09-19T11:53:37.759079+0000","last_unstale":"2024-09-19T11:58:41.587788+0000","last_undegraded":"2024-09-19T11:58:41.587788+0000","last_fullsized":"2024-09-19T11:58:41.587788+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:55.874038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.592016+0000","last_change":"2024-09-19T11:53:34.732158+0000","last_active":"2024-09-19T11:58:36.592016+0000","last_peered":"2024-09-19T11:58:36.592016+0000","last_clean":"2024-09-19T11:58:36.592016+0000","last_became_active":"2024-09-19T11:53:34.722675+0000","last_became_peered":"2024-09-19T11:53:34.722675+0000","last_unstale":"2024-09-19T11:58:36.592016+0000","last_undegraded":"2024-09-19T11:58:36.592016+0000","last_fullsized":"2024-09-19T11:58:36.592016+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:13.301780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":21504,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.586361+0000","last_change":"2024-09-19T11:51:53.486009+0000","last_active":"2024-09-19T11:59:11.586361+0000","last_peered":"2024-09-19T11:59:11.586361+0000","last_clean":"2024-09-19T11:59:11.586361+0000","last_became_active":"2024-09-19T11:51:53.485176+0000","last_became_peered":"2024-09-19T11:51:53.485176+0000","last_unstale":"2024-09-19T11:59:11.586361+0000","last_undegraded":"2024-09-19T11:59:11.586361+0000","last_fullsized":"2024-09-19T11:59:11.586361+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:32.437601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.585506+0000","last_change":"2024-09-19T11:53:37.738229+0000","last_active":"2024-09-19T11:58:31.585506+0000","last_peered":"2024-09-19T11:58:31.585506+0000","last_clean":"2024-09-19T11:58:31.585506+0000","last_became_active":"2024-09-19T11:53:37.735681+0000","last_became_peered":"2024-09-19T11:53:37.735681+0000","last_unstale":"2024-09-19T11:58:31.585506+0000","last_undegraded":"2024-09-19T11:58:31.585506+0000","last_fullsized":"2024-09-19T11:58:31.585506+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:26.373362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619176+0000","last_change":"2024-09-19T11:53:34.709295+0000","last_active":"2024-09-19T12:00:41.619176+0000","last_peered":"2024-09-19T12:00:41.619176+0000","last_clean":"2024-09-19T12:00:41.619176+0000","last_became_active":"2024-09-19T11:53:34.708831+0000","last_became_peered":"2024-09-19T11:53:34.708831+0000","last_unstale":"2024-09-19T12:00:41.619176+0000","last_undegraded":"2024-09-19T12:00:41.619176+0000","last_fullsized":"2024-09-19T12:00:41.619176+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:25.795767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.599708+0000","last_change":"2024-09-19T11:51:53.499050+0000","last_active":"2024-09-19T11:59:11.599708+0000","last_peered":"2024-09-19T11:59:11.599708+0000","last_clean":"2024-09-19T11:59:11.599708+0000","last_became_active":"2024-09-19T11:51:53.498327+0000","last_became_peered":"2024-09-19T11:51:53.498327+0000","last_unstale":"2024-09-19T11:59:11.599708+0000","last_undegraded":"2024-09-19T11:59:11.599708+0000","last_fullsized":"2024-09-19T11:59:11.599708+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:49.722787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615207+0000","last_change":"2024-09-19T11:53:37.755767+0000","last_active":"2024-09-19T12:00:41.615207+0000","last_peered":"2024-09-19T12:00:41.615207+0000","last_clean":"2024-09-19T12:00:41.615207+0000","last_became_active":"2024-09-19T11:53:37.754753+0000","last_became_peered":"2024-09-19T11:53:37.754753+0000","last_unstale":"2024-09-19T12:00:41.615207+0000","last_undegraded":"2024-09-19T12:00:41.615207+0000","last_fullsized":"2024-09-19T12:00:41.615207+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:22.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.592245+0000","last_change":"2024-09-19T11:53:34.720643+0000","last_active":"2024-09-19T11:58:26.592245+0000","last_peered":"2024-09-19T11:58:26.592245+0000","last_clean":"2024-09-19T11:58:26.592245+0000","last_became_active":"2024-09-19T11:53:34.720273+0000","last_became_peered":"2024-09-19T11:53:34.720273+0000","last_unstale":"2024-09-19T11:58:26.592245+0000","last_undegraded":"2024-09-19T11:58:26.592245+0000","last_fullsized":"2024-09-19T11:58:26.592245+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:26.226182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"255'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.594417+0000","last_change":"2024-09-19T11:51:53.497665+0000","last_active":"2024-09-19T11:59:11.594417+0000","last_peered":"2024-09-19T11:59:11.594417+0000","last_clean":"2024-09-19T11:59:11.594417+0000","last_became_active":"2024-09-19T11:51:53.496988+0000","last_became_peered":"2024-09-19T11:51:53.496988+0000","last_unstale":"2024-09-19T11:59:11.594417+0000","last_undegraded":"2024-09-19T11:59:11.594417+0000","last_fullsized":"2024-09-19T11:59:11.594417+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:42.583270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.17","version":"262'3","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.585554+0000","last_change":"2024-09-19T11:53:37.759921+0000","last_active":"2024-09-19T11:58:31.585554+0000","last_peered":"2024-09-19T11:58:31.585554+0000","last_clean":"2024-09-19T11:58:31.585554+0000","last_became_active":"2024-09-19T11:53:37.759275+0000","last_became_peered":"2024-09-19T11:53:37.759275+0000","last_unstale":"2024-09-19T11:58:31.585554+0000","last_undegraded":"2024-09-19T11:58:31.585554+0000","last_fullsized":"2024-09-19T11:58:31.585554+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:06.314026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":4096,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.578842+0000","last_change":"2024-09-19T11:53:34.700207+0000","last_active":"2024-09-19T11:58:26.578842+0000","last_peered":"2024-09-19T11:58:26.578842+0000","last_clean":"2024-09-19T11:58:26.578842+0000","last_became_active":"2024-09-19T11:53:34.699437+0000","last_became_peered":"2024-09-19T11:53:34.699437+0000","last_unstale":"2024-09-19T11:58:26.578842+0000","last_undegraded":"2024-09-19T11:58:26.578842+0000","last_fullsized":"2024-09-19T11:58:26.578842+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:54:30.963407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"256'23","reported_seq":100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.587246+0000","last_change":"2024-09-19T11:51:53.479917+0000","last_active":"2024-09-19T11:59:11.587246+0000","last_peered":"2024-09-19T11:59:11.587246+0000","last_clean":"2024-09-19T11:59:11.587246+0000","last_became_active":"2024-09-19T11:51:53.478643+0000","last_became_peered":"2024-09-19T11:51:53.478643+0000","last_unstale":"2024-09-19T11:59:11.587246+0000","last_undegraded":"2024-09-19T11:59:11.587246+0000","last_fullsized":"2024-09-19T11:59:11.587246+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:31.580713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":169,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.782900+0000","last_change":"2024-09-19T11:53:37.737666+0000","last_active":"2024-09-19T11:58:31.782900+0000","last_peered":"2024-09-19T11:58:31.782900+0000","last_clean":"2024-09-19T11:58:31.782900+0000","last_became_active":"2024-09-19T11:53:37.737215+0000","last_became_peered":"2024-09-19T11:53:37.737215+0000","last_unstale":"2024-09-19T11:58:31.782900+0000","last_undegraded":"2024-09-19T11:58:31.782900+0000","last_fullsized":"2024-09-19T11:58:31.782900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:58.237583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"262'4","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.589560+0000","last_change":"2024-09-19T11:53:34.732001+0000","last_active":"2024-09-19T11:58:26.589560+0000","last_peered":"2024-09-19T11:58:26.589560+0000","last_clean":"2024-09-19T11:58:26.589560+0000","last_became_active":"2024-09-19T11:53:34.723850+0000","last_became_peered":"2024-09-19T11:53:34.723850+0000","last_unstale":"2024-09-19T11:58:26.589560+0000","last_undegraded":"2024-09-19T11:58:26.589560+0000","last_fullsized":"2024-09-19T11:58:26.589560+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:50:09.990299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599872+0000","last_change":"2024-09-19T11:51:53.479627+0000","last_active":"2024-09-19T11:58:56.599872+0000","last_peered":"2024-09-19T11:58:56.599872+0000","last_clean":"2024-09-19T11:58:56.599872+0000","last_became_active":"2024-09-19T11:51:53.478922+0000","last_became_peered":"2024-09-19T11:51:53.478922+0000","last_unstale":"2024-09-19T11:58:56.599872+0000","last_undegraded":"2024-09-19T11:58:56.599872+0000","last_fullsized":"2024-09-19T11:58:56.599872+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:56.192816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607351+0000","last_change":"2024-09-19T11:53:37.742835+0000","last_active":"2024-09-19T12:00:41.607351+0000","last_peered":"2024-09-19T12:00:41.607351+0000","last_clean":"2024-09-19T12:00:41.607351+0000","last_became_active":"2024-09-19T11:53:37.734844+0000","last_became_peered":"2024-09-19T11:53:37.734844+0000","last_unstale":"2024-09-19T12:00:41.607351+0000","last_undegraded":"2024-09-19T12:00:41.607351+0000","last_fullsized":"2024-09-19T12:00:41.607351+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:22.920456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810733+0000","last_change":"2024-09-19T11:53:34.707106+0000","last_active":"2024-09-19T12:00:36.810733+0000","last_peered":"2024-09-19T12:00:36.810733+0000","last_clean":"2024-09-19T12:00:36.810733+0000","last_became_active":"2024-09-19T11:53:34.704150+0000","last_became_peered":"2024-09-19T11:53:34.704150+0000","last_unstale":"2024-09-19T12:00:36.810733+0000","last_undegraded":"2024-09-19T12:00:36.810733+0000","last_fullsized":"2024-09-19T12:00:36.810733+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:33.641088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599814+0000","last_change":"2024-09-19T11:51:53.481885+0000","last_active":"2024-09-19T11:58:56.599814+0000","last_peered":"2024-09-19T11:58:56.599814+0000","last_clean":"2024-09-19T11:58:56.599814+0000","last_became_active":"2024-09-19T11:51:53.481154+0000","last_became_peered":"2024-09-19T11:51:53.481154+0000","last_unstale":"2024-09-19T11:58:56.599814+0000","last_undegraded":"2024-09-19T11:58:56.599814+0000","last_fullsized":"2024-09-19T11:58:56.599814+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:33.647811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607252+0000","last_change":"2024-09-19T11:53:37.731071+0000","last_active":"2024-09-19T12:00:41.607252+0000","last_peered":"2024-09-19T12:00:41.607252+0000","last_clean":"2024-09-19T12:00:41.607252+0000","last_became_active":"2024-09-19T11:53:37.730152+0000","last_became_peered":"2024-09-19T11:53:37.730152+0000","last_unstale":"2024-09-19T12:00:41.607252+0000","last_undegraded":"2024-09-19T12:00:41.607252+0000","last_fullsized":"2024-09-19T12:00:41.607252+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:14:21.099777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.613805+0000","last_change":"2024-09-19T11:53:34.704187+0000","last_active":"2024-09-19T12:00:36.613805+0000","last_peered":"2024-09-19T12:00:36.613805+0000","last_clean":"2024-09-19T12:00:36.613805+0000","last_became_active":"2024-09-19T11:53:34.703463+0000","last_became_peered":"2024-09-19T11:53:34.703463+0000","last_unstale":"2024-09-19T12:00:36.613805+0000","last_undegraded":"2024-09-19T12:00:36.613805+0000","last_fullsized":"2024-09-19T12:00:36.613805+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:28.756801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.595963+0000","last_change":"2024-09-19T11:51:53.491344+0000","last_active":"2024-09-19T11:58:56.595963+0000","last_peered":"2024-09-19T11:58:56.595963+0000","last_clean":"2024-09-19T11:58:56.595963+0000","last_became_active":"2024-09-19T11:51:53.490650+0000","last_became_peered":"2024-09-19T11:51:53.490650+0000","last_unstale":"2024-09-19T11:58:56.595963+0000","last_undegraded":"2024-09-19T11:58:56.595963+0000","last_fullsized":"2024-09-19T11:58:56.595963+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:53.773642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615178+0000","last_change":"2024-09-19T11:53:37.759763+0000","last_active":"2024-09-19T12:00:41.615178+0000","last_peered":"2024-09-19T12:00:41.615178+0000","last_clean":"2024-09-19T12:00:41.615178+0000","last_became_active":"2024-09-19T11:53:37.755628+0000","last_became_peered":"2024-09-19T11:53:37.755628+0000","last_unstale":"2024-09-19T12:00:41.615178+0000","last_undegraded":"2024-09-19T12:00:41.615178+0000","last_fullsized":"2024-09-19T12:00:41.615178+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:25.674366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244926,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5122,"num_write":8,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618477+0000","last_change":"2024-09-19T11:53:34.708167+0000","last_active":"2024-09-19T12:00:36.618477+0000","last_peered":"2024-09-19T12:00:36.618477+0000","last_clean":"2024-09-19T12:00:36.618477+0000","last_became_active":"2024-09-19T11:53:34.707412+0000","last_became_peered":"2024-09-19T11:53:34.707412+0000","last_unstale":"2024-09-19T12:00:36.618477+0000","last_undegraded":"2024-09-19T12:00:36.618477+0000","last_fullsized":"2024-09-19T12:00:36.618477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:27.815287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"256'7","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.788702+0000","last_change":"2024-09-19T11:51:53.464544+0000","last_active":"2024-09-19T11:58:56.788702+0000","last_peered":"2024-09-19T11:58:56.788702+0000","last_clean":"2024-09-19T11:58:56.788702+0000","last_became_active":"2024-09-19T11:51:53.463784+0000","last_became_peered":"2024-09-19T11:51:53.463784+0000","last_unstale":"2024-09-19T11:58:56.788702+0000","last_undegraded":"2024-09-19T11:58:56.788702+0000","last_fullsized":"2024-09-19T11:58:56.788702+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:17.326366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.12","version":"262'2","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619685+0000","last_change":"2024-09-19T11:53:37.744463+0000","last_active":"2024-09-19T12:00:41.619685+0000","last_peered":"2024-09-19T12:00:41.619685+0000","last_clean":"2024-09-19T12:00:41.619685+0000","last_became_active":"2024-09-19T11:53:37.743807+0000","last_became_peered":"2024-09-19T11:53:37.743807+0000","last_unstale":"2024-09-19T12:00:41.619685+0000","last_undegraded":"2024-09-19T12:00:41.619685+0000","last_fullsized":"2024-09-19T12:00:41.619685+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:37.688342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.617873+0000","last_change":"2024-09-19T11:53:34.706511+0000","last_active":"2024-09-19T12:00:36.617873+0000","last_peered":"2024-09-19T12:00:36.617873+0000","last_clean":"2024-09-19T12:00:36.617873+0000","last_became_active":"2024-09-19T11:53:34.705705+0000","last_became_peered":"2024-09-19T11:53:34.705705+0000","last_unstale":"2024-09-19T12:00:36.617873+0000","last_undegraded":"2024-09-19T12:00:36.617873+0000","last_fullsized":"2024-09-19T12:00:36.617873+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:28.349619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.590471+0000","last_change":"2024-09-19T11:51:53.488994+0000","last_active":"2024-09-19T11:58:56.590471+0000","last_peered":"2024-09-19T11:58:56.590471+0000","last_clean":"2024-09-19T11:58:56.590471+0000","last_became_active":"2024-09-19T11:51:53.488252+0000","last_became_peered":"2024-09-19T11:51:53.488252+0000","last_unstale":"2024-09-19T11:58:56.590471+0000","last_undegraded":"2024-09-19T11:58:56.590471+0000","last_fullsized":"2024-09-19T11:58:56.590471+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:14.331678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.d","version":"262'3","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611701+0000","last_change":"2024-09-19T11:53:37.755108+0000","last_active":"2024-09-19T12:00:26.611701+0000","last_peered":"2024-09-19T12:00:26.611701+0000","last_clean":"2024-09-19T12:00:26.611701+0000","last_became_active":"2024-09-19T11:53:37.754497+0000","last_became_peered":"2024-09-19T11:53:37.754497+0000","last_unstale":"2024-09-19T12:00:26.611701+0000","last_undegraded":"2024-09-19T12:00:26.611701+0000","last_fullsized":"2024-09-19T12:00:26.611701+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:38.404433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":20480,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"262'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.618125+0000","last_change":"2024-09-19T11:53:34.721569+0000","last_active":"2024-09-19T12:00:21.618125+0000","last_peered":"2024-09-19T12:00:21.618125+0000","last_clean":"2024-09-19T12:00:21.618125+0000","last_became_active":"2024-09-19T11:53:34.721070+0000","last_became_peered":"2024-09-19T11:53:34.721070+0000","last_unstale":"2024-09-19T12:00:21.618125+0000","last_undegraded":"2024-09-19T12:00:21.618125+0000","last_fullsized":"2024-09-19T12:00:21.618125+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:11.145675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":25600,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"256'23","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.587947+0000","last_change":"2024-09-19T11:51:53.490847+0000","last_active":"2024-09-19T11:58:41.587947+0000","last_peered":"2024-09-19T11:58:41.587947+0000","last_clean":"2024-09-19T11:58:41.587947+0000","last_became_active":"2024-09-19T11:51:53.490074+0000","last_became_peered":"2024-09-19T11:51:53.490074+0000","last_unstale":"2024-09-19T11:58:41.587947+0000","last_undegraded":"2024-09-19T11:58:41.587947+0000","last_fullsized":"2024-09-19T11:58:41.587947+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:25.990044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":156,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611634+0000","last_change":"2024-09-19T11:53:37.759926+0000","last_active":"2024-09-19T12:00:26.611634+0000","last_peered":"2024-09-19T12:00:26.611634+0000","last_clean":"2024-09-19T12:00:26.611634+0000","last_became_active":"2024-09-19T11:53:37.758965+0000","last_became_peered":"2024-09-19T11:53:37.758965+0000","last_unstale":"2024-09-19T12:00:26.611634+0000","last_undegraded":"2024-09-19T12:00:26.611634+0000","last_fullsized":"2024-09-19T12:00:26.611634+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:35.768438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.601997+0000","last_change":"2024-09-19T11:53:34.730214+0000","last_active":"2024-09-19T12:00:21.601997+0000","last_peered":"2024-09-19T12:00:21.601997+0000","last_clean":"2024-09-19T12:00:21.601997+0000","last_became_active":"2024-09-19T11:53:34.729772+0000","last_became_peered":"2024-09-19T11:53:34.729772+0000","last_unstale":"2024-09-19T12:00:21.601997+0000","last_undegraded":"2024-09-19T12:00:21.601997+0000","last_fullsized":"2024-09-19T12:00:21.601997+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:08.302177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.592249+0000","last_change":"2024-09-19T11:51:53.480445+0000","last_active":"2024-09-19T11:58:41.592249+0000","last_peered":"2024-09-19T11:58:41.592249+0000","last_clean":"2024-09-19T11:58:41.592249+0000","last_became_active":"2024-09-19T11:51:53.479490+0000","last_became_peered":"2024-09-19T11:51:53.479490+0000","last_unstale":"2024-09-19T11:58:41.592249+0000","last_undegraded":"2024-09-19T11:58:41.592249+0000","last_fullsized":"2024-09-19T11:58:41.592249+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:37.406182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.605040+0000","last_change":"2024-09-19T11:53:37.731450+0000","last_active":"2024-09-19T12:00:31.605040+0000","last_peered":"2024-09-19T12:00:31.605040+0000","last_clean":"2024-09-19T12:00:31.605040+0000","last_became_active":"2024-09-19T11:53:37.730671+0000","last_became_peered":"2024-09-19T11:53:37.730671+0000","last_unstale":"2024-09-19T12:00:31.605040+0000","last_undegraded":"2024-09-19T12:00:31.605040+0000","last_fullsized":"2024-09-19T12:00:31.605040+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:37.080584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.616273+0000","last_change":"2024-09-19T11:53:34.722175+0000","last_active":"2024-09-19T12:00:21.616273+0000","last_peered":"2024-09-19T12:00:21.616273+0000","last_clean":"2024-09-19T12:00:21.616273+0000","last_became_active":"2024-09-19T11:53:34.720160+0000","last_became_peered":"2024-09-19T11:53:34.720160+0000","last_unstale":"2024-09-19T12:00:21.616273+0000","last_undegraded":"2024-09-19T12:00:21.616273+0000","last_fullsized":"2024-09-19T12:00:21.616273+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:52:58.935663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":4096,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.592954+0000","last_change":"2024-09-19T11:51:53.484469+0000","last_active":"2024-09-19T11:58:41.592954+0000","last_peered":"2024-09-19T11:58:41.592954+0000","last_clean":"2024-09-19T11:58:41.592954+0000","last_became_active":"2024-09-19T11:51:53.483786+0000","last_became_peered":"2024-09-19T11:51:53.483786+0000","last_unstale":"2024-09-19T11:58:41.592954+0000","last_undegraded":"2024-09-19T11:58:41.592954+0000","last_fullsized":"2024-09-19T11:58:41.592954+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:34.978547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611748+0000","last_change":"2024-09-19T11:53:37.745246+0000","last_active":"2024-09-19T12:00:26.611748+0000","last_peered":"2024-09-19T12:00:26.611748+0000","last_clean":"2024-09-19T12:00:26.611748+0000","last_became_active":"2024-09-19T11:53:37.739838+0000","last_became_peered":"2024-09-19T11:53:37.739838+0000","last_unstale":"2024-09-19T12:00:26.611748+0000","last_undegraded":"2024-09-19T12:00:26.611748+0000","last_fullsized":"2024-09-19T12:00:26.611748+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:07.343317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603804+0000","last_change":"2024-09-19T11:53:34.709512+0000","last_active":"2024-09-19T12:00:26.603804+0000","last_peered":"2024-09-19T12:00:26.603804+0000","last_clean":"2024-09-19T12:00:26.603804+0000","last_became_active":"2024-09-19T11:53:34.708542+0000","last_became_peered":"2024-09-19T11:53:34.708542+0000","last_unstale":"2024-09-19T12:00:26.603804+0000","last_undegraded":"2024-09-19T12:00:26.603804+0000","last_fullsized":"2024-09-19T12:00:26.603804+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:09.314949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.581698+0000","last_change":"2024-09-19T11:51:53.479663+0000","last_active":"2024-09-19T11:58:41.581698+0000","last_peered":"2024-09-19T11:58:41.581698+0000","last_clean":"2024-09-19T11:58:41.581698+0000","last_became_active":"2024-09-19T11:51:53.478940+0000","last_became_peered":"2024-09-19T11:51:53.478940+0000","last_unstale":"2024-09-19T11:58:41.581698+0000","last_undegraded":"2024-09-19T11:58:41.581698+0000","last_fullsized":"2024-09-19T11:58:41.581698+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:59.776490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.9","version":"262'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.805174+0000","last_change":"2024-09-19T11:54:08.215698+0000","last_active":"2024-09-19T12:00:11.805174+0000","last_peered":"2024-09-19T12:00:11.805174+0000","last_clean":"2024-09-19T12:00:11.805174+0000","last_became_active":"2024-09-19T11:54:08.143092+0000","last_became_peered":"2024-09-19T11:54:08.143092+0000","last_unstale":"2024-09-19T12:00:11.805174+0000","last_undegraded":"2024-09-19T12:00:11.805174+0000","last_fullsized":"2024-09-19T12:00:11.805174+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:06.545326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":26624,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.612462+0000","last_change":"2024-09-19T11:53:34.723264+0000","last_active":"2024-09-19T12:00:06.612462+0000","last_peered":"2024-09-19T12:00:06.612462+0000","last_clean":"2024-09-19T12:00:06.612462+0000","last_became_active":"2024-09-19T11:53:34.722786+0000","last_became_peered":"2024-09-19T11:53:34.722786+0000","last_unstale":"2024-09-19T12:00:06.612462+0000","last_undegraded":"2024-09-19T12:00:06.612462+0000","last_fullsized":"2024-09-19T12:00:06.612462+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:25:14.671300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.593130+0000","last_change":"2024-09-19T11:51:53.491094+0000","last_active":"2024-09-19T11:58:41.593130+0000","last_peered":"2024-09-19T11:58:41.593130+0000","last_clean":"2024-09-19T11:58:41.593130+0000","last_became_active":"2024-09-19T11:51:53.490467+0000","last_became_peered":"2024-09-19T11:51:53.490467+0000","last_unstale":"2024-09-19T11:58:41.593130+0000","last_undegraded":"2024-09-19T11:58:41.593130+0000","last_fullsized":"2024-09-19T11:58:41.593130+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:52.304018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.615854+0000","last_change":"2024-09-19T11:53:37.739452+0000","last_active":"2024-09-19T12:00:11.615854+0000","last_peered":"2024-09-19T12:00:11.615854+0000","last_clean":"2024-09-19T12:00:11.615854+0000","last_became_active":"2024-09-19T11:53:37.738652+0000","last_became_peered":"2024-09-19T11:53:37.738652+0000","last_unstale":"2024-09-19T12:00:11.615854+0000","last_undegraded":"2024-09-19T12:00:11.615854+0000","last_fullsized":"2024-09-19T12:00:11.615854+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.598691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.598923+0000","last_change":"2024-09-19T11:53:34.709704+0000","last_active":"2024-09-19T12:00:06.598923+0000","last_peered":"2024-09-19T12:00:06.598923+0000","last_clean":"2024-09-19T12:00:06.598923+0000","last_became_active":"2024-09-19T11:53:34.708971+0000","last_became_peered":"2024-09-19T11:53:34.708971+0000","last_unstale":"2024-09-19T12:00:06.598923+0000","last_undegraded":"2024-09-19T12:00:06.598923+0000","last_fullsized":"2024-09-19T12:00:06.598923+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:31.763785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"256'7","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.621385+0000","last_change":"2024-09-19T11:51:53.482164+0000","last_active":"2024-09-19T12:00:36.621385+0000","last_peered":"2024-09-19T12:00:36.621385+0000","last_clean":"2024-09-19T12:00:36.621385+0000","last_became_active":"2024-09-19T11:51:53.481429+0000","last_became_peered":"2024-09-19T11:51:53.481429+0000","last_unstale":"2024-09-19T12:00:36.621385+0000","last_undegraded":"2024-09-19T12:00:36.621385+0000","last_fullsized":"2024-09-19T12:00:36.621385+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:29.346644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":44,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603698+0000","last_change":"2024-09-19T11:53:37.743123+0000","last_active":"2024-09-19T12:00:26.603698+0000","last_peered":"2024-09-19T12:00:26.603698+0000","last_clean":"2024-09-19T12:00:26.603698+0000","last_became_active":"2024-09-19T11:53:37.742403+0000","last_became_peered":"2024-09-19T11:53:37.742403+0000","last_unstale":"2024-09-19T12:00:26.603698+0000","last_undegraded":"2024-09-19T12:00:26.603698+0000","last_fullsized":"2024-09-19T12:00:26.603698+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:17.009971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.612531+0000","last_change":"2024-09-19T11:53:34.731804+0000","last_active":"2024-09-19T12:00:06.612531+0000","last_peered":"2024-09-19T12:00:06.612531+0000","last_clean":"2024-09-19T12:00:06.612531+0000","last_became_active":"2024-09-19T11:53:34.728959+0000","last_became_peered":"2024-09-19T11:53:34.728959+0000","last_unstale":"2024-09-19T12:00:06.612531+0000","last_undegraded":"2024-09-19T12:00:06.612531+0000","last_fullsized":"2024-09-19T12:00:06.612531+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:26.270496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.613843+0000","last_change":"2024-09-19T11:51:53.473143+0000","last_active":"2024-09-19T12:00:36.613843+0000","last_peered":"2024-09-19T12:00:36.613843+0000","last_clean":"2024-09-19T12:00:36.613843+0000","last_became_active":"2024-09-19T11:51:53.472485+0000","last_became_peered":"2024-09-19T11:51:53.472485+0000","last_unstale":"2024-09-19T12:00:36.613843+0000","last_undegraded":"2024-09-19T12:00:36.613843+0000","last_fullsized":"2024-09-19T12:00:36.613843+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:05:05.000749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.615948+0000","last_change":"2024-09-19T11:53:37.737715+0000","last_active":"2024-09-19T12:00:11.615948+0000","last_peered":"2024-09-19T12:00:11.615948+0000","last_clean":"2024-09-19T12:00:11.615948+0000","last_became_active":"2024-09-19T11:53:37.736772+0000","last_became_peered":"2024-09-19T11:53:37.736772+0000","last_unstale":"2024-09-19T12:00:11.615948+0000","last_undegraded":"2024-09-19T12:00:11.615948+0000","last_fullsized":"2024-09-19T12:00:11.615948+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:02.929650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'4","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807394+0000","last_change":"2024-09-19T11:53:34.711999+0000","last_active":"2024-09-19T12:00:21.807394+0000","last_peered":"2024-09-19T12:00:21.807394+0000","last_clean":"2024-09-19T12:00:21.807394+0000","last_became_active":"2024-09-19T11:53:34.711382+0000","last_became_peered":"2024-09-19T11:53:34.711382+0000","last_unstale":"2024-09-19T12:00:21.807394+0000","last_undegraded":"2024-09-19T12:00:21.807394+0000","last_fullsized":"2024-09-19T12:00:21.807394+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:31.348728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":9,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618375+0000","last_change":"2024-09-19T11:51:53.487166+0000","last_active":"2024-09-19T12:00:36.618375+0000","last_peered":"2024-09-19T12:00:36.618375+0000","last_clean":"2024-09-19T12:00:36.618375+0000","last_became_active":"2024-09-19T11:51:53.486236+0000","last_became_peered":"2024-09-19T11:51:53.486236+0000","last_unstale":"2024-09-19T12:00:36.618375+0000","last_undegraded":"2024-09-19T12:00:36.618375+0000","last_fullsized":"2024-09-19T12:00:36.618375+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:19.897372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.610219+0000","last_change":"2024-09-19T11:53:37.747251+0000","last_active":"2024-09-19T11:59:56.610219+0000","last_peered":"2024-09-19T11:59:56.610219+0000","last_clean":"2024-09-19T11:59:56.610219+0000","last_became_active":"2024-09-19T11:53:37.745076+0000","last_became_peered":"2024-09-19T11:53:37.745076+0000","last_unstale":"2024-09-19T11:59:56.610219+0000","last_undegraded":"2024-09-19T11:59:56.610219+0000","last_fullsized":"2024-09-19T11:59:56.610219+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:16.840839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611669+0000","last_change":"2024-09-19T11:53:34.720400+0000","last_active":"2024-09-19T11:59:51.611669+0000","last_peered":"2024-09-19T11:59:51.611669+0000","last_clean":"2024-09-19T11:59:51.611669+0000","last_became_active":"2024-09-19T11:53:34.719535+0000","last_became_peered":"2024-09-19T11:53:34.719535+0000","last_unstale":"2024-09-19T11:59:51.611669+0000","last_undegraded":"2024-09-19T11:59:51.611669+0000","last_fullsized":"2024-09-19T11:59:51.611669+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:53.909023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'11","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.619919+0000","last_change":"2024-09-19T11:51:53.486865+0000","last_active":"2024-09-19T12:00:36.619919+0000","last_peered":"2024-09-19T12:00:36.619919+0000","last_clean":"2024-09-19T12:00:36.619919+0000","last_became_active":"2024-09-19T11:51:53.486126+0000","last_became_peered":"2024-09-19T11:51:53.486126+0000","last_unstale":"2024-09-19T12:00:36.619919+0000","last_undegraded":"2024-09-19T12:00:36.619919+0000","last_fullsized":"2024-09-19T12:00:36.619919+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:29.272674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":56,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.610165+0000","last_change":"2024-09-19T11:53:37.749405+0000","last_active":"2024-09-19T11:59:56.610165+0000","last_peered":"2024-09-19T11:59:56.610165+0000","last_clean":"2024-09-19T11:59:56.610165+0000","last_became_active":"2024-09-19T11:53:37.748479+0000","last_became_peered":"2024-09-19T11:53:37.748479+0000","last_unstale":"2024-09-19T11:59:56.610165+0000","last_undegraded":"2024-09-19T11:59:56.610165+0000","last_fullsized":"2024-09-19T11:59:56.610165+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:55.422274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"259'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.595554+0000","last_change":"2024-09-19T11:53:34.721846+0000","last_active":"2024-09-19T11:59:51.595554+0000","last_peered":"2024-09-19T11:59:51.595554+0000","last_clean":"2024-09-19T11:59:51.595554+0000","last_became_active":"2024-09-19T11:53:34.721421+0000","last_became_peered":"2024-09-19T11:53:34.721421+0000","last_unstale":"2024-09-19T11:59:51.595554+0000","last_undegraded":"2024-09-19T11:59:51.595554+0000","last_fullsized":"2024-09-19T11:59:51.595554+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:43:44.169249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618564+0000","last_change":"2024-09-19T11:51:53.469628+0000","last_active":"2024-09-19T12:00:36.618564+0000","last_peered":"2024-09-19T12:00:36.618564+0000","last_clean":"2024-09-19T12:00:36.618564+0000","last_became_active":"2024-09-19T11:51:53.468768+0000","last_became_peered":"2024-09-19T11:51:53.468768+0000","last_unstale":"2024-09-19T12:00:36.618564+0000","last_undegraded":"2024-09-19T12:00:36.618564+0000","last_fullsized":"2024-09-19T12:00:36.618564+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:35.828878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.616066+0000","last_change":"2024-09-19T11:53:37.749695+0000","last_active":"2024-09-19T12:00:11.616066+0000","last_peered":"2024-09-19T12:00:11.616066+0000","last_clean":"2024-09-19T12:00:11.616066+0000","last_became_active":"2024-09-19T11:53:37.749246+0000","last_became_peered":"2024-09-19T11:53:37.749246+0000","last_unstale":"2024-09-19T12:00:11.616066+0000","last_undegraded":"2024-09-19T12:00:11.616066+0000","last_fullsized":"2024-09-19T12:00:11.616066+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:35.006918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.610837+0000","last_change":"2024-09-19T11:53:34.703535+0000","last_active":"2024-09-19T12:00:06.610837+0000","last_peered":"2024-09-19T12:00:06.610837+0000","last_clean":"2024-09-19T12:00:06.610837+0000","last_became_active":"2024-09-19T11:53:34.702356+0000","last_became_peered":"2024-09-19T11:53:34.702356+0000","last_unstale":"2024-09-19T12:00:06.610837+0000","last_undegraded":"2024-09-19T12:00:06.610837+0000","last_fullsized":"2024-09-19T12:00:06.610837+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:05.738912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.617011+0000","last_change":"2024-09-19T11:51:53.484021+0000","last_active":"2024-09-19T12:00:16.617011+0000","last_peered":"2024-09-19T12:00:16.617011+0000","last_clean":"2024-09-19T12:00:16.617011+0000","last_became_active":"2024-09-19T11:51:53.483350+0000","last_became_peered":"2024-09-19T11:51:53.483350+0000","last_unstale":"2024-09-19T12:00:16.617011+0000","last_undegraded":"2024-09-19T12:00:16.617011+0000","last_fullsized":"2024-09-19T12:00:16.617011+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:32.695646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"262'6","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.805332+0000","last_change":"2024-09-19T11:53:37.731037+0000","last_active":"2024-09-19T12:00:11.805332+0000","last_peered":"2024-09-19T12:00:11.805332+0000","last_clean":"2024-09-19T12:00:11.805332+0000","last_became_active":"2024-09-19T11:53:37.730641+0000","last_became_peered":"2024-09-19T11:53:37.730641+0000","last_unstale":"2024-09-19T12:00:11.805332+0000","last_undegraded":"2024-09-19T12:00:11.805332+0000","last_fullsized":"2024-09-19T12:00:11.805332+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:40.518527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":11,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.614943+0000","last_change":"2024-09-19T11:53:34.719873+0000","last_active":"2024-09-19T12:00:06.614943+0000","last_peered":"2024-09-19T12:00:06.614943+0000","last_clean":"2024-09-19T12:00:06.614943+0000","last_became_active":"2024-09-19T11:53:34.719193+0000","last_became_peered":"2024-09-19T11:53:34.719193+0000","last_unstale":"2024-09-19T12:00:06.614943+0000","last_undegraded":"2024-09-19T12:00:06.614943+0000","last_fullsized":"2024-09-19T12:00:06.614943+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:17.922208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"256'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.601313+0000","last_change":"2024-09-19T11:51:53.479626+0000","last_active":"2024-09-19T12:00:16.601313+0000","last_peered":"2024-09-19T12:00:16.601313+0000","last_clean":"2024-09-19T12:00:16.601313+0000","last_became_active":"2024-09-19T11:51:53.476953+0000","last_became_peered":"2024-09-19T11:51:53.476953+0000","last_unstale":"2024-09-19T12:00:16.601313+0000","last_undegraded":"2024-09-19T12:00:16.601313+0000","last_fullsized":"2024-09-19T12:00:16.601313+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:40.063157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1","version":"262'2","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.596656+0000","last_change":"2024-09-19T11:53:37.736521+0000","last_active":"2024-09-19T11:59:56.596656+0000","last_peered":"2024-09-19T11:59:56.596656+0000","last_clean":"2024-09-19T11:59:56.596656+0000","last_became_active":"2024-09-19T11:53:37.731400+0000","last_became_peered":"2024-09-19T11:53:37.731400+0000","last_unstale":"2024-09-19T11:59:56.596656+0000","last_undegraded":"2024-09-19T11:59:56.596656+0000","last_fullsized":"2024-09-19T11:59:56.596656+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:04.607485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.608474+0000","last_change":"2024-09-19T11:53:34.724933+0000","last_active":"2024-09-19T11:59:36.608474+0000","last_peered":"2024-09-19T11:59:36.608474+0000","last_clean":"2024-09-19T11:59:36.608474+0000","last_became_active":"2024-09-19T11:53:34.724406+0000","last_became_peered":"2024-09-19T11:53:34.724406+0000","last_unstale":"2024-09-19T11:59:36.608474+0000","last_undegraded":"2024-09-19T11:59:36.608474+0000","last_fullsized":"2024-09-19T11:59:36.608474+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:26.998520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":21504,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.612913+0000","last_change":"2024-09-19T11:51:53.495205+0000","last_active":"2024-09-19T12:00:16.612913+0000","last_peered":"2024-09-19T12:00:16.612913+0000","last_clean":"2024-09-19T12:00:16.612913+0000","last_became_active":"2024-09-19T11:51:53.494443+0000","last_became_peered":"2024-09-19T11:51:53.494443+0000","last_unstale":"2024-09-19T12:00:16.612913+0000","last_undegraded":"2024-09-19T12:00:16.612913+0000","last_fullsized":"2024-09-19T12:00:16.612913+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:22.980807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.0","version":"262'1","reported_seq":24,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.605163+0000","last_change":"2024-09-19T11:53:37.729810+0000","last_active":"2024-09-19T11:59:41.605163+0000","last_peered":"2024-09-19T11:59:41.605163+0000","last_clean":"2024-09-19T11:59:41.605163+0000","last_became_active":"2024-09-19T11:53:37.729101+0000","last_became_peered":"2024-09-19T11:53:37.729101+0000","last_unstale":"2024-09-19T11:59:41.605163+0000","last_undegraded":"2024-09-19T11:59:41.605163+0000","last_fullsized":"2024-09-19T11:59:41.605163+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:23.824167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"262'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611574+0000","last_change":"2024-09-19T11:53:34.719029+0000","last_active":"2024-09-19T11:59:51.611574+0000","last_peered":"2024-09-19T11:59:51.611574+0000","last_clean":"2024-09-19T11:59:51.611574+0000","last_became_active":"2024-09-19T11:53:34.715905+0000","last_became_peered":"2024-09-19T11:53:34.715905+0000","last_unstale":"2024-09-19T11:59:51.611574+0000","last_undegraded":"2024-09-19T11:59:51.611574+0000","last_fullsized":"2024-09-19T11:59:51.611574+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:06.085056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.806309+0000","last_change":"2024-09-19T11:51:53.485332+0000","last_active":"2024-09-19T12:00:16.806309+0000","last_peered":"2024-09-19T12:00:16.806309+0000","last_clean":"2024-09-19T12:00:16.806309+0000","last_became_active":"2024-09-19T11:51:53.479975+0000","last_became_peered":"2024-09-19T11:51:53.479975+0000","last_unstale":"2024-09-19T12:00:16.806309+0000","last_undegraded":"2024-09-19T12:00:16.806309+0000","last_fullsized":"2024-09-19T12:00:16.806309+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:54.383913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.609354+0000","last_change":"2024-09-19T11:53:37.752407+0000","last_active":"2024-09-19T11:59:56.609354+0000","last_peered":"2024-09-19T11:59:56.609354+0000","last_clean":"2024-09-19T11:59:56.609354+0000","last_became_active":"2024-09-19T11:53:37.751835+0000","last_became_peered":"2024-09-19T11:53:37.751835+0000","last_unstale":"2024-09-19T11:59:56.609354+0000","last_undegraded":"2024-09-19T11:59:56.609354+0000","last_fullsized":"2024-09-19T11:59:56.609354+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:44.756436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.595536+0000","last_change":"2024-09-19T11:53:34.722088+0000","last_active":"2024-09-19T11:59:51.595536+0000","last_peered":"2024-09-19T11:59:51.595536+0000","last_clean":"2024-09-19T11:59:51.595536+0000","last_became_active":"2024-09-19T11:53:34.721659+0000","last_became_peered":"2024-09-19T11:53:34.721659+0000","last_unstale":"2024-09-19T11:59:51.595536+0000","last_undegraded":"2024-09-19T11:59:51.595536+0000","last_fullsized":"2024-09-19T11:59:51.595536+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:52.673209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.613783+0000","last_change":"2024-09-19T11:51:53.488636+0000","last_active":"2024-09-19T12:00:16.613783+0000","last_peered":"2024-09-19T12:00:16.613783+0000","last_clean":"2024-09-19T12:00:16.613783+0000","last_became_active":"2024-09-19T11:51:53.487416+0000","last_became_peered":"2024-09-19T11:51:53.487416+0000","last_unstale":"2024-09-19T12:00:16.613783+0000","last_undegraded":"2024-09-19T12:00:16.613783+0000","last_fullsized":"2024-09-19T12:00:16.613783+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:28.039923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"262'2","reported_seq":25,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.801984+0000","last_change":"2024-09-19T11:53:37.722872+0000","last_active":"2024-09-19T11:59:56.801984+0000","last_peered":"2024-09-19T11:59:56.801984+0000","last_clean":"2024-09-19T11:59:56.801984+0000","last_became_active":"2024-09-19T11:53:37.722160+0000","last_became_peered":"2024-09-19T11:53:37.722160+0000","last_unstale":"2024-09-19T11:59:56.801984+0000","last_undegraded":"2024-09-19T11:59:56.801984+0000","last_fullsized":"2024-09-19T11:59:56.801984+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:39.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.608199+0000","last_change":"2024-09-19T11:53:34.699925+0000","last_active":"2024-09-19T11:59:51.608199+0000","last_peered":"2024-09-19T11:59:51.608199+0000","last_clean":"2024-09-19T11:59:51.608199+0000","last_became_active":"2024-09-19T11:53:34.699127+0000","last_became_peered":"2024-09-19T11:53:34.699127+0000","last_unstale":"2024-09-19T11:59:51.608199+0000","last_undegraded":"2024-09-19T11:59:51.608199+0000","last_fullsized":"2024-09-19T11:59:51.608199+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:49.808733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"256'15","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.612683+0000","last_change":"2024-09-19T11:51:53.485393+0000","last_active":"2024-09-19T11:59:56.612683+0000","last_peered":"2024-09-19T11:59:56.612683+0000","last_clean":"2024-09-19T11:59:56.612683+0000","last_became_active":"2024-09-19T11:51:53.484630+0000","last_became_peered":"2024-09-19T11:51:53.484630+0000","last_unstale":"2024-09-19T11:59:56.612683+0000","last_undegraded":"2024-09-19T11:59:56.612683+0000","last_fullsized":"2024-09-19T11:59:56.612683+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:33.200357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":95,"num_write":34,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'24","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.620416+0000","last_change":"2024-09-19T11:35:31.629725+0000","last_active":"2024-09-19T12:00:31.620416+0000","last_peered":"2024-09-19T12:00:31.620416+0000","last_clean":"2024-09-19T12:00:31.620416+0000","last_became_active":"2024-09-19T11:35:31.628800+0000","last_became_peered":"2024-09-19T11:35:31.628800+0000","last_unstale":"2024-09-19T12:00:31.620416+0000","last_undegraded":"2024-09-19T12:00:31.620416+0000","last_fullsized":"2024-09-19T12:00:31.620416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:24.923313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":115,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'47","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.583989+0000","last_change":"2024-09-19T11:35:33.628736+0000","last_active":"2024-09-19T11:58:06.583989+0000","last_peered":"2024-09-19T11:58:06.583989+0000","last_clean":"2024-09-19T11:58:06.583989+0000","last_became_active":"2024-09-19T11:35:33.627994+0000","last_became_peered":"2024-09-19T11:35:33.627994+0000","last_unstale":"2024-09-19T11:58:06.583989+0000","last_undegraded":"2024-09-19T11:58:06.583989+0000","last_fullsized":"2024-09-19T11:58:06.583989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:58.580017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":154,"num_write":67,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'55","reported_seq":575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.456278+0000","last_change":"2024-09-19T11:35:31.608493+0000","last_active":"2024-09-19T12:02:32.456278+0000","last_peered":"2024-09-19T12:02:32.456278+0000","last_clean":"2024-09-19T12:02:32.456278+0000","last_became_active":"2024-09-19T11:35:31.608158+0000","last_became_peered":"2024-09-19T11:35:31.608158+0000","last_unstale":"2024-09-19T12:02:32.456278+0000","last_undegraded":"2024-09-19T12:02:32.456278+0000","last_fullsized":"2024-09-19T12:02:32.456278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:19.335025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15408,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":101,"num_read_kb":661,"num_write":200,"num_write_kb":4683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'27","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.587159+0000","last_change":"2024-09-19T11:35:33.621664+0000","last_active":"2024-09-19T11:58:06.587159+0000","last_peered":"2024-09-19T11:58:06.587159+0000","last_clean":"2024-09-19T11:58:06.587159+0000","last_became_active":"2024-09-19T11:35:33.618098+0000","last_became_peered":"2024-09-19T11:35:33.618098+0000","last_unstale":"2024-09-19T11:58:06.587159+0000","last_undegraded":"2024-09-19T11:58:06.587159+0000","last_fullsized":"2024-09-19T11:58:06.587159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:51.714564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":93,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'37","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.618666+0000","last_change":"2024-09-19T11:35:31.614280+0000","last_active":"2024-09-19T12:00:31.618666+0000","last_peered":"2024-09-19T12:00:31.618666+0000","last_clean":"2024-09-19T12:00:31.618666+0000","last_became_active":"2024-09-19T11:35:31.613678+0000","last_became_peered":"2024-09-19T11:35:31.613678+0000","last_unstale":"2024-09-19T12:00:31.618666+0000","last_undegraded":"2024-09-19T12:00:31.618666+0000","last_fullsized":"2024-09-19T12:00:31.618666+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:43.000538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":12351,"num_write":133,"num_write_kb":6154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'42","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:51.978171+0000","last_change":"2024-09-19T11:35:33.614046+0000","last_active":"2024-09-19T11:58:51.978171+0000","last_peered":"2024-09-19T11:58:51.978171+0000","last_clean":"2024-09-19T11:58:51.978171+0000","last_became_active":"2024-09-19T11:35:33.613298+0000","last_became_peered":"2024-09-19T11:35:33.613298+0000","last_unstale":"2024-09-19T11:58:51.978171+0000","last_undegraded":"2024-09-19T11:58:51.978171+0000","last_fullsized":"2024-09-19T11:58:51.978171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:34.924557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":123,"num_write":79,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'21","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.298951+0000","last_change":"2024-09-19T11:35:31.610606+0000","last_active":"2024-09-19T12:00:06.298951+0000","last_peered":"2024-09-19T12:00:06.298951+0000","last_clean":"2024-09-19T12:00:06.298951+0000","last_became_active":"2024-09-19T11:35:31.608115+0000","last_became_peered":"2024-09-19T11:35:31.608115+0000","last_unstale":"2024-09-19T12:00:06.298951+0000","last_undegraded":"2024-09-19T12:00:06.298951+0000","last_fullsized":"2024-09-19T12:00:06.298951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:40.436454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079934,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":1089,"num_write":115,"num_write_kb":1059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'54","reported_seq":577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.584726+0000","last_change":"2024-09-19T11:35:33.625809+0000","last_active":"2024-09-19T11:58:06.584726+0000","last_peered":"2024-09-19T11:58:06.584726+0000","last_clean":"2024-09-19T11:58:06.584726+0000","last_became_active":"2024-09-19T11:35:33.625528+0000","last_became_peered":"2024-09-19T11:35:33.625528+0000","last_unstale":"2024-09-19T11:58:06.584726+0000","last_undegraded":"2024-09-19T11:58:06.584726+0000","last_fullsized":"2024-09-19T11:58:06.584726+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:28.944541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":230,"num_read_kb":188,"num_write":85,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'55","reported_seq":575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.620311+0000","last_change":"2024-09-19T11:35:31.620118+0000","last_active":"2024-09-19T12:00:31.620311+0000","last_peered":"2024-09-19T12:00:31.620311+0000","last_clean":"2024-09-19T12:00:31.620311+0000","last_became_active":"2024-09-19T11:35:31.618555+0000","last_became_peered":"2024-09-19T11:35:31.618555+0000","last_unstale":"2024-09-19T12:00:31.620311+0000","last_undegraded":"2024-09-19T12:00:31.620311+0000","last_fullsized":"2024-09-19T12:00:31.620311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:25.667196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11562584,"num_objects":19,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":86,"num_read_kb":29373,"num_write":171,"num_write_kb":13979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'27","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.193132+0000","last_change":"2024-09-19T11:35:33.626035+0000","last_active":"2024-09-19T12:02:33.193132+0000","last_peered":"2024-09-19T12:02:33.193132+0000","last_clean":"2024-09-19T12:02:33.193132+0000","last_became_active":"2024-09-19T11:35:33.624952+0000","last_became_peered":"2024-09-19T11:35:33.624952+0000","last_unstale":"2024-09-19T12:02:33.193132+0000","last_undegraded":"2024-09-19T12:02:33.193132+0000","last_fullsized":"2024-09-19T12:02:33.193132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:40.687504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":112,"num_write":47,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'43","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.616588+0000","last_change":"2024-09-19T11:35:31.589199+0000","last_active":"2024-09-19T12:00:31.616588+0000","last_peered":"2024-09-19T12:00:31.616588+0000","last_clean":"2024-09-19T12:00:31.616588+0000","last_became_active":"2024-09-19T11:35:31.587016+0000","last_became_peered":"2024-09-19T11:35:31.587016+0000","last_unstale":"2024-09-19T12:00:31.616588+0000","last_undegraded":"2024-09-19T12:00:31.616588+0000","last_fullsized":"2024-09-19T12:00:31.616588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:43.361105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145912,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":83,"num_read_kb":3127,"num_write":126,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"253'2","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.811093+0000","last_change":"2024-09-19T11:35:33.614181+0000","last_active":"2024-09-19T12:00:36.811093+0000","last_peered":"2024-09-19T12:00:36.811093+0000","last_clean":"2024-09-19T12:00:36.811093+0000","last_became_active":"2024-09-19T11:35:33.612338+0000","last_became_peered":"2024-09-19T11:35:33.612338+0000","last_unstale":"2024-09-19T12:00:36.811093+0000","last_undegraded":"2024-09-19T12:00:36.811093+0000","last_fullsized":"2024-09-19T12:00:36.811093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:01.117001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'29","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.620229+0000","last_change":"2024-09-19T11:35:31.621888+0000","last_active":"2024-09-19T12:00:31.620229+0000","last_peered":"2024-09-19T12:00:31.620229+0000","last_clean":"2024-09-19T12:00:31.620229+0000","last_became_active":"2024-09-19T11:35:31.619730+0000","last_became_peered":"2024-09-19T11:35:31.619730+0000","last_unstale":"2024-09-19T12:00:31.620229+0000","last_undegraded":"2024-09-19T12:00:31.620229+0000","last_fullsized":"2024-09-19T12:00:31.620229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:41.738718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":104,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'48","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618078+0000","last_change":"2024-09-19T11:35:33.612223+0000","last_active":"2024-09-19T12:00:36.618078+0000","last_peered":"2024-09-19T12:00:36.618078+0000","last_clean":"2024-09-19T12:00:36.618078+0000","last_became_active":"2024-09-19T11:35:33.611495+0000","last_became_peered":"2024-09-19T11:35:33.611495+0000","last_unstale":"2024-09-19T12:00:36.618078+0000","last_undegraded":"2024-09-19T12:00:36.618078+0000","last_fullsized":"2024-09-19T12:00:36.618078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:50.704291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":135,"num_write":76,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'29","reported_seq":540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.612628+0000","last_change":"2024-09-19T11:35:31.594461+0000","last_active":"2024-09-19T12:00:31.612628+0000","last_peered":"2024-09-19T12:00:31.612628+0000","last_clean":"2024-09-19T12:00:31.612628+0000","last_became_active":"2024-09-19T11:35:31.593765+0000","last_became_peered":"2024-09-19T11:35:31.593765+0000","last_unstale":"2024-09-19T12:00:31.612628+0000","last_undegraded":"2024-09-19T12:00:31.612628+0000","last_fullsized":"2024-09-19T12:00:31.612628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:15.207126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2235,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":48,"num_read_kb":45,"num_write":108,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'46","reported_seq":564,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.197761+0000","last_change":"2024-09-19T11:35:33.606318+0000","last_active":"2024-09-19T12:02:33.197761+0000","last_peered":"2024-09-19T12:02:33.197761+0000","last_clean":"2024-09-19T12:02:33.197761+0000","last_became_active":"2024-09-19T11:35:33.604505+0000","last_became_peered":"2024-09-19T11:35:33.604505+0000","last_unstale":"2024-09-19T12:02:33.197761+0000","last_undegraded":"2024-09-19T12:02:33.197761+0000","last_fullsized":"2024-09-19T12:02:33.197761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:56.257217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":158,"num_write":84,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'76","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.163064+0000","last_change":"2024-09-19T11:35:33.608564+0000","last_active":"2024-09-19T12:02:33.163064+0000","last_peered":"2024-09-19T12:02:33.163064+0000","last_clean":"2024-09-19T12:02:33.163064+0000","last_became_active":"2024-09-19T11:35:33.607843+0000","last_became_peered":"2024-09-19T11:35:33.607843+0000","last_unstale":"2024-09-19T12:02:33.163064+0000","last_undegraded":"2024-09-19T12:02:33.163064+0000","last_fullsized":"2024-09-19T12:02:33.163064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:40.705119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":241,"num_write":113,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'35","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.125233+0000","last_change":"2024-09-19T11:36:06.682019+0000","last_active":"2024-09-19T12:00:41.125233+0000","last_peered":"2024-09-19T12:00:41.125233+0000","last_clean":"2024-09-19T12:00:41.125233+0000","last_became_active":"2024-09-19T11:36:06.680794+0000","last_became_peered":"2024-09-19T11:36:06.680794+0000","last_unstale":"2024-09-19T12:00:41.125233+0000","last_undegraded":"2024-09-19T12:00:41.125233+0000","last_fullsized":"2024-09-19T12:00:41.125233+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:15.316832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8321,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":35,"num_read_kb":3338,"num_write":145,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,1],"acting":[2,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599773+0000","last_change":"2024-09-19T11:35:33.622666+0000","last_active":"2024-09-19T11:58:56.599773+0000","last_peered":"2024-09-19T11:58:56.599773+0000","last_clean":"2024-09-19T11:58:56.599773+0000","last_became_active":"2024-09-19T11:35:33.621522+0000","last_became_peered":"2024-09-19T11:35:33.621522+0000","last_unstale":"2024-09-19T11:58:56.599773+0000","last_undegraded":"2024-09-19T11:58:56.599773+0000","last_fullsized":"2024-09-19T11:58:56.599773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:16.770624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'33","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.606056+0000","last_change":"2024-09-19T11:35:31.612184+0000","last_active":"2024-09-19T11:59:41.606056+0000","last_peered":"2024-09-19T11:59:41.606056+0000","last_clean":"2024-09-19T11:59:41.606056+0000","last_became_active":"2024-09-19T11:35:31.598016+0000","last_became_peered":"2024-09-19T11:35:31.598016+0000","last_unstale":"2024-09-19T11:59:41.606056+0000","last_undegraded":"2024-09-19T11:59:41.606056+0000","last_fullsized":"2024-09-19T11:59:41.606056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:59.949408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159847,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":97,"num_read_kb":2182,"num_write":159,"num_write_kb":2115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'48","reported_seq":554,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.596523+0000","last_change":"2024-09-19T11:35:33.612612+0000","last_active":"2024-09-19T11:59:01.596523+0000","last_peered":"2024-09-19T11:59:01.596523+0000","last_clean":"2024-09-19T11:59:01.596523+0000","last_became_active":"2024-09-19T11:35:33.610072+0000","last_became_peered":"2024-09-19T11:35:33.610072+0000","last_unstale":"2024-09-19T11:59:01.596523+0000","last_undegraded":"2024-09-19T11:59:01.596523+0000","last_fullsized":"2024-09-19T11:59:01.596523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:22.254214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":149,"num_write":86,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'31","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.587974+0000","last_change":"2024-09-19T11:35:31.615091+0000","last_active":"2024-09-19T12:02:32.587974+0000","last_peered":"2024-09-19T12:02:32.587974+0000","last_clean":"2024-09-19T12:02:32.587974+0000","last_became_active":"2024-09-19T11:35:31.614263+0000","last_became_peered":"2024-09-19T11:35:31.614263+0000","last_unstale":"2024-09-19T12:02:32.587974+0000","last_undegraded":"2024-09-19T12:02:32.587974+0000","last_fullsized":"2024-09-19T12:02:32.587974+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:03.358145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242995,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":5162,"num_write":123,"num_write_kb":10269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'149","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.050113+0000","last_change":"2024-09-19T11:35:33.611574+0000","last_active":"2024-09-19T12:02:33.050113+0000","last_peered":"2024-09-19T12:02:33.050113+0000","last_clean":"2024-09-19T12:02:33.050113+0000","last_became_active":"2024-09-19T11:35:33.611240+0000","last_became_peered":"2024-09-19T11:35:33.611240+0000","last_unstale":"2024-09-19T12:02:33.050113+0000","last_undegraded":"2024-09-19T12:02:33.050113+0000","last_fullsized":"2024-09-19T12:02:33.050113+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:58.616861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":454,"num_write":234,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'29","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.798430+0000","last_change":"2024-09-19T11:35:31.592787+0000","last_active":"2024-09-19T11:59:41.798430+0000","last_peered":"2024-09-19T11:59:41.798430+0000","last_clean":"2024-09-19T11:59:41.798430+0000","last_became_active":"2024-09-19T11:35:31.591932+0000","last_became_peered":"2024-09-19T11:35:31.591932+0000","last_unstale":"2024-09-19T11:59:41.798430+0000","last_undegraded":"2024-09-19T11:59:41.798430+0000","last_fullsized":"2024-09-19T11:59:41.798430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:16.215077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6295699,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":43,"num_read_kb":7804,"num_write":98,"num_write_kb":7776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'26","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.594514+0000","last_change":"2024-09-19T11:35:33.626081+0000","last_active":"2024-09-19T11:59:46.594514+0000","last_peered":"2024-09-19T11:59:46.594514+0000","last_clean":"2024-09-19T11:59:46.594514+0000","last_became_active":"2024-09-19T11:35:33.625698+0000","last_became_peered":"2024-09-19T11:35:33.625698+0000","last_unstale":"2024-09-19T11:59:46.594514+0000","last_undegraded":"2024-09-19T11:59:46.594514+0000","last_fullsized":"2024-09-19T11:59:46.594514+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:25.969110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":73,"num_write":57,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'22","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.601422+0000","last_change":"2024-09-19T11:35:31.601399+0000","last_active":"2024-09-19T11:59:41.601422+0000","last_peered":"2024-09-19T11:59:41.601422+0000","last_clean":"2024-09-19T11:59:41.601422+0000","last_became_active":"2024-09-19T11:35:31.600939+0000","last_became_peered":"2024-09-19T11:35:31.600939+0000","last_unstale":"2024-09-19T11:59:41.601422+0000","last_undegraded":"2024-09-19T11:59:41.601422+0000","last_fullsized":"2024-09-19T11:59:41.601422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:35.527377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291500,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":6211,"num_write":100,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.799672+0000","last_change":"2024-09-19T11:35:33.605918+0000","last_active":"2024-09-19T11:59:46.799672+0000","last_peered":"2024-09-19T11:59:46.799672+0000","last_clean":"2024-09-19T11:59:46.799672+0000","last_became_active":"2024-09-19T11:35:33.605215+0000","last_became_peered":"2024-09-19T11:35:33.605215+0000","last_unstale":"2024-09-19T11:59:46.799672+0000","last_undegraded":"2024-09-19T11:59:46.799672+0000","last_fullsized":"2024-09-19T11:59:46.799672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:06.551820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'42","reported_seq":567,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.596005+0000","last_change":"2024-09-19T11:35:31.597393+0000","last_active":"2024-09-19T11:58:56.596005+0000","last_peered":"2024-09-19T11:58:56.596005+0000","last_clean":"2024-09-19T11:58:56.596005+0000","last_became_active":"2024-09-19T11:35:31.597035+0000","last_became_peered":"2024-09-19T11:35:31.597035+0000","last_unstale":"2024-09-19T11:58:56.596005+0000","last_undegraded":"2024-09-19T11:58:56.596005+0000","last_fullsized":"2024-09-19T11:58:56.596005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:38.704431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485830,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":25668,"num_write":122,"num_write_kb":10245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'16","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.800682+0000","last_change":"2024-09-19T11:35:41.674446+0000","last_active":"2024-09-19T11:59:51.800682+0000","last_peered":"2024-09-19T11:59:51.800682+0000","last_clean":"2024-09-19T11:59:51.800682+0000","last_became_active":"2024-09-19T11:35:41.673420+0000","last_became_peered":"2024-09-19T11:35:41.673420+0000","last_unstale":"2024-09-19T11:59:51.800682+0000","last_undegraded":"2024-09-19T11:59:51.800682+0000","last_fullsized":"2024-09-19T11:59:51.800682+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:40.611862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":47,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.592064+0000","last_change":"2024-09-19T11:35:33.613895+0000","last_active":"2024-09-19T11:59:01.592064+0000","last_peered":"2024-09-19T11:59:01.592064+0000","last_clean":"2024-09-19T11:59:01.592064+0000","last_became_active":"2024-09-19T11:35:33.613437+0000","last_became_peered":"2024-09-19T11:35:33.613437+0000","last_unstale":"2024-09-19T11:59:01.592064+0000","last_undegraded":"2024-09-19T11:59:01.592064+0000","last_fullsized":"2024-09-19T11:59:01.592064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:34.414349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'46","reported_seq":559,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:38.945035+0000","last_change":"2024-09-19T11:35:31.600183+0000","last_active":"2024-09-19T12:00:38.945035+0000","last_peered":"2024-09-19T12:00:38.945035+0000","last_clean":"2024-09-19T12:00:38.945035+0000","last_became_active":"2024-09-19T11:35:31.599314+0000","last_became_peered":"2024-09-19T11:35:31.599314+0000","last_unstale":"2024-09-19T12:00:38.945035+0000","last_undegraded":"2024-09-19T12:00:38.945035+0000","last_fullsized":"2024-09-19T12:00:38.945035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:43.331402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231,"num_objects":19,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":83,"num_read_kb":1688,"num_write":186,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.606494+0000","last_change":"2024-09-19T11:35:35.617353+0000","last_active":"2024-09-19T11:59:46.606494+0000","last_peered":"2024-09-19T11:59:46.606494+0000","last_clean":"2024-09-19T11:59:46.606494+0000","last_became_active":"2024-09-19T11:35:35.616351+0000","last_became_peered":"2024-09-19T11:35:35.616351+0000","last_unstale":"2024-09-19T11:59:46.606494+0000","last_undegraded":"2024-09-19T11:59:46.606494+0000","last_fullsized":"2024-09-19T11:59:46.606494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:15.938562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'119","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.348420+0000","last_change":"2024-09-19T11:35:37.651194+0000","last_active":"2024-09-19T12:00:06.348420+0000","last_peered":"2024-09-19T12:00:06.348420+0000","last_clean":"2024-09-19T12:00:06.348420+0000","last_became_active":"2024-09-19T11:35:37.650685+0000","last_became_peered":"2024-09-19T11:35:37.650685+0000","last_unstale":"2024-09-19T12:00:06.348420+0000","last_undegraded":"2024-09-19T12:00:06.348420+0000","last_fullsized":"2024-09-19T12:00:06.348420+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:53.348943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8728,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":164,"num_read_kb":203,"num_write":116,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611862+0000","last_change":"2024-09-19T11:35:39.676563+0000","last_active":"2024-09-19T11:59:51.611862+0000","last_peered":"2024-09-19T11:59:51.611862+0000","last_clean":"2024-09-19T11:59:51.611862+0000","last_became_active":"2024-09-19T11:35:39.676033+0000","last_became_peered":"2024-09-19T11:35:39.676033+0000","last_unstale":"2024-09-19T11:59:51.611862+0000","last_undegraded":"2024-09-19T11:59:51.611862+0000","last_fullsized":"2024-09-19T11:59:51.611862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:44.059170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'15","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.608623+0000","last_change":"2024-09-19T11:35:41.682580+0000","last_active":"2024-09-19T11:59:56.608623+0000","last_peered":"2024-09-19T11:59:56.608623+0000","last_clean":"2024-09-19T11:59:56.608623+0000","last_became_active":"2024-09-19T11:35:41.680497+0000","last_became_peered":"2024-09-19T11:35:41.680497+0000","last_unstale":"2024-09-19T11:59:56.608623+0000","last_undegraded":"2024-09-19T11:59:56.608623+0000","last_fullsized":"2024-09-19T11:59:56.608623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:55.800690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":49,"num_write":53,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'2","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:11.640032+0000","last_change":"2024-09-19T11:35:33.617104+0000","last_active":"2024-09-19T12:02:11.640032+0000","last_peered":"2024-09-19T12:02:11.640032+0000","last_clean":"2024-09-19T12:02:11.640032+0000","last_became_active":"2024-09-19T11:35:33.615138+0000","last_became_peered":"2024-09-19T11:35:33.615138+0000","last_unstale":"2024-09-19T12:02:11.640032+0000","last_undegraded":"2024-09-19T12:02:11.640032+0000","last_fullsized":"2024-09-19T12:02:11.640032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:22.788235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'28","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:11.627448+0000","last_change":"2024-09-19T11:35:31.612888+0000","last_active":"2024-09-19T12:01:11.627448+0000","last_peered":"2024-09-19T12:01:11.627448+0000","last_clean":"2024-09-19T12:01:11.627448+0000","last_became_active":"2024-09-19T11:35:31.612424+0000","last_became_peered":"2024-09-19T11:35:31.612424+0000","last_unstale":"2024-09-19T12:01:11.627448+0000","last_undegraded":"2024-09-19T12:01:11.627448+0000","last_fullsized":"2024-09-19T12:01:11.627448+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:08.302859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":34,"num_read_kb":5150,"num_write":97,"num_write_kb":10271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.592095+0000","last_change":"2024-09-19T11:35:35.627312+0000","last_active":"2024-09-19T11:59:01.592095+0000","last_peered":"2024-09-19T11:59:01.592095+0000","last_clean":"2024-09-19T11:59:01.592095+0000","last_became_active":"2024-09-19T11:35:35.626979+0000","last_became_peered":"2024-09-19T11:35:35.626979+0000","last_unstale":"2024-09-19T11:59:01.592095+0000","last_undegraded":"2024-09-19T11:59:01.592095+0000","last_fullsized":"2024-09-19T11:59:01.592095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:42.288842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'48","reported_seq":554,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:16.833482+0000","last_change":"2024-09-19T11:35:37.630326+0000","last_active":"2024-09-19T12:02:16.833482+0000","last_peered":"2024-09-19T12:02:16.833482+0000","last_clean":"2024-09-19T12:02:16.833482+0000","last_became_active":"2024-09-19T11:35:37.624916+0000","last_became_peered":"2024-09-19T11:35:37.624916+0000","last_unstale":"2024-09-19T12:02:16.833482+0000","last_undegraded":"2024-09-19T12:02:16.833482+0000","last_fullsized":"2024-09-19T12:02:16.833482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:40.009132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":68,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.800889+0000","last_change":"2024-09-19T11:35:39.670488+0000","last_active":"2024-09-19T11:59:51.800889+0000","last_peered":"2024-09-19T11:59:51.800889+0000","last_clean":"2024-09-19T11:59:51.800889+0000","last_became_active":"2024-09-19T11:35:39.669732+0000","last_became_peered":"2024-09-19T11:35:39.669732+0000","last_unstale":"2024-09-19T11:59:51.800889+0000","last_undegraded":"2024-09-19T11:59:51.800889+0000","last_fullsized":"2024-09-19T11:59:51.800889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:15.697637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'26","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:18.515668+0000","last_change":"2024-09-19T11:35:41.695806+0000","last_active":"2024-09-19T11:58:18.515668+0000","last_peered":"2024-09-19T11:58:18.515668+0000","last_clean":"2024-09-19T11:58:18.515668+0000","last_became_active":"2024-09-19T11:35:41.693197+0000","last_became_peered":"2024-09-19T11:35:41.693197+0000","last_unstale":"2024-09-19T11:58:18.515668+0000","last_undegraded":"2024-09-19T11:58:18.515668+0000","last_fullsized":"2024-09-19T11:58:18.515668+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:38:56.811510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":93,"num_write":83,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'5","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.607864+0000","last_change":"2024-09-19T11:35:33.626048+0000","last_active":"2024-09-19T11:59:46.607864+0000","last_peered":"2024-09-19T11:59:46.607864+0000","last_clean":"2024-09-19T11:59:46.607864+0000","last_became_active":"2024-09-19T11:35:33.625606+0000","last_became_peered":"2024-09-19T11:35:33.625606+0000","last_unstale":"2024-09-19T11:59:46.607864+0000","last_undegraded":"2024-09-19T11:59:46.607864+0000","last_fullsized":"2024-09-19T11:59:46.607864+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:11.107345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'38","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.707563+0000","last_change":"2024-09-19T11:35:31.622618+0000","last_active":"2024-09-19T12:02:17.707563+0000","last_peered":"2024-09-19T12:02:17.707563+0000","last_clean":"2024-09-19T12:02:17.707563+0000","last_became_active":"2024-09-19T11:35:31.621190+0000","last_became_peered":"2024-09-19T11:35:31.621190+0000","last_unstale":"2024-09-19T12:02:17.707563+0000","last_undegraded":"2024-09-19T12:02:17.707563+0000","last_fullsized":"2024-09-19T12:02:17.707563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:14.420143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151900,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":54,"num_read_kb":198,"num_write":153,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"38'3","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.705500+0000","last_change":"2024-09-19T11:35:35.624498+0000","last_active":"2024-09-19T12:02:32.705500+0000","last_peered":"2024-09-19T12:02:32.705500+0000","last_clean":"2024-09-19T12:02:32.705500+0000","last_became_active":"2024-09-19T11:35:35.623997+0000","last_became_peered":"2024-09-19T11:35:35.623997+0000","last_unstale":"2024-09-19T12:02:32.705500+0000","last_undegraded":"2024-09-19T12:02:32.705500+0000","last_fullsized":"2024-09-19T12:02:32.705500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:39.064327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":623,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'64","reported_seq":579,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:26.614835+0000","last_change":"2024-09-19T11:35:37.628761+0000","last_active":"2024-09-19T12:01:26.614835+0000","last_peered":"2024-09-19T12:01:26.614835+0000","last_clean":"2024-09-19T12:01:26.614835+0000","last_became_active":"2024-09-19T11:35:37.628124+0000","last_became_peered":"2024-09-19T11:35:37.628124+0000","last_unstale":"2024-09-19T12:01:26.614835+0000","last_undegraded":"2024-09-19T12:01:26.614835+0000","last_fullsized":"2024-09-19T12:01:26.614835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:14.165078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'612","reported_seq":1501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.004966+0000","last_change":"2024-09-19T11:35:39.682448+0000","last_active":"2024-09-19T12:02:33.004966+0000","last_peered":"2024-09-19T12:02:33.004966+0000","last_clean":"2024-09-19T12:02:33.004966+0000","last_became_active":"2024-09-19T11:35:39.681867+0000","last_became_peered":"2024-09-19T11:35:39.681867+0000","last_unstale":"2024-09-19T12:02:33.004966+0000","last_undegraded":"2024-09-19T12:02:33.004966+0000","last_fullsized":"2024-09-19T12:02:33.004966+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:29.322118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'20","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:32.884237+0000","last_change":"2024-09-19T11:35:41.677700+0000","last_active":"2024-09-19T11:59:32.884237+0000","last_peered":"2024-09-19T11:59:32.884237+0000","last_clean":"2024-09-19T11:59:32.884237+0000","last_became_active":"2024-09-19T11:35:41.676988+0000","last_became_peered":"2024-09-19T11:35:41.676988+0000","last_unstale":"2024-09-19T11:59:32.884237+0000","last_undegraded":"2024-09-19T11:59:32.884237+0000","last_fullsized":"2024-09-19T11:59:32.884237+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:02.366492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'23","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.177039+0000","last_change":"2024-09-19T11:35:33.614935+0000","last_active":"2024-09-19T12:02:33.177039+0000","last_peered":"2024-09-19T12:02:33.177039+0000","last_clean":"2024-09-19T12:02:33.177039+0000","last_became_active":"2024-09-19T11:35:33.614168+0000","last_became_peered":"2024-09-19T11:35:33.614168+0000","last_unstale":"2024-09-19T12:02:33.177039+0000","last_undegraded":"2024-09-19T12:02:33.177039+0000","last_fullsized":"2024-09-19T12:02:33.177039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:40.524246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":86,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'43","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:32.856606+0000","last_change":"2024-09-19T11:35:31.611559+0000","last_active":"2024-09-19T11:59:32.856606+0000","last_peered":"2024-09-19T11:59:32.856606+0000","last_clean":"2024-09-19T11:59:32.856606+0000","last_became_active":"2024-09-19T11:35:31.610808+0000","last_became_peered":"2024-09-19T11:35:31.610808+0000","last_unstale":"2024-09-19T11:59:32.856606+0000","last_undegraded":"2024-09-19T11:59:32.856606+0000","last_fullsized":"2024-09-19T11:59:32.856606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:46.561986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7371487,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":100,"num_read_kb":7272,"num_write":179,"num_write_kb":7210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.606549+0000","last_change":"2024-09-19T11:35:35.624368+0000","last_active":"2024-09-19T11:59:46.606549+0000","last_peered":"2024-09-19T11:59:46.606549+0000","last_clean":"2024-09-19T11:59:46.606549+0000","last_became_active":"2024-09-19T11:35:35.623608+0000","last_became_peered":"2024-09-19T11:35:35.623608+0000","last_unstale":"2024-09-19T11:59:46.606549+0000","last_undegraded":"2024-09-19T11:59:46.606549+0000","last_fullsized":"2024-09-19T11:59:46.606549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:32.921728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'63","reported_seq":558,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611752+0000","last_change":"2024-09-19T11:35:37.646654+0000","last_active":"2024-09-19T11:59:51.611752+0000","last_peered":"2024-09-19T11:59:51.611752+0000","last_clean":"2024-09-19T11:59:51.611752+0000","last_became_active":"2024-09-19T11:35:37.645933+0000","last_became_peered":"2024-09-19T11:35:37.645933+0000","last_unstale":"2024-09-19T11:59:51.611752+0000","last_undegraded":"2024-09-19T11:59:51.611752+0000","last_fullsized":"2024-09-19T11:59:51.611752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:49.367677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9468,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":111,"num_write":62,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'618","reported_seq":1487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.017659+0000","last_change":"2024-09-19T11:35:39.655107+0000","last_active":"2024-09-19T12:02:33.017659+0000","last_peered":"2024-09-19T12:02:33.017659+0000","last_clean":"2024-09-19T12:02:33.017659+0000","last_became_active":"2024-09-19T11:35:39.654205+0000","last_became_peered":"2024-09-19T11:35:39.654205+0000","last_unstale":"2024-09-19T12:02:33.017659+0000","last_undegraded":"2024-09-19T12:02:33.017659+0000","last_fullsized":"2024-09-19T12:02:33.017659+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:09.266023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'23","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.173407+0000","last_change":"2024-09-19T11:35:33.625607+0000","last_active":"2024-09-19T12:02:33.173407+0000","last_peered":"2024-09-19T12:02:33.173407+0000","last_clean":"2024-09-19T12:02:33.173407+0000","last_became_active":"2024-09-19T11:35:33.624883+0000","last_became_peered":"2024-09-19T11:35:33.624883+0000","last_unstale":"2024-09-19T12:02:33.173407+0000","last_undegraded":"2024-09-19T12:02:33.173407+0000","last_fullsized":"2024-09-19T12:02:33.173407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:38.184558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":86,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'29","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.618229+0000","last_change":"2024-09-19T11:35:31.610576+0000","last_active":"2024-09-19T12:00:21.618229+0000","last_peered":"2024-09-19T12:00:21.618229+0000","last_clean":"2024-09-19T12:00:21.618229+0000","last_became_active":"2024-09-19T11:35:31.609658+0000","last_became_peered":"2024-09-19T11:35:31.609658+0000","last_unstale":"2024-09-19T12:00:21.618229+0000","last_undegraded":"2024-09-19T12:00:21.618229+0000","last_fullsized":"2024-09-19T12:00:21.618229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:27.502371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":46,"num_read_kb":38,"num_write":98,"num_write_kb":5152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.606363+0000","last_change":"2024-09-19T11:35:35.622091+0000","last_active":"2024-09-19T11:59:26.606363+0000","last_peered":"2024-09-19T11:59:26.606363+0000","last_clean":"2024-09-19T11:59:26.606363+0000","last_became_active":"2024-09-19T11:35:35.621170+0000","last_became_peered":"2024-09-19T11:35:35.621170+0000","last_unstale":"2024-09-19T11:59:26.606363+0000","last_undegraded":"2024-09-19T11:59:26.606363+0000","last_fullsized":"2024-09-19T11:59:26.606363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:48.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'117","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.603982+0000","last_change":"2024-09-19T11:35:37.636324+0000","last_active":"2024-09-19T11:59:36.603982+0000","last_peered":"2024-09-19T11:59:36.603982+0000","last_clean":"2024-09-19T11:59:36.603982+0000","last_became_active":"2024-09-19T11:35:37.635359+0000","last_became_peered":"2024-09-19T11:35:37.635359+0000","last_unstale":"2024-09-19T11:59:36.603982+0000","last_undegraded":"2024-09-19T11:59:36.603982+0000","last_fullsized":"2024-09-19T11:59:36.603982+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:43.517566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9704,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":167,"num_read_kb":202,"num_write":118,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603640+0000","last_change":"2024-09-19T11:35:39.683859+0000","last_active":"2024-09-19T12:00:26.603640+0000","last_peered":"2024-09-19T12:00:26.603640+0000","last_clean":"2024-09-19T12:00:26.603640+0000","last_became_active":"2024-09-19T11:35:39.683300+0000","last_became_peered":"2024-09-19T11:35:39.683300+0000","last_unstale":"2024-09-19T12:00:26.603640+0000","last_undegraded":"2024-09-19T12:00:26.603640+0000","last_fullsized":"2024-09-19T12:00:26.603640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:56.978681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'6","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619273+0000","last_change":"2024-09-19T11:35:41.685251+0000","last_active":"2024-09-19T12:00:41.619273+0000","last_peered":"2024-09-19T12:00:41.619273+0000","last_clean":"2024-09-19T12:00:41.619273+0000","last_became_active":"2024-09-19T11:35:41.684698+0000","last_became_peered":"2024-09-19T11:35:41.684698+0000","last_unstale":"2024-09-19T12:00:41.619273+0000","last_undegraded":"2024-09-19T12:00:41.619273+0000","last_fullsized":"2024-09-19T12:00:41.619273+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:43.679226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'9","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:36.824293+0000","last_change":"2024-09-19T11:35:33.618465+0000","last_active":"2024-09-19T12:01:36.824293+0000","last_peered":"2024-09-19T12:01:36.824293+0000","last_clean":"2024-09-19T12:01:36.824293+0000","last_became_active":"2024-09-19T11:35:33.617778+0000","last_became_peered":"2024-09-19T11:35:33.617778+0000","last_unstale":"2024-09-19T12:01:36.824293+0000","last_undegraded":"2024-09-19T12:01:36.824293+0000","last_fullsized":"2024-09-19T12:01:36.824293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:44.417211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":12,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'53","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.617110+0000","last_change":"2024-09-19T11:35:31.609984+0000","last_active":"2024-09-19T12:00:16.617110+0000","last_peered":"2024-09-19T12:00:16.617110+0000","last_clean":"2024-09-19T12:00:16.617110+0000","last_became_active":"2024-09-19T11:35:31.609243+0000","last_became_peered":"2024-09-19T11:35:31.609243+0000","last_unstale":"2024-09-19T12:00:16.617110+0000","last_undegraded":"2024-09-19T12:00:16.617110+0000","last_fullsized":"2024-09-19T12:00:16.617110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:56.221017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6330583,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":92,"num_read_kb":6258,"num_write":250,"num_write_kb":6195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.590189+0000","last_change":"2024-09-19T11:35:35.618693+0000","last_active":"2024-09-19T11:59:26.590189+0000","last_peered":"2024-09-19T11:59:26.590189+0000","last_clean":"2024-09-19T11:59:26.590189+0000","last_became_active":"2024-09-19T11:35:35.617934+0000","last_became_peered":"2024-09-19T11:35:35.617934+0000","last_unstale":"2024-09-19T11:59:26.590189+0000","last_undegraded":"2024-09-19T11:59:26.590189+0000","last_fullsized":"2024-09-19T11:59:26.590189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:47.062252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'63","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.798286+0000","last_change":"2024-09-19T11:35:37.643864+0000","last_active":"2024-09-19T12:02:17.798286+0000","last_peered":"2024-09-19T12:02:17.798286+0000","last_clean":"2024-09-19T12:02:17.798286+0000","last_became_active":"2024-09-19T11:35:37.643236+0000","last_became_peered":"2024-09-19T11:35:37.643236+0000","last_unstale":"2024-09-19T12:02:17.798286+0000","last_undegraded":"2024-09-19T12:02:17.798286+0000","last_fullsized":"2024-09-19T12:02:17.798286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:47.647100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12813,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":92,"num_read_kb":161,"num_write":74,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.600120+0000","last_change":"2024-09-19T11:35:39.653781+0000","last_active":"2024-09-19T11:59:36.600120+0000","last_peered":"2024-09-19T11:59:36.600120+0000","last_clean":"2024-09-19T11:59:36.600120+0000","last_became_active":"2024-09-19T11:35:39.652920+0000","last_became_peered":"2024-09-19T11:35:39.652920+0000","last_unstale":"2024-09-19T11:59:36.600120+0000","last_undegraded":"2024-09-19T11:59:36.600120+0000","last_fullsized":"2024-09-19T11:59:36.600120+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:26.583277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'12","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:46.620891+0000","last_change":"2024-09-19T11:35:41.678791+0000","last_active":"2024-09-19T12:00:46.620891+0000","last_peered":"2024-09-19T12:00:46.620891+0000","last_clean":"2024-09-19T12:00:46.620891+0000","last_became_active":"2024-09-19T11:35:41.678055+0000","last_became_peered":"2024-09-19T11:35:41.678055+0000","last_unstale":"2024-09-19T12:00:46.620891+0000","last_undegraded":"2024-09-19T12:00:46.620891+0000","last_fullsized":"2024-09-19T12:00:46.620891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:27.826190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":59,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'46","reported_seq":556,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.008451+0000","last_change":"2024-09-19T11:35:33.624918+0000","last_active":"2024-09-19T12:02:32.008451+0000","last_peered":"2024-09-19T12:02:32.008451+0000","last_clean":"2024-09-19T12:02:32.008451+0000","last_became_active":"2024-09-19T11:35:33.624015+0000","last_became_peered":"2024-09-19T11:35:33.624015+0000","last_unstale":"2024-09-19T12:02:32.008451+0000","last_undegraded":"2024-09-19T12:02:32.008451+0000","last_fullsized":"2024-09-19T12:02:32.008451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:06.414742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":170,"num_write":76,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'48","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.617053+0000","last_change":"2024-09-19T11:35:31.627788+0000","last_active":"2024-09-19T12:00:16.617053+0000","last_peered":"2024-09-19T12:00:16.617053+0000","last_clean":"2024-09-19T12:00:16.617053+0000","last_became_active":"2024-09-19T11:35:31.627232+0000","last_became_peered":"2024-09-19T11:35:31.627232+0000","last_unstale":"2024-09-19T12:00:16.617053+0000","last_undegraded":"2024-09-19T12:00:16.617053+0000","last_fullsized":"2024-09-19T12:00:16.617053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:49.266566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1326257,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":106,"num_read_kb":6226,"num_write":203,"num_write_kb":11300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.601938+0000","last_change":"2024-09-19T11:35:35.624395+0000","last_active":"2024-09-19T12:00:21.601938+0000","last_peered":"2024-09-19T12:00:21.601938+0000","last_clean":"2024-09-19T12:00:21.601938+0000","last_became_active":"2024-09-19T11:35:35.623852+0000","last_became_peered":"2024-09-19T11:35:35.623852+0000","last_unstale":"2024-09-19T12:00:21.601938+0000","last_undegraded":"2024-09-19T12:00:21.601938+0000","last_fullsized":"2024-09-19T12:00:21.601938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:40.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'72","reported_seq":577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:41.635724+0000","last_change":"2024-09-19T11:35:37.641622+0000","last_active":"2024-09-19T12:01:41.635724+0000","last_peered":"2024-09-19T12:01:41.635724+0000","last_clean":"2024-09-19T12:01:41.635724+0000","last_became_active":"2024-09-19T11:35:37.640906+0000","last_became_peered":"2024-09-19T11:35:37.640906+0000","last_unstale":"2024-09-19T12:01:41.635724+0000","last_undegraded":"2024-09-19T12:01:41.635724+0000","last_fullsized":"2024-09-19T12:01:41.635724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:36.736085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8959,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":94,"num_read_kb":121,"num_write":68,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'612","reported_seq":1452,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.021235+0000","last_change":"2024-09-19T11:35:39.673666+0000","last_active":"2024-09-19T12:02:33.021235+0000","last_peered":"2024-09-19T12:02:33.021235+0000","last_clean":"2024-09-19T12:02:33.021235+0000","last_became_active":"2024-09-19T11:35:39.672054+0000","last_became_peered":"2024-09-19T11:35:39.672054+0000","last_unstale":"2024-09-19T12:02:33.021235+0000","last_undegraded":"2024-09-19T12:02:33.021235+0000","last_fullsized":"2024-09-19T12:02:33.021235+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:26.938497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'4","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.604432+0000","last_change":"2024-09-19T11:35:41.696920+0000","last_active":"2024-09-19T11:59:31.604432+0000","last_peered":"2024-09-19T11:59:31.604432+0000","last_clean":"2024-09-19T11:59:31.604432+0000","last_became_active":"2024-09-19T11:35:41.693623+0000","last_became_peered":"2024-09-19T11:35:41.693623+0000","last_unstale":"2024-09-19T11:59:31.604432+0000","last_undegraded":"2024-09-19T11:59:31.604432+0000","last_fullsized":"2024-09-19T11:59:31.604432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:36:17.971489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'3","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.616177+0000","last_change":"2024-09-19T11:35:33.620540+0000","last_active":"2024-09-19T12:00:21.616177+0000","last_peered":"2024-09-19T12:00:21.616177+0000","last_clean":"2024-09-19T12:00:21.616177+0000","last_became_active":"2024-09-19T11:35:33.620252+0000","last_became_peered":"2024-09-19T11:35:33.620252+0000","last_unstale":"2024-09-19T12:00:21.616177+0000","last_undegraded":"2024-09-19T12:00:21.616177+0000","last_fullsized":"2024-09-19T12:00:21.616177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:59.675080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'24","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.528130+0000","last_change":"2024-09-19T11:35:31.606672+0000","last_active":"2024-09-19T12:02:32.528130+0000","last_peered":"2024-09-19T12:02:32.528130+0000","last_clean":"2024-09-19T12:02:32.528130+0000","last_became_active":"2024-09-19T11:35:31.606137+0000","last_became_peered":"2024-09-19T11:35:31.606137+0000","last_unstale":"2024-09-19T12:02:32.528130+0000","last_undegraded":"2024-09-19T12:02:32.528130+0000","last_fullsized":"2024-09-19T12:02:32.528130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:46.025619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":95,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.591409+0000","last_change":"2024-09-19T11:35:35.620661+0000","last_active":"2024-09-19T11:59:31.591409+0000","last_peered":"2024-09-19T11:59:31.591409+0000","last_clean":"2024-09-19T11:59:31.591409+0000","last_became_active":"2024-09-19T11:35:35.619995+0000","last_became_peered":"2024-09-19T11:35:35.619995+0000","last_unstale":"2024-09-19T11:59:31.591409+0000","last_undegraded":"2024-09-19T11:59:31.591409+0000","last_fullsized":"2024-09-19T11:59:31.591409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:20.831305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'91","reported_seq":595,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:41.634336+0000","last_change":"2024-09-19T11:35:37.647073+0000","last_active":"2024-09-19T12:01:41.634336+0000","last_peered":"2024-09-19T12:01:41.634336+0000","last_clean":"2024-09-19T12:01:41.634336+0000","last_became_active":"2024-09-19T11:35:37.646446+0000","last_became_peered":"2024-09-19T11:35:37.646446+0000","last_unstale":"2024-09-19T12:01:41.634336+0000","last_undegraded":"2024-09-19T12:01:41.634336+0000","last_fullsized":"2024-09-19T12:01:41.634336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:26.769867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18926,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":204,"num_write":94,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.591328+0000","last_change":"2024-09-19T11:35:39.658936+0000","last_active":"2024-09-19T11:59:31.591328+0000","last_peered":"2024-09-19T11:59:31.591328+0000","last_clean":"2024-09-19T11:59:31.591328+0000","last_became_active":"2024-09-19T11:35:39.658173+0000","last_became_peered":"2024-09-19T11:35:39.658173+0000","last_unstale":"2024-09-19T11:59:31.591328+0000","last_undegraded":"2024-09-19T11:59:31.591328+0000","last_fullsized":"2024-09-19T11:59:31.591328+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:40.200085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'7","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.993549+0000","last_change":"2024-09-19T11:35:41.679566+0000","last_active":"2024-09-19T12:02:32.993549+0000","last_peered":"2024-09-19T12:02:32.993549+0000","last_clean":"2024-09-19T12:02:32.993549+0000","last_became_active":"2024-09-19T11:35:41.678765+0000","last_became_peered":"2024-09-19T11:35:41.678765+0000","last_unstale":"2024-09-19T12:02:32.993549+0000","last_undegraded":"2024-09-19T12:02:32.993549+0000","last_fullsized":"2024-09-19T12:02:32.993549+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:11.159416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":41,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'2","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.727132+0000","last_change":"2024-09-19T11:35:33.613035+0000","last_active":"2024-09-19T12:02:17.727132+0000","last_peered":"2024-09-19T12:02:17.727132+0000","last_clean":"2024-09-19T12:02:17.727132+0000","last_became_active":"2024-09-19T11:35:33.612279+0000","last_became_peered":"2024-09-19T11:35:33.612279+0000","last_unstale":"2024-09-19T12:02:17.727132+0000","last_undegraded":"2024-09-19T12:02:17.727132+0000","last_fullsized":"2024-09-19T12:02:17.727132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:21.396428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'90","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.786587+0000","last_change":"2024-09-19T11:35:31.584569+0000","last_active":"2024-09-19T12:02:17.786587+0000","last_peered":"2024-09-19T12:02:17.786587+0000","last_clean":"2024-09-19T12:02:17.786587+0000","last_became_active":"2024-09-19T11:35:31.584188+0000","last_became_peered":"2024-09-19T11:35:31.584188+0000","last_unstale":"2024-09-19T12:02:17.786587+0000","last_undegraded":"2024-09-19T12:02:17.786587+0000","last_fullsized":"2024-09-19T12:02:17.786587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:54.139090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":270,"num_read_kb":3453,"num_write":506,"num_write_kb":3250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.602050+0000","last_change":"2024-09-19T11:35:35.615386+0000","last_active":"2024-09-19T12:00:21.602050+0000","last_peered":"2024-09-19T12:00:21.602050+0000","last_clean":"2024-09-19T12:00:21.602050+0000","last_became_active":"2024-09-19T11:35:35.614650+0000","last_became_peered":"2024-09-19T11:35:35.614650+0000","last_unstale":"2024-09-19T12:00:21.602050+0000","last_undegraded":"2024-09-19T12:00:21.602050+0000","last_fullsized":"2024-09-19T12:00:21.602050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:10.129352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'74","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.790629+0000","last_change":"2024-09-19T11:35:37.632361+0000","last_active":"2024-09-19T12:02:17.790629+0000","last_peered":"2024-09-19T12:02:17.790629+0000","last_clean":"2024-09-19T12:02:17.790629+0000","last_became_active":"2024-09-19T11:35:37.624951+0000","last_became_peered":"2024-09-19T11:35:37.624951+0000","last_unstale":"2024-09-19T12:02:17.790629+0000","last_undegraded":"2024-09-19T12:02:17.790629+0000","last_fullsized":"2024-09-19T12:02:17.790629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:24.797414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":118,"num_read_kb":152,"num_write":134,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":475,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.618781+0000","last_change":"2024-09-19T11:35:39.671990+0000","last_active":"2024-09-19T12:00:31.618781+0000","last_peered":"2024-09-19T12:00:31.618781+0000","last_clean":"2024-09-19T12:00:31.618781+0000","last_became_active":"2024-09-19T11:35:39.671181+0000","last_became_peered":"2024-09-19T11:35:39.671181+0000","last_unstale":"2024-09-19T12:00:31.618781+0000","last_undegraded":"2024-09-19T12:00:31.618781+0000","last_fullsized":"2024-09-19T12:00:31.618781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:41.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'18","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.602486+0000","last_change":"2024-09-19T11:35:41.685909+0000","last_active":"2024-09-19T11:59:46.602486+0000","last_peered":"2024-09-19T11:59:46.602486+0000","last_clean":"2024-09-19T11:59:46.602486+0000","last_became_active":"2024-09-19T11:35:41.684966+0000","last_became_peered":"2024-09-19T11:35:41.684966+0000","last_unstale":"2024-09-19T11:59:46.602486+0000","last_undegraded":"2024-09-19T11:59:46.602486+0000","last_fullsized":"2024-09-19T11:59:46.602486+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:36.205278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":94,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'76","reported_seq":577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807509+0000","last_change":"2024-09-19T11:35:33.615010+0000","last_active":"2024-09-19T12:00:21.807509+0000","last_peered":"2024-09-19T12:00:21.807509+0000","last_clean":"2024-09-19T12:00:21.807509+0000","last_became_active":"2024-09-19T11:35:33.613369+0000","last_became_peered":"2024-09-19T11:35:33.613369+0000","last_unstale":"2024-09-19T12:00:21.807509+0000","last_undegraded":"2024-09-19T12:00:21.807509+0000","last_fullsized":"2024-09-19T12:00:21.807509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:13.047628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":221,"num_write":116,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'31","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.307029+0000","last_change":"2024-09-19T11:36:06.676047+0000","last_active":"2024-09-19T12:00:06.307029+0000","last_peered":"2024-09-19T12:00:06.307029+0000","last_clean":"2024-09-19T12:00:06.307029+0000","last_became_active":"2024-09-19T11:36:06.674998+0000","last_became_peered":"2024-09-19T11:36:06.674998+0000","last_unstale":"2024-09-19T12:00:06.307029+0000","last_undegraded":"2024-09-19T12:00:06.307029+0000","last_fullsized":"2024-09-19T12:00:06.307029+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:32.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7402804,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":38,"num_read_kb":7484,"num_write":130,"num_write_kb":7462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,7],"acting":[2,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.602482+0000","last_change":"2024-09-19T11:35:35.632289+0000","last_active":"2024-09-19T12:00:21.602482+0000","last_peered":"2024-09-19T12:00:21.602482+0000","last_clean":"2024-09-19T12:00:21.602482+0000","last_became_active":"2024-09-19T11:35:35.631702+0000","last_became_peered":"2024-09-19T11:35:35.631702+0000","last_unstale":"2024-09-19T12:00:21.602482+0000","last_undegraded":"2024-09-19T12:00:21.602482+0000","last_fullsized":"2024-09-19T12:00:21.602482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:14.196241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'75","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.618207+0000","last_change":"2024-09-19T11:35:37.628795+0000","last_active":"2024-09-19T12:02:32.618207+0000","last_peered":"2024-09-19T12:02:32.618207+0000","last_clean":"2024-09-19T12:02:32.618207+0000","last_became_active":"2024-09-19T11:35:37.627720+0000","last_became_peered":"2024-09-19T11:35:37.627720+0000","last_unstale":"2024-09-19T12:02:32.618207+0000","last_undegraded":"2024-09-19T12:02:32.618207+0000","last_fullsized":"2024-09-19T12:02:32.618207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:36.397426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12172,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":104,"num_read_kb":146,"num_write":78,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'614","reported_seq":1625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.472134+0000","last_change":"2024-09-19T11:35:39.651921+0000","last_active":"2024-09-19T12:02:34.472134+0000","last_peered":"2024-09-19T12:02:34.472134+0000","last_clean":"2024-09-19T12:02:34.472134+0000","last_became_active":"2024-09-19T11:35:39.651203+0000","last_became_peered":"2024-09-19T11:35:39.651203+0000","last_unstale":"2024-09-19T12:02:34.472134+0000","last_undegraded":"2024-09-19T12:02:34.472134+0000","last_fullsized":"2024-09-19T12:02:34.472134+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:01.951944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'8","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607324+0000","last_change":"2024-09-19T11:35:41.691885+0000","last_active":"2024-09-19T12:00:41.607324+0000","last_peered":"2024-09-19T12:00:41.607324+0000","last_clean":"2024-09-19T12:00:41.607324+0000","last_became_active":"2024-09-19T11:35:41.691146+0000","last_became_peered":"2024-09-19T11:35:41.691146+0000","last_unstale":"2024-09-19T12:00:41.607324+0000","last_undegraded":"2024-09-19T12:00:41.607324+0000","last_fullsized":"2024-09-19T12:00:41.607324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:13.054334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":44,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'23","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807571+0000","last_change":"2024-09-19T11:35:33.628948+0000","last_active":"2024-09-19T12:00:21.807571+0000","last_peered":"2024-09-19T12:00:21.807571+0000","last_clean":"2024-09-19T12:00:21.807571+0000","last_became_active":"2024-09-19T11:35:33.628232+0000","last_became_peered":"2024-09-19T11:35:33.628232+0000","last_unstale":"2024-09-19T12:00:21.807571+0000","last_undegraded":"2024-09-19T12:00:21.807571+0000","last_fullsized":"2024-09-19T12:00:21.807571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:54.904056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'40","reported_seq":555,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:33.242294+0000","last_change":"2024-09-19T11:35:31.584516+0000","last_active":"2024-09-19T11:59:33.242294+0000","last_peered":"2024-09-19T11:59:33.242294+0000","last_clean":"2024-09-19T11:59:33.242294+0000","last_became_active":"2024-09-19T11:35:31.583509+0000","last_became_peered":"2024-09-19T11:35:31.583509+0000","last_unstale":"2024-09-19T11:59:33.242294+0000","last_undegraded":"2024-09-19T11:59:33.242294+0000","last_fullsized":"2024-09-19T11:59:33.242294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:18.443812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":87,"num_read_kb":273,"num_write":136,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1304,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.946470+0000","last_change":"2024-09-19T11:35:35.630576+0000","last_active":"2024-09-19T12:02:32.946470+0000","last_peered":"2024-09-19T12:02:32.946470+0000","last_clean":"2024-09-19T12:02:32.946470+0000","last_became_active":"2024-09-19T11:35:35.629728+0000","last_became_peered":"2024-09-19T11:35:35.629728+0000","last_unstale":"2024-09-19T12:02:32.946470+0000","last_undegraded":"2024-09-19T12:02:32.946470+0000","last_fullsized":"2024-09-19T12:02:32.946470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:45.444265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":820,"num_read_kb":820,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'34","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611679+0000","last_change":"2024-09-19T11:35:37.618793+0000","last_active":"2024-09-19T12:00:26.611679+0000","last_peered":"2024-09-19T12:00:26.611679+0000","last_clean":"2024-09-19T12:00:26.611679+0000","last_became_active":"2024-09-19T11:35:37.618061+0000","last_became_peered":"2024-09-19T11:35:37.618061+0000","last_unstale":"2024-09-19T12:00:26.611679+0000","last_undegraded":"2024-09-19T12:00:26.611679+0000","last_fullsized":"2024-09-19T12:00:26.611679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:25.182817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'614","reported_seq":1665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.469112+0000","last_change":"2024-09-19T11:35:39.670880+0000","last_active":"2024-09-19T12:02:34.469112+0000","last_peered":"2024-09-19T12:02:34.469112+0000","last_clean":"2024-09-19T12:02:34.469112+0000","last_became_active":"2024-09-19T11:35:39.670211+0000","last_became_peered":"2024-09-19T11:35:39.670211+0000","last_unstale":"2024-09-19T12:02:34.469112+0000","last_undegraded":"2024-09-19T12:02:34.469112+0000","last_fullsized":"2024-09-19T12:02:34.469112+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:33.137968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'12","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812121+0000","last_change":"2024-09-19T11:35:41.688504+0000","last_active":"2024-09-19T12:00:41.812121+0000","last_peered":"2024-09-19T12:00:41.812121+0000","last_clean":"2024-09-19T12:00:41.812121+0000","last_became_active":"2024-09-19T11:35:41.687793+0000","last_became_peered":"2024-09-19T11:35:41.687793+0000","last_unstale":"2024-09-19T12:00:41.812121+0000","last_undegraded":"2024-09-19T12:00:41.812121+0000","last_fullsized":"2024-09-19T12:00:41.812121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:01.111100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":22,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'40","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603842+0000","last_change":"2024-09-19T11:35:33.603329+0000","last_active":"2024-09-19T12:00:26.603842+0000","last_peered":"2024-09-19T12:00:26.603842+0000","last_clean":"2024-09-19T12:00:26.603842+0000","last_became_active":"2024-09-19T11:35:33.602988+0000","last_became_peered":"2024-09-19T11:35:33.602988+0000","last_unstale":"2024-09-19T12:00:26.603842+0000","last_undegraded":"2024-09-19T12:00:26.603842+0000","last_fullsized":"2024-09-19T12:00:26.603842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:22.788235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":120,"num_write":65,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'34","reported_seq":556,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:33.122139+0000","last_change":"2024-09-19T11:36:06.676997+0000","last_active":"2024-09-19T11:59:33.122139+0000","last_peered":"2024-09-19T11:59:33.122139+0000","last_clean":"2024-09-19T11:59:33.122139+0000","last_became_active":"2024-09-19T11:36:06.675863+0000","last_became_peered":"2024-09-19T11:36:06.675863+0000","last_unstale":"2024-09-19T11:59:33.122139+0000","last_undegraded":"2024-09-19T11:59:33.122139+0000","last_fullsized":"2024-09-19T11:59:33.122139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:09.211491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":68,"num_read_kb":59,"num_write":155,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807544+0000","last_change":"2024-09-19T11:35:35.624735+0000","last_active":"2024-09-19T12:00:21.807544+0000","last_peered":"2024-09-19T12:00:21.807544+0000","last_clean":"2024-09-19T12:00:21.807544+0000","last_became_active":"2024-09-19T11:35:35.623987+0000","last_became_peered":"2024-09-19T11:35:35.623987+0000","last_unstale":"2024-09-19T12:00:21.807544+0000","last_undegraded":"2024-09-19T12:00:21.807544+0000","last_fullsized":"2024-09-19T12:00:21.807544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:01.328886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'111","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.615494+0000","last_change":"2024-09-19T11:35:37.628778+0000","last_active":"2024-09-19T12:00:26.615494+0000","last_peered":"2024-09-19T12:00:26.615494+0000","last_clean":"2024-09-19T12:00:26.615494+0000","last_became_active":"2024-09-19T11:35:37.627374+0000","last_became_peered":"2024-09-19T11:35:37.627374+0000","last_unstale":"2024-09-19T12:00:26.615494+0000","last_undegraded":"2024-09-19T12:00:26.615494+0000","last_fullsized":"2024-09-19T12:00:26.615494+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:40.224279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8513,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":153,"num_read_kb":184,"num_write":108,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.616096+0000","last_change":"2024-09-19T11:35:39.666833+0000","last_active":"2024-09-19T12:00:26.616096+0000","last_peered":"2024-09-19T12:00:26.616096+0000","last_clean":"2024-09-19T12:00:26.616096+0000","last_became_active":"2024-09-19T11:35:39.666071+0000","last_became_peered":"2024-09-19T11:35:39.666071+0000","last_unstale":"2024-09-19T12:00:26.616096+0000","last_undegraded":"2024-09-19T12:00:26.616096+0000","last_fullsized":"2024-09-19T12:00:26.616096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:55.544445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"253'10","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607413+0000","last_change":"2024-09-19T11:35:41.681654+0000","last_active":"2024-09-19T12:00:41.607413+0000","last_peered":"2024-09-19T12:00:41.607413+0000","last_clean":"2024-09-19T12:00:41.607413+0000","last_became_active":"2024-09-19T11:35:41.680850+0000","last_became_peered":"2024-09-19T11:35:41.680850+0000","last_unstale":"2024-09-19T12:00:41.607413+0000","last_undegraded":"2024-09-19T12:00:41.607413+0000","last_fullsized":"2024-09-19T12:00:41.607413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:38.701888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":41,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'9","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619799+0000","last_change":"2024-09-19T11:35:33.633360+0000","last_active":"2024-09-19T12:00:41.619799+0000","last_peered":"2024-09-19T12:00:41.619799+0000","last_clean":"2024-09-19T12:00:41.619799+0000","last_became_active":"2024-09-19T11:35:33.632623+0000","last_became_peered":"2024-09-19T11:35:33.632623+0000","last_unstale":"2024-09-19T12:00:41.619799+0000","last_undegraded":"2024-09-19T12:00:41.619799+0000","last_fullsized":"2024-09-19T12:00:41.619799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:21.511371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:21.605222+0000","last_change":"2024-09-19T11:35:14.134637+0000","last_active":"2024-09-19T11:59:21.605222+0000","last_peered":"2024-09-19T11:59:21.605222+0000","last_clean":"2024-09-19T11:59:21.605222+0000","last_became_active":"2024-09-19T11:35:14.133710+0000","last_became_peered":"2024-09-19T11:35:14.133710+0000","last_unstale":"2024-09-19T11:59:21.605222+0000","last_undegraded":"2024-09-19T11:59:21.605222+0000","last_fullsized":"2024-09-19T11:59:21.605222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:13.080179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:13.080179+0000","last_clean_scrub_stamp":"2024-09-19T11:35:13.080179+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:26.810969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.614213+0000","last_change":"2024-09-19T11:35:21.174817+0000","last_active":"2024-09-19T12:00:21.614213+0000","last_peered":"2024-09-19T12:00:21.614213+0000","last_clean":"2024-09-19T12:00:21.614213+0000","last_became_active":"2024-09-19T11:35:19.150393+0000","last_became_peered":"2024-09-19T11:35:19.150393+0000","last_unstale":"2024-09-19T12:00:21.614213+0000","last_undegraded":"2024-09-19T12:00:21.614213+0000","last_fullsized":"2024-09-19T12:00:21.614213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:35.259610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001387466,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'59","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.629646+0000","last_change":"2024-09-19T11:35:31.593431+0000","last_active":"2024-09-19T12:02:32.629646+0000","last_peered":"2024-09-19T12:02:32.629646+0000","last_clean":"2024-09-19T12:02:32.629646+0000","last_became_active":"2024-09-19T11:35:31.592913+0000","last_became_peered":"2024-09-19T11:35:31.592913+0000","last_unstale":"2024-09-19T12:02:32.629646+0000","last_undegraded":"2024-09-19T12:02:32.629646+0000","last_fullsized":"2024-09-19T12:02:32.629646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:24:42.956900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":130,"num_read_kb":2042,"num_write":246,"num_write_kb":1946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.621462+0000","last_change":"2024-09-19T11:35:35.603629+0000","last_active":"2024-09-19T12:00:36.621462+0000","last_peered":"2024-09-19T12:00:36.621462+0000","last_clean":"2024-09-19T12:00:36.621462+0000","last_became_active":"2024-09-19T11:35:35.602892+0000","last_became_peered":"2024-09-19T11:35:35.602892+0000","last_unstale":"2024-09-19T12:00:36.621462+0000","last_undegraded":"2024-09-19T12:00:36.621462+0000","last_fullsized":"2024-09-19T12:00:36.621462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:06.994180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'175","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:45.370851+0000","last_change":"2024-09-19T11:35:37.638436+0000","last_active":"2024-09-19T12:01:45.370851+0000","last_peered":"2024-09-19T12:01:45.370851+0000","last_clean":"2024-09-19T12:01:45.370851+0000","last_became_active":"2024-09-19T11:35:37.636399+0000","last_became_peered":"2024-09-19T11:35:37.636399+0000","last_unstale":"2024-09-19T12:01:45.370851+0000","last_undegraded":"2024-09-19T12:01:45.370851+0000","last_fullsized":"2024-09-19T12:01:45.370851+0000","mapping_epoch":32,"log_start":"262'100","ondisk_log_start":"262'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:14:07.861992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33202,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":257,"num_read_kb":423,"num_write":244,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":475,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.604407+0000","last_change":"2024-09-19T11:35:39.681040+0000","last_active":"2024-09-19T11:59:31.604407+0000","last_peered":"2024-09-19T11:59:31.604407+0000","last_clean":"2024-09-19T11:59:31.604407+0000","last_became_active":"2024-09-19T11:35:39.680298+0000","last_became_peered":"2024-09-19T11:35:39.680298+0000","last_unstale":"2024-09-19T11:59:31.604407+0000","last_undegraded":"2024-09-19T11:59:31.604407+0000","last_fullsized":"2024-09-19T11:59:31.604407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:52.699540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'52","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.766635+0000","last_change":"2024-09-19T11:35:41.679956+0000","last_active":"2024-09-19T12:02:19.766635+0000","last_peered":"2024-09-19T12:02:19.766635+0000","last_clean":"2024-09-19T12:02:19.766635+0000","last_became_active":"2024-09-19T11:35:41.679219+0000","last_became_peered":"2024-09-19T11:35:41.679219+0000","last_unstale":"2024-09-19T12:02:19.766635+0000","last_undegraded":"2024-09-19T12:02:19.766635+0000","last_fullsized":"2024-09-19T12:02:19.766635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:30.335832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":334,"num_read_kb":278,"num_write":121,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'139","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.179765+0000","last_change":"2024-09-19T11:35:33.624017+0000","last_active":"2024-09-19T12:02:33.179765+0000","last_peered":"2024-09-19T12:02:33.179765+0000","last_clean":"2024-09-19T12:02:33.179765+0000","last_became_active":"2024-09-19T11:35:33.622065+0000","last_became_peered":"2024-09-19T11:35:33.622065+0000","last_unstale":"2024-09-19T12:02:33.179765+0000","last_undegraded":"2024-09-19T12:02:33.179765+0000","last_fullsized":"2024-09-19T12:02:33.179765+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.917346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":557,"num_read_kb":440,"num_write":210,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.606297+0000","last_change":"2024-09-19T11:35:21.463140+0000","last_active":"2024-09-19T11:59:26.606297+0000","last_peered":"2024-09-19T11:59:26.606297+0000","last_clean":"2024-09-19T11:59:26.606297+0000","last_became_active":"2024-09-19T11:35:19.154360+0000","last_became_peered":"2024-09-19T11:35:19.154360+0000","last_unstale":"2024-09-19T11:59:26.606297+0000","last_undegraded":"2024-09-19T11:59:26.606297+0000","last_fullsized":"2024-09-19T11:59:26.606297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:59.779314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086516000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'33","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.453497+0000","last_change":"2024-09-19T11:36:06.678664+0000","last_active":"2024-09-19T12:02:32.453497+0000","last_peered":"2024-09-19T12:02:32.453497+0000","last_clean":"2024-09-19T12:02:32.453497+0000","last_became_active":"2024-09-19T11:36:06.677474+0000","last_became_peered":"2024-09-19T11:36:06.677474+0000","last_unstale":"2024-09-19T12:02:32.453497+0000","last_undegraded":"2024-09-19T12:02:32.453497+0000","last_fullsized":"2024-09-19T12:02:32.453497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:18.377791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":54,"num_read_kb":49,"num_write":140,"num_write_kb":5149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,5],"acting":[0,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.601906+0000","last_change":"2024-09-19T11:35:35.618073+0000","last_active":"2024-09-19T11:59:26.601906+0000","last_peered":"2024-09-19T11:59:26.601906+0000","last_clean":"2024-09-19T11:59:26.601906+0000","last_became_active":"2024-09-19T11:35:35.616382+0000","last_became_peered":"2024-09-19T11:35:35.616382+0000","last_unstale":"2024-09-19T11:59:26.601906+0000","last_undegraded":"2024-09-19T11:59:26.601906+0000","last_fullsized":"2024-09-19T11:59:26.601906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:08.281218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'556","reported_seq":1601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.460872+0000","last_change":"2024-09-19T11:35:37.641209+0000","last_active":"2024-09-19T12:02:34.460872+0000","last_peered":"2024-09-19T12:02:34.460872+0000","last_clean":"2024-09-19T12:02:34.460872+0000","last_became_active":"2024-09-19T11:35:37.640355+0000","last_became_peered":"2024-09-19T11:35:37.640355+0000","last_unstale":"2024-09-19T12:02:34.460872+0000","last_undegraded":"2024-09-19T12:02:34.460872+0000","last_fullsized":"2024-09-19T12:02:34.460872+0000","mapping_epoch":32,"log_start":"264'501","ondisk_log_start":"264'501","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":501,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:53.345519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26845,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":798,"num_read_kb":909,"num_write":150,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:46.623781+0000","last_change":"2024-09-19T11:35:39.676564+0000","last_active":"2024-09-19T12:00:46.623781+0000","last_peered":"2024-09-19T12:00:46.623781+0000","last_clean":"2024-09-19T12:00:46.623781+0000","last_became_active":"2024-09-19T11:35:39.675795+0000","last_became_peered":"2024-09-19T11:35:39.675795+0000","last_unstale":"2024-09-19T12:00:46.623781+0000","last_undegraded":"2024-09-19T12:00:46.623781+0000","last_fullsized":"2024-09-19T12:00:46.623781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:43.633195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'10","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.592039+0000","last_change":"2024-09-19T11:35:41.679366+0000","last_active":"2024-09-19T11:59:36.592039+0000","last_peered":"2024-09-19T11:59:36.592039+0000","last_clean":"2024-09-19T11:59:36.592039+0000","last_became_active":"2024-09-19T11:35:41.678660+0000","last_became_peered":"2024-09-19T11:35:41.678660+0000","last_unstale":"2024-09-19T11:59:36.592039+0000","last_undegraded":"2024-09-19T11:59:36.592039+0000","last_fullsized":"2024-09-19T11:59:36.592039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:59.286098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'21","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.596686+0000","last_change":"2024-09-19T11:36:06.674126+0000","last_active":"2024-09-19T11:59:56.596686+0000","last_peered":"2024-09-19T11:59:56.596686+0000","last_clean":"2024-09-19T11:59:56.596686+0000","last_became_active":"2024-09-19T11:36:06.673265+0000","last_became_peered":"2024-09-19T11:36:06.673265+0000","last_unstale":"2024-09-19T11:59:56.596686+0000","last_undegraded":"2024-09-19T11:59:56.596686+0000","last_fullsized":"2024-09-19T11:59:56.596686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:39.951937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":39,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.601866+0000","last_change":"2024-09-19T11:35:21.169499+0000","last_active":"2024-09-19T12:00:21.601866+0000","last_peered":"2024-09-19T12:00:21.601866+0000","last_clean":"2024-09-19T12:00:21.601866+0000","last_became_active":"2024-09-19T11:35:19.969368+0000","last_became_peered":"2024-09-19T11:35:19.969368+0000","last_unstale":"2024-09-19T12:00:21.601866+0000","last_undegraded":"2024-09-19T12:00:21.601866+0000","last_fullsized":"2024-09-19T12:00:21.601866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:54.928769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001160424,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'17","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.591917+0000","last_change":"2024-09-19T11:35:31.591567+0000","last_active":"2024-09-19T11:59:36.591917+0000","last_peered":"2024-09-19T11:59:36.591917+0000","last_clean":"2024-09-19T11:59:36.591917+0000","last_became_active":"2024-09-19T11:35:31.590860+0000","last_became_peered":"2024-09-19T11:35:31.590860+0000","last_unstale":"2024-09-19T11:59:36.591917+0000","last_undegraded":"2024-09-19T11:59:36.591917+0000","last_fullsized":"2024-09-19T11:59:36.591917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:09.412483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":61,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.590321+0000","last_change":"2024-09-19T11:35:35.611723+0000","last_active":"2024-09-19T11:59:26.590321+0000","last_peered":"2024-09-19T11:59:26.590321+0000","last_clean":"2024-09-19T11:59:26.590321+0000","last_became_active":"2024-09-19T11:35:35.611092+0000","last_became_peered":"2024-09-19T11:35:35.611092+0000","last_unstale":"2024-09-19T11:59:26.590321+0000","last_undegraded":"2024-09-19T11:59:26.590321+0000","last_fullsized":"2024-09-19T11:59:26.590321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:28.447966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'117","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.344688+0000","last_change":"2024-09-19T11:35:37.647865+0000","last_active":"2024-09-19T12:02:34.344688+0000","last_peered":"2024-09-19T12:02:34.344688+0000","last_clean":"2024-09-19T12:02:34.344688+0000","last_became_active":"2024-09-19T11:35:37.647356+0000","last_became_peered":"2024-09-19T11:35:37.647356+0000","last_unstale":"2024-09-19T12:02:34.344688+0000","last_undegraded":"2024-09-19T12:02:34.344688+0000","last_fullsized":"2024-09-19T12:02:34.344688+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:35.178664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":120,"num_read_kb":109,"num_write":73,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621074+0000","last_change":"2024-09-19T11:35:39.673457+0000","last_active":"2024-09-19T12:00:41.621074+0000","last_peered":"2024-09-19T12:00:41.621074+0000","last_clean":"2024-09-19T12:00:41.621074+0000","last_became_active":"2024-09-19T11:35:39.672352+0000","last_became_peered":"2024-09-19T11:35:39.672352+0000","last_unstale":"2024-09-19T12:00:41.621074+0000","last_undegraded":"2024-09-19T12:00:41.621074+0000","last_fullsized":"2024-09-19T12:00:41.621074+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:47.157668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"256'101","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611538+0000","last_change":"2024-09-19T11:35:41.689002+0000","last_active":"2024-09-19T12:00:26.611538+0000","last_peered":"2024-09-19T12:00:26.611538+0000","last_clean":"2024-09-19T12:00:26.611538+0000","last_became_active":"2024-09-19T11:35:41.688239+0000","last_became_peered":"2024-09-19T11:35:41.688239+0000","last_unstale":"2024-09-19T12:00:26.611538+0000","last_undegraded":"2024-09-19T12:00:26.611538+0000","last_fullsized":"2024-09-19T12:00:26.611538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:43:57.342380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":254,"num_write":203,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'2","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.196523+0000","last_change":"2024-09-19T11:35:33.601303+0000","last_active":"2024-09-19T12:02:33.196523+0000","last_peered":"2024-09-19T12:02:33.196523+0000","last_clean":"2024-09-19T12:02:33.196523+0000","last_became_active":"2024-09-19T11:35:33.600618+0000","last_became_peered":"2024-09-19T11:35:33.600618+0000","last_unstale":"2024-09-19T12:02:33.196523+0000","last_undegraded":"2024-09-19T12:02:33.196523+0000","last_fullsized":"2024-09-19T12:02:33.196523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:54.655273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.614118+0000","last_change":"2024-09-19T11:35:21.176258+0000","last_active":"2024-09-19T12:00:21.614118+0000","last_peered":"2024-09-19T12:00:21.614118+0000","last_clean":"2024-09-19T12:00:21.614118+0000","last_became_active":"2024-09-19T11:35:19.151363+0000","last_became_peered":"2024-09-19T11:35:19.151363+0000","last_unstale":"2024-09-19T12:00:21.614118+0000","last_undegraded":"2024-09-19T12:00:21.614118+0000","last_fullsized":"2024-09-19T12:00:21.614118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:58.212055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028321980000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'31","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:26.479325+0000","last_change":"2024-09-19T11:35:31.588679+0000","last_active":"2024-09-19T12:02:26.479325+0000","last_peered":"2024-09-19T12:02:26.479325+0000","last_clean":"2024-09-19T12:02:26.479325+0000","last_became_active":"2024-09-19T11:35:31.587649+0000","last_became_peered":"2024-09-19T11:35:31.587649+0000","last_unstale":"2024-09-19T12:02:26.479325+0000","last_undegraded":"2024-09-19T12:02:26.479325+0000","last_fullsized":"2024-09-19T12:02:26.479325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:13.392140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246326,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":69,"num_read_kb":1908,"num_write":126,"num_write_kb":8008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621095+0000","last_change":"2024-09-19T11:35:35.617574+0000","last_active":"2024-09-19T12:00:41.621095+0000","last_peered":"2024-09-19T12:00:41.621095+0000","last_clean":"2024-09-19T12:00:41.621095+0000","last_became_active":"2024-09-19T11:35:35.617200+0000","last_became_peered":"2024-09-19T11:35:35.617200+0000","last_unstale":"2024-09-19T12:00:41.621095+0000","last_undegraded":"2024-09-19T12:00:41.621095+0000","last_fullsized":"2024-09-19T12:00:41.621095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:13.119332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'69","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.599082+0000","last_change":"2024-09-19T11:35:37.643925+0000","last_active":"2024-09-19T11:59:31.599082+0000","last_peered":"2024-09-19T11:59:31.599082+0000","last_clean":"2024-09-19T11:59:31.599082+0000","last_became_active":"2024-09-19T11:35:37.643310+0000","last_became_peered":"2024-09-19T11:35:37.643310+0000","last_unstale":"2024-09-19T11:59:31.599082+0000","last_undegraded":"2024-09-19T11:59:31.599082+0000","last_fullsized":"2024-09-19T11:59:31.599082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:52.522266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":101,"num_read_kb":95,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.603772+0000","last_change":"2024-09-19T11:35:39.670325+0000","last_active":"2024-09-19T11:59:31.603772+0000","last_peered":"2024-09-19T11:59:31.603772+0000","last_clean":"2024-09-19T11:59:31.603772+0000","last_became_active":"2024-09-19T11:35:39.669555+0000","last_became_peered":"2024-09-19T11:35:39.669555+0000","last_unstale":"2024-09-19T11:59:31.603772+0000","last_undegraded":"2024-09-19T11:59:31.603772+0000","last_fullsized":"2024-09-19T11:59:31.603772+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:49.076245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'20","reported_seq":557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.765426+0000","last_change":"2024-09-19T11:35:41.679051+0000","last_active":"2024-09-19T12:02:19.765426+0000","last_peered":"2024-09-19T12:02:19.765426+0000","last_clean":"2024-09-19T12:02:19.765426+0000","last_became_active":"2024-09-19T11:35:41.678167+0000","last_became_peered":"2024-09-19T11:35:41.678167+0000","last_unstale":"2024-09-19T12:02:19.765426+0000","last_undegraded":"2024-09-19T12:02:19.765426+0000","last_fullsized":"2024-09-19T12:02:19.765426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:18.723092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":65,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'93","reported_seq":609,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.606163+0000","last_change":"2024-09-19T11:35:33.606056+0000","last_active":"2024-09-19T12:00:36.606163+0000","last_peered":"2024-09-19T12:00:36.606163+0000","last_clean":"2024-09-19T12:00:36.606163+0000","last_became_active":"2024-09-19T11:35:33.605504+0000","last_became_peered":"2024-09-19T11:35:33.605504+0000","last_unstale":"2024-09-19T12:00:36.606163+0000","last_undegraded":"2024-09-19T12:00:36.606163+0000","last_fullsized":"2024-09-19T12:00:36.606163+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:14:43.679145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":306,"num_write":160,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'40","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.608437+0000","last_change":"2024-09-19T11:35:31.617849+0000","last_active":"2024-09-19T12:02:32.608437+0000","last_peered":"2024-09-19T12:02:32.608437+0000","last_clean":"2024-09-19T12:02:32.608437+0000","last_became_active":"2024-09-19T11:35:31.616954+0000","last_became_peered":"2024-09-19T11:35:31.616954+0000","last_unstale":"2024-09-19T12:02:32.608437+0000","last_undegraded":"2024-09-19T12:02:32.608437+0000","last_fullsized":"2024-09-19T12:02:32.608437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:52.945748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088230,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":55,"num_read_kb":2718,"num_write":146,"num_write_kb":7832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.602438+0000","last_change":"2024-09-19T11:35:21.183056+0000","last_active":"2024-09-19T12:00:21.602438+0000","last_peered":"2024-09-19T12:00:21.602438+0000","last_clean":"2024-09-19T12:00:21.602438+0000","last_became_active":"2024-09-19T11:35:20.096557+0000","last_became_peered":"2024-09-19T11:35:20.096557+0000","last_unstale":"2024-09-19T12:00:21.602438+0000","last_undegraded":"2024-09-19T12:00:21.602438+0000","last_fullsized":"2024-09-19T12:00:21.602438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:29.688644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010463289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.619805+0000","last_change":"2024-09-19T11:35:35.624242+0000","last_active":"2024-09-19T12:00:36.619805+0000","last_peered":"2024-09-19T12:00:36.619805+0000","last_clean":"2024-09-19T12:00:36.619805+0000","last_became_active":"2024-09-19T11:35:35.623450+0000","last_became_peered":"2024-09-19T11:35:35.623450+0000","last_unstale":"2024-09-19T12:00:36.619805+0000","last_undegraded":"2024-09-19T12:00:36.619805+0000","last_fullsized":"2024-09-19T12:00:36.619805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:29.438228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'143","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:46.635668+0000","last_change":"2024-09-19T11:35:37.638304+0000","last_active":"2024-09-19T12:01:46.635668+0000","last_peered":"2024-09-19T12:01:46.635668+0000","last_clean":"2024-09-19T12:01:46.635668+0000","last_became_active":"2024-09-19T11:35:37.637234+0000","last_became_peered":"2024-09-19T11:35:37.637234+0000","last_unstale":"2024-09-19T12:01:46.635668+0000","last_undegraded":"2024-09-19T12:01:46.635668+0000","last_fullsized":"2024-09-19T12:01:46.635668+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:56.332709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19177,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":285,"num_write":146,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812070+0000","last_change":"2024-09-19T11:35:39.671642+0000","last_active":"2024-09-19T12:00:41.812070+0000","last_peered":"2024-09-19T12:00:41.812070+0000","last_clean":"2024-09-19T12:00:41.812070+0000","last_became_active":"2024-09-19T11:35:39.669914+0000","last_became_peered":"2024-09-19T11:35:39.669914+0000","last_unstale":"2024-09-19T12:00:41.812070+0000","last_undegraded":"2024-09-19T12:00:41.812070+0000","last_fullsized":"2024-09-19T12:00:41.812070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:43.678369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'12","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.617421+0000","last_change":"2024-09-19T11:35:41.692653+0000","last_active":"2024-09-19T12:00:26.617421+0000","last_peered":"2024-09-19T12:00:26.617421+0000","last_clean":"2024-09-19T12:00:26.617421+0000","last_became_active":"2024-09-19T11:35:41.690257+0000","last_became_peered":"2024-09-19T11:35:41.690257+0000","last_unstale":"2024-09-19T12:00:26.617421+0000","last_undegraded":"2024-09-19T12:00:26.617421+0000","last_fullsized":"2024-09-19T12:00:26.617421+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:24.125004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'201","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.388896+0000","last_change":"2024-09-19T11:35:33.614634+0000","last_active":"2024-09-19T12:02:19.388896+0000","last_peered":"2024-09-19T12:02:19.388896+0000","last_clean":"2024-09-19T12:02:19.388896+0000","last_became_active":"2024-09-19T11:35:33.614327+0000","last_became_peered":"2024-09-19T11:35:33.614327+0000","last_unstale":"2024-09-19T12:02:19.388896+0000","last_undegraded":"2024-09-19T12:02:19.388896+0000","last_fullsized":"2024-09-19T12:02:19.388896+0000","mapping_epoch":28,"log_start":"256'100","ondisk_log_start":"256'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:00.637435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":855,"num_read_kb":681,"num_write":310,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'40","reported_seq":556,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.628087+0000","last_change":"2024-09-19T11:35:31.598990+0000","last_active":"2024-09-19T12:02:32.628087+0000","last_peered":"2024-09-19T12:02:32.628087+0000","last_clean":"2024-09-19T12:02:32.628087+0000","last_became_active":"2024-09-19T11:35:31.598447+0000","last_became_peered":"2024-09-19T11:35:31.598447+0000","last_unstale":"2024-09-19T12:02:32.628087+0000","last_undegraded":"2024-09-19T12:02:32.628087+0000","last_fullsized":"2024-09-19T12:02:32.628087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:13:57.048369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388737,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":83,"num_read_kb":9296,"num_write":134,"num_write_kb":14398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.619240+0000","last_change":"2024-09-19T11:35:21.463119+0000","last_active":"2024-09-19T12:00:26.619240+0000","last_peered":"2024-09-19T12:00:26.619240+0000","last_clean":"2024-09-19T12:00:26.619240+0000","last_became_active":"2024-09-19T11:35:20.094400+0000","last_became_peered":"2024-09-19T11:35:20.094400+0000","last_unstale":"2024-09-19T12:00:26.619240+0000","last_undegraded":"2024-09-19T12:00:26.619240+0000","last_fullsized":"2024-09-19T12:00:26.619240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:19.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088955000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"38'5","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.717295+0000","last_change":"2024-09-19T11:35:35.620047+0000","last_active":"2024-09-19T12:02:32.717295+0000","last_peered":"2024-09-19T12:02:32.717295+0000","last_clean":"2024-09-19T12:02:32.717295+0000","last_became_active":"2024-09-19T11:35:35.619212+0000","last_became_peered":"2024-09-19T11:35:35.619212+0000","last_unstale":"2024-09-19T12:02:32.717295+0000","last_undegraded":"2024-09-19T12:02:32.717295+0000","last_fullsized":"2024-09-19T12:02:32.717295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:38.449188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":1024,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'100","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607374+0000","last_change":"2024-09-19T11:35:37.633269+0000","last_active":"2024-09-19T12:00:41.607374+0000","last_peered":"2024-09-19T12:00:41.607374+0000","last_clean":"2024-09-19T12:00:41.607374+0000","last_became_active":"2024-09-19T11:35:37.629547+0000","last_became_peered":"2024-09-19T11:35:37.629547+0000","last_unstale":"2024-09-19T12:00:41.607374+0000","last_undegraded":"2024-09-19T12:00:41.607374+0000","last_fullsized":"2024-09-19T12:00:41.607374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:55.759738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":151,"num_read_kb":144,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'617","reported_seq":1651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.048365+0000","last_change":"2024-09-19T11:35:39.683282+0000","last_active":"2024-09-19T12:02:33.048365+0000","last_peered":"2024-09-19T12:02:33.048365+0000","last_clean":"2024-09-19T12:02:33.048365+0000","last_became_active":"2024-09-19T11:35:39.681476+0000","last_became_peered":"2024-09-19T11:35:39.681476+0000","last_unstale":"2024-09-19T12:02:33.048365+0000","last_undegraded":"2024-09-19T12:02:33.048365+0000","last_fullsized":"2024-09-19T12:02:33.048365+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:03.143481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'15","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.612867+0000","last_change":"2024-09-19T11:35:41.671140+0000","last_active":"2024-09-19T12:00:31.612867+0000","last_peered":"2024-09-19T12:00:31.612867+0000","last_clean":"2024-09-19T12:00:31.612867+0000","last_became_active":"2024-09-19T11:35:41.670410+0000","last_became_peered":"2024-09-19T11:35:41.670410+0000","last_unstale":"2024-09-19T12:00:31.612867+0000","last_undegraded":"2024-09-19T12:00:31.612867+0000","last_fullsized":"2024-09-19T12:00:31.612867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:12:45.264833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":68,"num_write":44,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'111","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:25.782149+0000","last_change":"2024-09-19T11:35:33.625333+0000","last_active":"2024-09-19T12:02:25.782149+0000","last_peered":"2024-09-19T12:02:25.782149+0000","last_clean":"2024-09-19T12:02:25.782149+0000","last_became_active":"2024-09-19T11:35:33.624885+0000","last_became_peered":"2024-09-19T11:35:33.624885+0000","last_unstale":"2024-09-19T12:02:25.782149+0000","last_undegraded":"2024-09-19T12:02:25.782149+0000","last_fullsized":"2024-09-19T12:02:25.782149+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:31.869760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":317,"num_write":191,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'31","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:30.666941+0000","last_change":"2024-09-19T11:36:06.650619+0000","last_active":"2024-09-19T11:59:30.666941+0000","last_peered":"2024-09-19T11:59:30.666941+0000","last_clean":"2024-09-19T11:59:30.666941+0000","last_became_active":"2024-09-19T11:36:06.649117+0000","last_became_peered":"2024-09-19T11:36:06.649117+0000","last_unstale":"2024-09-19T11:59:30.666941+0000","last_undegraded":"2024-09-19T11:59:30.666941+0000","last_fullsized":"2024-09-19T11:59:30.666941+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:52.917710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":153,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.586560+0000","last_change":"2024-09-19T11:35:21.182872+0000","last_active":"2024-09-19T11:59:11.586560+0000","last_peered":"2024-09-19T11:59:11.586560+0000","last_clean":"2024-09-19T11:59:11.586560+0000","last_became_active":"2024-09-19T11:35:19.152195+0000","last_became_peered":"2024-09-19T11:35:19.152195+0000","last_unstale":"2024-09-19T11:59:11.586560+0000","last_undegraded":"2024-09-19T11:59:11.586560+0000","last_fullsized":"2024-09-19T11:59:11.586560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:33.512818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094930600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810796+0000","last_change":"2024-09-19T11:35:35.625999+0000","last_active":"2024-09-19T12:00:36.810796+0000","last_peered":"2024-09-19T12:00:36.810796+0000","last_clean":"2024-09-19T12:00:36.810796+0000","last_became_active":"2024-09-19T11:35:35.625385+0000","last_became_peered":"2024-09-19T11:35:35.625385+0000","last_unstale":"2024-09-19T12:00:36.810796+0000","last_undegraded":"2024-09-19T12:00:36.810796+0000","last_fullsized":"2024-09-19T12:00:36.810796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:58.273564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'58","reported_seq":572,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812198+0000","last_change":"2024-09-19T11:35:37.642580+0000","last_active":"2024-09-19T12:00:41.812198+0000","last_peered":"2024-09-19T12:00:41.812198+0000","last_clean":"2024-09-19T12:00:41.812198+0000","last_became_active":"2024-09-19T11:35:37.641855+0000","last_became_peered":"2024-09-19T11:35:37.641855+0000","last_unstale":"2024-09-19T12:00:41.812198+0000","last_undegraded":"2024-09-19T12:00:41.812198+0000","last_fullsized":"2024-09-19T12:00:41.812198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:09.995922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":89,"num_read_kb":84,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'618","reported_seq":1534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.476923+0000","last_change":"2024-09-19T11:35:39.663385+0000","last_active":"2024-09-19T12:02:34.476923+0000","last_peered":"2024-09-19T12:02:34.476923+0000","last_clean":"2024-09-19T12:02:34.476923+0000","last_became_active":"2024-09-19T11:35:39.662678+0000","last_became_peered":"2024-09-19T11:35:39.662678+0000","last_unstale":"2024-09-19T12:02:34.476923+0000","last_undegraded":"2024-09-19T12:02:34.476923+0000","last_fullsized":"2024-09-19T12:02:34.476923+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:49.009964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'101","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.205987+0000","last_change":"2024-09-19T11:35:41.684355+0000","last_active":"2024-09-19T12:02:33.205987+0000","last_peered":"2024-09-19T12:02:33.205987+0000","last_clean":"2024-09-19T12:02:33.205987+0000","last_became_active":"2024-09-19T11:35:41.683629+0000","last_became_peered":"2024-09-19T11:35:41.683629+0000","last_unstale":"2024-09-19T12:02:33.205987+0000","last_undegraded":"2024-09-19T12:02:33.205987+0000","last_fullsized":"2024-09-19T12:02:33.205987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:47.007366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":202,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'36","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.192875+0000","last_change":"2024-09-19T11:35:33.616782+0000","last_active":"2024-09-19T12:02:33.192875+0000","last_peered":"2024-09-19T12:02:33.192875+0000","last_clean":"2024-09-19T12:02:33.192875+0000","last_became_active":"2024-09-19T11:35:33.616079+0000","last_became_peered":"2024-09-19T11:35:33.616079+0000","last_unstale":"2024-09-19T12:02:33.192875+0000","last_undegraded":"2024-09-19T12:02:33.192875+0000","last_fullsized":"2024-09-19T12:02:33.192875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:15:39.547552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":147,"num_write":69,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'35","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.714196+0000","last_change":"2024-09-19T11:35:31.613306+0000","last_active":"2024-09-19T12:02:17.714196+0000","last_peered":"2024-09-19T12:02:17.714196+0000","last_clean":"2024-09-19T12:02:17.714196+0000","last_became_active":"2024-09-19T11:35:31.612706+0000","last_became_peered":"2024-09-19T11:35:31.612706+0000","last_unstale":"2024-09-19T12:02:17.714196+0000","last_undegraded":"2024-09-19T12:02:17.714196+0000","last_fullsized":"2024-09-19T12:02:17.714196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:16.769591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322891,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":64,"num_read_kb":6249,"num_write":148,"num_write_kb":6206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.599479+0000","last_change":"2024-09-19T11:35:21.168189+0000","last_active":"2024-09-19T11:59:11.599479+0000","last_peered":"2024-09-19T11:59:11.599479+0000","last_clean":"2024-09-19T11:59:11.599479+0000","last_became_active":"2024-09-19T11:35:19.152446+0000","last_became_peered":"2024-09-19T11:35:19.152446+0000","last_unstale":"2024-09-19T11:59:11.599479+0000","last_undegraded":"2024-09-19T11:59:11.599479+0000","last_fullsized":"2024-09-19T11:59:11.599479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:09.874667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.601284+0000","last_change":"2024-09-19T11:35:35.624664+0000","last_active":"2024-09-19T11:59:41.601284+0000","last_peered":"2024-09-19T11:59:41.601284+0000","last_clean":"2024-09-19T11:59:41.601284+0000","last_became_active":"2024-09-19T11:35:35.624322+0000","last_became_peered":"2024-09-19T11:35:35.624322+0000","last_unstale":"2024-09-19T11:59:41.601284+0000","last_undegraded":"2024-09-19T11:59:41.601284+0000","last_fullsized":"2024-09-19T11:59:41.601284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:10.112342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'184","reported_seq":719,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.791588+0000","last_change":"2024-09-19T11:35:37.646919+0000","last_active":"2024-09-19T12:02:17.791588+0000","last_peered":"2024-09-19T12:02:17.791588+0000","last_clean":"2024-09-19T12:02:17.791588+0000","last_became_active":"2024-09-19T11:35:37.646158+0000","last_became_peered":"2024-09-19T11:35:37.646158+0000","last_unstale":"2024-09-19T12:02:17.791588+0000","last_undegraded":"2024-09-19T12:02:17.791588+0000","last_fullsized":"2024-09-19T12:02:17.791588+0000","mapping_epoch":32,"log_start":"256'100","ondisk_log_start":"256'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:25.054477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37796,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":260,"num_read_kb":439,"num_write":202,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615042+0000","last_change":"2024-09-19T11:35:39.684662+0000","last_active":"2024-09-19T12:00:41.615042+0000","last_peered":"2024-09-19T12:00:41.615042+0000","last_clean":"2024-09-19T12:00:41.615042+0000","last_became_active":"2024-09-19T11:35:39.684034+0000","last_became_peered":"2024-09-19T11:35:39.684034+0000","last_unstale":"2024-09-19T12:00:41.615042+0000","last_undegraded":"2024-09-19T12:00:41.615042+0000","last_fullsized":"2024-09-19T12:00:41.615042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:00.499255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'21","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.615420+0000","last_change":"2024-09-19T11:35:41.690412+0000","last_active":"2024-09-19T12:00:26.615420+0000","last_peered":"2024-09-19T12:00:26.615420+0000","last_clean":"2024-09-19T12:00:26.615420+0000","last_became_active":"2024-09-19T11:35:41.689764+0000","last_became_peered":"2024-09-19T11:35:41.689764+0000","last_unstale":"2024-09-19T12:00:26.615420+0000","last_undegraded":"2024-09-19T12:00:26.615420+0000","last_fullsized":"2024-09-19T12:00:26.615420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:54.147943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":78,"num_write":61,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'13","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621213+0000","last_change":"2024-09-19T11:35:41.691619+0000","last_active":"2024-09-19T12:00:41.621213+0000","last_peered":"2024-09-19T12:00:41.621213+0000","last_clean":"2024-09-19T12:00:41.621213+0000","last_became_active":"2024-09-19T11:35:41.691032+0000","last_became_peered":"2024-09-19T11:35:41.691032+0000","last_unstale":"2024-09-19T12:00:41.621213+0000","last_undegraded":"2024-09-19T12:00:41.621213+0000","last_fullsized":"2024-09-19T12:00:41.621213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:56.262332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":124,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'71","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.049397+0000","last_change":"2024-09-19T11:35:33.630221+0000","last_active":"2024-09-19T11:59:28.049397+0000","last_peered":"2024-09-19T11:59:28.049397+0000","last_clean":"2024-09-19T11:59:28.049397+0000","last_became_active":"2024-09-19T11:35:33.629606+0000","last_became_peered":"2024-09-19T11:35:33.629606+0000","last_unstale":"2024-09-19T11:59:28.049397+0000","last_undegraded":"2024-09-19T11:59:28.049397+0000","last_fullsized":"2024-09-19T11:59:28.049397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:26.189736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":210,"num_write":129,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'30","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:08.146210+0000","last_change":"2024-09-19T11:35:31.592429+0000","last_active":"2024-09-19T12:00:08.146210+0000","last_peered":"2024-09-19T12:00:08.146210+0000","last_clean":"2024-09-19T12:00:08.146210+0000","last_became_active":"2024-09-19T11:35:31.591519+0000","last_became_peered":"2024-09-19T11:35:31.591519+0000","last_unstale":"2024-09-19T12:00:08.146210+0000","last_undegraded":"2024-09-19T12:00:08.146210+0000","last_fullsized":"2024-09-19T12:00:08.146210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:03.358145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":47,"num_read_kb":3273,"num_write":128,"num_write_kb":3245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.583004+0000","last_change":"2024-09-19T11:35:35.613146+0000","last_active":"2024-09-19T11:58:56.583004+0000","last_peered":"2024-09-19T11:58:56.583004+0000","last_clean":"2024-09-19T11:58:56.583004+0000","last_became_active":"2024-09-19T11:35:35.612405+0000","last_became_peered":"2024-09-19T11:35:35.612405+0000","last_unstale":"2024-09-19T11:58:56.583004+0000","last_undegraded":"2024-09-19T11:58:56.583004+0000","last_fullsized":"2024-09-19T11:58:56.583004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:30:32.069279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'80","reported_seq":582,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.311958+0000","last_change":"2024-09-19T11:35:37.633337+0000","last_active":"2024-09-19T12:00:06.311958+0000","last_peered":"2024-09-19T12:00:06.311958+0000","last_clean":"2024-09-19T12:00:06.311958+0000","last_became_active":"2024-09-19T11:35:37.632543+0000","last_became_peered":"2024-09-19T11:35:37.632543+0000","last_unstale":"2024-09-19T12:00:06.311958+0000","last_undegraded":"2024-09-19T12:00:06.311958+0000","last_fullsized":"2024-09-19T12:00:06.311958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:04.865458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10904,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":155,"num_write":84,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.591731+0000","last_change":"2024-09-19T11:35:39.654809+0000","last_active":"2024-09-19T11:59:01.591731+0000","last_peered":"2024-09-19T11:59:01.591731+0000","last_clean":"2024-09-19T11:59:01.591731+0000","last_became_active":"2024-09-19T11:35:39.654012+0000","last_became_peered":"2024-09-19T11:35:39.654012+0000","last_unstale":"2024-09-19T11:59:01.591731+0000","last_undegraded":"2024-09-19T11:59:01.591731+0000","last_fullsized":"2024-09-19T11:59:01.591731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:29.043987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'11","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.602664+0000","last_change":"2024-09-19T11:35:41.676591+0000","last_active":"2024-09-19T11:59:46.602664+0000","last_peered":"2024-09-19T11:59:46.602664+0000","last_clean":"2024-09-19T11:59:46.602664+0000","last_became_active":"2024-09-19T11:35:41.675506+0000","last_became_peered":"2024-09-19T11:35:41.675506+0000","last_unstale":"2024-09-19T11:59:46.602664+0000","last_undegraded":"2024-09-19T11:59:46.602664+0000","last_fullsized":"2024-09-19T11:59:46.602664+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:14.936561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":25,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'13","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.169388+0000","last_change":"2024-09-19T11:35:33.635071+0000","last_active":"2024-09-19T12:02:33.169388+0000","last_peered":"2024-09-19T12:02:33.169388+0000","last_clean":"2024-09-19T12:02:33.169388+0000","last_became_active":"2024-09-19T11:35:33.634606+0000","last_became_peered":"2024-09-19T11:35:33.634606+0000","last_unstale":"2024-09-19T12:02:33.169388+0000","last_undegraded":"2024-09-19T12:02:33.169388+0000","last_fullsized":"2024-09-19T12:02:33.169388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:09.967791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":71,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'40","reported_seq":555,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.609620+0000","last_change":"2024-09-19T11:35:31.603150+0000","last_active":"2024-09-19T11:59:41.609620+0000","last_peered":"2024-09-19T11:59:41.609620+0000","last_clean":"2024-09-19T11:59:41.609620+0000","last_became_active":"2024-09-19T11:35:31.602343+0000","last_became_peered":"2024-09-19T11:35:31.602343+0000","last_unstale":"2024-09-19T11:59:41.609620+0000","last_undegraded":"2024-09-19T11:59:41.609620+0000","last_fullsized":"2024-09-19T11:59:41.609620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:51.716892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243020,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":78,"num_read_kb":10301,"num_write":152,"num_write_kb":15391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.590693+0000","last_change":"2024-09-19T11:35:35.630500+0000","last_active":"2024-09-19T11:58:56.590693+0000","last_peered":"2024-09-19T11:58:56.590693+0000","last_clean":"2024-09-19T11:58:56.590693+0000","last_became_active":"2024-09-19T11:35:35.630183+0000","last_became_peered":"2024-09-19T11:35:35.630183+0000","last_unstale":"2024-09-19T11:58:56.590693+0000","last_undegraded":"2024-09-19T11:58:56.590693+0000","last_fullsized":"2024-09-19T11:58:56.590693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:46.826155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'15","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.597192+0000","last_change":"2024-09-19T11:35:37.642215+0000","last_active":"2024-09-19T11:59:01.597192+0000","last_peered":"2024-09-19T11:59:01.597192+0000","last_clean":"2024-09-19T11:59:01.597192+0000","last_became_active":"2024-09-19T11:35:37.640723+0000","last_became_peered":"2024-09-19T11:35:37.640723+0000","last_unstale":"2024-09-19T11:59:01.597192+0000","last_undegraded":"2024-09-19T11:59:01.597192+0000","last_fullsized":"2024-09-19T11:59:01.597192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:00.528966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.600886+0000","last_change":"2024-09-19T11:35:39.668057+0000","last_active":"2024-09-19T11:59:01.600886+0000","last_peered":"2024-09-19T11:59:01.600886+0000","last_clean":"2024-09-19T11:59:01.600886+0000","last_became_active":"2024-09-19T11:35:39.667286+0000","last_became_peered":"2024-09-19T11:35:39.667286+0000","last_unstale":"2024-09-19T11:59:01.600886+0000","last_undegraded":"2024-09-19T11:59:01.600886+0000","last_fullsized":"2024-09-19T11:59:01.600886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:36.821583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'8","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:18.512713+0000","last_change":"2024-09-19T11:35:41.698132+0000","last_active":"2024-09-19T11:58:18.512713+0000","last_peered":"2024-09-19T11:58:18.512713+0000","last_clean":"2024-09-19T11:58:18.512713+0000","last_became_active":"2024-09-19T11:35:41.696369+0000","last_became_peered":"2024-09-19T11:35:41.696369+0000","last_unstale":"2024-09-19T11:58:18.512713+0000","last_undegraded":"2024-09-19T11:58:18.512713+0000","last_fullsized":"2024-09-19T11:58:18.512713+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:42.394020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'69","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.196713+0000","last_change":"2024-09-19T11:35:33.617102+0000","last_active":"2024-09-19T12:02:33.196713+0000","last_peered":"2024-09-19T12:02:33.196713+0000","last_clean":"2024-09-19T12:02:33.196713+0000","last_became_active":"2024-09-19T11:35:33.614693+0000","last_became_peered":"2024-09-19T11:35:33.614693+0000","last_unstale":"2024-09-19T12:02:33.196713+0000","last_undegraded":"2024-09-19T12:02:33.196713+0000","last_fullsized":"2024-09-19T12:02:33.196713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:04.830617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":230,"num_write":111,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'41","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.783722+0000","last_change":"2024-09-19T11:36:06.678190+0000","last_active":"2024-09-19T12:02:17.783722+0000","last_peered":"2024-09-19T12:02:17.783722+0000","last_clean":"2024-09-19T12:02:17.783722+0000","last_became_active":"2024-09-19T11:36:06.677102+0000","last_became_peered":"2024-09-19T11:36:06.677102+0000","last_unstale":"2024-09-19T12:02:17.783722+0000","last_undegraded":"2024-09-19T12:02:17.783722+0000","last_fullsized":"2024-09-19T12:02:17.783722+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:31.643124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":83,"num_read_kb":1744,"num_write":149,"num_write_kb":1703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599682+0000","last_change":"2024-09-19T11:35:35.618146+0000","last_active":"2024-09-19T11:58:56.599682+0000","last_peered":"2024-09-19T11:58:56.599682+0000","last_clean":"2024-09-19T11:58:56.599682+0000","last_became_active":"2024-09-19T11:35:35.617374+0000","last_became_peered":"2024-09-19T11:35:35.617374+0000","last_unstale":"2024-09-19T11:58:56.599682+0000","last_undegraded":"2024-09-19T11:58:56.599682+0000","last_fullsized":"2024-09-19T11:58:56.599682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:21.640183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'93","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.031384+0000","last_change":"2024-09-19T11:35:37.637365+0000","last_active":"2024-09-19T11:59:28.031384+0000","last_peered":"2024-09-19T11:59:28.031384+0000","last_clean":"2024-09-19T11:59:28.031384+0000","last_became_active":"2024-09-19T11:35:37.636913+0000","last_became_peered":"2024-09-19T11:35:37.636913+0000","last_unstale":"2024-09-19T11:59:28.031384+0000","last_undegraded":"2024-09-19T11:59:28.031384+0000","last_fullsized":"2024-09-19T11:59:28.031384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:19.745629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10680,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":133,"num_read_kb":183,"num_write":96,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":470,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.597548+0000","last_change":"2024-09-19T11:35:39.673878+0000","last_active":"2024-09-19T11:59:01.597548+0000","last_peered":"2024-09-19T11:59:01.597548+0000","last_clean":"2024-09-19T11:59:01.597548+0000","last_became_active":"2024-09-19T11:35:39.673172+0000","last_became_peered":"2024-09-19T11:35:39.673172+0000","last_unstale":"2024-09-19T11:59:01.597548+0000","last_undegraded":"2024-09-19T11:59:01.597548+0000","last_fullsized":"2024-09-19T11:59:01.597548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:06:47.106673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'13","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.043251+0000","last_change":"2024-09-19T11:35:41.678676+0000","last_active":"2024-09-19T11:59:28.043251+0000","last_peered":"2024-09-19T11:59:28.043251+0000","last_clean":"2024-09-19T11:59:28.043251+0000","last_became_active":"2024-09-19T11:35:41.677991+0000","last_became_peered":"2024-09-19T11:35:41.677991+0000","last_unstale":"2024-09-19T11:59:28.043251+0000","last_undegraded":"2024-09-19T11:59:28.043251+0000","last_fullsized":"2024-09-19T11:59:28.043251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:02.104343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":90,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":470,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.590229+0000","last_change":"2024-09-19T11:36:06.675768+0000","last_active":"2024-09-19T11:59:26.590229+0000","last_peered":"2024-09-19T11:59:26.590229+0000","last_clean":"2024-09-19T11:59:26.590229+0000","last_became_active":"2024-09-19T11:36:06.674947+0000","last_became_peered":"2024-09-19T11:36:06.674947+0000","last_unstale":"2024-09-19T11:59:26.590229+0000","last_undegraded":"2024-09-19T11:59:26.590229+0000","last_fullsized":"2024-09-19T11:59:26.590229+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:35.049315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"264'23","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.606726+0000","last_change":"2024-09-19T11:35:31.589696+0000","last_active":"2024-09-19T11:59:41.606726+0000","last_peered":"2024-09-19T11:59:41.606726+0000","last_clean":"2024-09-19T11:59:41.606726+0000","last_became_active":"2024-09-19T11:35:31.589077+0000","last_became_peered":"2024-09-19T11:35:31.589077+0000","last_unstale":"2024-09-19T11:59:41.606726+0000","last_undegraded":"2024-09-19T11:59:41.606726+0000","last_fullsized":"2024-09-19T11:59:41.606726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:24.386252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7371470,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":36,"num_read_kb":7227,"num_write":88,"num_write_kb":7207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.596258+0000","last_change":"2024-09-19T11:35:35.630499+0000","last_active":"2024-09-19T11:58:56.596258+0000","last_peered":"2024-09-19T11:58:56.596258+0000","last_clean":"2024-09-19T11:58:56.596258+0000","last_became_active":"2024-09-19T11:35:35.629798+0000","last_became_peered":"2024-09-19T11:35:35.629798+0000","last_unstale":"2024-09-19T11:58:56.596258+0000","last_undegraded":"2024-09-19T11:58:56.596258+0000","last_fullsized":"2024-09-19T11:58:56.596258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:11.036004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'65","reported_seq":560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:21.631532+0000","last_change":"2024-09-19T11:35:37.640794+0000","last_active":"2024-09-19T12:01:21.631532+0000","last_peered":"2024-09-19T12:01:21.631532+0000","last_clean":"2024-09-19T12:01:21.631532+0000","last_became_active":"2024-09-19T11:35:37.640008+0000","last_became_peered":"2024-09-19T11:35:37.640008+0000","last_unstale":"2024-09-19T12:01:21.631532+0000","last_undegraded":"2024-09-19T12:01:21.631532+0000","last_fullsized":"2024-09-19T12:01:21.631532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:27.014754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11361,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":143,"num_write":70,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.597356+0000","last_change":"2024-09-19T11:35:39.676685+0000","last_active":"2024-09-19T11:59:01.597356+0000","last_peered":"2024-09-19T11:59:01.597356+0000","last_clean":"2024-09-19T11:59:01.597356+0000","last_became_active":"2024-09-19T11:35:39.675913+0000","last_became_peered":"2024-09-19T11:35:39.675913+0000","last_unstale":"2024-09-19T11:59:01.597356+0000","last_undegraded":"2024-09-19T11:59:01.597356+0000","last_fullsized":"2024-09-19T11:59:01.597356+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:50.470241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'72","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618654+0000","last_change":"2024-09-19T11:35:33.625849+0000","last_active":"2024-09-19T12:00:36.618654+0000","last_peered":"2024-09-19T12:00:36.618654+0000","last_clean":"2024-09-19T12:00:36.618654+0000","last_became_active":"2024-09-19T11:35:33.624358+0000","last_became_peered":"2024-09-19T11:35:33.624358+0000","last_unstale":"2024-09-19T12:00:36.618654+0000","last_undegraded":"2024-09-19T12:00:36.618654+0000","last_fullsized":"2024-09-19T12:00:36.618654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:19.837363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":316,"num_read_kb":286,"num_write":104,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'30","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.294007+0000","last_change":"2024-09-19T11:35:31.575536+0000","last_active":"2024-09-19T12:00:06.294007+0000","last_peered":"2024-09-19T12:00:06.294007+0000","last_clean":"2024-09-19T12:00:06.294007+0000","last_became_active":"2024-09-19T11:35:31.574673+0000","last_became_peered":"2024-09-19T11:35:31.574673+0000","last_unstale":"2024-09-19T12:00:06.294007+0000","last_undegraded":"2024-09-19T12:00:06.294007+0000","last_fullsized":"2024-09-19T12:00:06.294007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.781451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5418,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":58,"num_read_kb":49,"num_write":113,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.606673+0000","last_change":"2024-09-19T11:35:35.620065+0000","last_active":"2024-09-19T11:59:41.606673+0000","last_peered":"2024-09-19T11:59:41.606673+0000","last_clean":"2024-09-19T11:59:41.606673+0000","last_became_active":"2024-09-19T11:35:35.617643+0000","last_became_peered":"2024-09-19T11:35:35.617643+0000","last_unstale":"2024-09-19T11:59:41.606673+0000","last_undegraded":"2024-09-19T11:59:41.606673+0000","last_fullsized":"2024-09-19T11:59:41.606673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:41.917586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'95","reported_seq":595,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.323158+0000","last_change":"2024-09-19T11:35:37.640664+0000","last_active":"2024-09-19T12:00:06.323158+0000","last_peered":"2024-09-19T12:00:06.323158+0000","last_clean":"2024-09-19T12:00:06.323158+0000","last_became_active":"2024-09-19T11:35:37.640147+0000","last_became_peered":"2024-09-19T11:35:37.640147+0000","last_unstale":"2024-09-19T12:00:06.323158+0000","last_undegraded":"2024-09-19T12:00:06.323158+0000","last_fullsized":"2024-09-19T12:00:06.323158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:58.172631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20894,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":129,"num_read_kb":228,"num_write":102,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":472,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.585226+0000","last_change":"2024-09-19T11:35:39.652153+0000","last_active":"2024-09-19T11:58:11.585226+0000","last_peered":"2024-09-19T11:58:11.585226+0000","last_clean":"2024-09-19T11:58:11.585226+0000","last_became_active":"2024-09-19T11:35:39.651426+0000","last_became_peered":"2024-09-19T11:35:39.651426+0000","last_unstale":"2024-09-19T11:58:11.585226+0000","last_undegraded":"2024-09-19T11:58:11.585226+0000","last_fullsized":"2024-09-19T11:58:11.585226+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:46.800698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'72","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.052035+0000","last_change":"2024-09-19T11:35:41.676328+0000","last_active":"2024-09-19T11:59:28.052035+0000","last_peered":"2024-09-19T11:59:28.052035+0000","last_clean":"2024-09-19T11:59:28.052035+0000","last_became_active":"2024-09-19T11:35:41.674006+0000","last_became_peered":"2024-09-19T11:35:41.674006+0000","last_unstale":"2024-09-19T11:59:28.052035+0000","last_undegraded":"2024-09-19T11:59:28.052035+0000","last_fullsized":"2024-09-19T11:59:28.052035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:43.399242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'110","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.380540+0000","last_change":"2024-09-19T11:35:33.612189+0000","last_active":"2024-09-19T12:02:19.380540+0000","last_peered":"2024-09-19T12:02:19.380540+0000","last_clean":"2024-09-19T12:02:19.380540+0000","last_became_active":"2024-09-19T11:35:33.611732+0000","last_became_peered":"2024-09-19T11:35:33.611732+0000","last_unstale":"2024-09-19T12:02:19.380540+0000","last_undegraded":"2024-09-19T12:02:19.380540+0000","last_fullsized":"2024-09-19T12:02:19.380540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:18.009652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":312,"num_write":153,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'43","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.594278+0000","last_change":"2024-09-19T11:35:31.585905+0000","last_active":"2024-09-19T11:59:46.594278+0000","last_peered":"2024-09-19T11:59:46.594278+0000","last_clean":"2024-09-19T11:59:46.594278+0000","last_became_active":"2024-09-19T11:35:31.585423+0000","last_became_peered":"2024-09-19T11:35:31.585423+0000","last_unstale":"2024-09-19T11:59:46.594278+0000","last_undegraded":"2024-09-19T11:59:46.594278+0000","last_fullsized":"2024-09-19T11:59:46.594278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:25:09.830393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080025,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":118,"num_read_kb":1132,"num_write":168,"num_write_kb":1063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618616+0000","last_change":"2024-09-19T11:35:35.633072+0000","last_active":"2024-09-19T12:00:36.618616+0000","last_peered":"2024-09-19T12:00:36.618616+0000","last_clean":"2024-09-19T12:00:36.618616+0000","last_became_active":"2024-09-19T11:35:35.632384+0000","last_became_peered":"2024-09-19T11:35:35.632384+0000","last_unstale":"2024-09-19T12:00:36.618616+0000","last_undegraded":"2024-09-19T12:00:36.618616+0000","last_fullsized":"2024-09-19T12:00:36.618616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:13.028878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'72","reported_seq":575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.796977+0000","last_change":"2024-09-19T11:35:37.642378+0000","last_active":"2024-09-19T12:02:17.796977+0000","last_peered":"2024-09-19T12:02:17.796977+0000","last_clean":"2024-09-19T12:02:17.796977+0000","last_became_active":"2024-09-19T11:35:37.641603+0000","last_became_peered":"2024-09-19T11:35:37.641603+0000","last_unstale":"2024-09-19T12:02:17.796977+0000","last_undegraded":"2024-09-19T12:02:17.796977+0000","last_fullsized":"2024-09-19T12:02:17.796977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:06.984305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8122,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":109,"num_read_kb":139,"num_write":96,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.573467+0000","last_change":"2024-09-19T11:35:39.684040+0000","last_active":"2024-09-19T11:58:11.573467+0000","last_peered":"2024-09-19T11:58:11.573467+0000","last_clean":"2024-09-19T11:58:11.573467+0000","last_became_active":"2024-09-19T11:35:39.683564+0000","last_became_peered":"2024-09-19T11:35:39.683564+0000","last_unstale":"2024-09-19T11:58:11.573467+0000","last_undegraded":"2024-09-19T11:58:11.573467+0000","last_fullsized":"2024-09-19T11:58:11.573467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:14.462022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'25","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.989255+0000","last_change":"2024-09-19T11:35:41.665955+0000","last_active":"2024-09-19T12:02:32.989255+0000","last_peered":"2024-09-19T12:02:32.989255+0000","last_clean":"2024-09-19T12:02:32.989255+0000","last_became_active":"2024-09-19T11:35:41.665262+0000","last_became_peered":"2024-09-19T11:35:41.665262+0000","last_unstale":"2024-09-19T12:02:32.989255+0000","last_undegraded":"2024-09-19T12:02:32.989255+0000","last_fullsized":"2024-09-19T12:02:32.989255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:27.405987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":132,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'2","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.166673+0000","last_change":"2024-09-19T11:35:33.614188+0000","last_active":"2024-09-19T12:02:33.166673+0000","last_peered":"2024-09-19T12:02:33.166673+0000","last_clean":"2024-09-19T12:02:33.166673+0000","last_became_active":"2024-09-19T11:35:33.613712+0000","last_became_peered":"2024-09-19T11:35:33.613712+0000","last_unstale":"2024-09-19T12:02:33.166673+0000","last_undegraded":"2024-09-19T12:02:33.166673+0000","last_fullsized":"2024-09-19T12:02:33.166673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:35.628949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'41","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.809581+0000","last_change":"2024-09-19T11:35:31.580900+0000","last_active":"2024-09-19T12:00:31.809581+0000","last_peered":"2024-09-19T12:00:31.809581+0000","last_clean":"2024-09-19T12:00:31.809581+0000","last_became_active":"2024-09-19T11:35:31.579680+0000","last_became_peered":"2024-09-19T11:35:31.579680+0000","last_unstale":"2024-09-19T12:00:31.809581+0000","last_undegraded":"2024-09-19T12:00:31.809581+0000","last_fullsized":"2024-09-19T12:00:31.809581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:17.218721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":100,"num_read_kb":1771,"num_write":183,"num_write_kb":1706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.777279+0000","last_change":"2024-09-19T11:35:35.628919+0000","last_active":"2024-09-19T11:58:06.777279+0000","last_peered":"2024-09-19T11:58:06.777279+0000","last_clean":"2024-09-19T11:58:06.777279+0000","last_became_active":"2024-09-19T11:35:35.625446+0000","last_became_peered":"2024-09-19T11:35:35.625446+0000","last_unstale":"2024-09-19T11:58:06.777279+0000","last_undegraded":"2024-09-19T11:58:06.777279+0000","last_fullsized":"2024-09-19T11:58:06.777279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:40.113640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'68","reported_seq":572,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615309+0000","last_change":"2024-09-19T11:35:37.617373+0000","last_active":"2024-09-19T12:00:41.615309+0000","last_peered":"2024-09-19T12:00:41.615309+0000","last_clean":"2024-09-19T12:00:41.615309+0000","last_became_active":"2024-09-19T11:35:37.616602+0000","last_became_peered":"2024-09-19T11:35:37.616602+0000","last_unstale":"2024-09-19T12:00:41.615309+0000","last_undegraded":"2024-09-19T12:00:41.615309+0000","last_fullsized":"2024-09-19T12:00:41.615309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:47.275427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10384,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":140,"num_write":70,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.594472+0000","last_change":"2024-09-19T11:35:39.686747+0000","last_active":"2024-09-19T11:59:46.594472+0000","last_peered":"2024-09-19T11:59:46.594472+0000","last_clean":"2024-09-19T11:59:46.594472+0000","last_became_active":"2024-09-19T11:35:39.686225+0000","last_became_peered":"2024-09-19T11:35:39.686225+0000","last_unstale":"2024-09-19T11:59:46.594472+0000","last_undegraded":"2024-09-19T11:59:46.594472+0000","last_fullsized":"2024-09-19T11:59:46.594472+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:38.757638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"256'2","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.596457+0000","last_change":"2024-09-19T11:35:41.683491+0000","last_active":"2024-09-19T11:59:01.596457+0000","last_peered":"2024-09-19T11:59:01.596457+0000","last_clean":"2024-09-19T11:59:01.596457+0000","last_became_active":"2024-09-19T11:35:41.682440+0000","last_became_peered":"2024-09-19T11:35:41.682440+0000","last_unstale":"2024-09-19T11:59:01.596457+0000","last_undegraded":"2024-09-19T11:59:01.596457+0000","last_fullsized":"2024-09-19T11:59:01.596457+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:15.584265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'93","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:43.947971+0000","last_change":"2024-09-19T11:35:33.605732+0000","last_active":"2024-09-19T12:01:43.947971+0000","last_peered":"2024-09-19T12:01:43.947971+0000","last_clean":"2024-09-19T12:01:43.947971+0000","last_became_active":"2024-09-19T11:35:33.605161+0000","last_became_peered":"2024-09-19T11:35:33.605161+0000","last_unstale":"2024-09-19T12:01:43.947971+0000","last_undegraded":"2024-09-19T12:01:43.947971+0000","last_fullsized":"2024-09-19T12:01:43.947971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:47.784644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":359,"num_read_kb":288,"num_write":158,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'26","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.618577+0000","last_change":"2024-09-19T11:35:31.602820+0000","last_active":"2024-09-19T12:00:31.618577+0000","last_peered":"2024-09-19T12:00:31.618577+0000","last_clean":"2024-09-19T12:00:31.618577+0000","last_became_active":"2024-09-19T11:35:31.602466+0000","last_became_peered":"2024-09-19T11:35:31.602466+0000","last_unstale":"2024-09-19T12:00:31.618577+0000","last_undegraded":"2024-09-19T12:00:31.618577+0000","last_fullsized":"2024-09-19T12:00:31.618577+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:21.152956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":45,"num_write":118,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.572238+0000","last_change":"2024-09-19T11:35:35.632089+0000","last_active":"2024-09-19T11:58:06.572238+0000","last_peered":"2024-09-19T11:58:06.572238+0000","last_clean":"2024-09-19T11:58:06.572238+0000","last_became_active":"2024-09-19T11:35:35.631573+0000","last_became_peered":"2024-09-19T11:35:35.631573+0000","last_unstale":"2024-09-19T11:58:06.572238+0000","last_undegraded":"2024-09-19T11:58:06.572238+0000","last_fullsized":"2024-09-19T11:58:06.572238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:57.000282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'40","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.798513+0000","last_change":"2024-09-19T11:35:37.633680+0000","last_active":"2024-09-19T11:59:41.798513+0000","last_peered":"2024-09-19T11:59:41.798513+0000","last_clean":"2024-09-19T11:59:41.798513+0000","last_became_active":"2024-09-19T11:35:37.632562+0000","last_became_peered":"2024-09-19T11:35:37.632562+0000","last_unstale":"2024-09-19T11:59:41.798513+0000","last_undegraded":"2024-09-19T11:59:41.798513+0000","last_fullsized":"2024-09-19T11:59:41.798513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:18.066710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":55,"num_read_kb":48,"num_write":46,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'614","reported_seq":1537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.458282+0000","last_change":"2024-09-19T11:35:39.660361+0000","last_active":"2024-09-19T12:02:34.458282+0000","last_peered":"2024-09-19T12:02:34.458282+0000","last_clean":"2024-09-19T12:02:34.458282+0000","last_became_active":"2024-09-19T11:35:39.659602+0000","last_became_peered":"2024-09-19T11:35:39.659602+0000","last_unstale":"2024-09-19T12:02:34.458282+0000","last_undegraded":"2024-09-19T12:02:34.458282+0000","last_fullsized":"2024-09-19T12:02:34.458282+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:19.524182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'7","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.600833+0000","last_change":"2024-09-19T11:35:41.682361+0000","last_active":"2024-09-19T11:59:01.600833+0000","last_peered":"2024-09-19T11:59:01.600833+0000","last_clean":"2024-09-19T11:59:01.600833+0000","last_became_active":"2024-09-19T11:35:41.681567+0000","last_became_peered":"2024-09-19T11:35:41.681567+0000","last_unstale":"2024-09-19T11:59:01.600833+0000","last_undegraded":"2024-09-19T11:59:01.600833+0000","last_fullsized":"2024-09-19T11:59:01.600833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:05.849048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'69","reported_seq":567,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:05.818754+0000","last_change":"2024-09-19T11:35:33.618140+0000","last_active":"2024-09-19T12:00:05.818754+0000","last_peered":"2024-09-19T12:00:05.818754+0000","last_clean":"2024-09-19T12:00:05.818754+0000","last_became_active":"2024-09-19T11:35:33.617414+0000","last_became_peered":"2024-09-19T11:35:33.617414+0000","last_unstale":"2024-09-19T12:00:05.818754+0000","last_undegraded":"2024-09-19T12:00:05.818754+0000","last_fullsized":"2024-09-19T12:00:05.818754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:12.877192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":201,"num_write":115,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'23","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.616654+0000","last_change":"2024-09-19T11:35:31.620319+0000","last_active":"2024-09-19T12:00:31.616654+0000","last_peered":"2024-09-19T12:00:31.616654+0000","last_clean":"2024-09-19T12:00:31.616654+0000","last_became_active":"2024-09-19T11:35:31.613260+0000","last_became_peered":"2024-09-19T11:35:31.613260+0000","last_unstale":"2024-09-19T12:00:31.616654+0000","last_undegraded":"2024-09-19T12:00:31.616654+0000","last_fullsized":"2024-09-19T12:00:31.616654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:43.808702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1104621,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":31,"num_read_kb":9290,"num_write":71,"num_write_kb":7234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.587216+0000","last_change":"2024-09-19T11:35:35.618214+0000","last_active":"2024-09-19T11:58:06.587216+0000","last_peered":"2024-09-19T11:58:06.587216+0000","last_clean":"2024-09-19T11:58:06.587216+0000","last_became_active":"2024-09-19T11:35:35.617489+0000","last_became_peered":"2024-09-19T11:35:35.617489+0000","last_unstale":"2024-09-19T11:58:06.587216+0000","last_undegraded":"2024-09-19T11:58:06.587216+0000","last_fullsized":"2024-09-19T11:58:06.587216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:05.845518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'87","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.792479+0000","last_change":"2024-09-19T11:35:37.625579+0000","last_active":"2024-09-19T12:02:17.792479+0000","last_peered":"2024-09-19T12:02:17.792479+0000","last_clean":"2024-09-19T12:02:17.792479+0000","last_became_active":"2024-09-19T11:35:37.624101+0000","last_became_peered":"2024-09-19T11:35:37.624101+0000","last_unstale":"2024-09-19T12:02:17.792479+0000","last_undegraded":"2024-09-19T12:02:17.792479+0000","last_fullsized":"2024-09-19T12:02:17.792479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:13:17.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10373,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":114,"num_read_kb":163,"num_write":88,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.608983+0000","last_change":"2024-09-19T11:35:39.674060+0000","last_active":"2024-09-19T11:59:51.608983+0000","last_peered":"2024-09-19T11:59:51.608983+0000","last_clean":"2024-09-19T11:59:51.608983+0000","last_became_active":"2024-09-19T11:35:39.671474+0000","last_became_peered":"2024-09-19T11:35:39.671474+0000","last_unstale":"2024-09-19T11:59:51.608983+0000","last_undegraded":"2024-09-19T11:59:51.608983+0000","last_fullsized":"2024-09-19T11:59:51.608983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:49.787232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'16","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611804+0000","last_change":"2024-09-19T11:35:41.694646+0000","last_active":"2024-09-19T11:59:51.611804+0000","last_peered":"2024-09-19T11:59:51.611804+0000","last_clean":"2024-09-19T11:59:51.611804+0000","last_became_active":"2024-09-19T11:35:41.693900+0000","last_became_peered":"2024-09-19T11:35:41.693900+0000","last_unstale":"2024-09-19T11:59:51.611804+0000","last_undegraded":"2024-09-19T11:59:51.611804+0000","last_fullsized":"2024-09-19T11:59:51.611804+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:06.653849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'84","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.164927+0000","last_change":"2024-09-19T11:35:33.605993+0000","last_active":"2024-09-19T12:02:33.164927+0000","last_peered":"2024-09-19T12:02:33.164927+0000","last_clean":"2024-09-19T12:02:33.164927+0000","last_became_active":"2024-09-19T11:35:33.605259+0000","last_became_peered":"2024-09-19T11:35:33.605259+0000","last_unstale":"2024-09-19T12:02:33.164927+0000","last_undegraded":"2024-09-19T12:02:33.164927+0000","last_fullsized":"2024-09-19T12:02:33.164927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:43.033562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":291,"num_write":128,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'42","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.778703+0000","last_change":"2024-09-19T11:35:31.623300+0000","last_active":"2024-09-19T12:02:17.778703+0000","last_peered":"2024-09-19T12:02:17.778703+0000","last_clean":"2024-09-19T12:02:17.778703+0000","last_became_active":"2024-09-19T11:35:31.622688+0000","last_became_peered":"2024-09-19T11:35:31.622688+0000","last_unstale":"2024-09-19T12:02:17.778703+0000","last_undegraded":"2024-09-19T12:02:17.778703+0000","last_fullsized":"2024-09-19T12:02:17.778703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:48.009120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079943,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":109,"num_read_kb":10950,"num_write":213,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.584085+0000","last_change":"2024-09-19T11:35:35.622260+0000","last_active":"2024-09-19T11:58:06.584085+0000","last_peered":"2024-09-19T11:58:06.584085+0000","last_clean":"2024-09-19T11:58:06.584085+0000","last_became_active":"2024-09-19T11:35:35.621518+0000","last_became_peered":"2024-09-19T11:35:35.621518+0000","last_unstale":"2024-09-19T11:58:06.584085+0000","last_undegraded":"2024-09-19T11:58:06.584085+0000","last_fullsized":"2024-09-19T11:58:06.584085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:30.262378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'88","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.358024+0000","last_change":"2024-09-19T11:35:37.641470+0000","last_active":"2024-09-19T12:02:19.358024+0000","last_peered":"2024-09-19T12:02:19.358024+0000","last_clean":"2024-09-19T12:02:19.358024+0000","last_became_active":"2024-09-19T11:35:37.639833+0000","last_became_peered":"2024-09-19T11:35:37.639833+0000","last_unstale":"2024-09-19T12:02:19.358024+0000","last_undegraded":"2024-09-19T12:02:19.358024+0000","last_fullsized":"2024-09-19T12:02:19.358024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:25.377817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10914,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":139,"num_write":82,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":470,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.609264+0000","last_change":"2024-09-19T11:35:39.659799+0000","last_active":"2024-09-19T11:59:56.609264+0000","last_peered":"2024-09-19T11:59:56.609264+0000","last_clean":"2024-09-19T11:59:56.609264+0000","last_became_active":"2024-09-19T11:35:39.659011+0000","last_became_peered":"2024-09-19T11:35:39.659011+0000","last_unstale":"2024-09-19T11:59:56.609264+0000","last_undegraded":"2024-09-19T11:59:56.609264+0000","last_fullsized":"2024-09-19T11:59:56.609264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:33.261718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'15","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.603923+0000","last_change":"2024-09-19T11:35:41.675429+0000","last_active":"2024-09-19T11:59:51.603923+0000","last_peered":"2024-09-19T11:59:51.603923+0000","last_clean":"2024-09-19T11:59:51.603923+0000","last_became_active":"2024-09-19T11:35:41.674818+0000","last_became_peered":"2024-09-19T11:35:41.674818+0000","last_unstale":"2024-09-19T11:59:51.603923+0000","last_undegraded":"2024-09-19T11:59:51.603923+0000","last_fullsized":"2024-09-19T11:59:51.603923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:12.876595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":90,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'44","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.603738+0000","last_change":"2024-09-19T11:35:33.603965+0000","last_active":"2024-09-19T11:59:51.603738+0000","last_peered":"2024-09-19T11:59:51.603738+0000","last_clean":"2024-09-19T11:59:51.603738+0000","last_became_active":"2024-09-19T11:35:33.603610+0000","last_became_peered":"2024-09-19T11:35:33.603610+0000","last_unstale":"2024-09-19T11:59:51.603738+0000","last_undegraded":"2024-09-19T11:59:51.603738+0000","last_fullsized":"2024-09-19T11:59:51.603738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:56.366121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":138,"num_write":82,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'39","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.782966+0000","last_change":"2024-09-19T11:35:31.621194+0000","last_active":"2024-09-19T12:02:17.782966+0000","last_peered":"2024-09-19T12:02:17.782966+0000","last_clean":"2024-09-19T12:02:17.782966+0000","last_became_active":"2024-09-19T11:35:31.620504+0000","last_became_peered":"2024-09-19T11:35:31.620504+0000","last_unstale":"2024-09-19T12:02:17.782966+0000","last_undegraded":"2024-09-19T12:02:17.782966+0000","last_fullsized":"2024-09-19T12:02:17.782966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:59.865113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5555,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":1683,"num_write":166,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.799503+0000","last_change":"2024-09-19T11:35:35.624137+0000","last_active":"2024-09-19T11:59:46.799503+0000","last_peered":"2024-09-19T11:59:46.799503+0000","last_clean":"2024-09-19T11:59:46.799503+0000","last_became_active":"2024-09-19T11:35:35.623348+0000","last_became_peered":"2024-09-19T11:35:35.623348+0000","last_unstale":"2024-09-19T11:59:46.799503+0000","last_undegraded":"2024-09-19T11:59:46.799503+0000","last_fullsized":"2024-09-19T11:59:46.799503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:43.589134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'39","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615151+0000","last_change":"2024-09-19T11:35:37.643750+0000","last_active":"2024-09-19T12:00:41.615151+0000","last_peered":"2024-09-19T12:00:41.615151+0000","last_clean":"2024-09-19T12:00:41.615151+0000","last_became_active":"2024-09-19T11:35:37.643249+0000","last_became_peered":"2024-09-19T11:35:37.643249+0000","last_unstale":"2024-09-19T12:00:41.615151+0000","last_undegraded":"2024-09-19T12:00:41.615151+0000","last_fullsized":"2024-09-19T12:00:41.615151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:36.730823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":81,"num_write":38,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.778397+0000","last_change":"2024-09-19T11:35:39.675950+0000","last_active":"2024-09-19T11:58:11.778397+0000","last_peered":"2024-09-19T11:58:11.778397+0000","last_clean":"2024-09-19T11:58:11.778397+0000","last_became_active":"2024-09-19T11:35:39.675285+0000","last_became_peered":"2024-09-19T11:35:39.675285+0000","last_unstale":"2024-09-19T11:58:11.778397+0000","last_undegraded":"2024-09-19T11:58:11.778397+0000","last_fullsized":"2024-09-19T11:58:11.778397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:52.963177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'22","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.336022+0000","last_change":"2024-09-19T11:35:41.695355+0000","last_active":"2024-09-19T12:00:06.336022+0000","last_peered":"2024-09-19T12:00:06.336022+0000","last_clean":"2024-09-19T12:00:06.336022+0000","last_became_active":"2024-09-19T11:35:41.694201+0000","last_became_peered":"2024-09-19T11:35:41.694201+0000","last_unstale":"2024-09-19T12:00:06.336022+0000","last_undegraded":"2024-09-19T12:00:06.336022+0000","last_fullsized":"2024-09-19T12:00:06.336022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:09.844137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":56,"num_write":68,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'84","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.162209+0000","last_change":"2024-09-19T11:35:33.629309+0000","last_active":"2024-09-19T12:02:33.162209+0000","last_peered":"2024-09-19T12:02:33.162209+0000","last_clean":"2024-09-19T12:02:33.162209+0000","last_became_active":"2024-09-19T11:35:33.628283+0000","last_became_peered":"2024-09-19T11:35:33.628283+0000","last_unstale":"2024-09-19T12:02:33.162209+0000","last_undegraded":"2024-09-19T12:02:33.162209+0000","last_fullsized":"2024-09-19T12:02:33.162209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:35.386501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":329,"num_read_kb":270,"num_write":117,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'28","reported_seq":540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.781745+0000","last_change":"2024-09-19T11:36:06.650917+0000","last_active":"2024-09-19T12:02:17.781745+0000","last_peered":"2024-09-19T12:02:17.781745+0000","last_clean":"2024-09-19T12:02:17.781745+0000","last_became_active":"2024-09-19T11:36:06.649652+0000","last_became_peered":"2024-09-19T11:36:06.649652+0000","last_unstale":"2024-09-19T12:02:17.781745+0000","last_undegraded":"2024-09-19T12:02:17.781745+0000","last_fullsized":"2024-09-19T12:02:17.781745+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:48.816823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080003,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":40,"num_read_kb":1095,"num_write":135,"num_write_kb":1067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,7],"acting":[0,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.595482+0000","last_change":"2024-09-19T11:35:35.612806+0000","last_active":"2024-09-19T11:59:51.595482+0000","last_peered":"2024-09-19T11:59:51.595482+0000","last_clean":"2024-09-19T11:59:51.595482+0000","last_became_active":"2024-09-19T11:35:35.612450+0000","last_became_peered":"2024-09-19T11:35:35.612450+0000","last_unstale":"2024-09-19T11:59:51.595482+0000","last_undegraded":"2024-09-19T11:59:51.595482+0000","last_fullsized":"2024-09-19T11:59:51.595482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:02.776959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'86","reported_seq":599,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812229+0000","last_change":"2024-09-19T11:35:37.639560+0000","last_active":"2024-09-19T12:00:41.812229+0000","last_peered":"2024-09-19T12:00:41.812229+0000","last_clean":"2024-09-19T12:00:41.812229+0000","last_became_active":"2024-09-19T11:35:37.638771+0000","last_became_peered":"2024-09-19T11:35:37.638771+0000","last_unstale":"2024-09-19T12:00:41.812229+0000","last_undegraded":"2024-09-19T12:00:41.812229+0000","last_fullsized":"2024-09-19T12:00:41.812229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:56.133473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9181,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":162,"num_write":88,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.585939+0000","last_change":"2024-09-19T11:35:39.663318+0000","last_active":"2024-09-19T11:58:11.585939+0000","last_peered":"2024-09-19T11:58:11.585939+0000","last_clean":"2024-09-19T11:58:11.585939+0000","last_became_active":"2024-09-19T11:35:39.662405+0000","last_became_peered":"2024-09-19T11:35:39.662405+0000","last_unstale":"2024-09-19T11:58:11.585939+0000","last_undegraded":"2024-09-19T11:58:11.585939+0000","last_fullsized":"2024-09-19T11:58:11.585939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:58.275311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"253'4","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.789890+0000","last_change":"2024-09-19T11:35:41.688704+0000","last_active":"2024-09-19T11:59:01.789890+0000","last_peered":"2024-09-19T11:59:01.789890+0000","last_clean":"2024-09-19T11:59:01.789890+0000","last_became_active":"2024-09-19T11:35:41.687549+0000","last_became_peered":"2024-09-19T11:35:41.687549+0000","last_unstale":"2024-09-19T11:59:01.789890+0000","last_undegraded":"2024-09-19T11:59:01.789890+0000","last_fullsized":"2024-09-19T11:59:01.789890+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:56.527265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'79","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.346041+0000","last_change":"2024-09-19T11:35:33.629428+0000","last_active":"2024-09-19T12:00:06.346041+0000","last_peered":"2024-09-19T12:00:06.346041+0000","last_clean":"2024-09-19T12:00:06.346041+0000","last_became_active":"2024-09-19T11:35:33.629186+0000","last_became_peered":"2024-09-19T11:35:33.629186+0000","last_unstale":"2024-09-19T12:00:06.346041+0000","last_undegraded":"2024-09-19T12:00:06.346041+0000","last_fullsized":"2024-09-19T12:00:06.346041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:40.061077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":235,"num_write":161,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'58","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:21.408053+0000","last_change":"2024-09-19T11:35:31.613416+0000","last_active":"2024-09-19T12:02:21.408053+0000","last_peered":"2024-09-19T12:02:21.408053+0000","last_clean":"2024-09-19T12:02:21.408053+0000","last_became_active":"2024-09-19T11:35:31.611719+0000","last_became_peered":"2024-09-19T11:35:31.611719+0000","last_unstale":"2024-09-19T12:02:21.408053+0000","last_undegraded":"2024-09-19T12:02:21.408053+0000","last_fullsized":"2024-09-19T12:02:21.408053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:31.214410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2100468,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":108,"num_read_kb":5194,"num_write":181,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"253'355","reported_seq":1052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.589820+0000","last_change":"2024-09-19T11:35:33.606387+0000","last_active":"2024-09-19T11:59:26.589820+0000","last_peered":"2024-09-19T11:59:26.589820+0000","last_clean":"2024-09-19T11:59:26.589820+0000","last_became_active":"2024-09-19T11:35:33.603938+0000","last_became_peered":"2024-09-19T11:35:33.603938+0000","last_unstale":"2024-09-19T11:59:26.589820+0000","last_undegraded":"2024-09-19T11:59:26.589820+0000","last_fullsized":"2024-09-19T11:59:26.589820+0000","mapping_epoch":28,"log_start":"253'300","ondisk_log_start":"253'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:36.334582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1936,"num_read_kb":1745,"num_write":575,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'31","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.626924+0000","last_change":"2024-09-19T11:35:31.602514+0000","last_active":"2024-09-19T12:02:32.626924+0000","last_peered":"2024-09-19T12:02:32.626924+0000","last_clean":"2024-09-19T12:02:32.626924+0000","last_became_active":"2024-09-19T11:35:31.602046+0000","last_became_peered":"2024-09-19T11:35:31.602046+0000","last_unstale":"2024-09-19T12:02:32.626924+0000","last_undegraded":"2024-09-19T12:02:32.626924+0000","last_fullsized":"2024-09-19T12:02:32.626924+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:30.711983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":68,"num_read_kb":1671,"num_write":108,"num_write_kb":1627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'4","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.168487+0000","last_change":"2024-09-19T11:35:33.617890+0000","last_active":"2024-09-19T12:02:33.168487+0000","last_peered":"2024-09-19T12:02:33.168487+0000","last_clean":"2024-09-19T12:02:33.168487+0000","last_became_active":"2024-09-19T11:35:33.616104+0000","last_became_peered":"2024-09-19T11:35:33.616104+0000","last_unstale":"2024-09-19T12:02:33.168487+0000","last_undegraded":"2024-09-19T12:02:33.168487+0000","last_fullsized":"2024-09-19T12:02:33.168487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:20.380664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'30","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:26.511044+0000","last_change":"2024-09-19T11:35:31.620857+0000","last_active":"2024-09-19T12:02:26.511044+0000","last_peered":"2024-09-19T12:02:26.511044+0000","last_clean":"2024-09-19T12:02:26.511044+0000","last_became_active":"2024-09-19T11:35:31.613195+0000","last_became_peered":"2024-09-19T11:35:31.613195+0000","last_unstale":"2024-09-19T12:02:26.511044+0000","last_undegraded":"2024-09-19T12:02:26.511044+0000","last_fullsized":"2024-09-19T12:02:26.511044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:06.230787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":129,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'20","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:36.618841+0000","last_change":"2024-09-19T11:35:33.619576+0000","last_active":"2024-09-19T12:01:36.618841+0000","last_peered":"2024-09-19T12:01:36.618841+0000","last_clean":"2024-09-19T12:01:36.618841+0000","last_became_active":"2024-09-19T11:35:33.619302+0000","last_became_peered":"2024-09-19T11:35:33.619302+0000","last_unstale":"2024-09-19T12:01:36.618841+0000","last_undegraded":"2024-09-19T12:01:36.618841+0000","last_fullsized":"2024-09-19T12:01:36.618841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:20.380664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'60","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.619732+0000","last_change":"2024-09-19T11:35:31.591076+0000","last_active":"2024-09-19T12:00:36.619732+0000","last_peered":"2024-09-19T12:00:36.619732+0000","last_clean":"2024-09-19T12:00:36.619732+0000","last_became_active":"2024-09-19T11:35:31.590651+0000","last_became_peered":"2024-09-19T11:35:31.590651+0000","last_unstale":"2024-09-19T12:00:36.619732+0000","last_undegraded":"2024-09-19T12:00:36.619732+0000","last_fullsized":"2024-09-19T12:00:36.619732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:43.726265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254104,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":157,"num_read_kb":1977,"num_write":237,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615123+0000","last_change":"2024-09-19T11:35:33.619828+0000","last_active":"2024-09-19T12:00:41.615123+0000","last_peered":"2024-09-19T12:00:41.615123+0000","last_clean":"2024-09-19T12:00:41.615123+0000","last_became_active":"2024-09-19T11:35:33.619372+0000","last_became_peered":"2024-09-19T11:35:33.619372+0000","last_unstale":"2024-09-19T12:00:41.615123+0000","last_undegraded":"2024-09-19T12:00:41.615123+0000","last_fullsized":"2024-09-19T12:00:41.615123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:25.554628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'13","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.307097+0000","last_change":"2024-09-19T11:35:31.584872+0000","last_active":"2024-09-19T12:00:06.307097+0000","last_peered":"2024-09-19T12:00:06.307097+0000","last_clean":"2024-09-19T12:00:06.307097+0000","last_became_active":"2024-09-19T11:35:31.584316+0000","last_became_peered":"2024-09-19T11:35:31.584316+0000","last_unstale":"2024-09-19T12:00:06.307097+0000","last_undegraded":"2024-09-19T12:00:06.307097+0000","last_fullsized":"2024-09-19T12:00:06.307097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:53.681623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079969,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":11,"num_read_kb":1065,"num_write":62,"num_write_kb":1060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810904+0000","last_change":"2024-09-19T11:35:33.627636+0000","last_active":"2024-09-19T12:00:36.810904+0000","last_peered":"2024-09-19T12:00:36.810904+0000","last_clean":"2024-09-19T12:00:36.810904+0000","last_became_active":"2024-09-19T11:35:33.626872+0000","last_became_peered":"2024-09-19T11:35:33.626872+0000","last_unstale":"2024-09-19T12:00:36.810904+0000","last_undegraded":"2024-09-19T12:00:36.810904+0000","last_fullsized":"2024-09-19T12:00:36.810904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:36.325211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'27","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.714132+0000","last_change":"2024-09-19T11:35:31.592141+0000","last_active":"2024-09-19T12:02:17.714132+0000","last_peered":"2024-09-19T12:02:17.714132+0000","last_clean":"2024-09-19T12:02:17.714132+0000","last_became_active":"2024-09-19T11:35:31.591724+0000","last_became_peered":"2024-09-19T11:35:31.591724+0000","last_unstale":"2024-09-19T12:02:17.714132+0000","last_undegraded":"2024-09-19T12:02:17.714132+0000","last_fullsized":"2024-09-19T12:02:17.714132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:35.585870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1129208,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":58,"num_read_kb":1149,"num_write":136,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'52","reported_seq":560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.197816+0000","last_change":"2024-09-19T11:35:33.614983+0000","last_active":"2024-09-19T12:02:33.197816+0000","last_peered":"2024-09-19T12:02:33.197816+0000","last_clean":"2024-09-19T12:02:33.197816+0000","last_became_active":"2024-09-19T11:35:33.614316+0000","last_became_peered":"2024-09-19T11:35:33.614316+0000","last_unstale":"2024-09-19T12:02:33.197816+0000","last_undegraded":"2024-09-19T12:02:33.197816+0000","last_fullsized":"2024-09-19T12:02:33.197816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:38.763908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":175,"num_write":74,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'40","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.516411+0000","last_change":"2024-09-19T11:35:31.613679+0000","last_active":"2024-09-19T12:02:32.516411+0000","last_peered":"2024-09-19T12:02:32.516411+0000","last_clean":"2024-09-19T12:02:32.516411+0000","last_became_active":"2024-09-19T11:35:31.612367+0000","last_became_peered":"2024-09-19T11:35:31.612367+0000","last_unstale":"2024-09-19T12:02:32.516411+0000","last_undegraded":"2024-09-19T12:02:32.516411+0000","last_fullsized":"2024-09-19T12:02:32.516411+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:21.506300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246359,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":87,"num_read_kb":319,"num_write":180,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'50","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618415+0000","last_change":"2024-09-19T11:35:33.625962+0000","last_active":"2024-09-19T12:00:36.618415+0000","last_peered":"2024-09-19T12:00:36.618415+0000","last_clean":"2024-09-19T12:00:36.618415+0000","last_became_active":"2024-09-19T11:35:33.625249+0000","last_became_peered":"2024-09-19T11:35:33.625249+0000","last_unstale":"2024-09-19T12:00:36.618415+0000","last_undegraded":"2024-09-19T12:00:36.618415+0000","last_fullsized":"2024-09-19T12:00:36.618415+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:54.254614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":159,"num_write":74,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'43","reported_seq":559,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.715507+0000","last_change":"2024-09-19T11:35:31.589092+0000","last_active":"2024-09-19T12:02:17.715507+0000","last_peered":"2024-09-19T12:02:17.715507+0000","last_clean":"2024-09-19T12:02:17.715507+0000","last_became_active":"2024-09-19T11:35:31.588705+0000","last_became_peered":"2024-09-19T11:35:31.588705+0000","last_unstale":"2024-09-19T12:02:17.715507+0000","last_undegraded":"2024-09-19T12:02:17.715507+0000","last_fullsized":"2024-09-19T12:02:17.715507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:23.530669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194452,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":74,"num_read_kb":4157,"num_write":175,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'73","reported_seq":570,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.596172+0000","last_change":"2024-09-19T11:35:33.626308+0000","last_active":"2024-09-19T11:58:56.596172+0000","last_peered":"2024-09-19T11:58:56.596172+0000","last_clean":"2024-09-19T11:58:56.596172+0000","last_became_active":"2024-09-19T11:35:33.625874+0000","last_became_peered":"2024-09-19T11:35:33.625874+0000","last_unstale":"2024-09-19T11:58:56.596172+0000","last_undegraded":"2024-09-19T11:58:56.596172+0000","last_fullsized":"2024-09-19T11:58:56.596172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:34.524797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":214,"num_write":124,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'25","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:32.852109+0000","last_change":"2024-09-19T11:35:31.594437+0000","last_active":"2024-09-19T11:59:32.852109+0000","last_peered":"2024-09-19T11:59:32.852109+0000","last_clean":"2024-09-19T11:59:32.852109+0000","last_became_active":"2024-09-19T11:35:31.593067+0000","last_became_peered":"2024-09-19T11:35:31.593067+0000","last_unstale":"2024-09-19T11:59:32.852109+0000","last_undegraded":"2024-09-19T11:59:32.852109+0000","last_fullsized":"2024-09-19T11:59:32.852109+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:39.500525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080024,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":43,"num_read_kb":1085,"num_write":109,"num_write_kb":1065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.788881+0000","last_change":"2024-09-19T11:35:33.613879+0000","last_active":"2024-09-19T11:58:56.788881+0000","last_peered":"2024-09-19T11:58:56.788881+0000","last_clean":"2024-09-19T11:58:56.788881+0000","last_became_active":"2024-09-19T11:35:33.612924+0000","last_became_peered":"2024-09-19T11:35:33.612924+0000","last_unstale":"2024-09-19T11:58:56.788881+0000","last_undegraded":"2024-09-19T11:58:56.788881+0000","last_fullsized":"2024-09-19T11:58:56.788881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:49.021618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'51","reported_seq":564,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:31.639122+0000","last_change":"2024-09-19T11:35:31.581801+0000","last_active":"2024-09-19T12:02:31.639122+0000","last_peered":"2024-09-19T12:02:31.639122+0000","last_clean":"2024-09-19T12:02:31.639122+0000","last_became_active":"2024-09-19T11:35:31.581058+0000","last_became_peered":"2024-09-19T11:35:31.581058+0000","last_unstale":"2024-09-19T12:02:31.639122+0000","last_undegraded":"2024-09-19T12:02:31.639122+0000","last_fullsized":"2024-09-19T12:02:31.639122+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:01.730787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246431,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":78,"num_read_kb":310,"num_write":188,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'63","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603171+0000","last_change":"2024-09-19T11:35:33.628641+0000","last_active":"2024-09-19T12:00:26.603171+0000","last_peered":"2024-09-19T12:00:26.603171+0000","last_clean":"2024-09-19T12:00:26.603171+0000","last_became_active":"2024-09-19T11:35:33.628335+0000","last_became_peered":"2024-09-19T11:35:33.628335+0000","last_unstale":"2024-09-19T12:00:26.603171+0000","last_undegraded":"2024-09-19T12:00:26.603171+0000","last_fullsized":"2024-09-19T12:00:26.603171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:30.155543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":184,"num_write":116,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'35","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.612851+0000","last_change":"2024-09-19T11:35:31.624411+0000","last_active":"2024-09-19T12:00:16.612851+0000","last_peered":"2024-09-19T12:00:16.612851+0000","last_clean":"2024-09-19T12:00:16.612851+0000","last_became_active":"2024-09-19T11:35:31.623733+0000","last_became_peered":"2024-09-19T11:35:31.623733+0000","last_unstale":"2024-09-19T12:00:16.612851+0000","last_undegraded":"2024-09-19T12:00:16.612851+0000","last_fullsized":"2024-09-19T12:00:16.612851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:54.808464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159980,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":69,"num_read_kb":2163,"num_write":158,"num_write_kb":2120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'85","reported_seq":599,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807456+0000","last_change":"2024-09-19T11:35:33.628930+0000","last_active":"2024-09-19T12:00:21.807456+0000","last_peered":"2024-09-19T12:00:21.807456+0000","last_clean":"2024-09-19T12:00:21.807456+0000","last_became_active":"2024-09-19T11:35:33.628184+0000","last_became_peered":"2024-09-19T11:35:33.628184+0000","last_unstale":"2024-09-19T12:00:21.807456+0000","last_undegraded":"2024-09-19T12:00:21.807456+0000","last_fullsized":"2024-09-19T12:00:21.807456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:43.237383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":344,"num_read_kb":269,"num_write":142,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'49","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.614927+0000","last_change":"2024-09-19T11:35:31.613045+0000","last_active":"2024-09-19T12:00:16.614927+0000","last_peered":"2024-09-19T12:00:16.614927+0000","last_clean":"2024-09-19T12:00:16.614927+0000","last_became_active":"2024-09-19T11:35:31.612601+0000","last_became_peered":"2024-09-19T11:35:31.612601+0000","last_unstale":"2024-09-19T12:00:16.614927+0000","last_undegraded":"2024-09-19T12:00:16.614927+0000","last_fullsized":"2024-09-19T12:00:16.614927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:35.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243045,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":69,"num_read_kb":6286,"num_write":164,"num_write_kb":11381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'7","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:25.789799+0000","last_change":"2024-09-19T11:35:33.624908+0000","last_active":"2024-09-19T12:02:25.789799+0000","last_peered":"2024-09-19T12:02:25.789799+0000","last_clean":"2024-09-19T12:02:25.789799+0000","last_became_active":"2024-09-19T11:35:33.624149+0000","last_became_peered":"2024-09-19T11:35:33.624149+0000","last_unstale":"2024-09-19T12:02:25.789799+0000","last_undegraded":"2024-09-19T12:02:25.789799+0000","last_fullsized":"2024-09-19T12:02:25.789799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:05.347375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'27","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.776403+0000","last_change":"2024-09-19T11:35:31.610796+0000","last_active":"2024-09-19T12:02:17.776403+0000","last_peered":"2024-09-19T12:02:17.776403+0000","last_clean":"2024-09-19T12:02:17.776403+0000","last_became_active":"2024-09-19T11:35:31.609885+0000","last_became_peered":"2024-09-19T11:35:31.609885+0000","last_unstale":"2024-09-19T12:02:17.776403+0000","last_undegraded":"2024-09-19T12:02:17.776403+0000","last_fullsized":"2024-09-19T12:02:17.776403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:34:42.272784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49273,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":83,"num_write":112,"num_write_kb":10337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'127","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.616101+0000","last_change":"2024-09-19T11:35:33.620724+0000","last_active":"2024-09-19T12:00:21.616101+0000","last_peered":"2024-09-19T12:00:21.616101+0000","last_clean":"2024-09-19T12:00:21.616101+0000","last_became_active":"2024-09-19T11:35:33.620326+0000","last_became_peered":"2024-09-19T11:35:33.620326+0000","last_unstale":"2024-09-19T12:00:21.616101+0000","last_undegraded":"2024-09-19T12:00:21.616101+0000","last_fullsized":"2024-09-19T12:00:21.616101+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:14.282141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":393,"num_write":181,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'37","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.608995+0000","last_change":"2024-09-19T11:35:31.625519+0000","last_active":"2024-09-19T12:02:32.608995+0000","last_peered":"2024-09-19T12:02:32.608995+0000","last_clean":"2024-09-19T12:02:32.608995+0000","last_became_active":"2024-09-19T11:35:31.620566+0000","last_became_peered":"2024-09-19T11:35:31.620566+0000","last_unstale":"2024-09-19T12:02:32.608995+0000","last_undegraded":"2024-09-19T12:02:32.608995+0000","last_fullsized":"2024-09-19T12:02:32.608995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:37.899900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":194,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'47","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.610388+0000","last_change":"2024-09-19T11:35:33.618657+0000","last_active":"2024-09-19T12:00:21.610388+0000","last_peered":"2024-09-19T12:00:21.610388+0000","last_clean":"2024-09-19T12:00:21.610388+0000","last_became_active":"2024-09-19T11:35:33.618247+0000","last_became_peered":"2024-09-19T11:35:33.618247+0000","last_unstale":"2024-09-19T12:00:21.610388+0000","last_undegraded":"2024-09-19T12:00:21.610388+0000","last_fullsized":"2024-09-19T12:00:21.610388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:16.980284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":141,"num_write":67,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'16","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:33.206831+0000","last_change":"2024-09-19T11:35:31.602891+0000","last_active":"2024-09-19T11:59:33.206831+0000","last_peered":"2024-09-19T11:59:33.206831+0000","last_clean":"2024-09-19T11:59:33.206831+0000","last_became_active":"2024-09-19T11:35:31.602248+0000","last_became_peered":"2024-09-19T11:35:31.602248+0000","last_unstale":"2024-09-19T11:59:33.206831+0000","last_undegraded":"2024-09-19T11:59:33.206831+0000","last_fullsized":"2024-09-19T11:59:33.206831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:05.964360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242991,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":21,"num_read_kb":5134,"num_write":70,"num_write_kb":5127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'37","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.376218+0000","last_change":"2024-09-19T11:35:33.625242+0000","last_active":"2024-09-19T12:02:19.376218+0000","last_peered":"2024-09-19T12:02:19.376218+0000","last_clean":"2024-09-19T12:02:19.376218+0000","last_became_active":"2024-09-19T11:35:33.624412+0000","last_became_peered":"2024-09-19T11:35:33.624412+0000","last_unstale":"2024-09-19T12:02:19.376218+0000","last_undegraded":"2024-09-19T12:02:19.376218+0000","last_fullsized":"2024-09-19T12:02:19.376218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:08.098513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":98,"num_write":42,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'24","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.474637+0000","last_change":"2024-09-19T11:35:31.609553+0000","last_active":"2024-09-19T12:02:32.474637+0000","last_peered":"2024-09-19T12:02:32.474637+0000","last_clean":"2024-09-19T12:02:32.474637+0000","last_became_active":"2024-09-19T11:35:31.607037+0000","last_became_peered":"2024-09-19T11:35:31.607037+0000","last_unstale":"2024-09-19T12:02:32.474637+0000","last_undegraded":"2024-09-19T12:02:32.474637+0000","last_fullsized":"2024-09-19T12:02:32.474637+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:33.501423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14288,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":45,"num_read_kb":53,"num_write":109,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'34","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.297625+0000","last_change":"2024-09-19T11:35:31.608404+0000","last_active":"2024-09-19T12:00:06.297625+0000","last_peered":"2024-09-19T12:00:06.297625+0000","last_clean":"2024-09-19T12:00:06.297625+0000","last_became_active":"2024-09-19T11:35:31.607805+0000","last_became_peered":"2024-09-19T11:35:31.607805+0000","last_unstale":"2024-09-19T12:00:06.297625+0000","last_undegraded":"2024-09-19T12:00:06.297625+0000","last_fullsized":"2024-09-19T12:00:06.297625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:55.223047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":82,"num_read_kb":66,"num_write":139,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.609215+0000","last_change":"2024-09-19T11:35:33.630383+0000","last_active":"2024-09-19T11:59:51.609215+0000","last_peered":"2024-09-19T11:59:51.609215+0000","last_clean":"2024-09-19T11:59:51.609215+0000","last_became_active":"2024-09-19T11:35:33.630100+0000","last_became_peered":"2024-09-19T11:35:33.630100+0000","last_unstale":"2024-09-19T11:59:51.609215+0000","last_undegraded":"2024-09-19T11:59:51.609215+0000","last_fullsized":"2024-09-19T11:59:51.609215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:23.578224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'23","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:54.759205+0000","last_change":"2024-09-19T11:35:31.588948+0000","last_active":"2024-09-19T11:58:54.759205+0000","last_peered":"2024-09-19T11:58:54.759205+0000","last_clean":"2024-09-19T11:58:54.759205+0000","last_became_active":"2024-09-19T11:35:31.588328+0000","last_became_peered":"2024-09-19T11:35:31.588328+0000","last_unstale":"2024-09-19T11:58:54.759205+0000","last_undegraded":"2024-09-19T11:58:54.759205+0000","last_fullsized":"2024-09-19T11:58:54.759205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:49.468879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":47,"num_read_kb":33,"num_write":105,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'232","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:43.939022+0000","last_change":"2024-09-19T11:35:33.612825+0000","last_active":"2024-09-19T12:01:43.939022+0000","last_peered":"2024-09-19T12:01:43.939022+0000","last_clean":"2024-09-19T12:01:43.939022+0000","last_became_active":"2024-09-19T11:35:33.612152+0000","last_became_peered":"2024-09-19T11:35:33.612152+0000","last_unstale":"2024-09-19T12:01:43.939022+0000","last_undegraded":"2024-09-19T12:01:43.939022+0000","last_fullsized":"2024-09-19T12:01:43.939022+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:31.538563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":962,"num_read_kb":742,"num_write":392,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1228,"num_read_kb":871,"num_write":344,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":8631,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2810,"num_read_kb":2559,"num_write":1797,"num_write_kb":496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":17262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":694,"ondisk_log_size":694,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":326267,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":4380,"num_read_kb":5764,"num_write":2905,"num_write_kb":1322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":349768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1960,"ondisk_log_size":1960,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2072,"num_read_kb":2467,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":14003,"num_read_kb":11442,"num_write":5494,"num_write_kb":2900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2398,"ondisk_log_size":2398,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":124933376,"num_objects":759,"num_object_clones":0,"num_object_copies":3036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":759,"num_whiteouts":0,"num_read":4515,"num_read_kb":236972,"num_write":9401,"num_write_kb":271206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":175980544,"data_stored":175980544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2304,"ondisk_log_size":2304,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":67110910,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":70,"num_read_kb":114690,"num_write":62,"num_write_kb":65538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134225920,"data_stored":134221820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":67110910,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":73,"num_read_kb":120834,"num_write":62,"num_write_kb":65538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134225920,"data_stored":134221820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542482,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243964,"kb_used_data":54508,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":94127876,"statfs":{"total":96636764160,"available":96386945024,"internally_reserved":0,"allocated":55816192,"data_stored":53814603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":193984970},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542481,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256008,"kb_used_data":66552,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":94115832,"statfs":{"total":96636764160,"available":96374611968,"internally_reserved":0,"allocated":68149248,"data_stored":66188937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":193984966},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542482,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81616,"kb_used_data":32384,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94290224,"statfs":{"total":96636764160,"available":96553189376,"internally_reserved":0,"allocated":33161216,"data_stored":31140925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542484,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126296,"kb_used_data":68744,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94245544,"statfs":{"total":96636764160,"available":96507437056,"internally_reserved":0,"allocated":70393856,"data_stored":68485861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542482,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":234436,"kb_used_data":58868,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":94137404,"statfs":{"total":96636764160,"available":96396701696,"internally_reserved":0,"allocated":60280832,"data_stored":58295358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179763655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542482,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87992,"kb_used_data":38760,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94283848,"statfs":{"total":96636764160,"available":96546660352,"internally_reserved":0,"allocated":39690240,"data_stored":37772067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542481,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152040,"kb_used_data":58456,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94219800,"statfs":{"total":96636764160,"available":96481075200,"internally_reserved":0,"allocated":59858944,"data_stored":57891099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542483,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":90216,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":92381184,"data_stored":90413428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212400581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24608768,"data_stored":24608768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23085056,"data_stored":23085056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17670144,"data_stored":17670144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":22417408,"data_stored":22417408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":21131264,"data_stored":21131264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23576576,"data_stored":23576576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24047616,"data_stored":24047616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":19443712,"data_stored":19443712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":42918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":45449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":20534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":65245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":9095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":65394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":33840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":67293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16779262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17829888,"data_stored":17827838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16779262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28311552,"data_stored":28311552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22024192,"data_stored":22022142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T12:03:06.397 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T12:03:06.774 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T12:03:06.784 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T12:03:06.791 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":1094,"stamp":"2024-09-19T12:03:05.384692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":260082274,"num_objects":1039,"num_object_clones":0,"num_object_copies":3596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1039,"num_whiteouts":0,"num_read":29217,"num_read_kb":495654,"num_write":20190,"num_write_kb":408755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7769,"ondisk_log_size":7769,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1480008,"kb_used_data":468488,"kb_used_omap":12,"kb_used_meta":1011379,"kb_avail":753494712,"statfs":{"total":773094113280,"available":771578585088,"internally_reserved":0,"allocated":479731712,"data_stored":464002278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1035652656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008657"},"pg_stats":[{"pgid":"67.1d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.590975+0000","last_change":"2024-09-19T11:53:37.745334+0000","last_active":"2024-09-19T11:58:36.590975+0000","last_peered":"2024-09-19T11:58:36.590975+0000","last_clean":"2024-09-19T11:58:36.590975+0000","last_became_active":"2024-09-19T11:53:37.744679+0000","last_became_peered":"2024-09-19T11:53:37.744679+0000","last_unstale":"2024-09-19T11:58:36.590975+0000","last_undegraded":"2024-09-19T11:58:36.590975+0000","last_fullsized":"2024-09-19T11:58:36.590975+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:29.888364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.586691+0000","last_change":"2024-09-19T11:53:34.715828+0000","last_active":"2024-09-19T11:58:36.586691+0000","last_peered":"2024-09-19T11:58:36.586691+0000","last_clean":"2024-09-19T11:58:36.586691+0000","last_became_active":"2024-09-19T11:53:34.714946+0000","last_became_peered":"2024-09-19T11:53:34.714946+0000","last_unstale":"2024-09-19T11:58:36.586691+0000","last_undegraded":"2024-09-19T11:58:36.586691+0000","last_fullsized":"2024-09-19T11:58:36.586691+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:46.457012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"256'14","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.615105+0000","last_change":"2024-09-19T11:51:53.494561+0000","last_active":"2024-09-19T12:00:16.615105+0000","last_peered":"2024-09-19T12:00:16.615105+0000","last_clean":"2024-09-19T12:00:16.615105+0000","last_became_active":"2024-09-19T11:51:53.493294+0000","last_became_peered":"2024-09-19T11:51:53.493294+0000","last_unstale":"2024-09-19T12:00:16.615105+0000","last_undegraded":"2024-09-19T12:00:16.615105+0000","last_fullsized":"2024-09-19T12:00:16.615105+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:25.608106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":86,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.785305+0000","last_change":"2024-09-19T11:53:37.715171+0000","last_active":"2024-09-19T11:58:41.785305+0000","last_peered":"2024-09-19T11:58:41.785305+0000","last_clean":"2024-09-19T11:58:41.785305+0000","last_became_active":"2024-09-19T11:53:37.714526+0000","last_became_peered":"2024-09-19T11:53:37.714526+0000","last_unstale":"2024-09-19T11:58:41.785305+0000","last_undegraded":"2024-09-19T11:58:41.785305+0000","last_fullsized":"2024-09-19T11:58:41.785305+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:47:00.837259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.579334+0000","last_change":"2024-09-19T11:53:34.730623+0000","last_active":"2024-09-19T11:58:36.579334+0000","last_peered":"2024-09-19T11:58:36.579334+0000","last_clean":"2024-09-19T11:58:36.579334+0000","last_became_active":"2024-09-19T11:53:34.730025+0000","last_became_peered":"2024-09-19T11:53:34.730025+0000","last_unstale":"2024-09-19T11:58:36.579334+0000","last_undegraded":"2024-09-19T11:58:36.579334+0000","last_fullsized":"2024-09-19T11:58:36.579334+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:52.233686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.596619+0000","last_change":"2024-09-19T11:51:53.495233+0000","last_active":"2024-09-19T11:59:56.596619+0000","last_peered":"2024-09-19T11:59:56.596619+0000","last_clean":"2024-09-19T11:59:56.596619+0000","last_became_active":"2024-09-19T11:51:53.494552+0000","last_became_peered":"2024-09-19T11:51:53.494552+0000","last_unstale":"2024-09-19T11:59:56.596619+0000","last_undegraded":"2024-09-19T11:59:56.596619+0000","last_fullsized":"2024-09-19T11:59:56.596619+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:17.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.610306+0000","last_change":"2024-09-19T11:53:37.760242+0000","last_active":"2024-09-19T11:59:56.610306+0000","last_peered":"2024-09-19T11:59:56.610306+0000","last_clean":"2024-09-19T11:59:56.610306+0000","last_became_active":"2024-09-19T11:53:37.757767+0000","last_became_peered":"2024-09-19T11:53:37.757767+0000","last_unstale":"2024-09-19T11:59:56.610306+0000","last_undegraded":"2024-09-19T11:59:56.610306+0000","last_fullsized":"2024-09-19T11:59:56.610306+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:53:27.455399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.592459+0000","last_change":"2024-09-19T11:53:34.712290+0000","last_active":"2024-09-19T11:59:36.592459+0000","last_peered":"2024-09-19T11:59:36.592459+0000","last_clean":"2024-09-19T11:59:36.592459+0000","last_became_active":"2024-09-19T11:53:34.711510+0000","last_became_peered":"2024-09-19T11:53:34.711510+0000","last_unstale":"2024-09-19T11:59:36.592459+0000","last_undegraded":"2024-09-19T11:59:36.592459+0000","last_fullsized":"2024-09-19T11:59:36.592459+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:51.007502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.603011+0000","last_change":"2024-09-19T11:51:53.480345+0000","last_active":"2024-09-19T11:59:26.603011+0000","last_peered":"2024-09-19T11:59:26.603011+0000","last_clean":"2024-09-19T11:59:26.603011+0000","last_became_active":"2024-09-19T11:51:53.479659+0000","last_became_peered":"2024-09-19T11:51:53.479659+0000","last_unstale":"2024-09-19T11:59:26.603011+0000","last_undegraded":"2024-09-19T11:59:26.603011+0000","last_fullsized":"2024-09-19T11:59:26.603011+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:02.230797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.601507+0000","last_change":"2024-09-19T11:53:37.758685+0000","last_active":"2024-09-19T11:59:41.601507+0000","last_peered":"2024-09-19T11:59:41.601507+0000","last_clean":"2024-09-19T11:59:41.601507+0000","last_became_active":"2024-09-19T11:53:37.756047+0000","last_became_peered":"2024-09-19T11:53:37.756047+0000","last_unstale":"2024-09-19T11:59:41.601507+0000","last_undegraded":"2024-09-19T11:59:41.601507+0000","last_fullsized":"2024-09-19T11:59:41.601507+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:44.645097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.800925+0000","last_change":"2024-09-19T11:53:34.706109+0000","last_active":"2024-09-19T11:59:51.800925+0000","last_peered":"2024-09-19T11:59:51.800925+0000","last_clean":"2024-09-19T11:59:51.800925+0000","last_became_active":"2024-09-19T11:53:34.705364+0000","last_became_peered":"2024-09-19T11:53:34.705364+0000","last_unstale":"2024-09-19T11:59:51.800925+0000","last_undegraded":"2024-09-19T11:59:51.800925+0000","last_fullsized":"2024-09-19T11:59:51.800925+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:58:24.677448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.597881+0000","last_change":"2024-09-19T11:51:53.477170+0000","last_active":"2024-09-19T11:59:26.597881+0000","last_peered":"2024-09-19T11:59:26.597881+0000","last_clean":"2024-09-19T11:59:26.597881+0000","last_became_active":"2024-09-19T11:51:53.475807+0000","last_became_peered":"2024-09-19T11:51:53.475807+0000","last_unstale":"2024-09-19T11:59:26.597881+0000","last_undegraded":"2024-09-19T11:59:26.597881+0000","last_fullsized":"2024-09-19T11:59:26.597881+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:44.084226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.589586+0000","last_change":"2024-09-19T11:53:37.733871+0000","last_active":"2024-09-19T11:58:31.589586+0000","last_peered":"2024-09-19T11:58:31.589586+0000","last_clean":"2024-09-19T11:58:31.589586+0000","last_became_active":"2024-09-19T11:53:37.733244+0000","last_became_peered":"2024-09-19T11:53:37.733244+0000","last_unstale":"2024-09-19T11:58:31.589586+0000","last_undegraded":"2024-09-19T11:58:31.589586+0000","last_fullsized":"2024-09-19T11:58:31.589586+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:59.898211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.589239+0000","last_change":"2024-09-19T11:53:34.723027+0000","last_active":"2024-09-19T11:58:26.589239+0000","last_peered":"2024-09-19T11:58:26.589239+0000","last_clean":"2024-09-19T11:58:26.589239+0000","last_became_active":"2024-09-19T11:53:34.722143+0000","last_became_peered":"2024-09-19T11:53:34.722143+0000","last_unstale":"2024-09-19T11:58:26.589239+0000","last_undegraded":"2024-09-19T11:58:26.589239+0000","last_fullsized":"2024-09-19T11:58:26.589239+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:35.362037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"256'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.597786+0000","last_change":"2024-09-19T11:51:53.497903+0000","last_active":"2024-09-19T11:59:26.597786+0000","last_peered":"2024-09-19T11:59:26.597786+0000","last_clean":"2024-09-19T11:59:26.597786+0000","last_became_active":"2024-09-19T11:51:53.496828+0000","last_became_peered":"2024-09-19T11:51:53.496828+0000","last_unstale":"2024-09-19T11:59:26.597786+0000","last_undegraded":"2024-09-19T11:59:26.597786+0000","last_fullsized":"2024-09-19T11:59:26.597786+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:33:53.888475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.18","version":"262'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.590468+0000","last_change":"2024-09-19T11:53:37.752259+0000","last_active":"2024-09-19T11:58:31.590468+0000","last_peered":"2024-09-19T11:58:31.590468+0000","last_clean":"2024-09-19T11:58:31.590468+0000","last_became_active":"2024-09-19T11:53:37.751550+0000","last_became_peered":"2024-09-19T11:53:37.751550+0000","last_unstale":"2024-09-19T11:58:31.590468+0000","last_undegraded":"2024-09-19T11:58:31.590468+0000","last_fullsized":"2024-09-19T11:58:31.590468+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:24.886099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":20480,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'1","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.781501+0000","last_change":"2024-09-19T11:53:34.700220+0000","last_active":"2024-09-19T11:58:26.781501+0000","last_peered":"2024-09-19T11:58:26.781501+0000","last_clean":"2024-09-19T11:58:26.781501+0000","last_became_active":"2024-09-19T11:53:34.699476+0000","last_became_peered":"2024-09-19T11:53:34.699476+0000","last_unstale":"2024-09-19T11:58:26.781501+0000","last_undegraded":"2024-09-19T11:58:26.781501+0000","last_fullsized":"2024-09-19T11:58:26.781501+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:31.463060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2046,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.602602+0000","last_change":"2024-09-19T11:51:53.469668+0000","last_active":"2024-09-19T11:59:26.602602+0000","last_peered":"2024-09-19T11:59:26.602602+0000","last_clean":"2024-09-19T11:59:26.602602+0000","last_became_active":"2024-09-19T11:51:53.468220+0000","last_became_peered":"2024-09-19T11:51:53.468220+0000","last_unstale":"2024-09-19T11:59:26.602602+0000","last_undegraded":"2024-09-19T11:59:26.602602+0000","last_fullsized":"2024-09-19T11:59:26.602602+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:15.153859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.592905+0000","last_change":"2024-09-19T11:53:37.734780+0000","last_active":"2024-09-19T11:58:41.592905+0000","last_peered":"2024-09-19T11:58:41.592905+0000","last_clean":"2024-09-19T11:58:41.592905+0000","last_became_active":"2024-09-19T11:53:37.733461+0000","last_became_peered":"2024-09-19T11:53:37.733461+0000","last_unstale":"2024-09-19T11:58:41.592905+0000","last_undegraded":"2024-09-19T11:58:41.592905+0000","last_fullsized":"2024-09-19T11:58:41.592905+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:09.138836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.784017+0000","last_change":"2024-09-19T11:53:34.711700+0000","last_active":"2024-09-19T11:58:36.784017+0000","last_peered":"2024-09-19T11:58:36.784017+0000","last_clean":"2024-09-19T11:58:36.784017+0000","last_became_active":"2024-09-19T11:53:34.711125+0000","last_became_peered":"2024-09-19T11:53:34.711125+0000","last_unstale":"2024-09-19T11:58:36.784017+0000","last_undegraded":"2024-09-19T11:58:36.784017+0000","last_fullsized":"2024-09-19T11:58:36.784017+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:23.766743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.599515+0000","last_change":"2024-09-19T11:51:53.498330+0000","last_active":"2024-09-19T11:59:11.599515+0000","last_peered":"2024-09-19T11:59:11.599515+0000","last_clean":"2024-09-19T11:59:11.599515+0000","last_became_active":"2024-09-19T11:51:53.497559+0000","last_became_peered":"2024-09-19T11:51:53.497559+0000","last_unstale":"2024-09-19T11:59:11.599515+0000","last_undegraded":"2024-09-19T11:59:11.599515+0000","last_fullsized":"2024-09-19T11:59:11.599515+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:57.123428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.587788+0000","last_change":"2024-09-19T11:53:37.760079+0000","last_active":"2024-09-19T11:58:41.587788+0000","last_peered":"2024-09-19T11:58:41.587788+0000","last_clean":"2024-09-19T11:58:41.587788+0000","last_became_active":"2024-09-19T11:53:37.759079+0000","last_became_peered":"2024-09-19T11:53:37.759079+0000","last_unstale":"2024-09-19T11:58:41.587788+0000","last_undegraded":"2024-09-19T11:58:41.587788+0000","last_fullsized":"2024-09-19T11:58:41.587788+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:55.874038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.592016+0000","last_change":"2024-09-19T11:53:34.732158+0000","last_active":"2024-09-19T11:58:36.592016+0000","last_peered":"2024-09-19T11:58:36.592016+0000","last_clean":"2024-09-19T11:58:36.592016+0000","last_became_active":"2024-09-19T11:53:34.722675+0000","last_became_peered":"2024-09-19T11:53:34.722675+0000","last_unstale":"2024-09-19T11:58:36.592016+0000","last_undegraded":"2024-09-19T11:58:36.592016+0000","last_fullsized":"2024-09-19T11:58:36.592016+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:13.301780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":21504,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.586361+0000","last_change":"2024-09-19T11:51:53.486009+0000","last_active":"2024-09-19T11:59:11.586361+0000","last_peered":"2024-09-19T11:59:11.586361+0000","last_clean":"2024-09-19T11:59:11.586361+0000","last_became_active":"2024-09-19T11:51:53.485176+0000","last_became_peered":"2024-09-19T11:51:53.485176+0000","last_unstale":"2024-09-19T11:59:11.586361+0000","last_undegraded":"2024-09-19T11:59:11.586361+0000","last_fullsized":"2024-09-19T11:59:11.586361+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:32.437601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.585506+0000","last_change":"2024-09-19T11:53:37.738229+0000","last_active":"2024-09-19T11:58:31.585506+0000","last_peered":"2024-09-19T11:58:31.585506+0000","last_clean":"2024-09-19T11:58:31.585506+0000","last_became_active":"2024-09-19T11:53:37.735681+0000","last_became_peered":"2024-09-19T11:53:37.735681+0000","last_unstale":"2024-09-19T11:58:31.585506+0000","last_undegraded":"2024-09-19T11:58:31.585506+0000","last_fullsized":"2024-09-19T11:58:31.585506+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:26.373362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619176+0000","last_change":"2024-09-19T11:53:34.709295+0000","last_active":"2024-09-19T12:00:41.619176+0000","last_peered":"2024-09-19T12:00:41.619176+0000","last_clean":"2024-09-19T12:00:41.619176+0000","last_became_active":"2024-09-19T11:53:34.708831+0000","last_became_peered":"2024-09-19T11:53:34.708831+0000","last_unstale":"2024-09-19T12:00:41.619176+0000","last_undegraded":"2024-09-19T12:00:41.619176+0000","last_fullsized":"2024-09-19T12:00:41.619176+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:25.795767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.599708+0000","last_change":"2024-09-19T11:51:53.499050+0000","last_active":"2024-09-19T11:59:11.599708+0000","last_peered":"2024-09-19T11:59:11.599708+0000","last_clean":"2024-09-19T11:59:11.599708+0000","last_became_active":"2024-09-19T11:51:53.498327+0000","last_became_peered":"2024-09-19T11:51:53.498327+0000","last_unstale":"2024-09-19T11:59:11.599708+0000","last_undegraded":"2024-09-19T11:59:11.599708+0000","last_fullsized":"2024-09-19T11:59:11.599708+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:49.722787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615207+0000","last_change":"2024-09-19T11:53:37.755767+0000","last_active":"2024-09-19T12:00:41.615207+0000","last_peered":"2024-09-19T12:00:41.615207+0000","last_clean":"2024-09-19T12:00:41.615207+0000","last_became_active":"2024-09-19T11:53:37.754753+0000","last_became_peered":"2024-09-19T11:53:37.754753+0000","last_unstale":"2024-09-19T12:00:41.615207+0000","last_undegraded":"2024-09-19T12:00:41.615207+0000","last_fullsized":"2024-09-19T12:00:41.615207+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:22.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.592245+0000","last_change":"2024-09-19T11:53:34.720643+0000","last_active":"2024-09-19T11:58:26.592245+0000","last_peered":"2024-09-19T11:58:26.592245+0000","last_clean":"2024-09-19T11:58:26.592245+0000","last_became_active":"2024-09-19T11:53:34.720273+0000","last_became_peered":"2024-09-19T11:53:34.720273+0000","last_unstale":"2024-09-19T11:58:26.592245+0000","last_undegraded":"2024-09-19T11:58:26.592245+0000","last_fullsized":"2024-09-19T11:58:26.592245+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:26.226182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"255'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.594417+0000","last_change":"2024-09-19T11:51:53.497665+0000","last_active":"2024-09-19T11:59:11.594417+0000","last_peered":"2024-09-19T11:59:11.594417+0000","last_clean":"2024-09-19T11:59:11.594417+0000","last_became_active":"2024-09-19T11:51:53.496988+0000","last_became_peered":"2024-09-19T11:51:53.496988+0000","last_unstale":"2024-09-19T11:59:11.594417+0000","last_undegraded":"2024-09-19T11:59:11.594417+0000","last_fullsized":"2024-09-19T11:59:11.594417+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:42.583270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.17","version":"262'3","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.585554+0000","last_change":"2024-09-19T11:53:37.759921+0000","last_active":"2024-09-19T11:58:31.585554+0000","last_peered":"2024-09-19T11:58:31.585554+0000","last_clean":"2024-09-19T11:58:31.585554+0000","last_became_active":"2024-09-19T11:53:37.759275+0000","last_became_peered":"2024-09-19T11:53:37.759275+0000","last_unstale":"2024-09-19T11:58:31.585554+0000","last_undegraded":"2024-09-19T11:58:31.585554+0000","last_fullsized":"2024-09-19T11:58:31.585554+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:06.314026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":4096,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.578842+0000","last_change":"2024-09-19T11:53:34.700207+0000","last_active":"2024-09-19T11:58:26.578842+0000","last_peered":"2024-09-19T11:58:26.578842+0000","last_clean":"2024-09-19T11:58:26.578842+0000","last_became_active":"2024-09-19T11:53:34.699437+0000","last_became_peered":"2024-09-19T11:53:34.699437+0000","last_unstale":"2024-09-19T11:58:26.578842+0000","last_undegraded":"2024-09-19T11:58:26.578842+0000","last_fullsized":"2024-09-19T11:58:26.578842+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:54:30.963407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"256'23","reported_seq":100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.587246+0000","last_change":"2024-09-19T11:51:53.479917+0000","last_active":"2024-09-19T11:59:11.587246+0000","last_peered":"2024-09-19T11:59:11.587246+0000","last_clean":"2024-09-19T11:59:11.587246+0000","last_became_active":"2024-09-19T11:51:53.478643+0000","last_became_peered":"2024-09-19T11:51:53.478643+0000","last_unstale":"2024-09-19T11:59:11.587246+0000","last_undegraded":"2024-09-19T11:59:11.587246+0000","last_fullsized":"2024-09-19T11:59:11.587246+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:31.580713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":169,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.782900+0000","last_change":"2024-09-19T11:53:37.737666+0000","last_active":"2024-09-19T11:58:31.782900+0000","last_peered":"2024-09-19T11:58:31.782900+0000","last_clean":"2024-09-19T11:58:31.782900+0000","last_became_active":"2024-09-19T11:53:37.737215+0000","last_became_peered":"2024-09-19T11:53:37.737215+0000","last_unstale":"2024-09-19T11:58:31.782900+0000","last_undegraded":"2024-09-19T11:58:31.782900+0000","last_fullsized":"2024-09-19T11:58:31.782900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:58.237583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"262'4","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.589560+0000","last_change":"2024-09-19T11:53:34.732001+0000","last_active":"2024-09-19T11:58:26.589560+0000","last_peered":"2024-09-19T11:58:26.589560+0000","last_clean":"2024-09-19T11:58:26.589560+0000","last_became_active":"2024-09-19T11:53:34.723850+0000","last_became_peered":"2024-09-19T11:53:34.723850+0000","last_unstale":"2024-09-19T11:58:26.589560+0000","last_undegraded":"2024-09-19T11:58:26.589560+0000","last_fullsized":"2024-09-19T11:58:26.589560+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:50:09.990299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599872+0000","last_change":"2024-09-19T11:51:53.479627+0000","last_active":"2024-09-19T11:58:56.599872+0000","last_peered":"2024-09-19T11:58:56.599872+0000","last_clean":"2024-09-19T11:58:56.599872+0000","last_became_active":"2024-09-19T11:51:53.478922+0000","last_became_peered":"2024-09-19T11:51:53.478922+0000","last_unstale":"2024-09-19T11:58:56.599872+0000","last_undegraded":"2024-09-19T11:58:56.599872+0000","last_fullsized":"2024-09-19T11:58:56.599872+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:56.192816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607351+0000","last_change":"2024-09-19T11:53:37.742835+0000","last_active":"2024-09-19T12:00:41.607351+0000","last_peered":"2024-09-19T12:00:41.607351+0000","last_clean":"2024-09-19T12:00:41.607351+0000","last_became_active":"2024-09-19T11:53:37.734844+0000","last_became_peered":"2024-09-19T11:53:37.734844+0000","last_unstale":"2024-09-19T12:00:41.607351+0000","last_undegraded":"2024-09-19T12:00:41.607351+0000","last_fullsized":"2024-09-19T12:00:41.607351+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:22.920456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810733+0000","last_change":"2024-09-19T11:53:34.707106+0000","last_active":"2024-09-19T12:00:36.810733+0000","last_peered":"2024-09-19T12:00:36.810733+0000","last_clean":"2024-09-19T12:00:36.810733+0000","last_became_active":"2024-09-19T11:53:34.704150+0000","last_became_peered":"2024-09-19T11:53:34.704150+0000","last_unstale":"2024-09-19T12:00:36.810733+0000","last_undegraded":"2024-09-19T12:00:36.810733+0000","last_fullsized":"2024-09-19T12:00:36.810733+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:33.641088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599814+0000","last_change":"2024-09-19T11:51:53.481885+0000","last_active":"2024-09-19T11:58:56.599814+0000","last_peered":"2024-09-19T11:58:56.599814+0000","last_clean":"2024-09-19T11:58:56.599814+0000","last_became_active":"2024-09-19T11:51:53.481154+0000","last_became_peered":"2024-09-19T11:51:53.481154+0000","last_unstale":"2024-09-19T11:58:56.599814+0000","last_undegraded":"2024-09-19T11:58:56.599814+0000","last_fullsized":"2024-09-19T11:58:56.599814+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:33.647811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607252+0000","last_change":"2024-09-19T11:53:37.731071+0000","last_active":"2024-09-19T12:00:41.607252+0000","last_peered":"2024-09-19T12:00:41.607252+0000","last_clean":"2024-09-19T12:00:41.607252+0000","last_became_active":"2024-09-19T11:53:37.730152+0000","last_became_peered":"2024-09-19T11:53:37.730152+0000","last_unstale":"2024-09-19T12:00:41.607252+0000","last_undegraded":"2024-09-19T12:00:41.607252+0000","last_fullsized":"2024-09-19T12:00:41.607252+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:14:21.099777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.613805+0000","last_change":"2024-09-19T11:53:34.704187+0000","last_active":"2024-09-19T12:00:36.613805+0000","last_peered":"2024-09-19T12:00:36.613805+0000","last_clean":"2024-09-19T12:00:36.613805+0000","last_became_active":"2024-09-19T11:53:34.703463+0000","last_became_peered":"2024-09-19T11:53:34.703463+0000","last_unstale":"2024-09-19T12:00:36.613805+0000","last_undegraded":"2024-09-19T12:00:36.613805+0000","last_fullsized":"2024-09-19T12:00:36.613805+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:28.756801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.595963+0000","last_change":"2024-09-19T11:51:53.491344+0000","last_active":"2024-09-19T11:58:56.595963+0000","last_peered":"2024-09-19T11:58:56.595963+0000","last_clean":"2024-09-19T11:58:56.595963+0000","last_became_active":"2024-09-19T11:51:53.490650+0000","last_became_peered":"2024-09-19T11:51:53.490650+0000","last_unstale":"2024-09-19T11:58:56.595963+0000","last_undegraded":"2024-09-19T11:58:56.595963+0000","last_fullsized":"2024-09-19T11:58:56.595963+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:53.773642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615178+0000","last_change":"2024-09-19T11:53:37.759763+0000","last_active":"2024-09-19T12:00:41.615178+0000","last_peered":"2024-09-19T12:00:41.615178+0000","last_clean":"2024-09-19T12:00:41.615178+0000","last_became_active":"2024-09-19T11:53:37.755628+0000","last_became_peered":"2024-09-19T11:53:37.755628+0000","last_unstale":"2024-09-19T12:00:41.615178+0000","last_undegraded":"2024-09-19T12:00:41.615178+0000","last_fullsized":"2024-09-19T12:00:41.615178+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:25.674366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244926,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5122,"num_write":8,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618477+0000","last_change":"2024-09-19T11:53:34.708167+0000","last_active":"2024-09-19T12:00:36.618477+0000","last_peered":"2024-09-19T12:00:36.618477+0000","last_clean":"2024-09-19T12:00:36.618477+0000","last_became_active":"2024-09-19T11:53:34.707412+0000","last_became_peered":"2024-09-19T11:53:34.707412+0000","last_unstale":"2024-09-19T12:00:36.618477+0000","last_undegraded":"2024-09-19T12:00:36.618477+0000","last_fullsized":"2024-09-19T12:00:36.618477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:27.815287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"256'7","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.788702+0000","last_change":"2024-09-19T11:51:53.464544+0000","last_active":"2024-09-19T11:58:56.788702+0000","last_peered":"2024-09-19T11:58:56.788702+0000","last_clean":"2024-09-19T11:58:56.788702+0000","last_became_active":"2024-09-19T11:51:53.463784+0000","last_became_peered":"2024-09-19T11:51:53.463784+0000","last_unstale":"2024-09-19T11:58:56.788702+0000","last_undegraded":"2024-09-19T11:58:56.788702+0000","last_fullsized":"2024-09-19T11:58:56.788702+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:17.326366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.12","version":"262'2","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619685+0000","last_change":"2024-09-19T11:53:37.744463+0000","last_active":"2024-09-19T12:00:41.619685+0000","last_peered":"2024-09-19T12:00:41.619685+0000","last_clean":"2024-09-19T12:00:41.619685+0000","last_became_active":"2024-09-19T11:53:37.743807+0000","last_became_peered":"2024-09-19T11:53:37.743807+0000","last_unstale":"2024-09-19T12:00:41.619685+0000","last_undegraded":"2024-09-19T12:00:41.619685+0000","last_fullsized":"2024-09-19T12:00:41.619685+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:37.688342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.617873+0000","last_change":"2024-09-19T11:53:34.706511+0000","last_active":"2024-09-19T12:00:36.617873+0000","last_peered":"2024-09-19T12:00:36.617873+0000","last_clean":"2024-09-19T12:00:36.617873+0000","last_became_active":"2024-09-19T11:53:34.705705+0000","last_became_peered":"2024-09-19T11:53:34.705705+0000","last_unstale":"2024-09-19T12:00:36.617873+0000","last_undegraded":"2024-09-19T12:00:36.617873+0000","last_fullsized":"2024-09-19T12:00:36.617873+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:28.349619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.590471+0000","last_change":"2024-09-19T11:51:53.488994+0000","last_active":"2024-09-19T11:58:56.590471+0000","last_peered":"2024-09-19T11:58:56.590471+0000","last_clean":"2024-09-19T11:58:56.590471+0000","last_became_active":"2024-09-19T11:51:53.488252+0000","last_became_peered":"2024-09-19T11:51:53.488252+0000","last_unstale":"2024-09-19T11:58:56.590471+0000","last_undegraded":"2024-09-19T11:58:56.590471+0000","last_fullsized":"2024-09-19T11:58:56.590471+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:14.331678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.d","version":"262'3","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611701+0000","last_change":"2024-09-19T11:53:37.755108+0000","last_active":"2024-09-19T12:00:26.611701+0000","last_peered":"2024-09-19T12:00:26.611701+0000","last_clean":"2024-09-19T12:00:26.611701+0000","last_became_active":"2024-09-19T11:53:37.754497+0000","last_became_peered":"2024-09-19T11:53:37.754497+0000","last_unstale":"2024-09-19T12:00:26.611701+0000","last_undegraded":"2024-09-19T12:00:26.611701+0000","last_fullsized":"2024-09-19T12:00:26.611701+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:38.404433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":20480,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"262'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.618125+0000","last_change":"2024-09-19T11:53:34.721569+0000","last_active":"2024-09-19T12:00:21.618125+0000","last_peered":"2024-09-19T12:00:21.618125+0000","last_clean":"2024-09-19T12:00:21.618125+0000","last_became_active":"2024-09-19T11:53:34.721070+0000","last_became_peered":"2024-09-19T11:53:34.721070+0000","last_unstale":"2024-09-19T12:00:21.618125+0000","last_undegraded":"2024-09-19T12:00:21.618125+0000","last_fullsized":"2024-09-19T12:00:21.618125+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:11.145675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":25600,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"256'23","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.587947+0000","last_change":"2024-09-19T11:51:53.490847+0000","last_active":"2024-09-19T11:58:41.587947+0000","last_peered":"2024-09-19T11:58:41.587947+0000","last_clean":"2024-09-19T11:58:41.587947+0000","last_became_active":"2024-09-19T11:51:53.490074+0000","last_became_peered":"2024-09-19T11:51:53.490074+0000","last_unstale":"2024-09-19T11:58:41.587947+0000","last_undegraded":"2024-09-19T11:58:41.587947+0000","last_fullsized":"2024-09-19T11:58:41.587947+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:25.990044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":156,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611634+0000","last_change":"2024-09-19T11:53:37.759926+0000","last_active":"2024-09-19T12:00:26.611634+0000","last_peered":"2024-09-19T12:00:26.611634+0000","last_clean":"2024-09-19T12:00:26.611634+0000","last_became_active":"2024-09-19T11:53:37.758965+0000","last_became_peered":"2024-09-19T11:53:37.758965+0000","last_unstale":"2024-09-19T12:00:26.611634+0000","last_undegraded":"2024-09-19T12:00:26.611634+0000","last_fullsized":"2024-09-19T12:00:26.611634+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:35.768438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.601997+0000","last_change":"2024-09-19T11:53:34.730214+0000","last_active":"2024-09-19T12:00:21.601997+0000","last_peered":"2024-09-19T12:00:21.601997+0000","last_clean":"2024-09-19T12:00:21.601997+0000","last_became_active":"2024-09-19T11:53:34.729772+0000","last_became_peered":"2024-09-19T11:53:34.729772+0000","last_unstale":"2024-09-19T12:00:21.601997+0000","last_undegraded":"2024-09-19T12:00:21.601997+0000","last_fullsized":"2024-09-19T12:00:21.601997+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:08.302177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.592249+0000","last_change":"2024-09-19T11:51:53.480445+0000","last_active":"2024-09-19T11:58:41.592249+0000","last_peered":"2024-09-19T11:58:41.592249+0000","last_clean":"2024-09-19T11:58:41.592249+0000","last_became_active":"2024-09-19T11:51:53.479490+0000","last_became_peered":"2024-09-19T11:51:53.479490+0000","last_unstale":"2024-09-19T11:58:41.592249+0000","last_undegraded":"2024-09-19T11:58:41.592249+0000","last_fullsized":"2024-09-19T11:58:41.592249+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:37.406182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.605040+0000","last_change":"2024-09-19T11:53:37.731450+0000","last_active":"2024-09-19T12:00:31.605040+0000","last_peered":"2024-09-19T12:00:31.605040+0000","last_clean":"2024-09-19T12:00:31.605040+0000","last_became_active":"2024-09-19T11:53:37.730671+0000","last_became_peered":"2024-09-19T11:53:37.730671+0000","last_unstale":"2024-09-19T12:00:31.605040+0000","last_undegraded":"2024-09-19T12:00:31.605040+0000","last_fullsized":"2024-09-19T12:00:31.605040+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:37.080584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.616273+0000","last_change":"2024-09-19T11:53:34.722175+0000","last_active":"2024-09-19T12:00:21.616273+0000","last_peered":"2024-09-19T12:00:21.616273+0000","last_clean":"2024-09-19T12:00:21.616273+0000","last_became_active":"2024-09-19T11:53:34.720160+0000","last_became_peered":"2024-09-19T11:53:34.720160+0000","last_unstale":"2024-09-19T12:00:21.616273+0000","last_undegraded":"2024-09-19T12:00:21.616273+0000","last_fullsized":"2024-09-19T12:00:21.616273+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:52:58.935663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":4096,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.592954+0000","last_change":"2024-09-19T11:51:53.484469+0000","last_active":"2024-09-19T11:58:41.592954+0000","last_peered":"2024-09-19T11:58:41.592954+0000","last_clean":"2024-09-19T11:58:41.592954+0000","last_became_active":"2024-09-19T11:51:53.483786+0000","last_became_peered":"2024-09-19T11:51:53.483786+0000","last_unstale":"2024-09-19T11:58:41.592954+0000","last_undegraded":"2024-09-19T11:58:41.592954+0000","last_fullsized":"2024-09-19T11:58:41.592954+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:34.978547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611748+0000","last_change":"2024-09-19T11:53:37.745246+0000","last_active":"2024-09-19T12:00:26.611748+0000","last_peered":"2024-09-19T12:00:26.611748+0000","last_clean":"2024-09-19T12:00:26.611748+0000","last_became_active":"2024-09-19T11:53:37.739838+0000","last_became_peered":"2024-09-19T11:53:37.739838+0000","last_unstale":"2024-09-19T12:00:26.611748+0000","last_undegraded":"2024-09-19T12:00:26.611748+0000","last_fullsized":"2024-09-19T12:00:26.611748+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:07.343317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603804+0000","last_change":"2024-09-19T11:53:34.709512+0000","last_active":"2024-09-19T12:00:26.603804+0000","last_peered":"2024-09-19T12:00:26.603804+0000","last_clean":"2024-09-19T12:00:26.603804+0000","last_became_active":"2024-09-19T11:53:34.708542+0000","last_became_peered":"2024-09-19T11:53:34.708542+0000","last_unstale":"2024-09-19T12:00:26.603804+0000","last_undegraded":"2024-09-19T12:00:26.603804+0000","last_fullsized":"2024-09-19T12:00:26.603804+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:09.314949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.581698+0000","last_change":"2024-09-19T11:51:53.479663+0000","last_active":"2024-09-19T11:58:41.581698+0000","last_peered":"2024-09-19T11:58:41.581698+0000","last_clean":"2024-09-19T11:58:41.581698+0000","last_became_active":"2024-09-19T11:51:53.478940+0000","last_became_peered":"2024-09-19T11:51:53.478940+0000","last_unstale":"2024-09-19T11:58:41.581698+0000","last_undegraded":"2024-09-19T11:58:41.581698+0000","last_fullsized":"2024-09-19T11:58:41.581698+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:59.776490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.9","version":"262'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.805174+0000","last_change":"2024-09-19T11:54:08.215698+0000","last_active":"2024-09-19T12:00:11.805174+0000","last_peered":"2024-09-19T12:00:11.805174+0000","last_clean":"2024-09-19T12:00:11.805174+0000","last_became_active":"2024-09-19T11:54:08.143092+0000","last_became_peered":"2024-09-19T11:54:08.143092+0000","last_unstale":"2024-09-19T12:00:11.805174+0000","last_undegraded":"2024-09-19T12:00:11.805174+0000","last_fullsized":"2024-09-19T12:00:11.805174+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:06.545326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":26624,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.612462+0000","last_change":"2024-09-19T11:53:34.723264+0000","last_active":"2024-09-19T12:00:06.612462+0000","last_peered":"2024-09-19T12:00:06.612462+0000","last_clean":"2024-09-19T12:00:06.612462+0000","last_became_active":"2024-09-19T11:53:34.722786+0000","last_became_peered":"2024-09-19T11:53:34.722786+0000","last_unstale":"2024-09-19T12:00:06.612462+0000","last_undegraded":"2024-09-19T12:00:06.612462+0000","last_fullsized":"2024-09-19T12:00:06.612462+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:25:14.671300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.593130+0000","last_change":"2024-09-19T11:51:53.491094+0000","last_active":"2024-09-19T11:58:41.593130+0000","last_peered":"2024-09-19T11:58:41.593130+0000","last_clean":"2024-09-19T11:58:41.593130+0000","last_became_active":"2024-09-19T11:51:53.490467+0000","last_became_peered":"2024-09-19T11:51:53.490467+0000","last_unstale":"2024-09-19T11:58:41.593130+0000","last_undegraded":"2024-09-19T11:58:41.593130+0000","last_fullsized":"2024-09-19T11:58:41.593130+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:52.304018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.615854+0000","last_change":"2024-09-19T11:53:37.739452+0000","last_active":"2024-09-19T12:00:11.615854+0000","last_peered":"2024-09-19T12:00:11.615854+0000","last_clean":"2024-09-19T12:00:11.615854+0000","last_became_active":"2024-09-19T11:53:37.738652+0000","last_became_peered":"2024-09-19T11:53:37.738652+0000","last_unstale":"2024-09-19T12:00:11.615854+0000","last_undegraded":"2024-09-19T12:00:11.615854+0000","last_fullsized":"2024-09-19T12:00:11.615854+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.598691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.598923+0000","last_change":"2024-09-19T11:53:34.709704+0000","last_active":"2024-09-19T12:00:06.598923+0000","last_peered":"2024-09-19T12:00:06.598923+0000","last_clean":"2024-09-19T12:00:06.598923+0000","last_became_active":"2024-09-19T11:53:34.708971+0000","last_became_peered":"2024-09-19T11:53:34.708971+0000","last_unstale":"2024-09-19T12:00:06.598923+0000","last_undegraded":"2024-09-19T12:00:06.598923+0000","last_fullsized":"2024-09-19T12:00:06.598923+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:31.763785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"256'7","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.621385+0000","last_change":"2024-09-19T11:51:53.482164+0000","last_active":"2024-09-19T12:00:36.621385+0000","last_peered":"2024-09-19T12:00:36.621385+0000","last_clean":"2024-09-19T12:00:36.621385+0000","last_became_active":"2024-09-19T11:51:53.481429+0000","last_became_peered":"2024-09-19T11:51:53.481429+0000","last_unstale":"2024-09-19T12:00:36.621385+0000","last_undegraded":"2024-09-19T12:00:36.621385+0000","last_fullsized":"2024-09-19T12:00:36.621385+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:29.346644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":44,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603698+0000","last_change":"2024-09-19T11:53:37.743123+0000","last_active":"2024-09-19T12:00:26.603698+0000","last_peered":"2024-09-19T12:00:26.603698+0000","last_clean":"2024-09-19T12:00:26.603698+0000","last_became_active":"2024-09-19T11:53:37.742403+0000","last_became_peered":"2024-09-19T11:53:37.742403+0000","last_unstale":"2024-09-19T12:00:26.603698+0000","last_undegraded":"2024-09-19T12:00:26.603698+0000","last_fullsized":"2024-09-19T12:00:26.603698+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:17.009971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.612531+0000","last_change":"2024-09-19T11:53:34.731804+0000","last_active":"2024-09-19T12:00:06.612531+0000","last_peered":"2024-09-19T12:00:06.612531+0000","last_clean":"2024-09-19T12:00:06.612531+0000","last_became_active":"2024-09-19T11:53:34.728959+0000","last_became_peered":"2024-09-19T11:53:34.728959+0000","last_unstale":"2024-09-19T12:00:06.612531+0000","last_undegraded":"2024-09-19T12:00:06.612531+0000","last_fullsized":"2024-09-19T12:00:06.612531+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:26.270496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.613843+0000","last_change":"2024-09-19T11:51:53.473143+0000","last_active":"2024-09-19T12:00:36.613843+0000","last_peered":"2024-09-19T12:00:36.613843+0000","last_clean":"2024-09-19T12:00:36.613843+0000","last_became_active":"2024-09-19T11:51:53.472485+0000","last_became_peered":"2024-09-19T11:51:53.472485+0000","last_unstale":"2024-09-19T12:00:36.613843+0000","last_undegraded":"2024-09-19T12:00:36.613843+0000","last_fullsized":"2024-09-19T12:00:36.613843+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:05:05.000749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.615948+0000","last_change":"2024-09-19T11:53:37.737715+0000","last_active":"2024-09-19T12:00:11.615948+0000","last_peered":"2024-09-19T12:00:11.615948+0000","last_clean":"2024-09-19T12:00:11.615948+0000","last_became_active":"2024-09-19T11:53:37.736772+0000","last_became_peered":"2024-09-19T11:53:37.736772+0000","last_unstale":"2024-09-19T12:00:11.615948+0000","last_undegraded":"2024-09-19T12:00:11.615948+0000","last_fullsized":"2024-09-19T12:00:11.615948+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:02.929650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'4","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807394+0000","last_change":"2024-09-19T11:53:34.711999+0000","last_active":"2024-09-19T12:00:21.807394+0000","last_peered":"2024-09-19T12:00:21.807394+0000","last_clean":"2024-09-19T12:00:21.807394+0000","last_became_active":"2024-09-19T11:53:34.711382+0000","last_became_peered":"2024-09-19T11:53:34.711382+0000","last_unstale":"2024-09-19T12:00:21.807394+0000","last_undegraded":"2024-09-19T12:00:21.807394+0000","last_fullsized":"2024-09-19T12:00:21.807394+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:31.348728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":9,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618375+0000","last_change":"2024-09-19T11:51:53.487166+0000","last_active":"2024-09-19T12:00:36.618375+0000","last_peered":"2024-09-19T12:00:36.618375+0000","last_clean":"2024-09-19T12:00:36.618375+0000","last_became_active":"2024-09-19T11:51:53.486236+0000","last_became_peered":"2024-09-19T11:51:53.486236+0000","last_unstale":"2024-09-19T12:00:36.618375+0000","last_undegraded":"2024-09-19T12:00:36.618375+0000","last_fullsized":"2024-09-19T12:00:36.618375+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:19.897372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.610219+0000","last_change":"2024-09-19T11:53:37.747251+0000","last_active":"2024-09-19T11:59:56.610219+0000","last_peered":"2024-09-19T11:59:56.610219+0000","last_clean":"2024-09-19T11:59:56.610219+0000","last_became_active":"2024-09-19T11:53:37.745076+0000","last_became_peered":"2024-09-19T11:53:37.745076+0000","last_unstale":"2024-09-19T11:59:56.610219+0000","last_undegraded":"2024-09-19T11:59:56.610219+0000","last_fullsized":"2024-09-19T11:59:56.610219+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:16.840839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611669+0000","last_change":"2024-09-19T11:53:34.720400+0000","last_active":"2024-09-19T11:59:51.611669+0000","last_peered":"2024-09-19T11:59:51.611669+0000","last_clean":"2024-09-19T11:59:51.611669+0000","last_became_active":"2024-09-19T11:53:34.719535+0000","last_became_peered":"2024-09-19T11:53:34.719535+0000","last_unstale":"2024-09-19T11:59:51.611669+0000","last_undegraded":"2024-09-19T11:59:51.611669+0000","last_fullsized":"2024-09-19T11:59:51.611669+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:53.909023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'11","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.619919+0000","last_change":"2024-09-19T11:51:53.486865+0000","last_active":"2024-09-19T12:00:36.619919+0000","last_peered":"2024-09-19T12:00:36.619919+0000","last_clean":"2024-09-19T12:00:36.619919+0000","last_became_active":"2024-09-19T11:51:53.486126+0000","last_became_peered":"2024-09-19T11:51:53.486126+0000","last_unstale":"2024-09-19T12:00:36.619919+0000","last_undegraded":"2024-09-19T12:00:36.619919+0000","last_fullsized":"2024-09-19T12:00:36.619919+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:29.272674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":56,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.610165+0000","last_change":"2024-09-19T11:53:37.749405+0000","last_active":"2024-09-19T11:59:56.610165+0000","last_peered":"2024-09-19T11:59:56.610165+0000","last_clean":"2024-09-19T11:59:56.610165+0000","last_became_active":"2024-09-19T11:53:37.748479+0000","last_became_peered":"2024-09-19T11:53:37.748479+0000","last_unstale":"2024-09-19T11:59:56.610165+0000","last_undegraded":"2024-09-19T11:59:56.610165+0000","last_fullsized":"2024-09-19T11:59:56.610165+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:55.422274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"259'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.595554+0000","last_change":"2024-09-19T11:53:34.721846+0000","last_active":"2024-09-19T11:59:51.595554+0000","last_peered":"2024-09-19T11:59:51.595554+0000","last_clean":"2024-09-19T11:59:51.595554+0000","last_became_active":"2024-09-19T11:53:34.721421+0000","last_became_peered":"2024-09-19T11:53:34.721421+0000","last_unstale":"2024-09-19T11:59:51.595554+0000","last_undegraded":"2024-09-19T11:59:51.595554+0000","last_fullsized":"2024-09-19T11:59:51.595554+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:43:44.169249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618564+0000","last_change":"2024-09-19T11:51:53.469628+0000","last_active":"2024-09-19T12:00:36.618564+0000","last_peered":"2024-09-19T12:00:36.618564+0000","last_clean":"2024-09-19T12:00:36.618564+0000","last_became_active":"2024-09-19T11:51:53.468768+0000","last_became_peered":"2024-09-19T11:51:53.468768+0000","last_unstale":"2024-09-19T12:00:36.618564+0000","last_undegraded":"2024-09-19T12:00:36.618564+0000","last_fullsized":"2024-09-19T12:00:36.618564+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:35.828878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.616066+0000","last_change":"2024-09-19T11:53:37.749695+0000","last_active":"2024-09-19T12:00:11.616066+0000","last_peered":"2024-09-19T12:00:11.616066+0000","last_clean":"2024-09-19T12:00:11.616066+0000","last_became_active":"2024-09-19T11:53:37.749246+0000","last_became_peered":"2024-09-19T11:53:37.749246+0000","last_unstale":"2024-09-19T12:00:11.616066+0000","last_undegraded":"2024-09-19T12:00:11.616066+0000","last_fullsized":"2024-09-19T12:00:11.616066+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:35.006918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.610837+0000","last_change":"2024-09-19T11:53:34.703535+0000","last_active":"2024-09-19T12:00:06.610837+0000","last_peered":"2024-09-19T12:00:06.610837+0000","last_clean":"2024-09-19T12:00:06.610837+0000","last_became_active":"2024-09-19T11:53:34.702356+0000","last_became_peered":"2024-09-19T11:53:34.702356+0000","last_unstale":"2024-09-19T12:00:06.610837+0000","last_undegraded":"2024-09-19T12:00:06.610837+0000","last_fullsized":"2024-09-19T12:00:06.610837+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:05.738912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.617011+0000","last_change":"2024-09-19T11:51:53.484021+0000","last_active":"2024-09-19T12:00:16.617011+0000","last_peered":"2024-09-19T12:00:16.617011+0000","last_clean":"2024-09-19T12:00:16.617011+0000","last_became_active":"2024-09-19T11:51:53.483350+0000","last_became_peered":"2024-09-19T11:51:53.483350+0000","last_unstale":"2024-09-19T12:00:16.617011+0000","last_undegraded":"2024-09-19T12:00:16.617011+0000","last_fullsized":"2024-09-19T12:00:16.617011+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:32.695646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"262'6","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.805332+0000","last_change":"2024-09-19T11:53:37.731037+0000","last_active":"2024-09-19T12:00:11.805332+0000","last_peered":"2024-09-19T12:00:11.805332+0000","last_clean":"2024-09-19T12:00:11.805332+0000","last_became_active":"2024-09-19T11:53:37.730641+0000","last_became_peered":"2024-09-19T11:53:37.730641+0000","last_unstale":"2024-09-19T12:00:11.805332+0000","last_undegraded":"2024-09-19T12:00:11.805332+0000","last_fullsized":"2024-09-19T12:00:11.805332+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:40.518527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":11,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.614943+0000","last_change":"2024-09-19T11:53:34.719873+0000","last_active":"2024-09-19T12:00:06.614943+0000","last_peered":"2024-09-19T12:00:06.614943+0000","last_clean":"2024-09-19T12:00:06.614943+0000","last_became_active":"2024-09-19T11:53:34.719193+0000","last_became_peered":"2024-09-19T11:53:34.719193+0000","last_unstale":"2024-09-19T12:00:06.614943+0000","last_undegraded":"2024-09-19T12:00:06.614943+0000","last_fullsized":"2024-09-19T12:00:06.614943+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:17.922208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"256'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.601313+0000","last_change":"2024-09-19T11:51:53.479626+0000","last_active":"2024-09-19T12:00:16.601313+0000","last_peered":"2024-09-19T12:00:16.601313+0000","last_clean":"2024-09-19T12:00:16.601313+0000","last_became_active":"2024-09-19T11:51:53.476953+0000","last_became_peered":"2024-09-19T11:51:53.476953+0000","last_unstale":"2024-09-19T12:00:16.601313+0000","last_undegraded":"2024-09-19T12:00:16.601313+0000","last_fullsized":"2024-09-19T12:00:16.601313+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:40.063157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1","version":"262'2","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.596656+0000","last_change":"2024-09-19T11:53:37.736521+0000","last_active":"2024-09-19T11:59:56.596656+0000","last_peered":"2024-09-19T11:59:56.596656+0000","last_clean":"2024-09-19T11:59:56.596656+0000","last_became_active":"2024-09-19T11:53:37.731400+0000","last_became_peered":"2024-09-19T11:53:37.731400+0000","last_unstale":"2024-09-19T11:59:56.596656+0000","last_undegraded":"2024-09-19T11:59:56.596656+0000","last_fullsized":"2024-09-19T11:59:56.596656+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:04.607485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.608474+0000","last_change":"2024-09-19T11:53:34.724933+0000","last_active":"2024-09-19T11:59:36.608474+0000","last_peered":"2024-09-19T11:59:36.608474+0000","last_clean":"2024-09-19T11:59:36.608474+0000","last_became_active":"2024-09-19T11:53:34.724406+0000","last_became_peered":"2024-09-19T11:53:34.724406+0000","last_unstale":"2024-09-19T11:59:36.608474+0000","last_undegraded":"2024-09-19T11:59:36.608474+0000","last_fullsized":"2024-09-19T11:59:36.608474+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:26.998520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":21504,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.612913+0000","last_change":"2024-09-19T11:51:53.495205+0000","last_active":"2024-09-19T12:00:16.612913+0000","last_peered":"2024-09-19T12:00:16.612913+0000","last_clean":"2024-09-19T12:00:16.612913+0000","last_became_active":"2024-09-19T11:51:53.494443+0000","last_became_peered":"2024-09-19T11:51:53.494443+0000","last_unstale":"2024-09-19T12:00:16.612913+0000","last_undegraded":"2024-09-19T12:00:16.612913+0000","last_fullsized":"2024-09-19T12:00:16.612913+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:22.980807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.0","version":"262'1","reported_seq":24,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.605163+0000","last_change":"2024-09-19T11:53:37.729810+0000","last_active":"2024-09-19T11:59:41.605163+0000","last_peered":"2024-09-19T11:59:41.605163+0000","last_clean":"2024-09-19T11:59:41.605163+0000","last_became_active":"2024-09-19T11:53:37.729101+0000","last_became_peered":"2024-09-19T11:53:37.729101+0000","last_unstale":"2024-09-19T11:59:41.605163+0000","last_undegraded":"2024-09-19T11:59:41.605163+0000","last_fullsized":"2024-09-19T11:59:41.605163+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:23.824167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"262'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611574+0000","last_change":"2024-09-19T11:53:34.719029+0000","last_active":"2024-09-19T11:59:51.611574+0000","last_peered":"2024-09-19T11:59:51.611574+0000","last_clean":"2024-09-19T11:59:51.611574+0000","last_became_active":"2024-09-19T11:53:34.715905+0000","last_became_peered":"2024-09-19T11:53:34.715905+0000","last_unstale":"2024-09-19T11:59:51.611574+0000","last_undegraded":"2024-09-19T11:59:51.611574+0000","last_fullsized":"2024-09-19T11:59:51.611574+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:06.085056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.806309+0000","last_change":"2024-09-19T11:51:53.485332+0000","last_active":"2024-09-19T12:00:16.806309+0000","last_peered":"2024-09-19T12:00:16.806309+0000","last_clean":"2024-09-19T12:00:16.806309+0000","last_became_active":"2024-09-19T11:51:53.479975+0000","last_became_peered":"2024-09-19T11:51:53.479975+0000","last_unstale":"2024-09-19T12:00:16.806309+0000","last_undegraded":"2024-09-19T12:00:16.806309+0000","last_fullsized":"2024-09-19T12:00:16.806309+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:54.383913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.609354+0000","last_change":"2024-09-19T11:53:37.752407+0000","last_active":"2024-09-19T11:59:56.609354+0000","last_peered":"2024-09-19T11:59:56.609354+0000","last_clean":"2024-09-19T11:59:56.609354+0000","last_became_active":"2024-09-19T11:53:37.751835+0000","last_became_peered":"2024-09-19T11:53:37.751835+0000","last_unstale":"2024-09-19T11:59:56.609354+0000","last_undegraded":"2024-09-19T11:59:56.609354+0000","last_fullsized":"2024-09-19T11:59:56.609354+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:44.756436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.595536+0000","last_change":"2024-09-19T11:53:34.722088+0000","last_active":"2024-09-19T11:59:51.595536+0000","last_peered":"2024-09-19T11:59:51.595536+0000","last_clean":"2024-09-19T11:59:51.595536+0000","last_became_active":"2024-09-19T11:53:34.721659+0000","last_became_peered":"2024-09-19T11:53:34.721659+0000","last_unstale":"2024-09-19T11:59:51.595536+0000","last_undegraded":"2024-09-19T11:59:51.595536+0000","last_fullsized":"2024-09-19T11:59:51.595536+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:52.673209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.613783+0000","last_change":"2024-09-19T11:51:53.488636+0000","last_active":"2024-09-19T12:00:16.613783+0000","last_peered":"2024-09-19T12:00:16.613783+0000","last_clean":"2024-09-19T12:00:16.613783+0000","last_became_active":"2024-09-19T11:51:53.487416+0000","last_became_peered":"2024-09-19T11:51:53.487416+0000","last_unstale":"2024-09-19T12:00:16.613783+0000","last_undegraded":"2024-09-19T12:00:16.613783+0000","last_fullsized":"2024-09-19T12:00:16.613783+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:28.039923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"262'2","reported_seq":25,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.801984+0000","last_change":"2024-09-19T11:53:37.722872+0000","last_active":"2024-09-19T11:59:56.801984+0000","last_peered":"2024-09-19T11:59:56.801984+0000","last_clean":"2024-09-19T11:59:56.801984+0000","last_became_active":"2024-09-19T11:53:37.722160+0000","last_became_peered":"2024-09-19T11:53:37.722160+0000","last_unstale":"2024-09-19T11:59:56.801984+0000","last_undegraded":"2024-09-19T11:59:56.801984+0000","last_fullsized":"2024-09-19T11:59:56.801984+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:39.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.608199+0000","last_change":"2024-09-19T11:53:34.699925+0000","last_active":"2024-09-19T11:59:51.608199+0000","last_peered":"2024-09-19T11:59:51.608199+0000","last_clean":"2024-09-19T11:59:51.608199+0000","last_became_active":"2024-09-19T11:53:34.699127+0000","last_became_peered":"2024-09-19T11:53:34.699127+0000","last_unstale":"2024-09-19T11:59:51.608199+0000","last_undegraded":"2024-09-19T11:59:51.608199+0000","last_fullsized":"2024-09-19T11:59:51.608199+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:49.808733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"256'15","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.612683+0000","last_change":"2024-09-19T11:51:53.485393+0000","last_active":"2024-09-19T11:59:56.612683+0000","last_peered":"2024-09-19T11:59:56.612683+0000","last_clean":"2024-09-19T11:59:56.612683+0000","last_became_active":"2024-09-19T11:51:53.484630+0000","last_became_peered":"2024-09-19T11:51:53.484630+0000","last_unstale":"2024-09-19T11:59:56.612683+0000","last_undegraded":"2024-09-19T11:59:56.612683+0000","last_fullsized":"2024-09-19T11:59:56.612683+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:33.200357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":95,"num_write":34,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'24","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.620416+0000","last_change":"2024-09-19T11:35:31.629725+0000","last_active":"2024-09-19T12:00:31.620416+0000","last_peered":"2024-09-19T12:00:31.620416+0000","last_clean":"2024-09-19T12:00:31.620416+0000","last_became_active":"2024-09-19T11:35:31.628800+0000","last_became_peered":"2024-09-19T11:35:31.628800+0000","last_unstale":"2024-09-19T12:00:31.620416+0000","last_undegraded":"2024-09-19T12:00:31.620416+0000","last_fullsized":"2024-09-19T12:00:31.620416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:24.923313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":115,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'47","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.583989+0000","last_change":"2024-09-19T11:35:33.628736+0000","last_active":"2024-09-19T11:58:06.583989+0000","last_peered":"2024-09-19T11:58:06.583989+0000","last_clean":"2024-09-19T11:58:06.583989+0000","last_became_active":"2024-09-19T11:35:33.627994+0000","last_became_peered":"2024-09-19T11:35:33.627994+0000","last_unstale":"2024-09-19T11:58:06.583989+0000","last_undegraded":"2024-09-19T11:58:06.583989+0000","last_fullsized":"2024-09-19T11:58:06.583989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:58.580017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":154,"num_write":67,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'55","reported_seq":575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.456278+0000","last_change":"2024-09-19T11:35:31.608493+0000","last_active":"2024-09-19T12:02:32.456278+0000","last_peered":"2024-09-19T12:02:32.456278+0000","last_clean":"2024-09-19T12:02:32.456278+0000","last_became_active":"2024-09-19T11:35:31.608158+0000","last_became_peered":"2024-09-19T11:35:31.608158+0000","last_unstale":"2024-09-19T12:02:32.456278+0000","last_undegraded":"2024-09-19T12:02:32.456278+0000","last_fullsized":"2024-09-19T12:02:32.456278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:19.335025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15408,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":101,"num_read_kb":661,"num_write":200,"num_write_kb":4683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'27","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.587159+0000","last_change":"2024-09-19T11:35:33.621664+0000","last_active":"2024-09-19T11:58:06.587159+0000","last_peered":"2024-09-19T11:58:06.587159+0000","last_clean":"2024-09-19T11:58:06.587159+0000","last_became_active":"2024-09-19T11:35:33.618098+0000","last_became_peered":"2024-09-19T11:35:33.618098+0000","last_unstale":"2024-09-19T11:58:06.587159+0000","last_undegraded":"2024-09-19T11:58:06.587159+0000","last_fullsized":"2024-09-19T11:58:06.587159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:51.714564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":93,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'37","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.618666+0000","last_change":"2024-09-19T11:35:31.614280+0000","last_active":"2024-09-19T12:00:31.618666+0000","last_peered":"2024-09-19T12:00:31.618666+0000","last_clean":"2024-09-19T12:00:31.618666+0000","last_became_active":"2024-09-19T11:35:31.613678+0000","last_became_peered":"2024-09-19T11:35:31.613678+0000","last_unstale":"2024-09-19T12:00:31.618666+0000","last_undegraded":"2024-09-19T12:00:31.618666+0000","last_fullsized":"2024-09-19T12:00:31.618666+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:43.000538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":12351,"num_write":133,"num_write_kb":6154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'42","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:51.978171+0000","last_change":"2024-09-19T11:35:33.614046+0000","last_active":"2024-09-19T11:58:51.978171+0000","last_peered":"2024-09-19T11:58:51.978171+0000","last_clean":"2024-09-19T11:58:51.978171+0000","last_became_active":"2024-09-19T11:35:33.613298+0000","last_became_peered":"2024-09-19T11:35:33.613298+0000","last_unstale":"2024-09-19T11:58:51.978171+0000","last_undegraded":"2024-09-19T11:58:51.978171+0000","last_fullsized":"2024-09-19T11:58:51.978171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:34.924557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":123,"num_write":79,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'21","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.298951+0000","last_change":"2024-09-19T11:35:31.610606+0000","last_active":"2024-09-19T12:00:06.298951+0000","last_peered":"2024-09-19T12:00:06.298951+0000","last_clean":"2024-09-19T12:00:06.298951+0000","last_became_active":"2024-09-19T11:35:31.608115+0000","last_became_peered":"2024-09-19T11:35:31.608115+0000","last_unstale":"2024-09-19T12:00:06.298951+0000","last_undegraded":"2024-09-19T12:00:06.298951+0000","last_fullsized":"2024-09-19T12:00:06.298951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:40.436454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079934,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":1089,"num_write":115,"num_write_kb":1059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'54","reported_seq":577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.584726+0000","last_change":"2024-09-19T11:35:33.625809+0000","last_active":"2024-09-19T11:58:06.584726+0000","last_peered":"2024-09-19T11:58:06.584726+0000","last_clean":"2024-09-19T11:58:06.584726+0000","last_became_active":"2024-09-19T11:35:33.625528+0000","last_became_peered":"2024-09-19T11:35:33.625528+0000","last_unstale":"2024-09-19T11:58:06.584726+0000","last_undegraded":"2024-09-19T11:58:06.584726+0000","last_fullsized":"2024-09-19T11:58:06.584726+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:28.944541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":230,"num_read_kb":188,"num_write":85,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'55","reported_seq":575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.620311+0000","last_change":"2024-09-19T11:35:31.620118+0000","last_active":"2024-09-19T12:00:31.620311+0000","last_peered":"2024-09-19T12:00:31.620311+0000","last_clean":"2024-09-19T12:00:31.620311+0000","last_became_active":"2024-09-19T11:35:31.618555+0000","last_became_peered":"2024-09-19T11:35:31.618555+0000","last_unstale":"2024-09-19T12:00:31.620311+0000","last_undegraded":"2024-09-19T12:00:31.620311+0000","last_fullsized":"2024-09-19T12:00:31.620311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:25.667196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11562584,"num_objects":19,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":86,"num_read_kb":29373,"num_write":171,"num_write_kb":13979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'27","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.193132+0000","last_change":"2024-09-19T11:35:33.626035+0000","last_active":"2024-09-19T12:02:33.193132+0000","last_peered":"2024-09-19T12:02:33.193132+0000","last_clean":"2024-09-19T12:02:33.193132+0000","last_became_active":"2024-09-19T11:35:33.624952+0000","last_became_peered":"2024-09-19T11:35:33.624952+0000","last_unstale":"2024-09-19T12:02:33.193132+0000","last_undegraded":"2024-09-19T12:02:33.193132+0000","last_fullsized":"2024-09-19T12:02:33.193132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:40.687504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":112,"num_write":47,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'43","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.616588+0000","last_change":"2024-09-19T11:35:31.589199+0000","last_active":"2024-09-19T12:00:31.616588+0000","last_peered":"2024-09-19T12:00:31.616588+0000","last_clean":"2024-09-19T12:00:31.616588+0000","last_became_active":"2024-09-19T11:35:31.587016+0000","last_became_peered":"2024-09-19T11:35:31.587016+0000","last_unstale":"2024-09-19T12:00:31.616588+0000","last_undegraded":"2024-09-19T12:00:31.616588+0000","last_fullsized":"2024-09-19T12:00:31.616588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:43.361105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145912,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":83,"num_read_kb":3127,"num_write":126,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"253'2","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.811093+0000","last_change":"2024-09-19T11:35:33.614181+0000","last_active":"2024-09-19T12:00:36.811093+0000","last_peered":"2024-09-19T12:00:36.811093+0000","last_clean":"2024-09-19T12:00:36.811093+0000","last_became_active":"2024-09-19T11:35:33.612338+0000","last_became_peered":"2024-09-19T11:35:33.612338+0000","last_unstale":"2024-09-19T12:00:36.811093+0000","last_undegraded":"2024-09-19T12:00:36.811093+0000","last_fullsized":"2024-09-19T12:00:36.811093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:01.117001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'29","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.620229+0000","last_change":"2024-09-19T11:35:31.621888+0000","last_active":"2024-09-19T12:00:31.620229+0000","last_peered":"2024-09-19T12:00:31.620229+0000","last_clean":"2024-09-19T12:00:31.620229+0000","last_became_active":"2024-09-19T11:35:31.619730+0000","last_became_peered":"2024-09-19T11:35:31.619730+0000","last_unstale":"2024-09-19T12:00:31.620229+0000","last_undegraded":"2024-09-19T12:00:31.620229+0000","last_fullsized":"2024-09-19T12:00:31.620229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:41.738718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":104,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'48","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618078+0000","last_change":"2024-09-19T11:35:33.612223+0000","last_active":"2024-09-19T12:00:36.618078+0000","last_peered":"2024-09-19T12:00:36.618078+0000","last_clean":"2024-09-19T12:00:36.618078+0000","last_became_active":"2024-09-19T11:35:33.611495+0000","last_became_peered":"2024-09-19T11:35:33.611495+0000","last_unstale":"2024-09-19T12:00:36.618078+0000","last_undegraded":"2024-09-19T12:00:36.618078+0000","last_fullsized":"2024-09-19T12:00:36.618078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:50.704291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":135,"num_write":76,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'29","reported_seq":540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.612628+0000","last_change":"2024-09-19T11:35:31.594461+0000","last_active":"2024-09-19T12:00:31.612628+0000","last_peered":"2024-09-19T12:00:31.612628+0000","last_clean":"2024-09-19T12:00:31.612628+0000","last_became_active":"2024-09-19T11:35:31.593765+0000","last_became_peered":"2024-09-19T11:35:31.593765+0000","last_unstale":"2024-09-19T12:00:31.612628+0000","last_undegraded":"2024-09-19T12:00:31.612628+0000","last_fullsized":"2024-09-19T12:00:31.612628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:15.207126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2235,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":48,"num_read_kb":45,"num_write":108,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'46","reported_seq":564,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.197761+0000","last_change":"2024-09-19T11:35:33.606318+0000","last_active":"2024-09-19T12:02:33.197761+0000","last_peered":"2024-09-19T12:02:33.197761+0000","last_clean":"2024-09-19T12:02:33.197761+0000","last_became_active":"2024-09-19T11:35:33.604505+0000","last_became_peered":"2024-09-19T11:35:33.604505+0000","last_unstale":"2024-09-19T12:02:33.197761+0000","last_undegraded":"2024-09-19T12:02:33.197761+0000","last_fullsized":"2024-09-19T12:02:33.197761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:56.257217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":158,"num_write":84,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'76","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.163064+0000","last_change":"2024-09-19T11:35:33.608564+0000","last_active":"2024-09-19T12:02:33.163064+0000","last_peered":"2024-09-19T12:02:33.163064+0000","last_clean":"2024-09-19T12:02:33.163064+0000","last_became_active":"2024-09-19T11:35:33.607843+0000","last_became_peered":"2024-09-19T11:35:33.607843+0000","last_unstale":"2024-09-19T12:02:33.163064+0000","last_undegraded":"2024-09-19T12:02:33.163064+0000","last_fullsized":"2024-09-19T12:02:33.163064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:40.705119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":241,"num_write":113,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'35","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.125233+0000","last_change":"2024-09-19T11:36:06.682019+0000","last_active":"2024-09-19T12:00:41.125233+0000","last_peered":"2024-09-19T12:00:41.125233+0000","last_clean":"2024-09-19T12:00:41.125233+0000","last_became_active":"2024-09-19T11:36:06.680794+0000","last_became_peered":"2024-09-19T11:36:06.680794+0000","last_unstale":"2024-09-19T12:00:41.125233+0000","last_undegraded":"2024-09-19T12:00:41.125233+0000","last_fullsized":"2024-09-19T12:00:41.125233+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:15.316832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8321,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":35,"num_read_kb":3338,"num_write":145,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,1],"acting":[2,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599773+0000","last_change":"2024-09-19T11:35:33.622666+0000","last_active":"2024-09-19T11:58:56.599773+0000","last_peered":"2024-09-19T11:58:56.599773+0000","last_clean":"2024-09-19T11:58:56.599773+0000","last_became_active":"2024-09-19T11:35:33.621522+0000","last_became_peered":"2024-09-19T11:35:33.621522+0000","last_unstale":"2024-09-19T11:58:56.599773+0000","last_undegraded":"2024-09-19T11:58:56.599773+0000","last_fullsized":"2024-09-19T11:58:56.599773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:16.770624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'33","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.606056+0000","last_change":"2024-09-19T11:35:31.612184+0000","last_active":"2024-09-19T11:59:41.606056+0000","last_peered":"2024-09-19T11:59:41.606056+0000","last_clean":"2024-09-19T11:59:41.606056+0000","last_became_active":"2024-09-19T11:35:31.598016+0000","last_became_peered":"2024-09-19T11:35:31.598016+0000","last_unstale":"2024-09-19T11:59:41.606056+0000","last_undegraded":"2024-09-19T11:59:41.606056+0000","last_fullsized":"2024-09-19T11:59:41.606056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:59.949408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159847,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":97,"num_read_kb":2182,"num_write":159,"num_write_kb":2115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'48","reported_seq":554,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.596523+0000","last_change":"2024-09-19T11:35:33.612612+0000","last_active":"2024-09-19T11:59:01.596523+0000","last_peered":"2024-09-19T11:59:01.596523+0000","last_clean":"2024-09-19T11:59:01.596523+0000","last_became_active":"2024-09-19T11:35:33.610072+0000","last_became_peered":"2024-09-19T11:35:33.610072+0000","last_unstale":"2024-09-19T11:59:01.596523+0000","last_undegraded":"2024-09-19T11:59:01.596523+0000","last_fullsized":"2024-09-19T11:59:01.596523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:22.254214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":149,"num_write":86,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'31","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.587974+0000","last_change":"2024-09-19T11:35:31.615091+0000","last_active":"2024-09-19T12:02:32.587974+0000","last_peered":"2024-09-19T12:02:32.587974+0000","last_clean":"2024-09-19T12:02:32.587974+0000","last_became_active":"2024-09-19T11:35:31.614263+0000","last_became_peered":"2024-09-19T11:35:31.614263+0000","last_unstale":"2024-09-19T12:02:32.587974+0000","last_undegraded":"2024-09-19T12:02:32.587974+0000","last_fullsized":"2024-09-19T12:02:32.587974+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:03.358145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242995,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":5162,"num_write":123,"num_write_kb":10269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'149","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.050113+0000","last_change":"2024-09-19T11:35:33.611574+0000","last_active":"2024-09-19T12:02:33.050113+0000","last_peered":"2024-09-19T12:02:33.050113+0000","last_clean":"2024-09-19T12:02:33.050113+0000","last_became_active":"2024-09-19T11:35:33.611240+0000","last_became_peered":"2024-09-19T11:35:33.611240+0000","last_unstale":"2024-09-19T12:02:33.050113+0000","last_undegraded":"2024-09-19T12:02:33.050113+0000","last_fullsized":"2024-09-19T12:02:33.050113+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:58.616861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":454,"num_write":234,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'29","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.798430+0000","last_change":"2024-09-19T11:35:31.592787+0000","last_active":"2024-09-19T11:59:41.798430+0000","last_peered":"2024-09-19T11:59:41.798430+0000","last_clean":"2024-09-19T11:59:41.798430+0000","last_became_active":"2024-09-19T11:35:31.591932+0000","last_became_peered":"2024-09-19T11:35:31.591932+0000","last_unstale":"2024-09-19T11:59:41.798430+0000","last_undegraded":"2024-09-19T11:59:41.798430+0000","last_fullsized":"2024-09-19T11:59:41.798430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:16.215077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6295699,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":43,"num_read_kb":7804,"num_write":98,"num_write_kb":7776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'26","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.594514+0000","last_change":"2024-09-19T11:35:33.626081+0000","last_active":"2024-09-19T11:59:46.594514+0000","last_peered":"2024-09-19T11:59:46.594514+0000","last_clean":"2024-09-19T11:59:46.594514+0000","last_became_active":"2024-09-19T11:35:33.625698+0000","last_became_peered":"2024-09-19T11:35:33.625698+0000","last_unstale":"2024-09-19T11:59:46.594514+0000","last_undegraded":"2024-09-19T11:59:46.594514+0000","last_fullsized":"2024-09-19T11:59:46.594514+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:25.969110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":73,"num_write":57,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'22","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.601422+0000","last_change":"2024-09-19T11:35:31.601399+0000","last_active":"2024-09-19T11:59:41.601422+0000","last_peered":"2024-09-19T11:59:41.601422+0000","last_clean":"2024-09-19T11:59:41.601422+0000","last_became_active":"2024-09-19T11:35:31.600939+0000","last_became_peered":"2024-09-19T11:35:31.600939+0000","last_unstale":"2024-09-19T11:59:41.601422+0000","last_undegraded":"2024-09-19T11:59:41.601422+0000","last_fullsized":"2024-09-19T11:59:41.601422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:35.527377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291500,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":6211,"num_write":100,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.799672+0000","last_change":"2024-09-19T11:35:33.605918+0000","last_active":"2024-09-19T11:59:46.799672+0000","last_peered":"2024-09-19T11:59:46.799672+0000","last_clean":"2024-09-19T11:59:46.799672+0000","last_became_active":"2024-09-19T11:35:33.605215+0000","last_became_peered":"2024-09-19T11:35:33.605215+0000","last_unstale":"2024-09-19T11:59:46.799672+0000","last_undegraded":"2024-09-19T11:59:46.799672+0000","last_fullsized":"2024-09-19T11:59:46.799672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:06.551820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'42","reported_seq":567,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.596005+0000","last_change":"2024-09-19T11:35:31.597393+0000","last_active":"2024-09-19T11:58:56.596005+0000","last_peered":"2024-09-19T11:58:56.596005+0000","last_clean":"2024-09-19T11:58:56.596005+0000","last_became_active":"2024-09-19T11:35:31.597035+0000","last_became_peered":"2024-09-19T11:35:31.597035+0000","last_unstale":"2024-09-19T11:58:56.596005+0000","last_undegraded":"2024-09-19T11:58:56.596005+0000","last_fullsized":"2024-09-19T11:58:56.596005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:38.704431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485830,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":25668,"num_write":122,"num_write_kb":10245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'16","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.800682+0000","last_change":"2024-09-19T11:35:41.674446+0000","last_active":"2024-09-19T11:59:51.800682+0000","last_peered":"2024-09-19T11:59:51.800682+0000","last_clean":"2024-09-19T11:59:51.800682+0000","last_became_active":"2024-09-19T11:35:41.673420+0000","last_became_peered":"2024-09-19T11:35:41.673420+0000","last_unstale":"2024-09-19T11:59:51.800682+0000","last_undegraded":"2024-09-19T11:59:51.800682+0000","last_fullsized":"2024-09-19T11:59:51.800682+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:40.611862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":47,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.592064+0000","last_change":"2024-09-19T11:35:33.613895+0000","last_active":"2024-09-19T11:59:01.592064+0000","last_peered":"2024-09-19T11:59:01.592064+0000","last_clean":"2024-09-19T11:59:01.592064+0000","last_became_active":"2024-09-19T11:35:33.613437+0000","last_became_peered":"2024-09-19T11:35:33.613437+0000","last_unstale":"2024-09-19T11:59:01.592064+0000","last_undegraded":"2024-09-19T11:59:01.592064+0000","last_fullsized":"2024-09-19T11:59:01.592064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:34.414349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'46","reported_seq":559,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:38.945035+0000","last_change":"2024-09-19T11:35:31.600183+0000","last_active":"2024-09-19T12:00:38.945035+0000","last_peered":"2024-09-19T12:00:38.945035+0000","last_clean":"2024-09-19T12:00:38.945035+0000","last_became_active":"2024-09-19T11:35:31.599314+0000","last_became_peered":"2024-09-19T11:35:31.599314+0000","last_unstale":"2024-09-19T12:00:38.945035+0000","last_undegraded":"2024-09-19T12:00:38.945035+0000","last_fullsized":"2024-09-19T12:00:38.945035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:43.331402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231,"num_objects":19,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":83,"num_read_kb":1688,"num_write":186,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.606494+0000","last_change":"2024-09-19T11:35:35.617353+0000","last_active":"2024-09-19T11:59:46.606494+0000","last_peered":"2024-09-19T11:59:46.606494+0000","last_clean":"2024-09-19T11:59:46.606494+0000","last_became_active":"2024-09-19T11:35:35.616351+0000","last_became_peered":"2024-09-19T11:35:35.616351+0000","last_unstale":"2024-09-19T11:59:46.606494+0000","last_undegraded":"2024-09-19T11:59:46.606494+0000","last_fullsized":"2024-09-19T11:59:46.606494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:15.938562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'119","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.348420+0000","last_change":"2024-09-19T11:35:37.651194+0000","last_active":"2024-09-19T12:00:06.348420+0000","last_peered":"2024-09-19T12:00:06.348420+0000","last_clean":"2024-09-19T12:00:06.348420+0000","last_became_active":"2024-09-19T11:35:37.650685+0000","last_became_peered":"2024-09-19T11:35:37.650685+0000","last_unstale":"2024-09-19T12:00:06.348420+0000","last_undegraded":"2024-09-19T12:00:06.348420+0000","last_fullsized":"2024-09-19T12:00:06.348420+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:53.348943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8728,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":164,"num_read_kb":203,"num_write":116,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611862+0000","last_change":"2024-09-19T11:35:39.676563+0000","last_active":"2024-09-19T11:59:51.611862+0000","last_peered":"2024-09-19T11:59:51.611862+0000","last_clean":"2024-09-19T11:59:51.611862+0000","last_became_active":"2024-09-19T11:35:39.676033+0000","last_became_peered":"2024-09-19T11:35:39.676033+0000","last_unstale":"2024-09-19T11:59:51.611862+0000","last_undegraded":"2024-09-19T11:59:51.611862+0000","last_fullsized":"2024-09-19T11:59:51.611862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:44.059170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'15","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.608623+0000","last_change":"2024-09-19T11:35:41.682580+0000","last_active":"2024-09-19T11:59:56.608623+0000","last_peered":"2024-09-19T11:59:56.608623+0000","last_clean":"2024-09-19T11:59:56.608623+0000","last_became_active":"2024-09-19T11:35:41.680497+0000","last_became_peered":"2024-09-19T11:35:41.680497+0000","last_unstale":"2024-09-19T11:59:56.608623+0000","last_undegraded":"2024-09-19T11:59:56.608623+0000","last_fullsized":"2024-09-19T11:59:56.608623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:55.800690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":49,"num_write":53,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'2","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:11.640032+0000","last_change":"2024-09-19T11:35:33.617104+0000","last_active":"2024-09-19T12:02:11.640032+0000","last_peered":"2024-09-19T12:02:11.640032+0000","last_clean":"2024-09-19T12:02:11.640032+0000","last_became_active":"2024-09-19T11:35:33.615138+0000","last_became_peered":"2024-09-19T11:35:33.615138+0000","last_unstale":"2024-09-19T12:02:11.640032+0000","last_undegraded":"2024-09-19T12:02:11.640032+0000","last_fullsized":"2024-09-19T12:02:11.640032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:22.788235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'28","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:11.627448+0000","last_change":"2024-09-19T11:35:31.612888+0000","last_active":"2024-09-19T12:01:11.627448+0000","last_peered":"2024-09-19T12:01:11.627448+0000","last_clean":"2024-09-19T12:01:11.627448+0000","last_became_active":"2024-09-19T11:35:31.612424+0000","last_became_peered":"2024-09-19T11:35:31.612424+0000","last_unstale":"2024-09-19T12:01:11.627448+0000","last_undegraded":"2024-09-19T12:01:11.627448+0000","last_fullsized":"2024-09-19T12:01:11.627448+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:08.302859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":34,"num_read_kb":5150,"num_write":97,"num_write_kb":10271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.592095+0000","last_change":"2024-09-19T11:35:35.627312+0000","last_active":"2024-09-19T11:59:01.592095+0000","last_peered":"2024-09-19T11:59:01.592095+0000","last_clean":"2024-09-19T11:59:01.592095+0000","last_became_active":"2024-09-19T11:35:35.626979+0000","last_became_peered":"2024-09-19T11:35:35.626979+0000","last_unstale":"2024-09-19T11:59:01.592095+0000","last_undegraded":"2024-09-19T11:59:01.592095+0000","last_fullsized":"2024-09-19T11:59:01.592095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:42.288842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'48","reported_seq":554,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:16.833482+0000","last_change":"2024-09-19T11:35:37.630326+0000","last_active":"2024-09-19T12:02:16.833482+0000","last_peered":"2024-09-19T12:02:16.833482+0000","last_clean":"2024-09-19T12:02:16.833482+0000","last_became_active":"2024-09-19T11:35:37.624916+0000","last_became_peered":"2024-09-19T11:35:37.624916+0000","last_unstale":"2024-09-19T12:02:16.833482+0000","last_undegraded":"2024-09-19T12:02:16.833482+0000","last_fullsized":"2024-09-19T12:02:16.833482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:40.009132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":68,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.800889+0000","last_change":"2024-09-19T11:35:39.670488+0000","last_active":"2024-09-19T11:59:51.800889+0000","last_peered":"2024-09-19T11:59:51.800889+0000","last_clean":"2024-09-19T11:59:51.800889+0000","last_became_active":"2024-09-19T11:35:39.669732+0000","last_became_peered":"2024-09-19T11:35:39.669732+0000","last_unstale":"2024-09-19T11:59:51.800889+0000","last_undegraded":"2024-09-19T11:59:51.800889+0000","last_fullsized":"2024-09-19T11:59:51.800889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:15.697637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'26","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:18.515668+0000","last_change":"2024-09-19T11:35:41.695806+0000","last_active":"2024-09-19T11:58:18.515668+0000","last_peered":"2024-09-19T11:58:18.515668+0000","last_clean":"2024-09-19T11:58:18.515668+0000","last_became_active":"2024-09-19T11:35:41.693197+0000","last_became_peered":"2024-09-19T11:35:41.693197+0000","last_unstale":"2024-09-19T11:58:18.515668+0000","last_undegraded":"2024-09-19T11:58:18.515668+0000","last_fullsized":"2024-09-19T11:58:18.515668+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:38:56.811510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":93,"num_write":83,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'5","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.607864+0000","last_change":"2024-09-19T11:35:33.626048+0000","last_active":"2024-09-19T11:59:46.607864+0000","last_peered":"2024-09-19T11:59:46.607864+0000","last_clean":"2024-09-19T11:59:46.607864+0000","last_became_active":"2024-09-19T11:35:33.625606+0000","last_became_peered":"2024-09-19T11:35:33.625606+0000","last_unstale":"2024-09-19T11:59:46.607864+0000","last_undegraded":"2024-09-19T11:59:46.607864+0000","last_fullsized":"2024-09-19T11:59:46.607864+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:11.107345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'38","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.707563+0000","last_change":"2024-09-19T11:35:31.622618+0000","last_active":"2024-09-19T12:02:17.707563+0000","last_peered":"2024-09-19T12:02:17.707563+0000","last_clean":"2024-09-19T12:02:17.707563+0000","last_became_active":"2024-09-19T11:35:31.621190+0000","last_became_peered":"2024-09-19T11:35:31.621190+0000","last_unstale":"2024-09-19T12:02:17.707563+0000","last_undegraded":"2024-09-19T12:02:17.707563+0000","last_fullsized":"2024-09-19T12:02:17.707563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:14.420143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151900,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":54,"num_read_kb":198,"num_write":153,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"38'3","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.705500+0000","last_change":"2024-09-19T11:35:35.624498+0000","last_active":"2024-09-19T12:02:32.705500+0000","last_peered":"2024-09-19T12:02:32.705500+0000","last_clean":"2024-09-19T12:02:32.705500+0000","last_became_active":"2024-09-19T11:35:35.623997+0000","last_became_peered":"2024-09-19T11:35:35.623997+0000","last_unstale":"2024-09-19T12:02:32.705500+0000","last_undegraded":"2024-09-19T12:02:32.705500+0000","last_fullsized":"2024-09-19T12:02:32.705500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:39.064327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":623,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'64","reported_seq":579,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:26.614835+0000","last_change":"2024-09-19T11:35:37.628761+0000","last_active":"2024-09-19T12:01:26.614835+0000","last_peered":"2024-09-19T12:01:26.614835+0000","last_clean":"2024-09-19T12:01:26.614835+0000","last_became_active":"2024-09-19T11:35:37.628124+0000","last_became_peered":"2024-09-19T11:35:37.628124+0000","last_unstale":"2024-09-19T12:01:26.614835+0000","last_undegraded":"2024-09-19T12:01:26.614835+0000","last_fullsized":"2024-09-19T12:01:26.614835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:14.165078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'612","reported_seq":1501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.004966+0000","last_change":"2024-09-19T11:35:39.682448+0000","last_active":"2024-09-19T12:02:33.004966+0000","last_peered":"2024-09-19T12:02:33.004966+0000","last_clean":"2024-09-19T12:02:33.004966+0000","last_became_active":"2024-09-19T11:35:39.681867+0000","last_became_peered":"2024-09-19T11:35:39.681867+0000","last_unstale":"2024-09-19T12:02:33.004966+0000","last_undegraded":"2024-09-19T12:02:33.004966+0000","last_fullsized":"2024-09-19T12:02:33.004966+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:29.322118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'20","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:32.884237+0000","last_change":"2024-09-19T11:35:41.677700+0000","last_active":"2024-09-19T11:59:32.884237+0000","last_peered":"2024-09-19T11:59:32.884237+0000","last_clean":"2024-09-19T11:59:32.884237+0000","last_became_active":"2024-09-19T11:35:41.676988+0000","last_became_peered":"2024-09-19T11:35:41.676988+0000","last_unstale":"2024-09-19T11:59:32.884237+0000","last_undegraded":"2024-09-19T11:59:32.884237+0000","last_fullsized":"2024-09-19T11:59:32.884237+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:02.366492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'23","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.177039+0000","last_change":"2024-09-19T11:35:33.614935+0000","last_active":"2024-09-19T12:02:33.177039+0000","last_peered":"2024-09-19T12:02:33.177039+0000","last_clean":"2024-09-19T12:02:33.177039+0000","last_became_active":"2024-09-19T11:35:33.614168+0000","last_became_peered":"2024-09-19T11:35:33.614168+0000","last_unstale":"2024-09-19T12:02:33.177039+0000","last_undegraded":"2024-09-19T12:02:33.177039+0000","last_fullsized":"2024-09-19T12:02:33.177039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:40.524246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":86,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'43","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:32.856606+0000","last_change":"2024-09-19T11:35:31.611559+0000","last_active":"2024-09-19T11:59:32.856606+0000","last_peered":"2024-09-19T11:59:32.856606+0000","last_clean":"2024-09-19T11:59:32.856606+0000","last_became_active":"2024-09-19T11:35:31.610808+0000","last_became_peered":"2024-09-19T11:35:31.610808+0000","last_unstale":"2024-09-19T11:59:32.856606+0000","last_undegraded":"2024-09-19T11:59:32.856606+0000","last_fullsized":"2024-09-19T11:59:32.856606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:46.561986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7371487,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":100,"num_read_kb":7272,"num_write":179,"num_write_kb":7210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.606549+0000","last_change":"2024-09-19T11:35:35.624368+0000","last_active":"2024-09-19T11:59:46.606549+0000","last_peered":"2024-09-19T11:59:46.606549+0000","last_clean":"2024-09-19T11:59:46.606549+0000","last_became_active":"2024-09-19T11:35:35.623608+0000","last_became_peered":"2024-09-19T11:35:35.623608+0000","last_unstale":"2024-09-19T11:59:46.606549+0000","last_undegraded":"2024-09-19T11:59:46.606549+0000","last_fullsized":"2024-09-19T11:59:46.606549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:32.921728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'63","reported_seq":558,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611752+0000","last_change":"2024-09-19T11:35:37.646654+0000","last_active":"2024-09-19T11:59:51.611752+0000","last_peered":"2024-09-19T11:59:51.611752+0000","last_clean":"2024-09-19T11:59:51.611752+0000","last_became_active":"2024-09-19T11:35:37.645933+0000","last_became_peered":"2024-09-19T11:35:37.645933+0000","last_unstale":"2024-09-19T11:59:51.611752+0000","last_undegraded":"2024-09-19T11:59:51.611752+0000","last_fullsized":"2024-09-19T11:59:51.611752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:49.367677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9468,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":111,"num_write":62,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'618","reported_seq":1487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.017659+0000","last_change":"2024-09-19T11:35:39.655107+0000","last_active":"2024-09-19T12:02:33.017659+0000","last_peered":"2024-09-19T12:02:33.017659+0000","last_clean":"2024-09-19T12:02:33.017659+0000","last_became_active":"2024-09-19T11:35:39.654205+0000","last_became_peered":"2024-09-19T11:35:39.654205+0000","last_unstale":"2024-09-19T12:02:33.017659+0000","last_undegraded":"2024-09-19T12:02:33.017659+0000","last_fullsized":"2024-09-19T12:02:33.017659+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:09.266023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'23","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.173407+0000","last_change":"2024-09-19T11:35:33.625607+0000","last_active":"2024-09-19T12:02:33.173407+0000","last_peered":"2024-09-19T12:02:33.173407+0000","last_clean":"2024-09-19T12:02:33.173407+0000","last_became_active":"2024-09-19T11:35:33.624883+0000","last_became_peered":"2024-09-19T11:35:33.624883+0000","last_unstale":"2024-09-19T12:02:33.173407+0000","last_undegraded":"2024-09-19T12:02:33.173407+0000","last_fullsized":"2024-09-19T12:02:33.173407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:38.184558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":86,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'29","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.618229+0000","last_change":"2024-09-19T11:35:31.610576+0000","last_active":"2024-09-19T12:00:21.618229+0000","last_peered":"2024-09-19T12:00:21.618229+0000","last_clean":"2024-09-19T12:00:21.618229+0000","last_became_active":"2024-09-19T11:35:31.609658+0000","last_became_peered":"2024-09-19T11:35:31.609658+0000","last_unstale":"2024-09-19T12:00:21.618229+0000","last_undegraded":"2024-09-19T12:00:21.618229+0000","last_fullsized":"2024-09-19T12:00:21.618229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:27.502371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":46,"num_read_kb":38,"num_write":98,"num_write_kb":5152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.606363+0000","last_change":"2024-09-19T11:35:35.622091+0000","last_active":"2024-09-19T11:59:26.606363+0000","last_peered":"2024-09-19T11:59:26.606363+0000","last_clean":"2024-09-19T11:59:26.606363+0000","last_became_active":"2024-09-19T11:35:35.621170+0000","last_became_peered":"2024-09-19T11:35:35.621170+0000","last_unstale":"2024-09-19T11:59:26.606363+0000","last_undegraded":"2024-09-19T11:59:26.606363+0000","last_fullsized":"2024-09-19T11:59:26.606363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:48.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'117","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.603982+0000","last_change":"2024-09-19T11:35:37.636324+0000","last_active":"2024-09-19T11:59:36.603982+0000","last_peered":"2024-09-19T11:59:36.603982+0000","last_clean":"2024-09-19T11:59:36.603982+0000","last_became_active":"2024-09-19T11:35:37.635359+0000","last_became_peered":"2024-09-19T11:35:37.635359+0000","last_unstale":"2024-09-19T11:59:36.603982+0000","last_undegraded":"2024-09-19T11:59:36.603982+0000","last_fullsized":"2024-09-19T11:59:36.603982+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:43.517566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9704,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":167,"num_read_kb":202,"num_write":118,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603640+0000","last_change":"2024-09-19T11:35:39.683859+0000","last_active":"2024-09-19T12:00:26.603640+0000","last_peered":"2024-09-19T12:00:26.603640+0000","last_clean":"2024-09-19T12:00:26.603640+0000","last_became_active":"2024-09-19T11:35:39.683300+0000","last_became_peered":"2024-09-19T11:35:39.683300+0000","last_unstale":"2024-09-19T12:00:26.603640+0000","last_undegraded":"2024-09-19T12:00:26.603640+0000","last_fullsized":"2024-09-19T12:00:26.603640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:56.978681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'6","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619273+0000","last_change":"2024-09-19T11:35:41.685251+0000","last_active":"2024-09-19T12:00:41.619273+0000","last_peered":"2024-09-19T12:00:41.619273+0000","last_clean":"2024-09-19T12:00:41.619273+0000","last_became_active":"2024-09-19T11:35:41.684698+0000","last_became_peered":"2024-09-19T11:35:41.684698+0000","last_unstale":"2024-09-19T12:00:41.619273+0000","last_undegraded":"2024-09-19T12:00:41.619273+0000","last_fullsized":"2024-09-19T12:00:41.619273+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:43.679226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'9","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:36.824293+0000","last_change":"2024-09-19T11:35:33.618465+0000","last_active":"2024-09-19T12:01:36.824293+0000","last_peered":"2024-09-19T12:01:36.824293+0000","last_clean":"2024-09-19T12:01:36.824293+0000","last_became_active":"2024-09-19T11:35:33.617778+0000","last_became_peered":"2024-09-19T11:35:33.617778+0000","last_unstale":"2024-09-19T12:01:36.824293+0000","last_undegraded":"2024-09-19T12:01:36.824293+0000","last_fullsized":"2024-09-19T12:01:36.824293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:44.417211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":12,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'53","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.617110+0000","last_change":"2024-09-19T11:35:31.609984+0000","last_active":"2024-09-19T12:00:16.617110+0000","last_peered":"2024-09-19T12:00:16.617110+0000","last_clean":"2024-09-19T12:00:16.617110+0000","last_became_active":"2024-09-19T11:35:31.609243+0000","last_became_peered":"2024-09-19T11:35:31.609243+0000","last_unstale":"2024-09-19T12:00:16.617110+0000","last_undegraded":"2024-09-19T12:00:16.617110+0000","last_fullsized":"2024-09-19T12:00:16.617110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:56.221017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6330583,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":92,"num_read_kb":6258,"num_write":250,"num_write_kb":6195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.590189+0000","last_change":"2024-09-19T11:35:35.618693+0000","last_active":"2024-09-19T11:59:26.590189+0000","last_peered":"2024-09-19T11:59:26.590189+0000","last_clean":"2024-09-19T11:59:26.590189+0000","last_became_active":"2024-09-19T11:35:35.617934+0000","last_became_peered":"2024-09-19T11:35:35.617934+0000","last_unstale":"2024-09-19T11:59:26.590189+0000","last_undegraded":"2024-09-19T11:59:26.590189+0000","last_fullsized":"2024-09-19T11:59:26.590189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:47.062252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'63","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.798286+0000","last_change":"2024-09-19T11:35:37.643864+0000","last_active":"2024-09-19T12:02:17.798286+0000","last_peered":"2024-09-19T12:02:17.798286+0000","last_clean":"2024-09-19T12:02:17.798286+0000","last_became_active":"2024-09-19T11:35:37.643236+0000","last_became_peered":"2024-09-19T11:35:37.643236+0000","last_unstale":"2024-09-19T12:02:17.798286+0000","last_undegraded":"2024-09-19T12:02:17.798286+0000","last_fullsized":"2024-09-19T12:02:17.798286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:47.647100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12813,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":92,"num_read_kb":161,"num_write":74,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.600120+0000","last_change":"2024-09-19T11:35:39.653781+0000","last_active":"2024-09-19T11:59:36.600120+0000","last_peered":"2024-09-19T11:59:36.600120+0000","last_clean":"2024-09-19T11:59:36.600120+0000","last_became_active":"2024-09-19T11:35:39.652920+0000","last_became_peered":"2024-09-19T11:35:39.652920+0000","last_unstale":"2024-09-19T11:59:36.600120+0000","last_undegraded":"2024-09-19T11:59:36.600120+0000","last_fullsized":"2024-09-19T11:59:36.600120+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:26.583277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'12","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:46.620891+0000","last_change":"2024-09-19T11:35:41.678791+0000","last_active":"2024-09-19T12:00:46.620891+0000","last_peered":"2024-09-19T12:00:46.620891+0000","last_clean":"2024-09-19T12:00:46.620891+0000","last_became_active":"2024-09-19T11:35:41.678055+0000","last_became_peered":"2024-09-19T11:35:41.678055+0000","last_unstale":"2024-09-19T12:00:46.620891+0000","last_undegraded":"2024-09-19T12:00:46.620891+0000","last_fullsized":"2024-09-19T12:00:46.620891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:27.826190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":59,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'46","reported_seq":556,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.008451+0000","last_change":"2024-09-19T11:35:33.624918+0000","last_active":"2024-09-19T12:02:32.008451+0000","last_peered":"2024-09-19T12:02:32.008451+0000","last_clean":"2024-09-19T12:02:32.008451+0000","last_became_active":"2024-09-19T11:35:33.624015+0000","last_became_peered":"2024-09-19T11:35:33.624015+0000","last_unstale":"2024-09-19T12:02:32.008451+0000","last_undegraded":"2024-09-19T12:02:32.008451+0000","last_fullsized":"2024-09-19T12:02:32.008451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:06.414742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":170,"num_write":76,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'48","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.617053+0000","last_change":"2024-09-19T11:35:31.627788+0000","last_active":"2024-09-19T12:00:16.617053+0000","last_peered":"2024-09-19T12:00:16.617053+0000","last_clean":"2024-09-19T12:00:16.617053+0000","last_became_active":"2024-09-19T11:35:31.627232+0000","last_became_peered":"2024-09-19T11:35:31.627232+0000","last_unstale":"2024-09-19T12:00:16.617053+0000","last_undegraded":"2024-09-19T12:00:16.617053+0000","last_fullsized":"2024-09-19T12:00:16.617053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:49.266566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1326257,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":106,"num_read_kb":6226,"num_write":203,"num_write_kb":11300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.601938+0000","last_change":"2024-09-19T11:35:35.624395+0000","last_active":"2024-09-19T12:00:21.601938+0000","last_peered":"2024-09-19T12:00:21.601938+0000","last_clean":"2024-09-19T12:00:21.601938+0000","last_became_active":"2024-09-19T11:35:35.623852+0000","last_became_peered":"2024-09-19T11:35:35.623852+0000","last_unstale":"2024-09-19T12:00:21.601938+0000","last_undegraded":"2024-09-19T12:00:21.601938+0000","last_fullsized":"2024-09-19T12:00:21.601938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:40.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'72","reported_seq":577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:41.635724+0000","last_change":"2024-09-19T11:35:37.641622+0000","last_active":"2024-09-19T12:01:41.635724+0000","last_peered":"2024-09-19T12:01:41.635724+0000","last_clean":"2024-09-19T12:01:41.635724+0000","last_became_active":"2024-09-19T11:35:37.640906+0000","last_became_peered":"2024-09-19T11:35:37.640906+0000","last_unstale":"2024-09-19T12:01:41.635724+0000","last_undegraded":"2024-09-19T12:01:41.635724+0000","last_fullsized":"2024-09-19T12:01:41.635724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:36.736085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8959,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":94,"num_read_kb":121,"num_write":68,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'612","reported_seq":1452,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.021235+0000","last_change":"2024-09-19T11:35:39.673666+0000","last_active":"2024-09-19T12:02:33.021235+0000","last_peered":"2024-09-19T12:02:33.021235+0000","last_clean":"2024-09-19T12:02:33.021235+0000","last_became_active":"2024-09-19T11:35:39.672054+0000","last_became_peered":"2024-09-19T11:35:39.672054+0000","last_unstale":"2024-09-19T12:02:33.021235+0000","last_undegraded":"2024-09-19T12:02:33.021235+0000","last_fullsized":"2024-09-19T12:02:33.021235+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:26.938497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'4","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.604432+0000","last_change":"2024-09-19T11:35:41.696920+0000","last_active":"2024-09-19T11:59:31.604432+0000","last_peered":"2024-09-19T11:59:31.604432+0000","last_clean":"2024-09-19T11:59:31.604432+0000","last_became_active":"2024-09-19T11:35:41.693623+0000","last_became_peered":"2024-09-19T11:35:41.693623+0000","last_unstale":"2024-09-19T11:59:31.604432+0000","last_undegraded":"2024-09-19T11:59:31.604432+0000","last_fullsized":"2024-09-19T11:59:31.604432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:36:17.971489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'3","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.616177+0000","last_change":"2024-09-19T11:35:33.620540+0000","last_active":"2024-09-19T12:00:21.616177+0000","last_peered":"2024-09-19T12:00:21.616177+0000","last_clean":"2024-09-19T12:00:21.616177+0000","last_became_active":"2024-09-19T11:35:33.620252+0000","last_became_peered":"2024-09-19T11:35:33.620252+0000","last_unstale":"2024-09-19T12:00:21.616177+0000","last_undegraded":"2024-09-19T12:00:21.616177+0000","last_fullsized":"2024-09-19T12:00:21.616177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:59.675080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'24","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.528130+0000","last_change":"2024-09-19T11:35:31.606672+0000","last_active":"2024-09-19T12:02:32.528130+0000","last_peered":"2024-09-19T12:02:32.528130+0000","last_clean":"2024-09-19T12:02:32.528130+0000","last_became_active":"2024-09-19T11:35:31.606137+0000","last_became_peered":"2024-09-19T11:35:31.606137+0000","last_unstale":"2024-09-19T12:02:32.528130+0000","last_undegraded":"2024-09-19T12:02:32.528130+0000","last_fullsized":"2024-09-19T12:02:32.528130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:46.025619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":95,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.591409+0000","last_change":"2024-09-19T11:35:35.620661+0000","last_active":"2024-09-19T11:59:31.591409+0000","last_peered":"2024-09-19T11:59:31.591409+0000","last_clean":"2024-09-19T11:59:31.591409+0000","last_became_active":"2024-09-19T11:35:35.619995+0000","last_became_peered":"2024-09-19T11:35:35.619995+0000","last_unstale":"2024-09-19T11:59:31.591409+0000","last_undegraded":"2024-09-19T11:59:31.591409+0000","last_fullsized":"2024-09-19T11:59:31.591409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:20.831305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'91","reported_seq":595,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:41.634336+0000","last_change":"2024-09-19T11:35:37.647073+0000","last_active":"2024-09-19T12:01:41.634336+0000","last_peered":"2024-09-19T12:01:41.634336+0000","last_clean":"2024-09-19T12:01:41.634336+0000","last_became_active":"2024-09-19T11:35:37.646446+0000","last_became_peered":"2024-09-19T11:35:37.646446+0000","last_unstale":"2024-09-19T12:01:41.634336+0000","last_undegraded":"2024-09-19T12:01:41.634336+0000","last_fullsized":"2024-09-19T12:01:41.634336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:26.769867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18926,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":204,"num_write":94,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.591328+0000","last_change":"2024-09-19T11:35:39.658936+0000","last_active":"2024-09-19T11:59:31.591328+0000","last_peered":"2024-09-19T11:59:31.591328+0000","last_clean":"2024-09-19T11:59:31.591328+0000","last_became_active":"2024-09-19T11:35:39.658173+0000","last_became_peered":"2024-09-19T11:35:39.658173+0000","last_unstale":"2024-09-19T11:59:31.591328+0000","last_undegraded":"2024-09-19T11:59:31.591328+0000","last_fullsized":"2024-09-19T11:59:31.591328+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:40.200085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'7","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.993549+0000","last_change":"2024-09-19T11:35:41.679566+0000","last_active":"2024-09-19T12:02:32.993549+0000","last_peered":"2024-09-19T12:02:32.993549+0000","last_clean":"2024-09-19T12:02:32.993549+0000","last_became_active":"2024-09-19T11:35:41.678765+0000","last_became_peered":"2024-09-19T11:35:41.678765+0000","last_unstale":"2024-09-19T12:02:32.993549+0000","last_undegraded":"2024-09-19T12:02:32.993549+0000","last_fullsized":"2024-09-19T12:02:32.993549+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:11.159416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":41,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'2","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.727132+0000","last_change":"2024-09-19T11:35:33.613035+0000","last_active":"2024-09-19T12:02:17.727132+0000","last_peered":"2024-09-19T12:02:17.727132+0000","last_clean":"2024-09-19T12:02:17.727132+0000","last_became_active":"2024-09-19T11:35:33.612279+0000","last_became_peered":"2024-09-19T11:35:33.612279+0000","last_unstale":"2024-09-19T12:02:17.727132+0000","last_undegraded":"2024-09-19T12:02:17.727132+0000","last_fullsized":"2024-09-19T12:02:17.727132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:21.396428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'90","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.786587+0000","last_change":"2024-09-19T11:35:31.584569+0000","last_active":"2024-09-19T12:02:17.786587+0000","last_peered":"2024-09-19T12:02:17.786587+0000","last_clean":"2024-09-19T12:02:17.786587+0000","last_became_active":"2024-09-19T11:35:31.584188+0000","last_became_peered":"2024-09-19T11:35:31.584188+0000","last_unstale":"2024-09-19T12:02:17.786587+0000","last_undegraded":"2024-09-19T12:02:17.786587+0000","last_fullsized":"2024-09-19T12:02:17.786587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:54.139090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":270,"num_read_kb":3453,"num_write":506,"num_write_kb":3250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.602050+0000","last_change":"2024-09-19T11:35:35.615386+0000","last_active":"2024-09-19T12:00:21.602050+0000","last_peered":"2024-09-19T12:00:21.602050+0000","last_clean":"2024-09-19T12:00:21.602050+0000","last_became_active":"2024-09-19T11:35:35.614650+0000","last_became_peered":"2024-09-19T11:35:35.614650+0000","last_unstale":"2024-09-19T12:00:21.602050+0000","last_undegraded":"2024-09-19T12:00:21.602050+0000","last_fullsized":"2024-09-19T12:00:21.602050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:10.129352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'74","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.790629+0000","last_change":"2024-09-19T11:35:37.632361+0000","last_active":"2024-09-19T12:02:17.790629+0000","last_peered":"2024-09-19T12:02:17.790629+0000","last_clean":"2024-09-19T12:02:17.790629+0000","last_became_active":"2024-09-19T11:35:37.624951+0000","last_became_peered":"2024-09-19T11:35:37.624951+0000","last_unstale":"2024-09-19T12:02:17.790629+0000","last_undegraded":"2024-09-19T12:02:17.790629+0000","last_fullsized":"2024-09-19T12:02:17.790629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:24.797414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":118,"num_read_kb":152,"num_write":134,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":475,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.618781+0000","last_change":"2024-09-19T11:35:39.671990+0000","last_active":"2024-09-19T12:00:31.618781+0000","last_peered":"2024-09-19T12:00:31.618781+0000","last_clean":"2024-09-19T12:00:31.618781+0000","last_became_active":"2024-09-19T11:35:39.671181+0000","last_became_peered":"2024-09-19T11:35:39.671181+0000","last_unstale":"2024-09-19T12:00:31.618781+0000","last_undegraded":"2024-09-19T12:00:31.618781+0000","last_fullsized":"2024-09-19T12:00:31.618781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:41.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'18","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.602486+0000","last_change":"2024-09-19T11:35:41.685909+0000","last_active":"2024-09-19T11:59:46.602486+0000","last_peered":"2024-09-19T11:59:46.602486+0000","last_clean":"2024-09-19T11:59:46.602486+0000","last_became_active":"2024-09-19T11:35:41.684966+0000","last_became_peered":"2024-09-19T11:35:41.684966+0000","last_unstale":"2024-09-19T11:59:46.602486+0000","last_undegraded":"2024-09-19T11:59:46.602486+0000","last_fullsized":"2024-09-19T11:59:46.602486+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:36.205278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":94,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'76","reported_seq":577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807509+0000","last_change":"2024-09-19T11:35:33.615010+0000","last_active":"2024-09-19T12:00:21.807509+0000","last_peered":"2024-09-19T12:00:21.807509+0000","last_clean":"2024-09-19T12:00:21.807509+0000","last_became_active":"2024-09-19T11:35:33.613369+0000","last_became_peered":"2024-09-19T11:35:33.613369+0000","last_unstale":"2024-09-19T12:00:21.807509+0000","last_undegraded":"2024-09-19T12:00:21.807509+0000","last_fullsized":"2024-09-19T12:00:21.807509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:13.047628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":221,"num_write":116,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'31","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.307029+0000","last_change":"2024-09-19T11:36:06.676047+0000","last_active":"2024-09-19T12:00:06.307029+0000","last_peered":"2024-09-19T12:00:06.307029+0000","last_clean":"2024-09-19T12:00:06.307029+0000","last_became_active":"2024-09-19T11:36:06.674998+0000","last_became_peered":"2024-09-19T11:36:06.674998+0000","last_unstale":"2024-09-19T12:00:06.307029+0000","last_undegraded":"2024-09-19T12:00:06.307029+0000","last_fullsized":"2024-09-19T12:00:06.307029+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:32.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7402804,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":38,"num_read_kb":7484,"num_write":130,"num_write_kb":7462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,7],"acting":[2,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.602482+0000","last_change":"2024-09-19T11:35:35.632289+0000","last_active":"2024-09-19T12:00:21.602482+0000","last_peered":"2024-09-19T12:00:21.602482+0000","last_clean":"2024-09-19T12:00:21.602482+0000","last_became_active":"2024-09-19T11:35:35.631702+0000","last_became_peered":"2024-09-19T11:35:35.631702+0000","last_unstale":"2024-09-19T12:00:21.602482+0000","last_undegraded":"2024-09-19T12:00:21.602482+0000","last_fullsized":"2024-09-19T12:00:21.602482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:14.196241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'75","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.618207+0000","last_change":"2024-09-19T11:35:37.628795+0000","last_active":"2024-09-19T12:02:32.618207+0000","last_peered":"2024-09-19T12:02:32.618207+0000","last_clean":"2024-09-19T12:02:32.618207+0000","last_became_active":"2024-09-19T11:35:37.627720+0000","last_became_peered":"2024-09-19T11:35:37.627720+0000","last_unstale":"2024-09-19T12:02:32.618207+0000","last_undegraded":"2024-09-19T12:02:32.618207+0000","last_fullsized":"2024-09-19T12:02:32.618207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:36.397426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12172,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":104,"num_read_kb":146,"num_write":78,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'614","reported_seq":1625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.472134+0000","last_change":"2024-09-19T11:35:39.651921+0000","last_active":"2024-09-19T12:02:34.472134+0000","last_peered":"2024-09-19T12:02:34.472134+0000","last_clean":"2024-09-19T12:02:34.472134+0000","last_became_active":"2024-09-19T11:35:39.651203+0000","last_became_peered":"2024-09-19T11:35:39.651203+0000","last_unstale":"2024-09-19T12:02:34.472134+0000","last_undegraded":"2024-09-19T12:02:34.472134+0000","last_fullsized":"2024-09-19T12:02:34.472134+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:01.951944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'8","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607324+0000","last_change":"2024-09-19T11:35:41.691885+0000","last_active":"2024-09-19T12:00:41.607324+0000","last_peered":"2024-09-19T12:00:41.607324+0000","last_clean":"2024-09-19T12:00:41.607324+0000","last_became_active":"2024-09-19T11:35:41.691146+0000","last_became_peered":"2024-09-19T11:35:41.691146+0000","last_unstale":"2024-09-19T12:00:41.607324+0000","last_undegraded":"2024-09-19T12:00:41.607324+0000","last_fullsized":"2024-09-19T12:00:41.607324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:13.054334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":44,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'23","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807571+0000","last_change":"2024-09-19T11:35:33.628948+0000","last_active":"2024-09-19T12:00:21.807571+0000","last_peered":"2024-09-19T12:00:21.807571+0000","last_clean":"2024-09-19T12:00:21.807571+0000","last_became_active":"2024-09-19T11:35:33.628232+0000","last_became_peered":"2024-09-19T11:35:33.628232+0000","last_unstale":"2024-09-19T12:00:21.807571+0000","last_undegraded":"2024-09-19T12:00:21.807571+0000","last_fullsized":"2024-09-19T12:00:21.807571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:54.904056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'40","reported_seq":555,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:33.242294+0000","last_change":"2024-09-19T11:35:31.584516+0000","last_active":"2024-09-19T11:59:33.242294+0000","last_peered":"2024-09-19T11:59:33.242294+0000","last_clean":"2024-09-19T11:59:33.242294+0000","last_became_active":"2024-09-19T11:35:31.583509+0000","last_became_peered":"2024-09-19T11:35:31.583509+0000","last_unstale":"2024-09-19T11:59:33.242294+0000","last_undegraded":"2024-09-19T11:59:33.242294+0000","last_fullsized":"2024-09-19T11:59:33.242294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:18.443812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":87,"num_read_kb":273,"num_write":136,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1304,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.946470+0000","last_change":"2024-09-19T11:35:35.630576+0000","last_active":"2024-09-19T12:02:32.946470+0000","last_peered":"2024-09-19T12:02:32.946470+0000","last_clean":"2024-09-19T12:02:32.946470+0000","last_became_active":"2024-09-19T11:35:35.629728+0000","last_became_peered":"2024-09-19T11:35:35.629728+0000","last_unstale":"2024-09-19T12:02:32.946470+0000","last_undegraded":"2024-09-19T12:02:32.946470+0000","last_fullsized":"2024-09-19T12:02:32.946470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:45.444265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":820,"num_read_kb":820,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'34","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611679+0000","last_change":"2024-09-19T11:35:37.618793+0000","last_active":"2024-09-19T12:00:26.611679+0000","last_peered":"2024-09-19T12:00:26.611679+0000","last_clean":"2024-09-19T12:00:26.611679+0000","last_became_active":"2024-09-19T11:35:37.618061+0000","last_became_peered":"2024-09-19T11:35:37.618061+0000","last_unstale":"2024-09-19T12:00:26.611679+0000","last_undegraded":"2024-09-19T12:00:26.611679+0000","last_fullsized":"2024-09-19T12:00:26.611679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:25.182817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'614","reported_seq":1665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.469112+0000","last_change":"2024-09-19T11:35:39.670880+0000","last_active":"2024-09-19T12:02:34.469112+0000","last_peered":"2024-09-19T12:02:34.469112+0000","last_clean":"2024-09-19T12:02:34.469112+0000","last_became_active":"2024-09-19T11:35:39.670211+0000","last_became_peered":"2024-09-19T11:35:39.670211+0000","last_unstale":"2024-09-19T12:02:34.469112+0000","last_undegraded":"2024-09-19T12:02:34.469112+0000","last_fullsized":"2024-09-19T12:02:34.469112+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:33.137968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'12","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812121+0000","last_change":"2024-09-19T11:35:41.688504+0000","last_active":"2024-09-19T12:00:41.812121+0000","last_peered":"2024-09-19T12:00:41.812121+0000","last_clean":"2024-09-19T12:00:41.812121+0000","last_became_active":"2024-09-19T11:35:41.687793+0000","last_became_peered":"2024-09-19T11:35:41.687793+0000","last_unstale":"2024-09-19T12:00:41.812121+0000","last_undegraded":"2024-09-19T12:00:41.812121+0000","last_fullsized":"2024-09-19T12:00:41.812121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:01.111100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":22,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'40","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603842+0000","last_change":"2024-09-19T11:35:33.603329+0000","last_active":"2024-09-19T12:00:26.603842+0000","last_peered":"2024-09-19T12:00:26.603842+0000","last_clean":"2024-09-19T12:00:26.603842+0000","last_became_active":"2024-09-19T11:35:33.602988+0000","last_became_peered":"2024-09-19T11:35:33.602988+0000","last_unstale":"2024-09-19T12:00:26.603842+0000","last_undegraded":"2024-09-19T12:00:26.603842+0000","last_fullsized":"2024-09-19T12:00:26.603842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:22.788235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":120,"num_write":65,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'34","reported_seq":556,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:33.122139+0000","last_change":"2024-09-19T11:36:06.676997+0000","last_active":"2024-09-19T11:59:33.122139+0000","last_peered":"2024-09-19T11:59:33.122139+0000","last_clean":"2024-09-19T11:59:33.122139+0000","last_became_active":"2024-09-19T11:36:06.675863+0000","last_became_peered":"2024-09-19T11:36:06.675863+0000","last_unstale":"2024-09-19T11:59:33.122139+0000","last_undegraded":"2024-09-19T11:59:33.122139+0000","last_fullsized":"2024-09-19T11:59:33.122139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:09.211491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":68,"num_read_kb":59,"num_write":155,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807544+0000","last_change":"2024-09-19T11:35:35.624735+0000","last_active":"2024-09-19T12:00:21.807544+0000","last_peered":"2024-09-19T12:00:21.807544+0000","last_clean":"2024-09-19T12:00:21.807544+0000","last_became_active":"2024-09-19T11:35:35.623987+0000","last_became_peered":"2024-09-19T11:35:35.623987+0000","last_unstale":"2024-09-19T12:00:21.807544+0000","last_undegraded":"2024-09-19T12:00:21.807544+0000","last_fullsized":"2024-09-19T12:00:21.807544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:01.328886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'111","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.615494+0000","last_change":"2024-09-19T11:35:37.628778+0000","last_active":"2024-09-19T12:00:26.615494+0000","last_peered":"2024-09-19T12:00:26.615494+0000","last_clean":"2024-09-19T12:00:26.615494+0000","last_became_active":"2024-09-19T11:35:37.627374+0000","last_became_peered":"2024-09-19T11:35:37.627374+0000","last_unstale":"2024-09-19T12:00:26.615494+0000","last_undegraded":"2024-09-19T12:00:26.615494+0000","last_fullsized":"2024-09-19T12:00:26.615494+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:40.224279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8513,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":153,"num_read_kb":184,"num_write":108,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.616096+0000","last_change":"2024-09-19T11:35:39.666833+0000","last_active":"2024-09-19T12:00:26.616096+0000","last_peered":"2024-09-19T12:00:26.616096+0000","last_clean":"2024-09-19T12:00:26.616096+0000","last_became_active":"2024-09-19T11:35:39.666071+0000","last_became_peered":"2024-09-19T11:35:39.666071+0000","last_unstale":"2024-09-19T12:00:26.616096+0000","last_undegraded":"2024-09-19T12:00:26.616096+0000","last_fullsized":"2024-09-19T12:00:26.616096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:55.544445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"253'10","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607413+0000","last_change":"2024-09-19T11:35:41.681654+0000","last_active":"2024-09-19T12:00:41.607413+0000","last_peered":"2024-09-19T12:00:41.607413+0000","last_clean":"2024-09-19T12:00:41.607413+0000","last_became_active":"2024-09-19T11:35:41.680850+0000","last_became_peered":"2024-09-19T11:35:41.680850+0000","last_unstale":"2024-09-19T12:00:41.607413+0000","last_undegraded":"2024-09-19T12:00:41.607413+0000","last_fullsized":"2024-09-19T12:00:41.607413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:38.701888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":41,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'9","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619799+0000","last_change":"2024-09-19T11:35:33.633360+0000","last_active":"2024-09-19T12:00:41.619799+0000","last_peered":"2024-09-19T12:00:41.619799+0000","last_clean":"2024-09-19T12:00:41.619799+0000","last_became_active":"2024-09-19T11:35:33.632623+0000","last_became_peered":"2024-09-19T11:35:33.632623+0000","last_unstale":"2024-09-19T12:00:41.619799+0000","last_undegraded":"2024-09-19T12:00:41.619799+0000","last_fullsized":"2024-09-19T12:00:41.619799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:21.511371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:21.605222+0000","last_change":"2024-09-19T11:35:14.134637+0000","last_active":"2024-09-19T11:59:21.605222+0000","last_peered":"2024-09-19T11:59:21.605222+0000","last_clean":"2024-09-19T11:59:21.605222+0000","last_became_active":"2024-09-19T11:35:14.133710+0000","last_became_peered":"2024-09-19T11:35:14.133710+0000","last_unstale":"2024-09-19T11:59:21.605222+0000","last_undegraded":"2024-09-19T11:59:21.605222+0000","last_fullsized":"2024-09-19T11:59:21.605222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:13.080179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:13.080179+0000","last_clean_scrub_stamp":"2024-09-19T11:35:13.080179+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:26.810969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.614213+0000","last_change":"2024-09-19T11:35:21.174817+0000","last_active":"2024-09-19T12:00:21.614213+0000","last_peered":"2024-09-19T12:00:21.614213+0000","last_clean":"2024-09-19T12:00:21.614213+0000","last_became_active":"2024-09-19T11:35:19.150393+0000","last_became_peered":"2024-09-19T11:35:19.150393+0000","last_unstale":"2024-09-19T12:00:21.614213+0000","last_undegraded":"2024-09-19T12:00:21.614213+0000","last_fullsized":"2024-09-19T12:00:21.614213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:35.259610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001387466,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'59","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.629646+0000","last_change":"2024-09-19T11:35:31.593431+0000","last_active":"2024-09-19T12:02:32.629646+0000","last_peered":"2024-09-19T12:02:32.629646+0000","last_clean":"2024-09-19T12:02:32.629646+0000","last_became_active":"2024-09-19T11:35:31.592913+0000","last_became_peered":"2024-09-19T11:35:31.592913+0000","last_unstale":"2024-09-19T12:02:32.629646+0000","last_undegraded":"2024-09-19T12:02:32.629646+0000","last_fullsized":"2024-09-19T12:02:32.629646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:24:42.956900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":130,"num_read_kb":2042,"num_write":246,"num_write_kb":1946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.621462+0000","last_change":"2024-09-19T11:35:35.603629+0000","last_active":"2024-09-19T12:00:36.621462+0000","last_peered":"2024-09-19T12:00:36.621462+0000","last_clean":"2024-09-19T12:00:36.621462+0000","last_became_active":"2024-09-19T11:35:35.602892+0000","last_became_peered":"2024-09-19T11:35:35.602892+0000","last_unstale":"2024-09-19T12:00:36.621462+0000","last_undegraded":"2024-09-19T12:00:36.621462+0000","last_fullsized":"2024-09-19T12:00:36.621462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:06.994180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'175","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:45.370851+0000","last_change":"2024-09-19T11:35:37.638436+0000","last_active":"2024-09-19T12:01:45.370851+0000","last_peered":"2024-09-19T12:01:45.370851+0000","last_clean":"2024-09-19T12:01:45.370851+0000","last_became_active":"2024-09-19T11:35:37.636399+0000","last_became_peered":"2024-09-19T11:35:37.636399+0000","last_unstale":"2024-09-19T12:01:45.370851+0000","last_undegraded":"2024-09-19T12:01:45.370851+0000","last_fullsized":"2024-09-19T12:01:45.370851+0000","mapping_epoch":32,"log_start":"262'100","ondisk_log_start":"262'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:14:07.861992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33202,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":257,"num_read_kb":423,"num_write":244,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":475,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.604407+0000","last_change":"2024-09-19T11:35:39.681040+0000","last_active":"2024-09-19T11:59:31.604407+0000","last_peered":"2024-09-19T11:59:31.604407+0000","last_clean":"2024-09-19T11:59:31.604407+0000","last_became_active":"2024-09-19T11:35:39.680298+0000","last_became_peered":"2024-09-19T11:35:39.680298+0000","last_unstale":"2024-09-19T11:59:31.604407+0000","last_undegraded":"2024-09-19T11:59:31.604407+0000","last_fullsized":"2024-09-19T11:59:31.604407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:52.699540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'52","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.766635+0000","last_change":"2024-09-19T11:35:41.679956+0000","last_active":"2024-09-19T12:02:19.766635+0000","last_peered":"2024-09-19T12:02:19.766635+0000","last_clean":"2024-09-19T12:02:19.766635+0000","last_became_active":"2024-09-19T11:35:41.679219+0000","last_became_peered":"2024-09-19T11:35:41.679219+0000","last_unstale":"2024-09-19T12:02:19.766635+0000","last_undegraded":"2024-09-19T12:02:19.766635+0000","last_fullsized":"2024-09-19T12:02:19.766635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:30.335832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":334,"num_read_kb":278,"num_write":121,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'139","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.179765+0000","last_change":"2024-09-19T11:35:33.624017+0000","last_active":"2024-09-19T12:02:33.179765+0000","last_peered":"2024-09-19T12:02:33.179765+0000","last_clean":"2024-09-19T12:02:33.179765+0000","last_became_active":"2024-09-19T11:35:33.622065+0000","last_became_peered":"2024-09-19T11:35:33.622065+0000","last_unstale":"2024-09-19T12:02:33.179765+0000","last_undegraded":"2024-09-19T12:02:33.179765+0000","last_fullsized":"2024-09-19T12:02:33.179765+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.917346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":557,"num_read_kb":440,"num_write":210,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.606297+0000","last_change":"2024-09-19T11:35:21.463140+0000","last_active":"2024-09-19T11:59:26.606297+0000","last_peered":"2024-09-19T11:59:26.606297+0000","last_clean":"2024-09-19T11:59:26.606297+0000","last_became_active":"2024-09-19T11:35:19.154360+0000","last_became_peered":"2024-09-19T11:35:19.154360+0000","last_unstale":"2024-09-19T11:59:26.606297+0000","last_undegraded":"2024-09-19T11:59:26.606297+0000","last_fullsized":"2024-09-19T11:59:26.606297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:59.779314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086516000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'33","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.453497+0000","last_change":"2024-09-19T11:36:06.678664+0000","last_active":"2024-09-19T12:02:32.453497+0000","last_peered":"2024-09-19T12:02:32.453497+0000","last_clean":"2024-09-19T12:02:32.453497+0000","last_became_active":"2024-09-19T11:36:06.677474+0000","last_became_peered":"2024-09-19T11:36:06.677474+0000","last_unstale":"2024-09-19T12:02:32.453497+0000","last_undegraded":"2024-09-19T12:02:32.453497+0000","last_fullsized":"2024-09-19T12:02:32.453497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:18.377791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":54,"num_read_kb":49,"num_write":140,"num_write_kb":5149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,5],"acting":[0,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.601906+0000","last_change":"2024-09-19T11:35:35.618073+0000","last_active":"2024-09-19T11:59:26.601906+0000","last_peered":"2024-09-19T11:59:26.601906+0000","last_clean":"2024-09-19T11:59:26.601906+0000","last_became_active":"2024-09-19T11:35:35.616382+0000","last_became_peered":"2024-09-19T11:35:35.616382+0000","last_unstale":"2024-09-19T11:59:26.601906+0000","last_undegraded":"2024-09-19T11:59:26.601906+0000","last_fullsized":"2024-09-19T11:59:26.601906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:08.281218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'556","reported_seq":1601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.460872+0000","last_change":"2024-09-19T11:35:37.641209+0000","last_active":"2024-09-19T12:02:34.460872+0000","last_peered":"2024-09-19T12:02:34.460872+0000","last_clean":"2024-09-19T12:02:34.460872+0000","last_became_active":"2024-09-19T11:35:37.640355+0000","last_became_peered":"2024-09-19T11:35:37.640355+0000","last_unstale":"2024-09-19T12:02:34.460872+0000","last_undegraded":"2024-09-19T12:02:34.460872+0000","last_fullsized":"2024-09-19T12:02:34.460872+0000","mapping_epoch":32,"log_start":"264'501","ondisk_log_start":"264'501","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":501,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:53.345519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26845,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":798,"num_read_kb":909,"num_write":150,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:46.623781+0000","last_change":"2024-09-19T11:35:39.676564+0000","last_active":"2024-09-19T12:00:46.623781+0000","last_peered":"2024-09-19T12:00:46.623781+0000","last_clean":"2024-09-19T12:00:46.623781+0000","last_became_active":"2024-09-19T11:35:39.675795+0000","last_became_peered":"2024-09-19T11:35:39.675795+0000","last_unstale":"2024-09-19T12:00:46.623781+0000","last_undegraded":"2024-09-19T12:00:46.623781+0000","last_fullsized":"2024-09-19T12:00:46.623781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:43.633195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'10","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.592039+0000","last_change":"2024-09-19T11:35:41.679366+0000","last_active":"2024-09-19T11:59:36.592039+0000","last_peered":"2024-09-19T11:59:36.592039+0000","last_clean":"2024-09-19T11:59:36.592039+0000","last_became_active":"2024-09-19T11:35:41.678660+0000","last_became_peered":"2024-09-19T11:35:41.678660+0000","last_unstale":"2024-09-19T11:59:36.592039+0000","last_undegraded":"2024-09-19T11:59:36.592039+0000","last_fullsized":"2024-09-19T11:59:36.592039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:59.286098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'21","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.596686+0000","last_change":"2024-09-19T11:36:06.674126+0000","last_active":"2024-09-19T11:59:56.596686+0000","last_peered":"2024-09-19T11:59:56.596686+0000","last_clean":"2024-09-19T11:59:56.596686+0000","last_became_active":"2024-09-19T11:36:06.673265+0000","last_became_peered":"2024-09-19T11:36:06.673265+0000","last_unstale":"2024-09-19T11:59:56.596686+0000","last_undegraded":"2024-09-19T11:59:56.596686+0000","last_fullsized":"2024-09-19T11:59:56.596686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:39.951937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":39,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.601866+0000","last_change":"2024-09-19T11:35:21.169499+0000","last_active":"2024-09-19T12:00:21.601866+0000","last_peered":"2024-09-19T12:00:21.601866+0000","last_clean":"2024-09-19T12:00:21.601866+0000","last_became_active":"2024-09-19T11:35:19.969368+0000","last_became_peered":"2024-09-19T11:35:19.969368+0000","last_unstale":"2024-09-19T12:00:21.601866+0000","last_undegraded":"2024-09-19T12:00:21.601866+0000","last_fullsized":"2024-09-19T12:00:21.601866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:54.928769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001160424,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'17","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.591917+0000","last_change":"2024-09-19T11:35:31.591567+0000","last_active":"2024-09-19T11:59:36.591917+0000","last_peered":"2024-09-19T11:59:36.591917+0000","last_clean":"2024-09-19T11:59:36.591917+0000","last_became_active":"2024-09-19T11:35:31.590860+0000","last_became_peered":"2024-09-19T11:35:31.590860+0000","last_unstale":"2024-09-19T11:59:36.591917+0000","last_undegraded":"2024-09-19T11:59:36.591917+0000","last_fullsized":"2024-09-19T11:59:36.591917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:09.412483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":61,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.590321+0000","last_change":"2024-09-19T11:35:35.611723+0000","last_active":"2024-09-19T11:59:26.590321+0000","last_peered":"2024-09-19T11:59:26.590321+0000","last_clean":"2024-09-19T11:59:26.590321+0000","last_became_active":"2024-09-19T11:35:35.611092+0000","last_became_peered":"2024-09-19T11:35:35.611092+0000","last_unstale":"2024-09-19T11:59:26.590321+0000","last_undegraded":"2024-09-19T11:59:26.590321+0000","last_fullsized":"2024-09-19T11:59:26.590321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:28.447966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'117","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.344688+0000","last_change":"2024-09-19T11:35:37.647865+0000","last_active":"2024-09-19T12:02:34.344688+0000","last_peered":"2024-09-19T12:02:34.344688+0000","last_clean":"2024-09-19T12:02:34.344688+0000","last_became_active":"2024-09-19T11:35:37.647356+0000","last_became_peered":"2024-09-19T11:35:37.647356+0000","last_unstale":"2024-09-19T12:02:34.344688+0000","last_undegraded":"2024-09-19T12:02:34.344688+0000","last_fullsized":"2024-09-19T12:02:34.344688+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:35.178664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":120,"num_read_kb":109,"num_write":73,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621074+0000","last_change":"2024-09-19T11:35:39.673457+0000","last_active":"2024-09-19T12:00:41.621074+0000","last_peered":"2024-09-19T12:00:41.621074+0000","last_clean":"2024-09-19T12:00:41.621074+0000","last_became_active":"2024-09-19T11:35:39.672352+0000","last_became_peered":"2024-09-19T11:35:39.672352+0000","last_unstale":"2024-09-19T12:00:41.621074+0000","last_undegraded":"2024-09-19T12:00:41.621074+0000","last_fullsized":"2024-09-19T12:00:41.621074+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:47.157668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"256'101","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611538+0000","last_change":"2024-09-19T11:35:41.689002+0000","last_active":"2024-09-19T12:00:26.611538+0000","last_peered":"2024-09-19T12:00:26.611538+0000","last_clean":"2024-09-19T12:00:26.611538+0000","last_became_active":"2024-09-19T11:35:41.688239+0000","last_became_peered":"2024-09-19T11:35:41.688239+0000","last_unstale":"2024-09-19T12:00:26.611538+0000","last_undegraded":"2024-09-19T12:00:26.611538+0000","last_fullsized":"2024-09-19T12:00:26.611538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:43:57.342380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":254,"num_write":203,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'2","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.196523+0000","last_change":"2024-09-19T11:35:33.601303+0000","last_active":"2024-09-19T12:02:33.196523+0000","last_peered":"2024-09-19T12:02:33.196523+0000","last_clean":"2024-09-19T12:02:33.196523+0000","last_became_active":"2024-09-19T11:35:33.600618+0000","last_became_peered":"2024-09-19T11:35:33.600618+0000","last_unstale":"2024-09-19T12:02:33.196523+0000","last_undegraded":"2024-09-19T12:02:33.196523+0000","last_fullsized":"2024-09-19T12:02:33.196523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:54.655273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.614118+0000","last_change":"2024-09-19T11:35:21.176258+0000","last_active":"2024-09-19T12:00:21.614118+0000","last_peered":"2024-09-19T12:00:21.614118+0000","last_clean":"2024-09-19T12:00:21.614118+0000","last_became_active":"2024-09-19T11:35:19.151363+0000","last_became_peered":"2024-09-19T11:35:19.151363+0000","last_unstale":"2024-09-19T12:00:21.614118+0000","last_undegraded":"2024-09-19T12:00:21.614118+0000","last_fullsized":"2024-09-19T12:00:21.614118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:58.212055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028321980000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'31","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:26.479325+0000","last_change":"2024-09-19T11:35:31.588679+0000","last_active":"2024-09-19T12:02:26.479325+0000","last_peered":"2024-09-19T12:02:26.479325+0000","last_clean":"2024-09-19T12:02:26.479325+0000","last_became_active":"2024-09-19T11:35:31.587649+0000","last_became_peered":"2024-09-19T11:35:31.587649+0000","last_unstale":"2024-09-19T12:02:26.479325+0000","last_undegraded":"2024-09-19T12:02:26.479325+0000","last_fullsized":"2024-09-19T12:02:26.479325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:13.392140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246326,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":69,"num_read_kb":1908,"num_write":126,"num_write_kb":8008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621095+0000","last_change":"2024-09-19T11:35:35.617574+0000","last_active":"2024-09-19T12:00:41.621095+0000","last_peered":"2024-09-19T12:00:41.621095+0000","last_clean":"2024-09-19T12:00:41.621095+0000","last_became_active":"2024-09-19T11:35:35.617200+0000","last_became_peered":"2024-09-19T11:35:35.617200+0000","last_unstale":"2024-09-19T12:00:41.621095+0000","last_undegraded":"2024-09-19T12:00:41.621095+0000","last_fullsized":"2024-09-19T12:00:41.621095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:13.119332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'69","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.599082+0000","last_change":"2024-09-19T11:35:37.643925+0000","last_active":"2024-09-19T11:59:31.599082+0000","last_peered":"2024-09-19T11:59:31.599082+0000","last_clean":"2024-09-19T11:59:31.599082+0000","last_became_active":"2024-09-19T11:35:37.643310+0000","last_became_peered":"2024-09-19T11:35:37.643310+0000","last_unstale":"2024-09-19T11:59:31.599082+0000","last_undegraded":"2024-09-19T11:59:31.599082+0000","last_fullsized":"2024-09-19T11:59:31.599082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:52.522266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":101,"num_read_kb":95,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.603772+0000","last_change":"2024-09-19T11:35:39.670325+0000","last_active":"2024-09-19T11:59:31.603772+0000","last_peered":"2024-09-19T11:59:31.603772+0000","last_clean":"2024-09-19T11:59:31.603772+0000","last_became_active":"2024-09-19T11:35:39.669555+0000","last_became_peered":"2024-09-19T11:35:39.669555+0000","last_unstale":"2024-09-19T11:59:31.603772+0000","last_undegraded":"2024-09-19T11:59:31.603772+0000","last_fullsized":"2024-09-19T11:59:31.603772+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:49.076245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'20","reported_seq":557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.765426+0000","last_change":"2024-09-19T11:35:41.679051+0000","last_active":"2024-09-19T12:02:19.765426+0000","last_peered":"2024-09-19T12:02:19.765426+0000","last_clean":"2024-09-19T12:02:19.765426+0000","last_became_active":"2024-09-19T11:35:41.678167+0000","last_became_peered":"2024-09-19T11:35:41.678167+0000","last_unstale":"2024-09-19T12:02:19.765426+0000","last_undegraded":"2024-09-19T12:02:19.765426+0000","last_fullsized":"2024-09-19T12:02:19.765426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:18.723092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":65,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'93","reported_seq":609,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.606163+0000","last_change":"2024-09-19T11:35:33.606056+0000","last_active":"2024-09-19T12:00:36.606163+0000","last_peered":"2024-09-19T12:00:36.606163+0000","last_clean":"2024-09-19T12:00:36.606163+0000","last_became_active":"2024-09-19T11:35:33.605504+0000","last_became_peered":"2024-09-19T11:35:33.605504+0000","last_unstale":"2024-09-19T12:00:36.606163+0000","last_undegraded":"2024-09-19T12:00:36.606163+0000","last_fullsized":"2024-09-19T12:00:36.606163+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:14:43.679145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":306,"num_write":160,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'40","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.608437+0000","last_change":"2024-09-19T11:35:31.617849+0000","last_active":"2024-09-19T12:02:32.608437+0000","last_peered":"2024-09-19T12:02:32.608437+0000","last_clean":"2024-09-19T12:02:32.608437+0000","last_became_active":"2024-09-19T11:35:31.616954+0000","last_became_peered":"2024-09-19T11:35:31.616954+0000","last_unstale":"2024-09-19T12:02:32.608437+0000","last_undegraded":"2024-09-19T12:02:32.608437+0000","last_fullsized":"2024-09-19T12:02:32.608437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:52.945748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088230,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":55,"num_read_kb":2718,"num_write":146,"num_write_kb":7832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.602438+0000","last_change":"2024-09-19T11:35:21.183056+0000","last_active":"2024-09-19T12:00:21.602438+0000","last_peered":"2024-09-19T12:00:21.602438+0000","last_clean":"2024-09-19T12:00:21.602438+0000","last_became_active":"2024-09-19T11:35:20.096557+0000","last_became_peered":"2024-09-19T11:35:20.096557+0000","last_unstale":"2024-09-19T12:00:21.602438+0000","last_undegraded":"2024-09-19T12:00:21.602438+0000","last_fullsized":"2024-09-19T12:00:21.602438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:29.688644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010463289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.619805+0000","last_change":"2024-09-19T11:35:35.624242+0000","last_active":"2024-09-19T12:00:36.619805+0000","last_peered":"2024-09-19T12:00:36.619805+0000","last_clean":"2024-09-19T12:00:36.619805+0000","last_became_active":"2024-09-19T11:35:35.623450+0000","last_became_peered":"2024-09-19T11:35:35.623450+0000","last_unstale":"2024-09-19T12:00:36.619805+0000","last_undegraded":"2024-09-19T12:00:36.619805+0000","last_fullsized":"2024-09-19T12:00:36.619805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:29.438228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'143","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:46.635668+0000","last_change":"2024-09-19T11:35:37.638304+0000","last_active":"2024-09-19T12:01:46.635668+0000","last_peered":"2024-09-19T12:01:46.635668+0000","last_clean":"2024-09-19T12:01:46.635668+0000","last_became_active":"2024-09-19T11:35:37.637234+0000","last_became_peered":"2024-09-19T11:35:37.637234+0000","last_unstale":"2024-09-19T12:01:46.635668+0000","last_undegraded":"2024-09-19T12:01:46.635668+0000","last_fullsized":"2024-09-19T12:01:46.635668+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:56.332709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19177,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":285,"num_write":146,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812070+0000","last_change":"2024-09-19T11:35:39.671642+0000","last_active":"2024-09-19T12:00:41.812070+0000","last_peered":"2024-09-19T12:00:41.812070+0000","last_clean":"2024-09-19T12:00:41.812070+0000","last_became_active":"2024-09-19T11:35:39.669914+0000","last_became_peered":"2024-09-19T11:35:39.669914+0000","last_unstale":"2024-09-19T12:00:41.812070+0000","last_undegraded":"2024-09-19T12:00:41.812070+0000","last_fullsized":"2024-09-19T12:00:41.812070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:43.678369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'12","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.617421+0000","last_change":"2024-09-19T11:35:41.692653+0000","last_active":"2024-09-19T12:00:26.617421+0000","last_peered":"2024-09-19T12:00:26.617421+0000","last_clean":"2024-09-19T12:00:26.617421+0000","last_became_active":"2024-09-19T11:35:41.690257+0000","last_became_peered":"2024-09-19T11:35:41.690257+0000","last_unstale":"2024-09-19T12:00:26.617421+0000","last_undegraded":"2024-09-19T12:00:26.617421+0000","last_fullsized":"2024-09-19T12:00:26.617421+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:24.125004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'201","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.388896+0000","last_change":"2024-09-19T11:35:33.614634+0000","last_active":"2024-09-19T12:02:19.388896+0000","last_peered":"2024-09-19T12:02:19.388896+0000","last_clean":"2024-09-19T12:02:19.388896+0000","last_became_active":"2024-09-19T11:35:33.614327+0000","last_became_peered":"2024-09-19T11:35:33.614327+0000","last_unstale":"2024-09-19T12:02:19.388896+0000","last_undegraded":"2024-09-19T12:02:19.388896+0000","last_fullsized":"2024-09-19T12:02:19.388896+0000","mapping_epoch":28,"log_start":"256'100","ondisk_log_start":"256'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:00.637435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":855,"num_read_kb":681,"num_write":310,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'40","reported_seq":556,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.628087+0000","last_change":"2024-09-19T11:35:31.598990+0000","last_active":"2024-09-19T12:02:32.628087+0000","last_peered":"2024-09-19T12:02:32.628087+0000","last_clean":"2024-09-19T12:02:32.628087+0000","last_became_active":"2024-09-19T11:35:31.598447+0000","last_became_peered":"2024-09-19T11:35:31.598447+0000","last_unstale":"2024-09-19T12:02:32.628087+0000","last_undegraded":"2024-09-19T12:02:32.628087+0000","last_fullsized":"2024-09-19T12:02:32.628087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:13:57.048369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388737,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":83,"num_read_kb":9296,"num_write":134,"num_write_kb":14398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.619240+0000","last_change":"2024-09-19T11:35:21.463119+0000","last_active":"2024-09-19T12:00:26.619240+0000","last_peered":"2024-09-19T12:00:26.619240+0000","last_clean":"2024-09-19T12:00:26.619240+0000","last_became_active":"2024-09-19T11:35:20.094400+0000","last_became_peered":"2024-09-19T11:35:20.094400+0000","last_unstale":"2024-09-19T12:00:26.619240+0000","last_undegraded":"2024-09-19T12:00:26.619240+0000","last_fullsized":"2024-09-19T12:00:26.619240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:19.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088955000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"38'5","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.717295+0000","last_change":"2024-09-19T11:35:35.620047+0000","last_active":"2024-09-19T12:02:32.717295+0000","last_peered":"2024-09-19T12:02:32.717295+0000","last_clean":"2024-09-19T12:02:32.717295+0000","last_became_active":"2024-09-19T11:35:35.619212+0000","last_became_peered":"2024-09-19T11:35:35.619212+0000","last_unstale":"2024-09-19T12:02:32.717295+0000","last_undegraded":"2024-09-19T12:02:32.717295+0000","last_fullsized":"2024-09-19T12:02:32.717295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:38.449188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":1024,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'100","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607374+0000","last_change":"2024-09-19T11:35:37.633269+0000","last_active":"2024-09-19T12:00:41.607374+0000","last_peered":"2024-09-19T12:00:41.607374+0000","last_clean":"2024-09-19T12:00:41.607374+0000","last_became_active":"2024-09-19T11:35:37.629547+0000","last_became_peered":"2024-09-19T11:35:37.629547+0000","last_unstale":"2024-09-19T12:00:41.607374+0000","last_undegraded":"2024-09-19T12:00:41.607374+0000","last_fullsized":"2024-09-19T12:00:41.607374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:55.759738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":151,"num_read_kb":144,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'617","reported_seq":1651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.048365+0000","last_change":"2024-09-19T11:35:39.683282+0000","last_active":"2024-09-19T12:02:33.048365+0000","last_peered":"2024-09-19T12:02:33.048365+0000","last_clean":"2024-09-19T12:02:33.048365+0000","last_became_active":"2024-09-19T11:35:39.681476+0000","last_became_peered":"2024-09-19T11:35:39.681476+0000","last_unstale":"2024-09-19T12:02:33.048365+0000","last_undegraded":"2024-09-19T12:02:33.048365+0000","last_fullsized":"2024-09-19T12:02:33.048365+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:03.143481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'15","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.612867+0000","last_change":"2024-09-19T11:35:41.671140+0000","last_active":"2024-09-19T12:00:31.612867+0000","last_peered":"2024-09-19T12:00:31.612867+0000","last_clean":"2024-09-19T12:00:31.612867+0000","last_became_active":"2024-09-19T11:35:41.670410+0000","last_became_peered":"2024-09-19T11:35:41.670410+0000","last_unstale":"2024-09-19T12:00:31.612867+0000","last_undegraded":"2024-09-19T12:00:31.612867+0000","last_fullsized":"2024-09-19T12:00:31.612867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:12:45.264833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":68,"num_write":44,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'111","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:25.782149+0000","last_change":"2024-09-19T11:35:33.625333+0000","last_active":"2024-09-19T12:02:25.782149+0000","last_peered":"2024-09-19T12:02:25.782149+0000","last_clean":"2024-09-19T12:02:25.782149+0000","last_became_active":"2024-09-19T11:35:33.624885+0000","last_became_peered":"2024-09-19T11:35:33.624885+0000","last_unstale":"2024-09-19T12:02:25.782149+0000","last_undegraded":"2024-09-19T12:02:25.782149+0000","last_fullsized":"2024-09-19T12:02:25.782149+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:31.869760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":317,"num_write":191,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'31","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:30.666941+0000","last_change":"2024-09-19T11:36:06.650619+0000","last_active":"2024-09-19T11:59:30.666941+0000","last_peered":"2024-09-19T11:59:30.666941+0000","last_clean":"2024-09-19T11:59:30.666941+0000","last_became_active":"2024-09-19T11:36:06.649117+0000","last_became_peered":"2024-09-19T11:36:06.649117+0000","last_unstale":"2024-09-19T11:59:30.666941+0000","last_undegraded":"2024-09-19T11:59:30.666941+0000","last_fullsized":"2024-09-19T11:59:30.666941+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:52.917710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":153,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.586560+0000","last_change":"2024-09-19T11:35:21.182872+0000","last_active":"2024-09-19T11:59:11.586560+0000","last_peered":"2024-09-19T11:59:11.586560+0000","last_clean":"2024-09-19T11:59:11.586560+0000","last_became_active":"2024-09-19T11:35:19.152195+0000","last_became_peered":"2024-09-19T11:35:19.152195+0000","last_unstale":"2024-09-19T11:59:11.586560+0000","last_undegraded":"2024-09-19T11:59:11.586560+0000","last_fullsized":"2024-09-19T11:59:11.586560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:33.512818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094930600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810796+0000","last_change":"2024-09-19T11:35:35.625999+0000","last_active":"2024-09-19T12:00:36.810796+0000","last_peered":"2024-09-19T12:00:36.810796+0000","last_clean":"2024-09-19T12:00:36.810796+0000","last_became_active":"2024-09-19T11:35:35.625385+0000","last_became_peered":"2024-09-19T11:35:35.625385+0000","last_unstale":"2024-09-19T12:00:36.810796+0000","last_undegraded":"2024-09-19T12:00:36.810796+0000","last_fullsized":"2024-09-19T12:00:36.810796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:58.273564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'58","reported_seq":572,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812198+0000","last_change":"2024-09-19T11:35:37.642580+0000","last_active":"2024-09-19T12:00:41.812198+0000","last_peered":"2024-09-19T12:00:41.812198+0000","last_clean":"2024-09-19T12:00:41.812198+0000","last_became_active":"2024-09-19T11:35:37.641855+0000","last_became_peered":"2024-09-19T11:35:37.641855+0000","last_unstale":"2024-09-19T12:00:41.812198+0000","last_undegraded":"2024-09-19T12:00:41.812198+0000","last_fullsized":"2024-09-19T12:00:41.812198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:09.995922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":89,"num_read_kb":84,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'618","reported_seq":1534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.476923+0000","last_change":"2024-09-19T11:35:39.663385+0000","last_active":"2024-09-19T12:02:34.476923+0000","last_peered":"2024-09-19T12:02:34.476923+0000","last_clean":"2024-09-19T12:02:34.476923+0000","last_became_active":"2024-09-19T11:35:39.662678+0000","last_became_peered":"2024-09-19T11:35:39.662678+0000","last_unstale":"2024-09-19T12:02:34.476923+0000","last_undegraded":"2024-09-19T12:02:34.476923+0000","last_fullsized":"2024-09-19T12:02:34.476923+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:49.009964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'101","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.205987+0000","last_change":"2024-09-19T11:35:41.684355+0000","last_active":"2024-09-19T12:02:33.205987+0000","last_peered":"2024-09-19T12:02:33.205987+0000","last_clean":"2024-09-19T12:02:33.205987+0000","last_became_active":"2024-09-19T11:35:41.683629+0000","last_became_peered":"2024-09-19T11:35:41.683629+0000","last_unstale":"2024-09-19T12:02:33.205987+0000","last_undegraded":"2024-09-19T12:02:33.205987+0000","last_fullsized":"2024-09-19T12:02:33.205987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:47.007366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":202,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'36","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.192875+0000","last_change":"2024-09-19T11:35:33.616782+0000","last_active":"2024-09-19T12:02:33.192875+0000","last_peered":"2024-09-19T12:02:33.192875+0000","last_clean":"2024-09-19T12:02:33.192875+0000","last_became_active":"2024-09-19T11:35:33.616079+0000","last_became_peered":"2024-09-19T11:35:33.616079+0000","last_unstale":"2024-09-19T12:02:33.192875+0000","last_undegraded":"2024-09-19T12:02:33.192875+0000","last_fullsized":"2024-09-19T12:02:33.192875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:15:39.547552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":147,"num_write":69,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'35","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.714196+0000","last_change":"2024-09-19T11:35:31.613306+0000","last_active":"2024-09-19T12:02:17.714196+0000","last_peered":"2024-09-19T12:02:17.714196+0000","last_clean":"2024-09-19T12:02:17.714196+0000","last_became_active":"2024-09-19T11:35:31.612706+0000","last_became_peered":"2024-09-19T11:35:31.612706+0000","last_unstale":"2024-09-19T12:02:17.714196+0000","last_undegraded":"2024-09-19T12:02:17.714196+0000","last_fullsized":"2024-09-19T12:02:17.714196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:16.769591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322891,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":64,"num_read_kb":6249,"num_write":148,"num_write_kb":6206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.599479+0000","last_change":"2024-09-19T11:35:21.168189+0000","last_active":"2024-09-19T11:59:11.599479+0000","last_peered":"2024-09-19T11:59:11.599479+0000","last_clean":"2024-09-19T11:59:11.599479+0000","last_became_active":"2024-09-19T11:35:19.152446+0000","last_became_peered":"2024-09-19T11:35:19.152446+0000","last_unstale":"2024-09-19T11:59:11.599479+0000","last_undegraded":"2024-09-19T11:59:11.599479+0000","last_fullsized":"2024-09-19T11:59:11.599479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:09.874667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.601284+0000","last_change":"2024-09-19T11:35:35.624664+0000","last_active":"2024-09-19T11:59:41.601284+0000","last_peered":"2024-09-19T11:59:41.601284+0000","last_clean":"2024-09-19T11:59:41.601284+0000","last_became_active":"2024-09-19T11:35:35.624322+0000","last_became_peered":"2024-09-19T11:35:35.624322+0000","last_unstale":"2024-09-19T11:59:41.601284+0000","last_undegraded":"2024-09-19T11:59:41.601284+0000","last_fullsized":"2024-09-19T11:59:41.601284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:10.112342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'184","reported_seq":719,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.791588+0000","last_change":"2024-09-19T11:35:37.646919+0000","last_active":"2024-09-19T12:02:17.791588+0000","last_peered":"2024-09-19T12:02:17.791588+0000","last_clean":"2024-09-19T12:02:17.791588+0000","last_became_active":"2024-09-19T11:35:37.646158+0000","last_became_peered":"2024-09-19T11:35:37.646158+0000","last_unstale":"2024-09-19T12:02:17.791588+0000","last_undegraded":"2024-09-19T12:02:17.791588+0000","last_fullsized":"2024-09-19T12:02:17.791588+0000","mapping_epoch":32,"log_start":"256'100","ondisk_log_start":"256'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:25.054477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37796,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":260,"num_read_kb":439,"num_write":202,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615042+0000","last_change":"2024-09-19T11:35:39.684662+0000","last_active":"2024-09-19T12:00:41.615042+0000","last_peered":"2024-09-19T12:00:41.615042+0000","last_clean":"2024-09-19T12:00:41.615042+0000","last_became_active":"2024-09-19T11:35:39.684034+0000","last_became_peered":"2024-09-19T11:35:39.684034+0000","last_unstale":"2024-09-19T12:00:41.615042+0000","last_undegraded":"2024-09-19T12:00:41.615042+0000","last_fullsized":"2024-09-19T12:00:41.615042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:00.499255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'21","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.615420+0000","last_change":"2024-09-19T11:35:41.690412+0000","last_active":"2024-09-19T12:00:26.615420+0000","last_peered":"2024-09-19T12:00:26.615420+0000","last_clean":"2024-09-19T12:00:26.615420+0000","last_became_active":"2024-09-19T11:35:41.689764+0000","last_became_peered":"2024-09-19T11:35:41.689764+0000","last_unstale":"2024-09-19T12:00:26.615420+0000","last_undegraded":"2024-09-19T12:00:26.615420+0000","last_fullsized":"2024-09-19T12:00:26.615420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:54.147943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":78,"num_write":61,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'13","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621213+0000","last_change":"2024-09-19T11:35:41.691619+0000","last_active":"2024-09-19T12:00:41.621213+0000","last_peered":"2024-09-19T12:00:41.621213+0000","last_clean":"2024-09-19T12:00:41.621213+0000","last_became_active":"2024-09-19T11:35:41.691032+0000","last_became_peered":"2024-09-19T11:35:41.691032+0000","last_unstale":"2024-09-19T12:00:41.621213+0000","last_undegraded":"2024-09-19T12:00:41.621213+0000","last_fullsized":"2024-09-19T12:00:41.621213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:56.262332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":124,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'71","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.049397+0000","last_change":"2024-09-19T11:35:33.630221+0000","last_active":"2024-09-19T11:59:28.049397+0000","last_peered":"2024-09-19T11:59:28.049397+0000","last_clean":"2024-09-19T11:59:28.049397+0000","last_became_active":"2024-09-19T11:35:33.629606+0000","last_became_peered":"2024-09-19T11:35:33.629606+0000","last_unstale":"2024-09-19T11:59:28.049397+0000","last_undegraded":"2024-09-19T11:59:28.049397+0000","last_fullsized":"2024-09-19T11:59:28.049397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:26.189736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":210,"num_write":129,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'30","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:08.146210+0000","last_change":"2024-09-19T11:35:31.592429+0000","last_active":"2024-09-19T12:00:08.146210+0000","last_peered":"2024-09-19T12:00:08.146210+0000","last_clean":"2024-09-19T12:00:08.146210+0000","last_became_active":"2024-09-19T11:35:31.591519+0000","last_became_peered":"2024-09-19T11:35:31.591519+0000","last_unstale":"2024-09-19T12:00:08.146210+0000","last_undegraded":"2024-09-19T12:00:08.146210+0000","last_fullsized":"2024-09-19T12:00:08.146210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:03.358145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":47,"num_read_kb":3273,"num_write":128,"num_write_kb":3245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.583004+0000","last_change":"2024-09-19T11:35:35.613146+0000","last_active":"2024-09-19T11:58:56.583004+0000","last_peered":"2024-09-19T11:58:56.583004+0000","last_clean":"2024-09-19T11:58:56.583004+0000","last_became_active":"2024-09-19T11:35:35.612405+0000","last_became_peered":"2024-09-19T11:35:35.612405+0000","last_unstale":"2024-09-19T11:58:56.583004+0000","last_undegraded":"2024-09-19T11:58:56.583004+0000","last_fullsized":"2024-09-19T11:58:56.583004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:30:32.069279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'80","reported_seq":582,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.311958+0000","last_change":"2024-09-19T11:35:37.633337+0000","last_active":"2024-09-19T12:00:06.311958+0000","last_peered":"2024-09-19T12:00:06.311958+0000","last_clean":"2024-09-19T12:00:06.311958+0000","last_became_active":"2024-09-19T11:35:37.632543+0000","last_became_peered":"2024-09-19T11:35:37.632543+0000","last_unstale":"2024-09-19T12:00:06.311958+0000","last_undegraded":"2024-09-19T12:00:06.311958+0000","last_fullsized":"2024-09-19T12:00:06.311958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:04.865458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10904,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":155,"num_write":84,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.591731+0000","last_change":"2024-09-19T11:35:39.654809+0000","last_active":"2024-09-19T11:59:01.591731+0000","last_peered":"2024-09-19T11:59:01.591731+0000","last_clean":"2024-09-19T11:59:01.591731+0000","last_became_active":"2024-09-19T11:35:39.654012+0000","last_became_peered":"2024-09-19T11:35:39.654012+0000","last_unstale":"2024-09-19T11:59:01.591731+0000","last_undegraded":"2024-09-19T11:59:01.591731+0000","last_fullsized":"2024-09-19T11:59:01.591731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:29.043987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'11","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.602664+0000","last_change":"2024-09-19T11:35:41.676591+0000","last_active":"2024-09-19T11:59:46.602664+0000","last_peered":"2024-09-19T11:59:46.602664+0000","last_clean":"2024-09-19T11:59:46.602664+0000","last_became_active":"2024-09-19T11:35:41.675506+0000","last_became_peered":"2024-09-19T11:35:41.675506+0000","last_unstale":"2024-09-19T11:59:46.602664+0000","last_undegraded":"2024-09-19T11:59:46.602664+0000","last_fullsized":"2024-09-19T11:59:46.602664+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:14.936561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":25,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'13","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.169388+0000","last_change":"2024-09-19T11:35:33.635071+0000","last_active":"2024-09-19T12:02:33.169388+0000","last_peered":"2024-09-19T12:02:33.169388+0000","last_clean":"2024-09-19T12:02:33.169388+0000","last_became_active":"2024-09-19T11:35:33.634606+0000","last_became_peered":"2024-09-19T11:35:33.634606+0000","last_unstale":"2024-09-19T12:02:33.169388+0000","last_undegraded":"2024-09-19T12:02:33.169388+0000","last_fullsized":"2024-09-19T12:02:33.169388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:09.967791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":71,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'40","reported_seq":555,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.609620+0000","last_change":"2024-09-19T11:35:31.603150+0000","last_active":"2024-09-19T11:59:41.609620+0000","last_peered":"2024-09-19T11:59:41.609620+0000","last_clean":"2024-09-19T11:59:41.609620+0000","last_became_active":"2024-09-19T11:35:31.602343+0000","last_became_peered":"2024-09-19T11:35:31.602343+0000","last_unstale":"2024-09-19T11:59:41.609620+0000","last_undegraded":"2024-09-19T11:59:41.609620+0000","last_fullsized":"2024-09-19T11:59:41.609620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:51.716892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243020,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":78,"num_read_kb":10301,"num_write":152,"num_write_kb":15391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.590693+0000","last_change":"2024-09-19T11:35:35.630500+0000","last_active":"2024-09-19T11:58:56.590693+0000","last_peered":"2024-09-19T11:58:56.590693+0000","last_clean":"2024-09-19T11:58:56.590693+0000","last_became_active":"2024-09-19T11:35:35.630183+0000","last_became_peered":"2024-09-19T11:35:35.630183+0000","last_unstale":"2024-09-19T11:58:56.590693+0000","last_undegraded":"2024-09-19T11:58:56.590693+0000","last_fullsized":"2024-09-19T11:58:56.590693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:46.826155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'15","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.597192+0000","last_change":"2024-09-19T11:35:37.642215+0000","last_active":"2024-09-19T11:59:01.597192+0000","last_peered":"2024-09-19T11:59:01.597192+0000","last_clean":"2024-09-19T11:59:01.597192+0000","last_became_active":"2024-09-19T11:35:37.640723+0000","last_became_peered":"2024-09-19T11:35:37.640723+0000","last_unstale":"2024-09-19T11:59:01.597192+0000","last_undegraded":"2024-09-19T11:59:01.597192+0000","last_fullsized":"2024-09-19T11:59:01.597192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:00.528966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.600886+0000","last_change":"2024-09-19T11:35:39.668057+0000","last_active":"2024-09-19T11:59:01.600886+0000","last_peered":"2024-09-19T11:59:01.600886+0000","last_clean":"2024-09-19T11:59:01.600886+0000","last_became_active":"2024-09-19T11:35:39.667286+0000","last_became_peered":"2024-09-19T11:35:39.667286+0000","last_unstale":"2024-09-19T11:59:01.600886+0000","last_undegraded":"2024-09-19T11:59:01.600886+0000","last_fullsized":"2024-09-19T11:59:01.600886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:36.821583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'8","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:18.512713+0000","last_change":"2024-09-19T11:35:41.698132+0000","last_active":"2024-09-19T11:58:18.512713+0000","last_peered":"2024-09-19T11:58:18.512713+0000","last_clean":"2024-09-19T11:58:18.512713+0000","last_became_active":"2024-09-19T11:35:41.696369+0000","last_became_peered":"2024-09-19T11:35:41.696369+0000","last_unstale":"2024-09-19T11:58:18.512713+0000","last_undegraded":"2024-09-19T11:58:18.512713+0000","last_fullsized":"2024-09-19T11:58:18.512713+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:42.394020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'69","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.196713+0000","last_change":"2024-09-19T11:35:33.617102+0000","last_active":"2024-09-19T12:02:33.196713+0000","last_peered":"2024-09-19T12:02:33.196713+0000","last_clean":"2024-09-19T12:02:33.196713+0000","last_became_active":"2024-09-19T11:35:33.614693+0000","last_became_peered":"2024-09-19T11:35:33.614693+0000","last_unstale":"2024-09-19T12:02:33.196713+0000","last_undegraded":"2024-09-19T12:02:33.196713+0000","last_fullsized":"2024-09-19T12:02:33.196713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:04.830617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":230,"num_write":111,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'41","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.783722+0000","last_change":"2024-09-19T11:36:06.678190+0000","last_active":"2024-09-19T12:02:17.783722+0000","last_peered":"2024-09-19T12:02:17.783722+0000","last_clean":"2024-09-19T12:02:17.783722+0000","last_became_active":"2024-09-19T11:36:06.677102+0000","last_became_peered":"2024-09-19T11:36:06.677102+0000","last_unstale":"2024-09-19T12:02:17.783722+0000","last_undegraded":"2024-09-19T12:02:17.783722+0000","last_fullsized":"2024-09-19T12:02:17.783722+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:31.643124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":83,"num_read_kb":1744,"num_write":149,"num_write_kb":1703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599682+0000","last_change":"2024-09-19T11:35:35.618146+0000","last_active":"2024-09-19T11:58:56.599682+0000","last_peered":"2024-09-19T11:58:56.599682+0000","last_clean":"2024-09-19T11:58:56.599682+0000","last_became_active":"2024-09-19T11:35:35.617374+0000","last_became_peered":"2024-09-19T11:35:35.617374+0000","last_unstale":"2024-09-19T11:58:56.599682+0000","last_undegraded":"2024-09-19T11:58:56.599682+0000","last_fullsized":"2024-09-19T11:58:56.599682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:21.640183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'93","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.031384+0000","last_change":"2024-09-19T11:35:37.637365+0000","last_active":"2024-09-19T11:59:28.031384+0000","last_peered":"2024-09-19T11:59:28.031384+0000","last_clean":"2024-09-19T11:59:28.031384+0000","last_became_active":"2024-09-19T11:35:37.636913+0000","last_became_peered":"2024-09-19T11:35:37.636913+0000","last_unstale":"2024-09-19T11:59:28.031384+0000","last_undegraded":"2024-09-19T11:59:28.031384+0000","last_fullsized":"2024-09-19T11:59:28.031384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:19.745629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10680,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":133,"num_read_kb":183,"num_write":96,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":470,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.597548+0000","last_change":"2024-09-19T11:35:39.673878+0000","last_active":"2024-09-19T11:59:01.597548+0000","last_peered":"2024-09-19T11:59:01.597548+0000","last_clean":"2024-09-19T11:59:01.597548+0000","last_became_active":"2024-09-19T11:35:39.673172+0000","last_became_peered":"2024-09-19T11:35:39.673172+0000","last_unstale":"2024-09-19T11:59:01.597548+0000","last_undegraded":"2024-09-19T11:59:01.597548+0000","last_fullsized":"2024-09-19T11:59:01.597548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:06:47.106673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'13","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.043251+0000","last_change":"2024-09-19T11:35:41.678676+0000","last_active":"2024-09-19T11:59:28.043251+0000","last_peered":"2024-09-19T11:59:28.043251+0000","last_clean":"2024-09-19T11:59:28.043251+0000","last_became_active":"2024-09-19T11:35:41.677991+0000","last_became_peered":"2024-09-19T11:35:41.677991+0000","last_unstale":"2024-09-19T11:59:28.043251+0000","last_undegraded":"2024-09-19T11:59:28.043251+0000","last_fullsized":"2024-09-19T11:59:28.043251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:02.104343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":90,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":470,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.590229+0000","last_change":"2024-09-19T11:36:06.675768+0000","last_active":"2024-09-19T11:59:26.590229+0000","last_peered":"2024-09-19T11:59:26.590229+0000","last_clean":"2024-09-19T11:59:26.590229+0000","last_became_active":"2024-09-19T11:36:06.674947+0000","last_became_peered":"2024-09-19T11:36:06.674947+0000","last_unstale":"2024-09-19T11:59:26.590229+0000","last_undegraded":"2024-09-19T11:59:26.590229+0000","last_fullsized":"2024-09-19T11:59:26.590229+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:35.049315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"264'23","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.606726+0000","last_change":"2024-09-19T11:35:31.589696+0000","last_active":"2024-09-19T11:59:41.606726+0000","last_peered":"2024-09-19T11:59:41.606726+0000","last_clean":"2024-09-19T11:59:41.606726+0000","last_became_active":"2024-09-19T11:35:31.589077+0000","last_became_peered":"2024-09-19T11:35:31.589077+0000","last_unstale":"2024-09-19T11:59:41.606726+0000","last_undegraded":"2024-09-19T11:59:41.606726+0000","last_fullsized":"2024-09-19T11:59:41.606726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:24.386252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7371470,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":36,"num_read_kb":7227,"num_write":88,"num_write_kb":7207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.596258+0000","last_change":"2024-09-19T11:35:35.630499+0000","last_active":"2024-09-19T11:58:56.596258+0000","last_peered":"2024-09-19T11:58:56.596258+0000","last_clean":"2024-09-19T11:58:56.596258+0000","last_became_active":"2024-09-19T11:35:35.629798+0000","last_became_peered":"2024-09-19T11:35:35.629798+0000","last_unstale":"2024-09-19T11:58:56.596258+0000","last_undegraded":"2024-09-19T11:58:56.596258+0000","last_fullsized":"2024-09-19T11:58:56.596258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:11.036004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'65","reported_seq":560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:21.631532+0000","last_change":"2024-09-19T11:35:37.640794+0000","last_active":"2024-09-19T12:01:21.631532+0000","last_peered":"2024-09-19T12:01:21.631532+0000","last_clean":"2024-09-19T12:01:21.631532+0000","last_became_active":"2024-09-19T11:35:37.640008+0000","last_became_peered":"2024-09-19T11:35:37.640008+0000","last_unstale":"2024-09-19T12:01:21.631532+0000","last_undegraded":"2024-09-19T12:01:21.631532+0000","last_fullsized":"2024-09-19T12:01:21.631532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:27.014754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11361,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":143,"num_write":70,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.597356+0000","last_change":"2024-09-19T11:35:39.676685+0000","last_active":"2024-09-19T11:59:01.597356+0000","last_peered":"2024-09-19T11:59:01.597356+0000","last_clean":"2024-09-19T11:59:01.597356+0000","last_became_active":"2024-09-19T11:35:39.675913+0000","last_became_peered":"2024-09-19T11:35:39.675913+0000","last_unstale":"2024-09-19T11:59:01.597356+0000","last_undegraded":"2024-09-19T11:59:01.597356+0000","last_fullsized":"2024-09-19T11:59:01.597356+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:50.470241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'72","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618654+0000","last_change":"2024-09-19T11:35:33.625849+0000","last_active":"2024-09-19T12:00:36.618654+0000","last_peered":"2024-09-19T12:00:36.618654+0000","last_clean":"2024-09-19T12:00:36.618654+0000","last_became_active":"2024-09-19T11:35:33.624358+0000","last_became_peered":"2024-09-19T11:35:33.624358+0000","last_unstale":"2024-09-19T12:00:36.618654+0000","last_undegraded":"2024-09-19T12:00:36.618654+0000","last_fullsized":"2024-09-19T12:00:36.618654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:19.837363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":316,"num_read_kb":286,"num_write":104,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'30","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.294007+0000","last_change":"2024-09-19T11:35:31.575536+0000","last_active":"2024-09-19T12:00:06.294007+0000","last_peered":"2024-09-19T12:00:06.294007+0000","last_clean":"2024-09-19T12:00:06.294007+0000","last_became_active":"2024-09-19T11:35:31.574673+0000","last_became_peered":"2024-09-19T11:35:31.574673+0000","last_unstale":"2024-09-19T12:00:06.294007+0000","last_undegraded":"2024-09-19T12:00:06.294007+0000","last_fullsized":"2024-09-19T12:00:06.294007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.781451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5418,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":58,"num_read_kb":49,"num_write":113,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.606673+0000","last_change":"2024-09-19T11:35:35.620065+0000","last_active":"2024-09-19T11:59:41.606673+0000","last_peered":"2024-09-19T11:59:41.606673+0000","last_clean":"2024-09-19T11:59:41.606673+0000","last_became_active":"2024-09-19T11:35:35.617643+0000","last_became_peered":"2024-09-19T11:35:35.617643+0000","last_unstale":"2024-09-19T11:59:41.606673+0000","last_undegraded":"2024-09-19T11:59:41.606673+0000","last_fullsized":"2024-09-19T11:59:41.606673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:41.917586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'95","reported_seq":595,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.323158+0000","last_change":"2024-09-19T11:35:37.640664+0000","last_active":"2024-09-19T12:00:06.323158+0000","last_peered":"2024-09-19T12:00:06.323158+0000","last_clean":"2024-09-19T12:00:06.323158+0000","last_became_active":"2024-09-19T11:35:37.640147+0000","last_became_peered":"2024-09-19T11:35:37.640147+0000","last_unstale":"2024-09-19T12:00:06.323158+0000","last_undegraded":"2024-09-19T12:00:06.323158+0000","last_fullsized":"2024-09-19T12:00:06.323158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:58.172631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20894,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":129,"num_read_kb":228,"num_write":102,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":472,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.585226+0000","last_change":"2024-09-19T11:35:39.652153+0000","last_active":"2024-09-19T11:58:11.585226+0000","last_peered":"2024-09-19T11:58:11.585226+0000","last_clean":"2024-09-19T11:58:11.585226+0000","last_became_active":"2024-09-19T11:35:39.651426+0000","last_became_peered":"2024-09-19T11:35:39.651426+0000","last_unstale":"2024-09-19T11:58:11.585226+0000","last_undegraded":"2024-09-19T11:58:11.585226+0000","last_fullsized":"2024-09-19T11:58:11.585226+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:46.800698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'72","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.052035+0000","last_change":"2024-09-19T11:35:41.676328+0000","last_active":"2024-09-19T11:59:28.052035+0000","last_peered":"2024-09-19T11:59:28.052035+0000","last_clean":"2024-09-19T11:59:28.052035+0000","last_became_active":"2024-09-19T11:35:41.674006+0000","last_became_peered":"2024-09-19T11:35:41.674006+0000","last_unstale":"2024-09-19T11:59:28.052035+0000","last_undegraded":"2024-09-19T11:59:28.052035+0000","last_fullsized":"2024-09-19T11:59:28.052035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:43.399242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'110","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.380540+0000","last_change":"2024-09-19T11:35:33.612189+0000","last_active":"2024-09-19T12:02:19.380540+0000","last_peered":"2024-09-19T12:02:19.380540+0000","last_clean":"2024-09-19T12:02:19.380540+0000","last_became_active":"2024-09-19T11:35:33.611732+0000","last_became_peered":"2024-09-19T11:35:33.611732+0000","last_unstale":"2024-09-19T12:02:19.380540+0000","last_undegraded":"2024-09-19T12:02:19.380540+0000","last_fullsized":"2024-09-19T12:02:19.380540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:18.009652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":312,"num_write":153,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'43","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.594278+0000","last_change":"2024-09-19T11:35:31.585905+0000","last_active":"2024-09-19T11:59:46.594278+0000","last_peered":"2024-09-19T11:59:46.594278+0000","last_clean":"2024-09-19T11:59:46.594278+0000","last_became_active":"2024-09-19T11:35:31.585423+0000","last_became_peered":"2024-09-19T11:35:31.585423+0000","last_unstale":"2024-09-19T11:59:46.594278+0000","last_undegraded":"2024-09-19T11:59:46.594278+0000","last_fullsized":"2024-09-19T11:59:46.594278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:25:09.830393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080025,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":118,"num_read_kb":1132,"num_write":168,"num_write_kb":1063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618616+0000","last_change":"2024-09-19T11:35:35.633072+0000","last_active":"2024-09-19T12:00:36.618616+0000","last_peered":"2024-09-19T12:00:36.618616+0000","last_clean":"2024-09-19T12:00:36.618616+0000","last_became_active":"2024-09-19T11:35:35.632384+0000","last_became_peered":"2024-09-19T11:35:35.632384+0000","last_unstale":"2024-09-19T12:00:36.618616+0000","last_undegraded":"2024-09-19T12:00:36.618616+0000","last_fullsized":"2024-09-19T12:00:36.618616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:13.028878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'72","reported_seq":575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.796977+0000","last_change":"2024-09-19T11:35:37.642378+0000","last_active":"2024-09-19T12:02:17.796977+0000","last_peered":"2024-09-19T12:02:17.796977+0000","last_clean":"2024-09-19T12:02:17.796977+0000","last_became_active":"2024-09-19T11:35:37.641603+0000","last_became_peered":"2024-09-19T11:35:37.641603+0000","last_unstale":"2024-09-19T12:02:17.796977+0000","last_undegraded":"2024-09-19T12:02:17.796977+0000","last_fullsized":"2024-09-19T12:02:17.796977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:06.984305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8122,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":109,"num_read_kb":139,"num_write":96,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.573467+0000","last_change":"2024-09-19T11:35:39.684040+0000","last_active":"2024-09-19T11:58:11.573467+0000","last_peered":"2024-09-19T11:58:11.573467+0000","last_clean":"2024-09-19T11:58:11.573467+0000","last_became_active":"2024-09-19T11:35:39.683564+0000","last_became_peered":"2024-09-19T11:35:39.683564+0000","last_unstale":"2024-09-19T11:58:11.573467+0000","last_undegraded":"2024-09-19T11:58:11.573467+0000","last_fullsized":"2024-09-19T11:58:11.573467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:14.462022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'25","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.989255+0000","last_change":"2024-09-19T11:35:41.665955+0000","last_active":"2024-09-19T12:02:32.989255+0000","last_peered":"2024-09-19T12:02:32.989255+0000","last_clean":"2024-09-19T12:02:32.989255+0000","last_became_active":"2024-09-19T11:35:41.665262+0000","last_became_peered":"2024-09-19T11:35:41.665262+0000","last_unstale":"2024-09-19T12:02:32.989255+0000","last_undegraded":"2024-09-19T12:02:32.989255+0000","last_fullsized":"2024-09-19T12:02:32.989255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:27.405987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":132,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'2","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.166673+0000","last_change":"2024-09-19T11:35:33.614188+0000","last_active":"2024-09-19T12:02:33.166673+0000","last_peered":"2024-09-19T12:02:33.166673+0000","last_clean":"2024-09-19T12:02:33.166673+0000","last_became_active":"2024-09-19T11:35:33.613712+0000","last_became_peered":"2024-09-19T11:35:33.613712+0000","last_unstale":"2024-09-19T12:02:33.166673+0000","last_undegraded":"2024-09-19T12:02:33.166673+0000","last_fullsized":"2024-09-19T12:02:33.166673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:35.628949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'41","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.809581+0000","last_change":"2024-09-19T11:35:31.580900+0000","last_active":"2024-09-19T12:00:31.809581+0000","last_peered":"2024-09-19T12:00:31.809581+0000","last_clean":"2024-09-19T12:00:31.809581+0000","last_became_active":"2024-09-19T11:35:31.579680+0000","last_became_peered":"2024-09-19T11:35:31.579680+0000","last_unstale":"2024-09-19T12:00:31.809581+0000","last_undegraded":"2024-09-19T12:00:31.809581+0000","last_fullsized":"2024-09-19T12:00:31.809581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:17.218721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":100,"num_read_kb":1771,"num_write":183,"num_write_kb":1706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.777279+0000","last_change":"2024-09-19T11:35:35.628919+0000","last_active":"2024-09-19T11:58:06.777279+0000","last_peered":"2024-09-19T11:58:06.777279+0000","last_clean":"2024-09-19T11:58:06.777279+0000","last_became_active":"2024-09-19T11:35:35.625446+0000","last_became_peered":"2024-09-19T11:35:35.625446+0000","last_unstale":"2024-09-19T11:58:06.777279+0000","last_undegraded":"2024-09-19T11:58:06.777279+0000","last_fullsized":"2024-09-19T11:58:06.777279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:40.113640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'68","reported_seq":572,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615309+0000","last_change":"2024-09-19T11:35:37.617373+0000","last_active":"2024-09-19T12:00:41.615309+0000","last_peered":"2024-09-19T12:00:41.615309+0000","last_clean":"2024-09-19T12:00:41.615309+0000","last_became_active":"2024-09-19T11:35:37.616602+0000","last_became_peered":"2024-09-19T11:35:37.616602+0000","last_unstale":"2024-09-19T12:00:41.615309+0000","last_undegraded":"2024-09-19T12:00:41.615309+0000","last_fullsized":"2024-09-19T12:00:41.615309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:47.275427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10384,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":140,"num_write":70,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.594472+0000","last_change":"2024-09-19T11:35:39.686747+0000","last_active":"2024-09-19T11:59:46.594472+0000","last_peered":"2024-09-19T11:59:46.594472+0000","last_clean":"2024-09-19T11:59:46.594472+0000","last_became_active":"2024-09-19T11:35:39.686225+0000","last_became_peered":"2024-09-19T11:35:39.686225+0000","last_unstale":"2024-09-19T11:59:46.594472+0000","last_undegraded":"2024-09-19T11:59:46.594472+0000","last_fullsized":"2024-09-19T11:59:46.594472+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:38.757638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"256'2","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.596457+0000","last_change":"2024-09-19T11:35:41.683491+0000","last_active":"2024-09-19T11:59:01.596457+0000","last_peered":"2024-09-19T11:59:01.596457+0000","last_clean":"2024-09-19T11:59:01.596457+0000","last_became_active":"2024-09-19T11:35:41.682440+0000","last_became_peered":"2024-09-19T11:35:41.682440+0000","last_unstale":"2024-09-19T11:59:01.596457+0000","last_undegraded":"2024-09-19T11:59:01.596457+0000","last_fullsized":"2024-09-19T11:59:01.596457+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:15.584265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'93","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:43.947971+0000","last_change":"2024-09-19T11:35:33.605732+0000","last_active":"2024-09-19T12:01:43.947971+0000","last_peered":"2024-09-19T12:01:43.947971+0000","last_clean":"2024-09-19T12:01:43.947971+0000","last_became_active":"2024-09-19T11:35:33.605161+0000","last_became_peered":"2024-09-19T11:35:33.605161+0000","last_unstale":"2024-09-19T12:01:43.947971+0000","last_undegraded":"2024-09-19T12:01:43.947971+0000","last_fullsized":"2024-09-19T12:01:43.947971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:47.784644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":359,"num_read_kb":288,"num_write":158,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'26","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.618577+0000","last_change":"2024-09-19T11:35:31.602820+0000","last_active":"2024-09-19T12:00:31.618577+0000","last_peered":"2024-09-19T12:00:31.618577+0000","last_clean":"2024-09-19T12:00:31.618577+0000","last_became_active":"2024-09-19T11:35:31.602466+0000","last_became_peered":"2024-09-19T11:35:31.602466+0000","last_unstale":"2024-09-19T12:00:31.618577+0000","last_undegraded":"2024-09-19T12:00:31.618577+0000","last_fullsized":"2024-09-19T12:00:31.618577+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:21.152956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":45,"num_write":118,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.572238+0000","last_change":"2024-09-19T11:35:35.632089+0000","last_active":"2024-09-19T11:58:06.572238+0000","last_peered":"2024-09-19T11:58:06.572238+0000","last_clean":"2024-09-19T11:58:06.572238+0000","last_became_active":"2024-09-19T11:35:35.631573+0000","last_became_peered":"2024-09-19T11:35:35.631573+0000","last_unstale":"2024-09-19T11:58:06.572238+0000","last_undegraded":"2024-09-19T11:58:06.572238+0000","last_fullsized":"2024-09-19T11:58:06.572238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:57.000282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'40","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.798513+0000","last_change":"2024-09-19T11:35:37.633680+0000","last_active":"2024-09-19T11:59:41.798513+0000","last_peered":"2024-09-19T11:59:41.798513+0000","last_clean":"2024-09-19T11:59:41.798513+0000","last_became_active":"2024-09-19T11:35:37.632562+0000","last_became_peered":"2024-09-19T11:35:37.632562+0000","last_unstale":"2024-09-19T11:59:41.798513+0000","last_undegraded":"2024-09-19T11:59:41.798513+0000","last_fullsized":"2024-09-19T11:59:41.798513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:18.066710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":55,"num_read_kb":48,"num_write":46,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'614","reported_seq":1537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.458282+0000","last_change":"2024-09-19T11:35:39.660361+0000","last_active":"2024-09-19T12:02:34.458282+0000","last_peered":"2024-09-19T12:02:34.458282+0000","last_clean":"2024-09-19T12:02:34.458282+0000","last_became_active":"2024-09-19T11:35:39.659602+0000","last_became_peered":"2024-09-19T11:35:39.659602+0000","last_unstale":"2024-09-19T12:02:34.458282+0000","last_undegraded":"2024-09-19T12:02:34.458282+0000","last_fullsized":"2024-09-19T12:02:34.458282+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:19.524182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'7","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.600833+0000","last_change":"2024-09-19T11:35:41.682361+0000","last_active":"2024-09-19T11:59:01.600833+0000","last_peered":"2024-09-19T11:59:01.600833+0000","last_clean":"2024-09-19T11:59:01.600833+0000","last_became_active":"2024-09-19T11:35:41.681567+0000","last_became_peered":"2024-09-19T11:35:41.681567+0000","last_unstale":"2024-09-19T11:59:01.600833+0000","last_undegraded":"2024-09-19T11:59:01.600833+0000","last_fullsized":"2024-09-19T11:59:01.600833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:05.849048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'69","reported_seq":567,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:05.818754+0000","last_change":"2024-09-19T11:35:33.618140+0000","last_active":"2024-09-19T12:00:05.818754+0000","last_peered":"2024-09-19T12:00:05.818754+0000","last_clean":"2024-09-19T12:00:05.818754+0000","last_became_active":"2024-09-19T11:35:33.617414+0000","last_became_peered":"2024-09-19T11:35:33.617414+0000","last_unstale":"2024-09-19T12:00:05.818754+0000","last_undegraded":"2024-09-19T12:00:05.818754+0000","last_fullsized":"2024-09-19T12:00:05.818754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:12.877192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":201,"num_write":115,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'23","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.616654+0000","last_change":"2024-09-19T11:35:31.620319+0000","last_active":"2024-09-19T12:00:31.616654+0000","last_peered":"2024-09-19T12:00:31.616654+0000","last_clean":"2024-09-19T12:00:31.616654+0000","last_became_active":"2024-09-19T11:35:31.613260+0000","last_became_peered":"2024-09-19T11:35:31.613260+0000","last_unstale":"2024-09-19T12:00:31.616654+0000","last_undegraded":"2024-09-19T12:00:31.616654+0000","last_fullsized":"2024-09-19T12:00:31.616654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:43.808702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1104621,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":31,"num_read_kb":9290,"num_write":71,"num_write_kb":7234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.587216+0000","last_change":"2024-09-19T11:35:35.618214+0000","last_active":"2024-09-19T11:58:06.587216+0000","last_peered":"2024-09-19T11:58:06.587216+0000","last_clean":"2024-09-19T11:58:06.587216+0000","last_became_active":"2024-09-19T11:35:35.617489+0000","last_became_peered":"2024-09-19T11:35:35.617489+0000","last_unstale":"2024-09-19T11:58:06.587216+0000","last_undegraded":"2024-09-19T11:58:06.587216+0000","last_fullsized":"2024-09-19T11:58:06.587216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:05.845518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'87","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.792479+0000","last_change":"2024-09-19T11:35:37.625579+0000","last_active":"2024-09-19T12:02:17.792479+0000","last_peered":"2024-09-19T12:02:17.792479+0000","last_clean":"2024-09-19T12:02:17.792479+0000","last_became_active":"2024-09-19T11:35:37.624101+0000","last_became_peered":"2024-09-19T11:35:37.624101+0000","last_unstale":"2024-09-19T12:02:17.792479+0000","last_undegraded":"2024-09-19T12:02:17.792479+0000","last_fullsized":"2024-09-19T12:02:17.792479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:13:17.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10373,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":114,"num_read_kb":163,"num_write":88,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.608983+0000","last_change":"2024-09-19T11:35:39.674060+0000","last_active":"2024-09-19T11:59:51.608983+0000","last_peered":"2024-09-19T11:59:51.608983+0000","last_clean":"2024-09-19T11:59:51.608983+0000","last_became_active":"2024-09-19T11:35:39.671474+0000","last_became_peered":"2024-09-19T11:35:39.671474+0000","last_unstale":"2024-09-19T11:59:51.608983+0000","last_undegraded":"2024-09-19T11:59:51.608983+0000","last_fullsized":"2024-09-19T11:59:51.608983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:49.787232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'16","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611804+0000","last_change":"2024-09-19T11:35:41.694646+0000","last_active":"2024-09-19T11:59:51.611804+0000","last_peered":"2024-09-19T11:59:51.611804+0000","last_clean":"2024-09-19T11:59:51.611804+0000","last_became_active":"2024-09-19T11:35:41.693900+0000","last_became_peered":"2024-09-19T11:35:41.693900+0000","last_unstale":"2024-09-19T11:59:51.611804+0000","last_undegraded":"2024-09-19T11:59:51.611804+0000","last_fullsized":"2024-09-19T11:59:51.611804+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:06.653849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'84","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.164927+0000","last_change":"2024-09-19T11:35:33.605993+0000","last_active":"2024-09-19T12:02:33.164927+0000","last_peered":"2024-09-19T12:02:33.164927+0000","last_clean":"2024-09-19T12:02:33.164927+0000","last_became_active":"2024-09-19T11:35:33.605259+0000","last_became_peered":"2024-09-19T11:35:33.605259+0000","last_unstale":"2024-09-19T12:02:33.164927+0000","last_undegraded":"2024-09-19T12:02:33.164927+0000","last_fullsized":"2024-09-19T12:02:33.164927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:43.033562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":291,"num_write":128,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'42","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.778703+0000","last_change":"2024-09-19T11:35:31.623300+0000","last_active":"2024-09-19T12:02:17.778703+0000","last_peered":"2024-09-19T12:02:17.778703+0000","last_clean":"2024-09-19T12:02:17.778703+0000","last_became_active":"2024-09-19T11:35:31.622688+0000","last_became_peered":"2024-09-19T11:35:31.622688+0000","last_unstale":"2024-09-19T12:02:17.778703+0000","last_undegraded":"2024-09-19T12:02:17.778703+0000","last_fullsized":"2024-09-19T12:02:17.778703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:48.009120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079943,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":109,"num_read_kb":10950,"num_write":213,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.584085+0000","last_change":"2024-09-19T11:35:35.622260+0000","last_active":"2024-09-19T11:58:06.584085+0000","last_peered":"2024-09-19T11:58:06.584085+0000","last_clean":"2024-09-19T11:58:06.584085+0000","last_became_active":"2024-09-19T11:35:35.621518+0000","last_became_peered":"2024-09-19T11:35:35.621518+0000","last_unstale":"2024-09-19T11:58:06.584085+0000","last_undegraded":"2024-09-19T11:58:06.584085+0000","last_fullsized":"2024-09-19T11:58:06.584085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:30.262378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'88","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.358024+0000","last_change":"2024-09-19T11:35:37.641470+0000","last_active":"2024-09-19T12:02:19.358024+0000","last_peered":"2024-09-19T12:02:19.358024+0000","last_clean":"2024-09-19T12:02:19.358024+0000","last_became_active":"2024-09-19T11:35:37.639833+0000","last_became_peered":"2024-09-19T11:35:37.639833+0000","last_unstale":"2024-09-19T12:02:19.358024+0000","last_undegraded":"2024-09-19T12:02:19.358024+0000","last_fullsized":"2024-09-19T12:02:19.358024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:25.377817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10914,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":139,"num_write":82,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":470,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.609264+0000","last_change":"2024-09-19T11:35:39.659799+0000","last_active":"2024-09-19T11:59:56.609264+0000","last_peered":"2024-09-19T11:59:56.609264+0000","last_clean":"2024-09-19T11:59:56.609264+0000","last_became_active":"2024-09-19T11:35:39.659011+0000","last_became_peered":"2024-09-19T11:35:39.659011+0000","last_unstale":"2024-09-19T11:59:56.609264+0000","last_undegraded":"2024-09-19T11:59:56.609264+0000","last_fullsized":"2024-09-19T11:59:56.609264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:33.261718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'15","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.603923+0000","last_change":"2024-09-19T11:35:41.675429+0000","last_active":"2024-09-19T11:59:51.603923+0000","last_peered":"2024-09-19T11:59:51.603923+0000","last_clean":"2024-09-19T11:59:51.603923+0000","last_became_active":"2024-09-19T11:35:41.674818+0000","last_became_peered":"2024-09-19T11:35:41.674818+0000","last_unstale":"2024-09-19T11:59:51.603923+0000","last_undegraded":"2024-09-19T11:59:51.603923+0000","last_fullsized":"2024-09-19T11:59:51.603923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:12.876595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":90,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'44","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.603738+0000","last_change":"2024-09-19T11:35:33.603965+0000","last_active":"2024-09-19T11:59:51.603738+0000","last_peered":"2024-09-19T11:59:51.603738+0000","last_clean":"2024-09-19T11:59:51.603738+0000","last_became_active":"2024-09-19T11:35:33.603610+0000","last_became_peered":"2024-09-19T11:35:33.603610+0000","last_unstale":"2024-09-19T11:59:51.603738+0000","last_undegraded":"2024-09-19T11:59:51.603738+0000","last_fullsized":"2024-09-19T11:59:51.603738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:56.366121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":138,"num_write":82,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'39","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.782966+0000","last_change":"2024-09-19T11:35:31.621194+0000","last_active":"2024-09-19T12:02:17.782966+0000","last_peered":"2024-09-19T12:02:17.782966+0000","last_clean":"2024-09-19T12:02:17.782966+0000","last_became_active":"2024-09-19T11:35:31.620504+0000","last_became_peered":"2024-09-19T11:35:31.620504+0000","last_unstale":"2024-09-19T12:02:17.782966+0000","last_undegraded":"2024-09-19T12:02:17.782966+0000","last_fullsized":"2024-09-19T12:02:17.782966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:59.865113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5555,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":1683,"num_write":166,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.799503+0000","last_change":"2024-09-19T11:35:35.624137+0000","last_active":"2024-09-19T11:59:46.799503+0000","last_peered":"2024-09-19T11:59:46.799503+0000","last_clean":"2024-09-19T11:59:46.799503+0000","last_became_active":"2024-09-19T11:35:35.623348+0000","last_became_peered":"2024-09-19T11:35:35.623348+0000","last_unstale":"2024-09-19T11:59:46.799503+0000","last_undegraded":"2024-09-19T11:59:46.799503+0000","last_fullsized":"2024-09-19T11:59:46.799503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:43.589134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'39","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615151+0000","last_change":"2024-09-19T11:35:37.643750+0000","last_active":"2024-09-19T12:00:41.615151+0000","last_peered":"2024-09-19T12:00:41.615151+0000","last_clean":"2024-09-19T12:00:41.615151+0000","last_became_active":"2024-09-19T11:35:37.643249+0000","last_became_peered":"2024-09-19T11:35:37.643249+0000","last_unstale":"2024-09-19T12:00:41.615151+0000","last_undegraded":"2024-09-19T12:00:41.615151+0000","last_fullsized":"2024-09-19T12:00:41.615151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:36.730823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":81,"num_write":38,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.778397+0000","last_change":"2024-09-19T11:35:39.675950+0000","last_active":"2024-09-19T11:58:11.778397+0000","last_peered":"2024-09-19T11:58:11.778397+0000","last_clean":"2024-09-19T11:58:11.778397+0000","last_became_active":"2024-09-19T11:35:39.675285+0000","last_became_peered":"2024-09-19T11:35:39.675285+0000","last_unstale":"2024-09-19T11:58:11.778397+0000","last_undegraded":"2024-09-19T11:58:11.778397+0000","last_fullsized":"2024-09-19T11:58:11.778397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:52.963177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'22","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.336022+0000","last_change":"2024-09-19T11:35:41.695355+0000","last_active":"2024-09-19T12:00:06.336022+0000","last_peered":"2024-09-19T12:00:06.336022+0000","last_clean":"2024-09-19T12:00:06.336022+0000","last_became_active":"2024-09-19T11:35:41.694201+0000","last_became_peered":"2024-09-19T11:35:41.694201+0000","last_unstale":"2024-09-19T12:00:06.336022+0000","last_undegraded":"2024-09-19T12:00:06.336022+0000","last_fullsized":"2024-09-19T12:00:06.336022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:09.844137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":56,"num_write":68,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'84","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.162209+0000","last_change":"2024-09-19T11:35:33.629309+0000","last_active":"2024-09-19T12:02:33.162209+0000","last_peered":"2024-09-19T12:02:33.162209+0000","last_clean":"2024-09-19T12:02:33.162209+0000","last_became_active":"2024-09-19T11:35:33.628283+0000","last_became_peered":"2024-09-19T11:35:33.628283+0000","last_unstale":"2024-09-19T12:02:33.162209+0000","last_undegraded":"2024-09-19T12:02:33.162209+0000","last_fullsized":"2024-09-19T12:02:33.162209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:35.386501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":329,"num_read_kb":270,"num_write":117,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'28","reported_seq":540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.781745+0000","last_change":"2024-09-19T11:36:06.650917+0000","last_active":"2024-09-19T12:02:17.781745+0000","last_peered":"2024-09-19T12:02:17.781745+0000","last_clean":"2024-09-19T12:02:17.781745+0000","last_became_active":"2024-09-19T11:36:06.649652+0000","last_became_peered":"2024-09-19T11:36:06.649652+0000","last_unstale":"2024-09-19T12:02:17.781745+0000","last_undegraded":"2024-09-19T12:02:17.781745+0000","last_fullsized":"2024-09-19T12:02:17.781745+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:48.816823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080003,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":40,"num_read_kb":1095,"num_write":135,"num_write_kb":1067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,7],"acting":[0,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.595482+0000","last_change":"2024-09-19T11:35:35.612806+0000","last_active":"2024-09-19T11:59:51.595482+0000","last_peered":"2024-09-19T11:59:51.595482+0000","last_clean":"2024-09-19T11:59:51.595482+0000","last_became_active":"2024-09-19T11:35:35.612450+0000","last_became_peered":"2024-09-19T11:35:35.612450+0000","last_unstale":"2024-09-19T11:59:51.595482+0000","last_undegraded":"2024-09-19T11:59:51.595482+0000","last_fullsized":"2024-09-19T11:59:51.595482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:02.776959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'86","reported_seq":599,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812229+0000","last_change":"2024-09-19T11:35:37.639560+0000","last_active":"2024-09-19T12:00:41.812229+0000","last_peered":"2024-09-19T12:00:41.812229+0000","last_clean":"2024-09-19T12:00:41.812229+0000","last_became_active":"2024-09-19T11:35:37.638771+0000","last_became_peered":"2024-09-19T11:35:37.638771+0000","last_unstale":"2024-09-19T12:00:41.812229+0000","last_undegraded":"2024-09-19T12:00:41.812229+0000","last_fullsized":"2024-09-19T12:00:41.812229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:56.133473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9181,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":162,"num_write":88,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.585939+0000","last_change":"2024-09-19T11:35:39.663318+0000","last_active":"2024-09-19T11:58:11.585939+0000","last_peered":"2024-09-19T11:58:11.585939+0000","last_clean":"2024-09-19T11:58:11.585939+0000","last_became_active":"2024-09-19T11:35:39.662405+0000","last_became_peered":"2024-09-19T11:35:39.662405+0000","last_unstale":"2024-09-19T11:58:11.585939+0000","last_undegraded":"2024-09-19T11:58:11.585939+0000","last_fullsized":"2024-09-19T11:58:11.585939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:58.275311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"253'4","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.789890+0000","last_change":"2024-09-19T11:35:41.688704+0000","last_active":"2024-09-19T11:59:01.789890+0000","last_peered":"2024-09-19T11:59:01.789890+0000","last_clean":"2024-09-19T11:59:01.789890+0000","last_became_active":"2024-09-19T11:35:41.687549+0000","last_became_peered":"2024-09-19T11:35:41.687549+0000","last_unstale":"2024-09-19T11:59:01.789890+0000","last_undegraded":"2024-09-19T11:59:01.789890+0000","last_fullsized":"2024-09-19T11:59:01.789890+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:56.527265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'79","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.346041+0000","last_change":"2024-09-19T11:35:33.629428+0000","last_active":"2024-09-19T12:00:06.346041+0000","last_peered":"2024-09-19T12:00:06.346041+0000","last_clean":"2024-09-19T12:00:06.346041+0000","last_became_active":"2024-09-19T11:35:33.629186+0000","last_became_peered":"2024-09-19T11:35:33.629186+0000","last_unstale":"2024-09-19T12:00:06.346041+0000","last_undegraded":"2024-09-19T12:00:06.346041+0000","last_fullsized":"2024-09-19T12:00:06.346041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:40.061077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":235,"num_write":161,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'58","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:21.408053+0000","last_change":"2024-09-19T11:35:31.613416+0000","last_active":"2024-09-19T12:02:21.408053+0000","last_peered":"2024-09-19T12:02:21.408053+0000","last_clean":"2024-09-19T12:02:21.408053+0000","last_became_active":"2024-09-19T11:35:31.611719+0000","last_became_peered":"2024-09-19T11:35:31.611719+0000","last_unstale":"2024-09-19T12:02:21.408053+0000","last_undegraded":"2024-09-19T12:02:21.408053+0000","last_fullsized":"2024-09-19T12:02:21.408053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:31.214410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2100468,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":108,"num_read_kb":5194,"num_write":181,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"253'355","reported_seq":1052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.589820+0000","last_change":"2024-09-19T11:35:33.606387+0000","last_active":"2024-09-19T11:59:26.589820+0000","last_peered":"2024-09-19T11:59:26.589820+0000","last_clean":"2024-09-19T11:59:26.589820+0000","last_became_active":"2024-09-19T11:35:33.603938+0000","last_became_peered":"2024-09-19T11:35:33.603938+0000","last_unstale":"2024-09-19T11:59:26.589820+0000","last_undegraded":"2024-09-19T11:59:26.589820+0000","last_fullsized":"2024-09-19T11:59:26.589820+0000","mapping_epoch":28,"log_start":"253'300","ondisk_log_start":"253'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:36.334582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1936,"num_read_kb":1745,"num_write":575,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'31","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.626924+0000","last_change":"2024-09-19T11:35:31.602514+0000","last_active":"2024-09-19T12:02:32.626924+0000","last_peered":"2024-09-19T12:02:32.626924+0000","last_clean":"2024-09-19T12:02:32.626924+0000","last_became_active":"2024-09-19T11:35:31.602046+0000","last_became_peered":"2024-09-19T11:35:31.602046+0000","last_unstale":"2024-09-19T12:02:32.626924+0000","last_undegraded":"2024-09-19T12:02:32.626924+0000","last_fullsized":"2024-09-19T12:02:32.626924+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:30.711983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":68,"num_read_kb":1671,"num_write":108,"num_write_kb":1627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'4","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.168487+0000","last_change":"2024-09-19T11:35:33.617890+0000","last_active":"2024-09-19T12:02:33.168487+0000","last_peered":"2024-09-19T12:02:33.168487+0000","last_clean":"2024-09-19T12:02:33.168487+0000","last_became_active":"2024-09-19T11:35:33.616104+0000","last_became_peered":"2024-09-19T11:35:33.616104+0000","last_unstale":"2024-09-19T12:02:33.168487+0000","last_undegraded":"2024-09-19T12:02:33.168487+0000","last_fullsized":"2024-09-19T12:02:33.168487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:20.380664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'30","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:26.511044+0000","last_change":"2024-09-19T11:35:31.620857+0000","last_active":"2024-09-19T12:02:26.511044+0000","last_peered":"2024-09-19T12:02:26.511044+0000","last_clean":"2024-09-19T12:02:26.511044+0000","last_became_active":"2024-09-19T11:35:31.613195+0000","last_became_peered":"2024-09-19T11:35:31.613195+0000","last_unstale":"2024-09-19T12:02:26.511044+0000","last_undegraded":"2024-09-19T12:02:26.511044+0000","last_fullsized":"2024-09-19T12:02:26.511044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:06.230787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":129,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'20","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:36.618841+0000","last_change":"2024-09-19T11:35:33.619576+0000","last_active":"2024-09-19T12:01:36.618841+0000","last_peered":"2024-09-19T12:01:36.618841+0000","last_clean":"2024-09-19T12:01:36.618841+0000","last_became_active":"2024-09-19T11:35:33.619302+0000","last_became_peered":"2024-09-19T11:35:33.619302+0000","last_unstale":"2024-09-19T12:01:36.618841+0000","last_undegraded":"2024-09-19T12:01:36.618841+0000","last_fullsized":"2024-09-19T12:01:36.618841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:20.380664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'60","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.619732+0000","last_change":"2024-09-19T11:35:31.591076+0000","last_active":"2024-09-19T12:00:36.619732+0000","last_peered":"2024-09-19T12:00:36.619732+0000","last_clean":"2024-09-19T12:00:36.619732+0000","last_became_active":"2024-09-19T11:35:31.590651+0000","last_became_peered":"2024-09-19T11:35:31.590651+0000","last_unstale":"2024-09-19T12:00:36.619732+0000","last_undegraded":"2024-09-19T12:00:36.619732+0000","last_fullsized":"2024-09-19T12:00:36.619732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:43.726265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254104,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":157,"num_read_kb":1977,"num_write":237,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615123+0000","last_change":"2024-09-19T11:35:33.619828+0000","last_active":"2024-09-19T12:00:41.615123+0000","last_peered":"2024-09-19T12:00:41.615123+0000","last_clean":"2024-09-19T12:00:41.615123+0000","last_became_active":"2024-09-19T11:35:33.619372+0000","last_became_peered":"2024-09-19T11:35:33.619372+0000","last_unstale":"2024-09-19T12:00:41.615123+0000","last_undegraded":"2024-09-19T12:00:41.615123+0000","last_fullsized":"2024-09-19T12:00:41.615123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:25.554628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'13","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.307097+0000","last_change":"2024-09-19T11:35:31.584872+0000","last_active":"2024-09-19T12:00:06.307097+0000","last_peered":"2024-09-19T12:00:06.307097+0000","last_clean":"2024-09-19T12:00:06.307097+0000","last_became_active":"2024-09-19T11:35:31.584316+0000","last_became_peered":"2024-09-19T11:35:31.584316+0000","last_unstale":"2024-09-19T12:00:06.307097+0000","last_undegraded":"2024-09-19T12:00:06.307097+0000","last_fullsized":"2024-09-19T12:00:06.307097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:53.681623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079969,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":11,"num_read_kb":1065,"num_write":62,"num_write_kb":1060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810904+0000","last_change":"2024-09-19T11:35:33.627636+0000","last_active":"2024-09-19T12:00:36.810904+0000","last_peered":"2024-09-19T12:00:36.810904+0000","last_clean":"2024-09-19T12:00:36.810904+0000","last_became_active":"2024-09-19T11:35:33.626872+0000","last_became_peered":"2024-09-19T11:35:33.626872+0000","last_unstale":"2024-09-19T12:00:36.810904+0000","last_undegraded":"2024-09-19T12:00:36.810904+0000","last_fullsized":"2024-09-19T12:00:36.810904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:36.325211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'27","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.714132+0000","last_change":"2024-09-19T11:35:31.592141+0000","last_active":"2024-09-19T12:02:17.714132+0000","last_peered":"2024-09-19T12:02:17.714132+0000","last_clean":"2024-09-19T12:02:17.714132+0000","last_became_active":"2024-09-19T11:35:31.591724+0000","last_became_peered":"2024-09-19T11:35:31.591724+0000","last_unstale":"2024-09-19T12:02:17.714132+0000","last_undegraded":"2024-09-19T12:02:17.714132+0000","last_fullsized":"2024-09-19T12:02:17.714132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:35.585870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1129208,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":58,"num_read_kb":1149,"num_write":136,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'52","reported_seq":560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.197816+0000","last_change":"2024-09-19T11:35:33.614983+0000","last_active":"2024-09-19T12:02:33.197816+0000","last_peered":"2024-09-19T12:02:33.197816+0000","last_clean":"2024-09-19T12:02:33.197816+0000","last_became_active":"2024-09-19T11:35:33.614316+0000","last_became_peered":"2024-09-19T11:35:33.614316+0000","last_unstale":"2024-09-19T12:02:33.197816+0000","last_undegraded":"2024-09-19T12:02:33.197816+0000","last_fullsized":"2024-09-19T12:02:33.197816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:38.763908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":175,"num_write":74,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'40","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.516411+0000","last_change":"2024-09-19T11:35:31.613679+0000","last_active":"2024-09-19T12:02:32.516411+0000","last_peered":"2024-09-19T12:02:32.516411+0000","last_clean":"2024-09-19T12:02:32.516411+0000","last_became_active":"2024-09-19T11:35:31.612367+0000","last_became_peered":"2024-09-19T11:35:31.612367+0000","last_unstale":"2024-09-19T12:02:32.516411+0000","last_undegraded":"2024-09-19T12:02:32.516411+0000","last_fullsized":"2024-09-19T12:02:32.516411+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:21.506300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246359,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":87,"num_read_kb":319,"num_write":180,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'50","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618415+0000","last_change":"2024-09-19T11:35:33.625962+0000","last_active":"2024-09-19T12:00:36.618415+0000","last_peered":"2024-09-19T12:00:36.618415+0000","last_clean":"2024-09-19T12:00:36.618415+0000","last_became_active":"2024-09-19T11:35:33.625249+0000","last_became_peered":"2024-09-19T11:35:33.625249+0000","last_unstale":"2024-09-19T12:00:36.618415+0000","last_undegraded":"2024-09-19T12:00:36.618415+0000","last_fullsized":"2024-09-19T12:00:36.618415+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:54.254614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":159,"num_write":74,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'43","reported_seq":559,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.715507+0000","last_change":"2024-09-19T11:35:31.589092+0000","last_active":"2024-09-19T12:02:17.715507+0000","last_peered":"2024-09-19T12:02:17.715507+0000","last_clean":"2024-09-19T12:02:17.715507+0000","last_became_active":"2024-09-19T11:35:31.588705+0000","last_became_peered":"2024-09-19T11:35:31.588705+0000","last_unstale":"2024-09-19T12:02:17.715507+0000","last_undegraded":"2024-09-19T12:02:17.715507+0000","last_fullsized":"2024-09-19T12:02:17.715507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:23.530669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194452,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":74,"num_read_kb":4157,"num_write":175,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'73","reported_seq":570,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.596172+0000","last_change":"2024-09-19T11:35:33.626308+0000","last_active":"2024-09-19T11:58:56.596172+0000","last_peered":"2024-09-19T11:58:56.596172+0000","last_clean":"2024-09-19T11:58:56.596172+0000","last_became_active":"2024-09-19T11:35:33.625874+0000","last_became_peered":"2024-09-19T11:35:33.625874+0000","last_unstale":"2024-09-19T11:58:56.596172+0000","last_undegraded":"2024-09-19T11:58:56.596172+0000","last_fullsized":"2024-09-19T11:58:56.596172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:34.524797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":214,"num_write":124,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'25","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:32.852109+0000","last_change":"2024-09-19T11:35:31.594437+0000","last_active":"2024-09-19T11:59:32.852109+0000","last_peered":"2024-09-19T11:59:32.852109+0000","last_clean":"2024-09-19T11:59:32.852109+0000","last_became_active":"2024-09-19T11:35:31.593067+0000","last_became_peered":"2024-09-19T11:35:31.593067+0000","last_unstale":"2024-09-19T11:59:32.852109+0000","last_undegraded":"2024-09-19T11:59:32.852109+0000","last_fullsized":"2024-09-19T11:59:32.852109+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:39.500525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080024,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":43,"num_read_kb":1085,"num_write":109,"num_write_kb":1065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.788881+0000","last_change":"2024-09-19T11:35:33.613879+0000","last_active":"2024-09-19T11:58:56.788881+0000","last_peered":"2024-09-19T11:58:56.788881+0000","last_clean":"2024-09-19T11:58:56.788881+0000","last_became_active":"2024-09-19T11:35:33.612924+0000","last_became_peered":"2024-09-19T11:35:33.612924+0000","last_unstale":"2024-09-19T11:58:56.788881+0000","last_undegraded":"2024-09-19T11:58:56.788881+0000","last_fullsized":"2024-09-19T11:58:56.788881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:49.021618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'51","reported_seq":564,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:31.639122+0000","last_change":"2024-09-19T11:35:31.581801+0000","last_active":"2024-09-19T12:02:31.639122+0000","last_peered":"2024-09-19T12:02:31.639122+0000","last_clean":"2024-09-19T12:02:31.639122+0000","last_became_active":"2024-09-19T11:35:31.581058+0000","last_became_peered":"2024-09-19T11:35:31.581058+0000","last_unstale":"2024-09-19T12:02:31.639122+0000","last_undegraded":"2024-09-19T12:02:31.639122+0000","last_fullsized":"2024-09-19T12:02:31.639122+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:01.730787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246431,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":78,"num_read_kb":310,"num_write":188,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'63","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603171+0000","last_change":"2024-09-19T11:35:33.628641+0000","last_active":"2024-09-19T12:00:26.603171+0000","last_peered":"2024-09-19T12:00:26.603171+0000","last_clean":"2024-09-19T12:00:26.603171+0000","last_became_active":"2024-09-19T11:35:33.628335+0000","last_became_peered":"2024-09-19T11:35:33.628335+0000","last_unstale":"2024-09-19T12:00:26.603171+0000","last_undegraded":"2024-09-19T12:00:26.603171+0000","last_fullsized":"2024-09-19T12:00:26.603171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:30.155543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":184,"num_write":116,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'35","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.612851+0000","last_change":"2024-09-19T11:35:31.624411+0000","last_active":"2024-09-19T12:00:16.612851+0000","last_peered":"2024-09-19T12:00:16.612851+0000","last_clean":"2024-09-19T12:00:16.612851+0000","last_became_active":"2024-09-19T11:35:31.623733+0000","last_became_peered":"2024-09-19T11:35:31.623733+0000","last_unstale":"2024-09-19T12:00:16.612851+0000","last_undegraded":"2024-09-19T12:00:16.612851+0000","last_fullsized":"2024-09-19T12:00:16.612851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:54.808464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159980,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":69,"num_read_kb":2163,"num_write":158,"num_write_kb":2120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'85","reported_seq":599,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807456+0000","last_change":"2024-09-19T11:35:33.628930+0000","last_active":"2024-09-19T12:00:21.807456+0000","last_peered":"2024-09-19T12:00:21.807456+0000","last_clean":"2024-09-19T12:00:21.807456+0000","last_became_active":"2024-09-19T11:35:33.628184+0000","last_became_peered":"2024-09-19T11:35:33.628184+0000","last_unstale":"2024-09-19T12:00:21.807456+0000","last_undegraded":"2024-09-19T12:00:21.807456+0000","last_fullsized":"2024-09-19T12:00:21.807456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:43.237383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":344,"num_read_kb":269,"num_write":142,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'49","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.614927+0000","last_change":"2024-09-19T11:35:31.613045+0000","last_active":"2024-09-19T12:00:16.614927+0000","last_peered":"2024-09-19T12:00:16.614927+0000","last_clean":"2024-09-19T12:00:16.614927+0000","last_became_active":"2024-09-19T11:35:31.612601+0000","last_became_peered":"2024-09-19T11:35:31.612601+0000","last_unstale":"2024-09-19T12:00:16.614927+0000","last_undegraded":"2024-09-19T12:00:16.614927+0000","last_fullsized":"2024-09-19T12:00:16.614927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:35.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243045,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":69,"num_read_kb":6286,"num_write":164,"num_write_kb":11381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'7","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:25.789799+0000","last_change":"2024-09-19T11:35:33.624908+0000","last_active":"2024-09-19T12:02:25.789799+0000","last_peered":"2024-09-19T12:02:25.789799+0000","last_clean":"2024-09-19T12:02:25.789799+0000","last_became_active":"2024-09-19T11:35:33.624149+0000","last_became_peered":"2024-09-19T11:35:33.624149+0000","last_unstale":"2024-09-19T12:02:25.789799+0000","last_undegraded":"2024-09-19T12:02:25.789799+0000","last_fullsized":"2024-09-19T12:02:25.789799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:05.347375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'27","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.776403+0000","last_change":"2024-09-19T11:35:31.610796+0000","last_active":"2024-09-19T12:02:17.776403+0000","last_peered":"2024-09-19T12:02:17.776403+0000","last_clean":"2024-09-19T12:02:17.776403+0000","last_became_active":"2024-09-19T11:35:31.609885+0000","last_became_peered":"2024-09-19T11:35:31.609885+0000","last_unstale":"2024-09-19T12:02:17.776403+0000","last_undegraded":"2024-09-19T12:02:17.776403+0000","last_fullsized":"2024-09-19T12:02:17.776403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:34:42.272784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49273,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":83,"num_write":112,"num_write_kb":10337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'127","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.616101+0000","last_change":"2024-09-19T11:35:33.620724+0000","last_active":"2024-09-19T12:00:21.616101+0000","last_peered":"2024-09-19T12:00:21.616101+0000","last_clean":"2024-09-19T12:00:21.616101+0000","last_became_active":"2024-09-19T11:35:33.620326+0000","last_became_peered":"2024-09-19T11:35:33.620326+0000","last_unstale":"2024-09-19T12:00:21.616101+0000","last_undegraded":"2024-09-19T12:00:21.616101+0000","last_fullsized":"2024-09-19T12:00:21.616101+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:14.282141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":393,"num_write":181,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'37","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.608995+0000","last_change":"2024-09-19T11:35:31.625519+0000","last_active":"2024-09-19T12:02:32.608995+0000","last_peered":"2024-09-19T12:02:32.608995+0000","last_clean":"2024-09-19T12:02:32.608995+0000","last_became_active":"2024-09-19T11:35:31.620566+0000","last_became_peered":"2024-09-19T11:35:31.620566+0000","last_unstale":"2024-09-19T12:02:32.608995+0000","last_undegraded":"2024-09-19T12:02:32.608995+0000","last_fullsized":"2024-09-19T12:02:32.608995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:37.899900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":194,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'47","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.610388+0000","last_change":"2024-09-19T11:35:33.618657+0000","last_active":"2024-09-19T12:00:21.610388+0000","last_peered":"2024-09-19T12:00:21.610388+0000","last_clean":"2024-09-19T12:00:21.610388+0000","last_became_active":"2024-09-19T11:35:33.618247+0000","last_became_peered":"2024-09-19T11:35:33.618247+0000","last_unstale":"2024-09-19T12:00:21.610388+0000","last_undegraded":"2024-09-19T12:00:21.610388+0000","last_fullsized":"2024-09-19T12:00:21.610388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:16.980284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":141,"num_write":67,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'16","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:33.206831+0000","last_change":"2024-09-19T11:35:31.602891+0000","last_active":"2024-09-19T11:59:33.206831+0000","last_peered":"2024-09-19T11:59:33.206831+0000","last_clean":"2024-09-19T11:59:33.206831+0000","last_became_active":"2024-09-19T11:35:31.602248+0000","last_became_peered":"2024-09-19T11:35:31.602248+0000","last_unstale":"2024-09-19T11:59:33.206831+0000","last_undegraded":"2024-09-19T11:59:33.206831+0000","last_fullsized":"2024-09-19T11:59:33.206831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:05.964360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242991,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":21,"num_read_kb":5134,"num_write":70,"num_write_kb":5127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'37","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.376218+0000","last_change":"2024-09-19T11:35:33.625242+0000","last_active":"2024-09-19T12:02:19.376218+0000","last_peered":"2024-09-19T12:02:19.376218+0000","last_clean":"2024-09-19T12:02:19.376218+0000","last_became_active":"2024-09-19T11:35:33.624412+0000","last_became_peered":"2024-09-19T11:35:33.624412+0000","last_unstale":"2024-09-19T12:02:19.376218+0000","last_undegraded":"2024-09-19T12:02:19.376218+0000","last_fullsized":"2024-09-19T12:02:19.376218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:08.098513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":98,"num_write":42,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'24","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.474637+0000","last_change":"2024-09-19T11:35:31.609553+0000","last_active":"2024-09-19T12:02:32.474637+0000","last_peered":"2024-09-19T12:02:32.474637+0000","last_clean":"2024-09-19T12:02:32.474637+0000","last_became_active":"2024-09-19T11:35:31.607037+0000","last_became_peered":"2024-09-19T11:35:31.607037+0000","last_unstale":"2024-09-19T12:02:32.474637+0000","last_undegraded":"2024-09-19T12:02:32.474637+0000","last_fullsized":"2024-09-19T12:02:32.474637+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:33.501423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14288,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":45,"num_read_kb":53,"num_write":109,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'34","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.297625+0000","last_change":"2024-09-19T11:35:31.608404+0000","last_active":"2024-09-19T12:00:06.297625+0000","last_peered":"2024-09-19T12:00:06.297625+0000","last_clean":"2024-09-19T12:00:06.297625+0000","last_became_active":"2024-09-19T11:35:31.607805+0000","last_became_peered":"2024-09-19T11:35:31.607805+0000","last_unstale":"2024-09-19T12:00:06.297625+0000","last_undegraded":"2024-09-19T12:00:06.297625+0000","last_fullsized":"2024-09-19T12:00:06.297625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:55.223047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":82,"num_read_kb":66,"num_write":139,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.609215+0000","last_change":"2024-09-19T11:35:33.630383+0000","last_active":"2024-09-19T11:59:51.609215+0000","last_peered":"2024-09-19T11:59:51.609215+0000","last_clean":"2024-09-19T11:59:51.609215+0000","last_became_active":"2024-09-19T11:35:33.630100+0000","last_became_peered":"2024-09-19T11:35:33.630100+0000","last_unstale":"2024-09-19T11:59:51.609215+0000","last_undegraded":"2024-09-19T11:59:51.609215+0000","last_fullsized":"2024-09-19T11:59:51.609215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:23.578224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'23","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:54.759205+0000","last_change":"2024-09-19T11:35:31.588948+0000","last_active":"2024-09-19T11:58:54.759205+0000","last_peered":"2024-09-19T11:58:54.759205+0000","last_clean":"2024-09-19T11:58:54.759205+0000","last_became_active":"2024-09-19T11:35:31.588328+0000","last_became_peered":"2024-09-19T11:35:31.588328+0000","last_unstale":"2024-09-19T11:58:54.759205+0000","last_undegraded":"2024-09-19T11:58:54.759205+0000","last_fullsized":"2024-09-19T11:58:54.759205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:49.468879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":47,"num_read_kb":33,"num_write":105,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'232","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:43.939022+0000","last_change":"2024-09-19T11:35:33.612825+0000","last_active":"2024-09-19T12:01:43.939022+0000","last_peered":"2024-09-19T12:01:43.939022+0000","last_clean":"2024-09-19T12:01:43.939022+0000","last_became_active":"2024-09-19T11:35:33.612152+0000","last_became_peered":"2024-09-19T11:35:33.612152+0000","last_unstale":"2024-09-19T12:01:43.939022+0000","last_undegraded":"2024-09-19T12:01:43.939022+0000","last_fullsized":"2024-09-19T12:01:43.939022+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:31.538563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":962,"num_read_kb":742,"num_write":392,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1228,"num_read_kb":871,"num_write":344,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":8631,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2810,"num_read_kb":2559,"num_write":1797,"num_write_kb":496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":17262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":694,"ondisk_log_size":694,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":326267,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":4380,"num_read_kb":5764,"num_write":2905,"num_write_kb":1322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":349768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1960,"ondisk_log_size":1960,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2072,"num_read_kb":2467,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":14003,"num_read_kb":11442,"num_write":5494,"num_write_kb":2900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2398,"ondisk_log_size":2398,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":124933376,"num_objects":759,"num_object_clones":0,"num_object_copies":3036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":759,"num_whiteouts":0,"num_read":4515,"num_read_kb":236972,"num_write":9401,"num_write_kb":271206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":175980544,"data_stored":175980544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2304,"ondisk_log_size":2304,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":67110910,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":70,"num_read_kb":114690,"num_write":62,"num_write_kb":65538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134225920,"data_stored":134221820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":67110910,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":73,"num_read_kb":120834,"num_write":62,"num_write_kb":65538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134225920,"data_stored":134221820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542482,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243964,"kb_used_data":54508,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":94127876,"statfs":{"total":96636764160,"available":96386945024,"internally_reserved":0,"allocated":55816192,"data_stored":53814603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":193984970},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542481,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256008,"kb_used_data":66552,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":94115832,"statfs":{"total":96636764160,"available":96374611968,"internally_reserved":0,"allocated":68149248,"data_stored":66188937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":193984966},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542482,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81616,"kb_used_data":32384,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94290224,"statfs":{"total":96636764160,"available":96553189376,"internally_reserved":0,"allocated":33161216,"data_stored":31140925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542484,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126296,"kb_used_data":68744,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94245544,"statfs":{"total":96636764160,"available":96507437056,"internally_reserved":0,"allocated":70393856,"data_stored":68485861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542482,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":234436,"kb_used_data":58868,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":94137404,"statfs":{"total":96636764160,"available":96396701696,"internally_reserved":0,"allocated":60280832,"data_stored":58295358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179763655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542482,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87992,"kb_used_data":38760,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94283848,"statfs":{"total":96636764160,"available":96546660352,"internally_reserved":0,"allocated":39690240,"data_stored":37772067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542481,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152040,"kb_used_data":58456,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94219800,"statfs":{"total":96636764160,"available":96481075200,"internally_reserved":0,"allocated":59858944,"data_stored":57891099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542483,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":90216,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":92381184,"data_stored":90413428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212400581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24608768,"data_stored":24608768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23085056,"data_stored":23085056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17670144,"data_stored":17670144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":22417408,"data_stored":22417408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":21131264,"data_stored":21131264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23576576,"data_stored":23576576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24047616,"data_stored":24047616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":19443712,"data_stored":19443712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":42918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":45449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":20534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":65245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":9095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":65394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":33840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":67293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16779262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17829888,"data_stored":17827838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16779262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28311552,"data_stored":28311552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22024192,"data_stored":22022142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T12:03:06.804 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T12:03:06.805 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T12:03:07.168 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T12:03:07.179 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T12:03:07.182 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":1094,"stamp":"2024-09-19T12:03:05.384692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":260082274,"num_objects":1039,"num_object_clones":0,"num_object_copies":3596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1039,"num_whiteouts":0,"num_read":29217,"num_read_kb":495654,"num_write":20190,"num_write_kb":408755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7769,"ondisk_log_size":7769,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1480008,"kb_used_data":468488,"kb_used_omap":12,"kb_used_meta":1011379,"kb_avail":753494712,"statfs":{"total":773094113280,"available":771578585088,"internally_reserved":0,"allocated":479731712,"data_stored":464002278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1035652656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008657"},"pg_stats":[{"pgid":"67.1d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.590975+0000","last_change":"2024-09-19T11:53:37.745334+0000","last_active":"2024-09-19T11:58:36.590975+0000","last_peered":"2024-09-19T11:58:36.590975+0000","last_clean":"2024-09-19T11:58:36.590975+0000","last_became_active":"2024-09-19T11:53:37.744679+0000","last_became_peered":"2024-09-19T11:53:37.744679+0000","last_unstale":"2024-09-19T11:58:36.590975+0000","last_undegraded":"2024-09-19T11:58:36.590975+0000","last_fullsized":"2024-09-19T11:58:36.590975+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:29.888364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.586691+0000","last_change":"2024-09-19T11:53:34.715828+0000","last_active":"2024-09-19T11:58:36.586691+0000","last_peered":"2024-09-19T11:58:36.586691+0000","last_clean":"2024-09-19T11:58:36.586691+0000","last_became_active":"2024-09-19T11:53:34.714946+0000","last_became_peered":"2024-09-19T11:53:34.714946+0000","last_unstale":"2024-09-19T11:58:36.586691+0000","last_undegraded":"2024-09-19T11:58:36.586691+0000","last_fullsized":"2024-09-19T11:58:36.586691+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:46.457012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"256'14","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.615105+0000","last_change":"2024-09-19T11:51:53.494561+0000","last_active":"2024-09-19T12:00:16.615105+0000","last_peered":"2024-09-19T12:00:16.615105+0000","last_clean":"2024-09-19T12:00:16.615105+0000","last_became_active":"2024-09-19T11:51:53.493294+0000","last_became_peered":"2024-09-19T11:51:53.493294+0000","last_unstale":"2024-09-19T12:00:16.615105+0000","last_undegraded":"2024-09-19T12:00:16.615105+0000","last_fullsized":"2024-09-19T12:00:16.615105+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:25.608106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":86,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.785305+0000","last_change":"2024-09-19T11:53:37.715171+0000","last_active":"2024-09-19T11:58:41.785305+0000","last_peered":"2024-09-19T11:58:41.785305+0000","last_clean":"2024-09-19T11:58:41.785305+0000","last_became_active":"2024-09-19T11:53:37.714526+0000","last_became_peered":"2024-09-19T11:53:37.714526+0000","last_unstale":"2024-09-19T11:58:41.785305+0000","last_undegraded":"2024-09-19T11:58:41.785305+0000","last_fullsized":"2024-09-19T11:58:41.785305+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:47:00.837259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.579334+0000","last_change":"2024-09-19T11:53:34.730623+0000","last_active":"2024-09-19T11:58:36.579334+0000","last_peered":"2024-09-19T11:58:36.579334+0000","last_clean":"2024-09-19T11:58:36.579334+0000","last_became_active":"2024-09-19T11:53:34.730025+0000","last_became_peered":"2024-09-19T11:53:34.730025+0000","last_unstale":"2024-09-19T11:58:36.579334+0000","last_undegraded":"2024-09-19T11:58:36.579334+0000","last_fullsized":"2024-09-19T11:58:36.579334+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:52.233686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.596619+0000","last_change":"2024-09-19T11:51:53.495233+0000","last_active":"2024-09-19T11:59:56.596619+0000","last_peered":"2024-09-19T11:59:56.596619+0000","last_clean":"2024-09-19T11:59:56.596619+0000","last_became_active":"2024-09-19T11:51:53.494552+0000","last_became_peered":"2024-09-19T11:51:53.494552+0000","last_unstale":"2024-09-19T11:59:56.596619+0000","last_undegraded":"2024-09-19T11:59:56.596619+0000","last_fullsized":"2024-09-19T11:59:56.596619+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:17.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.610306+0000","last_change":"2024-09-19T11:53:37.760242+0000","last_active":"2024-09-19T11:59:56.610306+0000","last_peered":"2024-09-19T11:59:56.610306+0000","last_clean":"2024-09-19T11:59:56.610306+0000","last_became_active":"2024-09-19T11:53:37.757767+0000","last_became_peered":"2024-09-19T11:53:37.757767+0000","last_unstale":"2024-09-19T11:59:56.610306+0000","last_undegraded":"2024-09-19T11:59:56.610306+0000","last_fullsized":"2024-09-19T11:59:56.610306+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:53:27.455399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.592459+0000","last_change":"2024-09-19T11:53:34.712290+0000","last_active":"2024-09-19T11:59:36.592459+0000","last_peered":"2024-09-19T11:59:36.592459+0000","last_clean":"2024-09-19T11:59:36.592459+0000","last_became_active":"2024-09-19T11:53:34.711510+0000","last_became_peered":"2024-09-19T11:53:34.711510+0000","last_unstale":"2024-09-19T11:59:36.592459+0000","last_undegraded":"2024-09-19T11:59:36.592459+0000","last_fullsized":"2024-09-19T11:59:36.592459+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:51.007502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.603011+0000","last_change":"2024-09-19T11:51:53.480345+0000","last_active":"2024-09-19T11:59:26.603011+0000","last_peered":"2024-09-19T11:59:26.603011+0000","last_clean":"2024-09-19T11:59:26.603011+0000","last_became_active":"2024-09-19T11:51:53.479659+0000","last_became_peered":"2024-09-19T11:51:53.479659+0000","last_unstale":"2024-09-19T11:59:26.603011+0000","last_undegraded":"2024-09-19T11:59:26.603011+0000","last_fullsized":"2024-09-19T11:59:26.603011+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:02.230797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.601507+0000","last_change":"2024-09-19T11:53:37.758685+0000","last_active":"2024-09-19T11:59:41.601507+0000","last_peered":"2024-09-19T11:59:41.601507+0000","last_clean":"2024-09-19T11:59:41.601507+0000","last_became_active":"2024-09-19T11:53:37.756047+0000","last_became_peered":"2024-09-19T11:53:37.756047+0000","last_unstale":"2024-09-19T11:59:41.601507+0000","last_undegraded":"2024-09-19T11:59:41.601507+0000","last_fullsized":"2024-09-19T11:59:41.601507+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:44.645097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"262'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.800925+0000","last_change":"2024-09-19T11:53:34.706109+0000","last_active":"2024-09-19T11:59:51.800925+0000","last_peered":"2024-09-19T11:59:51.800925+0000","last_clean":"2024-09-19T11:59:51.800925+0000","last_became_active":"2024-09-19T11:53:34.705364+0000","last_became_peered":"2024-09-19T11:53:34.705364+0000","last_unstale":"2024-09-19T11:59:51.800925+0000","last_undegraded":"2024-09-19T11:59:51.800925+0000","last_fullsized":"2024-09-19T11:59:51.800925+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:58:24.677448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.597881+0000","last_change":"2024-09-19T11:51:53.477170+0000","last_active":"2024-09-19T11:59:26.597881+0000","last_peered":"2024-09-19T11:59:26.597881+0000","last_clean":"2024-09-19T11:59:26.597881+0000","last_became_active":"2024-09-19T11:51:53.475807+0000","last_became_peered":"2024-09-19T11:51:53.475807+0000","last_unstale":"2024-09-19T11:59:26.597881+0000","last_undegraded":"2024-09-19T11:59:26.597881+0000","last_fullsized":"2024-09-19T11:59:26.597881+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:44.084226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.589586+0000","last_change":"2024-09-19T11:53:37.733871+0000","last_active":"2024-09-19T11:58:31.589586+0000","last_peered":"2024-09-19T11:58:31.589586+0000","last_clean":"2024-09-19T11:58:31.589586+0000","last_became_active":"2024-09-19T11:53:37.733244+0000","last_became_peered":"2024-09-19T11:53:37.733244+0000","last_unstale":"2024-09-19T11:58:31.589586+0000","last_undegraded":"2024-09-19T11:58:31.589586+0000","last_fullsized":"2024-09-19T11:58:31.589586+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:59.898211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.589239+0000","last_change":"2024-09-19T11:53:34.723027+0000","last_active":"2024-09-19T11:58:26.589239+0000","last_peered":"2024-09-19T11:58:26.589239+0000","last_clean":"2024-09-19T11:58:26.589239+0000","last_became_active":"2024-09-19T11:53:34.722143+0000","last_became_peered":"2024-09-19T11:53:34.722143+0000","last_unstale":"2024-09-19T11:58:26.589239+0000","last_undegraded":"2024-09-19T11:58:26.589239+0000","last_fullsized":"2024-09-19T11:58:26.589239+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:35.362037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"256'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.597786+0000","last_change":"2024-09-19T11:51:53.497903+0000","last_active":"2024-09-19T11:59:26.597786+0000","last_peered":"2024-09-19T11:59:26.597786+0000","last_clean":"2024-09-19T11:59:26.597786+0000","last_became_active":"2024-09-19T11:51:53.496828+0000","last_became_peered":"2024-09-19T11:51:53.496828+0000","last_unstale":"2024-09-19T11:59:26.597786+0000","last_undegraded":"2024-09-19T11:59:26.597786+0000","last_fullsized":"2024-09-19T11:59:26.597786+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:33:53.888475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.18","version":"262'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.590468+0000","last_change":"2024-09-19T11:53:37.752259+0000","last_active":"2024-09-19T11:58:31.590468+0000","last_peered":"2024-09-19T11:58:31.590468+0000","last_clean":"2024-09-19T11:58:31.590468+0000","last_became_active":"2024-09-19T11:53:37.751550+0000","last_became_peered":"2024-09-19T11:53:37.751550+0000","last_unstale":"2024-09-19T11:58:31.590468+0000","last_undegraded":"2024-09-19T11:58:31.590468+0000","last_fullsized":"2024-09-19T11:58:31.590468+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:24.886099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":20480,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"262'1","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.781501+0000","last_change":"2024-09-19T11:53:34.700220+0000","last_active":"2024-09-19T11:58:26.781501+0000","last_peered":"2024-09-19T11:58:26.781501+0000","last_clean":"2024-09-19T11:58:26.781501+0000","last_became_active":"2024-09-19T11:53:34.699476+0000","last_became_peered":"2024-09-19T11:53:34.699476+0000","last_unstale":"2024-09-19T11:58:26.781501+0000","last_undegraded":"2024-09-19T11:58:26.781501+0000","last_fullsized":"2024-09-19T11:58:26.781501+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:31.463060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2046,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.602602+0000","last_change":"2024-09-19T11:51:53.469668+0000","last_active":"2024-09-19T11:59:26.602602+0000","last_peered":"2024-09-19T11:59:26.602602+0000","last_clean":"2024-09-19T11:59:26.602602+0000","last_became_active":"2024-09-19T11:51:53.468220+0000","last_became_peered":"2024-09-19T11:51:53.468220+0000","last_unstale":"2024-09-19T11:59:26.602602+0000","last_undegraded":"2024-09-19T11:59:26.602602+0000","last_fullsized":"2024-09-19T11:59:26.602602+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:15.153859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.592905+0000","last_change":"2024-09-19T11:53:37.734780+0000","last_active":"2024-09-19T11:58:41.592905+0000","last_peered":"2024-09-19T11:58:41.592905+0000","last_clean":"2024-09-19T11:58:41.592905+0000","last_became_active":"2024-09-19T11:53:37.733461+0000","last_became_peered":"2024-09-19T11:53:37.733461+0000","last_unstale":"2024-09-19T11:58:41.592905+0000","last_undegraded":"2024-09-19T11:58:41.592905+0000","last_fullsized":"2024-09-19T11:58:41.592905+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:09.138836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.784017+0000","last_change":"2024-09-19T11:53:34.711700+0000","last_active":"2024-09-19T11:58:36.784017+0000","last_peered":"2024-09-19T11:58:36.784017+0000","last_clean":"2024-09-19T11:58:36.784017+0000","last_became_active":"2024-09-19T11:53:34.711125+0000","last_became_peered":"2024-09-19T11:53:34.711125+0000","last_unstale":"2024-09-19T11:58:36.784017+0000","last_undegraded":"2024-09-19T11:58:36.784017+0000","last_fullsized":"2024-09-19T11:58:36.784017+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:23.766743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.599515+0000","last_change":"2024-09-19T11:51:53.498330+0000","last_active":"2024-09-19T11:59:11.599515+0000","last_peered":"2024-09-19T11:59:11.599515+0000","last_clean":"2024-09-19T11:59:11.599515+0000","last_became_active":"2024-09-19T11:51:53.497559+0000","last_became_peered":"2024-09-19T11:51:53.497559+0000","last_unstale":"2024-09-19T11:59:11.599515+0000","last_undegraded":"2024-09-19T11:59:11.599515+0000","last_fullsized":"2024-09-19T11:59:11.599515+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:57.123428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.587788+0000","last_change":"2024-09-19T11:53:37.760079+0000","last_active":"2024-09-19T11:58:41.587788+0000","last_peered":"2024-09-19T11:58:41.587788+0000","last_clean":"2024-09-19T11:58:41.587788+0000","last_became_active":"2024-09-19T11:53:37.759079+0000","last_became_peered":"2024-09-19T11:53:37.759079+0000","last_unstale":"2024-09-19T11:58:41.587788+0000","last_undegraded":"2024-09-19T11:58:41.587788+0000","last_fullsized":"2024-09-19T11:58:41.587788+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:55.874038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.592016+0000","last_change":"2024-09-19T11:53:34.732158+0000","last_active":"2024-09-19T11:58:36.592016+0000","last_peered":"2024-09-19T11:58:36.592016+0000","last_clean":"2024-09-19T11:58:36.592016+0000","last_became_active":"2024-09-19T11:53:34.722675+0000","last_became_peered":"2024-09-19T11:53:34.722675+0000","last_unstale":"2024-09-19T11:58:36.592016+0000","last_undegraded":"2024-09-19T11:58:36.592016+0000","last_fullsized":"2024-09-19T11:58:36.592016+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:13.301780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":21504,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.586361+0000","last_change":"2024-09-19T11:51:53.486009+0000","last_active":"2024-09-19T11:59:11.586361+0000","last_peered":"2024-09-19T11:59:11.586361+0000","last_clean":"2024-09-19T11:59:11.586361+0000","last_became_active":"2024-09-19T11:51:53.485176+0000","last_became_peered":"2024-09-19T11:51:53.485176+0000","last_unstale":"2024-09-19T11:59:11.586361+0000","last_undegraded":"2024-09-19T11:59:11.586361+0000","last_fullsized":"2024-09-19T11:59:11.586361+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:32.437601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.585506+0000","last_change":"2024-09-19T11:53:37.738229+0000","last_active":"2024-09-19T11:58:31.585506+0000","last_peered":"2024-09-19T11:58:31.585506+0000","last_clean":"2024-09-19T11:58:31.585506+0000","last_became_active":"2024-09-19T11:53:37.735681+0000","last_became_peered":"2024-09-19T11:53:37.735681+0000","last_unstale":"2024-09-19T11:58:31.585506+0000","last_undegraded":"2024-09-19T11:58:31.585506+0000","last_fullsized":"2024-09-19T11:58:31.585506+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:26.373362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619176+0000","last_change":"2024-09-19T11:53:34.709295+0000","last_active":"2024-09-19T12:00:41.619176+0000","last_peered":"2024-09-19T12:00:41.619176+0000","last_clean":"2024-09-19T12:00:41.619176+0000","last_became_active":"2024-09-19T11:53:34.708831+0000","last_became_peered":"2024-09-19T11:53:34.708831+0000","last_unstale":"2024-09-19T12:00:41.619176+0000","last_undegraded":"2024-09-19T12:00:41.619176+0000","last_fullsized":"2024-09-19T12:00:41.619176+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:25.795767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.599708+0000","last_change":"2024-09-19T11:51:53.499050+0000","last_active":"2024-09-19T11:59:11.599708+0000","last_peered":"2024-09-19T11:59:11.599708+0000","last_clean":"2024-09-19T11:59:11.599708+0000","last_became_active":"2024-09-19T11:51:53.498327+0000","last_became_peered":"2024-09-19T11:51:53.498327+0000","last_unstale":"2024-09-19T11:59:11.599708+0000","last_undegraded":"2024-09-19T11:59:11.599708+0000","last_fullsized":"2024-09-19T11:59:11.599708+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:49.722787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615207+0000","last_change":"2024-09-19T11:53:37.755767+0000","last_active":"2024-09-19T12:00:41.615207+0000","last_peered":"2024-09-19T12:00:41.615207+0000","last_clean":"2024-09-19T12:00:41.615207+0000","last_became_active":"2024-09-19T11:53:37.754753+0000","last_became_peered":"2024-09-19T11:53:37.754753+0000","last_unstale":"2024-09-19T12:00:41.615207+0000","last_undegraded":"2024-09-19T12:00:41.615207+0000","last_fullsized":"2024-09-19T12:00:41.615207+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:22.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.592245+0000","last_change":"2024-09-19T11:53:34.720643+0000","last_active":"2024-09-19T11:58:26.592245+0000","last_peered":"2024-09-19T11:58:26.592245+0000","last_clean":"2024-09-19T11:58:26.592245+0000","last_became_active":"2024-09-19T11:53:34.720273+0000","last_became_peered":"2024-09-19T11:53:34.720273+0000","last_unstale":"2024-09-19T11:58:26.592245+0000","last_undegraded":"2024-09-19T11:58:26.592245+0000","last_fullsized":"2024-09-19T11:58:26.592245+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:26.226182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"255'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.594417+0000","last_change":"2024-09-19T11:51:53.497665+0000","last_active":"2024-09-19T11:59:11.594417+0000","last_peered":"2024-09-19T11:59:11.594417+0000","last_clean":"2024-09-19T11:59:11.594417+0000","last_became_active":"2024-09-19T11:51:53.496988+0000","last_became_peered":"2024-09-19T11:51:53.496988+0000","last_unstale":"2024-09-19T11:59:11.594417+0000","last_undegraded":"2024-09-19T11:59:11.594417+0000","last_fullsized":"2024-09-19T11:59:11.594417+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:42.583270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.17","version":"262'3","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.585554+0000","last_change":"2024-09-19T11:53:37.759921+0000","last_active":"2024-09-19T11:58:31.585554+0000","last_peered":"2024-09-19T11:58:31.585554+0000","last_clean":"2024-09-19T11:58:31.585554+0000","last_became_active":"2024-09-19T11:53:37.759275+0000","last_became_peered":"2024-09-19T11:53:37.759275+0000","last_unstale":"2024-09-19T11:58:31.585554+0000","last_undegraded":"2024-09-19T11:58:31.585554+0000","last_fullsized":"2024-09-19T11:58:31.585554+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:06.314026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":4096,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.578842+0000","last_change":"2024-09-19T11:53:34.700207+0000","last_active":"2024-09-19T11:58:26.578842+0000","last_peered":"2024-09-19T11:58:26.578842+0000","last_clean":"2024-09-19T11:58:26.578842+0000","last_became_active":"2024-09-19T11:53:34.699437+0000","last_became_peered":"2024-09-19T11:53:34.699437+0000","last_unstale":"2024-09-19T11:58:26.578842+0000","last_undegraded":"2024-09-19T11:58:26.578842+0000","last_fullsized":"2024-09-19T11:58:26.578842+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:54:30.963407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"256'23","reported_seq":100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.587246+0000","last_change":"2024-09-19T11:51:53.479917+0000","last_active":"2024-09-19T11:59:11.587246+0000","last_peered":"2024-09-19T11:59:11.587246+0000","last_clean":"2024-09-19T11:59:11.587246+0000","last_became_active":"2024-09-19T11:51:53.478643+0000","last_became_peered":"2024-09-19T11:51:53.478643+0000","last_unstale":"2024-09-19T11:59:11.587246+0000","last_undegraded":"2024-09-19T11:59:11.587246+0000","last_fullsized":"2024-09-19T11:59:11.587246+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:31.580713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":169,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.782900+0000","last_change":"2024-09-19T11:53:37.737666+0000","last_active":"2024-09-19T11:58:31.782900+0000","last_peered":"2024-09-19T11:58:31.782900+0000","last_clean":"2024-09-19T11:58:31.782900+0000","last_became_active":"2024-09-19T11:53:37.737215+0000","last_became_peered":"2024-09-19T11:53:37.737215+0000","last_unstale":"2024-09-19T11:58:31.782900+0000","last_undegraded":"2024-09-19T11:58:31.782900+0000","last_fullsized":"2024-09-19T11:58:31.782900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:58.237583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"262'4","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.589560+0000","last_change":"2024-09-19T11:53:34.732001+0000","last_active":"2024-09-19T11:58:26.589560+0000","last_peered":"2024-09-19T11:58:26.589560+0000","last_clean":"2024-09-19T11:58:26.589560+0000","last_became_active":"2024-09-19T11:53:34.723850+0000","last_became_peered":"2024-09-19T11:53:34.723850+0000","last_unstale":"2024-09-19T11:58:26.589560+0000","last_undegraded":"2024-09-19T11:58:26.589560+0000","last_fullsized":"2024-09-19T11:58:26.589560+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:50:09.990299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599872+0000","last_change":"2024-09-19T11:51:53.479627+0000","last_active":"2024-09-19T11:58:56.599872+0000","last_peered":"2024-09-19T11:58:56.599872+0000","last_clean":"2024-09-19T11:58:56.599872+0000","last_became_active":"2024-09-19T11:51:53.478922+0000","last_became_peered":"2024-09-19T11:51:53.478922+0000","last_unstale":"2024-09-19T11:58:56.599872+0000","last_undegraded":"2024-09-19T11:58:56.599872+0000","last_fullsized":"2024-09-19T11:58:56.599872+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:56.192816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607351+0000","last_change":"2024-09-19T11:53:37.742835+0000","last_active":"2024-09-19T12:00:41.607351+0000","last_peered":"2024-09-19T12:00:41.607351+0000","last_clean":"2024-09-19T12:00:41.607351+0000","last_became_active":"2024-09-19T11:53:37.734844+0000","last_became_peered":"2024-09-19T11:53:37.734844+0000","last_unstale":"2024-09-19T12:00:41.607351+0000","last_undegraded":"2024-09-19T12:00:41.607351+0000","last_fullsized":"2024-09-19T12:00:41.607351+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:22.920456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810733+0000","last_change":"2024-09-19T11:53:34.707106+0000","last_active":"2024-09-19T12:00:36.810733+0000","last_peered":"2024-09-19T12:00:36.810733+0000","last_clean":"2024-09-19T12:00:36.810733+0000","last_became_active":"2024-09-19T11:53:34.704150+0000","last_became_peered":"2024-09-19T11:53:34.704150+0000","last_unstale":"2024-09-19T12:00:36.810733+0000","last_undegraded":"2024-09-19T12:00:36.810733+0000","last_fullsized":"2024-09-19T12:00:36.810733+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:33.641088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599814+0000","last_change":"2024-09-19T11:51:53.481885+0000","last_active":"2024-09-19T11:58:56.599814+0000","last_peered":"2024-09-19T11:58:56.599814+0000","last_clean":"2024-09-19T11:58:56.599814+0000","last_became_active":"2024-09-19T11:51:53.481154+0000","last_became_peered":"2024-09-19T11:51:53.481154+0000","last_unstale":"2024-09-19T11:58:56.599814+0000","last_undegraded":"2024-09-19T11:58:56.599814+0000","last_fullsized":"2024-09-19T11:58:56.599814+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:33.647811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607252+0000","last_change":"2024-09-19T11:53:37.731071+0000","last_active":"2024-09-19T12:00:41.607252+0000","last_peered":"2024-09-19T12:00:41.607252+0000","last_clean":"2024-09-19T12:00:41.607252+0000","last_became_active":"2024-09-19T11:53:37.730152+0000","last_became_peered":"2024-09-19T11:53:37.730152+0000","last_unstale":"2024-09-19T12:00:41.607252+0000","last_undegraded":"2024-09-19T12:00:41.607252+0000","last_fullsized":"2024-09-19T12:00:41.607252+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:14:21.099777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.613805+0000","last_change":"2024-09-19T11:53:34.704187+0000","last_active":"2024-09-19T12:00:36.613805+0000","last_peered":"2024-09-19T12:00:36.613805+0000","last_clean":"2024-09-19T12:00:36.613805+0000","last_became_active":"2024-09-19T11:53:34.703463+0000","last_became_peered":"2024-09-19T11:53:34.703463+0000","last_unstale":"2024-09-19T12:00:36.613805+0000","last_undegraded":"2024-09-19T12:00:36.613805+0000","last_fullsized":"2024-09-19T12:00:36.613805+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:28.756801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.595963+0000","last_change":"2024-09-19T11:51:53.491344+0000","last_active":"2024-09-19T11:58:56.595963+0000","last_peered":"2024-09-19T11:58:56.595963+0000","last_clean":"2024-09-19T11:58:56.595963+0000","last_became_active":"2024-09-19T11:51:53.490650+0000","last_became_peered":"2024-09-19T11:51:53.490650+0000","last_unstale":"2024-09-19T11:58:56.595963+0000","last_undegraded":"2024-09-19T11:58:56.595963+0000","last_fullsized":"2024-09-19T11:58:56.595963+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:53.773642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615178+0000","last_change":"2024-09-19T11:53:37.759763+0000","last_active":"2024-09-19T12:00:41.615178+0000","last_peered":"2024-09-19T12:00:41.615178+0000","last_clean":"2024-09-19T12:00:41.615178+0000","last_became_active":"2024-09-19T11:53:37.755628+0000","last_became_peered":"2024-09-19T11:53:37.755628+0000","last_unstale":"2024-09-19T12:00:41.615178+0000","last_undegraded":"2024-09-19T12:00:41.615178+0000","last_fullsized":"2024-09-19T12:00:41.615178+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:25.674366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244926,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5122,"num_write":8,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618477+0000","last_change":"2024-09-19T11:53:34.708167+0000","last_active":"2024-09-19T12:00:36.618477+0000","last_peered":"2024-09-19T12:00:36.618477+0000","last_clean":"2024-09-19T12:00:36.618477+0000","last_became_active":"2024-09-19T11:53:34.707412+0000","last_became_peered":"2024-09-19T11:53:34.707412+0000","last_unstale":"2024-09-19T12:00:36.618477+0000","last_undegraded":"2024-09-19T12:00:36.618477+0000","last_fullsized":"2024-09-19T12:00:36.618477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:27.815287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"256'7","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.788702+0000","last_change":"2024-09-19T11:51:53.464544+0000","last_active":"2024-09-19T11:58:56.788702+0000","last_peered":"2024-09-19T11:58:56.788702+0000","last_clean":"2024-09-19T11:58:56.788702+0000","last_became_active":"2024-09-19T11:51:53.463784+0000","last_became_peered":"2024-09-19T11:51:53.463784+0000","last_unstale":"2024-09-19T11:58:56.788702+0000","last_undegraded":"2024-09-19T11:58:56.788702+0000","last_fullsized":"2024-09-19T11:58:56.788702+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:17.326366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.12","version":"262'2","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619685+0000","last_change":"2024-09-19T11:53:37.744463+0000","last_active":"2024-09-19T12:00:41.619685+0000","last_peered":"2024-09-19T12:00:41.619685+0000","last_clean":"2024-09-19T12:00:41.619685+0000","last_became_active":"2024-09-19T11:53:37.743807+0000","last_became_peered":"2024-09-19T11:53:37.743807+0000","last_unstale":"2024-09-19T12:00:41.619685+0000","last_undegraded":"2024-09-19T12:00:41.619685+0000","last_fullsized":"2024-09-19T12:00:41.619685+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:37.688342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.617873+0000","last_change":"2024-09-19T11:53:34.706511+0000","last_active":"2024-09-19T12:00:36.617873+0000","last_peered":"2024-09-19T12:00:36.617873+0000","last_clean":"2024-09-19T12:00:36.617873+0000","last_became_active":"2024-09-19T11:53:34.705705+0000","last_became_peered":"2024-09-19T11:53:34.705705+0000","last_unstale":"2024-09-19T12:00:36.617873+0000","last_undegraded":"2024-09-19T12:00:36.617873+0000","last_fullsized":"2024-09-19T12:00:36.617873+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:28.349619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.590471+0000","last_change":"2024-09-19T11:51:53.488994+0000","last_active":"2024-09-19T11:58:56.590471+0000","last_peered":"2024-09-19T11:58:56.590471+0000","last_clean":"2024-09-19T11:58:56.590471+0000","last_became_active":"2024-09-19T11:51:53.488252+0000","last_became_peered":"2024-09-19T11:51:53.488252+0000","last_unstale":"2024-09-19T11:58:56.590471+0000","last_undegraded":"2024-09-19T11:58:56.590471+0000","last_fullsized":"2024-09-19T11:58:56.590471+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:14.331678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.d","version":"262'3","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611701+0000","last_change":"2024-09-19T11:53:37.755108+0000","last_active":"2024-09-19T12:00:26.611701+0000","last_peered":"2024-09-19T12:00:26.611701+0000","last_clean":"2024-09-19T12:00:26.611701+0000","last_became_active":"2024-09-19T11:53:37.754497+0000","last_became_peered":"2024-09-19T11:53:37.754497+0000","last_unstale":"2024-09-19T12:00:26.611701+0000","last_undegraded":"2024-09-19T12:00:26.611701+0000","last_fullsized":"2024-09-19T12:00:26.611701+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:38.404433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":20480,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"262'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.618125+0000","last_change":"2024-09-19T11:53:34.721569+0000","last_active":"2024-09-19T12:00:21.618125+0000","last_peered":"2024-09-19T12:00:21.618125+0000","last_clean":"2024-09-19T12:00:21.618125+0000","last_became_active":"2024-09-19T11:53:34.721070+0000","last_became_peered":"2024-09-19T11:53:34.721070+0000","last_unstale":"2024-09-19T12:00:21.618125+0000","last_undegraded":"2024-09-19T12:00:21.618125+0000","last_fullsized":"2024-09-19T12:00:21.618125+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:11.145675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":25600,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"256'23","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.587947+0000","last_change":"2024-09-19T11:51:53.490847+0000","last_active":"2024-09-19T11:58:41.587947+0000","last_peered":"2024-09-19T11:58:41.587947+0000","last_clean":"2024-09-19T11:58:41.587947+0000","last_became_active":"2024-09-19T11:51:53.490074+0000","last_became_peered":"2024-09-19T11:51:53.490074+0000","last_unstale":"2024-09-19T11:58:41.587947+0000","last_undegraded":"2024-09-19T11:58:41.587947+0000","last_fullsized":"2024-09-19T11:58:41.587947+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:25.990044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":156,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611634+0000","last_change":"2024-09-19T11:53:37.759926+0000","last_active":"2024-09-19T12:00:26.611634+0000","last_peered":"2024-09-19T12:00:26.611634+0000","last_clean":"2024-09-19T12:00:26.611634+0000","last_became_active":"2024-09-19T11:53:37.758965+0000","last_became_peered":"2024-09-19T11:53:37.758965+0000","last_unstale":"2024-09-19T12:00:26.611634+0000","last_undegraded":"2024-09-19T12:00:26.611634+0000","last_fullsized":"2024-09-19T12:00:26.611634+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:35.768438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.601997+0000","last_change":"2024-09-19T11:53:34.730214+0000","last_active":"2024-09-19T12:00:21.601997+0000","last_peered":"2024-09-19T12:00:21.601997+0000","last_clean":"2024-09-19T12:00:21.601997+0000","last_became_active":"2024-09-19T11:53:34.729772+0000","last_became_peered":"2024-09-19T11:53:34.729772+0000","last_unstale":"2024-09-19T12:00:21.601997+0000","last_undegraded":"2024-09-19T12:00:21.601997+0000","last_fullsized":"2024-09-19T12:00:21.601997+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:08.302177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.592249+0000","last_change":"2024-09-19T11:51:53.480445+0000","last_active":"2024-09-19T11:58:41.592249+0000","last_peered":"2024-09-19T11:58:41.592249+0000","last_clean":"2024-09-19T11:58:41.592249+0000","last_became_active":"2024-09-19T11:51:53.479490+0000","last_became_peered":"2024-09-19T11:51:53.479490+0000","last_unstale":"2024-09-19T11:58:41.592249+0000","last_undegraded":"2024-09-19T11:58:41.592249+0000","last_fullsized":"2024-09-19T11:58:41.592249+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:37.406182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.605040+0000","last_change":"2024-09-19T11:53:37.731450+0000","last_active":"2024-09-19T12:00:31.605040+0000","last_peered":"2024-09-19T12:00:31.605040+0000","last_clean":"2024-09-19T12:00:31.605040+0000","last_became_active":"2024-09-19T11:53:37.730671+0000","last_became_peered":"2024-09-19T11:53:37.730671+0000","last_unstale":"2024-09-19T12:00:31.605040+0000","last_undegraded":"2024-09-19T12:00:31.605040+0000","last_fullsized":"2024-09-19T12:00:31.605040+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:37.080584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.616273+0000","last_change":"2024-09-19T11:53:34.722175+0000","last_active":"2024-09-19T12:00:21.616273+0000","last_peered":"2024-09-19T12:00:21.616273+0000","last_clean":"2024-09-19T12:00:21.616273+0000","last_became_active":"2024-09-19T11:53:34.720160+0000","last_became_peered":"2024-09-19T11:53:34.720160+0000","last_unstale":"2024-09-19T12:00:21.616273+0000","last_undegraded":"2024-09-19T12:00:21.616273+0000","last_fullsized":"2024-09-19T12:00:21.616273+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:52:58.935663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":4096,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.592954+0000","last_change":"2024-09-19T11:51:53.484469+0000","last_active":"2024-09-19T11:58:41.592954+0000","last_peered":"2024-09-19T11:58:41.592954+0000","last_clean":"2024-09-19T11:58:41.592954+0000","last_became_active":"2024-09-19T11:51:53.483786+0000","last_became_peered":"2024-09-19T11:51:53.483786+0000","last_unstale":"2024-09-19T11:58:41.592954+0000","last_undegraded":"2024-09-19T11:58:41.592954+0000","last_fullsized":"2024-09-19T11:58:41.592954+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:34.978547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611748+0000","last_change":"2024-09-19T11:53:37.745246+0000","last_active":"2024-09-19T12:00:26.611748+0000","last_peered":"2024-09-19T12:00:26.611748+0000","last_clean":"2024-09-19T12:00:26.611748+0000","last_became_active":"2024-09-19T11:53:37.739838+0000","last_became_peered":"2024-09-19T11:53:37.739838+0000","last_unstale":"2024-09-19T12:00:26.611748+0000","last_undegraded":"2024-09-19T12:00:26.611748+0000","last_fullsized":"2024-09-19T12:00:26.611748+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:07.343317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603804+0000","last_change":"2024-09-19T11:53:34.709512+0000","last_active":"2024-09-19T12:00:26.603804+0000","last_peered":"2024-09-19T12:00:26.603804+0000","last_clean":"2024-09-19T12:00:26.603804+0000","last_became_active":"2024-09-19T11:53:34.708542+0000","last_became_peered":"2024-09-19T11:53:34.708542+0000","last_unstale":"2024-09-19T12:00:26.603804+0000","last_undegraded":"2024-09-19T12:00:26.603804+0000","last_fullsized":"2024-09-19T12:00:26.603804+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:09.314949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.581698+0000","last_change":"2024-09-19T11:51:53.479663+0000","last_active":"2024-09-19T11:58:41.581698+0000","last_peered":"2024-09-19T11:58:41.581698+0000","last_clean":"2024-09-19T11:58:41.581698+0000","last_became_active":"2024-09-19T11:51:53.478940+0000","last_became_peered":"2024-09-19T11:51:53.478940+0000","last_unstale":"2024-09-19T11:58:41.581698+0000","last_undegraded":"2024-09-19T11:58:41.581698+0000","last_fullsized":"2024-09-19T11:58:41.581698+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:59.776490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.9","version":"262'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.805174+0000","last_change":"2024-09-19T11:54:08.215698+0000","last_active":"2024-09-19T12:00:11.805174+0000","last_peered":"2024-09-19T12:00:11.805174+0000","last_clean":"2024-09-19T12:00:11.805174+0000","last_became_active":"2024-09-19T11:54:08.143092+0000","last_became_peered":"2024-09-19T11:54:08.143092+0000","last_unstale":"2024-09-19T12:00:11.805174+0000","last_undegraded":"2024-09-19T12:00:11.805174+0000","last_fullsized":"2024-09-19T12:00:11.805174+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:06.545326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":26624,"num_write":10,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.612462+0000","last_change":"2024-09-19T11:53:34.723264+0000","last_active":"2024-09-19T12:00:06.612462+0000","last_peered":"2024-09-19T12:00:06.612462+0000","last_clean":"2024-09-19T12:00:06.612462+0000","last_became_active":"2024-09-19T11:53:34.722786+0000","last_became_peered":"2024-09-19T11:53:34.722786+0000","last_unstale":"2024-09-19T12:00:06.612462+0000","last_undegraded":"2024-09-19T12:00:06.612462+0000","last_fullsized":"2024-09-19T12:00:06.612462+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:25:14.671300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.593130+0000","last_change":"2024-09-19T11:51:53.491094+0000","last_active":"2024-09-19T11:58:41.593130+0000","last_peered":"2024-09-19T11:58:41.593130+0000","last_clean":"2024-09-19T11:58:41.593130+0000","last_became_active":"2024-09-19T11:51:53.490467+0000","last_became_peered":"2024-09-19T11:51:53.490467+0000","last_unstale":"2024-09-19T11:58:41.593130+0000","last_undegraded":"2024-09-19T11:58:41.593130+0000","last_fullsized":"2024-09-19T11:58:41.593130+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:52.304018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.615854+0000","last_change":"2024-09-19T11:53:37.739452+0000","last_active":"2024-09-19T12:00:11.615854+0000","last_peered":"2024-09-19T12:00:11.615854+0000","last_clean":"2024-09-19T12:00:11.615854+0000","last_became_active":"2024-09-19T11:53:37.738652+0000","last_became_peered":"2024-09-19T11:53:37.738652+0000","last_unstale":"2024-09-19T12:00:11.615854+0000","last_undegraded":"2024-09-19T12:00:11.615854+0000","last_fullsized":"2024-09-19T12:00:11.615854+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.598691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.598923+0000","last_change":"2024-09-19T11:53:34.709704+0000","last_active":"2024-09-19T12:00:06.598923+0000","last_peered":"2024-09-19T12:00:06.598923+0000","last_clean":"2024-09-19T12:00:06.598923+0000","last_became_active":"2024-09-19T11:53:34.708971+0000","last_became_peered":"2024-09-19T11:53:34.708971+0000","last_unstale":"2024-09-19T12:00:06.598923+0000","last_undegraded":"2024-09-19T12:00:06.598923+0000","last_fullsized":"2024-09-19T12:00:06.598923+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:31.763785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"256'7","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.621385+0000","last_change":"2024-09-19T11:51:53.482164+0000","last_active":"2024-09-19T12:00:36.621385+0000","last_peered":"2024-09-19T12:00:36.621385+0000","last_clean":"2024-09-19T12:00:36.621385+0000","last_became_active":"2024-09-19T11:51:53.481429+0000","last_became_peered":"2024-09-19T11:51:53.481429+0000","last_unstale":"2024-09-19T12:00:36.621385+0000","last_undegraded":"2024-09-19T12:00:36.621385+0000","last_fullsized":"2024-09-19T12:00:36.621385+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:29.346644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":44,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603698+0000","last_change":"2024-09-19T11:53:37.743123+0000","last_active":"2024-09-19T12:00:26.603698+0000","last_peered":"2024-09-19T12:00:26.603698+0000","last_clean":"2024-09-19T12:00:26.603698+0000","last_became_active":"2024-09-19T11:53:37.742403+0000","last_became_peered":"2024-09-19T11:53:37.742403+0000","last_unstale":"2024-09-19T12:00:26.603698+0000","last_undegraded":"2024-09-19T12:00:26.603698+0000","last_fullsized":"2024-09-19T12:00:26.603698+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:17.009971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.612531+0000","last_change":"2024-09-19T11:53:34.731804+0000","last_active":"2024-09-19T12:00:06.612531+0000","last_peered":"2024-09-19T12:00:06.612531+0000","last_clean":"2024-09-19T12:00:06.612531+0000","last_became_active":"2024-09-19T11:53:34.728959+0000","last_became_peered":"2024-09-19T11:53:34.728959+0000","last_unstale":"2024-09-19T12:00:06.612531+0000","last_undegraded":"2024-09-19T12:00:06.612531+0000","last_fullsized":"2024-09-19T12:00:06.612531+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:26.270496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.613843+0000","last_change":"2024-09-19T11:51:53.473143+0000","last_active":"2024-09-19T12:00:36.613843+0000","last_peered":"2024-09-19T12:00:36.613843+0000","last_clean":"2024-09-19T12:00:36.613843+0000","last_became_active":"2024-09-19T11:51:53.472485+0000","last_became_peered":"2024-09-19T11:51:53.472485+0000","last_unstale":"2024-09-19T12:00:36.613843+0000","last_undegraded":"2024-09-19T12:00:36.613843+0000","last_fullsized":"2024-09-19T12:00:36.613843+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:05:05.000749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.615948+0000","last_change":"2024-09-19T11:53:37.737715+0000","last_active":"2024-09-19T12:00:11.615948+0000","last_peered":"2024-09-19T12:00:11.615948+0000","last_clean":"2024-09-19T12:00:11.615948+0000","last_became_active":"2024-09-19T11:53:37.736772+0000","last_became_peered":"2024-09-19T11:53:37.736772+0000","last_unstale":"2024-09-19T12:00:11.615948+0000","last_undegraded":"2024-09-19T12:00:11.615948+0000","last_fullsized":"2024-09-19T12:00:11.615948+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:02.929650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"262'4","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807394+0000","last_change":"2024-09-19T11:53:34.711999+0000","last_active":"2024-09-19T12:00:21.807394+0000","last_peered":"2024-09-19T12:00:21.807394+0000","last_clean":"2024-09-19T12:00:21.807394+0000","last_became_active":"2024-09-19T11:53:34.711382+0000","last_became_peered":"2024-09-19T11:53:34.711382+0000","last_unstale":"2024-09-19T12:00:21.807394+0000","last_undegraded":"2024-09-19T12:00:21.807394+0000","last_fullsized":"2024-09-19T12:00:21.807394+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:31.348728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":9,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618375+0000","last_change":"2024-09-19T11:51:53.487166+0000","last_active":"2024-09-19T12:00:36.618375+0000","last_peered":"2024-09-19T12:00:36.618375+0000","last_clean":"2024-09-19T12:00:36.618375+0000","last_became_active":"2024-09-19T11:51:53.486236+0000","last_became_peered":"2024-09-19T11:51:53.486236+0000","last_unstale":"2024-09-19T12:00:36.618375+0000","last_undegraded":"2024-09-19T12:00:36.618375+0000","last_fullsized":"2024-09-19T12:00:36.618375+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:19.897372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.610219+0000","last_change":"2024-09-19T11:53:37.747251+0000","last_active":"2024-09-19T11:59:56.610219+0000","last_peered":"2024-09-19T11:59:56.610219+0000","last_clean":"2024-09-19T11:59:56.610219+0000","last_became_active":"2024-09-19T11:53:37.745076+0000","last_became_peered":"2024-09-19T11:53:37.745076+0000","last_unstale":"2024-09-19T11:59:56.610219+0000","last_undegraded":"2024-09-19T11:59:56.610219+0000","last_fullsized":"2024-09-19T11:59:56.610219+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:16.840839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611669+0000","last_change":"2024-09-19T11:53:34.720400+0000","last_active":"2024-09-19T11:59:51.611669+0000","last_peered":"2024-09-19T11:59:51.611669+0000","last_clean":"2024-09-19T11:59:51.611669+0000","last_became_active":"2024-09-19T11:53:34.719535+0000","last_became_peered":"2024-09-19T11:53:34.719535+0000","last_unstale":"2024-09-19T11:59:51.611669+0000","last_undegraded":"2024-09-19T11:59:51.611669+0000","last_fullsized":"2024-09-19T11:59:51.611669+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:53.909023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'11","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.619919+0000","last_change":"2024-09-19T11:51:53.486865+0000","last_active":"2024-09-19T12:00:36.619919+0000","last_peered":"2024-09-19T12:00:36.619919+0000","last_clean":"2024-09-19T12:00:36.619919+0000","last_became_active":"2024-09-19T11:51:53.486126+0000","last_became_peered":"2024-09-19T11:51:53.486126+0000","last_unstale":"2024-09-19T12:00:36.619919+0000","last_undegraded":"2024-09-19T12:00:36.619919+0000","last_fullsized":"2024-09-19T12:00:36.619919+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:29.272674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":56,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.610165+0000","last_change":"2024-09-19T11:53:37.749405+0000","last_active":"2024-09-19T11:59:56.610165+0000","last_peered":"2024-09-19T11:59:56.610165+0000","last_clean":"2024-09-19T11:59:56.610165+0000","last_became_active":"2024-09-19T11:53:37.748479+0000","last_became_peered":"2024-09-19T11:53:37.748479+0000","last_unstale":"2024-09-19T11:59:56.610165+0000","last_undegraded":"2024-09-19T11:59:56.610165+0000","last_fullsized":"2024-09-19T11:59:56.610165+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:55.422274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"259'1","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.595554+0000","last_change":"2024-09-19T11:53:34.721846+0000","last_active":"2024-09-19T11:59:51.595554+0000","last_peered":"2024-09-19T11:59:51.595554+0000","last_clean":"2024-09-19T11:59:51.595554+0000","last_became_active":"2024-09-19T11:53:34.721421+0000","last_became_peered":"2024-09-19T11:53:34.721421+0000","last_unstale":"2024-09-19T11:59:51.595554+0000","last_undegraded":"2024-09-19T11:59:51.595554+0000","last_fullsized":"2024-09-19T11:59:51.595554+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:43:44.169249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618564+0000","last_change":"2024-09-19T11:51:53.469628+0000","last_active":"2024-09-19T12:00:36.618564+0000","last_peered":"2024-09-19T12:00:36.618564+0000","last_clean":"2024-09-19T12:00:36.618564+0000","last_became_active":"2024-09-19T11:51:53.468768+0000","last_became_peered":"2024-09-19T11:51:53.468768+0000","last_unstale":"2024-09-19T12:00:36.618564+0000","last_undegraded":"2024-09-19T12:00:36.618564+0000","last_fullsized":"2024-09-19T12:00:36.618564+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:35.828878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.616066+0000","last_change":"2024-09-19T11:53:37.749695+0000","last_active":"2024-09-19T12:00:11.616066+0000","last_peered":"2024-09-19T12:00:11.616066+0000","last_clean":"2024-09-19T12:00:11.616066+0000","last_became_active":"2024-09-19T11:53:37.749246+0000","last_became_peered":"2024-09-19T11:53:37.749246+0000","last_unstale":"2024-09-19T12:00:11.616066+0000","last_undegraded":"2024-09-19T12:00:11.616066+0000","last_fullsized":"2024-09-19T12:00:11.616066+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:35.006918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.610837+0000","last_change":"2024-09-19T11:53:34.703535+0000","last_active":"2024-09-19T12:00:06.610837+0000","last_peered":"2024-09-19T12:00:06.610837+0000","last_clean":"2024-09-19T12:00:06.610837+0000","last_became_active":"2024-09-19T11:53:34.702356+0000","last_became_peered":"2024-09-19T11:53:34.702356+0000","last_unstale":"2024-09-19T12:00:06.610837+0000","last_undegraded":"2024-09-19T12:00:06.610837+0000","last_fullsized":"2024-09-19T12:00:06.610837+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:05.738912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.617011+0000","last_change":"2024-09-19T11:51:53.484021+0000","last_active":"2024-09-19T12:00:16.617011+0000","last_peered":"2024-09-19T12:00:16.617011+0000","last_clean":"2024-09-19T12:00:16.617011+0000","last_became_active":"2024-09-19T11:51:53.483350+0000","last_became_peered":"2024-09-19T11:51:53.483350+0000","last_unstale":"2024-09-19T12:00:16.617011+0000","last_undegraded":"2024-09-19T12:00:16.617011+0000","last_fullsized":"2024-09-19T12:00:16.617011+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:32.695646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"262'6","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.805332+0000","last_change":"2024-09-19T11:53:37.731037+0000","last_active":"2024-09-19T12:00:11.805332+0000","last_peered":"2024-09-19T12:00:11.805332+0000","last_clean":"2024-09-19T12:00:11.805332+0000","last_became_active":"2024-09-19T11:53:37.730641+0000","last_became_peered":"2024-09-19T11:53:37.730641+0000","last_unstale":"2024-09-19T12:00:11.805332+0000","last_undegraded":"2024-09-19T12:00:11.805332+0000","last_fullsized":"2024-09-19T12:00:11.805332+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:40.518527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":11,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.614943+0000","last_change":"2024-09-19T11:53:34.719873+0000","last_active":"2024-09-19T12:00:06.614943+0000","last_peered":"2024-09-19T12:00:06.614943+0000","last_clean":"2024-09-19T12:00:06.614943+0000","last_became_active":"2024-09-19T11:53:34.719193+0000","last_became_peered":"2024-09-19T11:53:34.719193+0000","last_unstale":"2024-09-19T12:00:06.614943+0000","last_undegraded":"2024-09-19T12:00:06.614943+0000","last_fullsized":"2024-09-19T12:00:06.614943+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:17.922208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"256'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.601313+0000","last_change":"2024-09-19T11:51:53.479626+0000","last_active":"2024-09-19T12:00:16.601313+0000","last_peered":"2024-09-19T12:00:16.601313+0000","last_clean":"2024-09-19T12:00:16.601313+0000","last_became_active":"2024-09-19T11:51:53.476953+0000","last_became_peered":"2024-09-19T11:51:53.476953+0000","last_unstale":"2024-09-19T12:00:16.601313+0000","last_undegraded":"2024-09-19T12:00:16.601313+0000","last_fullsized":"2024-09-19T12:00:16.601313+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:40.063157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1","version":"262'2","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.596656+0000","last_change":"2024-09-19T11:53:37.736521+0000","last_active":"2024-09-19T11:59:56.596656+0000","last_peered":"2024-09-19T11:59:56.596656+0000","last_clean":"2024-09-19T11:59:56.596656+0000","last_became_active":"2024-09-19T11:53:37.731400+0000","last_became_peered":"2024-09-19T11:53:37.731400+0000","last_unstale":"2024-09-19T11:59:56.596656+0000","last_undegraded":"2024-09-19T11:59:56.596656+0000","last_fullsized":"2024-09-19T11:59:56.596656+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:04.607485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.608474+0000","last_change":"2024-09-19T11:53:34.724933+0000","last_active":"2024-09-19T11:59:36.608474+0000","last_peered":"2024-09-19T11:59:36.608474+0000","last_clean":"2024-09-19T11:59:36.608474+0000","last_became_active":"2024-09-19T11:53:34.724406+0000","last_became_peered":"2024-09-19T11:53:34.724406+0000","last_unstale":"2024-09-19T11:59:36.608474+0000","last_undegraded":"2024-09-19T11:59:36.608474+0000","last_fullsized":"2024-09-19T11:59:36.608474+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:26.998520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":21504,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.612913+0000","last_change":"2024-09-19T11:51:53.495205+0000","last_active":"2024-09-19T12:00:16.612913+0000","last_peered":"2024-09-19T12:00:16.612913+0000","last_clean":"2024-09-19T12:00:16.612913+0000","last_became_active":"2024-09-19T11:51:53.494443+0000","last_became_peered":"2024-09-19T11:51:53.494443+0000","last_unstale":"2024-09-19T12:00:16.612913+0000","last_undegraded":"2024-09-19T12:00:16.612913+0000","last_fullsized":"2024-09-19T12:00:16.612913+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:22.980807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.0","version":"262'1","reported_seq":24,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.605163+0000","last_change":"2024-09-19T11:53:37.729810+0000","last_active":"2024-09-19T11:59:41.605163+0000","last_peered":"2024-09-19T11:59:41.605163+0000","last_clean":"2024-09-19T11:59:41.605163+0000","last_became_active":"2024-09-19T11:53:37.729101+0000","last_became_peered":"2024-09-19T11:53:37.729101+0000","last_unstale":"2024-09-19T11:59:41.605163+0000","last_undegraded":"2024-09-19T11:59:41.605163+0000","last_fullsized":"2024-09-19T11:59:41.605163+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:23.824167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"262'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611574+0000","last_change":"2024-09-19T11:53:34.719029+0000","last_active":"2024-09-19T11:59:51.611574+0000","last_peered":"2024-09-19T11:59:51.611574+0000","last_clean":"2024-09-19T11:59:51.611574+0000","last_became_active":"2024-09-19T11:53:34.715905+0000","last_became_peered":"2024-09-19T11:53:34.715905+0000","last_unstale":"2024-09-19T11:59:51.611574+0000","last_undegraded":"2024-09-19T11:59:51.611574+0000","last_fullsized":"2024-09-19T11:59:51.611574+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:06.085056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.806309+0000","last_change":"2024-09-19T11:51:53.485332+0000","last_active":"2024-09-19T12:00:16.806309+0000","last_peered":"2024-09-19T12:00:16.806309+0000","last_clean":"2024-09-19T12:00:16.806309+0000","last_became_active":"2024-09-19T11:51:53.479975+0000","last_became_peered":"2024-09-19T11:51:53.479975+0000","last_unstale":"2024-09-19T12:00:16.806309+0000","last_undegraded":"2024-09-19T12:00:16.806309+0000","last_fullsized":"2024-09-19T12:00:16.806309+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:54.383913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.609354+0000","last_change":"2024-09-19T11:53:37.752407+0000","last_active":"2024-09-19T11:59:56.609354+0000","last_peered":"2024-09-19T11:59:56.609354+0000","last_clean":"2024-09-19T11:59:56.609354+0000","last_became_active":"2024-09-19T11:53:37.751835+0000","last_became_peered":"2024-09-19T11:53:37.751835+0000","last_unstale":"2024-09-19T11:59:56.609354+0000","last_undegraded":"2024-09-19T11:59:56.609354+0000","last_fullsized":"2024-09-19T11:59:56.609354+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:44.756436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"262'2","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.595536+0000","last_change":"2024-09-19T11:53:34.722088+0000","last_active":"2024-09-19T11:59:51.595536+0000","last_peered":"2024-09-19T11:59:51.595536+0000","last_clean":"2024-09-19T11:59:51.595536+0000","last_became_active":"2024-09-19T11:53:34.721659+0000","last_became_peered":"2024-09-19T11:53:34.721659+0000","last_unstale":"2024-09-19T11:59:51.595536+0000","last_undegraded":"2024-09-19T11:59:51.595536+0000","last_fullsized":"2024-09-19T11:59:51.595536+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:52.673209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.613783+0000","last_change":"2024-09-19T11:51:53.488636+0000","last_active":"2024-09-19T12:00:16.613783+0000","last_peered":"2024-09-19T12:00:16.613783+0000","last_clean":"2024-09-19T12:00:16.613783+0000","last_became_active":"2024-09-19T11:51:53.487416+0000","last_became_peered":"2024-09-19T11:51:53.487416+0000","last_unstale":"2024-09-19T12:00:16.613783+0000","last_undegraded":"2024-09-19T12:00:16.613783+0000","last_fullsized":"2024-09-19T12:00:16.613783+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:28.039923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"262'2","reported_seq":25,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.801984+0000","last_change":"2024-09-19T11:53:37.722872+0000","last_active":"2024-09-19T11:59:56.801984+0000","last_peered":"2024-09-19T11:59:56.801984+0000","last_clean":"2024-09-19T11:59:56.801984+0000","last_became_active":"2024-09-19T11:53:37.722160+0000","last_became_peered":"2024-09-19T11:53:37.722160+0000","last_unstale":"2024-09-19T11:59:56.801984+0000","last_undegraded":"2024-09-19T11:59:56.801984+0000","last_fullsized":"2024-09-19T11:59:56.801984+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:39.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.608199+0000","last_change":"2024-09-19T11:53:34.699925+0000","last_active":"2024-09-19T11:59:51.608199+0000","last_peered":"2024-09-19T11:59:51.608199+0000","last_clean":"2024-09-19T11:59:51.608199+0000","last_became_active":"2024-09-19T11:53:34.699127+0000","last_became_peered":"2024-09-19T11:53:34.699127+0000","last_unstale":"2024-09-19T11:59:51.608199+0000","last_undegraded":"2024-09-19T11:59:51.608199+0000","last_fullsized":"2024-09-19T11:59:51.608199+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:49.808733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"256'15","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.612683+0000","last_change":"2024-09-19T11:51:53.485393+0000","last_active":"2024-09-19T11:59:56.612683+0000","last_peered":"2024-09-19T11:59:56.612683+0000","last_clean":"2024-09-19T11:59:56.612683+0000","last_became_active":"2024-09-19T11:51:53.484630+0000","last_became_peered":"2024-09-19T11:51:53.484630+0000","last_unstale":"2024-09-19T11:59:56.612683+0000","last_undegraded":"2024-09-19T11:59:56.612683+0000","last_fullsized":"2024-09-19T11:59:56.612683+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:33.200357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":95,"num_write":34,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'24","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.620416+0000","last_change":"2024-09-19T11:35:31.629725+0000","last_active":"2024-09-19T12:00:31.620416+0000","last_peered":"2024-09-19T12:00:31.620416+0000","last_clean":"2024-09-19T12:00:31.620416+0000","last_became_active":"2024-09-19T11:35:31.628800+0000","last_became_peered":"2024-09-19T11:35:31.628800+0000","last_unstale":"2024-09-19T12:00:31.620416+0000","last_undegraded":"2024-09-19T12:00:31.620416+0000","last_fullsized":"2024-09-19T12:00:31.620416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:24.923313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":40,"num_read_kb":38,"num_write":115,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'47","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.583989+0000","last_change":"2024-09-19T11:35:33.628736+0000","last_active":"2024-09-19T11:58:06.583989+0000","last_peered":"2024-09-19T11:58:06.583989+0000","last_clean":"2024-09-19T11:58:06.583989+0000","last_became_active":"2024-09-19T11:35:33.627994+0000","last_became_peered":"2024-09-19T11:35:33.627994+0000","last_unstale":"2024-09-19T11:58:06.583989+0000","last_undegraded":"2024-09-19T11:58:06.583989+0000","last_fullsized":"2024-09-19T11:58:06.583989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:58.580017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":154,"num_write":67,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'55","reported_seq":575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.456278+0000","last_change":"2024-09-19T11:35:31.608493+0000","last_active":"2024-09-19T12:02:32.456278+0000","last_peered":"2024-09-19T12:02:32.456278+0000","last_clean":"2024-09-19T12:02:32.456278+0000","last_became_active":"2024-09-19T11:35:31.608158+0000","last_became_peered":"2024-09-19T11:35:31.608158+0000","last_unstale":"2024-09-19T12:02:32.456278+0000","last_undegraded":"2024-09-19T12:02:32.456278+0000","last_fullsized":"2024-09-19T12:02:32.456278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:19.335025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15408,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":101,"num_read_kb":661,"num_write":200,"num_write_kb":4683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'27","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.587159+0000","last_change":"2024-09-19T11:35:33.621664+0000","last_active":"2024-09-19T11:58:06.587159+0000","last_peered":"2024-09-19T11:58:06.587159+0000","last_clean":"2024-09-19T11:58:06.587159+0000","last_became_active":"2024-09-19T11:35:33.618098+0000","last_became_peered":"2024-09-19T11:35:33.618098+0000","last_unstale":"2024-09-19T11:58:06.587159+0000","last_undegraded":"2024-09-19T11:58:06.587159+0000","last_fullsized":"2024-09-19T11:58:06.587159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:51.714564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":93,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'37","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.618666+0000","last_change":"2024-09-19T11:35:31.614280+0000","last_active":"2024-09-19T12:00:31.618666+0000","last_peered":"2024-09-19T12:00:31.618666+0000","last_clean":"2024-09-19T12:00:31.618666+0000","last_became_active":"2024-09-19T11:35:31.613678+0000","last_became_peered":"2024-09-19T11:35:31.613678+0000","last_unstale":"2024-09-19T12:00:31.618666+0000","last_undegraded":"2024-09-19T12:00:31.618666+0000","last_fullsized":"2024-09-19T12:00:31.618666+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:43.000538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":12351,"num_write":133,"num_write_kb":6154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'42","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:51.978171+0000","last_change":"2024-09-19T11:35:33.614046+0000","last_active":"2024-09-19T11:58:51.978171+0000","last_peered":"2024-09-19T11:58:51.978171+0000","last_clean":"2024-09-19T11:58:51.978171+0000","last_became_active":"2024-09-19T11:35:33.613298+0000","last_became_peered":"2024-09-19T11:35:33.613298+0000","last_unstale":"2024-09-19T11:58:51.978171+0000","last_undegraded":"2024-09-19T11:58:51.978171+0000","last_fullsized":"2024-09-19T11:58:51.978171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:34.924557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":123,"num_write":79,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'21","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.298951+0000","last_change":"2024-09-19T11:35:31.610606+0000","last_active":"2024-09-19T12:00:06.298951+0000","last_peered":"2024-09-19T12:00:06.298951+0000","last_clean":"2024-09-19T12:00:06.298951+0000","last_became_active":"2024-09-19T11:35:31.608115+0000","last_became_peered":"2024-09-19T11:35:31.608115+0000","last_unstale":"2024-09-19T12:00:06.298951+0000","last_undegraded":"2024-09-19T12:00:06.298951+0000","last_fullsized":"2024-09-19T12:00:06.298951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:40.436454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079934,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":1089,"num_write":115,"num_write_kb":1059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'54","reported_seq":577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.584726+0000","last_change":"2024-09-19T11:35:33.625809+0000","last_active":"2024-09-19T11:58:06.584726+0000","last_peered":"2024-09-19T11:58:06.584726+0000","last_clean":"2024-09-19T11:58:06.584726+0000","last_became_active":"2024-09-19T11:35:33.625528+0000","last_became_peered":"2024-09-19T11:35:33.625528+0000","last_unstale":"2024-09-19T11:58:06.584726+0000","last_undegraded":"2024-09-19T11:58:06.584726+0000","last_fullsized":"2024-09-19T11:58:06.584726+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:28.944541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":230,"num_read_kb":188,"num_write":85,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'55","reported_seq":575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.620311+0000","last_change":"2024-09-19T11:35:31.620118+0000","last_active":"2024-09-19T12:00:31.620311+0000","last_peered":"2024-09-19T12:00:31.620311+0000","last_clean":"2024-09-19T12:00:31.620311+0000","last_became_active":"2024-09-19T11:35:31.618555+0000","last_became_peered":"2024-09-19T11:35:31.618555+0000","last_unstale":"2024-09-19T12:00:31.620311+0000","last_undegraded":"2024-09-19T12:00:31.620311+0000","last_fullsized":"2024-09-19T12:00:31.620311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:25.667196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11562584,"num_objects":19,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":86,"num_read_kb":29373,"num_write":171,"num_write_kb":13979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'27","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.193132+0000","last_change":"2024-09-19T11:35:33.626035+0000","last_active":"2024-09-19T12:02:33.193132+0000","last_peered":"2024-09-19T12:02:33.193132+0000","last_clean":"2024-09-19T12:02:33.193132+0000","last_became_active":"2024-09-19T11:35:33.624952+0000","last_became_peered":"2024-09-19T11:35:33.624952+0000","last_unstale":"2024-09-19T12:02:33.193132+0000","last_undegraded":"2024-09-19T12:02:33.193132+0000","last_fullsized":"2024-09-19T12:02:33.193132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:40.687504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":112,"num_write":47,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'43","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.616588+0000","last_change":"2024-09-19T11:35:31.589199+0000","last_active":"2024-09-19T12:00:31.616588+0000","last_peered":"2024-09-19T12:00:31.616588+0000","last_clean":"2024-09-19T12:00:31.616588+0000","last_became_active":"2024-09-19T11:35:31.587016+0000","last_became_peered":"2024-09-19T11:35:31.587016+0000","last_unstale":"2024-09-19T12:00:31.616588+0000","last_undegraded":"2024-09-19T12:00:31.616588+0000","last_fullsized":"2024-09-19T12:00:31.616588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:43.361105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145912,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":83,"num_read_kb":3127,"num_write":126,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"253'2","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.811093+0000","last_change":"2024-09-19T11:35:33.614181+0000","last_active":"2024-09-19T12:00:36.811093+0000","last_peered":"2024-09-19T12:00:36.811093+0000","last_clean":"2024-09-19T12:00:36.811093+0000","last_became_active":"2024-09-19T11:35:33.612338+0000","last_became_peered":"2024-09-19T11:35:33.612338+0000","last_unstale":"2024-09-19T12:00:36.811093+0000","last_undegraded":"2024-09-19T12:00:36.811093+0000","last_fullsized":"2024-09-19T12:00:36.811093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:01.117001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'29","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.620229+0000","last_change":"2024-09-19T11:35:31.621888+0000","last_active":"2024-09-19T12:00:31.620229+0000","last_peered":"2024-09-19T12:00:31.620229+0000","last_clean":"2024-09-19T12:00:31.620229+0000","last_became_active":"2024-09-19T11:35:31.619730+0000","last_became_peered":"2024-09-19T11:35:31.619730+0000","last_unstale":"2024-09-19T12:00:31.620229+0000","last_undegraded":"2024-09-19T12:00:31.620229+0000","last_fullsized":"2024-09-19T12:00:31.620229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:41.738718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":104,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'48","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618078+0000","last_change":"2024-09-19T11:35:33.612223+0000","last_active":"2024-09-19T12:00:36.618078+0000","last_peered":"2024-09-19T12:00:36.618078+0000","last_clean":"2024-09-19T12:00:36.618078+0000","last_became_active":"2024-09-19T11:35:33.611495+0000","last_became_peered":"2024-09-19T11:35:33.611495+0000","last_unstale":"2024-09-19T12:00:36.618078+0000","last_undegraded":"2024-09-19T12:00:36.618078+0000","last_fullsized":"2024-09-19T12:00:36.618078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:50.704291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":135,"num_write":76,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'29","reported_seq":540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.612628+0000","last_change":"2024-09-19T11:35:31.594461+0000","last_active":"2024-09-19T12:00:31.612628+0000","last_peered":"2024-09-19T12:00:31.612628+0000","last_clean":"2024-09-19T12:00:31.612628+0000","last_became_active":"2024-09-19T11:35:31.593765+0000","last_became_peered":"2024-09-19T11:35:31.593765+0000","last_unstale":"2024-09-19T12:00:31.612628+0000","last_undegraded":"2024-09-19T12:00:31.612628+0000","last_fullsized":"2024-09-19T12:00:31.612628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:15.207126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2235,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":48,"num_read_kb":45,"num_write":108,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'46","reported_seq":564,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.197761+0000","last_change":"2024-09-19T11:35:33.606318+0000","last_active":"2024-09-19T12:02:33.197761+0000","last_peered":"2024-09-19T12:02:33.197761+0000","last_clean":"2024-09-19T12:02:33.197761+0000","last_became_active":"2024-09-19T11:35:33.604505+0000","last_became_peered":"2024-09-19T11:35:33.604505+0000","last_unstale":"2024-09-19T12:02:33.197761+0000","last_undegraded":"2024-09-19T12:02:33.197761+0000","last_fullsized":"2024-09-19T12:02:33.197761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:56.257217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":158,"num_write":84,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'76","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.163064+0000","last_change":"2024-09-19T11:35:33.608564+0000","last_active":"2024-09-19T12:02:33.163064+0000","last_peered":"2024-09-19T12:02:33.163064+0000","last_clean":"2024-09-19T12:02:33.163064+0000","last_became_active":"2024-09-19T11:35:33.607843+0000","last_became_peered":"2024-09-19T11:35:33.607843+0000","last_unstale":"2024-09-19T12:02:33.163064+0000","last_undegraded":"2024-09-19T12:02:33.163064+0000","last_fullsized":"2024-09-19T12:02:33.163064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:40.705119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":241,"num_write":113,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'35","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.125233+0000","last_change":"2024-09-19T11:36:06.682019+0000","last_active":"2024-09-19T12:00:41.125233+0000","last_peered":"2024-09-19T12:00:41.125233+0000","last_clean":"2024-09-19T12:00:41.125233+0000","last_became_active":"2024-09-19T11:36:06.680794+0000","last_became_peered":"2024-09-19T11:36:06.680794+0000","last_unstale":"2024-09-19T12:00:41.125233+0000","last_undegraded":"2024-09-19T12:00:41.125233+0000","last_fullsized":"2024-09-19T12:00:41.125233+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:15.316832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8321,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":35,"num_read_kb":3338,"num_write":145,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,1],"acting":[2,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599773+0000","last_change":"2024-09-19T11:35:33.622666+0000","last_active":"2024-09-19T11:58:56.599773+0000","last_peered":"2024-09-19T11:58:56.599773+0000","last_clean":"2024-09-19T11:58:56.599773+0000","last_became_active":"2024-09-19T11:35:33.621522+0000","last_became_peered":"2024-09-19T11:35:33.621522+0000","last_unstale":"2024-09-19T11:58:56.599773+0000","last_undegraded":"2024-09-19T11:58:56.599773+0000","last_fullsized":"2024-09-19T11:58:56.599773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:16.770624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'33","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.606056+0000","last_change":"2024-09-19T11:35:31.612184+0000","last_active":"2024-09-19T11:59:41.606056+0000","last_peered":"2024-09-19T11:59:41.606056+0000","last_clean":"2024-09-19T11:59:41.606056+0000","last_became_active":"2024-09-19T11:35:31.598016+0000","last_became_peered":"2024-09-19T11:35:31.598016+0000","last_unstale":"2024-09-19T11:59:41.606056+0000","last_undegraded":"2024-09-19T11:59:41.606056+0000","last_fullsized":"2024-09-19T11:59:41.606056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:59.949408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159847,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":97,"num_read_kb":2182,"num_write":159,"num_write_kb":2115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'48","reported_seq":554,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.596523+0000","last_change":"2024-09-19T11:35:33.612612+0000","last_active":"2024-09-19T11:59:01.596523+0000","last_peered":"2024-09-19T11:59:01.596523+0000","last_clean":"2024-09-19T11:59:01.596523+0000","last_became_active":"2024-09-19T11:35:33.610072+0000","last_became_peered":"2024-09-19T11:35:33.610072+0000","last_unstale":"2024-09-19T11:59:01.596523+0000","last_undegraded":"2024-09-19T11:59:01.596523+0000","last_fullsized":"2024-09-19T11:59:01.596523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:22.254214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":149,"num_write":86,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'31","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.587974+0000","last_change":"2024-09-19T11:35:31.615091+0000","last_active":"2024-09-19T12:02:32.587974+0000","last_peered":"2024-09-19T12:02:32.587974+0000","last_clean":"2024-09-19T12:02:32.587974+0000","last_became_active":"2024-09-19T11:35:31.614263+0000","last_became_peered":"2024-09-19T11:35:31.614263+0000","last_unstale":"2024-09-19T12:02:32.587974+0000","last_undegraded":"2024-09-19T12:02:32.587974+0000","last_fullsized":"2024-09-19T12:02:32.587974+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:03.358145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242995,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":5162,"num_write":123,"num_write_kb":10269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'149","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.050113+0000","last_change":"2024-09-19T11:35:33.611574+0000","last_active":"2024-09-19T12:02:33.050113+0000","last_peered":"2024-09-19T12:02:33.050113+0000","last_clean":"2024-09-19T12:02:33.050113+0000","last_became_active":"2024-09-19T11:35:33.611240+0000","last_became_peered":"2024-09-19T11:35:33.611240+0000","last_unstale":"2024-09-19T12:02:33.050113+0000","last_undegraded":"2024-09-19T12:02:33.050113+0000","last_fullsized":"2024-09-19T12:02:33.050113+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:58.616861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":454,"num_write":234,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'29","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.798430+0000","last_change":"2024-09-19T11:35:31.592787+0000","last_active":"2024-09-19T11:59:41.798430+0000","last_peered":"2024-09-19T11:59:41.798430+0000","last_clean":"2024-09-19T11:59:41.798430+0000","last_became_active":"2024-09-19T11:35:31.591932+0000","last_became_peered":"2024-09-19T11:35:31.591932+0000","last_unstale":"2024-09-19T11:59:41.798430+0000","last_undegraded":"2024-09-19T11:59:41.798430+0000","last_fullsized":"2024-09-19T11:59:41.798430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:16.215077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6295699,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":43,"num_read_kb":7804,"num_write":98,"num_write_kb":7776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'26","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.594514+0000","last_change":"2024-09-19T11:35:33.626081+0000","last_active":"2024-09-19T11:59:46.594514+0000","last_peered":"2024-09-19T11:59:46.594514+0000","last_clean":"2024-09-19T11:59:46.594514+0000","last_became_active":"2024-09-19T11:35:33.625698+0000","last_became_peered":"2024-09-19T11:35:33.625698+0000","last_unstale":"2024-09-19T11:59:46.594514+0000","last_undegraded":"2024-09-19T11:59:46.594514+0000","last_fullsized":"2024-09-19T11:59:46.594514+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:25.969110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":73,"num_write":57,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'22","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.601422+0000","last_change":"2024-09-19T11:35:31.601399+0000","last_active":"2024-09-19T11:59:41.601422+0000","last_peered":"2024-09-19T11:59:41.601422+0000","last_clean":"2024-09-19T11:59:41.601422+0000","last_became_active":"2024-09-19T11:35:31.600939+0000","last_became_peered":"2024-09-19T11:35:31.600939+0000","last_unstale":"2024-09-19T11:59:41.601422+0000","last_undegraded":"2024-09-19T11:59:41.601422+0000","last_fullsized":"2024-09-19T11:59:41.601422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:35.527377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291500,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":6211,"num_write":100,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.799672+0000","last_change":"2024-09-19T11:35:33.605918+0000","last_active":"2024-09-19T11:59:46.799672+0000","last_peered":"2024-09-19T11:59:46.799672+0000","last_clean":"2024-09-19T11:59:46.799672+0000","last_became_active":"2024-09-19T11:35:33.605215+0000","last_became_peered":"2024-09-19T11:35:33.605215+0000","last_unstale":"2024-09-19T11:59:46.799672+0000","last_undegraded":"2024-09-19T11:59:46.799672+0000","last_fullsized":"2024-09-19T11:59:46.799672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:06.551820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'42","reported_seq":567,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.596005+0000","last_change":"2024-09-19T11:35:31.597393+0000","last_active":"2024-09-19T11:58:56.596005+0000","last_peered":"2024-09-19T11:58:56.596005+0000","last_clean":"2024-09-19T11:58:56.596005+0000","last_became_active":"2024-09-19T11:35:31.597035+0000","last_became_peered":"2024-09-19T11:35:31.597035+0000","last_unstale":"2024-09-19T11:58:56.596005+0000","last_undegraded":"2024-09-19T11:58:56.596005+0000","last_fullsized":"2024-09-19T11:58:56.596005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:38.704431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485830,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":25668,"num_write":122,"num_write_kb":10245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'16","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.800682+0000","last_change":"2024-09-19T11:35:41.674446+0000","last_active":"2024-09-19T11:59:51.800682+0000","last_peered":"2024-09-19T11:59:51.800682+0000","last_clean":"2024-09-19T11:59:51.800682+0000","last_became_active":"2024-09-19T11:35:41.673420+0000","last_became_peered":"2024-09-19T11:35:41.673420+0000","last_unstale":"2024-09-19T11:59:51.800682+0000","last_undegraded":"2024-09-19T11:59:51.800682+0000","last_fullsized":"2024-09-19T11:59:51.800682+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:40.611862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":47,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.592064+0000","last_change":"2024-09-19T11:35:33.613895+0000","last_active":"2024-09-19T11:59:01.592064+0000","last_peered":"2024-09-19T11:59:01.592064+0000","last_clean":"2024-09-19T11:59:01.592064+0000","last_became_active":"2024-09-19T11:35:33.613437+0000","last_became_peered":"2024-09-19T11:35:33.613437+0000","last_unstale":"2024-09-19T11:59:01.592064+0000","last_undegraded":"2024-09-19T11:59:01.592064+0000","last_fullsized":"2024-09-19T11:59:01.592064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:34.414349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'46","reported_seq":559,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:38.945035+0000","last_change":"2024-09-19T11:35:31.600183+0000","last_active":"2024-09-19T12:00:38.945035+0000","last_peered":"2024-09-19T12:00:38.945035+0000","last_clean":"2024-09-19T12:00:38.945035+0000","last_became_active":"2024-09-19T11:35:31.599314+0000","last_became_peered":"2024-09-19T11:35:31.599314+0000","last_unstale":"2024-09-19T12:00:38.945035+0000","last_undegraded":"2024-09-19T12:00:38.945035+0000","last_fullsized":"2024-09-19T12:00:38.945035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:43.331402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":231,"num_objects":19,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":83,"num_read_kb":1688,"num_write":186,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.606494+0000","last_change":"2024-09-19T11:35:35.617353+0000","last_active":"2024-09-19T11:59:46.606494+0000","last_peered":"2024-09-19T11:59:46.606494+0000","last_clean":"2024-09-19T11:59:46.606494+0000","last_became_active":"2024-09-19T11:35:35.616351+0000","last_became_peered":"2024-09-19T11:35:35.616351+0000","last_unstale":"2024-09-19T11:59:46.606494+0000","last_undegraded":"2024-09-19T11:59:46.606494+0000","last_fullsized":"2024-09-19T11:59:46.606494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:15.938562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'119","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.348420+0000","last_change":"2024-09-19T11:35:37.651194+0000","last_active":"2024-09-19T12:00:06.348420+0000","last_peered":"2024-09-19T12:00:06.348420+0000","last_clean":"2024-09-19T12:00:06.348420+0000","last_became_active":"2024-09-19T11:35:37.650685+0000","last_became_peered":"2024-09-19T11:35:37.650685+0000","last_unstale":"2024-09-19T12:00:06.348420+0000","last_undegraded":"2024-09-19T12:00:06.348420+0000","last_fullsized":"2024-09-19T12:00:06.348420+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:53.348943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8728,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":164,"num_read_kb":203,"num_write":116,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611862+0000","last_change":"2024-09-19T11:35:39.676563+0000","last_active":"2024-09-19T11:59:51.611862+0000","last_peered":"2024-09-19T11:59:51.611862+0000","last_clean":"2024-09-19T11:59:51.611862+0000","last_became_active":"2024-09-19T11:35:39.676033+0000","last_became_peered":"2024-09-19T11:35:39.676033+0000","last_unstale":"2024-09-19T11:59:51.611862+0000","last_undegraded":"2024-09-19T11:59:51.611862+0000","last_fullsized":"2024-09-19T11:59:51.611862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:44.059170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'15","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.608623+0000","last_change":"2024-09-19T11:35:41.682580+0000","last_active":"2024-09-19T11:59:56.608623+0000","last_peered":"2024-09-19T11:59:56.608623+0000","last_clean":"2024-09-19T11:59:56.608623+0000","last_became_active":"2024-09-19T11:35:41.680497+0000","last_became_peered":"2024-09-19T11:35:41.680497+0000","last_unstale":"2024-09-19T11:59:56.608623+0000","last_undegraded":"2024-09-19T11:59:56.608623+0000","last_fullsized":"2024-09-19T11:59:56.608623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:55.800690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":49,"num_write":53,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'2","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:11.640032+0000","last_change":"2024-09-19T11:35:33.617104+0000","last_active":"2024-09-19T12:02:11.640032+0000","last_peered":"2024-09-19T12:02:11.640032+0000","last_clean":"2024-09-19T12:02:11.640032+0000","last_became_active":"2024-09-19T11:35:33.615138+0000","last_became_peered":"2024-09-19T11:35:33.615138+0000","last_unstale":"2024-09-19T12:02:11.640032+0000","last_undegraded":"2024-09-19T12:02:11.640032+0000","last_fullsized":"2024-09-19T12:02:11.640032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:22.788235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'28","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:11.627448+0000","last_change":"2024-09-19T11:35:31.612888+0000","last_active":"2024-09-19T12:01:11.627448+0000","last_peered":"2024-09-19T12:01:11.627448+0000","last_clean":"2024-09-19T12:01:11.627448+0000","last_became_active":"2024-09-19T11:35:31.612424+0000","last_became_peered":"2024-09-19T11:35:31.612424+0000","last_unstale":"2024-09-19T12:01:11.627448+0000","last_undegraded":"2024-09-19T12:01:11.627448+0000","last_fullsized":"2024-09-19T12:01:11.627448+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:08.302859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":34,"num_read_kb":5150,"num_write":97,"num_write_kb":10271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.592095+0000","last_change":"2024-09-19T11:35:35.627312+0000","last_active":"2024-09-19T11:59:01.592095+0000","last_peered":"2024-09-19T11:59:01.592095+0000","last_clean":"2024-09-19T11:59:01.592095+0000","last_became_active":"2024-09-19T11:35:35.626979+0000","last_became_peered":"2024-09-19T11:35:35.626979+0000","last_unstale":"2024-09-19T11:59:01.592095+0000","last_undegraded":"2024-09-19T11:59:01.592095+0000","last_fullsized":"2024-09-19T11:59:01.592095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:42.288842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'48","reported_seq":554,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:16.833482+0000","last_change":"2024-09-19T11:35:37.630326+0000","last_active":"2024-09-19T12:02:16.833482+0000","last_peered":"2024-09-19T12:02:16.833482+0000","last_clean":"2024-09-19T12:02:16.833482+0000","last_became_active":"2024-09-19T11:35:37.624916+0000","last_became_peered":"2024-09-19T11:35:37.624916+0000","last_unstale":"2024-09-19T12:02:16.833482+0000","last_undegraded":"2024-09-19T12:02:16.833482+0000","last_fullsized":"2024-09-19T12:02:16.833482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:40.009132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":68,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.800889+0000","last_change":"2024-09-19T11:35:39.670488+0000","last_active":"2024-09-19T11:59:51.800889+0000","last_peered":"2024-09-19T11:59:51.800889+0000","last_clean":"2024-09-19T11:59:51.800889+0000","last_became_active":"2024-09-19T11:35:39.669732+0000","last_became_peered":"2024-09-19T11:35:39.669732+0000","last_unstale":"2024-09-19T11:59:51.800889+0000","last_undegraded":"2024-09-19T11:59:51.800889+0000","last_fullsized":"2024-09-19T11:59:51.800889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:15.697637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'26","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:18.515668+0000","last_change":"2024-09-19T11:35:41.695806+0000","last_active":"2024-09-19T11:58:18.515668+0000","last_peered":"2024-09-19T11:58:18.515668+0000","last_clean":"2024-09-19T11:58:18.515668+0000","last_became_active":"2024-09-19T11:35:41.693197+0000","last_became_peered":"2024-09-19T11:35:41.693197+0000","last_unstale":"2024-09-19T11:58:18.515668+0000","last_undegraded":"2024-09-19T11:58:18.515668+0000","last_fullsized":"2024-09-19T11:58:18.515668+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:38:56.811510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":93,"num_write":83,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'5","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.607864+0000","last_change":"2024-09-19T11:35:33.626048+0000","last_active":"2024-09-19T11:59:46.607864+0000","last_peered":"2024-09-19T11:59:46.607864+0000","last_clean":"2024-09-19T11:59:46.607864+0000","last_became_active":"2024-09-19T11:35:33.625606+0000","last_became_peered":"2024-09-19T11:35:33.625606+0000","last_unstale":"2024-09-19T11:59:46.607864+0000","last_undegraded":"2024-09-19T11:59:46.607864+0000","last_fullsized":"2024-09-19T11:59:46.607864+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:11.107345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'38","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.707563+0000","last_change":"2024-09-19T11:35:31.622618+0000","last_active":"2024-09-19T12:02:17.707563+0000","last_peered":"2024-09-19T12:02:17.707563+0000","last_clean":"2024-09-19T12:02:17.707563+0000","last_became_active":"2024-09-19T11:35:31.621190+0000","last_became_peered":"2024-09-19T11:35:31.621190+0000","last_unstale":"2024-09-19T12:02:17.707563+0000","last_undegraded":"2024-09-19T12:02:17.707563+0000","last_fullsized":"2024-09-19T12:02:17.707563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:14.420143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151900,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":54,"num_read_kb":198,"num_write":153,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"38'3","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.705500+0000","last_change":"2024-09-19T11:35:35.624498+0000","last_active":"2024-09-19T12:02:32.705500+0000","last_peered":"2024-09-19T12:02:32.705500+0000","last_clean":"2024-09-19T12:02:32.705500+0000","last_became_active":"2024-09-19T11:35:35.623997+0000","last_became_peered":"2024-09-19T11:35:35.623997+0000","last_unstale":"2024-09-19T12:02:32.705500+0000","last_undegraded":"2024-09-19T12:02:32.705500+0000","last_fullsized":"2024-09-19T12:02:32.705500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:39.064327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":625,"num_read_kb":623,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'64","reported_seq":579,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:26.614835+0000","last_change":"2024-09-19T11:35:37.628761+0000","last_active":"2024-09-19T12:01:26.614835+0000","last_peered":"2024-09-19T12:01:26.614835+0000","last_clean":"2024-09-19T12:01:26.614835+0000","last_became_active":"2024-09-19T11:35:37.628124+0000","last_became_peered":"2024-09-19T11:35:37.628124+0000","last_unstale":"2024-09-19T12:01:26.614835+0000","last_undegraded":"2024-09-19T12:01:26.614835+0000","last_fullsized":"2024-09-19T12:01:26.614835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:14.165078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'612","reported_seq":1501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.004966+0000","last_change":"2024-09-19T11:35:39.682448+0000","last_active":"2024-09-19T12:02:33.004966+0000","last_peered":"2024-09-19T12:02:33.004966+0000","last_clean":"2024-09-19T12:02:33.004966+0000","last_became_active":"2024-09-19T11:35:39.681867+0000","last_became_peered":"2024-09-19T11:35:39.681867+0000","last_unstale":"2024-09-19T12:02:33.004966+0000","last_undegraded":"2024-09-19T12:02:33.004966+0000","last_fullsized":"2024-09-19T12:02:33.004966+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:29.322118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'20","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:32.884237+0000","last_change":"2024-09-19T11:35:41.677700+0000","last_active":"2024-09-19T11:59:32.884237+0000","last_peered":"2024-09-19T11:59:32.884237+0000","last_clean":"2024-09-19T11:59:32.884237+0000","last_became_active":"2024-09-19T11:35:41.676988+0000","last_became_peered":"2024-09-19T11:35:41.676988+0000","last_unstale":"2024-09-19T11:59:32.884237+0000","last_undegraded":"2024-09-19T11:59:32.884237+0000","last_fullsized":"2024-09-19T11:59:32.884237+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:02.366492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'23","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.177039+0000","last_change":"2024-09-19T11:35:33.614935+0000","last_active":"2024-09-19T12:02:33.177039+0000","last_peered":"2024-09-19T12:02:33.177039+0000","last_clean":"2024-09-19T12:02:33.177039+0000","last_became_active":"2024-09-19T11:35:33.614168+0000","last_became_peered":"2024-09-19T11:35:33.614168+0000","last_unstale":"2024-09-19T12:02:33.177039+0000","last_undegraded":"2024-09-19T12:02:33.177039+0000","last_fullsized":"2024-09-19T12:02:33.177039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:40.524246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":86,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'43","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:32.856606+0000","last_change":"2024-09-19T11:35:31.611559+0000","last_active":"2024-09-19T11:59:32.856606+0000","last_peered":"2024-09-19T11:59:32.856606+0000","last_clean":"2024-09-19T11:59:32.856606+0000","last_became_active":"2024-09-19T11:35:31.610808+0000","last_became_peered":"2024-09-19T11:35:31.610808+0000","last_unstale":"2024-09-19T11:59:32.856606+0000","last_undegraded":"2024-09-19T11:59:32.856606+0000","last_fullsized":"2024-09-19T11:59:32.856606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:46.561986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7371487,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":100,"num_read_kb":7272,"num_write":179,"num_write_kb":7210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.606549+0000","last_change":"2024-09-19T11:35:35.624368+0000","last_active":"2024-09-19T11:59:46.606549+0000","last_peered":"2024-09-19T11:59:46.606549+0000","last_clean":"2024-09-19T11:59:46.606549+0000","last_became_active":"2024-09-19T11:35:35.623608+0000","last_became_peered":"2024-09-19T11:35:35.623608+0000","last_unstale":"2024-09-19T11:59:46.606549+0000","last_undegraded":"2024-09-19T11:59:46.606549+0000","last_fullsized":"2024-09-19T11:59:46.606549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:32.921728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'63","reported_seq":558,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611752+0000","last_change":"2024-09-19T11:35:37.646654+0000","last_active":"2024-09-19T11:59:51.611752+0000","last_peered":"2024-09-19T11:59:51.611752+0000","last_clean":"2024-09-19T11:59:51.611752+0000","last_became_active":"2024-09-19T11:35:37.645933+0000","last_became_peered":"2024-09-19T11:35:37.645933+0000","last_unstale":"2024-09-19T11:59:51.611752+0000","last_undegraded":"2024-09-19T11:59:51.611752+0000","last_fullsized":"2024-09-19T11:59:51.611752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:49.367677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9468,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":79,"num_read_kb":111,"num_write":62,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'618","reported_seq":1487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.017659+0000","last_change":"2024-09-19T11:35:39.655107+0000","last_active":"2024-09-19T12:02:33.017659+0000","last_peered":"2024-09-19T12:02:33.017659+0000","last_clean":"2024-09-19T12:02:33.017659+0000","last_became_active":"2024-09-19T11:35:39.654205+0000","last_became_peered":"2024-09-19T11:35:39.654205+0000","last_unstale":"2024-09-19T12:02:33.017659+0000","last_undegraded":"2024-09-19T12:02:33.017659+0000","last_fullsized":"2024-09-19T12:02:33.017659+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:09.266023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'23","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.173407+0000","last_change":"2024-09-19T11:35:33.625607+0000","last_active":"2024-09-19T12:02:33.173407+0000","last_peered":"2024-09-19T12:02:33.173407+0000","last_clean":"2024-09-19T12:02:33.173407+0000","last_became_active":"2024-09-19T11:35:33.624883+0000","last_became_peered":"2024-09-19T11:35:33.624883+0000","last_unstale":"2024-09-19T12:02:33.173407+0000","last_undegraded":"2024-09-19T12:02:33.173407+0000","last_fullsized":"2024-09-19T12:02:33.173407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:38.184558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":86,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'29","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.618229+0000","last_change":"2024-09-19T11:35:31.610576+0000","last_active":"2024-09-19T12:00:21.618229+0000","last_peered":"2024-09-19T12:00:21.618229+0000","last_clean":"2024-09-19T12:00:21.618229+0000","last_became_active":"2024-09-19T11:35:31.609658+0000","last_became_peered":"2024-09-19T11:35:31.609658+0000","last_unstale":"2024-09-19T12:00:21.618229+0000","last_undegraded":"2024-09-19T12:00:21.618229+0000","last_fullsized":"2024-09-19T12:00:21.618229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:27.502371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":46,"num_read_kb":38,"num_write":98,"num_write_kb":5152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.606363+0000","last_change":"2024-09-19T11:35:35.622091+0000","last_active":"2024-09-19T11:59:26.606363+0000","last_peered":"2024-09-19T11:59:26.606363+0000","last_clean":"2024-09-19T11:59:26.606363+0000","last_became_active":"2024-09-19T11:35:35.621170+0000","last_became_peered":"2024-09-19T11:35:35.621170+0000","last_unstale":"2024-09-19T11:59:26.606363+0000","last_undegraded":"2024-09-19T11:59:26.606363+0000","last_fullsized":"2024-09-19T11:59:26.606363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:48.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'117","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.603982+0000","last_change":"2024-09-19T11:35:37.636324+0000","last_active":"2024-09-19T11:59:36.603982+0000","last_peered":"2024-09-19T11:59:36.603982+0000","last_clean":"2024-09-19T11:59:36.603982+0000","last_became_active":"2024-09-19T11:35:37.635359+0000","last_became_peered":"2024-09-19T11:35:37.635359+0000","last_unstale":"2024-09-19T11:59:36.603982+0000","last_undegraded":"2024-09-19T11:59:36.603982+0000","last_fullsized":"2024-09-19T11:59:36.603982+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:43.517566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9704,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":167,"num_read_kb":202,"num_write":118,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603640+0000","last_change":"2024-09-19T11:35:39.683859+0000","last_active":"2024-09-19T12:00:26.603640+0000","last_peered":"2024-09-19T12:00:26.603640+0000","last_clean":"2024-09-19T12:00:26.603640+0000","last_became_active":"2024-09-19T11:35:39.683300+0000","last_became_peered":"2024-09-19T11:35:39.683300+0000","last_unstale":"2024-09-19T12:00:26.603640+0000","last_undegraded":"2024-09-19T12:00:26.603640+0000","last_fullsized":"2024-09-19T12:00:26.603640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:56.978681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'6","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619273+0000","last_change":"2024-09-19T11:35:41.685251+0000","last_active":"2024-09-19T12:00:41.619273+0000","last_peered":"2024-09-19T12:00:41.619273+0000","last_clean":"2024-09-19T12:00:41.619273+0000","last_became_active":"2024-09-19T11:35:41.684698+0000","last_became_peered":"2024-09-19T11:35:41.684698+0000","last_unstale":"2024-09-19T12:00:41.619273+0000","last_undegraded":"2024-09-19T12:00:41.619273+0000","last_fullsized":"2024-09-19T12:00:41.619273+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:43.679226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'9","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:36.824293+0000","last_change":"2024-09-19T11:35:33.618465+0000","last_active":"2024-09-19T12:01:36.824293+0000","last_peered":"2024-09-19T12:01:36.824293+0000","last_clean":"2024-09-19T12:01:36.824293+0000","last_became_active":"2024-09-19T11:35:33.617778+0000","last_became_peered":"2024-09-19T11:35:33.617778+0000","last_unstale":"2024-09-19T12:01:36.824293+0000","last_undegraded":"2024-09-19T12:01:36.824293+0000","last_fullsized":"2024-09-19T12:01:36.824293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:44.417211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":12,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'53","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.617110+0000","last_change":"2024-09-19T11:35:31.609984+0000","last_active":"2024-09-19T12:00:16.617110+0000","last_peered":"2024-09-19T12:00:16.617110+0000","last_clean":"2024-09-19T12:00:16.617110+0000","last_became_active":"2024-09-19T11:35:31.609243+0000","last_became_peered":"2024-09-19T11:35:31.609243+0000","last_unstale":"2024-09-19T12:00:16.617110+0000","last_undegraded":"2024-09-19T12:00:16.617110+0000","last_fullsized":"2024-09-19T12:00:16.617110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:56.221017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6330583,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":92,"num_read_kb":6258,"num_write":250,"num_write_kb":6195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.590189+0000","last_change":"2024-09-19T11:35:35.618693+0000","last_active":"2024-09-19T11:59:26.590189+0000","last_peered":"2024-09-19T11:59:26.590189+0000","last_clean":"2024-09-19T11:59:26.590189+0000","last_became_active":"2024-09-19T11:35:35.617934+0000","last_became_peered":"2024-09-19T11:35:35.617934+0000","last_unstale":"2024-09-19T11:59:26.590189+0000","last_undegraded":"2024-09-19T11:59:26.590189+0000","last_fullsized":"2024-09-19T11:59:26.590189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:47.062252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'63","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.798286+0000","last_change":"2024-09-19T11:35:37.643864+0000","last_active":"2024-09-19T12:02:17.798286+0000","last_peered":"2024-09-19T12:02:17.798286+0000","last_clean":"2024-09-19T12:02:17.798286+0000","last_became_active":"2024-09-19T11:35:37.643236+0000","last_became_peered":"2024-09-19T11:35:37.643236+0000","last_unstale":"2024-09-19T12:02:17.798286+0000","last_undegraded":"2024-09-19T12:02:17.798286+0000","last_fullsized":"2024-09-19T12:02:17.798286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:47.647100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12813,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":92,"num_read_kb":161,"num_write":74,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.600120+0000","last_change":"2024-09-19T11:35:39.653781+0000","last_active":"2024-09-19T11:59:36.600120+0000","last_peered":"2024-09-19T11:59:36.600120+0000","last_clean":"2024-09-19T11:59:36.600120+0000","last_became_active":"2024-09-19T11:35:39.652920+0000","last_became_peered":"2024-09-19T11:35:39.652920+0000","last_unstale":"2024-09-19T11:59:36.600120+0000","last_undegraded":"2024-09-19T11:59:36.600120+0000","last_fullsized":"2024-09-19T11:59:36.600120+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:26.583277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'12","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:46.620891+0000","last_change":"2024-09-19T11:35:41.678791+0000","last_active":"2024-09-19T12:00:46.620891+0000","last_peered":"2024-09-19T12:00:46.620891+0000","last_clean":"2024-09-19T12:00:46.620891+0000","last_became_active":"2024-09-19T11:35:41.678055+0000","last_became_peered":"2024-09-19T11:35:41.678055+0000","last_unstale":"2024-09-19T12:00:46.620891+0000","last_undegraded":"2024-09-19T12:00:46.620891+0000","last_fullsized":"2024-09-19T12:00:46.620891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:27.826190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":59,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'46","reported_seq":556,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.008451+0000","last_change":"2024-09-19T11:35:33.624918+0000","last_active":"2024-09-19T12:02:32.008451+0000","last_peered":"2024-09-19T12:02:32.008451+0000","last_clean":"2024-09-19T12:02:32.008451+0000","last_became_active":"2024-09-19T11:35:33.624015+0000","last_became_peered":"2024-09-19T11:35:33.624015+0000","last_unstale":"2024-09-19T12:02:32.008451+0000","last_undegraded":"2024-09-19T12:02:32.008451+0000","last_fullsized":"2024-09-19T12:02:32.008451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:06.414742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":170,"num_write":76,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'48","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.617053+0000","last_change":"2024-09-19T11:35:31.627788+0000","last_active":"2024-09-19T12:00:16.617053+0000","last_peered":"2024-09-19T12:00:16.617053+0000","last_clean":"2024-09-19T12:00:16.617053+0000","last_became_active":"2024-09-19T11:35:31.627232+0000","last_became_peered":"2024-09-19T11:35:31.627232+0000","last_unstale":"2024-09-19T12:00:16.617053+0000","last_undegraded":"2024-09-19T12:00:16.617053+0000","last_fullsized":"2024-09-19T12:00:16.617053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:49.266566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1326257,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":106,"num_read_kb":6226,"num_write":203,"num_write_kb":11300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.601938+0000","last_change":"2024-09-19T11:35:35.624395+0000","last_active":"2024-09-19T12:00:21.601938+0000","last_peered":"2024-09-19T12:00:21.601938+0000","last_clean":"2024-09-19T12:00:21.601938+0000","last_became_active":"2024-09-19T11:35:35.623852+0000","last_became_peered":"2024-09-19T11:35:35.623852+0000","last_unstale":"2024-09-19T12:00:21.601938+0000","last_undegraded":"2024-09-19T12:00:21.601938+0000","last_fullsized":"2024-09-19T12:00:21.601938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:40.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'72","reported_seq":577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:41.635724+0000","last_change":"2024-09-19T11:35:37.641622+0000","last_active":"2024-09-19T12:01:41.635724+0000","last_peered":"2024-09-19T12:01:41.635724+0000","last_clean":"2024-09-19T12:01:41.635724+0000","last_became_active":"2024-09-19T11:35:37.640906+0000","last_became_peered":"2024-09-19T11:35:37.640906+0000","last_unstale":"2024-09-19T12:01:41.635724+0000","last_undegraded":"2024-09-19T12:01:41.635724+0000","last_fullsized":"2024-09-19T12:01:41.635724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:36.736085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8959,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":94,"num_read_kb":121,"num_write":68,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'612","reported_seq":1452,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.021235+0000","last_change":"2024-09-19T11:35:39.673666+0000","last_active":"2024-09-19T12:02:33.021235+0000","last_peered":"2024-09-19T12:02:33.021235+0000","last_clean":"2024-09-19T12:02:33.021235+0000","last_became_active":"2024-09-19T11:35:39.672054+0000","last_became_peered":"2024-09-19T11:35:39.672054+0000","last_unstale":"2024-09-19T12:02:33.021235+0000","last_undegraded":"2024-09-19T12:02:33.021235+0000","last_fullsized":"2024-09-19T12:02:33.021235+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:26.938497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'4","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.604432+0000","last_change":"2024-09-19T11:35:41.696920+0000","last_active":"2024-09-19T11:59:31.604432+0000","last_peered":"2024-09-19T11:59:31.604432+0000","last_clean":"2024-09-19T11:59:31.604432+0000","last_became_active":"2024-09-19T11:35:41.693623+0000","last_became_peered":"2024-09-19T11:35:41.693623+0000","last_unstale":"2024-09-19T11:59:31.604432+0000","last_undegraded":"2024-09-19T11:59:31.604432+0000","last_fullsized":"2024-09-19T11:59:31.604432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:36:17.971489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'3","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.616177+0000","last_change":"2024-09-19T11:35:33.620540+0000","last_active":"2024-09-19T12:00:21.616177+0000","last_peered":"2024-09-19T12:00:21.616177+0000","last_clean":"2024-09-19T12:00:21.616177+0000","last_became_active":"2024-09-19T11:35:33.620252+0000","last_became_peered":"2024-09-19T11:35:33.620252+0000","last_unstale":"2024-09-19T12:00:21.616177+0000","last_undegraded":"2024-09-19T12:00:21.616177+0000","last_fullsized":"2024-09-19T12:00:21.616177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:59.675080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'24","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.528130+0000","last_change":"2024-09-19T11:35:31.606672+0000","last_active":"2024-09-19T12:02:32.528130+0000","last_peered":"2024-09-19T12:02:32.528130+0000","last_clean":"2024-09-19T12:02:32.528130+0000","last_became_active":"2024-09-19T11:35:31.606137+0000","last_became_peered":"2024-09-19T11:35:31.606137+0000","last_unstale":"2024-09-19T12:02:32.528130+0000","last_undegraded":"2024-09-19T12:02:32.528130+0000","last_fullsized":"2024-09-19T12:02:32.528130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:46.025619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":95,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.591409+0000","last_change":"2024-09-19T11:35:35.620661+0000","last_active":"2024-09-19T11:59:31.591409+0000","last_peered":"2024-09-19T11:59:31.591409+0000","last_clean":"2024-09-19T11:59:31.591409+0000","last_became_active":"2024-09-19T11:35:35.619995+0000","last_became_peered":"2024-09-19T11:35:35.619995+0000","last_unstale":"2024-09-19T11:59:31.591409+0000","last_undegraded":"2024-09-19T11:59:31.591409+0000","last_fullsized":"2024-09-19T11:59:31.591409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:20.831305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'91","reported_seq":595,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:41.634336+0000","last_change":"2024-09-19T11:35:37.647073+0000","last_active":"2024-09-19T12:01:41.634336+0000","last_peered":"2024-09-19T12:01:41.634336+0000","last_clean":"2024-09-19T12:01:41.634336+0000","last_became_active":"2024-09-19T11:35:37.646446+0000","last_became_peered":"2024-09-19T11:35:37.646446+0000","last_unstale":"2024-09-19T12:01:41.634336+0000","last_undegraded":"2024-09-19T12:01:41.634336+0000","last_fullsized":"2024-09-19T12:01:41.634336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:26.769867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18926,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":204,"num_write":94,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.591328+0000","last_change":"2024-09-19T11:35:39.658936+0000","last_active":"2024-09-19T11:59:31.591328+0000","last_peered":"2024-09-19T11:59:31.591328+0000","last_clean":"2024-09-19T11:59:31.591328+0000","last_became_active":"2024-09-19T11:35:39.658173+0000","last_became_peered":"2024-09-19T11:35:39.658173+0000","last_unstale":"2024-09-19T11:59:31.591328+0000","last_undegraded":"2024-09-19T11:59:31.591328+0000","last_fullsized":"2024-09-19T11:59:31.591328+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:40.200085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'7","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.993549+0000","last_change":"2024-09-19T11:35:41.679566+0000","last_active":"2024-09-19T12:02:32.993549+0000","last_peered":"2024-09-19T12:02:32.993549+0000","last_clean":"2024-09-19T12:02:32.993549+0000","last_became_active":"2024-09-19T11:35:41.678765+0000","last_became_peered":"2024-09-19T11:35:41.678765+0000","last_unstale":"2024-09-19T12:02:32.993549+0000","last_undegraded":"2024-09-19T12:02:32.993549+0000","last_fullsized":"2024-09-19T12:02:32.993549+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:11.159416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":41,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'2","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.727132+0000","last_change":"2024-09-19T11:35:33.613035+0000","last_active":"2024-09-19T12:02:17.727132+0000","last_peered":"2024-09-19T12:02:17.727132+0000","last_clean":"2024-09-19T12:02:17.727132+0000","last_became_active":"2024-09-19T11:35:33.612279+0000","last_became_peered":"2024-09-19T11:35:33.612279+0000","last_unstale":"2024-09-19T12:02:17.727132+0000","last_undegraded":"2024-09-19T12:02:17.727132+0000","last_fullsized":"2024-09-19T12:02:17.727132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:21.396428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'90","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.786587+0000","last_change":"2024-09-19T11:35:31.584569+0000","last_active":"2024-09-19T12:02:17.786587+0000","last_peered":"2024-09-19T12:02:17.786587+0000","last_clean":"2024-09-19T12:02:17.786587+0000","last_became_active":"2024-09-19T11:35:31.584188+0000","last_became_peered":"2024-09-19T11:35:31.584188+0000","last_unstale":"2024-09-19T12:02:17.786587+0000","last_undegraded":"2024-09-19T12:02:17.786587+0000","last_fullsized":"2024-09-19T12:02:17.786587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:54.139090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":270,"num_read_kb":3453,"num_write":506,"num_write_kb":3250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.602050+0000","last_change":"2024-09-19T11:35:35.615386+0000","last_active":"2024-09-19T12:00:21.602050+0000","last_peered":"2024-09-19T12:00:21.602050+0000","last_clean":"2024-09-19T12:00:21.602050+0000","last_became_active":"2024-09-19T11:35:35.614650+0000","last_became_peered":"2024-09-19T11:35:35.614650+0000","last_unstale":"2024-09-19T12:00:21.602050+0000","last_undegraded":"2024-09-19T12:00:21.602050+0000","last_fullsized":"2024-09-19T12:00:21.602050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:10.129352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'74","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.790629+0000","last_change":"2024-09-19T11:35:37.632361+0000","last_active":"2024-09-19T12:02:17.790629+0000","last_peered":"2024-09-19T12:02:17.790629+0000","last_clean":"2024-09-19T12:02:17.790629+0000","last_became_active":"2024-09-19T11:35:37.624951+0000","last_became_peered":"2024-09-19T11:35:37.624951+0000","last_unstale":"2024-09-19T12:02:17.790629+0000","last_undegraded":"2024-09-19T12:02:17.790629+0000","last_fullsized":"2024-09-19T12:02:17.790629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:24.797414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":118,"num_read_kb":152,"num_write":134,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":475,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.618781+0000","last_change":"2024-09-19T11:35:39.671990+0000","last_active":"2024-09-19T12:00:31.618781+0000","last_peered":"2024-09-19T12:00:31.618781+0000","last_clean":"2024-09-19T12:00:31.618781+0000","last_became_active":"2024-09-19T11:35:39.671181+0000","last_became_peered":"2024-09-19T11:35:39.671181+0000","last_unstale":"2024-09-19T12:00:31.618781+0000","last_undegraded":"2024-09-19T12:00:31.618781+0000","last_fullsized":"2024-09-19T12:00:31.618781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:41.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'18","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.602486+0000","last_change":"2024-09-19T11:35:41.685909+0000","last_active":"2024-09-19T11:59:46.602486+0000","last_peered":"2024-09-19T11:59:46.602486+0000","last_clean":"2024-09-19T11:59:46.602486+0000","last_became_active":"2024-09-19T11:35:41.684966+0000","last_became_peered":"2024-09-19T11:35:41.684966+0000","last_unstale":"2024-09-19T11:59:46.602486+0000","last_undegraded":"2024-09-19T11:59:46.602486+0000","last_fullsized":"2024-09-19T11:59:46.602486+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:36.205278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":94,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'76","reported_seq":577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807509+0000","last_change":"2024-09-19T11:35:33.615010+0000","last_active":"2024-09-19T12:00:21.807509+0000","last_peered":"2024-09-19T12:00:21.807509+0000","last_clean":"2024-09-19T12:00:21.807509+0000","last_became_active":"2024-09-19T11:35:33.613369+0000","last_became_peered":"2024-09-19T11:35:33.613369+0000","last_unstale":"2024-09-19T12:00:21.807509+0000","last_undegraded":"2024-09-19T12:00:21.807509+0000","last_fullsized":"2024-09-19T12:00:21.807509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:13.047628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":221,"num_write":116,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'31","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.307029+0000","last_change":"2024-09-19T11:36:06.676047+0000","last_active":"2024-09-19T12:00:06.307029+0000","last_peered":"2024-09-19T12:00:06.307029+0000","last_clean":"2024-09-19T12:00:06.307029+0000","last_became_active":"2024-09-19T11:36:06.674998+0000","last_became_peered":"2024-09-19T11:36:06.674998+0000","last_unstale":"2024-09-19T12:00:06.307029+0000","last_undegraded":"2024-09-19T12:00:06.307029+0000","last_fullsized":"2024-09-19T12:00:06.307029+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:32.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7402804,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":38,"num_read_kb":7484,"num_write":130,"num_write_kb":7462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,7],"acting":[2,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.602482+0000","last_change":"2024-09-19T11:35:35.632289+0000","last_active":"2024-09-19T12:00:21.602482+0000","last_peered":"2024-09-19T12:00:21.602482+0000","last_clean":"2024-09-19T12:00:21.602482+0000","last_became_active":"2024-09-19T11:35:35.631702+0000","last_became_peered":"2024-09-19T11:35:35.631702+0000","last_unstale":"2024-09-19T12:00:21.602482+0000","last_undegraded":"2024-09-19T12:00:21.602482+0000","last_fullsized":"2024-09-19T12:00:21.602482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:14.196241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'75","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.618207+0000","last_change":"2024-09-19T11:35:37.628795+0000","last_active":"2024-09-19T12:02:32.618207+0000","last_peered":"2024-09-19T12:02:32.618207+0000","last_clean":"2024-09-19T12:02:32.618207+0000","last_became_active":"2024-09-19T11:35:37.627720+0000","last_became_peered":"2024-09-19T11:35:37.627720+0000","last_unstale":"2024-09-19T12:02:32.618207+0000","last_undegraded":"2024-09-19T12:02:32.618207+0000","last_fullsized":"2024-09-19T12:02:32.618207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:36.397426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12172,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":104,"num_read_kb":146,"num_write":78,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'614","reported_seq":1625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.472134+0000","last_change":"2024-09-19T11:35:39.651921+0000","last_active":"2024-09-19T12:02:34.472134+0000","last_peered":"2024-09-19T12:02:34.472134+0000","last_clean":"2024-09-19T12:02:34.472134+0000","last_became_active":"2024-09-19T11:35:39.651203+0000","last_became_peered":"2024-09-19T11:35:39.651203+0000","last_unstale":"2024-09-19T12:02:34.472134+0000","last_undegraded":"2024-09-19T12:02:34.472134+0000","last_fullsized":"2024-09-19T12:02:34.472134+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:01.951944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'8","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607324+0000","last_change":"2024-09-19T11:35:41.691885+0000","last_active":"2024-09-19T12:00:41.607324+0000","last_peered":"2024-09-19T12:00:41.607324+0000","last_clean":"2024-09-19T12:00:41.607324+0000","last_became_active":"2024-09-19T11:35:41.691146+0000","last_became_peered":"2024-09-19T11:35:41.691146+0000","last_unstale":"2024-09-19T12:00:41.607324+0000","last_undegraded":"2024-09-19T12:00:41.607324+0000","last_fullsized":"2024-09-19T12:00:41.607324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:13.054334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":44,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'23","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807571+0000","last_change":"2024-09-19T11:35:33.628948+0000","last_active":"2024-09-19T12:00:21.807571+0000","last_peered":"2024-09-19T12:00:21.807571+0000","last_clean":"2024-09-19T12:00:21.807571+0000","last_became_active":"2024-09-19T11:35:33.628232+0000","last_became_peered":"2024-09-19T11:35:33.628232+0000","last_unstale":"2024-09-19T12:00:21.807571+0000","last_undegraded":"2024-09-19T12:00:21.807571+0000","last_fullsized":"2024-09-19T12:00:21.807571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:54.904056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'40","reported_seq":555,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:33.242294+0000","last_change":"2024-09-19T11:35:31.584516+0000","last_active":"2024-09-19T11:59:33.242294+0000","last_peered":"2024-09-19T11:59:33.242294+0000","last_clean":"2024-09-19T11:59:33.242294+0000","last_became_active":"2024-09-19T11:35:31.583509+0000","last_became_peered":"2024-09-19T11:35:31.583509+0000","last_unstale":"2024-09-19T11:59:33.242294+0000","last_undegraded":"2024-09-19T11:59:33.242294+0000","last_fullsized":"2024-09-19T11:59:33.242294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:18.443812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":87,"num_read_kb":273,"num_write":136,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1304,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.946470+0000","last_change":"2024-09-19T11:35:35.630576+0000","last_active":"2024-09-19T12:02:32.946470+0000","last_peered":"2024-09-19T12:02:32.946470+0000","last_clean":"2024-09-19T12:02:32.946470+0000","last_became_active":"2024-09-19T11:35:35.629728+0000","last_became_peered":"2024-09-19T11:35:35.629728+0000","last_unstale":"2024-09-19T12:02:32.946470+0000","last_undegraded":"2024-09-19T12:02:32.946470+0000","last_fullsized":"2024-09-19T12:02:32.946470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:45.444265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":820,"num_read_kb":820,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'34","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611679+0000","last_change":"2024-09-19T11:35:37.618793+0000","last_active":"2024-09-19T12:00:26.611679+0000","last_peered":"2024-09-19T12:00:26.611679+0000","last_clean":"2024-09-19T12:00:26.611679+0000","last_became_active":"2024-09-19T11:35:37.618061+0000","last_became_peered":"2024-09-19T11:35:37.618061+0000","last_unstale":"2024-09-19T12:00:26.611679+0000","last_undegraded":"2024-09-19T12:00:26.611679+0000","last_fullsized":"2024-09-19T12:00:26.611679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:25.182817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'614","reported_seq":1665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.469112+0000","last_change":"2024-09-19T11:35:39.670880+0000","last_active":"2024-09-19T12:02:34.469112+0000","last_peered":"2024-09-19T12:02:34.469112+0000","last_clean":"2024-09-19T12:02:34.469112+0000","last_became_active":"2024-09-19T11:35:39.670211+0000","last_became_peered":"2024-09-19T11:35:39.670211+0000","last_unstale":"2024-09-19T12:02:34.469112+0000","last_undegraded":"2024-09-19T12:02:34.469112+0000","last_fullsized":"2024-09-19T12:02:34.469112+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:33.137968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'12","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812121+0000","last_change":"2024-09-19T11:35:41.688504+0000","last_active":"2024-09-19T12:00:41.812121+0000","last_peered":"2024-09-19T12:00:41.812121+0000","last_clean":"2024-09-19T12:00:41.812121+0000","last_became_active":"2024-09-19T11:35:41.687793+0000","last_became_peered":"2024-09-19T11:35:41.687793+0000","last_unstale":"2024-09-19T12:00:41.812121+0000","last_undegraded":"2024-09-19T12:00:41.812121+0000","last_fullsized":"2024-09-19T12:00:41.812121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:01.111100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":22,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'40","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603842+0000","last_change":"2024-09-19T11:35:33.603329+0000","last_active":"2024-09-19T12:00:26.603842+0000","last_peered":"2024-09-19T12:00:26.603842+0000","last_clean":"2024-09-19T12:00:26.603842+0000","last_became_active":"2024-09-19T11:35:33.602988+0000","last_became_peered":"2024-09-19T11:35:33.602988+0000","last_unstale":"2024-09-19T12:00:26.603842+0000","last_undegraded":"2024-09-19T12:00:26.603842+0000","last_fullsized":"2024-09-19T12:00:26.603842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:22.788235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":120,"num_write":65,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'34","reported_seq":556,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:33.122139+0000","last_change":"2024-09-19T11:36:06.676997+0000","last_active":"2024-09-19T11:59:33.122139+0000","last_peered":"2024-09-19T11:59:33.122139+0000","last_clean":"2024-09-19T11:59:33.122139+0000","last_became_active":"2024-09-19T11:36:06.675863+0000","last_became_peered":"2024-09-19T11:36:06.675863+0000","last_unstale":"2024-09-19T11:59:33.122139+0000","last_undegraded":"2024-09-19T11:59:33.122139+0000","last_fullsized":"2024-09-19T11:59:33.122139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:09.211491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":68,"num_read_kb":59,"num_write":155,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807544+0000","last_change":"2024-09-19T11:35:35.624735+0000","last_active":"2024-09-19T12:00:21.807544+0000","last_peered":"2024-09-19T12:00:21.807544+0000","last_clean":"2024-09-19T12:00:21.807544+0000","last_became_active":"2024-09-19T11:35:35.623987+0000","last_became_peered":"2024-09-19T11:35:35.623987+0000","last_unstale":"2024-09-19T12:00:21.807544+0000","last_undegraded":"2024-09-19T12:00:21.807544+0000","last_fullsized":"2024-09-19T12:00:21.807544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:01.328886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'111","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.615494+0000","last_change":"2024-09-19T11:35:37.628778+0000","last_active":"2024-09-19T12:00:26.615494+0000","last_peered":"2024-09-19T12:00:26.615494+0000","last_clean":"2024-09-19T12:00:26.615494+0000","last_became_active":"2024-09-19T11:35:37.627374+0000","last_became_peered":"2024-09-19T11:35:37.627374+0000","last_unstale":"2024-09-19T12:00:26.615494+0000","last_undegraded":"2024-09-19T12:00:26.615494+0000","last_fullsized":"2024-09-19T12:00:26.615494+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:40.224279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8513,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":153,"num_read_kb":184,"num_write":108,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.616096+0000","last_change":"2024-09-19T11:35:39.666833+0000","last_active":"2024-09-19T12:00:26.616096+0000","last_peered":"2024-09-19T12:00:26.616096+0000","last_clean":"2024-09-19T12:00:26.616096+0000","last_became_active":"2024-09-19T11:35:39.666071+0000","last_became_peered":"2024-09-19T11:35:39.666071+0000","last_unstale":"2024-09-19T12:00:26.616096+0000","last_undegraded":"2024-09-19T12:00:26.616096+0000","last_fullsized":"2024-09-19T12:00:26.616096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:55.544445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"253'10","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607413+0000","last_change":"2024-09-19T11:35:41.681654+0000","last_active":"2024-09-19T12:00:41.607413+0000","last_peered":"2024-09-19T12:00:41.607413+0000","last_clean":"2024-09-19T12:00:41.607413+0000","last_became_active":"2024-09-19T11:35:41.680850+0000","last_became_peered":"2024-09-19T11:35:41.680850+0000","last_unstale":"2024-09-19T12:00:41.607413+0000","last_undegraded":"2024-09-19T12:00:41.607413+0000","last_fullsized":"2024-09-19T12:00:41.607413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:38.701888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":41,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'9","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619799+0000","last_change":"2024-09-19T11:35:33.633360+0000","last_active":"2024-09-19T12:00:41.619799+0000","last_peered":"2024-09-19T12:00:41.619799+0000","last_clean":"2024-09-19T12:00:41.619799+0000","last_became_active":"2024-09-19T11:35:33.632623+0000","last_became_peered":"2024-09-19T11:35:33.632623+0000","last_unstale":"2024-09-19T12:00:41.619799+0000","last_undegraded":"2024-09-19T12:00:41.619799+0000","last_fullsized":"2024-09-19T12:00:41.619799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:21.511371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:21.605222+0000","last_change":"2024-09-19T11:35:14.134637+0000","last_active":"2024-09-19T11:59:21.605222+0000","last_peered":"2024-09-19T11:59:21.605222+0000","last_clean":"2024-09-19T11:59:21.605222+0000","last_became_active":"2024-09-19T11:35:14.133710+0000","last_became_peered":"2024-09-19T11:35:14.133710+0000","last_unstale":"2024-09-19T11:59:21.605222+0000","last_undegraded":"2024-09-19T11:59:21.605222+0000","last_fullsized":"2024-09-19T11:59:21.605222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:13.080179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:13.080179+0000","last_clean_scrub_stamp":"2024-09-19T11:35:13.080179+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:26.810969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.614213+0000","last_change":"2024-09-19T11:35:21.174817+0000","last_active":"2024-09-19T12:00:21.614213+0000","last_peered":"2024-09-19T12:00:21.614213+0000","last_clean":"2024-09-19T12:00:21.614213+0000","last_became_active":"2024-09-19T11:35:19.150393+0000","last_became_peered":"2024-09-19T11:35:19.150393+0000","last_unstale":"2024-09-19T12:00:21.614213+0000","last_undegraded":"2024-09-19T12:00:21.614213+0000","last_fullsized":"2024-09-19T12:00:21.614213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:35.259610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001387466,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'59","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.629646+0000","last_change":"2024-09-19T11:35:31.593431+0000","last_active":"2024-09-19T12:02:32.629646+0000","last_peered":"2024-09-19T12:02:32.629646+0000","last_clean":"2024-09-19T12:02:32.629646+0000","last_became_active":"2024-09-19T11:35:31.592913+0000","last_became_peered":"2024-09-19T11:35:31.592913+0000","last_unstale":"2024-09-19T12:02:32.629646+0000","last_undegraded":"2024-09-19T12:02:32.629646+0000","last_fullsized":"2024-09-19T12:02:32.629646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:24:42.956900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":130,"num_read_kb":2042,"num_write":246,"num_write_kb":1946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.621462+0000","last_change":"2024-09-19T11:35:35.603629+0000","last_active":"2024-09-19T12:00:36.621462+0000","last_peered":"2024-09-19T12:00:36.621462+0000","last_clean":"2024-09-19T12:00:36.621462+0000","last_became_active":"2024-09-19T11:35:35.602892+0000","last_became_peered":"2024-09-19T11:35:35.602892+0000","last_unstale":"2024-09-19T12:00:36.621462+0000","last_undegraded":"2024-09-19T12:00:36.621462+0000","last_fullsized":"2024-09-19T12:00:36.621462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:06.994180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'175","reported_seq":699,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:45.370851+0000","last_change":"2024-09-19T11:35:37.638436+0000","last_active":"2024-09-19T12:01:45.370851+0000","last_peered":"2024-09-19T12:01:45.370851+0000","last_clean":"2024-09-19T12:01:45.370851+0000","last_became_active":"2024-09-19T11:35:37.636399+0000","last_became_peered":"2024-09-19T11:35:37.636399+0000","last_unstale":"2024-09-19T12:01:45.370851+0000","last_undegraded":"2024-09-19T12:01:45.370851+0000","last_fullsized":"2024-09-19T12:01:45.370851+0000","mapping_epoch":32,"log_start":"262'100","ondisk_log_start":"262'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:14:07.861992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33202,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":257,"num_read_kb":423,"num_write":244,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":475,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.604407+0000","last_change":"2024-09-19T11:35:39.681040+0000","last_active":"2024-09-19T11:59:31.604407+0000","last_peered":"2024-09-19T11:59:31.604407+0000","last_clean":"2024-09-19T11:59:31.604407+0000","last_became_active":"2024-09-19T11:35:39.680298+0000","last_became_peered":"2024-09-19T11:35:39.680298+0000","last_unstale":"2024-09-19T11:59:31.604407+0000","last_undegraded":"2024-09-19T11:59:31.604407+0000","last_fullsized":"2024-09-19T11:59:31.604407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:52.699540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'52","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.766635+0000","last_change":"2024-09-19T11:35:41.679956+0000","last_active":"2024-09-19T12:02:19.766635+0000","last_peered":"2024-09-19T12:02:19.766635+0000","last_clean":"2024-09-19T12:02:19.766635+0000","last_became_active":"2024-09-19T11:35:41.679219+0000","last_became_peered":"2024-09-19T11:35:41.679219+0000","last_unstale":"2024-09-19T12:02:19.766635+0000","last_undegraded":"2024-09-19T12:02:19.766635+0000","last_fullsized":"2024-09-19T12:02:19.766635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:30.335832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":334,"num_read_kb":278,"num_write":121,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'139","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.179765+0000","last_change":"2024-09-19T11:35:33.624017+0000","last_active":"2024-09-19T12:02:33.179765+0000","last_peered":"2024-09-19T12:02:33.179765+0000","last_clean":"2024-09-19T12:02:33.179765+0000","last_became_active":"2024-09-19T11:35:33.622065+0000","last_became_peered":"2024-09-19T11:35:33.622065+0000","last_unstale":"2024-09-19T12:02:33.179765+0000","last_undegraded":"2024-09-19T12:02:33.179765+0000","last_fullsized":"2024-09-19T12:02:33.179765+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.917346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":557,"num_read_kb":440,"num_write":210,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.606297+0000","last_change":"2024-09-19T11:35:21.463140+0000","last_active":"2024-09-19T11:59:26.606297+0000","last_peered":"2024-09-19T11:59:26.606297+0000","last_clean":"2024-09-19T11:59:26.606297+0000","last_became_active":"2024-09-19T11:35:19.154360+0000","last_became_peered":"2024-09-19T11:35:19.154360+0000","last_unstale":"2024-09-19T11:59:26.606297+0000","last_undegraded":"2024-09-19T11:59:26.606297+0000","last_fullsized":"2024-09-19T11:59:26.606297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:59.779314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086516000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'33","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.453497+0000","last_change":"2024-09-19T11:36:06.678664+0000","last_active":"2024-09-19T12:02:32.453497+0000","last_peered":"2024-09-19T12:02:32.453497+0000","last_clean":"2024-09-19T12:02:32.453497+0000","last_became_active":"2024-09-19T11:36:06.677474+0000","last_became_peered":"2024-09-19T11:36:06.677474+0000","last_unstale":"2024-09-19T12:02:32.453497+0000","last_undegraded":"2024-09-19T12:02:32.453497+0000","last_fullsized":"2024-09-19T12:02:32.453497+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:18.377791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":54,"num_read_kb":49,"num_write":140,"num_write_kb":5149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,5],"acting":[0,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.601906+0000","last_change":"2024-09-19T11:35:35.618073+0000","last_active":"2024-09-19T11:59:26.601906+0000","last_peered":"2024-09-19T11:59:26.601906+0000","last_clean":"2024-09-19T11:59:26.601906+0000","last_became_active":"2024-09-19T11:35:35.616382+0000","last_became_peered":"2024-09-19T11:35:35.616382+0000","last_unstale":"2024-09-19T11:59:26.601906+0000","last_undegraded":"2024-09-19T11:59:26.601906+0000","last_fullsized":"2024-09-19T11:59:26.601906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:08.281218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'556","reported_seq":1601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.460872+0000","last_change":"2024-09-19T11:35:37.641209+0000","last_active":"2024-09-19T12:02:34.460872+0000","last_peered":"2024-09-19T12:02:34.460872+0000","last_clean":"2024-09-19T12:02:34.460872+0000","last_became_active":"2024-09-19T11:35:37.640355+0000","last_became_peered":"2024-09-19T11:35:37.640355+0000","last_unstale":"2024-09-19T12:02:34.460872+0000","last_undegraded":"2024-09-19T12:02:34.460872+0000","last_fullsized":"2024-09-19T12:02:34.460872+0000","mapping_epoch":32,"log_start":"264'501","ondisk_log_start":"264'501","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":501,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:53.345519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26845,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":798,"num_read_kb":909,"num_write":150,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:46.623781+0000","last_change":"2024-09-19T11:35:39.676564+0000","last_active":"2024-09-19T12:00:46.623781+0000","last_peered":"2024-09-19T12:00:46.623781+0000","last_clean":"2024-09-19T12:00:46.623781+0000","last_became_active":"2024-09-19T11:35:39.675795+0000","last_became_peered":"2024-09-19T11:35:39.675795+0000","last_unstale":"2024-09-19T12:00:46.623781+0000","last_undegraded":"2024-09-19T12:00:46.623781+0000","last_fullsized":"2024-09-19T12:00:46.623781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:43.633195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'10","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.592039+0000","last_change":"2024-09-19T11:35:41.679366+0000","last_active":"2024-09-19T11:59:36.592039+0000","last_peered":"2024-09-19T11:59:36.592039+0000","last_clean":"2024-09-19T11:59:36.592039+0000","last_became_active":"2024-09-19T11:35:41.678660+0000","last_became_peered":"2024-09-19T11:35:41.678660+0000","last_unstale":"2024-09-19T11:59:36.592039+0000","last_undegraded":"2024-09-19T11:59:36.592039+0000","last_fullsized":"2024-09-19T11:59:36.592039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:59.286098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'21","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.596686+0000","last_change":"2024-09-19T11:36:06.674126+0000","last_active":"2024-09-19T11:59:56.596686+0000","last_peered":"2024-09-19T11:59:56.596686+0000","last_clean":"2024-09-19T11:59:56.596686+0000","last_became_active":"2024-09-19T11:36:06.673265+0000","last_became_peered":"2024-09-19T11:36:06.673265+0000","last_unstale":"2024-09-19T11:59:56.596686+0000","last_undegraded":"2024-09-19T11:59:56.596686+0000","last_fullsized":"2024-09-19T11:59:56.596686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:39.951937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":39,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.601866+0000","last_change":"2024-09-19T11:35:21.169499+0000","last_active":"2024-09-19T12:00:21.601866+0000","last_peered":"2024-09-19T12:00:21.601866+0000","last_clean":"2024-09-19T12:00:21.601866+0000","last_became_active":"2024-09-19T11:35:19.969368+0000","last_became_peered":"2024-09-19T11:35:19.969368+0000","last_unstale":"2024-09-19T12:00:21.601866+0000","last_undegraded":"2024-09-19T12:00:21.601866+0000","last_fullsized":"2024-09-19T12:00:21.601866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:54.928769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001160424,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'17","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.591917+0000","last_change":"2024-09-19T11:35:31.591567+0000","last_active":"2024-09-19T11:59:36.591917+0000","last_peered":"2024-09-19T11:59:36.591917+0000","last_clean":"2024-09-19T11:59:36.591917+0000","last_became_active":"2024-09-19T11:35:31.590860+0000","last_became_peered":"2024-09-19T11:35:31.590860+0000","last_unstale":"2024-09-19T11:59:36.591917+0000","last_undegraded":"2024-09-19T11:59:36.591917+0000","last_fullsized":"2024-09-19T11:59:36.591917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:09.412483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":61,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.590321+0000","last_change":"2024-09-19T11:35:35.611723+0000","last_active":"2024-09-19T11:59:26.590321+0000","last_peered":"2024-09-19T11:59:26.590321+0000","last_clean":"2024-09-19T11:59:26.590321+0000","last_became_active":"2024-09-19T11:35:35.611092+0000","last_became_peered":"2024-09-19T11:35:35.611092+0000","last_unstale":"2024-09-19T11:59:26.590321+0000","last_undegraded":"2024-09-19T11:59:26.590321+0000","last_fullsized":"2024-09-19T11:59:26.590321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:28.447966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'117","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.344688+0000","last_change":"2024-09-19T11:35:37.647865+0000","last_active":"2024-09-19T12:02:34.344688+0000","last_peered":"2024-09-19T12:02:34.344688+0000","last_clean":"2024-09-19T12:02:34.344688+0000","last_became_active":"2024-09-19T11:35:37.647356+0000","last_became_peered":"2024-09-19T11:35:37.647356+0000","last_unstale":"2024-09-19T12:02:34.344688+0000","last_undegraded":"2024-09-19T12:02:34.344688+0000","last_fullsized":"2024-09-19T12:02:34.344688+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:35.178664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":120,"num_read_kb":109,"num_write":73,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621074+0000","last_change":"2024-09-19T11:35:39.673457+0000","last_active":"2024-09-19T12:00:41.621074+0000","last_peered":"2024-09-19T12:00:41.621074+0000","last_clean":"2024-09-19T12:00:41.621074+0000","last_became_active":"2024-09-19T11:35:39.672352+0000","last_became_peered":"2024-09-19T11:35:39.672352+0000","last_unstale":"2024-09-19T12:00:41.621074+0000","last_undegraded":"2024-09-19T12:00:41.621074+0000","last_fullsized":"2024-09-19T12:00:41.621074+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:47.157668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"256'101","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611538+0000","last_change":"2024-09-19T11:35:41.689002+0000","last_active":"2024-09-19T12:00:26.611538+0000","last_peered":"2024-09-19T12:00:26.611538+0000","last_clean":"2024-09-19T12:00:26.611538+0000","last_became_active":"2024-09-19T11:35:41.688239+0000","last_became_peered":"2024-09-19T11:35:41.688239+0000","last_unstale":"2024-09-19T12:00:26.611538+0000","last_undegraded":"2024-09-19T12:00:26.611538+0000","last_fullsized":"2024-09-19T12:00:26.611538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:43:57.342380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":254,"num_write":203,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'2","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.196523+0000","last_change":"2024-09-19T11:35:33.601303+0000","last_active":"2024-09-19T12:02:33.196523+0000","last_peered":"2024-09-19T12:02:33.196523+0000","last_clean":"2024-09-19T12:02:33.196523+0000","last_became_active":"2024-09-19T11:35:33.600618+0000","last_became_peered":"2024-09-19T11:35:33.600618+0000","last_unstale":"2024-09-19T12:02:33.196523+0000","last_undegraded":"2024-09-19T12:02:33.196523+0000","last_fullsized":"2024-09-19T12:02:33.196523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:54.655273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.614118+0000","last_change":"2024-09-19T11:35:21.176258+0000","last_active":"2024-09-19T12:00:21.614118+0000","last_peered":"2024-09-19T12:00:21.614118+0000","last_clean":"2024-09-19T12:00:21.614118+0000","last_became_active":"2024-09-19T11:35:19.151363+0000","last_became_peered":"2024-09-19T11:35:19.151363+0000","last_unstale":"2024-09-19T12:00:21.614118+0000","last_undegraded":"2024-09-19T12:00:21.614118+0000","last_fullsized":"2024-09-19T12:00:21.614118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:58.212055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028321980000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'31","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:26.479325+0000","last_change":"2024-09-19T11:35:31.588679+0000","last_active":"2024-09-19T12:02:26.479325+0000","last_peered":"2024-09-19T12:02:26.479325+0000","last_clean":"2024-09-19T12:02:26.479325+0000","last_became_active":"2024-09-19T11:35:31.587649+0000","last_became_peered":"2024-09-19T11:35:31.587649+0000","last_unstale":"2024-09-19T12:02:26.479325+0000","last_undegraded":"2024-09-19T12:02:26.479325+0000","last_fullsized":"2024-09-19T12:02:26.479325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:13.392140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246326,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":69,"num_read_kb":1908,"num_write":126,"num_write_kb":8008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621095+0000","last_change":"2024-09-19T11:35:35.617574+0000","last_active":"2024-09-19T12:00:41.621095+0000","last_peered":"2024-09-19T12:00:41.621095+0000","last_clean":"2024-09-19T12:00:41.621095+0000","last_became_active":"2024-09-19T11:35:35.617200+0000","last_became_peered":"2024-09-19T11:35:35.617200+0000","last_unstale":"2024-09-19T12:00:41.621095+0000","last_undegraded":"2024-09-19T12:00:41.621095+0000","last_fullsized":"2024-09-19T12:00:41.621095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:13.119332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'69","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.599082+0000","last_change":"2024-09-19T11:35:37.643925+0000","last_active":"2024-09-19T11:59:31.599082+0000","last_peered":"2024-09-19T11:59:31.599082+0000","last_clean":"2024-09-19T11:59:31.599082+0000","last_became_active":"2024-09-19T11:35:37.643310+0000","last_became_peered":"2024-09-19T11:35:37.643310+0000","last_unstale":"2024-09-19T11:59:31.599082+0000","last_undegraded":"2024-09-19T11:59:31.599082+0000","last_fullsized":"2024-09-19T11:59:31.599082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:52.522266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":101,"num_read_kb":95,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.603772+0000","last_change":"2024-09-19T11:35:39.670325+0000","last_active":"2024-09-19T11:59:31.603772+0000","last_peered":"2024-09-19T11:59:31.603772+0000","last_clean":"2024-09-19T11:59:31.603772+0000","last_became_active":"2024-09-19T11:35:39.669555+0000","last_became_peered":"2024-09-19T11:35:39.669555+0000","last_unstale":"2024-09-19T11:59:31.603772+0000","last_undegraded":"2024-09-19T11:59:31.603772+0000","last_fullsized":"2024-09-19T11:59:31.603772+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:49.076245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'20","reported_seq":557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.765426+0000","last_change":"2024-09-19T11:35:41.679051+0000","last_active":"2024-09-19T12:02:19.765426+0000","last_peered":"2024-09-19T12:02:19.765426+0000","last_clean":"2024-09-19T12:02:19.765426+0000","last_became_active":"2024-09-19T11:35:41.678167+0000","last_became_peered":"2024-09-19T11:35:41.678167+0000","last_unstale":"2024-09-19T12:02:19.765426+0000","last_undegraded":"2024-09-19T12:02:19.765426+0000","last_fullsized":"2024-09-19T12:02:19.765426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:18.723092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":65,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'93","reported_seq":609,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.606163+0000","last_change":"2024-09-19T11:35:33.606056+0000","last_active":"2024-09-19T12:00:36.606163+0000","last_peered":"2024-09-19T12:00:36.606163+0000","last_clean":"2024-09-19T12:00:36.606163+0000","last_became_active":"2024-09-19T11:35:33.605504+0000","last_became_peered":"2024-09-19T11:35:33.605504+0000","last_unstale":"2024-09-19T12:00:36.606163+0000","last_undegraded":"2024-09-19T12:00:36.606163+0000","last_fullsized":"2024-09-19T12:00:36.606163+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:14:43.679145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":306,"num_write":160,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'40","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.608437+0000","last_change":"2024-09-19T11:35:31.617849+0000","last_active":"2024-09-19T12:02:32.608437+0000","last_peered":"2024-09-19T12:02:32.608437+0000","last_clean":"2024-09-19T12:02:32.608437+0000","last_became_active":"2024-09-19T11:35:31.616954+0000","last_became_peered":"2024-09-19T11:35:31.616954+0000","last_unstale":"2024-09-19T12:02:32.608437+0000","last_undegraded":"2024-09-19T12:02:32.608437+0000","last_fullsized":"2024-09-19T12:02:32.608437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:52.945748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088230,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":55,"num_read_kb":2718,"num_write":146,"num_write_kb":7832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.602438+0000","last_change":"2024-09-19T11:35:21.183056+0000","last_active":"2024-09-19T12:00:21.602438+0000","last_peered":"2024-09-19T12:00:21.602438+0000","last_clean":"2024-09-19T12:00:21.602438+0000","last_became_active":"2024-09-19T11:35:20.096557+0000","last_became_peered":"2024-09-19T11:35:20.096557+0000","last_unstale":"2024-09-19T12:00:21.602438+0000","last_undegraded":"2024-09-19T12:00:21.602438+0000","last_fullsized":"2024-09-19T12:00:21.602438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:29.688644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010463289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.619805+0000","last_change":"2024-09-19T11:35:35.624242+0000","last_active":"2024-09-19T12:00:36.619805+0000","last_peered":"2024-09-19T12:00:36.619805+0000","last_clean":"2024-09-19T12:00:36.619805+0000","last_became_active":"2024-09-19T11:35:35.623450+0000","last_became_peered":"2024-09-19T11:35:35.623450+0000","last_unstale":"2024-09-19T12:00:36.619805+0000","last_undegraded":"2024-09-19T12:00:36.619805+0000","last_fullsized":"2024-09-19T12:00:36.619805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:29.438228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'143","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:46.635668+0000","last_change":"2024-09-19T11:35:37.638304+0000","last_active":"2024-09-19T12:01:46.635668+0000","last_peered":"2024-09-19T12:01:46.635668+0000","last_clean":"2024-09-19T12:01:46.635668+0000","last_became_active":"2024-09-19T11:35:37.637234+0000","last_became_peered":"2024-09-19T11:35:37.637234+0000","last_unstale":"2024-09-19T12:01:46.635668+0000","last_undegraded":"2024-09-19T12:01:46.635668+0000","last_fullsized":"2024-09-19T12:01:46.635668+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:56.332709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19177,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":285,"num_write":146,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812070+0000","last_change":"2024-09-19T11:35:39.671642+0000","last_active":"2024-09-19T12:00:41.812070+0000","last_peered":"2024-09-19T12:00:41.812070+0000","last_clean":"2024-09-19T12:00:41.812070+0000","last_became_active":"2024-09-19T11:35:39.669914+0000","last_became_peered":"2024-09-19T11:35:39.669914+0000","last_unstale":"2024-09-19T12:00:41.812070+0000","last_undegraded":"2024-09-19T12:00:41.812070+0000","last_fullsized":"2024-09-19T12:00:41.812070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:43.678369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'12","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.617421+0000","last_change":"2024-09-19T11:35:41.692653+0000","last_active":"2024-09-19T12:00:26.617421+0000","last_peered":"2024-09-19T12:00:26.617421+0000","last_clean":"2024-09-19T12:00:26.617421+0000","last_became_active":"2024-09-19T11:35:41.690257+0000","last_became_peered":"2024-09-19T11:35:41.690257+0000","last_unstale":"2024-09-19T12:00:26.617421+0000","last_undegraded":"2024-09-19T12:00:26.617421+0000","last_fullsized":"2024-09-19T12:00:26.617421+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:24.125004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'201","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.388896+0000","last_change":"2024-09-19T11:35:33.614634+0000","last_active":"2024-09-19T12:02:19.388896+0000","last_peered":"2024-09-19T12:02:19.388896+0000","last_clean":"2024-09-19T12:02:19.388896+0000","last_became_active":"2024-09-19T11:35:33.614327+0000","last_became_peered":"2024-09-19T11:35:33.614327+0000","last_unstale":"2024-09-19T12:02:19.388896+0000","last_undegraded":"2024-09-19T12:02:19.388896+0000","last_fullsized":"2024-09-19T12:02:19.388896+0000","mapping_epoch":28,"log_start":"256'100","ondisk_log_start":"256'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:00.637435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":855,"num_read_kb":681,"num_write":310,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'40","reported_seq":556,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.628087+0000","last_change":"2024-09-19T11:35:31.598990+0000","last_active":"2024-09-19T12:02:32.628087+0000","last_peered":"2024-09-19T12:02:32.628087+0000","last_clean":"2024-09-19T12:02:32.628087+0000","last_became_active":"2024-09-19T11:35:31.598447+0000","last_became_peered":"2024-09-19T11:35:31.598447+0000","last_unstale":"2024-09-19T12:02:32.628087+0000","last_undegraded":"2024-09-19T12:02:32.628087+0000","last_fullsized":"2024-09-19T12:02:32.628087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:13:57.048369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388737,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":83,"num_read_kb":9296,"num_write":134,"num_write_kb":14398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.619240+0000","last_change":"2024-09-19T11:35:21.463119+0000","last_active":"2024-09-19T12:00:26.619240+0000","last_peered":"2024-09-19T12:00:26.619240+0000","last_clean":"2024-09-19T12:00:26.619240+0000","last_became_active":"2024-09-19T11:35:20.094400+0000","last_became_peered":"2024-09-19T11:35:20.094400+0000","last_unstale":"2024-09-19T12:00:26.619240+0000","last_undegraded":"2024-09-19T12:00:26.619240+0000","last_fullsized":"2024-09-19T12:00:26.619240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:19.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088955000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"38'5","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.717295+0000","last_change":"2024-09-19T11:35:35.620047+0000","last_active":"2024-09-19T12:02:32.717295+0000","last_peered":"2024-09-19T12:02:32.717295+0000","last_clean":"2024-09-19T12:02:32.717295+0000","last_became_active":"2024-09-19T11:35:35.619212+0000","last_became_peered":"2024-09-19T11:35:35.619212+0000","last_unstale":"2024-09-19T12:02:32.717295+0000","last_undegraded":"2024-09-19T12:02:32.717295+0000","last_fullsized":"2024-09-19T12:02:32.717295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:38.449188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":627,"num_read_kb":1024,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'100","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607374+0000","last_change":"2024-09-19T11:35:37.633269+0000","last_active":"2024-09-19T12:00:41.607374+0000","last_peered":"2024-09-19T12:00:41.607374+0000","last_clean":"2024-09-19T12:00:41.607374+0000","last_became_active":"2024-09-19T11:35:37.629547+0000","last_became_peered":"2024-09-19T11:35:37.629547+0000","last_unstale":"2024-09-19T12:00:41.607374+0000","last_undegraded":"2024-09-19T12:00:41.607374+0000","last_fullsized":"2024-09-19T12:00:41.607374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:55.759738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":151,"num_read_kb":144,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'617","reported_seq":1651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.048365+0000","last_change":"2024-09-19T11:35:39.683282+0000","last_active":"2024-09-19T12:02:33.048365+0000","last_peered":"2024-09-19T12:02:33.048365+0000","last_clean":"2024-09-19T12:02:33.048365+0000","last_became_active":"2024-09-19T11:35:39.681476+0000","last_became_peered":"2024-09-19T11:35:39.681476+0000","last_unstale":"2024-09-19T12:02:33.048365+0000","last_undegraded":"2024-09-19T12:02:33.048365+0000","last_fullsized":"2024-09-19T12:02:33.048365+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:03.143481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'15","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.612867+0000","last_change":"2024-09-19T11:35:41.671140+0000","last_active":"2024-09-19T12:00:31.612867+0000","last_peered":"2024-09-19T12:00:31.612867+0000","last_clean":"2024-09-19T12:00:31.612867+0000","last_became_active":"2024-09-19T11:35:41.670410+0000","last_became_peered":"2024-09-19T11:35:41.670410+0000","last_unstale":"2024-09-19T12:00:31.612867+0000","last_undegraded":"2024-09-19T12:00:31.612867+0000","last_fullsized":"2024-09-19T12:00:31.612867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:12:45.264833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":68,"num_write":44,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'111","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:25.782149+0000","last_change":"2024-09-19T11:35:33.625333+0000","last_active":"2024-09-19T12:02:25.782149+0000","last_peered":"2024-09-19T12:02:25.782149+0000","last_clean":"2024-09-19T12:02:25.782149+0000","last_became_active":"2024-09-19T11:35:33.624885+0000","last_became_peered":"2024-09-19T11:35:33.624885+0000","last_unstale":"2024-09-19T12:02:25.782149+0000","last_undegraded":"2024-09-19T12:02:25.782149+0000","last_fullsized":"2024-09-19T12:02:25.782149+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:31.869760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":317,"num_write":191,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'31","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:30.666941+0000","last_change":"2024-09-19T11:36:06.650619+0000","last_active":"2024-09-19T11:59:30.666941+0000","last_peered":"2024-09-19T11:59:30.666941+0000","last_clean":"2024-09-19T11:59:30.666941+0000","last_became_active":"2024-09-19T11:36:06.649117+0000","last_became_peered":"2024-09-19T11:36:06.649117+0000","last_unstale":"2024-09-19T11:59:30.666941+0000","last_undegraded":"2024-09-19T11:59:30.666941+0000","last_fullsized":"2024-09-19T11:59:30.666941+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:52.917710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":153,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.586560+0000","last_change":"2024-09-19T11:35:21.182872+0000","last_active":"2024-09-19T11:59:11.586560+0000","last_peered":"2024-09-19T11:59:11.586560+0000","last_clean":"2024-09-19T11:59:11.586560+0000","last_became_active":"2024-09-19T11:35:19.152195+0000","last_became_peered":"2024-09-19T11:35:19.152195+0000","last_unstale":"2024-09-19T11:59:11.586560+0000","last_undegraded":"2024-09-19T11:59:11.586560+0000","last_fullsized":"2024-09-19T11:59:11.586560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:33.512818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094930600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810796+0000","last_change":"2024-09-19T11:35:35.625999+0000","last_active":"2024-09-19T12:00:36.810796+0000","last_peered":"2024-09-19T12:00:36.810796+0000","last_clean":"2024-09-19T12:00:36.810796+0000","last_became_active":"2024-09-19T11:35:35.625385+0000","last_became_peered":"2024-09-19T11:35:35.625385+0000","last_unstale":"2024-09-19T12:00:36.810796+0000","last_undegraded":"2024-09-19T12:00:36.810796+0000","last_fullsized":"2024-09-19T12:00:36.810796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:58.273564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'58","reported_seq":572,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812198+0000","last_change":"2024-09-19T11:35:37.642580+0000","last_active":"2024-09-19T12:00:41.812198+0000","last_peered":"2024-09-19T12:00:41.812198+0000","last_clean":"2024-09-19T12:00:41.812198+0000","last_became_active":"2024-09-19T11:35:37.641855+0000","last_became_peered":"2024-09-19T11:35:37.641855+0000","last_unstale":"2024-09-19T12:00:41.812198+0000","last_undegraded":"2024-09-19T12:00:41.812198+0000","last_fullsized":"2024-09-19T12:00:41.812198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:09.995922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":89,"num_read_kb":84,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'618","reported_seq":1534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.476923+0000","last_change":"2024-09-19T11:35:39.663385+0000","last_active":"2024-09-19T12:02:34.476923+0000","last_peered":"2024-09-19T12:02:34.476923+0000","last_clean":"2024-09-19T12:02:34.476923+0000","last_became_active":"2024-09-19T11:35:39.662678+0000","last_became_peered":"2024-09-19T11:35:39.662678+0000","last_unstale":"2024-09-19T12:02:34.476923+0000","last_undegraded":"2024-09-19T12:02:34.476923+0000","last_fullsized":"2024-09-19T12:02:34.476923+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:49.009964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'101","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.205987+0000","last_change":"2024-09-19T11:35:41.684355+0000","last_active":"2024-09-19T12:02:33.205987+0000","last_peered":"2024-09-19T12:02:33.205987+0000","last_clean":"2024-09-19T12:02:33.205987+0000","last_became_active":"2024-09-19T11:35:41.683629+0000","last_became_peered":"2024-09-19T11:35:41.683629+0000","last_unstale":"2024-09-19T12:02:33.205987+0000","last_undegraded":"2024-09-19T12:02:33.205987+0000","last_fullsized":"2024-09-19T12:02:33.205987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:47.007366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":202,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'36","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.192875+0000","last_change":"2024-09-19T11:35:33.616782+0000","last_active":"2024-09-19T12:02:33.192875+0000","last_peered":"2024-09-19T12:02:33.192875+0000","last_clean":"2024-09-19T12:02:33.192875+0000","last_became_active":"2024-09-19T11:35:33.616079+0000","last_became_peered":"2024-09-19T11:35:33.616079+0000","last_unstale":"2024-09-19T12:02:33.192875+0000","last_undegraded":"2024-09-19T12:02:33.192875+0000","last_fullsized":"2024-09-19T12:02:33.192875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:15:39.547552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":147,"num_write":69,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'35","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.714196+0000","last_change":"2024-09-19T11:35:31.613306+0000","last_active":"2024-09-19T12:02:17.714196+0000","last_peered":"2024-09-19T12:02:17.714196+0000","last_clean":"2024-09-19T12:02:17.714196+0000","last_became_active":"2024-09-19T11:35:31.612706+0000","last_became_peered":"2024-09-19T11:35:31.612706+0000","last_unstale":"2024-09-19T12:02:17.714196+0000","last_undegraded":"2024-09-19T12:02:17.714196+0000","last_fullsized":"2024-09-19T12:02:17.714196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:16.769591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322891,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":64,"num_read_kb":6249,"num_write":148,"num_write_kb":6206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.599479+0000","last_change":"2024-09-19T11:35:21.168189+0000","last_active":"2024-09-19T11:59:11.599479+0000","last_peered":"2024-09-19T11:59:11.599479+0000","last_clean":"2024-09-19T11:59:11.599479+0000","last_became_active":"2024-09-19T11:35:19.152446+0000","last_became_peered":"2024-09-19T11:35:19.152446+0000","last_unstale":"2024-09-19T11:59:11.599479+0000","last_undegraded":"2024-09-19T11:59:11.599479+0000","last_fullsized":"2024-09-19T11:59:11.599479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:09.874667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.601284+0000","last_change":"2024-09-19T11:35:35.624664+0000","last_active":"2024-09-19T11:59:41.601284+0000","last_peered":"2024-09-19T11:59:41.601284+0000","last_clean":"2024-09-19T11:59:41.601284+0000","last_became_active":"2024-09-19T11:35:35.624322+0000","last_became_peered":"2024-09-19T11:35:35.624322+0000","last_unstale":"2024-09-19T11:59:41.601284+0000","last_undegraded":"2024-09-19T11:59:41.601284+0000","last_fullsized":"2024-09-19T11:59:41.601284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:10.112342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'184","reported_seq":719,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.791588+0000","last_change":"2024-09-19T11:35:37.646919+0000","last_active":"2024-09-19T12:02:17.791588+0000","last_peered":"2024-09-19T12:02:17.791588+0000","last_clean":"2024-09-19T12:02:17.791588+0000","last_became_active":"2024-09-19T11:35:37.646158+0000","last_became_peered":"2024-09-19T11:35:37.646158+0000","last_unstale":"2024-09-19T12:02:17.791588+0000","last_undegraded":"2024-09-19T12:02:17.791588+0000","last_fullsized":"2024-09-19T12:02:17.791588+0000","mapping_epoch":32,"log_start":"256'100","ondisk_log_start":"256'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:25.054477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37796,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":260,"num_read_kb":439,"num_write":202,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615042+0000","last_change":"2024-09-19T11:35:39.684662+0000","last_active":"2024-09-19T12:00:41.615042+0000","last_peered":"2024-09-19T12:00:41.615042+0000","last_clean":"2024-09-19T12:00:41.615042+0000","last_became_active":"2024-09-19T11:35:39.684034+0000","last_became_peered":"2024-09-19T11:35:39.684034+0000","last_unstale":"2024-09-19T12:00:41.615042+0000","last_undegraded":"2024-09-19T12:00:41.615042+0000","last_fullsized":"2024-09-19T12:00:41.615042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:00.499255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'21","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.615420+0000","last_change":"2024-09-19T11:35:41.690412+0000","last_active":"2024-09-19T12:00:26.615420+0000","last_peered":"2024-09-19T12:00:26.615420+0000","last_clean":"2024-09-19T12:00:26.615420+0000","last_became_active":"2024-09-19T11:35:41.689764+0000","last_became_peered":"2024-09-19T11:35:41.689764+0000","last_unstale":"2024-09-19T12:00:26.615420+0000","last_undegraded":"2024-09-19T12:00:26.615420+0000","last_fullsized":"2024-09-19T12:00:26.615420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:54.147943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":78,"num_write":61,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'13","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621213+0000","last_change":"2024-09-19T11:35:41.691619+0000","last_active":"2024-09-19T12:00:41.621213+0000","last_peered":"2024-09-19T12:00:41.621213+0000","last_clean":"2024-09-19T12:00:41.621213+0000","last_became_active":"2024-09-19T11:35:41.691032+0000","last_became_peered":"2024-09-19T11:35:41.691032+0000","last_unstale":"2024-09-19T12:00:41.621213+0000","last_undegraded":"2024-09-19T12:00:41.621213+0000","last_fullsized":"2024-09-19T12:00:41.621213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:56.262332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":124,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'71","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.049397+0000","last_change":"2024-09-19T11:35:33.630221+0000","last_active":"2024-09-19T11:59:28.049397+0000","last_peered":"2024-09-19T11:59:28.049397+0000","last_clean":"2024-09-19T11:59:28.049397+0000","last_became_active":"2024-09-19T11:35:33.629606+0000","last_became_peered":"2024-09-19T11:35:33.629606+0000","last_unstale":"2024-09-19T11:59:28.049397+0000","last_undegraded":"2024-09-19T11:59:28.049397+0000","last_fullsized":"2024-09-19T11:59:28.049397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:26.189736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":210,"num_write":129,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'30","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:08.146210+0000","last_change":"2024-09-19T11:35:31.592429+0000","last_active":"2024-09-19T12:00:08.146210+0000","last_peered":"2024-09-19T12:00:08.146210+0000","last_clean":"2024-09-19T12:00:08.146210+0000","last_became_active":"2024-09-19T11:35:31.591519+0000","last_became_peered":"2024-09-19T11:35:31.591519+0000","last_unstale":"2024-09-19T12:00:08.146210+0000","last_undegraded":"2024-09-19T12:00:08.146210+0000","last_fullsized":"2024-09-19T12:00:08.146210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:03.358145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":47,"num_read_kb":3273,"num_write":128,"num_write_kb":3245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.583004+0000","last_change":"2024-09-19T11:35:35.613146+0000","last_active":"2024-09-19T11:58:56.583004+0000","last_peered":"2024-09-19T11:58:56.583004+0000","last_clean":"2024-09-19T11:58:56.583004+0000","last_became_active":"2024-09-19T11:35:35.612405+0000","last_became_peered":"2024-09-19T11:35:35.612405+0000","last_unstale":"2024-09-19T11:58:56.583004+0000","last_undegraded":"2024-09-19T11:58:56.583004+0000","last_fullsized":"2024-09-19T11:58:56.583004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:30:32.069279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'80","reported_seq":582,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.311958+0000","last_change":"2024-09-19T11:35:37.633337+0000","last_active":"2024-09-19T12:00:06.311958+0000","last_peered":"2024-09-19T12:00:06.311958+0000","last_clean":"2024-09-19T12:00:06.311958+0000","last_became_active":"2024-09-19T11:35:37.632543+0000","last_became_peered":"2024-09-19T11:35:37.632543+0000","last_unstale":"2024-09-19T12:00:06.311958+0000","last_undegraded":"2024-09-19T12:00:06.311958+0000","last_fullsized":"2024-09-19T12:00:06.311958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:04.865458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10904,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":104,"num_read_kb":155,"num_write":84,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.591731+0000","last_change":"2024-09-19T11:35:39.654809+0000","last_active":"2024-09-19T11:59:01.591731+0000","last_peered":"2024-09-19T11:59:01.591731+0000","last_clean":"2024-09-19T11:59:01.591731+0000","last_became_active":"2024-09-19T11:35:39.654012+0000","last_became_peered":"2024-09-19T11:35:39.654012+0000","last_unstale":"2024-09-19T11:59:01.591731+0000","last_undegraded":"2024-09-19T11:59:01.591731+0000","last_fullsized":"2024-09-19T11:59:01.591731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:29.043987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'11","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.602664+0000","last_change":"2024-09-19T11:35:41.676591+0000","last_active":"2024-09-19T11:59:46.602664+0000","last_peered":"2024-09-19T11:59:46.602664+0000","last_clean":"2024-09-19T11:59:46.602664+0000","last_became_active":"2024-09-19T11:35:41.675506+0000","last_became_peered":"2024-09-19T11:35:41.675506+0000","last_unstale":"2024-09-19T11:59:46.602664+0000","last_undegraded":"2024-09-19T11:59:46.602664+0000","last_fullsized":"2024-09-19T11:59:46.602664+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:14.936561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":25,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'13","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.169388+0000","last_change":"2024-09-19T11:35:33.635071+0000","last_active":"2024-09-19T12:02:33.169388+0000","last_peered":"2024-09-19T12:02:33.169388+0000","last_clean":"2024-09-19T12:02:33.169388+0000","last_became_active":"2024-09-19T11:35:33.634606+0000","last_became_peered":"2024-09-19T11:35:33.634606+0000","last_unstale":"2024-09-19T12:02:33.169388+0000","last_undegraded":"2024-09-19T12:02:33.169388+0000","last_fullsized":"2024-09-19T12:02:33.169388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:09.967791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":71,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'40","reported_seq":555,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.609620+0000","last_change":"2024-09-19T11:35:31.603150+0000","last_active":"2024-09-19T11:59:41.609620+0000","last_peered":"2024-09-19T11:59:41.609620+0000","last_clean":"2024-09-19T11:59:41.609620+0000","last_became_active":"2024-09-19T11:35:31.602343+0000","last_became_peered":"2024-09-19T11:35:31.602343+0000","last_unstale":"2024-09-19T11:59:41.609620+0000","last_undegraded":"2024-09-19T11:59:41.609620+0000","last_fullsized":"2024-09-19T11:59:41.609620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:51.716892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243020,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":78,"num_read_kb":10301,"num_write":152,"num_write_kb":15391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.590693+0000","last_change":"2024-09-19T11:35:35.630500+0000","last_active":"2024-09-19T11:58:56.590693+0000","last_peered":"2024-09-19T11:58:56.590693+0000","last_clean":"2024-09-19T11:58:56.590693+0000","last_became_active":"2024-09-19T11:35:35.630183+0000","last_became_peered":"2024-09-19T11:35:35.630183+0000","last_unstale":"2024-09-19T11:58:56.590693+0000","last_undegraded":"2024-09-19T11:58:56.590693+0000","last_fullsized":"2024-09-19T11:58:56.590693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:46.826155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'15","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.597192+0000","last_change":"2024-09-19T11:35:37.642215+0000","last_active":"2024-09-19T11:59:01.597192+0000","last_peered":"2024-09-19T11:59:01.597192+0000","last_clean":"2024-09-19T11:59:01.597192+0000","last_became_active":"2024-09-19T11:35:37.640723+0000","last_became_peered":"2024-09-19T11:35:37.640723+0000","last_unstale":"2024-09-19T11:59:01.597192+0000","last_undegraded":"2024-09-19T11:59:01.597192+0000","last_fullsized":"2024-09-19T11:59:01.597192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:00.528966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.600886+0000","last_change":"2024-09-19T11:35:39.668057+0000","last_active":"2024-09-19T11:59:01.600886+0000","last_peered":"2024-09-19T11:59:01.600886+0000","last_clean":"2024-09-19T11:59:01.600886+0000","last_became_active":"2024-09-19T11:35:39.667286+0000","last_became_peered":"2024-09-19T11:35:39.667286+0000","last_unstale":"2024-09-19T11:59:01.600886+0000","last_undegraded":"2024-09-19T11:59:01.600886+0000","last_fullsized":"2024-09-19T11:59:01.600886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:36.821583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'8","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:18.512713+0000","last_change":"2024-09-19T11:35:41.698132+0000","last_active":"2024-09-19T11:58:18.512713+0000","last_peered":"2024-09-19T11:58:18.512713+0000","last_clean":"2024-09-19T11:58:18.512713+0000","last_became_active":"2024-09-19T11:35:41.696369+0000","last_became_peered":"2024-09-19T11:35:41.696369+0000","last_unstale":"2024-09-19T11:58:18.512713+0000","last_undegraded":"2024-09-19T11:58:18.512713+0000","last_fullsized":"2024-09-19T11:58:18.512713+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:42.394020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'69","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.196713+0000","last_change":"2024-09-19T11:35:33.617102+0000","last_active":"2024-09-19T12:02:33.196713+0000","last_peered":"2024-09-19T12:02:33.196713+0000","last_clean":"2024-09-19T12:02:33.196713+0000","last_became_active":"2024-09-19T11:35:33.614693+0000","last_became_peered":"2024-09-19T11:35:33.614693+0000","last_unstale":"2024-09-19T12:02:33.196713+0000","last_undegraded":"2024-09-19T12:02:33.196713+0000","last_fullsized":"2024-09-19T12:02:33.196713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:04.830617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":230,"num_write":111,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'41","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.783722+0000","last_change":"2024-09-19T11:36:06.678190+0000","last_active":"2024-09-19T12:02:17.783722+0000","last_peered":"2024-09-19T12:02:17.783722+0000","last_clean":"2024-09-19T12:02:17.783722+0000","last_became_active":"2024-09-19T11:36:06.677102+0000","last_became_peered":"2024-09-19T11:36:06.677102+0000","last_unstale":"2024-09-19T12:02:17.783722+0000","last_undegraded":"2024-09-19T12:02:17.783722+0000","last_fullsized":"2024-09-19T12:02:17.783722+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:31.643124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":83,"num_read_kb":1744,"num_write":149,"num_write_kb":1703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599682+0000","last_change":"2024-09-19T11:35:35.618146+0000","last_active":"2024-09-19T11:58:56.599682+0000","last_peered":"2024-09-19T11:58:56.599682+0000","last_clean":"2024-09-19T11:58:56.599682+0000","last_became_active":"2024-09-19T11:35:35.617374+0000","last_became_peered":"2024-09-19T11:35:35.617374+0000","last_unstale":"2024-09-19T11:58:56.599682+0000","last_undegraded":"2024-09-19T11:58:56.599682+0000","last_fullsized":"2024-09-19T11:58:56.599682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:21.640183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'93","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.031384+0000","last_change":"2024-09-19T11:35:37.637365+0000","last_active":"2024-09-19T11:59:28.031384+0000","last_peered":"2024-09-19T11:59:28.031384+0000","last_clean":"2024-09-19T11:59:28.031384+0000","last_became_active":"2024-09-19T11:35:37.636913+0000","last_became_peered":"2024-09-19T11:35:37.636913+0000","last_unstale":"2024-09-19T11:59:28.031384+0000","last_undegraded":"2024-09-19T11:59:28.031384+0000","last_fullsized":"2024-09-19T11:59:28.031384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:19.745629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10680,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":133,"num_read_kb":183,"num_write":96,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":470,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.597548+0000","last_change":"2024-09-19T11:35:39.673878+0000","last_active":"2024-09-19T11:59:01.597548+0000","last_peered":"2024-09-19T11:59:01.597548+0000","last_clean":"2024-09-19T11:59:01.597548+0000","last_became_active":"2024-09-19T11:35:39.673172+0000","last_became_peered":"2024-09-19T11:35:39.673172+0000","last_unstale":"2024-09-19T11:59:01.597548+0000","last_undegraded":"2024-09-19T11:59:01.597548+0000","last_fullsized":"2024-09-19T11:59:01.597548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:06:47.106673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'13","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.043251+0000","last_change":"2024-09-19T11:35:41.678676+0000","last_active":"2024-09-19T11:59:28.043251+0000","last_peered":"2024-09-19T11:59:28.043251+0000","last_clean":"2024-09-19T11:59:28.043251+0000","last_became_active":"2024-09-19T11:35:41.677991+0000","last_became_peered":"2024-09-19T11:35:41.677991+0000","last_unstale":"2024-09-19T11:59:28.043251+0000","last_undegraded":"2024-09-19T11:59:28.043251+0000","last_fullsized":"2024-09-19T11:59:28.043251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:02.104343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":90,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":470,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.590229+0000","last_change":"2024-09-19T11:36:06.675768+0000","last_active":"2024-09-19T11:59:26.590229+0000","last_peered":"2024-09-19T11:59:26.590229+0000","last_clean":"2024-09-19T11:59:26.590229+0000","last_became_active":"2024-09-19T11:36:06.674947+0000","last_became_peered":"2024-09-19T11:36:06.674947+0000","last_unstale":"2024-09-19T11:59:26.590229+0000","last_undegraded":"2024-09-19T11:59:26.590229+0000","last_fullsized":"2024-09-19T11:59:26.590229+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:35.049315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"264'23","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.606726+0000","last_change":"2024-09-19T11:35:31.589696+0000","last_active":"2024-09-19T11:59:41.606726+0000","last_peered":"2024-09-19T11:59:41.606726+0000","last_clean":"2024-09-19T11:59:41.606726+0000","last_became_active":"2024-09-19T11:35:31.589077+0000","last_became_peered":"2024-09-19T11:35:31.589077+0000","last_unstale":"2024-09-19T11:59:41.606726+0000","last_undegraded":"2024-09-19T11:59:41.606726+0000","last_fullsized":"2024-09-19T11:59:41.606726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:24.386252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7371470,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":36,"num_read_kb":7227,"num_write":88,"num_write_kb":7207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.596258+0000","last_change":"2024-09-19T11:35:35.630499+0000","last_active":"2024-09-19T11:58:56.596258+0000","last_peered":"2024-09-19T11:58:56.596258+0000","last_clean":"2024-09-19T11:58:56.596258+0000","last_became_active":"2024-09-19T11:35:35.629798+0000","last_became_peered":"2024-09-19T11:35:35.629798+0000","last_unstale":"2024-09-19T11:58:56.596258+0000","last_undegraded":"2024-09-19T11:58:56.596258+0000","last_fullsized":"2024-09-19T11:58:56.596258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:11.036004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'65","reported_seq":560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:21.631532+0000","last_change":"2024-09-19T11:35:37.640794+0000","last_active":"2024-09-19T12:01:21.631532+0000","last_peered":"2024-09-19T12:01:21.631532+0000","last_clean":"2024-09-19T12:01:21.631532+0000","last_became_active":"2024-09-19T11:35:37.640008+0000","last_became_peered":"2024-09-19T11:35:37.640008+0000","last_unstale":"2024-09-19T12:01:21.631532+0000","last_undegraded":"2024-09-19T12:01:21.631532+0000","last_fullsized":"2024-09-19T12:01:21.631532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:27.014754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11361,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":87,"num_read_kb":143,"num_write":70,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.597356+0000","last_change":"2024-09-19T11:35:39.676685+0000","last_active":"2024-09-19T11:59:01.597356+0000","last_peered":"2024-09-19T11:59:01.597356+0000","last_clean":"2024-09-19T11:59:01.597356+0000","last_became_active":"2024-09-19T11:35:39.675913+0000","last_became_peered":"2024-09-19T11:35:39.675913+0000","last_unstale":"2024-09-19T11:59:01.597356+0000","last_undegraded":"2024-09-19T11:59:01.597356+0000","last_fullsized":"2024-09-19T11:59:01.597356+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:50.470241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'72","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618654+0000","last_change":"2024-09-19T11:35:33.625849+0000","last_active":"2024-09-19T12:00:36.618654+0000","last_peered":"2024-09-19T12:00:36.618654+0000","last_clean":"2024-09-19T12:00:36.618654+0000","last_became_active":"2024-09-19T11:35:33.624358+0000","last_became_peered":"2024-09-19T11:35:33.624358+0000","last_unstale":"2024-09-19T12:00:36.618654+0000","last_undegraded":"2024-09-19T12:00:36.618654+0000","last_fullsized":"2024-09-19T12:00:36.618654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:19.837363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":316,"num_read_kb":286,"num_write":104,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'30","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.294007+0000","last_change":"2024-09-19T11:35:31.575536+0000","last_active":"2024-09-19T12:00:06.294007+0000","last_peered":"2024-09-19T12:00:06.294007+0000","last_clean":"2024-09-19T12:00:06.294007+0000","last_became_active":"2024-09-19T11:35:31.574673+0000","last_became_peered":"2024-09-19T11:35:31.574673+0000","last_unstale":"2024-09-19T12:00:06.294007+0000","last_undegraded":"2024-09-19T12:00:06.294007+0000","last_fullsized":"2024-09-19T12:00:06.294007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.781451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5418,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":58,"num_read_kb":49,"num_write":113,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.606673+0000","last_change":"2024-09-19T11:35:35.620065+0000","last_active":"2024-09-19T11:59:41.606673+0000","last_peered":"2024-09-19T11:59:41.606673+0000","last_clean":"2024-09-19T11:59:41.606673+0000","last_became_active":"2024-09-19T11:35:35.617643+0000","last_became_peered":"2024-09-19T11:35:35.617643+0000","last_unstale":"2024-09-19T11:59:41.606673+0000","last_undegraded":"2024-09-19T11:59:41.606673+0000","last_fullsized":"2024-09-19T11:59:41.606673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:41.917586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'95","reported_seq":595,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.323158+0000","last_change":"2024-09-19T11:35:37.640664+0000","last_active":"2024-09-19T12:00:06.323158+0000","last_peered":"2024-09-19T12:00:06.323158+0000","last_clean":"2024-09-19T12:00:06.323158+0000","last_became_active":"2024-09-19T11:35:37.640147+0000","last_became_peered":"2024-09-19T11:35:37.640147+0000","last_unstale":"2024-09-19T12:00:06.323158+0000","last_undegraded":"2024-09-19T12:00:06.323158+0000","last_fullsized":"2024-09-19T12:00:06.323158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:58.172631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20894,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":129,"num_read_kb":228,"num_write":102,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":472,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.585226+0000","last_change":"2024-09-19T11:35:39.652153+0000","last_active":"2024-09-19T11:58:11.585226+0000","last_peered":"2024-09-19T11:58:11.585226+0000","last_clean":"2024-09-19T11:58:11.585226+0000","last_became_active":"2024-09-19T11:35:39.651426+0000","last_became_peered":"2024-09-19T11:35:39.651426+0000","last_unstale":"2024-09-19T11:58:11.585226+0000","last_undegraded":"2024-09-19T11:58:11.585226+0000","last_fullsized":"2024-09-19T11:58:11.585226+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:46.800698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'72","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.052035+0000","last_change":"2024-09-19T11:35:41.676328+0000","last_active":"2024-09-19T11:59:28.052035+0000","last_peered":"2024-09-19T11:59:28.052035+0000","last_clean":"2024-09-19T11:59:28.052035+0000","last_became_active":"2024-09-19T11:35:41.674006+0000","last_became_peered":"2024-09-19T11:35:41.674006+0000","last_unstale":"2024-09-19T11:59:28.052035+0000","last_undegraded":"2024-09-19T11:59:28.052035+0000","last_fullsized":"2024-09-19T11:59:28.052035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:43.399242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'110","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.380540+0000","last_change":"2024-09-19T11:35:33.612189+0000","last_active":"2024-09-19T12:02:19.380540+0000","last_peered":"2024-09-19T12:02:19.380540+0000","last_clean":"2024-09-19T12:02:19.380540+0000","last_became_active":"2024-09-19T11:35:33.611732+0000","last_became_peered":"2024-09-19T11:35:33.611732+0000","last_unstale":"2024-09-19T12:02:19.380540+0000","last_undegraded":"2024-09-19T12:02:19.380540+0000","last_fullsized":"2024-09-19T12:02:19.380540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:18.009652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":312,"num_write":153,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'43","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.594278+0000","last_change":"2024-09-19T11:35:31.585905+0000","last_active":"2024-09-19T11:59:46.594278+0000","last_peered":"2024-09-19T11:59:46.594278+0000","last_clean":"2024-09-19T11:59:46.594278+0000","last_became_active":"2024-09-19T11:35:31.585423+0000","last_became_peered":"2024-09-19T11:35:31.585423+0000","last_unstale":"2024-09-19T11:59:46.594278+0000","last_undegraded":"2024-09-19T11:59:46.594278+0000","last_fullsized":"2024-09-19T11:59:46.594278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:25:09.830393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080025,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":118,"num_read_kb":1132,"num_write":168,"num_write_kb":1063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618616+0000","last_change":"2024-09-19T11:35:35.633072+0000","last_active":"2024-09-19T12:00:36.618616+0000","last_peered":"2024-09-19T12:00:36.618616+0000","last_clean":"2024-09-19T12:00:36.618616+0000","last_became_active":"2024-09-19T11:35:35.632384+0000","last_became_peered":"2024-09-19T11:35:35.632384+0000","last_unstale":"2024-09-19T12:00:36.618616+0000","last_undegraded":"2024-09-19T12:00:36.618616+0000","last_fullsized":"2024-09-19T12:00:36.618616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:13.028878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'72","reported_seq":575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.796977+0000","last_change":"2024-09-19T11:35:37.642378+0000","last_active":"2024-09-19T12:02:17.796977+0000","last_peered":"2024-09-19T12:02:17.796977+0000","last_clean":"2024-09-19T12:02:17.796977+0000","last_became_active":"2024-09-19T11:35:37.641603+0000","last_became_peered":"2024-09-19T11:35:37.641603+0000","last_unstale":"2024-09-19T12:02:17.796977+0000","last_undegraded":"2024-09-19T12:02:17.796977+0000","last_fullsized":"2024-09-19T12:02:17.796977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:06.984305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8122,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":109,"num_read_kb":139,"num_write":96,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.573467+0000","last_change":"2024-09-19T11:35:39.684040+0000","last_active":"2024-09-19T11:58:11.573467+0000","last_peered":"2024-09-19T11:58:11.573467+0000","last_clean":"2024-09-19T11:58:11.573467+0000","last_became_active":"2024-09-19T11:35:39.683564+0000","last_became_peered":"2024-09-19T11:35:39.683564+0000","last_unstale":"2024-09-19T11:58:11.573467+0000","last_undegraded":"2024-09-19T11:58:11.573467+0000","last_fullsized":"2024-09-19T11:58:11.573467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:14.462022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'25","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.989255+0000","last_change":"2024-09-19T11:35:41.665955+0000","last_active":"2024-09-19T12:02:32.989255+0000","last_peered":"2024-09-19T12:02:32.989255+0000","last_clean":"2024-09-19T12:02:32.989255+0000","last_became_active":"2024-09-19T11:35:41.665262+0000","last_became_peered":"2024-09-19T11:35:41.665262+0000","last_unstale":"2024-09-19T12:02:32.989255+0000","last_undegraded":"2024-09-19T12:02:32.989255+0000","last_fullsized":"2024-09-19T12:02:32.989255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:27.405987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":132,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'2","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.166673+0000","last_change":"2024-09-19T11:35:33.614188+0000","last_active":"2024-09-19T12:02:33.166673+0000","last_peered":"2024-09-19T12:02:33.166673+0000","last_clean":"2024-09-19T12:02:33.166673+0000","last_became_active":"2024-09-19T11:35:33.613712+0000","last_became_peered":"2024-09-19T11:35:33.613712+0000","last_unstale":"2024-09-19T12:02:33.166673+0000","last_undegraded":"2024-09-19T12:02:33.166673+0000","last_fullsized":"2024-09-19T12:02:33.166673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:35.628949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'41","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.809581+0000","last_change":"2024-09-19T11:35:31.580900+0000","last_active":"2024-09-19T12:00:31.809581+0000","last_peered":"2024-09-19T12:00:31.809581+0000","last_clean":"2024-09-19T12:00:31.809581+0000","last_became_active":"2024-09-19T11:35:31.579680+0000","last_became_peered":"2024-09-19T11:35:31.579680+0000","last_unstale":"2024-09-19T12:00:31.809581+0000","last_undegraded":"2024-09-19T12:00:31.809581+0000","last_fullsized":"2024-09-19T12:00:31.809581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:17.218721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":100,"num_read_kb":1771,"num_write":183,"num_write_kb":1706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.777279+0000","last_change":"2024-09-19T11:35:35.628919+0000","last_active":"2024-09-19T11:58:06.777279+0000","last_peered":"2024-09-19T11:58:06.777279+0000","last_clean":"2024-09-19T11:58:06.777279+0000","last_became_active":"2024-09-19T11:35:35.625446+0000","last_became_peered":"2024-09-19T11:35:35.625446+0000","last_unstale":"2024-09-19T11:58:06.777279+0000","last_undegraded":"2024-09-19T11:58:06.777279+0000","last_fullsized":"2024-09-19T11:58:06.777279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:40.113640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'68","reported_seq":572,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615309+0000","last_change":"2024-09-19T11:35:37.617373+0000","last_active":"2024-09-19T12:00:41.615309+0000","last_peered":"2024-09-19T12:00:41.615309+0000","last_clean":"2024-09-19T12:00:41.615309+0000","last_became_active":"2024-09-19T11:35:37.616602+0000","last_became_peered":"2024-09-19T11:35:37.616602+0000","last_unstale":"2024-09-19T12:00:41.615309+0000","last_undegraded":"2024-09-19T12:00:41.615309+0000","last_fullsized":"2024-09-19T12:00:41.615309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:47.275427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10384,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":91,"num_read_kb":140,"num_write":70,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.594472+0000","last_change":"2024-09-19T11:35:39.686747+0000","last_active":"2024-09-19T11:59:46.594472+0000","last_peered":"2024-09-19T11:59:46.594472+0000","last_clean":"2024-09-19T11:59:46.594472+0000","last_became_active":"2024-09-19T11:35:39.686225+0000","last_became_peered":"2024-09-19T11:35:39.686225+0000","last_unstale":"2024-09-19T11:59:46.594472+0000","last_undegraded":"2024-09-19T11:59:46.594472+0000","last_fullsized":"2024-09-19T11:59:46.594472+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:38.757638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"256'2","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.596457+0000","last_change":"2024-09-19T11:35:41.683491+0000","last_active":"2024-09-19T11:59:01.596457+0000","last_peered":"2024-09-19T11:59:01.596457+0000","last_clean":"2024-09-19T11:59:01.596457+0000","last_became_active":"2024-09-19T11:35:41.682440+0000","last_became_peered":"2024-09-19T11:35:41.682440+0000","last_unstale":"2024-09-19T11:59:01.596457+0000","last_undegraded":"2024-09-19T11:59:01.596457+0000","last_fullsized":"2024-09-19T11:59:01.596457+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:15.584265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'93","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:43.947971+0000","last_change":"2024-09-19T11:35:33.605732+0000","last_active":"2024-09-19T12:01:43.947971+0000","last_peered":"2024-09-19T12:01:43.947971+0000","last_clean":"2024-09-19T12:01:43.947971+0000","last_became_active":"2024-09-19T11:35:33.605161+0000","last_became_peered":"2024-09-19T11:35:33.605161+0000","last_unstale":"2024-09-19T12:01:43.947971+0000","last_undegraded":"2024-09-19T12:01:43.947971+0000","last_fullsized":"2024-09-19T12:01:43.947971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:47.784644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":359,"num_read_kb":288,"num_write":158,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'26","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.618577+0000","last_change":"2024-09-19T11:35:31.602820+0000","last_active":"2024-09-19T12:00:31.618577+0000","last_peered":"2024-09-19T12:00:31.618577+0000","last_clean":"2024-09-19T12:00:31.618577+0000","last_became_active":"2024-09-19T11:35:31.602466+0000","last_became_peered":"2024-09-19T11:35:31.602466+0000","last_unstale":"2024-09-19T12:00:31.618577+0000","last_undegraded":"2024-09-19T12:00:31.618577+0000","last_fullsized":"2024-09-19T12:00:31.618577+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:21.152956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":45,"num_write":118,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.572238+0000","last_change":"2024-09-19T11:35:35.632089+0000","last_active":"2024-09-19T11:58:06.572238+0000","last_peered":"2024-09-19T11:58:06.572238+0000","last_clean":"2024-09-19T11:58:06.572238+0000","last_became_active":"2024-09-19T11:35:35.631573+0000","last_became_peered":"2024-09-19T11:35:35.631573+0000","last_unstale":"2024-09-19T11:58:06.572238+0000","last_undegraded":"2024-09-19T11:58:06.572238+0000","last_fullsized":"2024-09-19T11:58:06.572238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:57.000282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'40","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.798513+0000","last_change":"2024-09-19T11:35:37.633680+0000","last_active":"2024-09-19T11:59:41.798513+0000","last_peered":"2024-09-19T11:59:41.798513+0000","last_clean":"2024-09-19T11:59:41.798513+0000","last_became_active":"2024-09-19T11:35:37.632562+0000","last_became_peered":"2024-09-19T11:35:37.632562+0000","last_unstale":"2024-09-19T11:59:41.798513+0000","last_undegraded":"2024-09-19T11:59:41.798513+0000","last_fullsized":"2024-09-19T11:59:41.798513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:18.066710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":55,"num_read_kb":48,"num_write":46,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'614","reported_seq":1537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.458282+0000","last_change":"2024-09-19T11:35:39.660361+0000","last_active":"2024-09-19T12:02:34.458282+0000","last_peered":"2024-09-19T12:02:34.458282+0000","last_clean":"2024-09-19T12:02:34.458282+0000","last_became_active":"2024-09-19T11:35:39.659602+0000","last_became_peered":"2024-09-19T11:35:39.659602+0000","last_unstale":"2024-09-19T12:02:34.458282+0000","last_undegraded":"2024-09-19T12:02:34.458282+0000","last_fullsized":"2024-09-19T12:02:34.458282+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:19.524182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'7","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.600833+0000","last_change":"2024-09-19T11:35:41.682361+0000","last_active":"2024-09-19T11:59:01.600833+0000","last_peered":"2024-09-19T11:59:01.600833+0000","last_clean":"2024-09-19T11:59:01.600833+0000","last_became_active":"2024-09-19T11:35:41.681567+0000","last_became_peered":"2024-09-19T11:35:41.681567+0000","last_unstale":"2024-09-19T11:59:01.600833+0000","last_undegraded":"2024-09-19T11:59:01.600833+0000","last_fullsized":"2024-09-19T11:59:01.600833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:05.849048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'69","reported_seq":567,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:05.818754+0000","last_change":"2024-09-19T11:35:33.618140+0000","last_active":"2024-09-19T12:00:05.818754+0000","last_peered":"2024-09-19T12:00:05.818754+0000","last_clean":"2024-09-19T12:00:05.818754+0000","last_became_active":"2024-09-19T11:35:33.617414+0000","last_became_peered":"2024-09-19T11:35:33.617414+0000","last_unstale":"2024-09-19T12:00:05.818754+0000","last_undegraded":"2024-09-19T12:00:05.818754+0000","last_fullsized":"2024-09-19T12:00:05.818754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:12.877192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":201,"num_write":115,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'23","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.616654+0000","last_change":"2024-09-19T11:35:31.620319+0000","last_active":"2024-09-19T12:00:31.616654+0000","last_peered":"2024-09-19T12:00:31.616654+0000","last_clean":"2024-09-19T12:00:31.616654+0000","last_became_active":"2024-09-19T11:35:31.613260+0000","last_became_peered":"2024-09-19T11:35:31.613260+0000","last_unstale":"2024-09-19T12:00:31.616654+0000","last_undegraded":"2024-09-19T12:00:31.616654+0000","last_fullsized":"2024-09-19T12:00:31.616654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:43.808702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1104621,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":31,"num_read_kb":9290,"num_write":71,"num_write_kb":7234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.587216+0000","last_change":"2024-09-19T11:35:35.618214+0000","last_active":"2024-09-19T11:58:06.587216+0000","last_peered":"2024-09-19T11:58:06.587216+0000","last_clean":"2024-09-19T11:58:06.587216+0000","last_became_active":"2024-09-19T11:35:35.617489+0000","last_became_peered":"2024-09-19T11:35:35.617489+0000","last_unstale":"2024-09-19T11:58:06.587216+0000","last_undegraded":"2024-09-19T11:58:06.587216+0000","last_fullsized":"2024-09-19T11:58:06.587216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:05.845518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'87","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.792479+0000","last_change":"2024-09-19T11:35:37.625579+0000","last_active":"2024-09-19T12:02:17.792479+0000","last_peered":"2024-09-19T12:02:17.792479+0000","last_clean":"2024-09-19T12:02:17.792479+0000","last_became_active":"2024-09-19T11:35:37.624101+0000","last_became_peered":"2024-09-19T11:35:37.624101+0000","last_unstale":"2024-09-19T12:02:17.792479+0000","last_undegraded":"2024-09-19T12:02:17.792479+0000","last_fullsized":"2024-09-19T12:02:17.792479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:13:17.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10373,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":114,"num_read_kb":163,"num_write":88,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.608983+0000","last_change":"2024-09-19T11:35:39.674060+0000","last_active":"2024-09-19T11:59:51.608983+0000","last_peered":"2024-09-19T11:59:51.608983+0000","last_clean":"2024-09-19T11:59:51.608983+0000","last_became_active":"2024-09-19T11:35:39.671474+0000","last_became_peered":"2024-09-19T11:35:39.671474+0000","last_unstale":"2024-09-19T11:59:51.608983+0000","last_undegraded":"2024-09-19T11:59:51.608983+0000","last_fullsized":"2024-09-19T11:59:51.608983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:49.787232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'16","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611804+0000","last_change":"2024-09-19T11:35:41.694646+0000","last_active":"2024-09-19T11:59:51.611804+0000","last_peered":"2024-09-19T11:59:51.611804+0000","last_clean":"2024-09-19T11:59:51.611804+0000","last_became_active":"2024-09-19T11:35:41.693900+0000","last_became_peered":"2024-09-19T11:35:41.693900+0000","last_unstale":"2024-09-19T11:59:51.611804+0000","last_undegraded":"2024-09-19T11:59:51.611804+0000","last_fullsized":"2024-09-19T11:59:51.611804+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:06.653849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'84","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.164927+0000","last_change":"2024-09-19T11:35:33.605993+0000","last_active":"2024-09-19T12:02:33.164927+0000","last_peered":"2024-09-19T12:02:33.164927+0000","last_clean":"2024-09-19T12:02:33.164927+0000","last_became_active":"2024-09-19T11:35:33.605259+0000","last_became_peered":"2024-09-19T11:35:33.605259+0000","last_unstale":"2024-09-19T12:02:33.164927+0000","last_undegraded":"2024-09-19T12:02:33.164927+0000","last_fullsized":"2024-09-19T12:02:33.164927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:43.033562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":291,"num_write":128,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'42","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.778703+0000","last_change":"2024-09-19T11:35:31.623300+0000","last_active":"2024-09-19T12:02:17.778703+0000","last_peered":"2024-09-19T12:02:17.778703+0000","last_clean":"2024-09-19T12:02:17.778703+0000","last_became_active":"2024-09-19T11:35:31.622688+0000","last_became_peered":"2024-09-19T11:35:31.622688+0000","last_unstale":"2024-09-19T12:02:17.778703+0000","last_undegraded":"2024-09-19T12:02:17.778703+0000","last_fullsized":"2024-09-19T12:02:17.778703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:48.009120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079943,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":109,"num_read_kb":10950,"num_write":213,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:06.584085+0000","last_change":"2024-09-19T11:35:35.622260+0000","last_active":"2024-09-19T11:58:06.584085+0000","last_peered":"2024-09-19T11:58:06.584085+0000","last_clean":"2024-09-19T11:58:06.584085+0000","last_became_active":"2024-09-19T11:35:35.621518+0000","last_became_peered":"2024-09-19T11:35:35.621518+0000","last_unstale":"2024-09-19T11:58:06.584085+0000","last_undegraded":"2024-09-19T11:58:06.584085+0000","last_fullsized":"2024-09-19T11:58:06.584085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:30.262378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'88","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.358024+0000","last_change":"2024-09-19T11:35:37.641470+0000","last_active":"2024-09-19T12:02:19.358024+0000","last_peered":"2024-09-19T12:02:19.358024+0000","last_clean":"2024-09-19T12:02:19.358024+0000","last_became_active":"2024-09-19T11:35:37.639833+0000","last_became_peered":"2024-09-19T11:35:37.639833+0000","last_unstale":"2024-09-19T12:02:19.358024+0000","last_undegraded":"2024-09-19T12:02:19.358024+0000","last_fullsized":"2024-09-19T12:02:19.358024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:25.377817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10914,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":139,"num_write":82,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":470,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.609264+0000","last_change":"2024-09-19T11:35:39.659799+0000","last_active":"2024-09-19T11:59:56.609264+0000","last_peered":"2024-09-19T11:59:56.609264+0000","last_clean":"2024-09-19T11:59:56.609264+0000","last_became_active":"2024-09-19T11:35:39.659011+0000","last_became_peered":"2024-09-19T11:35:39.659011+0000","last_unstale":"2024-09-19T11:59:56.609264+0000","last_undegraded":"2024-09-19T11:59:56.609264+0000","last_fullsized":"2024-09-19T11:59:56.609264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:33.261718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'15","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.603923+0000","last_change":"2024-09-19T11:35:41.675429+0000","last_active":"2024-09-19T11:59:51.603923+0000","last_peered":"2024-09-19T11:59:51.603923+0000","last_clean":"2024-09-19T11:59:51.603923+0000","last_became_active":"2024-09-19T11:35:41.674818+0000","last_became_peered":"2024-09-19T11:35:41.674818+0000","last_unstale":"2024-09-19T11:59:51.603923+0000","last_undegraded":"2024-09-19T11:59:51.603923+0000","last_fullsized":"2024-09-19T11:59:51.603923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:12.876595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":90,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'44","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.603738+0000","last_change":"2024-09-19T11:35:33.603965+0000","last_active":"2024-09-19T11:59:51.603738+0000","last_peered":"2024-09-19T11:59:51.603738+0000","last_clean":"2024-09-19T11:59:51.603738+0000","last_became_active":"2024-09-19T11:35:33.603610+0000","last_became_peered":"2024-09-19T11:35:33.603610+0000","last_unstale":"2024-09-19T11:59:51.603738+0000","last_undegraded":"2024-09-19T11:59:51.603738+0000","last_fullsized":"2024-09-19T11:59:51.603738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:56.366121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":138,"num_write":82,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'39","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.782966+0000","last_change":"2024-09-19T11:35:31.621194+0000","last_active":"2024-09-19T12:02:17.782966+0000","last_peered":"2024-09-19T12:02:17.782966+0000","last_clean":"2024-09-19T12:02:17.782966+0000","last_became_active":"2024-09-19T11:35:31.620504+0000","last_became_peered":"2024-09-19T11:35:31.620504+0000","last_unstale":"2024-09-19T12:02:17.782966+0000","last_undegraded":"2024-09-19T12:02:17.782966+0000","last_fullsized":"2024-09-19T12:02:17.782966+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:59.865113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5555,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":1683,"num_write":166,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.799503+0000","last_change":"2024-09-19T11:35:35.624137+0000","last_active":"2024-09-19T11:59:46.799503+0000","last_peered":"2024-09-19T11:59:46.799503+0000","last_clean":"2024-09-19T11:59:46.799503+0000","last_became_active":"2024-09-19T11:35:35.623348+0000","last_became_peered":"2024-09-19T11:35:35.623348+0000","last_unstale":"2024-09-19T11:59:46.799503+0000","last_undegraded":"2024-09-19T11:59:46.799503+0000","last_fullsized":"2024-09-19T11:59:46.799503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:43.589134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'39","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615151+0000","last_change":"2024-09-19T11:35:37.643750+0000","last_active":"2024-09-19T12:00:41.615151+0000","last_peered":"2024-09-19T12:00:41.615151+0000","last_clean":"2024-09-19T12:00:41.615151+0000","last_became_active":"2024-09-19T11:35:37.643249+0000","last_became_peered":"2024-09-19T11:35:37.643249+0000","last_unstale":"2024-09-19T12:00:41.615151+0000","last_undegraded":"2024-09-19T12:00:41.615151+0000","last_fullsized":"2024-09-19T12:00:41.615151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:36.730823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":81,"num_write":38,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.778397+0000","last_change":"2024-09-19T11:35:39.675950+0000","last_active":"2024-09-19T11:58:11.778397+0000","last_peered":"2024-09-19T11:58:11.778397+0000","last_clean":"2024-09-19T11:58:11.778397+0000","last_became_active":"2024-09-19T11:35:39.675285+0000","last_became_peered":"2024-09-19T11:35:39.675285+0000","last_unstale":"2024-09-19T11:58:11.778397+0000","last_undegraded":"2024-09-19T11:58:11.778397+0000","last_fullsized":"2024-09-19T11:58:11.778397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:52.963177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'22","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.336022+0000","last_change":"2024-09-19T11:35:41.695355+0000","last_active":"2024-09-19T12:00:06.336022+0000","last_peered":"2024-09-19T12:00:06.336022+0000","last_clean":"2024-09-19T12:00:06.336022+0000","last_became_active":"2024-09-19T11:35:41.694201+0000","last_became_peered":"2024-09-19T11:35:41.694201+0000","last_unstale":"2024-09-19T12:00:06.336022+0000","last_undegraded":"2024-09-19T12:00:06.336022+0000","last_fullsized":"2024-09-19T12:00:06.336022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:09.844137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":56,"num_write":68,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'84","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.162209+0000","last_change":"2024-09-19T11:35:33.629309+0000","last_active":"2024-09-19T12:02:33.162209+0000","last_peered":"2024-09-19T12:02:33.162209+0000","last_clean":"2024-09-19T12:02:33.162209+0000","last_became_active":"2024-09-19T11:35:33.628283+0000","last_became_peered":"2024-09-19T11:35:33.628283+0000","last_unstale":"2024-09-19T12:02:33.162209+0000","last_undegraded":"2024-09-19T12:02:33.162209+0000","last_fullsized":"2024-09-19T12:02:33.162209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:35.386501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":329,"num_read_kb":270,"num_write":117,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'28","reported_seq":540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.781745+0000","last_change":"2024-09-19T11:36:06.650917+0000","last_active":"2024-09-19T12:02:17.781745+0000","last_peered":"2024-09-19T12:02:17.781745+0000","last_clean":"2024-09-19T12:02:17.781745+0000","last_became_active":"2024-09-19T11:36:06.649652+0000","last_became_peered":"2024-09-19T11:36:06.649652+0000","last_unstale":"2024-09-19T12:02:17.781745+0000","last_undegraded":"2024-09-19T12:02:17.781745+0000","last_fullsized":"2024-09-19T12:02:17.781745+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:48.816823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080003,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":40,"num_read_kb":1095,"num_write":135,"num_write_kb":1067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,7],"acting":[0,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.595482+0000","last_change":"2024-09-19T11:35:35.612806+0000","last_active":"2024-09-19T11:59:51.595482+0000","last_peered":"2024-09-19T11:59:51.595482+0000","last_clean":"2024-09-19T11:59:51.595482+0000","last_became_active":"2024-09-19T11:35:35.612450+0000","last_became_peered":"2024-09-19T11:35:35.612450+0000","last_unstale":"2024-09-19T11:59:51.595482+0000","last_undegraded":"2024-09-19T11:59:51.595482+0000","last_fullsized":"2024-09-19T11:59:51.595482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:02.776959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'86","reported_seq":599,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812229+0000","last_change":"2024-09-19T11:35:37.639560+0000","last_active":"2024-09-19T12:00:41.812229+0000","last_peered":"2024-09-19T12:00:41.812229+0000","last_clean":"2024-09-19T12:00:41.812229+0000","last_became_active":"2024-09-19T11:35:37.638771+0000","last_became_peered":"2024-09-19T11:35:37.638771+0000","last_unstale":"2024-09-19T12:00:41.812229+0000","last_undegraded":"2024-09-19T12:00:41.812229+0000","last_fullsized":"2024-09-19T12:00:41.812229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:56.133473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9181,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":162,"num_write":88,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.585939+0000","last_change":"2024-09-19T11:35:39.663318+0000","last_active":"2024-09-19T11:58:11.585939+0000","last_peered":"2024-09-19T11:58:11.585939+0000","last_clean":"2024-09-19T11:58:11.585939+0000","last_became_active":"2024-09-19T11:35:39.662405+0000","last_became_peered":"2024-09-19T11:35:39.662405+0000","last_unstale":"2024-09-19T11:58:11.585939+0000","last_undegraded":"2024-09-19T11:58:11.585939+0000","last_fullsized":"2024-09-19T11:58:11.585939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:58.275311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"253'4","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.789890+0000","last_change":"2024-09-19T11:35:41.688704+0000","last_active":"2024-09-19T11:59:01.789890+0000","last_peered":"2024-09-19T11:59:01.789890+0000","last_clean":"2024-09-19T11:59:01.789890+0000","last_became_active":"2024-09-19T11:35:41.687549+0000","last_became_peered":"2024-09-19T11:35:41.687549+0000","last_unstale":"2024-09-19T11:59:01.789890+0000","last_undegraded":"2024-09-19T11:59:01.789890+0000","last_fullsized":"2024-09-19T11:59:01.789890+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:56.527265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'79","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.346041+0000","last_change":"2024-09-19T11:35:33.629428+0000","last_active":"2024-09-19T12:00:06.346041+0000","last_peered":"2024-09-19T12:00:06.346041+0000","last_clean":"2024-09-19T12:00:06.346041+0000","last_became_active":"2024-09-19T11:35:33.629186+0000","last_became_peered":"2024-09-19T11:35:33.629186+0000","last_unstale":"2024-09-19T12:00:06.346041+0000","last_undegraded":"2024-09-19T12:00:06.346041+0000","last_fullsized":"2024-09-19T12:00:06.346041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:40.061077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":235,"num_write":161,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'58","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:21.408053+0000","last_change":"2024-09-19T11:35:31.613416+0000","last_active":"2024-09-19T12:02:21.408053+0000","last_peered":"2024-09-19T12:02:21.408053+0000","last_clean":"2024-09-19T12:02:21.408053+0000","last_became_active":"2024-09-19T11:35:31.611719+0000","last_became_peered":"2024-09-19T11:35:31.611719+0000","last_unstale":"2024-09-19T12:02:21.408053+0000","last_undegraded":"2024-09-19T12:02:21.408053+0000","last_fullsized":"2024-09-19T12:02:21.408053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:31.214410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2100468,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":108,"num_read_kb":5194,"num_write":181,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"253'355","reported_seq":1052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.589820+0000","last_change":"2024-09-19T11:35:33.606387+0000","last_active":"2024-09-19T11:59:26.589820+0000","last_peered":"2024-09-19T11:59:26.589820+0000","last_clean":"2024-09-19T11:59:26.589820+0000","last_became_active":"2024-09-19T11:35:33.603938+0000","last_became_peered":"2024-09-19T11:35:33.603938+0000","last_unstale":"2024-09-19T11:59:26.589820+0000","last_undegraded":"2024-09-19T11:59:26.589820+0000","last_fullsized":"2024-09-19T11:59:26.589820+0000","mapping_epoch":28,"log_start":"253'300","ondisk_log_start":"253'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:36.334582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1936,"num_read_kb":1745,"num_write":575,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'31","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.626924+0000","last_change":"2024-09-19T11:35:31.602514+0000","last_active":"2024-09-19T12:02:32.626924+0000","last_peered":"2024-09-19T12:02:32.626924+0000","last_clean":"2024-09-19T12:02:32.626924+0000","last_became_active":"2024-09-19T11:35:31.602046+0000","last_became_peered":"2024-09-19T11:35:31.602046+0000","last_unstale":"2024-09-19T12:02:32.626924+0000","last_undegraded":"2024-09-19T12:02:32.626924+0000","last_fullsized":"2024-09-19T12:02:32.626924+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:30.711983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":68,"num_read_kb":1671,"num_write":108,"num_write_kb":1627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'4","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.168487+0000","last_change":"2024-09-19T11:35:33.617890+0000","last_active":"2024-09-19T12:02:33.168487+0000","last_peered":"2024-09-19T12:02:33.168487+0000","last_clean":"2024-09-19T12:02:33.168487+0000","last_became_active":"2024-09-19T11:35:33.616104+0000","last_became_peered":"2024-09-19T11:35:33.616104+0000","last_unstale":"2024-09-19T12:02:33.168487+0000","last_undegraded":"2024-09-19T12:02:33.168487+0000","last_fullsized":"2024-09-19T12:02:33.168487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:20.380664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'30","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:26.511044+0000","last_change":"2024-09-19T11:35:31.620857+0000","last_active":"2024-09-19T12:02:26.511044+0000","last_peered":"2024-09-19T12:02:26.511044+0000","last_clean":"2024-09-19T12:02:26.511044+0000","last_became_active":"2024-09-19T11:35:31.613195+0000","last_became_peered":"2024-09-19T11:35:31.613195+0000","last_unstale":"2024-09-19T12:02:26.511044+0000","last_undegraded":"2024-09-19T12:02:26.511044+0000","last_fullsized":"2024-09-19T12:02:26.511044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:06.230787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":129,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'20","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:36.618841+0000","last_change":"2024-09-19T11:35:33.619576+0000","last_active":"2024-09-19T12:01:36.618841+0000","last_peered":"2024-09-19T12:01:36.618841+0000","last_clean":"2024-09-19T12:01:36.618841+0000","last_became_active":"2024-09-19T11:35:33.619302+0000","last_became_peered":"2024-09-19T11:35:33.619302+0000","last_unstale":"2024-09-19T12:01:36.618841+0000","last_undegraded":"2024-09-19T12:01:36.618841+0000","last_fullsized":"2024-09-19T12:01:36.618841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:20.380664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'60","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.619732+0000","last_change":"2024-09-19T11:35:31.591076+0000","last_active":"2024-09-19T12:00:36.619732+0000","last_peered":"2024-09-19T12:00:36.619732+0000","last_clean":"2024-09-19T12:00:36.619732+0000","last_became_active":"2024-09-19T11:35:31.590651+0000","last_became_peered":"2024-09-19T11:35:31.590651+0000","last_unstale":"2024-09-19T12:00:36.619732+0000","last_undegraded":"2024-09-19T12:00:36.619732+0000","last_fullsized":"2024-09-19T12:00:36.619732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:43.726265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254104,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":157,"num_read_kb":1977,"num_write":237,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615123+0000","last_change":"2024-09-19T11:35:33.619828+0000","last_active":"2024-09-19T12:00:41.615123+0000","last_peered":"2024-09-19T12:00:41.615123+0000","last_clean":"2024-09-19T12:00:41.615123+0000","last_became_active":"2024-09-19T11:35:33.619372+0000","last_became_peered":"2024-09-19T11:35:33.619372+0000","last_unstale":"2024-09-19T12:00:41.615123+0000","last_undegraded":"2024-09-19T12:00:41.615123+0000","last_fullsized":"2024-09-19T12:00:41.615123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:25.554628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'13","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.307097+0000","last_change":"2024-09-19T11:35:31.584872+0000","last_active":"2024-09-19T12:00:06.307097+0000","last_peered":"2024-09-19T12:00:06.307097+0000","last_clean":"2024-09-19T12:00:06.307097+0000","last_became_active":"2024-09-19T11:35:31.584316+0000","last_became_peered":"2024-09-19T11:35:31.584316+0000","last_unstale":"2024-09-19T12:00:06.307097+0000","last_undegraded":"2024-09-19T12:00:06.307097+0000","last_fullsized":"2024-09-19T12:00:06.307097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:53.681623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079969,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":11,"num_read_kb":1065,"num_write":62,"num_write_kb":1060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810904+0000","last_change":"2024-09-19T11:35:33.627636+0000","last_active":"2024-09-19T12:00:36.810904+0000","last_peered":"2024-09-19T12:00:36.810904+0000","last_clean":"2024-09-19T12:00:36.810904+0000","last_became_active":"2024-09-19T11:35:33.626872+0000","last_became_peered":"2024-09-19T11:35:33.626872+0000","last_unstale":"2024-09-19T12:00:36.810904+0000","last_undegraded":"2024-09-19T12:00:36.810904+0000","last_fullsized":"2024-09-19T12:00:36.810904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:36.325211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'27","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.714132+0000","last_change":"2024-09-19T11:35:31.592141+0000","last_active":"2024-09-19T12:02:17.714132+0000","last_peered":"2024-09-19T12:02:17.714132+0000","last_clean":"2024-09-19T12:02:17.714132+0000","last_became_active":"2024-09-19T11:35:31.591724+0000","last_became_peered":"2024-09-19T11:35:31.591724+0000","last_unstale":"2024-09-19T12:02:17.714132+0000","last_undegraded":"2024-09-19T12:02:17.714132+0000","last_fullsized":"2024-09-19T12:02:17.714132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:35.585870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1129208,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":58,"num_read_kb":1149,"num_write":136,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'52","reported_seq":560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.197816+0000","last_change":"2024-09-19T11:35:33.614983+0000","last_active":"2024-09-19T12:02:33.197816+0000","last_peered":"2024-09-19T12:02:33.197816+0000","last_clean":"2024-09-19T12:02:33.197816+0000","last_became_active":"2024-09-19T11:35:33.614316+0000","last_became_peered":"2024-09-19T11:35:33.614316+0000","last_unstale":"2024-09-19T12:02:33.197816+0000","last_undegraded":"2024-09-19T12:02:33.197816+0000","last_fullsized":"2024-09-19T12:02:33.197816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:38.763908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":175,"num_write":74,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'40","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.516411+0000","last_change":"2024-09-19T11:35:31.613679+0000","last_active":"2024-09-19T12:02:32.516411+0000","last_peered":"2024-09-19T12:02:32.516411+0000","last_clean":"2024-09-19T12:02:32.516411+0000","last_became_active":"2024-09-19T11:35:31.612367+0000","last_became_peered":"2024-09-19T11:35:31.612367+0000","last_unstale":"2024-09-19T12:02:32.516411+0000","last_undegraded":"2024-09-19T12:02:32.516411+0000","last_fullsized":"2024-09-19T12:02:32.516411+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:21.506300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246359,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":87,"num_read_kb":319,"num_write":180,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'50","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618415+0000","last_change":"2024-09-19T11:35:33.625962+0000","last_active":"2024-09-19T12:00:36.618415+0000","last_peered":"2024-09-19T12:00:36.618415+0000","last_clean":"2024-09-19T12:00:36.618415+0000","last_became_active":"2024-09-19T11:35:33.625249+0000","last_became_peered":"2024-09-19T11:35:33.625249+0000","last_unstale":"2024-09-19T12:00:36.618415+0000","last_undegraded":"2024-09-19T12:00:36.618415+0000","last_fullsized":"2024-09-19T12:00:36.618415+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:54.254614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":159,"num_write":74,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'43","reported_seq":559,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.715507+0000","last_change":"2024-09-19T11:35:31.589092+0000","last_active":"2024-09-19T12:02:17.715507+0000","last_peered":"2024-09-19T12:02:17.715507+0000","last_clean":"2024-09-19T12:02:17.715507+0000","last_became_active":"2024-09-19T11:35:31.588705+0000","last_became_peered":"2024-09-19T11:35:31.588705+0000","last_unstale":"2024-09-19T12:02:17.715507+0000","last_undegraded":"2024-09-19T12:02:17.715507+0000","last_fullsized":"2024-09-19T12:02:17.715507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:23.530669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194452,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":74,"num_read_kb":4157,"num_write":175,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'73","reported_seq":570,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.596172+0000","last_change":"2024-09-19T11:35:33.626308+0000","last_active":"2024-09-19T11:58:56.596172+0000","last_peered":"2024-09-19T11:58:56.596172+0000","last_clean":"2024-09-19T11:58:56.596172+0000","last_became_active":"2024-09-19T11:35:33.625874+0000","last_became_peered":"2024-09-19T11:35:33.625874+0000","last_unstale":"2024-09-19T11:58:56.596172+0000","last_undegraded":"2024-09-19T11:58:56.596172+0000","last_fullsized":"2024-09-19T11:58:56.596172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:34.524797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":214,"num_write":124,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'25","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:32.852109+0000","last_change":"2024-09-19T11:35:31.594437+0000","last_active":"2024-09-19T11:59:32.852109+0000","last_peered":"2024-09-19T11:59:32.852109+0000","last_clean":"2024-09-19T11:59:32.852109+0000","last_became_active":"2024-09-19T11:35:31.593067+0000","last_became_peered":"2024-09-19T11:35:31.593067+0000","last_unstale":"2024-09-19T11:59:32.852109+0000","last_undegraded":"2024-09-19T11:59:32.852109+0000","last_fullsized":"2024-09-19T11:59:32.852109+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:39.500525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080024,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":43,"num_read_kb":1085,"num_write":109,"num_write_kb":1065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.788881+0000","last_change":"2024-09-19T11:35:33.613879+0000","last_active":"2024-09-19T11:58:56.788881+0000","last_peered":"2024-09-19T11:58:56.788881+0000","last_clean":"2024-09-19T11:58:56.788881+0000","last_became_active":"2024-09-19T11:35:33.612924+0000","last_became_peered":"2024-09-19T11:35:33.612924+0000","last_unstale":"2024-09-19T11:58:56.788881+0000","last_undegraded":"2024-09-19T11:58:56.788881+0000","last_fullsized":"2024-09-19T11:58:56.788881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:49.021618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'51","reported_seq":564,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:31.639122+0000","last_change":"2024-09-19T11:35:31.581801+0000","last_active":"2024-09-19T12:02:31.639122+0000","last_peered":"2024-09-19T12:02:31.639122+0000","last_clean":"2024-09-19T12:02:31.639122+0000","last_became_active":"2024-09-19T11:35:31.581058+0000","last_became_peered":"2024-09-19T11:35:31.581058+0000","last_unstale":"2024-09-19T12:02:31.639122+0000","last_undegraded":"2024-09-19T12:02:31.639122+0000","last_fullsized":"2024-09-19T12:02:31.639122+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:01.730787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246431,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":78,"num_read_kb":310,"num_write":188,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'63","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603171+0000","last_change":"2024-09-19T11:35:33.628641+0000","last_active":"2024-09-19T12:00:26.603171+0000","last_peered":"2024-09-19T12:00:26.603171+0000","last_clean":"2024-09-19T12:00:26.603171+0000","last_became_active":"2024-09-19T11:35:33.628335+0000","last_became_peered":"2024-09-19T11:35:33.628335+0000","last_unstale":"2024-09-19T12:00:26.603171+0000","last_undegraded":"2024-09-19T12:00:26.603171+0000","last_fullsized":"2024-09-19T12:00:26.603171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:30.155543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":184,"num_write":116,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'35","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.612851+0000","last_change":"2024-09-19T11:35:31.624411+0000","last_active":"2024-09-19T12:00:16.612851+0000","last_peered":"2024-09-19T12:00:16.612851+0000","last_clean":"2024-09-19T12:00:16.612851+0000","last_became_active":"2024-09-19T11:35:31.623733+0000","last_became_peered":"2024-09-19T11:35:31.623733+0000","last_unstale":"2024-09-19T12:00:16.612851+0000","last_undegraded":"2024-09-19T12:00:16.612851+0000","last_fullsized":"2024-09-19T12:00:16.612851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:54.808464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159980,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":69,"num_read_kb":2163,"num_write":158,"num_write_kb":2120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'85","reported_seq":599,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807456+0000","last_change":"2024-09-19T11:35:33.628930+0000","last_active":"2024-09-19T12:00:21.807456+0000","last_peered":"2024-09-19T12:00:21.807456+0000","last_clean":"2024-09-19T12:00:21.807456+0000","last_became_active":"2024-09-19T11:35:33.628184+0000","last_became_peered":"2024-09-19T11:35:33.628184+0000","last_unstale":"2024-09-19T12:00:21.807456+0000","last_undegraded":"2024-09-19T12:00:21.807456+0000","last_fullsized":"2024-09-19T12:00:21.807456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:43.237383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":344,"num_read_kb":269,"num_write":142,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'49","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.614927+0000","last_change":"2024-09-19T11:35:31.613045+0000","last_active":"2024-09-19T12:00:16.614927+0000","last_peered":"2024-09-19T12:00:16.614927+0000","last_clean":"2024-09-19T12:00:16.614927+0000","last_became_active":"2024-09-19T11:35:31.612601+0000","last_became_peered":"2024-09-19T11:35:31.612601+0000","last_unstale":"2024-09-19T12:00:16.614927+0000","last_undegraded":"2024-09-19T12:00:16.614927+0000","last_fullsized":"2024-09-19T12:00:16.614927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:35.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243045,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":69,"num_read_kb":6286,"num_write":164,"num_write_kb":11381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'7","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:25.789799+0000","last_change":"2024-09-19T11:35:33.624908+0000","last_active":"2024-09-19T12:02:25.789799+0000","last_peered":"2024-09-19T12:02:25.789799+0000","last_clean":"2024-09-19T12:02:25.789799+0000","last_became_active":"2024-09-19T11:35:33.624149+0000","last_became_peered":"2024-09-19T11:35:33.624149+0000","last_unstale":"2024-09-19T12:02:25.789799+0000","last_undegraded":"2024-09-19T12:02:25.789799+0000","last_fullsized":"2024-09-19T12:02:25.789799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:05.347375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'27","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.776403+0000","last_change":"2024-09-19T11:35:31.610796+0000","last_active":"2024-09-19T12:02:17.776403+0000","last_peered":"2024-09-19T12:02:17.776403+0000","last_clean":"2024-09-19T12:02:17.776403+0000","last_became_active":"2024-09-19T11:35:31.609885+0000","last_became_peered":"2024-09-19T11:35:31.609885+0000","last_unstale":"2024-09-19T12:02:17.776403+0000","last_undegraded":"2024-09-19T12:02:17.776403+0000","last_fullsized":"2024-09-19T12:02:17.776403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:34:42.272784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49273,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":83,"num_write":112,"num_write_kb":10337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'127","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.616101+0000","last_change":"2024-09-19T11:35:33.620724+0000","last_active":"2024-09-19T12:00:21.616101+0000","last_peered":"2024-09-19T12:00:21.616101+0000","last_clean":"2024-09-19T12:00:21.616101+0000","last_became_active":"2024-09-19T11:35:33.620326+0000","last_became_peered":"2024-09-19T11:35:33.620326+0000","last_unstale":"2024-09-19T12:00:21.616101+0000","last_undegraded":"2024-09-19T12:00:21.616101+0000","last_fullsized":"2024-09-19T12:00:21.616101+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:14.282141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":393,"num_write":181,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'37","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.608995+0000","last_change":"2024-09-19T11:35:31.625519+0000","last_active":"2024-09-19T12:02:32.608995+0000","last_peered":"2024-09-19T12:02:32.608995+0000","last_clean":"2024-09-19T12:02:32.608995+0000","last_became_active":"2024-09-19T11:35:31.620566+0000","last_became_peered":"2024-09-19T11:35:31.620566+0000","last_unstale":"2024-09-19T12:02:32.608995+0000","last_undegraded":"2024-09-19T12:02:32.608995+0000","last_fullsized":"2024-09-19T12:02:32.608995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:37.899900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":84,"num_read_kb":69,"num_write":194,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'47","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.610388+0000","last_change":"2024-09-19T11:35:33.618657+0000","last_active":"2024-09-19T12:00:21.610388+0000","last_peered":"2024-09-19T12:00:21.610388+0000","last_clean":"2024-09-19T12:00:21.610388+0000","last_became_active":"2024-09-19T11:35:33.618247+0000","last_became_peered":"2024-09-19T11:35:33.618247+0000","last_unstale":"2024-09-19T12:00:21.610388+0000","last_undegraded":"2024-09-19T12:00:21.610388+0000","last_fullsized":"2024-09-19T12:00:21.610388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:16.980284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":141,"num_write":67,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'16","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:33.206831+0000","last_change":"2024-09-19T11:35:31.602891+0000","last_active":"2024-09-19T11:59:33.206831+0000","last_peered":"2024-09-19T11:59:33.206831+0000","last_clean":"2024-09-19T11:59:33.206831+0000","last_became_active":"2024-09-19T11:35:31.602248+0000","last_became_peered":"2024-09-19T11:35:31.602248+0000","last_unstale":"2024-09-19T11:59:33.206831+0000","last_undegraded":"2024-09-19T11:59:33.206831+0000","last_fullsized":"2024-09-19T11:59:33.206831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:05.964360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242991,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":21,"num_read_kb":5134,"num_write":70,"num_write_kb":5127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'37","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.376218+0000","last_change":"2024-09-19T11:35:33.625242+0000","last_active":"2024-09-19T12:02:19.376218+0000","last_peered":"2024-09-19T12:02:19.376218+0000","last_clean":"2024-09-19T12:02:19.376218+0000","last_became_active":"2024-09-19T11:35:33.624412+0000","last_became_peered":"2024-09-19T11:35:33.624412+0000","last_unstale":"2024-09-19T12:02:19.376218+0000","last_undegraded":"2024-09-19T12:02:19.376218+0000","last_fullsized":"2024-09-19T12:02:19.376218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:08.098513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":98,"num_write":42,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'24","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.474637+0000","last_change":"2024-09-19T11:35:31.609553+0000","last_active":"2024-09-19T12:02:32.474637+0000","last_peered":"2024-09-19T12:02:32.474637+0000","last_clean":"2024-09-19T12:02:32.474637+0000","last_became_active":"2024-09-19T11:35:31.607037+0000","last_became_peered":"2024-09-19T11:35:31.607037+0000","last_unstale":"2024-09-19T12:02:32.474637+0000","last_undegraded":"2024-09-19T12:02:32.474637+0000","last_fullsized":"2024-09-19T12:02:32.474637+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:33.501423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14288,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":45,"num_read_kb":53,"num_write":109,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'34","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.297625+0000","last_change":"2024-09-19T11:35:31.608404+0000","last_active":"2024-09-19T12:00:06.297625+0000","last_peered":"2024-09-19T12:00:06.297625+0000","last_clean":"2024-09-19T12:00:06.297625+0000","last_became_active":"2024-09-19T11:35:31.607805+0000","last_became_peered":"2024-09-19T11:35:31.607805+0000","last_unstale":"2024-09-19T12:00:06.297625+0000","last_undegraded":"2024-09-19T12:00:06.297625+0000","last_fullsized":"2024-09-19T12:00:06.297625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:55.223047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":82,"num_read_kb":66,"num_write":139,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.609215+0000","last_change":"2024-09-19T11:35:33.630383+0000","last_active":"2024-09-19T11:59:51.609215+0000","last_peered":"2024-09-19T11:59:51.609215+0000","last_clean":"2024-09-19T11:59:51.609215+0000","last_became_active":"2024-09-19T11:35:33.630100+0000","last_became_peered":"2024-09-19T11:35:33.630100+0000","last_unstale":"2024-09-19T11:59:51.609215+0000","last_undegraded":"2024-09-19T11:59:51.609215+0000","last_fullsized":"2024-09-19T11:59:51.609215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:23.578224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'23","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:54.759205+0000","last_change":"2024-09-19T11:35:31.588948+0000","last_active":"2024-09-19T11:58:54.759205+0000","last_peered":"2024-09-19T11:58:54.759205+0000","last_clean":"2024-09-19T11:58:54.759205+0000","last_became_active":"2024-09-19T11:35:31.588328+0000","last_became_peered":"2024-09-19T11:35:31.588328+0000","last_unstale":"2024-09-19T11:58:54.759205+0000","last_undegraded":"2024-09-19T11:58:54.759205+0000","last_fullsized":"2024-09-19T11:58:54.759205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:49.468879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":47,"num_read_kb":33,"num_write":105,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'232","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:43.939022+0000","last_change":"2024-09-19T11:35:33.612825+0000","last_active":"2024-09-19T12:01:43.939022+0000","last_peered":"2024-09-19T12:01:43.939022+0000","last_clean":"2024-09-19T12:01:43.939022+0000","last_became_active":"2024-09-19T11:35:33.612152+0000","last_became_peered":"2024-09-19T11:35:33.612152+0000","last_unstale":"2024-09-19T12:01:43.939022+0000","last_undegraded":"2024-09-19T12:01:43.939022+0000","last_fullsized":"2024-09-19T12:01:43.939022+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:31.538563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":962,"num_read_kb":742,"num_write":392,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1228,"num_read_kb":871,"num_write":344,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":8631,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2810,"num_read_kb":2559,"num_write":1797,"num_write_kb":496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":17262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":694,"ondisk_log_size":694,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":326267,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":4380,"num_read_kb":5764,"num_write":2905,"num_write_kb":1322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":349768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1960,"ondisk_log_size":1960,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2072,"num_read_kb":2467,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":14003,"num_read_kb":11442,"num_write":5494,"num_write_kb":2900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2398,"ondisk_log_size":2398,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":124933376,"num_objects":759,"num_object_clones":0,"num_object_copies":3036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":759,"num_whiteouts":0,"num_read":4515,"num_read_kb":236972,"num_write":9401,"num_write_kb":271206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":175980544,"data_stored":175980544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2304,"ondisk_log_size":2304,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":67110910,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":70,"num_read_kb":114690,"num_write":62,"num_write_kb":65538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134225920,"data_stored":134221820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":67110910,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":73,"num_read_kb":120834,"num_write":62,"num_write_kb":65538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134225920,"data_stored":134221820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542482,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243964,"kb_used_data":54508,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":94127876,"statfs":{"total":96636764160,"available":96386945024,"internally_reserved":0,"allocated":55816192,"data_stored":53814603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":193984970},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542481,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256008,"kb_used_data":66552,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":94115832,"statfs":{"total":96636764160,"available":96374611968,"internally_reserved":0,"allocated":68149248,"data_stored":66188937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":193984966},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542482,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81616,"kb_used_data":32384,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94290224,"statfs":{"total":96636764160,"available":96553189376,"internally_reserved":0,"allocated":33161216,"data_stored":31140925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542484,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126296,"kb_used_data":68744,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94245544,"statfs":{"total":96636764160,"available":96507437056,"internally_reserved":0,"allocated":70393856,"data_stored":68485861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542482,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":234436,"kb_used_data":58868,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":94137404,"statfs":{"total":96636764160,"available":96396701696,"internally_reserved":0,"allocated":60280832,"data_stored":58295358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179763655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542482,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87992,"kb_used_data":38760,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94283848,"statfs":{"total":96636764160,"available":96546660352,"internally_reserved":0,"allocated":39690240,"data_stored":37772067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542481,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152040,"kb_used_data":58456,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94219800,"statfs":{"total":96636764160,"available":96481075200,"internally_reserved":0,"allocated":59858944,"data_stored":57891099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542483,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":90216,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":92381184,"data_stored":90413428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212400581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24608768,"data_stored":24608768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23085056,"data_stored":23085056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17670144,"data_stored":17670144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":22417408,"data_stored":22417408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":21131264,"data_stored":21131264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23576576,"data_stored":23576576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24047616,"data_stored":24047616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":19443712,"data_stored":19443712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":42918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":45449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":20534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":65245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":9095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":65394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":33840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":67293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16779262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17829888,"data_stored":17827838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16779262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28311552,"data_stored":28311552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22024192,"data_stored":22022142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T12:03:07.194 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T12:03:07.540 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T12:03:07.541 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":264,"fsid":"e4647c72-93bd-41bc-8102-6ca42f6edad4","created":"2024-09-19T11:34:59.387938+0000","modified":"2024-09-19T11:54:08.125687+0000","last_up_change":"2024-09-19T11:35:11.074438+0000","last_in_change":"2024-09-19T11:35:01.684559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":67,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T11:35:12.462300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-19T11:35:17.641758+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-19T11:35:29.530167+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-19T11:35:31.880422+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-19T11:35:33.723063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-19T11:35:35.729891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-19T11:35:37.654390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-19T11:35:39.800562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-19T11:51:52.170803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-19T11:53:33.049186+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-19T11:53:35.875482+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"262","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c6f4cff4-42cd-4606-9588-4dc40244f947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6809","nonce":1940228464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6811","nonce":1940228464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6815","nonce":1940228464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":1940228464},{"type":"v1","addr":"172.21.15.120:6813","nonce":1940228464}]},"public_addr":"172.21.15.120:6809/1940228464","cluster_addr":"172.21.15.120:6811/1940228464","heartbeat_back_addr":"172.21.15.120:6815/1940228464","heartbeat_front_addr":"172.21.15.120:6813/1940228464","state":["exists","up"]},{"osd":1,"uuid":"fa6ebdc7-7db1-4740-91c9-918a4d82b59e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6817","nonce":2362810278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6819","nonce":2362810278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6823","nonce":2362810278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":2362810278},{"type":"v1","addr":"172.21.15.120:6821","nonce":2362810278}]},"public_addr":"172.21.15.120:6817/2362810278","cluster_addr":"172.21.15.120:6819/2362810278","heartbeat_back_addr":"172.21.15.120:6823/2362810278","heartbeat_front_addr":"172.21.15.120:6821/2362810278","state":["exists","up"]},{"osd":2,"uuid":"54736b9e-f941-4aa7-aeb8-3a39902d254d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":257,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6801","nonce":1864022726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6803","nonce":1864022726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6807","nonce":1864022726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1864022726},{"type":"v1","addr":"172.21.15.120:6805","nonce":1864022726}]},"public_addr":"172.21.15.120:6801/1864022726","cluster_addr":"172.21.15.120:6803/1864022726","heartbeat_back_addr":"172.21.15.120:6807/1864022726","heartbeat_front_addr":"172.21.15.120:6805/1864022726","state":["exists","up"]},{"osd":3,"uuid":"ace2198d-da3d-4555-a0d3-86f83a9a565c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6825","nonce":1565558845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6827","nonce":1565558845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6831","nonce":1565558845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":1565558845},{"type":"v1","addr":"172.21.15.120:6829","nonce":1565558845}]},"public_addr":"172.21.15.120:6825/1565558845","cluster_addr":"172.21.15.120:6827/1565558845","heartbeat_back_addr":"172.21.15.120:6831/1565558845","heartbeat_front_addr":"172.21.15.120:6829/1565558845","state":["exists","up"]},{"osd":4,"uuid":"021ef3d1-e1a9-4d4f-9cfb-b6599dfa15d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6801","nonce":4207680840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6803","nonce":4207680840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6807","nonce":4207680840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4207680840},{"type":"v1","addr":"172.21.15.151:6805","nonce":4207680840}]},"public_addr":"172.21.15.151:6801/4207680840","cluster_addr":"172.21.15.151:6803/4207680840","heartbeat_back_addr":"172.21.15.151:6807/4207680840","heartbeat_front_addr":"172.21.15.151:6805/4207680840","state":["exists","up"]},{"osd":5,"uuid":"23b747d9-39bd-48ff-a044-12b6263e9398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6825","nonce":1967784835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6827","nonce":1967784835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6831","nonce":1967784835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1967784835},{"type":"v1","addr":"172.21.15.151:6829","nonce":1967784835}]},"public_addr":"172.21.15.151:6825/1967784835","cluster_addr":"172.21.15.151:6827/1967784835","heartbeat_back_addr":"172.21.15.151:6831/1967784835","heartbeat_front_addr":"172.21.15.151:6829/1967784835","state":["exists","up"]},{"osd":6,"uuid":"0fd18d41-a379-44f9-8d57-d23c38e1bdd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6809","nonce":4185618971}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6811","nonce":4185618971}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6815","nonce":4185618971}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":4185618971},{"type":"v1","addr":"172.21.15.151:6813","nonce":4185618971}]},"public_addr":"172.21.15.151:6809/4185618971","cluster_addr":"172.21.15.151:6811/4185618971","heartbeat_back_addr":"172.21.15.151:6815/4185618971","heartbeat_front_addr":"172.21.15.151:6813/4185618971","state":["exists","up"]},{"osd":7,"uuid":"1a511214-3f37-4d07-9d3f-d1b3c207451f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":260,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6817","nonce":2331670939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6819","nonce":2331670939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6823","nonce":2331670939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2331670939},{"type":"v1","addr":"172.21.15.151:6821","nonce":2331670939}]},"public_addr":"172.21.15.151:6817/2331670939","cluster_addr":"172.21.15.151:6819/2331670939","heartbeat_back_addr":"172.21.15.151:6823/2331670939","heartbeat_front_addr":"172.21.15.151:6821/2331670939","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.111242+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.777828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.207060+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.974538+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.234741+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.592114+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.348056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:35:08.522745+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1","mappings":[{"from":4,"to":1}]},{"pgid":"3.7","mappings":[{"from":5,"to":2}]},{"pgid":"3.8","mappings":[{"from":7,"to":2}]},{"pgid":"3.a","mappings":[{"from":6,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":3}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"67.9","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T12:03:08.559 INFO:tasks.ceph:Scrubbing osd.0 2024-09-19T12:03:08.560 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-19T12:03:08.723 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T12:03:08.723 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T12:03:08.723 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T12:03:08.739 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-19T12:03:09.041 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 0 to deep-scrub 2024-09-19T12:03:09.060 INFO:tasks.ceph:Scrubbing osd.1 2024-09-19T12:03:09.061 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-19T12:03:09.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-19T12:03:09.206 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T12:03:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T12:03:09.206 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T12:03:09.222 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-19T12:03:09.512 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 1 to deep-scrub 2024-09-19T12:03:09.531 INFO:tasks.ceph:Scrubbing osd.2 2024-09-19T12:03:09.532 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-19T12:03:09.684 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T12:03:09.684 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T12:03:09.684 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T12:03:09.701 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-19T12:03:09.993 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 2 to deep-scrub 2024-09-19T12:03:10.012 INFO:tasks.ceph:Scrubbing osd.3 2024-09-19T12:03:10.013 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-19T12:03:10.145 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T12:03:10.146 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T12:03:10.146 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T12:03:10.160 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-19T12:03:10.454 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 3 to deep-scrub 2024-09-19T12:03:10.472 INFO:tasks.ceph:Scrubbing osd.4 2024-09-19T12:03:10.473 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-19T12:03:10.614 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T12:03:10.614 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T12:03:10.614 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T12:03:10.629 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-19T12:03:10.909 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 4 to deep-scrub 2024-09-19T12:03:10.927 INFO:tasks.ceph:Scrubbing osd.5 2024-09-19T12:03:10.927 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-19T12:03:11.073 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T12:03:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T12:03:11.074 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T12:03:11.088 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-19T12:03:11.370 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 5 to deep-scrub 2024-09-19T12:03:11.388 INFO:tasks.ceph:Scrubbing osd.6 2024-09-19T12:03:11.388 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-19T12:03:11.527 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T12:03:11.528 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T12:03:11.528 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T12:03:11.543 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-19T12:03:11.844 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 6 to deep-scrub 2024-09-19T12:03:11.863 INFO:tasks.ceph:Scrubbing osd.7 2024-09-19T12:03:11.863 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-19T12:03:12.015 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T12:03:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T12:03:12.015 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T12:03:12.030 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-19T12:03:12.310 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 7 to deep-scrub 2024-09-19T12:03:12.327 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T12:03:12.663 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T12:03:12.673 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T12:03:12.678 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":1097,"stamp":"2024-09-19T12:03:11.388503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29695886,"num_objects":525,"num_object_clones":0,"num_object_copies":1600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":525,"num_whiteouts":0,"num_read":30044,"num_read_kb":496475,"num_write":20844,"num_write_kb":408787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8452,"ondisk_log_size":8452,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1118824,"kb_used_data":102704,"kb_used_omap":12,"kb_used_meta":1015539,"kb_avail":753855896,"statfs":{"total":773094113280,"available":771948437504,"internally_reserved":0,"allocated":105168896,"data_stored":89632045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1039912496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-230386388,"num_objects":-514,"num_object_clones":0,"num_object_copies":-1996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-514,"num_whiteouts":0,"num_read":827,"num_read_kb":821,"num_write":654,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007392"},"pg_stats":[{"pgid":"67.1d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.590975+0000","last_change":"2024-09-19T11:53:37.745334+0000","last_active":"2024-09-19T11:58:36.590975+0000","last_peered":"2024-09-19T11:58:36.590975+0000","last_clean":"2024-09-19T11:58:36.590975+0000","last_became_active":"2024-09-19T11:53:37.744679+0000","last_became_peered":"2024-09-19T11:53:37.744679+0000","last_unstale":"2024-09-19T11:58:36.590975+0000","last_undegraded":"2024-09-19T11:58:36.590975+0000","last_fullsized":"2024-09-19T11:58:36.590975+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:29.888364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.586691+0000","last_change":"2024-09-19T11:53:34.715828+0000","last_active":"2024-09-19T11:58:36.586691+0000","last_peered":"2024-09-19T11:58:36.586691+0000","last_clean":"2024-09-19T11:58:36.586691+0000","last_became_active":"2024-09-19T11:53:34.714946+0000","last_became_peered":"2024-09-19T11:53:34.714946+0000","last_unstale":"2024-09-19T11:58:36.586691+0000","last_undegraded":"2024-09-19T11:58:36.586691+0000","last_fullsized":"2024-09-19T11:58:36.586691+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:46.457012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"256'14","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.615105+0000","last_change":"2024-09-19T11:51:53.494561+0000","last_active":"2024-09-19T12:00:16.615105+0000","last_peered":"2024-09-19T12:00:16.615105+0000","last_clean":"2024-09-19T12:00:16.615105+0000","last_became_active":"2024-09-19T11:51:53.493294+0000","last_became_peered":"2024-09-19T11:51:53.493294+0000","last_unstale":"2024-09-19T12:00:16.615105+0000","last_undegraded":"2024-09-19T12:00:16.615105+0000","last_fullsized":"2024-09-19T12:00:16.615105+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:25.608106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":86,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.785305+0000","last_change":"2024-09-19T11:53:37.715171+0000","last_active":"2024-09-19T11:58:41.785305+0000","last_peered":"2024-09-19T11:58:41.785305+0000","last_clean":"2024-09-19T11:58:41.785305+0000","last_became_active":"2024-09-19T11:53:37.714526+0000","last_became_peered":"2024-09-19T11:53:37.714526+0000","last_unstale":"2024-09-19T11:58:41.785305+0000","last_undegraded":"2024-09-19T11:58:41.785305+0000","last_fullsized":"2024-09-19T11:58:41.785305+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:47:00.837259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.579334+0000","last_change":"2024-09-19T11:53:34.730623+0000","last_active":"2024-09-19T11:58:36.579334+0000","last_peered":"2024-09-19T11:58:36.579334+0000","last_clean":"2024-09-19T11:58:36.579334+0000","last_became_active":"2024-09-19T11:53:34.730025+0000","last_became_peered":"2024-09-19T11:53:34.730025+0000","last_unstale":"2024-09-19T11:58:36.579334+0000","last_undegraded":"2024-09-19T11:58:36.579334+0000","last_fullsized":"2024-09-19T11:58:36.579334+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:52.233686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.596619+0000","last_change":"2024-09-19T11:51:53.495233+0000","last_active":"2024-09-19T11:59:56.596619+0000","last_peered":"2024-09-19T11:59:56.596619+0000","last_clean":"2024-09-19T11:59:56.596619+0000","last_became_active":"2024-09-19T11:51:53.494552+0000","last_became_peered":"2024-09-19T11:51:53.494552+0000","last_unstale":"2024-09-19T11:59:56.596619+0000","last_undegraded":"2024-09-19T11:59:56.596619+0000","last_fullsized":"2024-09-19T11:59:56.596619+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:17.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.610306+0000","last_change":"2024-09-19T11:53:37.760242+0000","last_active":"2024-09-19T11:59:56.610306+0000","last_peered":"2024-09-19T11:59:56.610306+0000","last_clean":"2024-09-19T11:59:56.610306+0000","last_became_active":"2024-09-19T11:53:37.757767+0000","last_became_peered":"2024-09-19T11:53:37.757767+0000","last_unstale":"2024-09-19T11:59:56.610306+0000","last_undegraded":"2024-09-19T11:59:56.610306+0000","last_fullsized":"2024-09-19T11:59:56.610306+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:53:27.455399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.592459+0000","last_change":"2024-09-19T11:53:34.712290+0000","last_active":"2024-09-19T11:59:36.592459+0000","last_peered":"2024-09-19T11:59:36.592459+0000","last_clean":"2024-09-19T11:59:36.592459+0000","last_became_active":"2024-09-19T11:53:34.711510+0000","last_became_peered":"2024-09-19T11:53:34.711510+0000","last_unstale":"2024-09-19T11:59:36.592459+0000","last_undegraded":"2024-09-19T11:59:36.592459+0000","last_fullsized":"2024-09-19T11:59:36.592459+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:51.007502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.603011+0000","last_change":"2024-09-19T11:51:53.480345+0000","last_active":"2024-09-19T11:59:26.603011+0000","last_peered":"2024-09-19T11:59:26.603011+0000","last_clean":"2024-09-19T11:59:26.603011+0000","last_became_active":"2024-09-19T11:51:53.479659+0000","last_became_peered":"2024-09-19T11:51:53.479659+0000","last_unstale":"2024-09-19T11:59:26.603011+0000","last_undegraded":"2024-09-19T11:59:26.603011+0000","last_fullsized":"2024-09-19T11:59:26.603011+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:02.230797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.601507+0000","last_change":"2024-09-19T11:53:37.758685+0000","last_active":"2024-09-19T11:59:41.601507+0000","last_peered":"2024-09-19T11:59:41.601507+0000","last_clean":"2024-09-19T11:59:41.601507+0000","last_became_active":"2024-09-19T11:53:37.756047+0000","last_became_peered":"2024-09-19T11:53:37.756047+0000","last_unstale":"2024-09-19T11:59:41.601507+0000","last_undegraded":"2024-09-19T11:59:41.601507+0000","last_fullsized":"2024-09-19T11:59:41.601507+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:44.645097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:56.828737+0000","last_change":"2024-09-19T11:53:34.706109+0000","last_active":"2024-09-19T12:01:56.828737+0000","last_peered":"2024-09-19T12:01:56.828737+0000","last_clean":"2024-09-19T12:01:56.828737+0000","last_became_active":"2024-09-19T11:53:34.705364+0000","last_became_peered":"2024-09-19T11:53:34.705364+0000","last_unstale":"2024-09-19T12:01:56.828737+0000","last_undegraded":"2024-09-19T12:01:56.828737+0000","last_fullsized":"2024-09-19T12:01:56.828737+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:58:24.677448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.597881+0000","last_change":"2024-09-19T11:51:53.477170+0000","last_active":"2024-09-19T11:59:26.597881+0000","last_peered":"2024-09-19T11:59:26.597881+0000","last_clean":"2024-09-19T11:59:26.597881+0000","last_became_active":"2024-09-19T11:51:53.475807+0000","last_became_peered":"2024-09-19T11:51:53.475807+0000","last_unstale":"2024-09-19T11:59:26.597881+0000","last_undegraded":"2024-09-19T11:59:26.597881+0000","last_fullsized":"2024-09-19T11:59:26.597881+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:44.084226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.589586+0000","last_change":"2024-09-19T11:53:37.733871+0000","last_active":"2024-09-19T11:58:31.589586+0000","last_peered":"2024-09-19T11:58:31.589586+0000","last_clean":"2024-09-19T11:58:31.589586+0000","last_became_active":"2024-09-19T11:53:37.733244+0000","last_became_peered":"2024-09-19T11:53:37.733244+0000","last_unstale":"2024-09-19T11:58:31.589586+0000","last_undegraded":"2024-09-19T11:58:31.589586+0000","last_fullsized":"2024-09-19T11:58:31.589586+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:59.898211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.589239+0000","last_change":"2024-09-19T11:53:34.723027+0000","last_active":"2024-09-19T11:58:26.589239+0000","last_peered":"2024-09-19T11:58:26.589239+0000","last_clean":"2024-09-19T11:58:26.589239+0000","last_became_active":"2024-09-19T11:53:34.722143+0000","last_became_peered":"2024-09-19T11:53:34.722143+0000","last_unstale":"2024-09-19T11:58:26.589239+0000","last_undegraded":"2024-09-19T11:58:26.589239+0000","last_fullsized":"2024-09-19T11:58:26.589239+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:35.362037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"256'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.597786+0000","last_change":"2024-09-19T11:51:53.497903+0000","last_active":"2024-09-19T11:59:26.597786+0000","last_peered":"2024-09-19T11:59:26.597786+0000","last_clean":"2024-09-19T11:59:26.597786+0000","last_became_active":"2024-09-19T11:51:53.496828+0000","last_became_peered":"2024-09-19T11:51:53.496828+0000","last_unstale":"2024-09-19T11:59:26.597786+0000","last_undegraded":"2024-09-19T11:59:26.597786+0000","last_fullsized":"2024-09-19T11:59:26.597786+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:33:53.888475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.18","version":"264'5","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.691733+0000","last_change":"2024-09-19T11:53:37.752259+0000","last_active":"2024-09-19T12:03:05.691733+0000","last_peered":"2024-09-19T12:03:05.691733+0000","last_clean":"2024-09-19T12:03:05.691733+0000","last_became_active":"2024-09-19T11:53:37.751550+0000","last_became_peered":"2024-09-19T11:53:37.751550+0000","last_unstale":"2024-09-19T12:03:05.691733+0000","last_undegraded":"2024-09-19T12:03:05.691733+0000","last_fullsized":"2024-09-19T12:03:05.691733+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:24.886099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:51.814233+0000","last_change":"2024-09-19T11:53:34.700220+0000","last_active":"2024-09-19T12:00:51.814233+0000","last_peered":"2024-09-19T12:00:51.814233+0000","last_clean":"2024-09-19T12:00:51.814233+0000","last_became_active":"2024-09-19T11:53:34.699476+0000","last_became_peered":"2024-09-19T11:53:34.699476+0000","last_unstale":"2024-09-19T12:00:51.814233+0000","last_undegraded":"2024-09-19T12:00:51.814233+0000","last_fullsized":"2024-09-19T12:00:51.814233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:31.463060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.602602+0000","last_change":"2024-09-19T11:51:53.469668+0000","last_active":"2024-09-19T11:59:26.602602+0000","last_peered":"2024-09-19T11:59:26.602602+0000","last_clean":"2024-09-19T11:59:26.602602+0000","last_became_active":"2024-09-19T11:51:53.468220+0000","last_became_peered":"2024-09-19T11:51:53.468220+0000","last_unstale":"2024-09-19T11:59:26.602602+0000","last_undegraded":"2024-09-19T11:59:26.602602+0000","last_fullsized":"2024-09-19T11:59:26.602602+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:15.153859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.592905+0000","last_change":"2024-09-19T11:53:37.734780+0000","last_active":"2024-09-19T11:58:41.592905+0000","last_peered":"2024-09-19T11:58:41.592905+0000","last_clean":"2024-09-19T11:58:41.592905+0000","last_became_active":"2024-09-19T11:53:37.733461+0000","last_became_peered":"2024-09-19T11:53:37.733461+0000","last_unstale":"2024-09-19T11:58:41.592905+0000","last_undegraded":"2024-09-19T11:58:41.592905+0000","last_fullsized":"2024-09-19T11:58:41.592905+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:09.138836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.784017+0000","last_change":"2024-09-19T11:53:34.711700+0000","last_active":"2024-09-19T11:58:36.784017+0000","last_peered":"2024-09-19T11:58:36.784017+0000","last_clean":"2024-09-19T11:58:36.784017+0000","last_became_active":"2024-09-19T11:53:34.711125+0000","last_became_peered":"2024-09-19T11:53:34.711125+0000","last_unstale":"2024-09-19T11:58:36.784017+0000","last_undegraded":"2024-09-19T11:58:36.784017+0000","last_fullsized":"2024-09-19T11:58:36.784017+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:23.766743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.599515+0000","last_change":"2024-09-19T11:51:53.498330+0000","last_active":"2024-09-19T11:59:11.599515+0000","last_peered":"2024-09-19T11:59:11.599515+0000","last_clean":"2024-09-19T11:59:11.599515+0000","last_became_active":"2024-09-19T11:51:53.497559+0000","last_became_peered":"2024-09-19T11:51:53.497559+0000","last_unstale":"2024-09-19T11:59:11.599515+0000","last_undegraded":"2024-09-19T11:59:11.599515+0000","last_fullsized":"2024-09-19T11:59:11.599515+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:57.123428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.587788+0000","last_change":"2024-09-19T11:53:37.760079+0000","last_active":"2024-09-19T11:58:41.587788+0000","last_peered":"2024-09-19T11:58:41.587788+0000","last_clean":"2024-09-19T11:58:41.587788+0000","last_became_active":"2024-09-19T11:53:37.759079+0000","last_became_peered":"2024-09-19T11:53:37.759079+0000","last_unstale":"2024-09-19T11:58:41.587788+0000","last_undegraded":"2024-09-19T11:58:41.587788+0000","last_fullsized":"2024-09-19T11:58:41.587788+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:55.874038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'8","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.643331+0000","last_change":"2024-09-19T11:53:34.732158+0000","last_active":"2024-09-19T12:03:05.643331+0000","last_peered":"2024-09-19T12:03:05.643331+0000","last_clean":"2024-09-19T12:03:05.643331+0000","last_became_active":"2024-09-19T11:53:34.722675+0000","last_became_peered":"2024-09-19T11:53:34.722675+0000","last_unstale":"2024-09-19T12:03:05.643331+0000","last_undegraded":"2024-09-19T12:03:05.643331+0000","last_fullsized":"2024-09-19T12:03:05.643331+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:13.301780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.586361+0000","last_change":"2024-09-19T11:51:53.486009+0000","last_active":"2024-09-19T11:59:11.586361+0000","last_peered":"2024-09-19T11:59:11.586361+0000","last_clean":"2024-09-19T11:59:11.586361+0000","last_became_active":"2024-09-19T11:51:53.485176+0000","last_became_peered":"2024-09-19T11:51:53.485176+0000","last_unstale":"2024-09-19T11:59:11.586361+0000","last_undegraded":"2024-09-19T11:59:11.586361+0000","last_fullsized":"2024-09-19T11:59:11.586361+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:32.437601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.585506+0000","last_change":"2024-09-19T11:53:37.738229+0000","last_active":"2024-09-19T11:58:31.585506+0000","last_peered":"2024-09-19T11:58:31.585506+0000","last_clean":"2024-09-19T11:58:31.585506+0000","last_became_active":"2024-09-19T11:53:37.735681+0000","last_became_peered":"2024-09-19T11:53:37.735681+0000","last_unstale":"2024-09-19T11:58:31.585506+0000","last_undegraded":"2024-09-19T11:58:31.585506+0000","last_fullsized":"2024-09-19T11:58:31.585506+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:26.373362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619176+0000","last_change":"2024-09-19T11:53:34.709295+0000","last_active":"2024-09-19T12:00:41.619176+0000","last_peered":"2024-09-19T12:00:41.619176+0000","last_clean":"2024-09-19T12:00:41.619176+0000","last_became_active":"2024-09-19T11:53:34.708831+0000","last_became_peered":"2024-09-19T11:53:34.708831+0000","last_unstale":"2024-09-19T12:00:41.619176+0000","last_undegraded":"2024-09-19T12:00:41.619176+0000","last_fullsized":"2024-09-19T12:00:41.619176+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:25.795767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.599708+0000","last_change":"2024-09-19T11:51:53.499050+0000","last_active":"2024-09-19T11:59:11.599708+0000","last_peered":"2024-09-19T11:59:11.599708+0000","last_clean":"2024-09-19T11:59:11.599708+0000","last_became_active":"2024-09-19T11:51:53.498327+0000","last_became_peered":"2024-09-19T11:51:53.498327+0000","last_unstale":"2024-09-19T11:59:11.599708+0000","last_undegraded":"2024-09-19T11:59:11.599708+0000","last_fullsized":"2024-09-19T11:59:11.599708+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:49.722787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615207+0000","last_change":"2024-09-19T11:53:37.755767+0000","last_active":"2024-09-19T12:00:41.615207+0000","last_peered":"2024-09-19T12:00:41.615207+0000","last_clean":"2024-09-19T12:00:41.615207+0000","last_became_active":"2024-09-19T11:53:37.754753+0000","last_became_peered":"2024-09-19T11:53:37.754753+0000","last_unstale":"2024-09-19T12:00:41.615207+0000","last_undegraded":"2024-09-19T12:00:41.615207+0000","last_fullsized":"2024-09-19T12:00:41.615207+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:22.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.592245+0000","last_change":"2024-09-19T11:53:34.720643+0000","last_active":"2024-09-19T11:58:26.592245+0000","last_peered":"2024-09-19T11:58:26.592245+0000","last_clean":"2024-09-19T11:58:26.592245+0000","last_became_active":"2024-09-19T11:53:34.720273+0000","last_became_peered":"2024-09-19T11:53:34.720273+0000","last_unstale":"2024-09-19T11:58:26.592245+0000","last_undegraded":"2024-09-19T11:58:26.592245+0000","last_fullsized":"2024-09-19T11:58:26.592245+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:26.226182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"255'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.594417+0000","last_change":"2024-09-19T11:51:53.497665+0000","last_active":"2024-09-19T11:59:11.594417+0000","last_peered":"2024-09-19T11:59:11.594417+0000","last_clean":"2024-09-19T11:59:11.594417+0000","last_became_active":"2024-09-19T11:51:53.496988+0000","last_became_peered":"2024-09-19T11:51:53.496988+0000","last_unstale":"2024-09-19T11:59:11.594417+0000","last_undegraded":"2024-09-19T11:59:11.594417+0000","last_fullsized":"2024-09-19T11:59:11.594417+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:42.583270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.17","version":"264'5","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.698442+0000","last_change":"2024-09-19T11:53:37.759921+0000","last_active":"2024-09-19T12:03:05.698442+0000","last_peered":"2024-09-19T12:03:05.698442+0000","last_clean":"2024-09-19T12:03:05.698442+0000","last_became_active":"2024-09-19T11:53:37.759275+0000","last_became_peered":"2024-09-19T11:53:37.759275+0000","last_unstale":"2024-09-19T12:03:05.698442+0000","last_undegraded":"2024-09-19T12:03:05.698442+0000","last_fullsized":"2024-09-19T12:03:05.698442+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:06.314026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:26.578842+0000","last_change":"2024-09-19T11:53:34.700207+0000","last_active":"2024-09-19T11:58:26.578842+0000","last_peered":"2024-09-19T11:58:26.578842+0000","last_clean":"2024-09-19T11:58:26.578842+0000","last_became_active":"2024-09-19T11:53:34.699437+0000","last_became_peered":"2024-09-19T11:53:34.699437+0000","last_unstale":"2024-09-19T11:58:26.578842+0000","last_undegraded":"2024-09-19T11:58:26.578842+0000","last_fullsized":"2024-09-19T11:58:26.578842+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:54:30.963407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"256'23","reported_seq":100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.587246+0000","last_change":"2024-09-19T11:51:53.479917+0000","last_active":"2024-09-19T11:59:11.587246+0000","last_peered":"2024-09-19T11:59:11.587246+0000","last_clean":"2024-09-19T11:59:11.587246+0000","last_became_active":"2024-09-19T11:51:53.478643+0000","last_became_peered":"2024-09-19T11:51:53.478643+0000","last_unstale":"2024-09-19T11:59:11.587246+0000","last_undegraded":"2024-09-19T11:59:11.587246+0000","last_fullsized":"2024-09-19T11:59:11.587246+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:31.580713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":169,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:31.782900+0000","last_change":"2024-09-19T11:53:37.737666+0000","last_active":"2024-09-19T11:58:31.782900+0000","last_peered":"2024-09-19T11:58:31.782900+0000","last_clean":"2024-09-19T11:58:31.782900+0000","last_became_active":"2024-09-19T11:53:37.737215+0000","last_became_peered":"2024-09-19T11:53:37.737215+0000","last_unstale":"2024-09-19T11:58:31.782900+0000","last_undegraded":"2024-09-19T11:58:31.782900+0000","last_fullsized":"2024-09-19T11:58:31.782900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:58.237583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.752008+0000","last_change":"2024-09-19T11:53:34.732001+0000","last_active":"2024-09-19T12:03:05.752008+0000","last_peered":"2024-09-19T12:03:05.752008+0000","last_clean":"2024-09-19T12:03:05.752008+0000","last_became_active":"2024-09-19T11:53:34.723850+0000","last_became_peered":"2024-09-19T11:53:34.723850+0000","last_unstale":"2024-09-19T12:03:05.752008+0000","last_undegraded":"2024-09-19T12:03:05.752008+0000","last_fullsized":"2024-09-19T12:03:05.752008+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:50:09.990299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599872+0000","last_change":"2024-09-19T11:51:53.479627+0000","last_active":"2024-09-19T11:58:56.599872+0000","last_peered":"2024-09-19T11:58:56.599872+0000","last_clean":"2024-09-19T11:58:56.599872+0000","last_became_active":"2024-09-19T11:51:53.478922+0000","last_became_peered":"2024-09-19T11:51:53.478922+0000","last_unstale":"2024-09-19T11:58:56.599872+0000","last_undegraded":"2024-09-19T11:58:56.599872+0000","last_fullsized":"2024-09-19T11:58:56.599872+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:56.192816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607351+0000","last_change":"2024-09-19T11:53:37.742835+0000","last_active":"2024-09-19T12:00:41.607351+0000","last_peered":"2024-09-19T12:00:41.607351+0000","last_clean":"2024-09-19T12:00:41.607351+0000","last_became_active":"2024-09-19T11:53:37.734844+0000","last_became_peered":"2024-09-19T11:53:37.734844+0000","last_unstale":"2024-09-19T12:00:41.607351+0000","last_undegraded":"2024-09-19T12:00:41.607351+0000","last_fullsized":"2024-09-19T12:00:41.607351+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:22.920456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810733+0000","last_change":"2024-09-19T11:53:34.707106+0000","last_active":"2024-09-19T12:00:36.810733+0000","last_peered":"2024-09-19T12:00:36.810733+0000","last_clean":"2024-09-19T12:00:36.810733+0000","last_became_active":"2024-09-19T11:53:34.704150+0000","last_became_peered":"2024-09-19T11:53:34.704150+0000","last_unstale":"2024-09-19T12:00:36.810733+0000","last_undegraded":"2024-09-19T12:00:36.810733+0000","last_fullsized":"2024-09-19T12:00:36.810733+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:33.641088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599814+0000","last_change":"2024-09-19T11:51:53.481885+0000","last_active":"2024-09-19T11:58:56.599814+0000","last_peered":"2024-09-19T11:58:56.599814+0000","last_clean":"2024-09-19T11:58:56.599814+0000","last_became_active":"2024-09-19T11:51:53.481154+0000","last_became_peered":"2024-09-19T11:51:53.481154+0000","last_unstale":"2024-09-19T11:58:56.599814+0000","last_undegraded":"2024-09-19T11:58:56.599814+0000","last_fullsized":"2024-09-19T11:58:56.599814+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:33.647811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607252+0000","last_change":"2024-09-19T11:53:37.731071+0000","last_active":"2024-09-19T12:00:41.607252+0000","last_peered":"2024-09-19T12:00:41.607252+0000","last_clean":"2024-09-19T12:00:41.607252+0000","last_became_active":"2024-09-19T11:53:37.730152+0000","last_became_peered":"2024-09-19T11:53:37.730152+0000","last_unstale":"2024-09-19T12:00:41.607252+0000","last_undegraded":"2024-09-19T12:00:41.607252+0000","last_fullsized":"2024-09-19T12:00:41.607252+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:14:21.099777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.613805+0000","last_change":"2024-09-19T11:53:34.704187+0000","last_active":"2024-09-19T12:00:36.613805+0000","last_peered":"2024-09-19T12:00:36.613805+0000","last_clean":"2024-09-19T12:00:36.613805+0000","last_became_active":"2024-09-19T11:53:34.703463+0000","last_became_peered":"2024-09-19T11:53:34.703463+0000","last_unstale":"2024-09-19T12:00:36.613805+0000","last_undegraded":"2024-09-19T12:00:36.613805+0000","last_fullsized":"2024-09-19T12:00:36.613805+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:28.756801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.595963+0000","last_change":"2024-09-19T11:51:53.491344+0000","last_active":"2024-09-19T11:58:56.595963+0000","last_peered":"2024-09-19T11:58:56.595963+0000","last_clean":"2024-09-19T11:58:56.595963+0000","last_became_active":"2024-09-19T11:51:53.490650+0000","last_became_peered":"2024-09-19T11:51:53.490650+0000","last_unstale":"2024-09-19T11:58:56.595963+0000","last_undegraded":"2024-09-19T11:58:56.595963+0000","last_fullsized":"2024-09-19T11:58:56.595963+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:53.773642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.711153+0000","last_change":"2024-09-19T11:53:37.759763+0000","last_active":"2024-09-19T12:03:05.711153+0000","last_peered":"2024-09-19T12:03:05.711153+0000","last_clean":"2024-09-19T12:03:05.711153+0000","last_became_active":"2024-09-19T11:53:37.755628+0000","last_became_peered":"2024-09-19T11:53:37.755628+0000","last_unstale":"2024-09-19T12:03:05.711153+0000","last_undegraded":"2024-09-19T12:03:05.711153+0000","last_fullsized":"2024-09-19T12:03:05.711153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:25.674366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5122,"num_write":10,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618477+0000","last_change":"2024-09-19T11:53:34.708167+0000","last_active":"2024-09-19T12:00:36.618477+0000","last_peered":"2024-09-19T12:00:36.618477+0000","last_clean":"2024-09-19T12:00:36.618477+0000","last_became_active":"2024-09-19T11:53:34.707412+0000","last_became_peered":"2024-09-19T11:53:34.707412+0000","last_unstale":"2024-09-19T12:00:36.618477+0000","last_undegraded":"2024-09-19T12:00:36.618477+0000","last_fullsized":"2024-09-19T12:00:36.618477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:27.815287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"256'7","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.788702+0000","last_change":"2024-09-19T11:51:53.464544+0000","last_active":"2024-09-19T11:58:56.788702+0000","last_peered":"2024-09-19T11:58:56.788702+0000","last_clean":"2024-09-19T11:58:56.788702+0000","last_became_active":"2024-09-19T11:51:53.463784+0000","last_became_peered":"2024-09-19T11:51:53.463784+0000","last_unstale":"2024-09-19T11:58:56.788702+0000","last_undegraded":"2024-09-19T11:58:56.788702+0000","last_fullsized":"2024-09-19T11:58:56.788702+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:17.326366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.12","version":"264'3","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:01.650911+0000","last_change":"2024-09-19T11:53:37.744463+0000","last_active":"2024-09-19T12:03:01.650911+0000","last_peered":"2024-09-19T12:03:01.650911+0000","last_clean":"2024-09-19T12:03:01.650911+0000","last_became_active":"2024-09-19T11:53:37.743807+0000","last_became_peered":"2024-09-19T11:53:37.743807+0000","last_unstale":"2024-09-19T12:03:01.650911+0000","last_undegraded":"2024-09-19T12:03:01.650911+0000","last_fullsized":"2024-09-19T12:03:01.650911+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:37.688342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.617873+0000","last_change":"2024-09-19T11:53:34.706511+0000","last_active":"2024-09-19T12:00:36.617873+0000","last_peered":"2024-09-19T12:00:36.617873+0000","last_clean":"2024-09-19T12:00:36.617873+0000","last_became_active":"2024-09-19T11:53:34.705705+0000","last_became_peered":"2024-09-19T11:53:34.705705+0000","last_unstale":"2024-09-19T12:00:36.617873+0000","last_undegraded":"2024-09-19T12:00:36.617873+0000","last_fullsized":"2024-09-19T12:00:36.617873+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:28.349619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.590471+0000","last_change":"2024-09-19T11:51:53.488994+0000","last_active":"2024-09-19T11:58:56.590471+0000","last_peered":"2024-09-19T11:58:56.590471+0000","last_clean":"2024-09-19T11:58:56.590471+0000","last_became_active":"2024-09-19T11:51:53.488252+0000","last_became_peered":"2024-09-19T11:51:53.488252+0000","last_unstale":"2024-09-19T11:58:56.590471+0000","last_undegraded":"2024-09-19T11:58:56.590471+0000","last_fullsized":"2024-09-19T11:58:56.590471+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:14.331678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.551446+0000","last_change":"2024-09-19T11:53:37.755108+0000","last_active":"2024-09-19T12:03:05.551446+0000","last_peered":"2024-09-19T12:03:05.551446+0000","last_clean":"2024-09-19T12:03:05.551446+0000","last_became_active":"2024-09-19T11:53:37.754497+0000","last_became_peered":"2024-09-19T11:53:37.754497+0000","last_unstale":"2024-09-19T12:03:05.551446+0000","last_undegraded":"2024-09-19T12:03:05.551446+0000","last_fullsized":"2024-09-19T12:03:05.551446+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:38.404433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.886651+0000","last_change":"2024-09-19T11:53:34.721569+0000","last_active":"2024-09-19T12:03:05.886651+0000","last_peered":"2024-09-19T12:03:05.886651+0000","last_clean":"2024-09-19T12:03:05.886651+0000","last_became_active":"2024-09-19T11:53:34.721070+0000","last_became_peered":"2024-09-19T11:53:34.721070+0000","last_unstale":"2024-09-19T12:03:05.886651+0000","last_undegraded":"2024-09-19T12:03:05.886651+0000","last_fullsized":"2024-09-19T12:03:05.886651+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:11.145675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"256'23","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.587947+0000","last_change":"2024-09-19T11:51:53.490847+0000","last_active":"2024-09-19T11:58:41.587947+0000","last_peered":"2024-09-19T11:58:41.587947+0000","last_clean":"2024-09-19T11:58:41.587947+0000","last_became_active":"2024-09-19T11:51:53.490074+0000","last_became_peered":"2024-09-19T11:51:53.490074+0000","last_unstale":"2024-09-19T11:58:41.587947+0000","last_undegraded":"2024-09-19T11:58:41.587947+0000","last_fullsized":"2024-09-19T11:58:41.587947+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:25.990044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":156,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611634+0000","last_change":"2024-09-19T11:53:37.759926+0000","last_active":"2024-09-19T12:00:26.611634+0000","last_peered":"2024-09-19T12:00:26.611634+0000","last_clean":"2024-09-19T12:00:26.611634+0000","last_became_active":"2024-09-19T11:53:37.758965+0000","last_became_peered":"2024-09-19T11:53:37.758965+0000","last_unstale":"2024-09-19T12:00:26.611634+0000","last_undegraded":"2024-09-19T12:00:26.611634+0000","last_fullsized":"2024-09-19T12:00:26.611634+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:35.768438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.601997+0000","last_change":"2024-09-19T11:53:34.730214+0000","last_active":"2024-09-19T12:00:21.601997+0000","last_peered":"2024-09-19T12:00:21.601997+0000","last_clean":"2024-09-19T12:00:21.601997+0000","last_became_active":"2024-09-19T11:53:34.729772+0000","last_became_peered":"2024-09-19T11:53:34.729772+0000","last_unstale":"2024-09-19T12:00:21.601997+0000","last_undegraded":"2024-09-19T12:00:21.601997+0000","last_fullsized":"2024-09-19T12:00:21.601997+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:08.302177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.592249+0000","last_change":"2024-09-19T11:51:53.480445+0000","last_active":"2024-09-19T11:58:41.592249+0000","last_peered":"2024-09-19T11:58:41.592249+0000","last_clean":"2024-09-19T11:58:41.592249+0000","last_became_active":"2024-09-19T11:51:53.479490+0000","last_became_peered":"2024-09-19T11:51:53.479490+0000","last_unstale":"2024-09-19T11:58:41.592249+0000","last_undegraded":"2024-09-19T11:58:41.592249+0000","last_fullsized":"2024-09-19T11:58:41.592249+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:37.406182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.605040+0000","last_change":"2024-09-19T11:53:37.731450+0000","last_active":"2024-09-19T12:00:31.605040+0000","last_peered":"2024-09-19T12:00:31.605040+0000","last_clean":"2024-09-19T12:00:31.605040+0000","last_became_active":"2024-09-19T11:53:37.730671+0000","last_became_peered":"2024-09-19T11:53:37.730671+0000","last_unstale":"2024-09-19T12:00:31.605040+0000","last_undegraded":"2024-09-19T12:00:31.605040+0000","last_fullsized":"2024-09-19T12:00:31.605040+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:37.080584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'5","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.892067+0000","last_change":"2024-09-19T11:53:34.722175+0000","last_active":"2024-09-19T12:03:05.892067+0000","last_peered":"2024-09-19T12:03:05.892067+0000","last_clean":"2024-09-19T12:03:05.892067+0000","last_became_active":"2024-09-19T11:53:34.720160+0000","last_became_peered":"2024-09-19T11:53:34.720160+0000","last_unstale":"2024-09-19T12:03:05.892067+0000","last_undegraded":"2024-09-19T12:03:05.892067+0000","last_fullsized":"2024-09-19T12:03:05.892067+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:52:58.935663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.592954+0000","last_change":"2024-09-19T11:51:53.484469+0000","last_active":"2024-09-19T11:58:41.592954+0000","last_peered":"2024-09-19T11:58:41.592954+0000","last_clean":"2024-09-19T11:58:41.592954+0000","last_became_active":"2024-09-19T11:51:53.483786+0000","last_became_peered":"2024-09-19T11:51:53.483786+0000","last_unstale":"2024-09-19T11:58:41.592954+0000","last_undegraded":"2024-09-19T11:58:41.592954+0000","last_fullsized":"2024-09-19T11:58:41.592954+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:34.978547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611748+0000","last_change":"2024-09-19T11:53:37.745246+0000","last_active":"2024-09-19T12:00:26.611748+0000","last_peered":"2024-09-19T12:00:26.611748+0000","last_clean":"2024-09-19T12:00:26.611748+0000","last_became_active":"2024-09-19T11:53:37.739838+0000","last_became_peered":"2024-09-19T11:53:37.739838+0000","last_unstale":"2024-09-19T12:00:26.611748+0000","last_undegraded":"2024-09-19T12:00:26.611748+0000","last_fullsized":"2024-09-19T12:00:26.611748+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:07.343317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603804+0000","last_change":"2024-09-19T11:53:34.709512+0000","last_active":"2024-09-19T12:00:26.603804+0000","last_peered":"2024-09-19T12:00:26.603804+0000","last_clean":"2024-09-19T12:00:26.603804+0000","last_became_active":"2024-09-19T11:53:34.708542+0000","last_became_peered":"2024-09-19T11:53:34.708542+0000","last_unstale":"2024-09-19T12:00:26.603804+0000","last_undegraded":"2024-09-19T12:00:26.603804+0000","last_fullsized":"2024-09-19T12:00:26.603804+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:09.314949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.581698+0000","last_change":"2024-09-19T11:51:53.479663+0000","last_active":"2024-09-19T11:58:41.581698+0000","last_peered":"2024-09-19T11:58:41.581698+0000","last_clean":"2024-09-19T11:58:41.581698+0000","last_became_active":"2024-09-19T11:51:53.478940+0000","last_became_peered":"2024-09-19T11:51:53.478940+0000","last_unstale":"2024-09-19T11:58:41.581698+0000","last_undegraded":"2024-09-19T11:58:41.581698+0000","last_fullsized":"2024-09-19T11:58:41.581698+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:59.776490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.9","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.904415+0000","last_change":"2024-09-19T11:54:08.215698+0000","last_active":"2024-09-19T12:03:05.904415+0000","last_peered":"2024-09-19T12:03:05.904415+0000","last_clean":"2024-09-19T12:03:05.904415+0000","last_became_active":"2024-09-19T11:54:08.143092+0000","last_became_peered":"2024-09-19T11:54:08.143092+0000","last_unstale":"2024-09-19T12:03:05.904415+0000","last_undegraded":"2024-09-19T12:03:05.904415+0000","last_fullsized":"2024-09-19T12:03:05.904415+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:06.545326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.612462+0000","last_change":"2024-09-19T11:53:34.723264+0000","last_active":"2024-09-19T12:00:06.612462+0000","last_peered":"2024-09-19T12:00:06.612462+0000","last_clean":"2024-09-19T12:00:06.612462+0000","last_became_active":"2024-09-19T11:53:34.722786+0000","last_became_peered":"2024-09-19T11:53:34.722786+0000","last_unstale":"2024-09-19T12:00:06.612462+0000","last_undegraded":"2024-09-19T12:00:06.612462+0000","last_fullsized":"2024-09-19T12:00:06.612462+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:25:14.671300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.593130+0000","last_change":"2024-09-19T11:51:53.491094+0000","last_active":"2024-09-19T11:58:41.593130+0000","last_peered":"2024-09-19T11:58:41.593130+0000","last_clean":"2024-09-19T11:58:41.593130+0000","last_became_active":"2024-09-19T11:51:53.490467+0000","last_became_peered":"2024-09-19T11:51:53.490467+0000","last_unstale":"2024-09-19T11:58:41.593130+0000","last_undegraded":"2024-09-19T11:58:41.593130+0000","last_fullsized":"2024-09-19T11:58:41.593130+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:52.304018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.615854+0000","last_change":"2024-09-19T11:53:37.739452+0000","last_active":"2024-09-19T12:00:11.615854+0000","last_peered":"2024-09-19T12:00:11.615854+0000","last_clean":"2024-09-19T12:00:11.615854+0000","last_became_active":"2024-09-19T11:53:37.738652+0000","last_became_peered":"2024-09-19T11:53:37.738652+0000","last_unstale":"2024-09-19T12:00:11.615854+0000","last_undegraded":"2024-09-19T12:00:11.615854+0000","last_fullsized":"2024-09-19T12:00:11.615854+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.598691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:16.626692+0000","last_change":"2024-09-19T11:53:34.709704+0000","last_active":"2024-09-19T12:02:16.626692+0000","last_peered":"2024-09-19T12:02:16.626692+0000","last_clean":"2024-09-19T12:02:16.626692+0000","last_became_active":"2024-09-19T11:53:34.708971+0000","last_became_peered":"2024-09-19T11:53:34.708971+0000","last_unstale":"2024-09-19T12:02:16.626692+0000","last_undegraded":"2024-09-19T12:02:16.626692+0000","last_fullsized":"2024-09-19T12:02:16.626692+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:31.763785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"256'7","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.621385+0000","last_change":"2024-09-19T11:51:53.482164+0000","last_active":"2024-09-19T12:00:36.621385+0000","last_peered":"2024-09-19T12:00:36.621385+0000","last_clean":"2024-09-19T12:00:36.621385+0000","last_became_active":"2024-09-19T11:51:53.481429+0000","last_became_peered":"2024-09-19T11:51:53.481429+0000","last_unstale":"2024-09-19T12:00:36.621385+0000","last_undegraded":"2024-09-19T12:00:36.621385+0000","last_fullsized":"2024-09-19T12:00:36.621385+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:29.346644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":44,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603698+0000","last_change":"2024-09-19T11:53:37.743123+0000","last_active":"2024-09-19T12:00:26.603698+0000","last_peered":"2024-09-19T12:00:26.603698+0000","last_clean":"2024-09-19T12:00:26.603698+0000","last_became_active":"2024-09-19T11:53:37.742403+0000","last_became_peered":"2024-09-19T11:53:37.742403+0000","last_unstale":"2024-09-19T12:00:26.603698+0000","last_undegraded":"2024-09-19T12:00:26.603698+0000","last_fullsized":"2024-09-19T12:00:26.603698+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:17.009971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.612531+0000","last_change":"2024-09-19T11:53:34.731804+0000","last_active":"2024-09-19T12:00:06.612531+0000","last_peered":"2024-09-19T12:00:06.612531+0000","last_clean":"2024-09-19T12:00:06.612531+0000","last_became_active":"2024-09-19T11:53:34.728959+0000","last_became_peered":"2024-09-19T11:53:34.728959+0000","last_unstale":"2024-09-19T12:00:06.612531+0000","last_undegraded":"2024-09-19T12:00:06.612531+0000","last_fullsized":"2024-09-19T12:00:06.612531+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:26.270496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.613843+0000","last_change":"2024-09-19T11:51:53.473143+0000","last_active":"2024-09-19T12:00:36.613843+0000","last_peered":"2024-09-19T12:00:36.613843+0000","last_clean":"2024-09-19T12:00:36.613843+0000","last_became_active":"2024-09-19T11:51:53.472485+0000","last_became_peered":"2024-09-19T11:51:53.472485+0000","last_unstale":"2024-09-19T12:00:36.613843+0000","last_undegraded":"2024-09-19T12:00:36.613843+0000","last_fullsized":"2024-09-19T12:00:36.613843+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:05:05.000749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.615948+0000","last_change":"2024-09-19T11:53:37.737715+0000","last_active":"2024-09-19T12:00:11.615948+0000","last_peered":"2024-09-19T12:00:11.615948+0000","last_clean":"2024-09-19T12:00:11.615948+0000","last_became_active":"2024-09-19T11:53:37.736772+0000","last_became_peered":"2024-09-19T11:53:37.736772+0000","last_unstale":"2024-09-19T12:00:11.615948+0000","last_undegraded":"2024-09-19T12:00:11.615948+0000","last_fullsized":"2024-09-19T12:00:11.615948+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:02.929650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'6","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.721991+0000","last_change":"2024-09-19T11:53:34.711999+0000","last_active":"2024-09-19T12:03:05.721991+0000","last_peered":"2024-09-19T12:03:05.721991+0000","last_clean":"2024-09-19T12:03:05.721991+0000","last_became_active":"2024-09-19T11:53:34.711382+0000","last_became_peered":"2024-09-19T11:53:34.711382+0000","last_unstale":"2024-09-19T12:03:05.721991+0000","last_undegraded":"2024-09-19T12:03:05.721991+0000","last_fullsized":"2024-09-19T12:03:05.721991+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:31.348728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618375+0000","last_change":"2024-09-19T11:51:53.487166+0000","last_active":"2024-09-19T12:00:36.618375+0000","last_peered":"2024-09-19T12:00:36.618375+0000","last_clean":"2024-09-19T12:00:36.618375+0000","last_became_active":"2024-09-19T11:51:53.486236+0000","last_became_peered":"2024-09-19T11:51:53.486236+0000","last_unstale":"2024-09-19T12:00:36.618375+0000","last_undegraded":"2024-09-19T12:00:36.618375+0000","last_fullsized":"2024-09-19T12:00:36.618375+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:19.897372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.610219+0000","last_change":"2024-09-19T11:53:37.747251+0000","last_active":"2024-09-19T11:59:56.610219+0000","last_peered":"2024-09-19T11:59:56.610219+0000","last_clean":"2024-09-19T11:59:56.610219+0000","last_became_active":"2024-09-19T11:53:37.745076+0000","last_became_peered":"2024-09-19T11:53:37.745076+0000","last_unstale":"2024-09-19T11:59:56.610219+0000","last_undegraded":"2024-09-19T11:59:56.610219+0000","last_fullsized":"2024-09-19T11:59:56.610219+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:16.840839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611669+0000","last_change":"2024-09-19T11:53:34.720400+0000","last_active":"2024-09-19T11:59:51.611669+0000","last_peered":"2024-09-19T11:59:51.611669+0000","last_clean":"2024-09-19T11:59:51.611669+0000","last_became_active":"2024-09-19T11:53:34.719535+0000","last_became_peered":"2024-09-19T11:53:34.719535+0000","last_unstale":"2024-09-19T11:59:51.611669+0000","last_undegraded":"2024-09-19T11:59:51.611669+0000","last_fullsized":"2024-09-19T11:59:51.611669+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:53.909023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'11","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.619919+0000","last_change":"2024-09-19T11:51:53.486865+0000","last_active":"2024-09-19T12:00:36.619919+0000","last_peered":"2024-09-19T12:00:36.619919+0000","last_clean":"2024-09-19T12:00:36.619919+0000","last_became_active":"2024-09-19T11:51:53.486126+0000","last_became_peered":"2024-09-19T11:51:53.486126+0000","last_unstale":"2024-09-19T12:00:36.619919+0000","last_undegraded":"2024-09-19T12:00:36.619919+0000","last_fullsized":"2024-09-19T12:00:36.619919+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:29.272674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":56,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:01.639128+0000","last_change":"2024-09-19T11:53:37.749405+0000","last_active":"2024-09-19T12:02:01.639128+0000","last_peered":"2024-09-19T12:02:01.639128+0000","last_clean":"2024-09-19T12:02:01.639128+0000","last_became_active":"2024-09-19T11:53:37.748479+0000","last_became_peered":"2024-09-19T11:53:37.748479+0000","last_unstale":"2024-09-19T12:02:01.639128+0000","last_undegraded":"2024-09-19T12:02:01.639128+0000","last_fullsized":"2024-09-19T12:02:01.639128+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:55.422274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:56.621015+0000","last_change":"2024-09-19T11:53:34.721846+0000","last_active":"2024-09-19T12:01:56.621015+0000","last_peered":"2024-09-19T12:01:56.621015+0000","last_clean":"2024-09-19T12:01:56.621015+0000","last_became_active":"2024-09-19T11:53:34.721421+0000","last_became_peered":"2024-09-19T11:53:34.721421+0000","last_unstale":"2024-09-19T12:01:56.621015+0000","last_undegraded":"2024-09-19T12:01:56.621015+0000","last_fullsized":"2024-09-19T12:01:56.621015+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:43:44.169249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618564+0000","last_change":"2024-09-19T11:51:53.469628+0000","last_active":"2024-09-19T12:00:36.618564+0000","last_peered":"2024-09-19T12:00:36.618564+0000","last_clean":"2024-09-19T12:00:36.618564+0000","last_became_active":"2024-09-19T11:51:53.468768+0000","last_became_peered":"2024-09-19T11:51:53.468768+0000","last_unstale":"2024-09-19T12:00:36.618564+0000","last_undegraded":"2024-09-19T12:00:36.618564+0000","last_fullsized":"2024-09-19T12:00:36.618564+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:35.828878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.616066+0000","last_change":"2024-09-19T11:53:37.749695+0000","last_active":"2024-09-19T12:00:11.616066+0000","last_peered":"2024-09-19T12:00:11.616066+0000","last_clean":"2024-09-19T12:00:11.616066+0000","last_became_active":"2024-09-19T11:53:37.749246+0000","last_became_peered":"2024-09-19T11:53:37.749246+0000","last_unstale":"2024-09-19T12:00:11.616066+0000","last_undegraded":"2024-09-19T12:00:11.616066+0000","last_fullsized":"2024-09-19T12:00:11.616066+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:35.006918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.610837+0000","last_change":"2024-09-19T11:53:34.703535+0000","last_active":"2024-09-19T12:00:06.610837+0000","last_peered":"2024-09-19T12:00:06.610837+0000","last_clean":"2024-09-19T12:00:06.610837+0000","last_became_active":"2024-09-19T11:53:34.702356+0000","last_became_peered":"2024-09-19T11:53:34.702356+0000","last_unstale":"2024-09-19T12:00:06.610837+0000","last_undegraded":"2024-09-19T12:00:06.610837+0000","last_fullsized":"2024-09-19T12:00:06.610837+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:05.738912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.617011+0000","last_change":"2024-09-19T11:51:53.484021+0000","last_active":"2024-09-19T12:00:16.617011+0000","last_peered":"2024-09-19T12:00:16.617011+0000","last_clean":"2024-09-19T12:00:16.617011+0000","last_became_active":"2024-09-19T11:51:53.483350+0000","last_became_peered":"2024-09-19T11:51:53.483350+0000","last_unstale":"2024-09-19T12:00:16.617011+0000","last_undegraded":"2024-09-19T12:00:16.617011+0000","last_fullsized":"2024-09-19T12:00:16.617011+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:32.695646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"264'9","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.872856+0000","last_change":"2024-09-19T11:53:37.731037+0000","last_active":"2024-09-19T12:03:05.872856+0000","last_peered":"2024-09-19T12:03:05.872856+0000","last_clean":"2024-09-19T12:03:05.872856+0000","last_became_active":"2024-09-19T11:53:37.730641+0000","last_became_peered":"2024-09-19T11:53:37.730641+0000","last_unstale":"2024-09-19T12:03:05.872856+0000","last_undegraded":"2024-09-19T12:03:05.872856+0000","last_fullsized":"2024-09-19T12:03:05.872856+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:40.518527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15360,"num_write":14,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.614943+0000","last_change":"2024-09-19T11:53:34.719873+0000","last_active":"2024-09-19T12:00:06.614943+0000","last_peered":"2024-09-19T12:00:06.614943+0000","last_clean":"2024-09-19T12:00:06.614943+0000","last_became_active":"2024-09-19T11:53:34.719193+0000","last_became_peered":"2024-09-19T11:53:34.719193+0000","last_unstale":"2024-09-19T12:00:06.614943+0000","last_undegraded":"2024-09-19T12:00:06.614943+0000","last_fullsized":"2024-09-19T12:00:06.614943+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:17.922208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"256'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.601313+0000","last_change":"2024-09-19T11:51:53.479626+0000","last_active":"2024-09-19T12:00:16.601313+0000","last_peered":"2024-09-19T12:00:16.601313+0000","last_clean":"2024-09-19T12:00:16.601313+0000","last_became_active":"2024-09-19T11:51:53.476953+0000","last_became_peered":"2024-09-19T11:51:53.476953+0000","last_unstale":"2024-09-19T12:00:16.601313+0000","last_undegraded":"2024-09-19T12:00:16.601313+0000","last_fullsized":"2024-09-19T12:00:16.601313+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:40.063157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:01.623954+0000","last_change":"2024-09-19T11:53:37.736521+0000","last_active":"2024-09-19T12:02:01.623954+0000","last_peered":"2024-09-19T12:02:01.623954+0000","last_clean":"2024-09-19T12:02:01.623954+0000","last_became_active":"2024-09-19T11:53:37.731400+0000","last_became_peered":"2024-09-19T11:53:37.731400+0000","last_unstale":"2024-09-19T12:02:01.623954+0000","last_undegraded":"2024-09-19T12:02:01.623954+0000","last_fullsized":"2024-09-19T12:02:01.623954+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:04.607485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.886887+0000","last_change":"2024-09-19T11:53:34.724933+0000","last_active":"2024-09-19T12:03:05.886887+0000","last_peered":"2024-09-19T12:03:05.886887+0000","last_clean":"2024-09-19T12:03:05.886887+0000","last_became_active":"2024-09-19T11:53:34.724406+0000","last_became_peered":"2024-09-19T11:53:34.724406+0000","last_unstale":"2024-09-19T12:03:05.886887+0000","last_undegraded":"2024-09-19T12:03:05.886887+0000","last_fullsized":"2024-09-19T12:03:05.886887+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:26.998520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":21506,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.612913+0000","last_change":"2024-09-19T11:51:53.495205+0000","last_active":"2024-09-19T12:00:16.612913+0000","last_peered":"2024-09-19T12:00:16.612913+0000","last_clean":"2024-09-19T12:00:16.612913+0000","last_became_active":"2024-09-19T11:51:53.494443+0000","last_became_peered":"2024-09-19T11:51:53.494443+0000","last_unstale":"2024-09-19T12:00:16.612913+0000","last_undegraded":"2024-09-19T12:00:16.612913+0000","last_fullsized":"2024-09-19T12:00:16.612913+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:22.980807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.0","version":"264'2","reported_seq":25,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:41.633179+0000","last_change":"2024-09-19T11:53:37.729810+0000","last_active":"2024-09-19T12:01:41.633179+0000","last_peered":"2024-09-19T12:01:41.633179+0000","last_clean":"2024-09-19T12:01:41.633179+0000","last_became_active":"2024-09-19T11:53:37.729101+0000","last_became_peered":"2024-09-19T11:53:37.729101+0000","last_unstale":"2024-09-19T12:01:41.633179+0000","last_undegraded":"2024-09-19T12:01:41.633179+0000","last_fullsized":"2024-09-19T12:01:41.633179+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:23.824167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:56.639147+0000","last_change":"2024-09-19T11:53:34.719029+0000","last_active":"2024-09-19T12:01:56.639147+0000","last_peered":"2024-09-19T12:01:56.639147+0000","last_clean":"2024-09-19T12:01:56.639147+0000","last_became_active":"2024-09-19T11:53:34.715905+0000","last_became_peered":"2024-09-19T11:53:34.715905+0000","last_unstale":"2024-09-19T12:01:56.639147+0000","last_undegraded":"2024-09-19T12:01:56.639147+0000","last_fullsized":"2024-09-19T12:01:56.639147+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:06.085056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.806309+0000","last_change":"2024-09-19T11:51:53.485332+0000","last_active":"2024-09-19T12:00:16.806309+0000","last_peered":"2024-09-19T12:00:16.806309+0000","last_clean":"2024-09-19T12:00:16.806309+0000","last_became_active":"2024-09-19T11:51:53.479975+0000","last_became_peered":"2024-09-19T11:51:53.479975+0000","last_unstale":"2024-09-19T12:00:16.806309+0000","last_undegraded":"2024-09-19T12:00:16.806309+0000","last_fullsized":"2024-09-19T12:00:16.806309+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:54.383913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.609354+0000","last_change":"2024-09-19T11:53:37.752407+0000","last_active":"2024-09-19T11:59:56.609354+0000","last_peered":"2024-09-19T11:59:56.609354+0000","last_clean":"2024-09-19T11:59:56.609354+0000","last_became_active":"2024-09-19T11:53:37.751835+0000","last_became_peered":"2024-09-19T11:53:37.751835+0000","last_unstale":"2024-09-19T11:59:56.609354+0000","last_undegraded":"2024-09-19T11:59:56.609354+0000","last_fullsized":"2024-09-19T11:59:56.609354+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:44.756436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:56.623014+0000","last_change":"2024-09-19T11:53:34.722088+0000","last_active":"2024-09-19T12:01:56.623014+0000","last_peered":"2024-09-19T12:01:56.623014+0000","last_clean":"2024-09-19T12:01:56.623014+0000","last_became_active":"2024-09-19T11:53:34.721659+0000","last_became_peered":"2024-09-19T11:53:34.721659+0000","last_unstale":"2024-09-19T12:01:56.623014+0000","last_undegraded":"2024-09-19T12:01:56.623014+0000","last_fullsized":"2024-09-19T12:01:56.623014+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:52.673209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.613783+0000","last_change":"2024-09-19T11:51:53.488636+0000","last_active":"2024-09-19T12:00:16.613783+0000","last_peered":"2024-09-19T12:00:16.613783+0000","last_clean":"2024-09-19T12:00:16.613783+0000","last_became_active":"2024-09-19T11:51:53.487416+0000","last_became_peered":"2024-09-19T11:51:53.487416+0000","last_unstale":"2024-09-19T12:00:16.613783+0000","last_undegraded":"2024-09-19T12:00:16.613783+0000","last_fullsized":"2024-09-19T12:00:16.613783+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:28.039923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"264'3","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:01.829672+0000","last_change":"2024-09-19T11:53:37.722872+0000","last_active":"2024-09-19T12:02:01.829672+0000","last_peered":"2024-09-19T12:02:01.829672+0000","last_clean":"2024-09-19T12:02:01.829672+0000","last_became_active":"2024-09-19T11:53:37.722160+0000","last_became_peered":"2024-09-19T11:53:37.722160+0000","last_unstale":"2024-09-19T12:02:01.829672+0000","last_undegraded":"2024-09-19T12:02:01.829672+0000","last_fullsized":"2024-09-19T12:02:01.829672+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:39.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.608199+0000","last_change":"2024-09-19T11:53:34.699925+0000","last_active":"2024-09-19T11:59:51.608199+0000","last_peered":"2024-09-19T11:59:51.608199+0000","last_clean":"2024-09-19T11:59:51.608199+0000","last_became_active":"2024-09-19T11:53:34.699127+0000","last_became_peered":"2024-09-19T11:53:34.699127+0000","last_unstale":"2024-09-19T11:59:51.608199+0000","last_undegraded":"2024-09-19T11:59:51.608199+0000","last_fullsized":"2024-09-19T11:59:51.608199+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:49.808733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"256'15","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.612683+0000","last_change":"2024-09-19T11:51:53.485393+0000","last_active":"2024-09-19T11:59:56.612683+0000","last_peered":"2024-09-19T11:59:56.612683+0000","last_clean":"2024-09-19T11:59:56.612683+0000","last_became_active":"2024-09-19T11:51:53.484630+0000","last_became_peered":"2024-09-19T11:51:53.484630+0000","last_unstale":"2024-09-19T11:59:56.612683+0000","last_undegraded":"2024-09-19T11:59:56.612683+0000","last_fullsized":"2024-09-19T11:59:56.612683+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:33.200357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":95,"num_write":34,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'29","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.861654+0000","last_change":"2024-09-19T11:35:31.629725+0000","last_active":"2024-09-19T12:03:05.861654+0000","last_peered":"2024-09-19T12:03:05.861654+0000","last_clean":"2024-09-19T12:03:05.861654+0000","last_became_active":"2024-09-19T11:35:31.628800+0000","last_became_peered":"2024-09-19T11:35:31.628800+0000","last_unstale":"2024-09-19T12:03:05.861654+0000","last_undegraded":"2024-09-19T12:03:05.861654+0000","last_fullsized":"2024-09-19T12:03:05.861654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:24.923313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":38,"num_write":120,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'47","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.617744+0000","last_change":"2024-09-19T11:35:33.628736+0000","last_active":"2024-09-19T12:00:36.617744+0000","last_peered":"2024-09-19T12:00:36.617744+0000","last_clean":"2024-09-19T12:00:36.617744+0000","last_became_active":"2024-09-19T11:35:33.627994+0000","last_became_peered":"2024-09-19T11:35:33.627994+0000","last_unstale":"2024-09-19T12:00:36.617744+0000","last_undegraded":"2024-09-19T12:00:36.617744+0000","last_fullsized":"2024-09-19T12:00:36.617744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:58.580017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":154,"num_write":67,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'64","reported_seq":584,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.946002+0000","last_change":"2024-09-19T11:35:31.608493+0000","last_active":"2024-09-19T12:03:05.946002+0000","last_peered":"2024-09-19T12:03:05.946002+0000","last_clean":"2024-09-19T12:03:05.946002+0000","last_became_active":"2024-09-19T11:35:31.608158+0000","last_became_peered":"2024-09-19T11:35:31.608158+0000","last_unstale":"2024-09-19T12:03:05.946002+0000","last_undegraded":"2024-09-19T12:03:05.946002+0000","last_fullsized":"2024-09-19T12:03:05.946002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:19.335025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":661,"num_write":209,"num_write_kb":4683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'27","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.621331+0000","last_change":"2024-09-19T11:35:33.621664+0000","last_active":"2024-09-19T12:00:36.621331+0000","last_peered":"2024-09-19T12:00:36.621331+0000","last_clean":"2024-09-19T12:00:36.621331+0000","last_became_active":"2024-09-19T11:35:33.618098+0000","last_became_peered":"2024-09-19T11:35:33.618098+0000","last_unstale":"2024-09-19T12:00:36.621331+0000","last_undegraded":"2024-09-19T12:00:36.621331+0000","last_fullsized":"2024-09-19T12:00:36.621331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:51.714564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":93,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'44","reported_seq":558,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.893930+0000","last_change":"2024-09-19T11:35:31.614280+0000","last_active":"2024-09-19T12:03:05.893930+0000","last_peered":"2024-09-19T12:03:05.893930+0000","last_clean":"2024-09-19T12:03:05.893930+0000","last_became_active":"2024-09-19T11:35:31.613678+0000","last_became_peered":"2024-09-19T11:35:31.613678+0000","last_unstale":"2024-09-19T12:03:05.893930+0000","last_undegraded":"2024-09-19T12:03:05.893930+0000","last_fullsized":"2024-09-19T12:03:05.893930+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:43.000538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":82,"num_read_kb":12351,"num_write":140,"num_write_kb":6154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'42","reported_seq":543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810975+0000","last_change":"2024-09-19T11:35:33.614046+0000","last_active":"2024-09-19T12:00:36.810975+0000","last_peered":"2024-09-19T12:00:36.810975+0000","last_clean":"2024-09-19T12:00:36.810975+0000","last_became_active":"2024-09-19T11:35:33.613298+0000","last_became_peered":"2024-09-19T11:35:33.613298+0000","last_unstale":"2024-09-19T12:00:36.810975+0000","last_undegraded":"2024-09-19T12:00:36.810975+0000","last_fullsized":"2024-09-19T12:00:36.810975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:34.924557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":123,"num_write":79,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'25","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.842724+0000","last_change":"2024-09-19T11:35:31.610606+0000","last_active":"2024-09-19T12:03:05.842724+0000","last_peered":"2024-09-19T12:03:05.842724+0000","last_clean":"2024-09-19T12:03:05.842724+0000","last_became_active":"2024-09-19T11:35:31.608115+0000","last_became_peered":"2024-09-19T11:35:31.608115+0000","last_unstale":"2024-09-19T12:03:05.842724+0000","last_undegraded":"2024-09-19T12:03:05.842724+0000","last_fullsized":"2024-09-19T12:03:05.842724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:40.436454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":1089,"num_write":119,"num_write_kb":1059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'54","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.619823+0000","last_change":"2024-09-19T11:35:33.625809+0000","last_active":"2024-09-19T12:00:36.619823+0000","last_peered":"2024-09-19T12:00:36.619823+0000","last_clean":"2024-09-19T12:00:36.619823+0000","last_became_active":"2024-09-19T11:35:33.625528+0000","last_became_peered":"2024-09-19T11:35:33.625528+0000","last_unstale":"2024-09-19T12:00:36.619823+0000","last_undegraded":"2024-09-19T12:00:36.619823+0000","last_fullsized":"2024-09-19T12:00:36.619823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:28.944541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":230,"num_read_kb":188,"num_write":85,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'71","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.920423+0000","last_change":"2024-09-19T11:35:31.620118+0000","last_active":"2024-09-19T12:03:05.920423+0000","last_peered":"2024-09-19T12:03:05.920423+0000","last_clean":"2024-09-19T12:03:05.920423+0000","last_became_active":"2024-09-19T11:35:31.618555+0000","last_became_peered":"2024-09-19T11:35:31.618555+0000","last_unstale":"2024-09-19T12:03:05.920423+0000","last_undegraded":"2024-09-19T12:03:05.920423+0000","last_fullsized":"2024-09-19T12:03:05.920423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:25.667196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":29375,"num_write":187,"num_write_kb":13979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'27","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.193132+0000","last_change":"2024-09-19T11:35:33.626035+0000","last_active":"2024-09-19T12:02:33.193132+0000","last_peered":"2024-09-19T12:02:33.193132+0000","last_clean":"2024-09-19T12:02:33.193132+0000","last_became_active":"2024-09-19T11:35:33.624952+0000","last_became_peered":"2024-09-19T11:35:33.624952+0000","last_unstale":"2024-09-19T12:02:33.193132+0000","last_undegraded":"2024-09-19T12:02:33.193132+0000","last_fullsized":"2024-09-19T12:02:33.193132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:40.687504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":112,"num_write":47,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'51","reported_seq":558,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.735542+0000","last_change":"2024-09-19T11:35:31.589199+0000","last_active":"2024-09-19T12:03:05.735542+0000","last_peered":"2024-09-19T12:03:05.735542+0000","last_clean":"2024-09-19T12:03:05.735542+0000","last_became_active":"2024-09-19T11:35:31.587016+0000","last_became_peered":"2024-09-19T11:35:31.587016+0000","last_unstale":"2024-09-19T12:03:05.735542+0000","last_undegraded":"2024-09-19T12:03:05.735542+0000","last_fullsized":"2024-09-19T12:03:05.735542+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:43.361105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":3127,"num_write":134,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"253'2","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.811093+0000","last_change":"2024-09-19T11:35:33.614181+0000","last_active":"2024-09-19T12:00:36.811093+0000","last_peered":"2024-09-19T12:00:36.811093+0000","last_clean":"2024-09-19T12:00:36.811093+0000","last_became_active":"2024-09-19T11:35:33.612338+0000","last_became_peered":"2024-09-19T11:35:33.612338+0000","last_unstale":"2024-09-19T12:00:36.811093+0000","last_undegraded":"2024-09-19T12:00:36.811093+0000","last_fullsized":"2024-09-19T12:00:36.811093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:01.117001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'39","reported_seq":543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.952552+0000","last_change":"2024-09-19T11:35:31.621888+0000","last_active":"2024-09-19T12:03:05.952552+0000","last_peered":"2024-09-19T12:03:05.952552+0000","last_clean":"2024-09-19T12:03:05.952552+0000","last_became_active":"2024-09-19T11:35:31.619730+0000","last_became_peered":"2024-09-19T11:35:31.619730+0000","last_unstale":"2024-09-19T12:03:05.952552+0000","last_undegraded":"2024-09-19T12:03:05.952552+0000","last_fullsized":"2024-09-19T12:03:05.952552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:41.738718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":33,"num_write":114,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'48","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618078+0000","last_change":"2024-09-19T11:35:33.612223+0000","last_active":"2024-09-19T12:00:36.618078+0000","last_peered":"2024-09-19T12:00:36.618078+0000","last_clean":"2024-09-19T12:00:36.618078+0000","last_became_active":"2024-09-19T11:35:33.611495+0000","last_became_peered":"2024-09-19T11:35:33.611495+0000","last_unstale":"2024-09-19T12:00:36.618078+0000","last_undegraded":"2024-09-19T12:00:36.618078+0000","last_fullsized":"2024-09-19T12:00:36.618078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:50.704291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":135,"num_write":76,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'38","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.878019+0000","last_change":"2024-09-19T11:35:31.594461+0000","last_active":"2024-09-19T12:03:05.878019+0000","last_peered":"2024-09-19T12:03:05.878019+0000","last_clean":"2024-09-19T12:03:05.878019+0000","last_became_active":"2024-09-19T11:35:31.593765+0000","last_became_peered":"2024-09-19T11:35:31.593765+0000","last_unstale":"2024-09-19T12:03:05.878019+0000","last_undegraded":"2024-09-19T12:03:05.878019+0000","last_fullsized":"2024-09-19T12:03:05.878019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:15.207126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":57,"num_read_kb":47,"num_write":117,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'46","reported_seq":564,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.197761+0000","last_change":"2024-09-19T11:35:33.606318+0000","last_active":"2024-09-19T12:02:33.197761+0000","last_peered":"2024-09-19T12:02:33.197761+0000","last_clean":"2024-09-19T12:02:33.197761+0000","last_became_active":"2024-09-19T11:35:33.604505+0000","last_became_peered":"2024-09-19T11:35:33.604505+0000","last_unstale":"2024-09-19T12:02:33.197761+0000","last_undegraded":"2024-09-19T12:02:33.197761+0000","last_fullsized":"2024-09-19T12:02:33.197761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:56.257217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":158,"num_write":84,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'76","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.163064+0000","last_change":"2024-09-19T11:35:33.608564+0000","last_active":"2024-09-19T12:02:33.163064+0000","last_peered":"2024-09-19T12:02:33.163064+0000","last_clean":"2024-09-19T12:02:33.163064+0000","last_became_active":"2024-09-19T11:35:33.607843+0000","last_became_peered":"2024-09-19T11:35:33.607843+0000","last_unstale":"2024-09-19T12:02:33.163064+0000","last_undegraded":"2024-09-19T12:02:33.163064+0000","last_fullsized":"2024-09-19T12:02:33.163064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:40.705119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":241,"num_write":113,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'43","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.869575+0000","last_change":"2024-09-19T11:36:06.682019+0000","last_active":"2024-09-19T12:03:05.869575+0000","last_peered":"2024-09-19T12:03:05.869575+0000","last_clean":"2024-09-19T12:03:05.869575+0000","last_became_active":"2024-09-19T11:36:06.680794+0000","last_became_peered":"2024-09-19T11:36:06.680794+0000","last_unstale":"2024-09-19T12:03:05.869575+0000","last_undegraded":"2024-09-19T12:03:05.869575+0000","last_fullsized":"2024-09-19T12:03:05.869575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:15.316832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":3338,"num_write":153,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,1],"acting":[2,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599773+0000","last_change":"2024-09-19T11:35:33.622666+0000","last_active":"2024-09-19T11:58:56.599773+0000","last_peered":"2024-09-19T11:58:56.599773+0000","last_clean":"2024-09-19T11:58:56.599773+0000","last_became_active":"2024-09-19T11:35:33.621522+0000","last_became_peered":"2024-09-19T11:35:33.621522+0000","last_unstale":"2024-09-19T11:58:56.599773+0000","last_undegraded":"2024-09-19T11:58:56.599773+0000","last_fullsized":"2024-09-19T11:58:56.599773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:16.770624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'38","reported_seq":554,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.924221+0000","last_change":"2024-09-19T11:35:31.612184+0000","last_active":"2024-09-19T12:03:05.924221+0000","last_peered":"2024-09-19T12:03:05.924221+0000","last_clean":"2024-09-19T12:03:05.924221+0000","last_became_active":"2024-09-19T11:35:31.598016+0000","last_became_peered":"2024-09-19T11:35:31.598016+0000","last_unstale":"2024-09-19T12:03:05.924221+0000","last_undegraded":"2024-09-19T12:03:05.924221+0000","last_fullsized":"2024-09-19T12:03:05.924221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:59.949408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159780,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":2182,"num_write":164,"num_write_kb":2115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'48","reported_seq":554,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.596523+0000","last_change":"2024-09-19T11:35:33.612612+0000","last_active":"2024-09-19T11:59:01.596523+0000","last_peered":"2024-09-19T11:59:01.596523+0000","last_clean":"2024-09-19T11:59:01.596523+0000","last_became_active":"2024-09-19T11:35:33.610072+0000","last_became_peered":"2024-09-19T11:35:33.610072+0000","last_unstale":"2024-09-19T11:59:01.596523+0000","last_undegraded":"2024-09-19T11:59:01.596523+0000","last_fullsized":"2024-09-19T11:59:01.596523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:22.254214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":149,"num_write":86,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'38","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.807519+0000","last_change":"2024-09-19T11:35:31.615091+0000","last_active":"2024-09-19T12:03:05.807519+0000","last_peered":"2024-09-19T12:03:05.807519+0000","last_clean":"2024-09-19T12:03:05.807519+0000","last_became_active":"2024-09-19T11:35:31.614263+0000","last_became_peered":"2024-09-19T11:35:31.614263+0000","last_unstale":"2024-09-19T12:03:05.807519+0000","last_undegraded":"2024-09-19T12:03:05.807519+0000","last_fullsized":"2024-09-19T12:03:05.807519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:03.358145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":5162,"num_write":130,"num_write_kb":10269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'149","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.050113+0000","last_change":"2024-09-19T11:35:33.611574+0000","last_active":"2024-09-19T12:02:33.050113+0000","last_peered":"2024-09-19T12:02:33.050113+0000","last_clean":"2024-09-19T12:02:33.050113+0000","last_became_active":"2024-09-19T11:35:33.611240+0000","last_became_peered":"2024-09-19T11:35:33.611240+0000","last_unstale":"2024-09-19T12:02:33.050113+0000","last_undegraded":"2024-09-19T12:02:33.050113+0000","last_fullsized":"2024-09-19T12:02:33.050113+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:58.616861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":454,"num_write":234,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'36","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.920563+0000","last_change":"2024-09-19T11:35:31.592787+0000","last_active":"2024-09-19T12:03:05.920563+0000","last_peered":"2024-09-19T12:03:05.920563+0000","last_clean":"2024-09-19T12:03:05.920563+0000","last_became_active":"2024-09-19T11:35:31.591932+0000","last_became_peered":"2024-09-19T11:35:31.591932+0000","last_unstale":"2024-09-19T12:03:05.920563+0000","last_undegraded":"2024-09-19T12:03:05.920563+0000","last_fullsized":"2024-09-19T12:03:05.920563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:16.215077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291468,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":7804,"num_write":105,"num_write_kb":7776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'26","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.594514+0000","last_change":"2024-09-19T11:35:33.626081+0000","last_active":"2024-09-19T11:59:46.594514+0000","last_peered":"2024-09-19T11:59:46.594514+0000","last_clean":"2024-09-19T11:59:46.594514+0000","last_became_active":"2024-09-19T11:35:33.625698+0000","last_became_peered":"2024-09-19T11:35:33.625698+0000","last_unstale":"2024-09-19T11:59:46.594514+0000","last_undegraded":"2024-09-19T11:59:46.594514+0000","last_fullsized":"2024-09-19T11:59:46.594514+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:25.969110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":73,"num_write":57,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'25","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.817778+0000","last_change":"2024-09-19T11:35:31.601399+0000","last_active":"2024-09-19T12:03:05.817778+0000","last_peered":"2024-09-19T12:03:05.817778+0000","last_clean":"2024-09-19T12:03:05.817778+0000","last_became_active":"2024-09-19T11:35:31.600939+0000","last_became_peered":"2024-09-19T11:35:31.600939+0000","last_unstale":"2024-09-19T12:03:05.817778+0000","last_undegraded":"2024-09-19T12:03:05.817778+0000","last_fullsized":"2024-09-19T12:03:05.817778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:35.527377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":6211,"num_write":103,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.799672+0000","last_change":"2024-09-19T11:35:33.605918+0000","last_active":"2024-09-19T11:59:46.799672+0000","last_peered":"2024-09-19T11:59:46.799672+0000","last_clean":"2024-09-19T11:59:46.799672+0000","last_became_active":"2024-09-19T11:35:33.605215+0000","last_became_peered":"2024-09-19T11:35:33.605215+0000","last_unstale":"2024-09-19T11:59:46.799672+0000","last_undegraded":"2024-09-19T11:59:46.799672+0000","last_fullsized":"2024-09-19T11:59:46.799672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:06.551820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'50","reported_seq":575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.878018+0000","last_change":"2024-09-19T11:35:31.597393+0000","last_active":"2024-09-19T12:03:05.878018+0000","last_peered":"2024-09-19T12:03:05.878018+0000","last_clean":"2024-09-19T12:03:05.878018+0000","last_became_active":"2024-09-19T11:35:31.597035+0000","last_became_peered":"2024-09-19T11:35:31.597035+0000","last_unstale":"2024-09-19T12:03:05.878018+0000","last_undegraded":"2024-09-19T12:03:05.878018+0000","last_fullsized":"2024-09-19T12:03:05.878018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:38.704431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":25670,"num_write":130,"num_write_kb":10245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'16","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.800682+0000","last_change":"2024-09-19T11:35:41.674446+0000","last_active":"2024-09-19T11:59:51.800682+0000","last_peered":"2024-09-19T11:59:51.800682+0000","last_clean":"2024-09-19T11:59:51.800682+0000","last_became_active":"2024-09-19T11:35:41.673420+0000","last_became_peered":"2024-09-19T11:35:41.673420+0000","last_unstale":"2024-09-19T11:59:51.800682+0000","last_undegraded":"2024-09-19T11:59:51.800682+0000","last_fullsized":"2024-09-19T11:59:51.800682+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:40.611862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":47,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.592064+0000","last_change":"2024-09-19T11:35:33.613895+0000","last_active":"2024-09-19T11:59:01.592064+0000","last_peered":"2024-09-19T11:59:01.592064+0000","last_clean":"2024-09-19T11:59:01.592064+0000","last_became_active":"2024-09-19T11:35:33.613437+0000","last_became_peered":"2024-09-19T11:35:33.613437+0000","last_unstale":"2024-09-19T11:59:01.592064+0000","last_undegraded":"2024-09-19T11:59:01.592064+0000","last_fullsized":"2024-09-19T11:59:01.592064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:34.414349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'59","reported_seq":572,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.843646+0000","last_change":"2024-09-19T11:35:31.600183+0000","last_active":"2024-09-19T12:03:05.843646+0000","last_peered":"2024-09-19T12:03:05.843646+0000","last_clean":"2024-09-19T12:03:05.843646+0000","last_became_active":"2024-09-19T11:35:31.599314+0000","last_became_peered":"2024-09-19T11:35:31.599314+0000","last_unstale":"2024-09-19T12:03:05.843646+0000","last_undegraded":"2024-09-19T12:03:05.843646+0000","last_fullsized":"2024-09-19T12:03:05.843646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:43.331402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":96,"num_read_kb":1688,"num_write":199,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.606494+0000","last_change":"2024-09-19T11:35:35.617353+0000","last_active":"2024-09-19T11:59:46.606494+0000","last_peered":"2024-09-19T11:59:46.606494+0000","last_clean":"2024-09-19T11:59:46.606494+0000","last_became_active":"2024-09-19T11:35:35.616351+0000","last_became_peered":"2024-09-19T11:35:35.616351+0000","last_unstale":"2024-09-19T11:59:46.606494+0000","last_undegraded":"2024-09-19T11:59:46.606494+0000","last_fullsized":"2024-09-19T11:59:46.606494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:15.938562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'123","reported_seq":656,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.649912+0000","last_change":"2024-09-19T11:35:37.651194+0000","last_active":"2024-09-19T12:03:05.649912+0000","last_peered":"2024-09-19T12:03:05.649912+0000","last_clean":"2024-09-19T12:03:05.649912+0000","last_became_active":"2024-09-19T11:35:37.650685+0000","last_became_peered":"2024-09-19T11:35:37.650685+0000","last_unstale":"2024-09-19T12:03:05.649912+0000","last_undegraded":"2024-09-19T12:03:05.649912+0000","last_fullsized":"2024-09-19T12:03:05.649912+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:53.348943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":226,"num_write":120,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611862+0000","last_change":"2024-09-19T11:35:39.676563+0000","last_active":"2024-09-19T11:59:51.611862+0000","last_peered":"2024-09-19T11:59:51.611862+0000","last_clean":"2024-09-19T11:59:51.611862+0000","last_became_active":"2024-09-19T11:35:39.676033+0000","last_became_peered":"2024-09-19T11:35:39.676033+0000","last_unstale":"2024-09-19T11:59:51.611862+0000","last_undegraded":"2024-09-19T11:59:51.611862+0000","last_fullsized":"2024-09-19T11:59:51.611862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:44.059170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'15","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.608623+0000","last_change":"2024-09-19T11:35:41.682580+0000","last_active":"2024-09-19T11:59:56.608623+0000","last_peered":"2024-09-19T11:59:56.608623+0000","last_clean":"2024-09-19T11:59:56.608623+0000","last_became_active":"2024-09-19T11:35:41.680497+0000","last_became_peered":"2024-09-19T11:35:41.680497+0000","last_unstale":"2024-09-19T11:59:56.608623+0000","last_undegraded":"2024-09-19T11:59:56.608623+0000","last_fullsized":"2024-09-19T11:59:56.608623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:55.800690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":49,"num_write":53,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'2","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:11.640032+0000","last_change":"2024-09-19T11:35:33.617104+0000","last_active":"2024-09-19T12:02:11.640032+0000","last_peered":"2024-09-19T12:02:11.640032+0000","last_clean":"2024-09-19T12:02:11.640032+0000","last_became_active":"2024-09-19T11:35:33.615138+0000","last_became_peered":"2024-09-19T11:35:33.615138+0000","last_unstale":"2024-09-19T12:02:11.640032+0000","last_undegraded":"2024-09-19T12:02:11.640032+0000","last_fullsized":"2024-09-19T12:02:11.640032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:22.788235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'37","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.853247+0000","last_change":"2024-09-19T11:35:31.612888+0000","last_active":"2024-09-19T12:03:05.853247+0000","last_peered":"2024-09-19T12:03:05.853247+0000","last_clean":"2024-09-19T12:03:05.853247+0000","last_became_active":"2024-09-19T11:35:31.612424+0000","last_became_peered":"2024-09-19T11:35:31.612424+0000","last_unstale":"2024-09-19T12:03:05.853247+0000","last_undegraded":"2024-09-19T12:03:05.853247+0000","last_fullsized":"2024-09-19T12:03:05.853247+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:08.302859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":5150,"num_write":106,"num_write_kb":10271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.592095+0000","last_change":"2024-09-19T11:35:35.627312+0000","last_active":"2024-09-19T11:59:01.592095+0000","last_peered":"2024-09-19T11:59:01.592095+0000","last_clean":"2024-09-19T11:59:01.592095+0000","last_became_active":"2024-09-19T11:35:35.626979+0000","last_became_peered":"2024-09-19T11:35:35.626979+0000","last_unstale":"2024-09-19T11:59:01.592095+0000","last_undegraded":"2024-09-19T11:59:01.592095+0000","last_fullsized":"2024-09-19T11:59:01.592095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:42.288842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'48","reported_seq":554,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:16.833482+0000","last_change":"2024-09-19T11:35:37.630326+0000","last_active":"2024-09-19T12:02:16.833482+0000","last_peered":"2024-09-19T12:02:16.833482+0000","last_clean":"2024-09-19T12:02:16.833482+0000","last_became_active":"2024-09-19T11:35:37.624916+0000","last_became_peered":"2024-09-19T11:35:37.624916+0000","last_unstale":"2024-09-19T12:02:16.833482+0000","last_undegraded":"2024-09-19T12:02:16.833482+0000","last_fullsized":"2024-09-19T12:02:16.833482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:40.009132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":68,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.800889+0000","last_change":"2024-09-19T11:35:39.670488+0000","last_active":"2024-09-19T11:59:51.800889+0000","last_peered":"2024-09-19T11:59:51.800889+0000","last_clean":"2024-09-19T11:59:51.800889+0000","last_became_active":"2024-09-19T11:35:39.669732+0000","last_became_peered":"2024-09-19T11:35:39.669732+0000","last_unstale":"2024-09-19T11:59:51.800889+0000","last_undegraded":"2024-09-19T11:59:51.800889+0000","last_fullsized":"2024-09-19T11:59:51.800889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:15.697637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'26","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:18.515668+0000","last_change":"2024-09-19T11:35:41.695806+0000","last_active":"2024-09-19T11:58:18.515668+0000","last_peered":"2024-09-19T11:58:18.515668+0000","last_clean":"2024-09-19T11:58:18.515668+0000","last_became_active":"2024-09-19T11:35:41.693197+0000","last_became_peered":"2024-09-19T11:35:41.693197+0000","last_unstale":"2024-09-19T11:58:18.515668+0000","last_undegraded":"2024-09-19T11:58:18.515668+0000","last_fullsized":"2024-09-19T11:58:18.515668+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:38:56.811510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":93,"num_write":83,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'5","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.607864+0000","last_change":"2024-09-19T11:35:33.626048+0000","last_active":"2024-09-19T11:59:46.607864+0000","last_peered":"2024-09-19T11:59:46.607864+0000","last_clean":"2024-09-19T11:59:46.607864+0000","last_became_active":"2024-09-19T11:35:33.625606+0000","last_became_peered":"2024-09-19T11:35:33.625606+0000","last_unstale":"2024-09-19T11:59:46.607864+0000","last_undegraded":"2024-09-19T11:59:46.607864+0000","last_fullsized":"2024-09-19T11:59:46.607864+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:11.107345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'49","reported_seq":555,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.861043+0000","last_change":"2024-09-19T11:35:31.622618+0000","last_active":"2024-09-19T12:03:05.861043+0000","last_peered":"2024-09-19T12:03:05.861043+0000","last_clean":"2024-09-19T12:03:05.861043+0000","last_became_active":"2024-09-19T11:35:31.621190+0000","last_became_peered":"2024-09-19T11:35:31.621190+0000","last_unstale":"2024-09-19T12:03:05.861043+0000","last_undegraded":"2024-09-19T12:03:05.861043+0000","last_fullsized":"2024-09-19T12:03:05.861043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:14.420143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":65,"num_read_kb":198,"num_write":164,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"38'3","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.052304+0000","last_change":"2024-09-19T11:35:35.624498+0000","last_active":"2024-09-19T12:03:05.052304+0000","last_peered":"2024-09-19T12:03:05.052304+0000","last_clean":"2024-09-19T12:03:05.052304+0000","last_became_active":"2024-09-19T11:35:35.623997+0000","last_became_peered":"2024-09-19T11:35:35.623997+0000","last_unstale":"2024-09-19T12:03:05.052304+0000","last_undegraded":"2024-09-19T12:03:05.052304+0000","last_fullsized":"2024-09-19T12:03:05.052304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:39.064327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":628,"num_read_kb":626,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'64","reported_seq":579,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:26.614835+0000","last_change":"2024-09-19T11:35:37.628761+0000","last_active":"2024-09-19T12:01:26.614835+0000","last_peered":"2024-09-19T12:01:26.614835+0000","last_clean":"2024-09-19T12:01:26.614835+0000","last_became_active":"2024-09-19T11:35:37.628124+0000","last_became_peered":"2024-09-19T11:35:37.628124+0000","last_unstale":"2024-09-19T12:01:26.614835+0000","last_undegraded":"2024-09-19T12:01:26.614835+0000","last_fullsized":"2024-09-19T12:01:26.614835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:14.165078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'615","reported_seq":1504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.307146+0000","last_change":"2024-09-19T11:35:39.682448+0000","last_active":"2024-09-19T12:03:05.307146+0000","last_peered":"2024-09-19T12:03:05.307146+0000","last_clean":"2024-09-19T12:03:05.307146+0000","last_became_active":"2024-09-19T11:35:39.681867+0000","last_became_peered":"2024-09-19T11:35:39.681867+0000","last_unstale":"2024-09-19T12:03:05.307146+0000","last_undegraded":"2024-09-19T12:03:05.307146+0000","last_fullsized":"2024-09-19T12:03:05.307146+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:29.322118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'20","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:32.884237+0000","last_change":"2024-09-19T11:35:41.677700+0000","last_active":"2024-09-19T11:59:32.884237+0000","last_peered":"2024-09-19T11:59:32.884237+0000","last_clean":"2024-09-19T11:59:32.884237+0000","last_became_active":"2024-09-19T11:35:41.676988+0000","last_became_peered":"2024-09-19T11:35:41.676988+0000","last_unstale":"2024-09-19T11:59:32.884237+0000","last_undegraded":"2024-09-19T11:59:32.884237+0000","last_fullsized":"2024-09-19T11:59:32.884237+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:02.366492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'23","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.177039+0000","last_change":"2024-09-19T11:35:33.614935+0000","last_active":"2024-09-19T12:02:33.177039+0000","last_peered":"2024-09-19T12:02:33.177039+0000","last_clean":"2024-09-19T12:02:33.177039+0000","last_became_active":"2024-09-19T11:35:33.614168+0000","last_became_peered":"2024-09-19T11:35:33.614168+0000","last_unstale":"2024-09-19T12:02:33.177039+0000","last_undegraded":"2024-09-19T12:02:33.177039+0000","last_fullsized":"2024-09-19T12:02:33.177039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:40.524246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":86,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'51","reported_seq":569,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.895998+0000","last_change":"2024-09-19T11:35:31.611559+0000","last_active":"2024-09-19T12:03:05.895998+0000","last_peered":"2024-09-19T12:03:05.895998+0000","last_clean":"2024-09-19T12:03:05.895998+0000","last_became_active":"2024-09-19T11:35:31.610808+0000","last_became_peered":"2024-09-19T11:35:31.610808+0000","last_unstale":"2024-09-19T12:03:05.895998+0000","last_undegraded":"2024-09-19T12:03:05.895998+0000","last_fullsized":"2024-09-19T12:03:05.895998+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:46.561986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2128531,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":7272,"num_write":187,"num_write_kb":7210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.606549+0000","last_change":"2024-09-19T11:35:35.624368+0000","last_active":"2024-09-19T11:59:46.606549+0000","last_peered":"2024-09-19T11:59:46.606549+0000","last_clean":"2024-09-19T11:59:46.606549+0000","last_became_active":"2024-09-19T11:35:35.623608+0000","last_became_peered":"2024-09-19T11:35:35.623608+0000","last_unstale":"2024-09-19T11:59:46.606549+0000","last_undegraded":"2024-09-19T11:59:46.606549+0000","last_fullsized":"2024-09-19T11:59:46.606549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:32.921728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'67","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.575793+0000","last_change":"2024-09-19T11:35:37.646654+0000","last_active":"2024-09-19T12:03:05.575793+0000","last_peered":"2024-09-19T12:03:05.575793+0000","last_clean":"2024-09-19T12:03:05.575793+0000","last_became_active":"2024-09-19T11:35:37.645933+0000","last_became_peered":"2024-09-19T11:35:37.645933+0000","last_unstale":"2024-09-19T12:03:05.575793+0000","last_undegraded":"2024-09-19T12:03:05.575793+0000","last_fullsized":"2024-09-19T12:03:05.575793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:49.367677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":136,"num_write":66,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'622","reported_seq":1491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.701167+0000","last_change":"2024-09-19T11:35:39.655107+0000","last_active":"2024-09-19T12:03:05.701167+0000","last_peered":"2024-09-19T12:03:05.701167+0000","last_clean":"2024-09-19T12:03:05.701167+0000","last_became_active":"2024-09-19T11:35:39.654205+0000","last_became_peered":"2024-09-19T11:35:39.654205+0000","last_unstale":"2024-09-19T12:03:05.701167+0000","last_undegraded":"2024-09-19T12:03:05.701167+0000","last_fullsized":"2024-09-19T12:03:05.701167+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:09.266023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'23","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.173407+0000","last_change":"2024-09-19T11:35:33.625607+0000","last_active":"2024-09-19T12:02:33.173407+0000","last_peered":"2024-09-19T12:02:33.173407+0000","last_clean":"2024-09-19T12:02:33.173407+0000","last_became_active":"2024-09-19T11:35:33.624883+0000","last_became_peered":"2024-09-19T11:35:33.624883+0000","last_unstale":"2024-09-19T12:02:33.173407+0000","last_undegraded":"2024-09-19T12:02:33.173407+0000","last_fullsized":"2024-09-19T12:02:33.173407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:38.184558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":86,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'37","reported_seq":540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.790282+0000","last_change":"2024-09-19T11:35:31.610576+0000","last_active":"2024-09-19T12:03:05.790282+0000","last_peered":"2024-09-19T12:03:05.790282+0000","last_clean":"2024-09-19T12:03:05.790282+0000","last_became_active":"2024-09-19T11:35:31.609658+0000","last_became_peered":"2024-09-19T11:35:31.609658+0000","last_unstale":"2024-09-19T12:03:05.790282+0000","last_undegraded":"2024-09-19T12:03:05.790282+0000","last_fullsized":"2024-09-19T12:03:05.790282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:27.502371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":54,"num_read_kb":38,"num_write":106,"num_write_kb":5152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.606363+0000","last_change":"2024-09-19T11:35:35.622091+0000","last_active":"2024-09-19T11:59:26.606363+0000","last_peered":"2024-09-19T11:59:26.606363+0000","last_clean":"2024-09-19T11:59:26.606363+0000","last_became_active":"2024-09-19T11:35:35.621170+0000","last_became_peered":"2024-09-19T11:35:35.621170+0000","last_unstale":"2024-09-19T11:59:26.606363+0000","last_undegraded":"2024-09-19T11:59:26.606363+0000","last_fullsized":"2024-09-19T11:59:26.606363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:48.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'121","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.699213+0000","last_change":"2024-09-19T11:35:37.636324+0000","last_active":"2024-09-19T12:03:05.699213+0000","last_peered":"2024-09-19T12:03:05.699213+0000","last_clean":"2024-09-19T12:03:05.699213+0000","last_became_active":"2024-09-19T11:35:37.635359+0000","last_became_peered":"2024-09-19T11:35:37.635359+0000","last_unstale":"2024-09-19T12:03:05.699213+0000","last_undegraded":"2024-09-19T12:03:05.699213+0000","last_fullsized":"2024-09-19T12:03:05.699213+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:43.517566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4817,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":176,"num_read_kb":225,"num_write":122,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603640+0000","last_change":"2024-09-19T11:35:39.683859+0000","last_active":"2024-09-19T12:00:26.603640+0000","last_peered":"2024-09-19T12:00:26.603640+0000","last_clean":"2024-09-19T12:00:26.603640+0000","last_became_active":"2024-09-19T11:35:39.683300+0000","last_became_peered":"2024-09-19T11:35:39.683300+0000","last_unstale":"2024-09-19T12:00:26.603640+0000","last_undegraded":"2024-09-19T12:00:26.603640+0000","last_fullsized":"2024-09-19T12:00:26.603640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:56.978681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'6","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619273+0000","last_change":"2024-09-19T11:35:41.685251+0000","last_active":"2024-09-19T12:00:41.619273+0000","last_peered":"2024-09-19T12:00:41.619273+0000","last_clean":"2024-09-19T12:00:41.619273+0000","last_became_active":"2024-09-19T11:35:41.684698+0000","last_became_peered":"2024-09-19T11:35:41.684698+0000","last_unstale":"2024-09-19T12:00:41.619273+0000","last_undegraded":"2024-09-19T12:00:41.619273+0000","last_fullsized":"2024-09-19T12:00:41.619273+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:43.679226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'9","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:36.824293+0000","last_change":"2024-09-19T11:35:33.618465+0000","last_active":"2024-09-19T12:01:36.824293+0000","last_peered":"2024-09-19T12:01:36.824293+0000","last_clean":"2024-09-19T12:01:36.824293+0000","last_became_active":"2024-09-19T11:35:33.617778+0000","last_became_peered":"2024-09-19T11:35:33.617778+0000","last_unstale":"2024-09-19T12:01:36.824293+0000","last_undegraded":"2024-09-19T12:01:36.824293+0000","last_fullsized":"2024-09-19T12:01:36.824293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:44.417211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":12,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'64","reported_seq":582,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.873076+0000","last_change":"2024-09-19T11:35:31.609984+0000","last_active":"2024-09-19T12:03:05.873076+0000","last_peered":"2024-09-19T12:03:05.873076+0000","last_clean":"2024-09-19T12:03:05.873076+0000","last_became_active":"2024-09-19T11:35:31.609243+0000","last_became_peered":"2024-09-19T11:35:31.609243+0000","last_unstale":"2024-09-19T12:03:05.873076+0000","last_undegraded":"2024-09-19T12:03:05.873076+0000","last_fullsized":"2024-09-19T12:03:05.873076+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:56.221017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":103,"num_read_kb":6258,"num_write":261,"num_write_kb":6195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.590189+0000","last_change":"2024-09-19T11:35:35.618693+0000","last_active":"2024-09-19T11:59:26.590189+0000","last_peered":"2024-09-19T11:59:26.590189+0000","last_clean":"2024-09-19T11:59:26.590189+0000","last_became_active":"2024-09-19T11:35:35.617934+0000","last_became_peered":"2024-09-19T11:35:35.617934+0000","last_unstale":"2024-09-19T11:59:26.590189+0000","last_undegraded":"2024-09-19T11:59:26.590189+0000","last_fullsized":"2024-09-19T11:59:26.590189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:47.062252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'67","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.903208+0000","last_change":"2024-09-19T11:35:37.643864+0000","last_active":"2024-09-19T12:03:05.903208+0000","last_peered":"2024-09-19T12:03:05.903208+0000","last_clean":"2024-09-19T12:03:05.903208+0000","last_became_active":"2024-09-19T11:35:37.643236+0000","last_became_peered":"2024-09-19T11:35:37.643236+0000","last_unstale":"2024-09-19T12:03:05.903208+0000","last_undegraded":"2024-09-19T12:03:05.903208+0000","last_fullsized":"2024-09-19T12:03:05.903208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:47.647100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":101,"num_read_kb":192,"num_write":78,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.600120+0000","last_change":"2024-09-19T11:35:39.653781+0000","last_active":"2024-09-19T11:59:36.600120+0000","last_peered":"2024-09-19T11:59:36.600120+0000","last_clean":"2024-09-19T11:59:36.600120+0000","last_became_active":"2024-09-19T11:35:39.652920+0000","last_became_peered":"2024-09-19T11:35:39.652920+0000","last_unstale":"2024-09-19T11:59:36.600120+0000","last_undegraded":"2024-09-19T11:59:36.600120+0000","last_fullsized":"2024-09-19T11:59:36.600120+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:26.583277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'12","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:46.620891+0000","last_change":"2024-09-19T11:35:41.678791+0000","last_active":"2024-09-19T12:00:46.620891+0000","last_peered":"2024-09-19T12:00:46.620891+0000","last_clean":"2024-09-19T12:00:46.620891+0000","last_became_active":"2024-09-19T11:35:41.678055+0000","last_became_peered":"2024-09-19T11:35:41.678055+0000","last_unstale":"2024-09-19T12:00:46.620891+0000","last_undegraded":"2024-09-19T12:00:46.620891+0000","last_fullsized":"2024-09-19T12:00:46.620891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:27.826190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":59,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'46","reported_seq":556,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.008451+0000","last_change":"2024-09-19T11:35:33.624918+0000","last_active":"2024-09-19T12:02:32.008451+0000","last_peered":"2024-09-19T12:02:32.008451+0000","last_clean":"2024-09-19T12:02:32.008451+0000","last_became_active":"2024-09-19T11:35:33.624015+0000","last_became_peered":"2024-09-19T11:35:33.624015+0000","last_unstale":"2024-09-19T12:02:32.008451+0000","last_undegraded":"2024-09-19T12:02:32.008451+0000","last_fullsized":"2024-09-19T12:02:32.008451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:06.414742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":170,"num_write":76,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'56","reported_seq":579,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.862237+0000","last_change":"2024-09-19T11:35:31.627788+0000","last_active":"2024-09-19T12:03:05.862237+0000","last_peered":"2024-09-19T12:03:05.862237+0000","last_clean":"2024-09-19T12:03:05.862237+0000","last_became_active":"2024-09-19T11:35:31.627232+0000","last_became_peered":"2024-09-19T11:35:31.627232+0000","last_unstale":"2024-09-19T12:03:05.862237+0000","last_undegraded":"2024-09-19T12:03:05.862237+0000","last_fullsized":"2024-09-19T12:03:05.862237+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:49.266566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":114,"num_read_kb":6226,"num_write":211,"num_write_kb":11300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.601938+0000","last_change":"2024-09-19T11:35:35.624395+0000","last_active":"2024-09-19T12:00:21.601938+0000","last_peered":"2024-09-19T12:00:21.601938+0000","last_clean":"2024-09-19T12:00:21.601938+0000","last_became_active":"2024-09-19T11:35:35.623852+0000","last_became_peered":"2024-09-19T11:35:35.623852+0000","last_unstale":"2024-09-19T12:00:21.601938+0000","last_undegraded":"2024-09-19T12:00:21.601938+0000","last_fullsized":"2024-09-19T12:00:21.601938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:40.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'76","reported_seq":585,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.728361+0000","last_change":"2024-09-19T11:35:37.641622+0000","last_active":"2024-09-19T12:03:05.728361+0000","last_peered":"2024-09-19T12:03:05.728361+0000","last_clean":"2024-09-19T12:03:05.728361+0000","last_became_active":"2024-09-19T11:35:37.640906+0000","last_became_peered":"2024-09-19T11:35:37.640906+0000","last_unstale":"2024-09-19T12:03:05.728361+0000","last_undegraded":"2024-09-19T12:03:05.728361+0000","last_fullsized":"2024-09-19T12:03:05.728361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:36.736085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":103,"num_read_kb":144,"num_write":72,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'616","reported_seq":1456,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.502971+0000","last_change":"2024-09-19T11:35:39.673666+0000","last_active":"2024-09-19T12:03:05.502971+0000","last_peered":"2024-09-19T12:03:05.502971+0000","last_clean":"2024-09-19T12:03:05.502971+0000","last_became_active":"2024-09-19T11:35:39.672054+0000","last_became_peered":"2024-09-19T11:35:39.672054+0000","last_unstale":"2024-09-19T12:03:05.502971+0000","last_undegraded":"2024-09-19T12:03:05.502971+0000","last_fullsized":"2024-09-19T12:03:05.502971+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":600,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:26.938497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'4","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.604432+0000","last_change":"2024-09-19T11:35:41.696920+0000","last_active":"2024-09-19T11:59:31.604432+0000","last_peered":"2024-09-19T11:59:31.604432+0000","last_clean":"2024-09-19T11:59:31.604432+0000","last_became_active":"2024-09-19T11:35:41.693623+0000","last_became_peered":"2024-09-19T11:35:41.693623+0000","last_unstale":"2024-09-19T11:59:31.604432+0000","last_undegraded":"2024-09-19T11:59:31.604432+0000","last_fullsized":"2024-09-19T11:59:31.604432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:36:17.971489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'3","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.616177+0000","last_change":"2024-09-19T11:35:33.620540+0000","last_active":"2024-09-19T12:00:21.616177+0000","last_peered":"2024-09-19T12:00:21.616177+0000","last_clean":"2024-09-19T12:00:21.616177+0000","last_became_active":"2024-09-19T11:35:33.620252+0000","last_became_peered":"2024-09-19T11:35:33.620252+0000","last_unstale":"2024-09-19T12:00:21.616177+0000","last_undegraded":"2024-09-19T12:00:21.616177+0000","last_fullsized":"2024-09-19T12:00:21.616177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:59.675080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'28","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.747553+0000","last_change":"2024-09-19T11:35:31.606672+0000","last_active":"2024-09-19T12:03:05.747553+0000","last_peered":"2024-09-19T12:03:05.747553+0000","last_clean":"2024-09-19T12:03:05.747553+0000","last_became_active":"2024-09-19T11:35:31.606137+0000","last_became_peered":"2024-09-19T11:35:31.606137+0000","last_unstale":"2024-09-19T12:03:05.747553+0000","last_undegraded":"2024-09-19T12:03:05.747553+0000","last_fullsized":"2024-09-19T12:03:05.747553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:46.025619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":99,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.591409+0000","last_change":"2024-09-19T11:35:35.620661+0000","last_active":"2024-09-19T11:59:31.591409+0000","last_peered":"2024-09-19T11:59:31.591409+0000","last_clean":"2024-09-19T11:59:31.591409+0000","last_became_active":"2024-09-19T11:35:35.619995+0000","last_became_peered":"2024-09-19T11:35:35.619995+0000","last_unstale":"2024-09-19T11:59:31.591409+0000","last_undegraded":"2024-09-19T11:59:31.591409+0000","last_fullsized":"2024-09-19T11:59:31.591409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:20.831305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'99","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.951104+0000","last_change":"2024-09-19T11:35:37.647073+0000","last_active":"2024-09-19T12:03:05.951104+0000","last_peered":"2024-09-19T12:03:05.951104+0000","last_clean":"2024-09-19T12:03:05.951104+0000","last_became_active":"2024-09-19T11:35:37.646446+0000","last_became_peered":"2024-09-19T11:35:37.646446+0000","last_unstale":"2024-09-19T12:03:05.951104+0000","last_undegraded":"2024-09-19T12:03:05.951104+0000","last_fullsized":"2024-09-19T12:03:05.951104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:26.769867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":252,"num_write":102,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.591328+0000","last_change":"2024-09-19T11:35:39.658936+0000","last_active":"2024-09-19T11:59:31.591328+0000","last_peered":"2024-09-19T11:59:31.591328+0000","last_clean":"2024-09-19T11:59:31.591328+0000","last_became_active":"2024-09-19T11:35:39.658173+0000","last_became_peered":"2024-09-19T11:35:39.658173+0000","last_unstale":"2024-09-19T11:59:31.591328+0000","last_undegraded":"2024-09-19T11:59:31.591328+0000","last_fullsized":"2024-09-19T11:59:31.591328+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:40.200085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'7","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.993549+0000","last_change":"2024-09-19T11:35:41.679566+0000","last_active":"2024-09-19T12:02:32.993549+0000","last_peered":"2024-09-19T12:02:32.993549+0000","last_clean":"2024-09-19T12:02:32.993549+0000","last_became_active":"2024-09-19T11:35:41.678765+0000","last_became_peered":"2024-09-19T11:35:41.678765+0000","last_unstale":"2024-09-19T12:02:32.993549+0000","last_undegraded":"2024-09-19T12:02:32.993549+0000","last_fullsized":"2024-09-19T12:02:32.993549+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:11.159416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":41,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'2","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.727132+0000","last_change":"2024-09-19T11:35:33.613035+0000","last_active":"2024-09-19T12:02:17.727132+0000","last_peered":"2024-09-19T12:02:17.727132+0000","last_clean":"2024-09-19T12:02:17.727132+0000","last_became_active":"2024-09-19T11:35:33.612279+0000","last_became_peered":"2024-09-19T11:35:33.612279+0000","last_unstale":"2024-09-19T12:02:17.727132+0000","last_undegraded":"2024-09-19T12:02:17.727132+0000","last_fullsized":"2024-09-19T12:02:17.727132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:21.396428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'100","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.828032+0000","last_change":"2024-09-19T11:35:31.584569+0000","last_active":"2024-09-19T12:03:05.828032+0000","last_peered":"2024-09-19T12:03:05.828032+0000","last_clean":"2024-09-19T12:03:05.828032+0000","last_became_active":"2024-09-19T11:35:31.584188+0000","last_became_peered":"2024-09-19T11:35:31.584188+0000","last_unstale":"2024-09-19T12:03:05.828032+0000","last_undegraded":"2024-09-19T12:03:05.828032+0000","last_fullsized":"2024-09-19T12:03:05.828032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:54.139090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":280,"num_read_kb":3453,"num_write":516,"num_write_kb":3250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.602050+0000","last_change":"2024-09-19T11:35:35.615386+0000","last_active":"2024-09-19T12:00:21.602050+0000","last_peered":"2024-09-19T12:00:21.602050+0000","last_clean":"2024-09-19T12:00:21.602050+0000","last_became_active":"2024-09-19T11:35:35.614650+0000","last_became_peered":"2024-09-19T11:35:35.614650+0000","last_unstale":"2024-09-19T12:00:21.602050+0000","last_undegraded":"2024-09-19T12:00:21.602050+0000","last_fullsized":"2024-09-19T12:00:21.602050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:10.129352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'78","reported_seq":584,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.958138+0000","last_change":"2024-09-19T11:35:37.632361+0000","last_active":"2024-09-19T12:03:05.958138+0000","last_peered":"2024-09-19T12:03:05.958138+0000","last_clean":"2024-09-19T12:03:05.958138+0000","last_became_active":"2024-09-19T11:35:37.624951+0000","last_became_peered":"2024-09-19T11:35:37.624951+0000","last_unstale":"2024-09-19T12:03:05.958138+0000","last_undegraded":"2024-09-19T12:03:05.958138+0000","last_fullsized":"2024-09-19T12:03:05.958138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:24.797414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4425,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":175,"num_write":138,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":475,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.618781+0000","last_change":"2024-09-19T11:35:39.671990+0000","last_active":"2024-09-19T12:00:31.618781+0000","last_peered":"2024-09-19T12:00:31.618781+0000","last_clean":"2024-09-19T12:00:31.618781+0000","last_became_active":"2024-09-19T11:35:39.671181+0000","last_became_peered":"2024-09-19T11:35:39.671181+0000","last_unstale":"2024-09-19T12:00:31.618781+0000","last_undegraded":"2024-09-19T12:00:31.618781+0000","last_fullsized":"2024-09-19T12:00:31.618781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:41.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'18","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.602486+0000","last_change":"2024-09-19T11:35:41.685909+0000","last_active":"2024-09-19T11:59:46.602486+0000","last_peered":"2024-09-19T11:59:46.602486+0000","last_clean":"2024-09-19T11:59:46.602486+0000","last_became_active":"2024-09-19T11:35:41.684966+0000","last_became_peered":"2024-09-19T11:35:41.684966+0000","last_unstale":"2024-09-19T11:59:46.602486+0000","last_undegraded":"2024-09-19T11:59:46.602486+0000","last_fullsized":"2024-09-19T11:59:46.602486+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:36.205278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":94,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'76","reported_seq":577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807509+0000","last_change":"2024-09-19T11:35:33.615010+0000","last_active":"2024-09-19T12:00:21.807509+0000","last_peered":"2024-09-19T12:00:21.807509+0000","last_clean":"2024-09-19T12:00:21.807509+0000","last_became_active":"2024-09-19T11:35:33.613369+0000","last_became_peered":"2024-09-19T11:35:33.613369+0000","last_unstale":"2024-09-19T12:00:21.807509+0000","last_undegraded":"2024-09-19T12:00:21.807509+0000","last_fullsized":"2024-09-19T12:00:21.807509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:13.047628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":221,"num_write":116,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'36","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.669122+0000","last_change":"2024-09-19T11:36:06.676047+0000","last_active":"2024-09-19T12:03:05.669122+0000","last_peered":"2024-09-19T12:03:05.669122+0000","last_clean":"2024-09-19T12:03:05.669122+0000","last_became_active":"2024-09-19T11:36:06.674998+0000","last_became_peered":"2024-09-19T11:36:06.674998+0000","last_unstale":"2024-09-19T12:03:05.669122+0000","last_undegraded":"2024-09-19T12:03:05.669122+0000","last_fullsized":"2024-09-19T12:03:05.669122+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:32.710592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159858,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":7484,"num_write":135,"num_write_kb":7462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,7],"acting":[2,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.602482+0000","last_change":"2024-09-19T11:35:35.632289+0000","last_active":"2024-09-19T12:00:21.602482+0000","last_peered":"2024-09-19T12:00:21.602482+0000","last_clean":"2024-09-19T12:00:21.602482+0000","last_became_active":"2024-09-19T11:35:35.631702+0000","last_became_peered":"2024-09-19T11:35:35.631702+0000","last_unstale":"2024-09-19T12:00:21.602482+0000","last_undegraded":"2024-09-19T12:00:21.602482+0000","last_fullsized":"2024-09-19T12:00:21.602482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:14.196241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'79","reported_seq":594,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.855566+0000","last_change":"2024-09-19T11:35:37.628795+0000","last_active":"2024-09-19T12:03:05.855566+0000","last_peered":"2024-09-19T12:03:05.855566+0000","last_clean":"2024-09-19T12:03:05.855566+0000","last_became_active":"2024-09-19T11:35:37.627720+0000","last_became_peered":"2024-09-19T11:35:37.627720+0000","last_unstale":"2024-09-19T12:03:05.855566+0000","last_undegraded":"2024-09-19T12:03:05.855566+0000","last_fullsized":"2024-09-19T12:03:05.855566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:36.397426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":113,"num_read_kb":175,"num_write":82,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'617","reported_seq":1628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.315965+0000","last_change":"2024-09-19T11:35:39.651921+0000","last_active":"2024-09-19T12:03:05.315965+0000","last_peered":"2024-09-19T12:03:05.315965+0000","last_clean":"2024-09-19T12:03:05.315965+0000","last_became_active":"2024-09-19T11:35:39.651203+0000","last_became_peered":"2024-09-19T11:35:39.651203+0000","last_unstale":"2024-09-19T12:03:05.315965+0000","last_undegraded":"2024-09-19T12:03:05.315965+0000","last_fullsized":"2024-09-19T12:03:05.315965+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:01.951944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'8","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607324+0000","last_change":"2024-09-19T11:35:41.691885+0000","last_active":"2024-09-19T12:00:41.607324+0000","last_peered":"2024-09-19T12:00:41.607324+0000","last_clean":"2024-09-19T12:00:41.607324+0000","last_became_active":"2024-09-19T11:35:41.691146+0000","last_became_peered":"2024-09-19T11:35:41.691146+0000","last_unstale":"2024-09-19T12:00:41.607324+0000","last_undegraded":"2024-09-19T12:00:41.607324+0000","last_fullsized":"2024-09-19T12:00:41.607324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:13.054334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":44,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'23","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807571+0000","last_change":"2024-09-19T11:35:33.628948+0000","last_active":"2024-09-19T12:00:21.807571+0000","last_peered":"2024-09-19T12:00:21.807571+0000","last_clean":"2024-09-19T12:00:21.807571+0000","last_became_active":"2024-09-19T11:35:33.628232+0000","last_became_peered":"2024-09-19T11:35:33.628232+0000","last_unstale":"2024-09-19T12:00:21.807571+0000","last_undegraded":"2024-09-19T12:00:21.807571+0000","last_fullsized":"2024-09-19T12:00:21.807571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:54.904056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'45","reported_seq":560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.890613+0000","last_change":"2024-09-19T11:35:31.584516+0000","last_active":"2024-09-19T12:03:05.890613+0000","last_peered":"2024-09-19T12:03:05.890613+0000","last_clean":"2024-09-19T12:03:05.890613+0000","last_became_active":"2024-09-19T11:35:31.583509+0000","last_became_peered":"2024-09-19T11:35:31.583509+0000","last_unstale":"2024-09-19T12:03:05.890613+0000","last_undegraded":"2024-09-19T12:03:05.890613+0000","last_fullsized":"2024-09-19T12:03:05.890613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:18.443812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":273,"num_write":141,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1308,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.059604+0000","last_change":"2024-09-19T11:35:35.630576+0000","last_active":"2024-09-19T12:03:05.059604+0000","last_peered":"2024-09-19T12:03:05.059604+0000","last_clean":"2024-09-19T12:03:05.059604+0000","last_became_active":"2024-09-19T11:35:35.629728+0000","last_became_peered":"2024-09-19T11:35:35.629728+0000","last_unstale":"2024-09-19T12:03:05.059604+0000","last_undegraded":"2024-09-19T12:03:05.059604+0000","last_fullsized":"2024-09-19T12:03:05.059604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:45.444265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":824,"num_read_kb":824,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'34","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611679+0000","last_change":"2024-09-19T11:35:37.618793+0000","last_active":"2024-09-19T12:00:26.611679+0000","last_peered":"2024-09-19T12:00:26.611679+0000","last_clean":"2024-09-19T12:00:26.611679+0000","last_became_active":"2024-09-19T11:35:37.618061+0000","last_became_peered":"2024-09-19T11:35:37.618061+0000","last_unstale":"2024-09-19T12:00:26.611679+0000","last_undegraded":"2024-09-19T12:00:26.611679+0000","last_fullsized":"2024-09-19T12:00:26.611679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:25.182817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'617","reported_seq":1668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.313355+0000","last_change":"2024-09-19T11:35:39.670880+0000","last_active":"2024-09-19T12:03:05.313355+0000","last_peered":"2024-09-19T12:03:05.313355+0000","last_clean":"2024-09-19T12:03:05.313355+0000","last_became_active":"2024-09-19T11:35:39.670211+0000","last_became_peered":"2024-09-19T11:35:39.670211+0000","last_unstale":"2024-09-19T12:03:05.313355+0000","last_undegraded":"2024-09-19T12:03:05.313355+0000","last_fullsized":"2024-09-19T12:03:05.313355+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:33.137968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'12","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812121+0000","last_change":"2024-09-19T11:35:41.688504+0000","last_active":"2024-09-19T12:00:41.812121+0000","last_peered":"2024-09-19T12:00:41.812121+0000","last_clean":"2024-09-19T12:00:41.812121+0000","last_became_active":"2024-09-19T11:35:41.687793+0000","last_became_peered":"2024-09-19T11:35:41.687793+0000","last_unstale":"2024-09-19T12:00:41.812121+0000","last_undegraded":"2024-09-19T12:00:41.812121+0000","last_fullsized":"2024-09-19T12:00:41.812121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:01.111100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":22,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'40","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603842+0000","last_change":"2024-09-19T11:35:33.603329+0000","last_active":"2024-09-19T12:00:26.603842+0000","last_peered":"2024-09-19T12:00:26.603842+0000","last_clean":"2024-09-19T12:00:26.603842+0000","last_became_active":"2024-09-19T11:35:33.602988+0000","last_became_peered":"2024-09-19T11:35:33.602988+0000","last_unstale":"2024-09-19T12:00:26.603842+0000","last_undegraded":"2024-09-19T12:00:26.603842+0000","last_fullsized":"2024-09-19T12:00:26.603842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:22.788235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":120,"num_write":65,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'40","reported_seq":562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.715184+0000","last_change":"2024-09-19T11:36:06.676997+0000","last_active":"2024-09-19T12:03:05.715184+0000","last_peered":"2024-09-19T12:03:05.715184+0000","last_clean":"2024-09-19T12:03:05.715184+0000","last_became_active":"2024-09-19T11:36:06.675863+0000","last_became_peered":"2024-09-19T11:36:06.675863+0000","last_unstale":"2024-09-19T12:03:05.715184+0000","last_undegraded":"2024-09-19T12:03:05.715184+0000","last_fullsized":"2024-09-19T12:03:05.715184+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:09.211491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":74,"num_read_kb":59,"num_write":161,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807544+0000","last_change":"2024-09-19T11:35:35.624735+0000","last_active":"2024-09-19T12:00:21.807544+0000","last_peered":"2024-09-19T12:00:21.807544+0000","last_clean":"2024-09-19T12:00:21.807544+0000","last_became_active":"2024-09-19T11:35:35.623987+0000","last_became_peered":"2024-09-19T11:35:35.623987+0000","last_unstale":"2024-09-19T12:00:21.807544+0000","last_undegraded":"2024-09-19T12:00:21.807544+0000","last_fullsized":"2024-09-19T12:00:21.807544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:01.328886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'115","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.655776+0000","last_change":"2024-09-19T11:35:37.628778+0000","last_active":"2024-09-19T12:03:05.655776+0000","last_peered":"2024-09-19T12:03:05.655776+0000","last_clean":"2024-09-19T12:03:05.655776+0000","last_became_active":"2024-09-19T11:35:37.627374+0000","last_became_peered":"2024-09-19T11:35:37.627374+0000","last_unstale":"2024-09-19T12:03:05.655776+0000","last_undegraded":"2024-09-19T12:03:05.655776+0000","last_fullsized":"2024-09-19T12:03:05.655776+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:40.224279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4881,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":162,"num_read_kb":205,"num_write":112,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.616096+0000","last_change":"2024-09-19T11:35:39.666833+0000","last_active":"2024-09-19T12:00:26.616096+0000","last_peered":"2024-09-19T12:00:26.616096+0000","last_clean":"2024-09-19T12:00:26.616096+0000","last_became_active":"2024-09-19T11:35:39.666071+0000","last_became_peered":"2024-09-19T11:35:39.666071+0000","last_unstale":"2024-09-19T12:00:26.616096+0000","last_undegraded":"2024-09-19T12:00:26.616096+0000","last_fullsized":"2024-09-19T12:00:26.616096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:55.544445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"253'10","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607413+0000","last_change":"2024-09-19T11:35:41.681654+0000","last_active":"2024-09-19T12:00:41.607413+0000","last_peered":"2024-09-19T12:00:41.607413+0000","last_clean":"2024-09-19T12:00:41.607413+0000","last_became_active":"2024-09-19T11:35:41.680850+0000","last_became_peered":"2024-09-19T11:35:41.680850+0000","last_unstale":"2024-09-19T12:00:41.607413+0000","last_undegraded":"2024-09-19T12:00:41.607413+0000","last_fullsized":"2024-09-19T12:00:41.607413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:38.701888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":41,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'9","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619799+0000","last_change":"2024-09-19T11:35:33.633360+0000","last_active":"2024-09-19T12:00:41.619799+0000","last_peered":"2024-09-19T12:00:41.619799+0000","last_clean":"2024-09-19T12:00:41.619799+0000","last_became_active":"2024-09-19T11:35:33.632623+0000","last_became_peered":"2024-09-19T11:35:33.632623+0000","last_unstale":"2024-09-19T12:00:41.619799+0000","last_undegraded":"2024-09-19T12:00:41.619799+0000","last_fullsized":"2024-09-19T12:00:41.619799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:21.511371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:21.605222+0000","last_change":"2024-09-19T11:35:14.134637+0000","last_active":"2024-09-19T11:59:21.605222+0000","last_peered":"2024-09-19T11:59:21.605222+0000","last_clean":"2024-09-19T11:59:21.605222+0000","last_became_active":"2024-09-19T11:35:14.133710+0000","last_became_peered":"2024-09-19T11:35:14.133710+0000","last_unstale":"2024-09-19T11:59:21.605222+0000","last_undegraded":"2024-09-19T11:59:21.605222+0000","last_fullsized":"2024-09-19T11:59:21.605222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:13.080179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:13.080179+0000","last_clean_scrub_stamp":"2024-09-19T11:35:13.080179+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:26.810969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.614213+0000","last_change":"2024-09-19T11:35:21.174817+0000","last_active":"2024-09-19T12:00:21.614213+0000","last_peered":"2024-09-19T12:00:21.614213+0000","last_clean":"2024-09-19T12:00:21.614213+0000","last_became_active":"2024-09-19T11:35:19.150393+0000","last_became_peered":"2024-09-19T11:35:19.150393+0000","last_unstale":"2024-09-19T12:00:21.614213+0000","last_undegraded":"2024-09-19T12:00:21.614213+0000","last_fullsized":"2024-09-19T12:00:21.614213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:35.259610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001387466,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'66","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.849544+0000","last_change":"2024-09-19T11:35:31.593431+0000","last_active":"2024-09-19T12:03:05.849544+0000","last_peered":"2024-09-19T12:03:05.849544+0000","last_clean":"2024-09-19T12:03:05.849544+0000","last_became_active":"2024-09-19T11:35:31.592913+0000","last_became_peered":"2024-09-19T11:35:31.592913+0000","last_unstale":"2024-09-19T12:03:05.849544+0000","last_undegraded":"2024-09-19T12:03:05.849544+0000","last_fullsized":"2024-09-19T12:03:05.849544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:24:42.956900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":2042,"num_write":253,"num_write_kb":1946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.621462+0000","last_change":"2024-09-19T11:35:35.603629+0000","last_active":"2024-09-19T12:00:36.621462+0000","last_peered":"2024-09-19T12:00:36.621462+0000","last_clean":"2024-09-19T12:00:36.621462+0000","last_became_active":"2024-09-19T11:35:35.602892+0000","last_became_peered":"2024-09-19T11:35:35.602892+0000","last_unstale":"2024-09-19T12:00:36.621462+0000","last_undegraded":"2024-09-19T12:00:36.621462+0000","last_fullsized":"2024-09-19T12:00:36.621462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:06.994180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'187","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.816235+0000","last_change":"2024-09-19T11:35:37.638436+0000","last_active":"2024-09-19T12:03:05.816235+0000","last_peered":"2024-09-19T12:03:05.816235+0000","last_clean":"2024-09-19T12:03:05.816235+0000","last_became_active":"2024-09-19T11:35:37.636399+0000","last_became_peered":"2024-09-19T11:35:37.636399+0000","last_unstale":"2024-09-19T12:03:05.816235+0000","last_undegraded":"2024-09-19T12:03:05.816235+0000","last_fullsized":"2024-09-19T12:03:05.816235+0000","mapping_epoch":32,"log_start":"262'100","ondisk_log_start":"262'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:14:07.861992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17019,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":284,"num_read_kb":496,"num_write":256,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":475,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.604407+0000","last_change":"2024-09-19T11:35:39.681040+0000","last_active":"2024-09-19T11:59:31.604407+0000","last_peered":"2024-09-19T11:59:31.604407+0000","last_clean":"2024-09-19T11:59:31.604407+0000","last_became_active":"2024-09-19T11:35:39.680298+0000","last_became_peered":"2024-09-19T11:35:39.680298+0000","last_unstale":"2024-09-19T11:59:31.604407+0000","last_undegraded":"2024-09-19T11:59:31.604407+0000","last_fullsized":"2024-09-19T11:59:31.604407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:52.699540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'52","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.766635+0000","last_change":"2024-09-19T11:35:41.679956+0000","last_active":"2024-09-19T12:02:19.766635+0000","last_peered":"2024-09-19T12:02:19.766635+0000","last_clean":"2024-09-19T12:02:19.766635+0000","last_became_active":"2024-09-19T11:35:41.679219+0000","last_became_peered":"2024-09-19T11:35:41.679219+0000","last_unstale":"2024-09-19T12:02:19.766635+0000","last_undegraded":"2024-09-19T12:02:19.766635+0000","last_fullsized":"2024-09-19T12:02:19.766635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:30.335832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":334,"num_read_kb":278,"num_write":121,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'139","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.179765+0000","last_change":"2024-09-19T11:35:33.624017+0000","last_active":"2024-09-19T12:02:33.179765+0000","last_peered":"2024-09-19T12:02:33.179765+0000","last_clean":"2024-09-19T12:02:33.179765+0000","last_became_active":"2024-09-19T11:35:33.622065+0000","last_became_peered":"2024-09-19T11:35:33.622065+0000","last_unstale":"2024-09-19T12:02:33.179765+0000","last_undegraded":"2024-09-19T12:02:33.179765+0000","last_fullsized":"2024-09-19T12:02:33.179765+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.917346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":557,"num_read_kb":440,"num_write":210,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.606297+0000","last_change":"2024-09-19T11:35:21.463140+0000","last_active":"2024-09-19T11:59:26.606297+0000","last_peered":"2024-09-19T11:59:26.606297+0000","last_clean":"2024-09-19T11:59:26.606297+0000","last_became_active":"2024-09-19T11:35:19.154360+0000","last_became_peered":"2024-09-19T11:35:19.154360+0000","last_unstale":"2024-09-19T11:59:26.606297+0000","last_undegraded":"2024-09-19T11:59:26.606297+0000","last_fullsized":"2024-09-19T11:59:26.606297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:59.779314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086516000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'39","reported_seq":555,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.863174+0000","last_change":"2024-09-19T11:36:06.678664+0000","last_active":"2024-09-19T12:03:05.863174+0000","last_peered":"2024-09-19T12:03:05.863174+0000","last_clean":"2024-09-19T12:03:05.863174+0000","last_became_active":"2024-09-19T11:36:06.677474+0000","last_became_peered":"2024-09-19T11:36:06.677474+0000","last_unstale":"2024-09-19T12:03:05.863174+0000","last_undegraded":"2024-09-19T12:03:05.863174+0000","last_fullsized":"2024-09-19T12:03:05.863174+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:18.377791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":49,"num_write":146,"num_write_kb":5149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,5],"acting":[0,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.601906+0000","last_change":"2024-09-19T11:35:35.618073+0000","last_active":"2024-09-19T11:59:26.601906+0000","last_peered":"2024-09-19T11:59:26.601906+0000","last_clean":"2024-09-19T11:59:26.601906+0000","last_became_active":"2024-09-19T11:35:35.616382+0000","last_became_peered":"2024-09-19T11:35:35.616382+0000","last_unstale":"2024-09-19T11:59:26.601906+0000","last_undegraded":"2024-09-19T11:59:26.601906+0000","last_fullsized":"2024-09-19T11:59:26.601906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:08.281218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'570","reported_seq":1628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.917885+0000","last_change":"2024-09-19T11:35:37.641209+0000","last_active":"2024-09-19T12:03:05.917885+0000","last_peered":"2024-09-19T12:03:05.917885+0000","last_clean":"2024-09-19T12:03:05.917885+0000","last_became_active":"2024-09-19T11:35:37.640355+0000","last_became_peered":"2024-09-19T11:35:37.640355+0000","last_unstale":"2024-09-19T12:03:05.917885+0000","last_undegraded":"2024-09-19T12:03:05.917885+0000","last_fullsized":"2024-09-19T12:03:05.917885+0000","mapping_epoch":32,"log_start":"264'501","ondisk_log_start":"264'501","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":501,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:53.345519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13007,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":828,"num_read_kb":979,"num_write":162,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:46.623781+0000","last_change":"2024-09-19T11:35:39.676564+0000","last_active":"2024-09-19T12:00:46.623781+0000","last_peered":"2024-09-19T12:00:46.623781+0000","last_clean":"2024-09-19T12:00:46.623781+0000","last_became_active":"2024-09-19T11:35:39.675795+0000","last_became_peered":"2024-09-19T11:35:39.675795+0000","last_unstale":"2024-09-19T12:00:46.623781+0000","last_undegraded":"2024-09-19T12:00:46.623781+0000","last_fullsized":"2024-09-19T12:00:46.623781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:43.633195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'10","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.592039+0000","last_change":"2024-09-19T11:35:41.679366+0000","last_active":"2024-09-19T11:59:36.592039+0000","last_peered":"2024-09-19T11:59:36.592039+0000","last_clean":"2024-09-19T11:59:36.592039+0000","last_became_active":"2024-09-19T11:35:41.678660+0000","last_became_peered":"2024-09-19T11:35:41.678660+0000","last_unstale":"2024-09-19T11:59:36.592039+0000","last_undegraded":"2024-09-19T11:59:36.592039+0000","last_fullsized":"2024-09-19T11:59:36.592039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:59.286098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'21","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.596686+0000","last_change":"2024-09-19T11:36:06.674126+0000","last_active":"2024-09-19T11:59:56.596686+0000","last_peered":"2024-09-19T11:59:56.596686+0000","last_clean":"2024-09-19T11:59:56.596686+0000","last_became_active":"2024-09-19T11:36:06.673265+0000","last_became_peered":"2024-09-19T11:36:06.673265+0000","last_unstale":"2024-09-19T11:59:56.596686+0000","last_undegraded":"2024-09-19T11:59:56.596686+0000","last_fullsized":"2024-09-19T11:59:56.596686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:39.951937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":39,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.601866+0000","last_change":"2024-09-19T11:35:21.169499+0000","last_active":"2024-09-19T12:00:21.601866+0000","last_peered":"2024-09-19T12:00:21.601866+0000","last_clean":"2024-09-19T12:00:21.601866+0000","last_became_active":"2024-09-19T11:35:19.969368+0000","last_became_peered":"2024-09-19T11:35:19.969368+0000","last_unstale":"2024-09-19T12:00:21.601866+0000","last_undegraded":"2024-09-19T12:00:21.601866+0000","last_fullsized":"2024-09-19T12:00:21.601866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:54.928769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001160424,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'23","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.829201+0000","last_change":"2024-09-19T11:35:31.591567+0000","last_active":"2024-09-19T12:03:05.829201+0000","last_peered":"2024-09-19T12:03:05.829201+0000","last_clean":"2024-09-19T12:03:05.829201+0000","last_became_active":"2024-09-19T11:35:31.590860+0000","last_became_peered":"2024-09-19T11:35:31.590860+0000","last_unstale":"2024-09-19T12:03:05.829201+0000","last_undegraded":"2024-09-19T12:03:05.829201+0000","last_fullsized":"2024-09-19T12:03:05.829201+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:09.412483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":67,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.590321+0000","last_change":"2024-09-19T11:35:35.611723+0000","last_active":"2024-09-19T11:59:26.590321+0000","last_peered":"2024-09-19T11:59:26.590321+0000","last_clean":"2024-09-19T11:59:26.590321+0000","last_became_active":"2024-09-19T11:35:35.611092+0000","last_became_peered":"2024-09-19T11:35:35.611092+0000","last_unstale":"2024-09-19T11:59:26.590321+0000","last_undegraded":"2024-09-19T11:59:26.590321+0000","last_fullsized":"2024-09-19T11:59:26.590321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:28.447966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'117","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.344688+0000","last_change":"2024-09-19T11:35:37.647865+0000","last_active":"2024-09-19T12:02:34.344688+0000","last_peered":"2024-09-19T12:02:34.344688+0000","last_clean":"2024-09-19T12:02:34.344688+0000","last_became_active":"2024-09-19T11:35:37.647356+0000","last_became_peered":"2024-09-19T11:35:37.647356+0000","last_unstale":"2024-09-19T12:02:34.344688+0000","last_undegraded":"2024-09-19T12:02:34.344688+0000","last_fullsized":"2024-09-19T12:02:34.344688+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:35.178664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":120,"num_read_kb":109,"num_write":73,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621074+0000","last_change":"2024-09-19T11:35:39.673457+0000","last_active":"2024-09-19T12:00:41.621074+0000","last_peered":"2024-09-19T12:00:41.621074+0000","last_clean":"2024-09-19T12:00:41.621074+0000","last_became_active":"2024-09-19T11:35:39.672352+0000","last_became_peered":"2024-09-19T11:35:39.672352+0000","last_unstale":"2024-09-19T12:00:41.621074+0000","last_undegraded":"2024-09-19T12:00:41.621074+0000","last_fullsized":"2024-09-19T12:00:41.621074+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:47.157668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"256'101","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611538+0000","last_change":"2024-09-19T11:35:41.689002+0000","last_active":"2024-09-19T12:00:26.611538+0000","last_peered":"2024-09-19T12:00:26.611538+0000","last_clean":"2024-09-19T12:00:26.611538+0000","last_became_active":"2024-09-19T11:35:41.688239+0000","last_became_peered":"2024-09-19T11:35:41.688239+0000","last_unstale":"2024-09-19T12:00:26.611538+0000","last_undegraded":"2024-09-19T12:00:26.611538+0000","last_fullsized":"2024-09-19T12:00:26.611538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:43:57.342380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":254,"num_write":203,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'2","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.196523+0000","last_change":"2024-09-19T11:35:33.601303+0000","last_active":"2024-09-19T12:02:33.196523+0000","last_peered":"2024-09-19T12:02:33.196523+0000","last_clean":"2024-09-19T12:02:33.196523+0000","last_became_active":"2024-09-19T11:35:33.600618+0000","last_became_peered":"2024-09-19T11:35:33.600618+0000","last_unstale":"2024-09-19T12:02:33.196523+0000","last_undegraded":"2024-09-19T12:02:33.196523+0000","last_fullsized":"2024-09-19T12:02:33.196523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:54.655273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.614118+0000","last_change":"2024-09-19T11:35:21.176258+0000","last_active":"2024-09-19T12:00:21.614118+0000","last_peered":"2024-09-19T12:00:21.614118+0000","last_clean":"2024-09-19T12:00:21.614118+0000","last_became_active":"2024-09-19T11:35:19.151363+0000","last_became_peered":"2024-09-19T11:35:19.151363+0000","last_unstale":"2024-09-19T12:00:21.614118+0000","last_undegraded":"2024-09-19T12:00:21.614118+0000","last_fullsized":"2024-09-19T12:00:21.614118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:58.212055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028321980000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'37","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.797490+0000","last_change":"2024-09-19T11:35:31.588679+0000","last_active":"2024-09-19T12:03:05.797490+0000","last_peered":"2024-09-19T12:03:05.797490+0000","last_clean":"2024-09-19T12:03:05.797490+0000","last_became_active":"2024-09-19T11:35:31.587649+0000","last_became_peered":"2024-09-19T11:35:31.587649+0000","last_unstale":"2024-09-19T12:03:05.797490+0000","last_undegraded":"2024-09-19T12:03:05.797490+0000","last_fullsized":"2024-09-19T12:03:05.797490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:13.392140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":1908,"num_write":132,"num_write_kb":8008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621095+0000","last_change":"2024-09-19T11:35:35.617574+0000","last_active":"2024-09-19T12:00:41.621095+0000","last_peered":"2024-09-19T12:00:41.621095+0000","last_clean":"2024-09-19T12:00:41.621095+0000","last_became_active":"2024-09-19T11:35:35.617200+0000","last_became_peered":"2024-09-19T11:35:35.617200+0000","last_unstale":"2024-09-19T12:00:41.621095+0000","last_undegraded":"2024-09-19T12:00:41.621095+0000","last_fullsized":"2024-09-19T12:00:41.621095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:13.119332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'69","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.599082+0000","last_change":"2024-09-19T11:35:37.643925+0000","last_active":"2024-09-19T11:59:31.599082+0000","last_peered":"2024-09-19T11:59:31.599082+0000","last_clean":"2024-09-19T11:59:31.599082+0000","last_became_active":"2024-09-19T11:35:37.643310+0000","last_became_peered":"2024-09-19T11:35:37.643310+0000","last_unstale":"2024-09-19T11:59:31.599082+0000","last_undegraded":"2024-09-19T11:59:31.599082+0000","last_fullsized":"2024-09-19T11:59:31.599082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:52.522266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":101,"num_read_kb":95,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.603772+0000","last_change":"2024-09-19T11:35:39.670325+0000","last_active":"2024-09-19T11:59:31.603772+0000","last_peered":"2024-09-19T11:59:31.603772+0000","last_clean":"2024-09-19T11:59:31.603772+0000","last_became_active":"2024-09-19T11:35:39.669555+0000","last_became_peered":"2024-09-19T11:35:39.669555+0000","last_unstale":"2024-09-19T11:59:31.603772+0000","last_undegraded":"2024-09-19T11:59:31.603772+0000","last_fullsized":"2024-09-19T11:59:31.603772+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:49.076245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'20","reported_seq":557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.765426+0000","last_change":"2024-09-19T11:35:41.679051+0000","last_active":"2024-09-19T12:02:19.765426+0000","last_peered":"2024-09-19T12:02:19.765426+0000","last_clean":"2024-09-19T12:02:19.765426+0000","last_became_active":"2024-09-19T11:35:41.678167+0000","last_became_peered":"2024-09-19T11:35:41.678167+0000","last_unstale":"2024-09-19T12:02:19.765426+0000","last_undegraded":"2024-09-19T12:02:19.765426+0000","last_fullsized":"2024-09-19T12:02:19.765426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:18.723092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":65,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'93","reported_seq":609,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.606163+0000","last_change":"2024-09-19T11:35:33.606056+0000","last_active":"2024-09-19T12:00:36.606163+0000","last_peered":"2024-09-19T12:00:36.606163+0000","last_clean":"2024-09-19T12:00:36.606163+0000","last_became_active":"2024-09-19T11:35:33.605504+0000","last_became_peered":"2024-09-19T11:35:33.605504+0000","last_unstale":"2024-09-19T12:00:36.606163+0000","last_undegraded":"2024-09-19T12:00:36.606163+0000","last_fullsized":"2024-09-19T12:00:36.606163+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:14:43.679145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":306,"num_write":160,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'51","reported_seq":557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.930023+0000","last_change":"2024-09-19T11:35:31.617849+0000","last_active":"2024-09-19T12:03:05.930023+0000","last_peered":"2024-09-19T12:03:05.930023+0000","last_clean":"2024-09-19T12:03:05.930023+0000","last_became_active":"2024-09-19T11:35:31.616954+0000","last_became_peered":"2024-09-19T11:35:31.616954+0000","last_unstale":"2024-09-19T12:03:05.930023+0000","last_undegraded":"2024-09-19T12:03:05.930023+0000","last_fullsized":"2024-09-19T12:03:05.930023+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:52.945748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":2718,"num_write":157,"num_write_kb":7832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.602438+0000","last_change":"2024-09-19T11:35:21.183056+0000","last_active":"2024-09-19T12:00:21.602438+0000","last_peered":"2024-09-19T12:00:21.602438+0000","last_clean":"2024-09-19T12:00:21.602438+0000","last_became_active":"2024-09-19T11:35:20.096557+0000","last_became_peered":"2024-09-19T11:35:20.096557+0000","last_unstale":"2024-09-19T12:00:21.602438+0000","last_undegraded":"2024-09-19T12:00:21.602438+0000","last_fullsized":"2024-09-19T12:00:21.602438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:29.688644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010463289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.619805+0000","last_change":"2024-09-19T11:35:35.624242+0000","last_active":"2024-09-19T12:00:36.619805+0000","last_peered":"2024-09-19T12:00:36.619805+0000","last_clean":"2024-09-19T12:00:36.619805+0000","last_became_active":"2024-09-19T11:35:35.623450+0000","last_became_peered":"2024-09-19T11:35:35.623450+0000","last_unstale":"2024-09-19T12:00:36.619805+0000","last_undegraded":"2024-09-19T12:00:36.619805+0000","last_fullsized":"2024-09-19T12:00:36.619805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:29.438228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'151","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.835530+0000","last_change":"2024-09-19T11:35:37.638304+0000","last_active":"2024-09-19T12:03:05.835530+0000","last_peered":"2024-09-19T12:03:05.835530+0000","last_clean":"2024-09-19T12:03:05.835530+0000","last_became_active":"2024-09-19T11:35:37.637234+0000","last_became_peered":"2024-09-19T11:35:37.637234+0000","last_unstale":"2024-09-19T12:03:05.835530+0000","last_undegraded":"2024-09-19T12:03:05.835530+0000","last_fullsized":"2024-09-19T12:03:05.835530+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:56.332709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9930,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":215,"num_read_kb":331,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812070+0000","last_change":"2024-09-19T11:35:39.671642+0000","last_active":"2024-09-19T12:00:41.812070+0000","last_peered":"2024-09-19T12:00:41.812070+0000","last_clean":"2024-09-19T12:00:41.812070+0000","last_became_active":"2024-09-19T11:35:39.669914+0000","last_became_peered":"2024-09-19T11:35:39.669914+0000","last_unstale":"2024-09-19T12:00:41.812070+0000","last_undegraded":"2024-09-19T12:00:41.812070+0000","last_fullsized":"2024-09-19T12:00:41.812070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:43.678369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'12","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.617421+0000","last_change":"2024-09-19T11:35:41.692653+0000","last_active":"2024-09-19T12:00:26.617421+0000","last_peered":"2024-09-19T12:00:26.617421+0000","last_clean":"2024-09-19T12:00:26.617421+0000","last_became_active":"2024-09-19T11:35:41.690257+0000","last_became_peered":"2024-09-19T11:35:41.690257+0000","last_unstale":"2024-09-19T12:00:26.617421+0000","last_undegraded":"2024-09-19T12:00:26.617421+0000","last_fullsized":"2024-09-19T12:00:26.617421+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:24.125004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'201","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.388896+0000","last_change":"2024-09-19T11:35:33.614634+0000","last_active":"2024-09-19T12:02:19.388896+0000","last_peered":"2024-09-19T12:02:19.388896+0000","last_clean":"2024-09-19T12:02:19.388896+0000","last_became_active":"2024-09-19T11:35:33.614327+0000","last_became_peered":"2024-09-19T11:35:33.614327+0000","last_unstale":"2024-09-19T12:02:19.388896+0000","last_undegraded":"2024-09-19T12:02:19.388896+0000","last_fullsized":"2024-09-19T12:02:19.388896+0000","mapping_epoch":28,"log_start":"256'100","ondisk_log_start":"256'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:00.637435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":855,"num_read_kb":681,"num_write":310,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'50","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.866743+0000","last_change":"2024-09-19T11:35:31.598990+0000","last_active":"2024-09-19T12:03:05.866743+0000","last_peered":"2024-09-19T12:03:05.866743+0000","last_clean":"2024-09-19T12:03:05.866743+0000","last_became_active":"2024-09-19T11:35:31.598447+0000","last_became_peered":"2024-09-19T11:35:31.598447+0000","last_unstale":"2024-09-19T12:03:05.866743+0000","last_undegraded":"2024-09-19T12:03:05.866743+0000","last_fullsized":"2024-09-19T12:03:05.866743+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:13:57.048369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":9296,"num_write":144,"num_write_kb":14398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.619240+0000","last_change":"2024-09-19T11:35:21.463119+0000","last_active":"2024-09-19T12:00:26.619240+0000","last_peered":"2024-09-19T12:00:26.619240+0000","last_clean":"2024-09-19T12:00:26.619240+0000","last_became_active":"2024-09-19T11:35:20.094400+0000","last_became_peered":"2024-09-19T11:35:20.094400+0000","last_unstale":"2024-09-19T12:00:26.619240+0000","last_undegraded":"2024-09-19T12:00:26.619240+0000","last_fullsized":"2024-09-19T12:00:26.619240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:19.422926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088955000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"38'5","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.045340+0000","last_change":"2024-09-19T11:35:35.620047+0000","last_active":"2024-09-19T12:03:05.045340+0000","last_peered":"2024-09-19T12:03:05.045340+0000","last_clean":"2024-09-19T12:03:05.045340+0000","last_became_active":"2024-09-19T11:35:35.619212+0000","last_became_peered":"2024-09-19T11:35:35.619212+0000","last_unstale":"2024-09-19T12:03:05.045340+0000","last_undegraded":"2024-09-19T12:03:05.045340+0000","last_fullsized":"2024-09-19T12:03:05.045340+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:38.449188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":630,"num_read_kb":1029,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'100","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607374+0000","last_change":"2024-09-19T11:35:37.633269+0000","last_active":"2024-09-19T12:00:41.607374+0000","last_peered":"2024-09-19T12:00:41.607374+0000","last_clean":"2024-09-19T12:00:41.607374+0000","last_became_active":"2024-09-19T11:35:37.629547+0000","last_became_peered":"2024-09-19T11:35:37.629547+0000","last_unstale":"2024-09-19T12:00:41.607374+0000","last_undegraded":"2024-09-19T12:00:41.607374+0000","last_fullsized":"2024-09-19T12:00:41.607374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:55.759738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":151,"num_read_kb":144,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'620","reported_seq":1654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.304142+0000","last_change":"2024-09-19T11:35:39.683282+0000","last_active":"2024-09-19T12:03:05.304142+0000","last_peered":"2024-09-19T12:03:05.304142+0000","last_clean":"2024-09-19T12:03:05.304142+0000","last_became_active":"2024-09-19T11:35:39.681476+0000","last_became_peered":"2024-09-19T11:35:39.681476+0000","last_unstale":"2024-09-19T12:03:05.304142+0000","last_undegraded":"2024-09-19T12:03:05.304142+0000","last_fullsized":"2024-09-19T12:03:05.304142+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":600,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:03.143481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'15","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.612867+0000","last_change":"2024-09-19T11:35:41.671140+0000","last_active":"2024-09-19T12:00:31.612867+0000","last_peered":"2024-09-19T12:00:31.612867+0000","last_clean":"2024-09-19T12:00:31.612867+0000","last_became_active":"2024-09-19T11:35:41.670410+0000","last_became_peered":"2024-09-19T11:35:41.670410+0000","last_unstale":"2024-09-19T12:00:31.612867+0000","last_undegraded":"2024-09-19T12:00:31.612867+0000","last_fullsized":"2024-09-19T12:00:31.612867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:12:45.264833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":68,"num_write":44,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'111","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:25.782149+0000","last_change":"2024-09-19T11:35:33.625333+0000","last_active":"2024-09-19T12:02:25.782149+0000","last_peered":"2024-09-19T12:02:25.782149+0000","last_clean":"2024-09-19T12:02:25.782149+0000","last_became_active":"2024-09-19T11:35:33.624885+0000","last_became_peered":"2024-09-19T11:35:33.624885+0000","last_unstale":"2024-09-19T12:02:25.782149+0000","last_undegraded":"2024-09-19T12:02:25.782149+0000","last_fullsized":"2024-09-19T12:02:25.782149+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:31.869760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":317,"num_write":191,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'36","reported_seq":554,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.645331+0000","last_change":"2024-09-19T11:36:06.650619+0000","last_active":"2024-09-19T12:03:05.645331+0000","last_peered":"2024-09-19T12:03:05.645331+0000","last_clean":"2024-09-19T12:03:05.645331+0000","last_became_active":"2024-09-19T11:36:06.649117+0000","last_became_peered":"2024-09-19T11:36:06.649117+0000","last_unstale":"2024-09-19T12:03:05.645331+0000","last_undegraded":"2024-09-19T12:03:05.645331+0000","last_fullsized":"2024-09-19T12:03:05.645331+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:52.917710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":54,"num_write":158,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.586560+0000","last_change":"2024-09-19T11:35:21.182872+0000","last_active":"2024-09-19T11:59:11.586560+0000","last_peered":"2024-09-19T11:59:11.586560+0000","last_clean":"2024-09-19T11:59:11.586560+0000","last_became_active":"2024-09-19T11:35:19.152195+0000","last_became_peered":"2024-09-19T11:35:19.152195+0000","last_unstale":"2024-09-19T11:59:11.586560+0000","last_undegraded":"2024-09-19T11:59:11.586560+0000","last_fullsized":"2024-09-19T11:59:11.586560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:33.512818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094930600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810796+0000","last_change":"2024-09-19T11:35:35.625999+0000","last_active":"2024-09-19T12:00:36.810796+0000","last_peered":"2024-09-19T12:00:36.810796+0000","last_clean":"2024-09-19T12:00:36.810796+0000","last_became_active":"2024-09-19T11:35:35.625385+0000","last_became_peered":"2024-09-19T11:35:35.625385+0000","last_unstale":"2024-09-19T12:00:36.810796+0000","last_undegraded":"2024-09-19T12:00:36.810796+0000","last_fullsized":"2024-09-19T12:00:36.810796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:58.273564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'58","reported_seq":572,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812198+0000","last_change":"2024-09-19T11:35:37.642580+0000","last_active":"2024-09-19T12:00:41.812198+0000","last_peered":"2024-09-19T12:00:41.812198+0000","last_clean":"2024-09-19T12:00:41.812198+0000","last_became_active":"2024-09-19T11:35:37.641855+0000","last_became_peered":"2024-09-19T11:35:37.641855+0000","last_unstale":"2024-09-19T12:00:41.812198+0000","last_undegraded":"2024-09-19T12:00:41.812198+0000","last_fullsized":"2024-09-19T12:00:41.812198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:09.995922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":89,"num_read_kb":84,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'622","reported_seq":1538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.700894+0000","last_change":"2024-09-19T11:35:39.663385+0000","last_active":"2024-09-19T12:03:05.700894+0000","last_peered":"2024-09-19T12:03:05.700894+0000","last_clean":"2024-09-19T12:03:05.700894+0000","last_became_active":"2024-09-19T11:35:39.662678+0000","last_became_peered":"2024-09-19T11:35:39.662678+0000","last_unstale":"2024-09-19T12:03:05.700894+0000","last_undegraded":"2024-09-19T12:03:05.700894+0000","last_fullsized":"2024-09-19T12:03:05.700894+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:49.009964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'101","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.205987+0000","last_change":"2024-09-19T11:35:41.684355+0000","last_active":"2024-09-19T12:02:33.205987+0000","last_peered":"2024-09-19T12:02:33.205987+0000","last_clean":"2024-09-19T12:02:33.205987+0000","last_became_active":"2024-09-19T11:35:41.683629+0000","last_became_peered":"2024-09-19T11:35:41.683629+0000","last_unstale":"2024-09-19T12:02:33.205987+0000","last_undegraded":"2024-09-19T12:02:33.205987+0000","last_fullsized":"2024-09-19T12:02:33.205987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:47.007366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":202,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'36","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.192875+0000","last_change":"2024-09-19T11:35:33.616782+0000","last_active":"2024-09-19T12:02:33.192875+0000","last_peered":"2024-09-19T12:02:33.192875+0000","last_clean":"2024-09-19T12:02:33.192875+0000","last_became_active":"2024-09-19T11:35:33.616079+0000","last_became_peered":"2024-09-19T11:35:33.616079+0000","last_unstale":"2024-09-19T12:02:33.192875+0000","last_undegraded":"2024-09-19T12:02:33.192875+0000","last_fullsized":"2024-09-19T12:02:33.192875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:15:39.547552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":147,"num_write":69,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'45","reported_seq":557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.944182+0000","last_change":"2024-09-19T11:35:31.613306+0000","last_active":"2024-09-19T12:03:05.944182+0000","last_peered":"2024-09-19T12:03:05.944182+0000","last_clean":"2024-09-19T12:03:05.944182+0000","last_became_active":"2024-09-19T11:35:31.612706+0000","last_became_peered":"2024-09-19T11:35:31.612706+0000","last_unstale":"2024-09-19T12:03:05.944182+0000","last_undegraded":"2024-09-19T12:03:05.944182+0000","last_fullsized":"2024-09-19T12:03:05.944182+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:16.769591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":6249,"num_write":158,"num_write_kb":6206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.599479+0000","last_change":"2024-09-19T11:35:21.168189+0000","last_active":"2024-09-19T11:59:11.599479+0000","last_peered":"2024-09-19T11:59:11.599479+0000","last_clean":"2024-09-19T11:59:11.599479+0000","last_became_active":"2024-09-19T11:35:19.152446+0000","last_became_peered":"2024-09-19T11:35:19.152446+0000","last_unstale":"2024-09-19T11:59:11.599479+0000","last_undegraded":"2024-09-19T11:59:11.599479+0000","last_fullsized":"2024-09-19T11:59:11.599479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:18.126175+0000","last_clean_scrub_stamp":"2024-09-19T11:35:18.126175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:09.874667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.601284+0000","last_change":"2024-09-19T11:35:35.624664+0000","last_active":"2024-09-19T11:59:41.601284+0000","last_peered":"2024-09-19T11:59:41.601284+0000","last_clean":"2024-09-19T11:59:41.601284+0000","last_became_active":"2024-09-19T11:35:35.624322+0000","last_became_peered":"2024-09-19T11:35:35.624322+0000","last_unstale":"2024-09-19T11:59:41.601284+0000","last_undegraded":"2024-09-19T11:59:41.601284+0000","last_fullsized":"2024-09-19T11:59:41.601284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:10.112342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'196","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.931684+0000","last_change":"2024-09-19T11:35:37.646919+0000","last_active":"2024-09-19T12:03:05.931684+0000","last_peered":"2024-09-19T12:03:05.931684+0000","last_clean":"2024-09-19T12:03:05.931684+0000","last_became_active":"2024-09-19T11:35:37.646158+0000","last_became_peered":"2024-09-19T11:35:37.646158+0000","last_unstale":"2024-09-19T12:03:05.931684+0000","last_undegraded":"2024-09-19T12:03:05.931684+0000","last_fullsized":"2024-09-19T12:03:05.931684+0000","mapping_epoch":32,"log_start":"256'100","ondisk_log_start":"256'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:25.054477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20533,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":287,"num_read_kb":516,"num_write":214,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615042+0000","last_change":"2024-09-19T11:35:39.684662+0000","last_active":"2024-09-19T12:00:41.615042+0000","last_peered":"2024-09-19T12:00:41.615042+0000","last_clean":"2024-09-19T12:00:41.615042+0000","last_became_active":"2024-09-19T11:35:39.684034+0000","last_became_peered":"2024-09-19T11:35:39.684034+0000","last_unstale":"2024-09-19T12:00:41.615042+0000","last_undegraded":"2024-09-19T12:00:41.615042+0000","last_fullsized":"2024-09-19T12:00:41.615042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:00.499255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'21","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.615420+0000","last_change":"2024-09-19T11:35:41.690412+0000","last_active":"2024-09-19T12:00:26.615420+0000","last_peered":"2024-09-19T12:00:26.615420+0000","last_clean":"2024-09-19T12:00:26.615420+0000","last_became_active":"2024-09-19T11:35:41.689764+0000","last_became_peered":"2024-09-19T11:35:41.689764+0000","last_unstale":"2024-09-19T12:00:26.615420+0000","last_undegraded":"2024-09-19T12:00:26.615420+0000","last_fullsized":"2024-09-19T12:00:26.615420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:54.147943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":78,"num_write":61,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'13","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621213+0000","last_change":"2024-09-19T11:35:41.691619+0000","last_active":"2024-09-19T12:00:41.621213+0000","last_peered":"2024-09-19T12:00:41.621213+0000","last_clean":"2024-09-19T12:00:41.621213+0000","last_became_active":"2024-09-19T11:35:41.691032+0000","last_became_peered":"2024-09-19T11:35:41.691032+0000","last_unstale":"2024-09-19T12:00:41.621213+0000","last_undegraded":"2024-09-19T12:00:41.621213+0000","last_fullsized":"2024-09-19T12:00:41.621213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:56.262332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":124,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'71","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.049397+0000","last_change":"2024-09-19T11:35:33.630221+0000","last_active":"2024-09-19T11:59:28.049397+0000","last_peered":"2024-09-19T11:59:28.049397+0000","last_clean":"2024-09-19T11:59:28.049397+0000","last_became_active":"2024-09-19T11:35:33.629606+0000","last_became_peered":"2024-09-19T11:35:33.629606+0000","last_unstale":"2024-09-19T11:59:28.049397+0000","last_undegraded":"2024-09-19T11:59:28.049397+0000","last_fullsized":"2024-09-19T11:59:28.049397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:26.189736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":210,"num_write":129,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'37","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.889243+0000","last_change":"2024-09-19T11:35:31.592429+0000","last_active":"2024-09-19T12:03:05.889243+0000","last_peered":"2024-09-19T12:03:05.889243+0000","last_clean":"2024-09-19T12:03:05.889243+0000","last_became_active":"2024-09-19T11:35:31.591519+0000","last_became_peered":"2024-09-19T11:35:31.591519+0000","last_unstale":"2024-09-19T12:03:05.889243+0000","last_undegraded":"2024-09-19T12:03:05.889243+0000","last_fullsized":"2024-09-19T12:03:05.889243+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:03.358145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":3273,"num_write":135,"num_write_kb":3245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.583004+0000","last_change":"2024-09-19T11:35:35.613146+0000","last_active":"2024-09-19T11:58:56.583004+0000","last_peered":"2024-09-19T11:58:56.583004+0000","last_clean":"2024-09-19T11:58:56.583004+0000","last_became_active":"2024-09-19T11:35:35.612405+0000","last_became_peered":"2024-09-19T11:35:35.612405+0000","last_unstale":"2024-09-19T11:58:56.583004+0000","last_undegraded":"2024-09-19T11:58:56.583004+0000","last_fullsized":"2024-09-19T11:58:56.583004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:30:32.069279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'84","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.720757+0000","last_change":"2024-09-19T11:35:37.633337+0000","last_active":"2024-09-19T12:03:05.720757+0000","last_peered":"2024-09-19T12:03:05.720757+0000","last_clean":"2024-09-19T12:03:05.720757+0000","last_became_active":"2024-09-19T11:35:37.632543+0000","last_became_peered":"2024-09-19T11:35:37.632543+0000","last_unstale":"2024-09-19T12:03:05.720757+0000","last_undegraded":"2024-09-19T12:03:05.720757+0000","last_fullsized":"2024-09-19T12:03:05.720757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:04.865458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4752,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":182,"num_write":88,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.591731+0000","last_change":"2024-09-19T11:35:39.654809+0000","last_active":"2024-09-19T11:59:01.591731+0000","last_peered":"2024-09-19T11:59:01.591731+0000","last_clean":"2024-09-19T11:59:01.591731+0000","last_became_active":"2024-09-19T11:35:39.654012+0000","last_became_peered":"2024-09-19T11:35:39.654012+0000","last_unstale":"2024-09-19T11:59:01.591731+0000","last_undegraded":"2024-09-19T11:59:01.591731+0000","last_fullsized":"2024-09-19T11:59:01.591731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:29.043987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'11","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.602664+0000","last_change":"2024-09-19T11:35:41.676591+0000","last_active":"2024-09-19T11:59:46.602664+0000","last_peered":"2024-09-19T11:59:46.602664+0000","last_clean":"2024-09-19T11:59:46.602664+0000","last_became_active":"2024-09-19T11:35:41.675506+0000","last_became_peered":"2024-09-19T11:35:41.675506+0000","last_unstale":"2024-09-19T11:59:46.602664+0000","last_undegraded":"2024-09-19T11:59:46.602664+0000","last_fullsized":"2024-09-19T11:59:46.602664+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:14.936561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":25,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'13","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.169388+0000","last_change":"2024-09-19T11:35:33.635071+0000","last_active":"2024-09-19T12:02:33.169388+0000","last_peered":"2024-09-19T12:02:33.169388+0000","last_clean":"2024-09-19T12:02:33.169388+0000","last_became_active":"2024-09-19T11:35:33.634606+0000","last_became_peered":"2024-09-19T11:35:33.634606+0000","last_unstale":"2024-09-19T12:02:33.169388+0000","last_undegraded":"2024-09-19T12:02:33.169388+0000","last_fullsized":"2024-09-19T12:02:33.169388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:09.967791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":71,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'47","reported_seq":562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.872425+0000","last_change":"2024-09-19T11:35:31.603150+0000","last_active":"2024-09-19T12:03:05.872425+0000","last_peered":"2024-09-19T12:03:05.872425+0000","last_clean":"2024-09-19T12:03:05.872425+0000","last_became_active":"2024-09-19T11:35:31.602343+0000","last_became_peered":"2024-09-19T11:35:31.602343+0000","last_unstale":"2024-09-19T12:03:05.872425+0000","last_undegraded":"2024-09-19T12:03:05.872425+0000","last_fullsized":"2024-09-19T12:03:05.872425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:51.716892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":10301,"num_write":159,"num_write_kb":15391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.590693+0000","last_change":"2024-09-19T11:35:35.630500+0000","last_active":"2024-09-19T11:58:56.590693+0000","last_peered":"2024-09-19T11:58:56.590693+0000","last_clean":"2024-09-19T11:58:56.590693+0000","last_became_active":"2024-09-19T11:35:35.630183+0000","last_became_peered":"2024-09-19T11:35:35.630183+0000","last_unstale":"2024-09-19T11:58:56.590693+0000","last_undegraded":"2024-09-19T11:58:56.590693+0000","last_fullsized":"2024-09-19T11:58:56.590693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:46.826155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'15","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.597192+0000","last_change":"2024-09-19T11:35:37.642215+0000","last_active":"2024-09-19T11:59:01.597192+0000","last_peered":"2024-09-19T11:59:01.597192+0000","last_clean":"2024-09-19T11:59:01.597192+0000","last_became_active":"2024-09-19T11:35:37.640723+0000","last_became_peered":"2024-09-19T11:35:37.640723+0000","last_unstale":"2024-09-19T11:59:01.597192+0000","last_undegraded":"2024-09-19T11:59:01.597192+0000","last_fullsized":"2024-09-19T11:59:01.597192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:00.528966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.600886+0000","last_change":"2024-09-19T11:35:39.668057+0000","last_active":"2024-09-19T11:59:01.600886+0000","last_peered":"2024-09-19T11:59:01.600886+0000","last_clean":"2024-09-19T11:59:01.600886+0000","last_became_active":"2024-09-19T11:35:39.667286+0000","last_became_peered":"2024-09-19T11:35:39.667286+0000","last_unstale":"2024-09-19T11:59:01.600886+0000","last_undegraded":"2024-09-19T11:59:01.600886+0000","last_fullsized":"2024-09-19T11:59:01.600886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:36.821583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'8","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:18.512713+0000","last_change":"2024-09-19T11:35:41.698132+0000","last_active":"2024-09-19T11:58:18.512713+0000","last_peered":"2024-09-19T11:58:18.512713+0000","last_clean":"2024-09-19T11:58:18.512713+0000","last_became_active":"2024-09-19T11:35:41.696369+0000","last_became_peered":"2024-09-19T11:35:41.696369+0000","last_unstale":"2024-09-19T11:58:18.512713+0000","last_undegraded":"2024-09-19T11:58:18.512713+0000","last_fullsized":"2024-09-19T11:58:18.512713+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:42.394020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'69","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.196713+0000","last_change":"2024-09-19T11:35:33.617102+0000","last_active":"2024-09-19T12:02:33.196713+0000","last_peered":"2024-09-19T12:02:33.196713+0000","last_clean":"2024-09-19T12:02:33.196713+0000","last_became_active":"2024-09-19T11:35:33.614693+0000","last_became_peered":"2024-09-19T11:35:33.614693+0000","last_unstale":"2024-09-19T12:02:33.196713+0000","last_undegraded":"2024-09-19T12:02:33.196713+0000","last_fullsized":"2024-09-19T12:02:33.196713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:04.830617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":230,"num_write":111,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'49","reported_seq":540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.893525+0000","last_change":"2024-09-19T11:36:06.678190+0000","last_active":"2024-09-19T12:03:05.893525+0000","last_peered":"2024-09-19T12:03:05.893525+0000","last_clean":"2024-09-19T12:03:05.893525+0000","last_became_active":"2024-09-19T11:36:06.677102+0000","last_became_peered":"2024-09-19T11:36:06.677102+0000","last_unstale":"2024-09-19T12:03:05.893525+0000","last_undegraded":"2024-09-19T12:03:05.893525+0000","last_fullsized":"2024-09-19T12:03:05.893525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:31.643124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":91,"num_read_kb":1744,"num_write":157,"num_write_kb":1703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599682+0000","last_change":"2024-09-19T11:35:35.618146+0000","last_active":"2024-09-19T11:58:56.599682+0000","last_peered":"2024-09-19T11:58:56.599682+0000","last_clean":"2024-09-19T11:58:56.599682+0000","last_became_active":"2024-09-19T11:35:35.617374+0000","last_became_peered":"2024-09-19T11:35:35.617374+0000","last_unstale":"2024-09-19T11:58:56.599682+0000","last_undegraded":"2024-09-19T11:58:56.599682+0000","last_fullsized":"2024-09-19T11:58:56.599682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:21.640183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'97","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.561936+0000","last_change":"2024-09-19T11:35:37.637365+0000","last_active":"2024-09-19T12:03:05.561936+0000","last_peered":"2024-09-19T12:03:05.561936+0000","last_clean":"2024-09-19T12:03:05.561936+0000","last_became_active":"2024-09-19T11:35:37.636913+0000","last_became_peered":"2024-09-19T11:35:37.636913+0000","last_unstale":"2024-09-19T12:03:05.561936+0000","last_undegraded":"2024-09-19T12:03:05.561936+0000","last_fullsized":"2024-09-19T12:03:05.561936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:19.745629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4489,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":210,"num_write":100,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":470,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.597548+0000","last_change":"2024-09-19T11:35:39.673878+0000","last_active":"2024-09-19T11:59:01.597548+0000","last_peered":"2024-09-19T11:59:01.597548+0000","last_clean":"2024-09-19T11:59:01.597548+0000","last_became_active":"2024-09-19T11:35:39.673172+0000","last_became_peered":"2024-09-19T11:35:39.673172+0000","last_unstale":"2024-09-19T11:59:01.597548+0000","last_undegraded":"2024-09-19T11:59:01.597548+0000","last_fullsized":"2024-09-19T11:59:01.597548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:06:47.106673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'13","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.043251+0000","last_change":"2024-09-19T11:35:41.678676+0000","last_active":"2024-09-19T11:59:28.043251+0000","last_peered":"2024-09-19T11:59:28.043251+0000","last_clean":"2024-09-19T11:59:28.043251+0000","last_became_active":"2024-09-19T11:35:41.677991+0000","last_became_peered":"2024-09-19T11:35:41.677991+0000","last_unstale":"2024-09-19T11:59:28.043251+0000","last_undegraded":"2024-09-19T11:59:28.043251+0000","last_fullsized":"2024-09-19T11:59:28.043251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:02.104343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":90,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":470,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.590229+0000","last_change":"2024-09-19T11:36:06.675768+0000","last_active":"2024-09-19T11:59:26.590229+0000","last_peered":"2024-09-19T11:59:26.590229+0000","last_clean":"2024-09-19T11:59:26.590229+0000","last_became_active":"2024-09-19T11:36:06.674947+0000","last_became_peered":"2024-09-19T11:36:06.674947+0000","last_unstale":"2024-09-19T11:59:26.590229+0000","last_undegraded":"2024-09-19T11:59:26.590229+0000","last_fullsized":"2024-09-19T11:59:26.590229+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:35.049315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"264'32","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.931375+0000","last_change":"2024-09-19T11:35:31.589696+0000","last_active":"2024-09-19T12:03:05.931375+0000","last_peered":"2024-09-19T12:03:05.931375+0000","last_clean":"2024-09-19T12:03:05.931375+0000","last_became_active":"2024-09-19T11:35:31.589077+0000","last_became_peered":"2024-09-19T11:35:31.589077+0000","last_unstale":"2024-09-19T12:03:05.931375+0000","last_undegraded":"2024-09-19T12:03:05.931375+0000","last_fullsized":"2024-09-19T12:03:05.931375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:24.386252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":45,"num_read_kb":7227,"num_write":97,"num_write_kb":7207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.596258+0000","last_change":"2024-09-19T11:35:35.630499+0000","last_active":"2024-09-19T11:58:56.596258+0000","last_peered":"2024-09-19T11:58:56.596258+0000","last_clean":"2024-09-19T11:58:56.596258+0000","last_became_active":"2024-09-19T11:35:35.629798+0000","last_became_peered":"2024-09-19T11:35:35.629798+0000","last_unstale":"2024-09-19T11:58:56.596258+0000","last_undegraded":"2024-09-19T11:58:56.596258+0000","last_fullsized":"2024-09-19T11:58:56.596258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:11.036004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'69","reported_seq":568,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.486498+0000","last_change":"2024-09-19T11:35:37.640794+0000","last_active":"2024-09-19T12:03:05.486498+0000","last_peered":"2024-09-19T12:03:05.486498+0000","last_clean":"2024-09-19T12:03:05.486498+0000","last_became_active":"2024-09-19T11:35:37.640008+0000","last_became_peered":"2024-09-19T11:35:37.640008+0000","last_unstale":"2024-09-19T12:03:05.486498+0000","last_undegraded":"2024-09-19T12:03:05.486498+0000","last_fullsized":"2024-09-19T12:03:05.486498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:27.014754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":172,"num_write":74,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.597356+0000","last_change":"2024-09-19T11:35:39.676685+0000","last_active":"2024-09-19T11:59:01.597356+0000","last_peered":"2024-09-19T11:59:01.597356+0000","last_clean":"2024-09-19T11:59:01.597356+0000","last_became_active":"2024-09-19T11:35:39.675913+0000","last_became_peered":"2024-09-19T11:35:39.675913+0000","last_unstale":"2024-09-19T11:59:01.597356+0000","last_undegraded":"2024-09-19T11:59:01.597356+0000","last_fullsized":"2024-09-19T11:59:01.597356+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:50.470241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'72","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618654+0000","last_change":"2024-09-19T11:35:33.625849+0000","last_active":"2024-09-19T12:00:36.618654+0000","last_peered":"2024-09-19T12:00:36.618654+0000","last_clean":"2024-09-19T12:00:36.618654+0000","last_became_active":"2024-09-19T11:35:33.624358+0000","last_became_peered":"2024-09-19T11:35:33.624358+0000","last_unstale":"2024-09-19T12:00:36.618654+0000","last_undegraded":"2024-09-19T12:00:36.618654+0000","last_fullsized":"2024-09-19T12:00:36.618654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:19.837363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":316,"num_read_kb":286,"num_write":104,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'41","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.900506+0000","last_change":"2024-09-19T11:35:31.575536+0000","last_active":"2024-09-19T12:03:05.900506+0000","last_peered":"2024-09-19T12:03:05.900506+0000","last_clean":"2024-09-19T12:03:05.900506+0000","last_became_active":"2024-09-19T11:35:31.574673+0000","last_became_peered":"2024-09-19T11:35:31.574673+0000","last_unstale":"2024-09-19T12:03:05.900506+0000","last_undegraded":"2024-09-19T12:03:05.900506+0000","last_fullsized":"2024-09-19T12:03:05.900506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.781451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":49,"num_write":124,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.606673+0000","last_change":"2024-09-19T11:35:35.620065+0000","last_active":"2024-09-19T11:59:41.606673+0000","last_peered":"2024-09-19T11:59:41.606673+0000","last_clean":"2024-09-19T11:59:41.606673+0000","last_became_active":"2024-09-19T11:35:35.617643+0000","last_became_peered":"2024-09-19T11:35:35.617643+0000","last_unstale":"2024-09-19T11:59:41.606673+0000","last_undegraded":"2024-09-19T11:59:41.606673+0000","last_fullsized":"2024-09-19T11:59:41.606673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:41.917586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'103","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.805477+0000","last_change":"2024-09-19T11:35:37.640664+0000","last_active":"2024-09-19T12:03:05.805477+0000","last_peered":"2024-09-19T12:03:05.805477+0000","last_clean":"2024-09-19T12:03:05.805477+0000","last_became_active":"2024-09-19T11:35:37.640147+0000","last_became_peered":"2024-09-19T11:35:37.640147+0000","last_unstale":"2024-09-19T12:03:05.805477+0000","last_undegraded":"2024-09-19T12:03:05.805477+0000","last_fullsized":"2024-09-19T12:03:05.805477+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:58.172631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9836,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":276,"num_write":110,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":472,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.585226+0000","last_change":"2024-09-19T11:35:39.652153+0000","last_active":"2024-09-19T11:58:11.585226+0000","last_peered":"2024-09-19T11:58:11.585226+0000","last_clean":"2024-09-19T11:58:11.585226+0000","last_became_active":"2024-09-19T11:35:39.651426+0000","last_became_peered":"2024-09-19T11:35:39.651426+0000","last_unstale":"2024-09-19T11:58:11.585226+0000","last_undegraded":"2024-09-19T11:58:11.585226+0000","last_fullsized":"2024-09-19T11:58:11.585226+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:46.800698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'72","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.052035+0000","last_change":"2024-09-19T11:35:41.676328+0000","last_active":"2024-09-19T11:59:28.052035+0000","last_peered":"2024-09-19T11:59:28.052035+0000","last_clean":"2024-09-19T11:59:28.052035+0000","last_became_active":"2024-09-19T11:35:41.674006+0000","last_became_peered":"2024-09-19T11:35:41.674006+0000","last_unstale":"2024-09-19T11:59:28.052035+0000","last_undegraded":"2024-09-19T11:59:28.052035+0000","last_fullsized":"2024-09-19T11:59:28.052035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:43.399242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'110","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.380540+0000","last_change":"2024-09-19T11:35:33.612189+0000","last_active":"2024-09-19T12:02:19.380540+0000","last_peered":"2024-09-19T12:02:19.380540+0000","last_clean":"2024-09-19T12:02:19.380540+0000","last_became_active":"2024-09-19T11:35:33.611732+0000","last_became_peered":"2024-09-19T11:35:33.611732+0000","last_unstale":"2024-09-19T12:02:19.380540+0000","last_undegraded":"2024-09-19T12:02:19.380540+0000","last_fullsized":"2024-09-19T12:02:19.380540+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:18.009652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":312,"num_write":153,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'50","reported_seq":568,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.933324+0000","last_change":"2024-09-19T11:35:31.585905+0000","last_active":"2024-09-19T12:03:05.933324+0000","last_peered":"2024-09-19T12:03:05.933324+0000","last_clean":"2024-09-19T12:03:05.933324+0000","last_became_active":"2024-09-19T11:35:31.585423+0000","last_became_peered":"2024-09-19T11:35:31.585423+0000","last_unstale":"2024-09-19T12:03:05.933324+0000","last_undegraded":"2024-09-19T12:03:05.933324+0000","last_fullsized":"2024-09-19T12:03:05.933324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:25:09.830393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":1132,"num_write":175,"num_write_kb":1063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618616+0000","last_change":"2024-09-19T11:35:35.633072+0000","last_active":"2024-09-19T12:00:36.618616+0000","last_peered":"2024-09-19T12:00:36.618616+0000","last_clean":"2024-09-19T12:00:36.618616+0000","last_became_active":"2024-09-19T11:35:35.632384+0000","last_became_peered":"2024-09-19T11:35:35.632384+0000","last_unstale":"2024-09-19T12:00:36.618616+0000","last_undegraded":"2024-09-19T12:00:36.618616+0000","last_fullsized":"2024-09-19T12:00:36.618616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:13.028878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'76","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.513933+0000","last_change":"2024-09-19T11:35:37.642378+0000","last_active":"2024-09-19T12:03:05.513933+0000","last_peered":"2024-09-19T12:03:05.513933+0000","last_clean":"2024-09-19T12:03:05.513933+0000","last_became_active":"2024-09-19T11:35:37.641603+0000","last_became_peered":"2024-09-19T11:35:37.641603+0000","last_unstale":"2024-09-19T12:03:05.513933+0000","last_undegraded":"2024-09-19T12:03:05.513933+0000","last_fullsized":"2024-09-19T12:03:05.513933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:06.984305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":118,"num_read_kb":160,"num_write":100,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.573467+0000","last_change":"2024-09-19T11:35:39.684040+0000","last_active":"2024-09-19T11:58:11.573467+0000","last_peered":"2024-09-19T11:58:11.573467+0000","last_clean":"2024-09-19T11:58:11.573467+0000","last_became_active":"2024-09-19T11:35:39.683564+0000","last_became_peered":"2024-09-19T11:35:39.683564+0000","last_unstale":"2024-09-19T11:58:11.573467+0000","last_undegraded":"2024-09-19T11:58:11.573467+0000","last_fullsized":"2024-09-19T11:58:11.573467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:14.462022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'25","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.989255+0000","last_change":"2024-09-19T11:35:41.665955+0000","last_active":"2024-09-19T12:02:32.989255+0000","last_peered":"2024-09-19T12:02:32.989255+0000","last_clean":"2024-09-19T12:02:32.989255+0000","last_became_active":"2024-09-19T11:35:41.665262+0000","last_became_peered":"2024-09-19T11:35:41.665262+0000","last_unstale":"2024-09-19T12:02:32.989255+0000","last_undegraded":"2024-09-19T12:02:32.989255+0000","last_fullsized":"2024-09-19T12:02:32.989255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:27.405987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":132,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'2","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.197011+0000","last_change":"2024-09-19T11:35:33.614188+0000","last_active":"2024-09-19T12:02:33.197011+0000","last_peered":"2024-09-19T12:02:33.197011+0000","last_clean":"2024-09-19T12:02:33.197011+0000","last_became_active":"2024-09-19T11:35:33.613712+0000","last_became_peered":"2024-09-19T11:35:33.613712+0000","last_unstale":"2024-09-19T12:02:33.197011+0000","last_undegraded":"2024-09-19T12:02:33.197011+0000","last_fullsized":"2024-09-19T12:02:33.197011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:35.628949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'48","reported_seq":572,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.722883+0000","last_change":"2024-09-19T11:35:31.580900+0000","last_active":"2024-09-19T12:03:05.722883+0000","last_peered":"2024-09-19T12:03:05.722883+0000","last_clean":"2024-09-19T12:03:05.722883+0000","last_became_active":"2024-09-19T11:35:31.579680+0000","last_became_peered":"2024-09-19T11:35:31.579680+0000","last_unstale":"2024-09-19T12:03:05.722883+0000","last_undegraded":"2024-09-19T12:03:05.722883+0000","last_fullsized":"2024-09-19T12:03:05.722883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:17.218721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":1771,"num_write":190,"num_write_kb":1706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.811062+0000","last_change":"2024-09-19T11:35:35.628919+0000","last_active":"2024-09-19T12:00:36.811062+0000","last_peered":"2024-09-19T12:00:36.811062+0000","last_clean":"2024-09-19T12:00:36.811062+0000","last_became_active":"2024-09-19T11:35:35.625446+0000","last_became_peered":"2024-09-19T11:35:35.625446+0000","last_unstale":"2024-09-19T12:00:36.811062+0000","last_undegraded":"2024-09-19T12:00:36.811062+0000","last_fullsized":"2024-09-19T12:00:36.811062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:40.113640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'72","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.773417+0000","last_change":"2024-09-19T11:35:37.617373+0000","last_active":"2024-09-19T12:03:05.773417+0000","last_peered":"2024-09-19T12:03:05.773417+0000","last_clean":"2024-09-19T12:03:05.773417+0000","last_became_active":"2024-09-19T11:35:37.616602+0000","last_became_peered":"2024-09-19T11:35:37.616602+0000","last_unstale":"2024-09-19T12:03:05.773417+0000","last_undegraded":"2024-09-19T12:03:05.773417+0000","last_fullsized":"2024-09-19T12:03:05.773417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:47.275427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4880,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":165,"num_write":74,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.594472+0000","last_change":"2024-09-19T11:35:39.686747+0000","last_active":"2024-09-19T11:59:46.594472+0000","last_peered":"2024-09-19T11:59:46.594472+0000","last_clean":"2024-09-19T11:59:46.594472+0000","last_became_active":"2024-09-19T11:35:39.686225+0000","last_became_peered":"2024-09-19T11:35:39.686225+0000","last_unstale":"2024-09-19T11:59:46.594472+0000","last_undegraded":"2024-09-19T11:59:46.594472+0000","last_fullsized":"2024-09-19T11:59:46.594472+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:38.757638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"256'2","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.596457+0000","last_change":"2024-09-19T11:35:41.683491+0000","last_active":"2024-09-19T11:59:01.596457+0000","last_peered":"2024-09-19T11:59:01.596457+0000","last_clean":"2024-09-19T11:59:01.596457+0000","last_became_active":"2024-09-19T11:35:41.682440+0000","last_became_peered":"2024-09-19T11:35:41.682440+0000","last_unstale":"2024-09-19T11:59:01.596457+0000","last_undegraded":"2024-09-19T11:59:01.596457+0000","last_fullsized":"2024-09-19T11:59:01.596457+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:15.584265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'93","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:17.732716+0000","last_change":"2024-09-19T11:35:33.605732+0000","last_active":"2024-09-19T12:02:17.732716+0000","last_peered":"2024-09-19T12:02:17.732716+0000","last_clean":"2024-09-19T12:02:17.732716+0000","last_became_active":"2024-09-19T11:35:33.605161+0000","last_became_peered":"2024-09-19T11:35:33.605161+0000","last_unstale":"2024-09-19T12:02:17.732716+0000","last_undegraded":"2024-09-19T12:02:17.732716+0000","last_fullsized":"2024-09-19T12:02:17.732716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:47.784644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":359,"num_read_kb":288,"num_write":158,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'32","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.881788+0000","last_change":"2024-09-19T11:35:31.602820+0000","last_active":"2024-09-19T12:03:05.881788+0000","last_peered":"2024-09-19T12:03:05.881788+0000","last_clean":"2024-09-19T12:03:05.881788+0000","last_became_active":"2024-09-19T11:35:31.602466+0000","last_became_peered":"2024-09-19T11:35:31.602466+0000","last_unstale":"2024-09-19T12:03:05.881788+0000","last_undegraded":"2024-09-19T12:03:05.881788+0000","last_fullsized":"2024-09-19T12:03:05.881788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:21.152956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":124,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.606275+0000","last_change":"2024-09-19T11:35:35.632089+0000","last_active":"2024-09-19T12:00:36.606275+0000","last_peered":"2024-09-19T12:00:36.606275+0000","last_clean":"2024-09-19T12:00:36.606275+0000","last_became_active":"2024-09-19T11:35:35.631573+0000","last_became_peered":"2024-09-19T11:35:35.631573+0000","last_unstale":"2024-09-19T12:00:36.606275+0000","last_undegraded":"2024-09-19T12:00:36.606275+0000","last_fullsized":"2024-09-19T12:00:36.606275+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:57.000282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'40","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.798513+0000","last_change":"2024-09-19T11:35:37.633680+0000","last_active":"2024-09-19T11:59:41.798513+0000","last_peered":"2024-09-19T11:59:41.798513+0000","last_clean":"2024-09-19T11:59:41.798513+0000","last_became_active":"2024-09-19T11:35:37.632562+0000","last_became_peered":"2024-09-19T11:35:37.632562+0000","last_unstale":"2024-09-19T11:59:41.798513+0000","last_undegraded":"2024-09-19T11:59:41.798513+0000","last_fullsized":"2024-09-19T11:59:41.798513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:18.066710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":55,"num_read_kb":48,"num_write":46,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'617","reported_seq":1540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.301211+0000","last_change":"2024-09-19T11:35:39.660361+0000","last_active":"2024-09-19T12:03:05.301211+0000","last_peered":"2024-09-19T12:03:05.301211+0000","last_clean":"2024-09-19T12:03:05.301211+0000","last_became_active":"2024-09-19T11:35:39.659602+0000","last_became_peered":"2024-09-19T11:35:39.659602+0000","last_unstale":"2024-09-19T12:03:05.301211+0000","last_undegraded":"2024-09-19T12:03:05.301211+0000","last_fullsized":"2024-09-19T12:03:05.301211+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:19.524182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'7","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.600833+0000","last_change":"2024-09-19T11:35:41.682361+0000","last_active":"2024-09-19T11:59:01.600833+0000","last_peered":"2024-09-19T11:59:01.600833+0000","last_clean":"2024-09-19T11:59:01.600833+0000","last_became_active":"2024-09-19T11:35:41.681567+0000","last_became_peered":"2024-09-19T11:35:41.681567+0000","last_unstale":"2024-09-19T11:59:01.600833+0000","last_undegraded":"2024-09-19T11:59:01.600833+0000","last_fullsized":"2024-09-19T11:59:01.600833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:05.849048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'69","reported_seq":568,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.811015+0000","last_change":"2024-09-19T11:35:33.618140+0000","last_active":"2024-09-19T12:00:36.811015+0000","last_peered":"2024-09-19T12:00:36.811015+0000","last_clean":"2024-09-19T12:00:36.811015+0000","last_became_active":"2024-09-19T11:35:33.617414+0000","last_became_peered":"2024-09-19T11:35:33.617414+0000","last_unstale":"2024-09-19T12:00:36.811015+0000","last_undegraded":"2024-09-19T12:00:36.811015+0000","last_fullsized":"2024-09-19T12:00:36.811015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:12.877192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":201,"num_write":115,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'34","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.909945+0000","last_change":"2024-09-19T11:35:31.620319+0000","last_active":"2024-09-19T12:03:05.909945+0000","last_peered":"2024-09-19T12:03:05.909945+0000","last_clean":"2024-09-19T12:03:05.909945+0000","last_became_active":"2024-09-19T11:35:31.613260+0000","last_became_peered":"2024-09-19T11:35:31.613260+0000","last_unstale":"2024-09-19T12:03:05.909945+0000","last_undegraded":"2024-09-19T12:03:05.909945+0000","last_fullsized":"2024-09-19T12:03:05.909945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:43.808702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":9290,"num_write":82,"num_write_kb":7234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.621410+0000","last_change":"2024-09-19T11:35:35.618214+0000","last_active":"2024-09-19T12:00:36.621410+0000","last_peered":"2024-09-19T12:00:36.621410+0000","last_clean":"2024-09-19T12:00:36.621410+0000","last_became_active":"2024-09-19T11:35:35.617489+0000","last_became_peered":"2024-09-19T11:35:35.617489+0000","last_unstale":"2024-09-19T12:00:36.621410+0000","last_undegraded":"2024-09-19T12:00:36.621410+0000","last_fullsized":"2024-09-19T12:00:36.621410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:05.845518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'91","reported_seq":598,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.865956+0000","last_change":"2024-09-19T11:35:37.625579+0000","last_active":"2024-09-19T12:03:05.865956+0000","last_peered":"2024-09-19T12:03:05.865956+0000","last_clean":"2024-09-19T12:03:05.865956+0000","last_became_active":"2024-09-19T11:35:37.624101+0000","last_became_peered":"2024-09-19T11:35:37.624101+0000","last_unstale":"2024-09-19T12:03:05.865956+0000","last_undegraded":"2024-09-19T12:03:05.865956+0000","last_fullsized":"2024-09-19T12:03:05.865956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:13:17.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4425,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":123,"num_read_kb":188,"num_write":92,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.608983+0000","last_change":"2024-09-19T11:35:39.674060+0000","last_active":"2024-09-19T11:59:51.608983+0000","last_peered":"2024-09-19T11:59:51.608983+0000","last_clean":"2024-09-19T11:59:51.608983+0000","last_became_active":"2024-09-19T11:35:39.671474+0000","last_became_peered":"2024-09-19T11:35:39.671474+0000","last_unstale":"2024-09-19T11:59:51.608983+0000","last_undegraded":"2024-09-19T11:59:51.608983+0000","last_fullsized":"2024-09-19T11:59:51.608983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:49.787232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'16","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611804+0000","last_change":"2024-09-19T11:35:41.694646+0000","last_active":"2024-09-19T11:59:51.611804+0000","last_peered":"2024-09-19T11:59:51.611804+0000","last_clean":"2024-09-19T11:59:51.611804+0000","last_became_active":"2024-09-19T11:35:41.693900+0000","last_became_peered":"2024-09-19T11:35:41.693900+0000","last_unstale":"2024-09-19T11:59:51.611804+0000","last_undegraded":"2024-09-19T11:59:51.611804+0000","last_fullsized":"2024-09-19T11:59:51.611804+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:06.653849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'84","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.193531+0000","last_change":"2024-09-19T11:35:33.605993+0000","last_active":"2024-09-19T12:02:33.193531+0000","last_peered":"2024-09-19T12:02:33.193531+0000","last_clean":"2024-09-19T12:02:33.193531+0000","last_became_active":"2024-09-19T11:35:33.605259+0000","last_became_peered":"2024-09-19T11:35:33.605259+0000","last_unstale":"2024-09-19T12:02:33.193531+0000","last_undegraded":"2024-09-19T12:02:33.193531+0000","last_fullsized":"2024-09-19T12:02:33.193531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:43.033562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":291,"num_write":128,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'46","reported_seq":570,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.908490+0000","last_change":"2024-09-19T11:35:31.623300+0000","last_active":"2024-09-19T12:03:05.908490+0000","last_peered":"2024-09-19T12:03:05.908490+0000","last_clean":"2024-09-19T12:03:05.908490+0000","last_became_active":"2024-09-19T11:35:31.622688+0000","last_became_peered":"2024-09-19T11:35:31.622688+0000","last_unstale":"2024-09-19T12:03:05.908490+0000","last_undegraded":"2024-09-19T12:03:05.908490+0000","last_fullsized":"2024-09-19T12:03:05.908490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:48.009120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":10950,"num_write":217,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.617902+0000","last_change":"2024-09-19T11:35:35.622260+0000","last_active":"2024-09-19T12:00:36.617902+0000","last_peered":"2024-09-19T12:00:36.617902+0000","last_clean":"2024-09-19T12:00:36.617902+0000","last_became_active":"2024-09-19T11:35:35.621518+0000","last_became_peered":"2024-09-19T11:35:35.621518+0000","last_unstale":"2024-09-19T12:00:36.617902+0000","last_undegraded":"2024-09-19T12:00:36.617902+0000","last_fullsized":"2024-09-19T12:00:36.617902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:30.262378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'92","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.886317+0000","last_change":"2024-09-19T11:35:37.641470+0000","last_active":"2024-09-19T12:03:05.886317+0000","last_peered":"2024-09-19T12:03:05.886317+0000","last_clean":"2024-09-19T12:03:05.886317+0000","last_became_active":"2024-09-19T11:35:37.639833+0000","last_became_peered":"2024-09-19T11:35:37.639833+0000","last_unstale":"2024-09-19T12:03:05.886317+0000","last_undegraded":"2024-09-19T12:03:05.886317+0000","last_fullsized":"2024-09-19T12:03:05.886317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:25.377817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5142,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":105,"num_read_kb":164,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":470,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.609264+0000","last_change":"2024-09-19T11:35:39.659799+0000","last_active":"2024-09-19T11:59:56.609264+0000","last_peered":"2024-09-19T11:59:56.609264+0000","last_clean":"2024-09-19T11:59:56.609264+0000","last_became_active":"2024-09-19T11:35:39.659011+0000","last_became_peered":"2024-09-19T11:35:39.659011+0000","last_unstale":"2024-09-19T11:59:56.609264+0000","last_undegraded":"2024-09-19T11:59:56.609264+0000","last_fullsized":"2024-09-19T11:59:56.609264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:33.261718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'15","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.603923+0000","last_change":"2024-09-19T11:35:41.675429+0000","last_active":"2024-09-19T11:59:51.603923+0000","last_peered":"2024-09-19T11:59:51.603923+0000","last_clean":"2024-09-19T11:59:51.603923+0000","last_became_active":"2024-09-19T11:35:41.674818+0000","last_became_peered":"2024-09-19T11:35:41.674818+0000","last_unstale":"2024-09-19T11:59:51.603923+0000","last_undegraded":"2024-09-19T11:59:51.603923+0000","last_fullsized":"2024-09-19T11:59:51.603923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:12.876595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":90,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'44","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.603738+0000","last_change":"2024-09-19T11:35:33.603965+0000","last_active":"2024-09-19T11:59:51.603738+0000","last_peered":"2024-09-19T11:59:51.603738+0000","last_clean":"2024-09-19T11:59:51.603738+0000","last_became_active":"2024-09-19T11:35:33.603610+0000","last_became_peered":"2024-09-19T11:35:33.603610+0000","last_unstale":"2024-09-19T11:59:51.603738+0000","last_undegraded":"2024-09-19T11:59:51.603738+0000","last_fullsized":"2024-09-19T11:59:51.603738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:56.366121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":138,"num_write":82,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'50","reported_seq":564,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.850133+0000","last_change":"2024-09-19T11:35:31.621194+0000","last_active":"2024-09-19T12:03:05.850133+0000","last_peered":"2024-09-19T12:03:05.850133+0000","last_clean":"2024-09-19T12:03:05.850133+0000","last_became_active":"2024-09-19T11:35:31.620504+0000","last_became_peered":"2024-09-19T11:35:31.620504+0000","last_unstale":"2024-09-19T12:03:05.850133+0000","last_undegraded":"2024-09-19T12:03:05.850133+0000","last_fullsized":"2024-09-19T12:03:05.850133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:59.865113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":1683,"num_write":177,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.799503+0000","last_change":"2024-09-19T11:35:35.624137+0000","last_active":"2024-09-19T11:59:46.799503+0000","last_peered":"2024-09-19T11:59:46.799503+0000","last_clean":"2024-09-19T11:59:46.799503+0000","last_became_active":"2024-09-19T11:35:35.623348+0000","last_became_peered":"2024-09-19T11:35:35.623348+0000","last_unstale":"2024-09-19T11:59:46.799503+0000","last_undegraded":"2024-09-19T11:59:46.799503+0000","last_fullsized":"2024-09-19T11:59:46.799503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:43.589134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'43","reported_seq":539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.745265+0000","last_change":"2024-09-19T11:35:37.643750+0000","last_active":"2024-09-19T12:03:05.745265+0000","last_peered":"2024-09-19T12:03:05.745265+0000","last_clean":"2024-09-19T12:03:05.745265+0000","last_became_active":"2024-09-19T11:35:37.643249+0000","last_became_peered":"2024-09-19T11:35:37.643249+0000","last_unstale":"2024-09-19T12:03:05.745265+0000","last_undegraded":"2024-09-19T12:03:05.745265+0000","last_fullsized":"2024-09-19T12:03:05.745265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:36.730823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":104,"num_write":42,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.778397+0000","last_change":"2024-09-19T11:35:39.675950+0000","last_active":"2024-09-19T11:58:11.778397+0000","last_peered":"2024-09-19T11:58:11.778397+0000","last_clean":"2024-09-19T11:58:11.778397+0000","last_became_active":"2024-09-19T11:35:39.675285+0000","last_became_peered":"2024-09-19T11:35:39.675285+0000","last_unstale":"2024-09-19T11:58:11.778397+0000","last_undegraded":"2024-09-19T11:58:11.778397+0000","last_fullsized":"2024-09-19T11:58:11.778397+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:52.963177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'22","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.336022+0000","last_change":"2024-09-19T11:35:41.695355+0000","last_active":"2024-09-19T12:00:06.336022+0000","last_peered":"2024-09-19T12:00:06.336022+0000","last_clean":"2024-09-19T12:00:06.336022+0000","last_became_active":"2024-09-19T11:35:41.694201+0000","last_became_peered":"2024-09-19T11:35:41.694201+0000","last_unstale":"2024-09-19T12:00:06.336022+0000","last_undegraded":"2024-09-19T12:00:06.336022+0000","last_fullsized":"2024-09-19T12:00:06.336022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:09.844137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":56,"num_write":68,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'84","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.162209+0000","last_change":"2024-09-19T11:35:33.629309+0000","last_active":"2024-09-19T12:02:33.162209+0000","last_peered":"2024-09-19T12:02:33.162209+0000","last_clean":"2024-09-19T12:02:33.162209+0000","last_became_active":"2024-09-19T11:35:33.628283+0000","last_became_peered":"2024-09-19T11:35:33.628283+0000","last_unstale":"2024-09-19T12:02:33.162209+0000","last_undegraded":"2024-09-19T12:02:33.162209+0000","last_fullsized":"2024-09-19T12:02:33.162209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:35.386501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":329,"num_read_kb":270,"num_write":117,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'31","reported_seq":543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.925514+0000","last_change":"2024-09-19T11:36:06.650917+0000","last_active":"2024-09-19T12:03:05.925514+0000","last_peered":"2024-09-19T12:03:05.925514+0000","last_clean":"2024-09-19T12:03:05.925514+0000","last_became_active":"2024-09-19T11:36:06.649652+0000","last_became_peered":"2024-09-19T11:36:06.649652+0000","last_unstale":"2024-09-19T12:03:05.925514+0000","last_undegraded":"2024-09-19T12:03:05.925514+0000","last_fullsized":"2024-09-19T12:03:05.925514+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:48.816823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079957,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":43,"num_read_kb":1095,"num_write":138,"num_write_kb":1067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,7],"acting":[0,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.595482+0000","last_change":"2024-09-19T11:35:35.612806+0000","last_active":"2024-09-19T11:59:51.595482+0000","last_peered":"2024-09-19T11:59:51.595482+0000","last_clean":"2024-09-19T11:59:51.595482+0000","last_became_active":"2024-09-19T11:35:35.612450+0000","last_became_peered":"2024-09-19T11:35:35.612450+0000","last_unstale":"2024-09-19T11:59:51.595482+0000","last_undegraded":"2024-09-19T11:59:51.595482+0000","last_fullsized":"2024-09-19T11:59:51.595482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:02.776959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'90","reported_seq":607,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.783528+0000","last_change":"2024-09-19T11:35:37.639560+0000","last_active":"2024-09-19T12:03:05.783528+0000","last_peered":"2024-09-19T12:03:05.783528+0000","last_clean":"2024-09-19T12:03:05.783528+0000","last_became_active":"2024-09-19T11:35:37.638771+0000","last_became_peered":"2024-09-19T11:35:37.638771+0000","last_unstale":"2024-09-19T12:03:05.783528+0000","last_undegraded":"2024-09-19T12:03:05.783528+0000","last_fullsized":"2024-09-19T12:03:05.783528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:56.133473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4489,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":185,"num_write":92,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:11.585939+0000","last_change":"2024-09-19T11:35:39.663318+0000","last_active":"2024-09-19T11:58:11.585939+0000","last_peered":"2024-09-19T11:58:11.585939+0000","last_clean":"2024-09-19T11:58:11.585939+0000","last_became_active":"2024-09-19T11:35:39.662405+0000","last_became_peered":"2024-09-19T11:35:39.662405+0000","last_unstale":"2024-09-19T11:58:11.585939+0000","last_undegraded":"2024-09-19T11:58:11.585939+0000","last_fullsized":"2024-09-19T11:58:11.585939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:58.275311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"253'4","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.789890+0000","last_change":"2024-09-19T11:35:41.688704+0000","last_active":"2024-09-19T11:59:01.789890+0000","last_peered":"2024-09-19T11:59:01.789890+0000","last_clean":"2024-09-19T11:59:01.789890+0000","last_became_active":"2024-09-19T11:35:41.687549+0000","last_became_peered":"2024-09-19T11:35:41.687549+0000","last_unstale":"2024-09-19T11:59:01.789890+0000","last_undegraded":"2024-09-19T11:59:01.789890+0000","last_fullsized":"2024-09-19T11:59:01.789890+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:56.527265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'79","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.346041+0000","last_change":"2024-09-19T11:35:33.629428+0000","last_active":"2024-09-19T12:00:06.346041+0000","last_peered":"2024-09-19T12:00:06.346041+0000","last_clean":"2024-09-19T12:00:06.346041+0000","last_became_active":"2024-09-19T11:35:33.629186+0000","last_became_peered":"2024-09-19T11:35:33.629186+0000","last_unstale":"2024-09-19T12:00:06.346041+0000","last_undegraded":"2024-09-19T12:00:06.346041+0000","last_fullsized":"2024-09-19T12:00:06.346041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:40.061077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":235,"num_write":161,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'77","reported_seq":595,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.890540+0000","last_change":"2024-09-19T11:35:31.613416+0000","last_active":"2024-09-19T12:03:05.890540+0000","last_peered":"2024-09-19T12:03:05.890540+0000","last_clean":"2024-09-19T12:03:05.890540+0000","last_became_active":"2024-09-19T11:35:31.611719+0000","last_became_peered":"2024-09-19T11:35:31.611719+0000","last_unstale":"2024-09-19T12:03:05.890540+0000","last_undegraded":"2024-09-19T12:03:05.890540+0000","last_fullsized":"2024-09-19T12:03:05.890540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:31.214410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":5196,"num_write":200,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"253'355","reported_seq":1052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.589820+0000","last_change":"2024-09-19T11:35:33.606387+0000","last_active":"2024-09-19T11:59:26.589820+0000","last_peered":"2024-09-19T11:59:26.589820+0000","last_clean":"2024-09-19T11:59:26.589820+0000","last_became_active":"2024-09-19T11:35:33.603938+0000","last_became_peered":"2024-09-19T11:35:33.603938+0000","last_unstale":"2024-09-19T11:59:26.589820+0000","last_undegraded":"2024-09-19T11:59:26.589820+0000","last_fullsized":"2024-09-19T11:59:26.589820+0000","mapping_epoch":28,"log_start":"253'300","ondisk_log_start":"253'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:36.334582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1936,"num_read_kb":1745,"num_write":575,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'39","reported_seq":555,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.786309+0000","last_change":"2024-09-19T11:35:31.602514+0000","last_active":"2024-09-19T12:03:05.786309+0000","last_peered":"2024-09-19T12:03:05.786309+0000","last_clean":"2024-09-19T12:03:05.786309+0000","last_became_active":"2024-09-19T11:35:31.602046+0000","last_became_peered":"2024-09-19T11:35:31.602046+0000","last_unstale":"2024-09-19T12:03:05.786309+0000","last_undegraded":"2024-09-19T12:03:05.786309+0000","last_fullsized":"2024-09-19T12:03:05.786309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:30.711983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":1671,"num_write":116,"num_write_kb":1627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'4","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.168487+0000","last_change":"2024-09-19T11:35:33.617890+0000","last_active":"2024-09-19T12:02:33.168487+0000","last_peered":"2024-09-19T12:02:33.168487+0000","last_clean":"2024-09-19T12:02:33.168487+0000","last_became_active":"2024-09-19T11:35:33.616104+0000","last_became_peered":"2024-09-19T11:35:33.616104+0000","last_unstale":"2024-09-19T12:02:33.168487+0000","last_undegraded":"2024-09-19T12:02:33.168487+0000","last_fullsized":"2024-09-19T12:02:33.168487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:20.380664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'37","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.895397+0000","last_change":"2024-09-19T11:35:31.620857+0000","last_active":"2024-09-19T12:03:05.895397+0000","last_peered":"2024-09-19T12:03:05.895397+0000","last_clean":"2024-09-19T12:03:05.895397+0000","last_became_active":"2024-09-19T11:35:31.613195+0000","last_became_peered":"2024-09-19T11:35:31.613195+0000","last_unstale":"2024-09-19T12:03:05.895397+0000","last_undegraded":"2024-09-19T12:03:05.895397+0000","last_fullsized":"2024-09-19T12:03:05.895397+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:06.230787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":62,"num_read_kb":44,"num_write":136,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'20","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:36.618841+0000","last_change":"2024-09-19T11:35:33.619576+0000","last_active":"2024-09-19T12:01:36.618841+0000","last_peered":"2024-09-19T12:01:36.618841+0000","last_clean":"2024-09-19T12:01:36.618841+0000","last_became_active":"2024-09-19T11:35:33.619302+0000","last_became_peered":"2024-09-19T11:35:33.619302+0000","last_unstale":"2024-09-19T12:01:36.618841+0000","last_undegraded":"2024-09-19T12:01:36.618841+0000","last_fullsized":"2024-09-19T12:01:36.618841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:20.380664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'66","reported_seq":598,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.740916+0000","last_change":"2024-09-19T11:35:31.591076+0000","last_active":"2024-09-19T12:03:05.740916+0000","last_peered":"2024-09-19T12:03:05.740916+0000","last_clean":"2024-09-19T12:03:05.740916+0000","last_became_active":"2024-09-19T11:35:31.590651+0000","last_became_peered":"2024-09-19T11:35:31.590651+0000","last_unstale":"2024-09-19T12:03:05.740916+0000","last_undegraded":"2024-09-19T12:03:05.740916+0000","last_fullsized":"2024-09-19T12:03:05.740916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:43.726265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":163,"num_read_kb":1977,"num_write":243,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615123+0000","last_change":"2024-09-19T11:35:33.619828+0000","last_active":"2024-09-19T12:00:41.615123+0000","last_peered":"2024-09-19T12:00:41.615123+0000","last_clean":"2024-09-19T12:00:41.615123+0000","last_became_active":"2024-09-19T11:35:33.619372+0000","last_became_peered":"2024-09-19T11:35:33.619372+0000","last_unstale":"2024-09-19T12:00:41.615123+0000","last_undegraded":"2024-09-19T12:00:41.615123+0000","last_fullsized":"2024-09-19T12:00:41.615123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:25.554628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'17","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.910843+0000","last_change":"2024-09-19T11:35:31.584872+0000","last_active":"2024-09-19T12:03:05.910843+0000","last_peered":"2024-09-19T12:03:05.910843+0000","last_clean":"2024-09-19T12:03:05.910843+0000","last_became_active":"2024-09-19T11:35:31.584316+0000","last_became_peered":"2024-09-19T11:35:31.584316+0000","last_unstale":"2024-09-19T12:03:05.910843+0000","last_undegraded":"2024-09-19T12:03:05.910843+0000","last_fullsized":"2024-09-19T12:03:05.910843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:53.681623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079915,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":1065,"num_write":66,"num_write_kb":1060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810904+0000","last_change":"2024-09-19T11:35:33.627636+0000","last_active":"2024-09-19T12:00:36.810904+0000","last_peered":"2024-09-19T12:00:36.810904+0000","last_clean":"2024-09-19T12:00:36.810904+0000","last_became_active":"2024-09-19T11:35:33.626872+0000","last_became_peered":"2024-09-19T11:35:33.626872+0000","last_unstale":"2024-09-19T12:00:36.810904+0000","last_undegraded":"2024-09-19T12:00:36.810904+0000","last_fullsized":"2024-09-19T12:00:36.810904+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:36.325211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'31","reported_seq":540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.844867+0000","last_change":"2024-09-19T11:35:31.592141+0000","last_active":"2024-09-19T12:03:05.844867+0000","last_peered":"2024-09-19T12:03:05.844867+0000","last_clean":"2024-09-19T12:03:05.844867+0000","last_became_active":"2024-09-19T11:35:31.591724+0000","last_became_peered":"2024-09-19T11:35:31.591724+0000","last_unstale":"2024-09-19T12:03:05.844867+0000","last_undegraded":"2024-09-19T12:03:05.844867+0000","last_fullsized":"2024-09-19T12:03:05.844867+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:35.585870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079955,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":1149,"num_write":140,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'52","reported_seq":560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.197816+0000","last_change":"2024-09-19T11:35:33.614983+0000","last_active":"2024-09-19T12:02:33.197816+0000","last_peered":"2024-09-19T12:02:33.197816+0000","last_clean":"2024-09-19T12:02:33.197816+0000","last_became_active":"2024-09-19T11:35:33.614316+0000","last_became_peered":"2024-09-19T11:35:33.614316+0000","last_unstale":"2024-09-19T12:02:33.197816+0000","last_undegraded":"2024-09-19T12:02:33.197816+0000","last_fullsized":"2024-09-19T12:02:33.197816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:38.763908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":175,"num_write":74,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'46","reported_seq":557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.808739+0000","last_change":"2024-09-19T11:35:31.613679+0000","last_active":"2024-09-19T12:03:05.808739+0000","last_peered":"2024-09-19T12:03:05.808739+0000","last_clean":"2024-09-19T12:03:05.808739+0000","last_became_active":"2024-09-19T11:35:31.612367+0000","last_became_peered":"2024-09-19T11:35:31.612367+0000","last_unstale":"2024-09-19T12:03:05.808739+0000","last_undegraded":"2024-09-19T12:03:05.808739+0000","last_fullsized":"2024-09-19T12:03:05.808739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:21.506300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":319,"num_write":186,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'50","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618415+0000","last_change":"2024-09-19T11:35:33.625962+0000","last_active":"2024-09-19T12:00:36.618415+0000","last_peered":"2024-09-19T12:00:36.618415+0000","last_clean":"2024-09-19T12:00:36.618415+0000","last_became_active":"2024-09-19T11:35:33.625249+0000","last_became_peered":"2024-09-19T11:35:33.625249+0000","last_unstale":"2024-09-19T12:00:36.618415+0000","last_undegraded":"2024-09-19T12:00:36.618415+0000","last_fullsized":"2024-09-19T12:00:36.618415+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:54.254614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":159,"num_write":74,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'52","reported_seq":568,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.948610+0000","last_change":"2024-09-19T11:35:31.589092+0000","last_active":"2024-09-19T12:03:05.948610+0000","last_peered":"2024-09-19T12:03:05.948610+0000","last_clean":"2024-09-19T12:03:05.948610+0000","last_became_active":"2024-09-19T11:35:31.588705+0000","last_became_peered":"2024-09-19T11:35:31.588705+0000","last_unstale":"2024-09-19T12:03:05.948610+0000","last_undegraded":"2024-09-19T12:03:05.948610+0000","last_fullsized":"2024-09-19T12:03:05.948610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:23.530669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":83,"num_read_kb":4157,"num_write":184,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'73","reported_seq":570,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.596172+0000","last_change":"2024-09-19T11:35:33.626308+0000","last_active":"2024-09-19T11:58:56.596172+0000","last_peered":"2024-09-19T11:58:56.596172+0000","last_clean":"2024-09-19T11:58:56.596172+0000","last_became_active":"2024-09-19T11:35:33.625874+0000","last_became_peered":"2024-09-19T11:35:33.625874+0000","last_unstale":"2024-09-19T11:58:56.596172+0000","last_undegraded":"2024-09-19T11:58:56.596172+0000","last_fullsized":"2024-09-19T11:58:56.596172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:34.524797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":214,"num_write":124,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'30","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.940920+0000","last_change":"2024-09-19T11:35:31.594437+0000","last_active":"2024-09-19T12:03:05.940920+0000","last_peered":"2024-09-19T12:03:05.940920+0000","last_clean":"2024-09-19T12:03:05.940920+0000","last_became_active":"2024-09-19T11:35:31.593067+0000","last_became_peered":"2024-09-19T11:35:31.593067+0000","last_unstale":"2024-09-19T12:03:05.940920+0000","last_undegraded":"2024-09-19T12:03:05.940920+0000","last_fullsized":"2024-09-19T12:03:05.940920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:39.500525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079937,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":48,"num_read_kb":1085,"num_write":114,"num_write_kb":1065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.788881+0000","last_change":"2024-09-19T11:35:33.613879+0000","last_active":"2024-09-19T11:58:56.788881+0000","last_peered":"2024-09-19T11:58:56.788881+0000","last_clean":"2024-09-19T11:58:56.788881+0000","last_became_active":"2024-09-19T11:35:33.612924+0000","last_became_peered":"2024-09-19T11:35:33.612924+0000","last_unstale":"2024-09-19T11:58:56.788881+0000","last_undegraded":"2024-09-19T11:58:56.788881+0000","last_fullsized":"2024-09-19T11:58:56.788881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:49.021618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'63","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.929694+0000","last_change":"2024-09-19T11:35:31.581801+0000","last_active":"2024-09-19T12:03:05.929694+0000","last_peered":"2024-09-19T12:03:05.929694+0000","last_clean":"2024-09-19T12:03:05.929694+0000","last_became_active":"2024-09-19T11:35:31.581058+0000","last_became_peered":"2024-09-19T11:35:31.581058+0000","last_unstale":"2024-09-19T12:03:05.929694+0000","last_undegraded":"2024-09-19T12:03:05.929694+0000","last_fullsized":"2024-09-19T12:03:05.929694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:01.730787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":310,"num_write":200,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'63","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603171+0000","last_change":"2024-09-19T11:35:33.628641+0000","last_active":"2024-09-19T12:00:26.603171+0000","last_peered":"2024-09-19T12:00:26.603171+0000","last_clean":"2024-09-19T12:00:26.603171+0000","last_became_active":"2024-09-19T11:35:33.628335+0000","last_became_peered":"2024-09-19T11:35:33.628335+0000","last_unstale":"2024-09-19T12:00:26.603171+0000","last_undegraded":"2024-09-19T12:00:26.603171+0000","last_fullsized":"2024-09-19T12:00:26.603171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:30.155543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":184,"num_write":116,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'40","reported_seq":552,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.678515+0000","last_change":"2024-09-19T11:35:31.624411+0000","last_active":"2024-09-19T12:03:05.678515+0000","last_peered":"2024-09-19T12:03:05.678515+0000","last_clean":"2024-09-19T12:03:05.678515+0000","last_became_active":"2024-09-19T11:35:31.623733+0000","last_became_peered":"2024-09-19T11:35:31.623733+0000","last_unstale":"2024-09-19T12:03:05.678515+0000","last_undegraded":"2024-09-19T12:03:05.678515+0000","last_fullsized":"2024-09-19T12:03:05.678515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:54.808464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159904,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":74,"num_read_kb":2163,"num_write":163,"num_write_kb":2120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'85","reported_seq":599,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807456+0000","last_change":"2024-09-19T11:35:33.628930+0000","last_active":"2024-09-19T12:00:21.807456+0000","last_peered":"2024-09-19T12:00:21.807456+0000","last_clean":"2024-09-19T12:00:21.807456+0000","last_became_active":"2024-09-19T11:35:33.628184+0000","last_became_peered":"2024-09-19T11:35:33.628184+0000","last_unstale":"2024-09-19T12:00:21.807456+0000","last_undegraded":"2024-09-19T12:00:21.807456+0000","last_fullsized":"2024-09-19T12:00:21.807456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:43.237383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":344,"num_read_kb":269,"num_write":142,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'57","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.812824+0000","last_change":"2024-09-19T11:35:31.613045+0000","last_active":"2024-09-19T12:03:05.812824+0000","last_peered":"2024-09-19T12:03:05.812824+0000","last_clean":"2024-09-19T12:03:05.812824+0000","last_became_active":"2024-09-19T11:35:31.612601+0000","last_became_peered":"2024-09-19T11:35:31.612601+0000","last_unstale":"2024-09-19T12:03:05.812824+0000","last_undegraded":"2024-09-19T12:03:05.812824+0000","last_fullsized":"2024-09-19T12:03:05.812824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:35.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":6286,"num_write":172,"num_write_kb":11381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'7","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:25.789799+0000","last_change":"2024-09-19T11:35:33.624908+0000","last_active":"2024-09-19T12:02:25.789799+0000","last_peered":"2024-09-19T12:02:25.789799+0000","last_clean":"2024-09-19T12:02:25.789799+0000","last_became_active":"2024-09-19T11:35:33.624149+0000","last_became_peered":"2024-09-19T11:35:33.624149+0000","last_unstale":"2024-09-19T12:02:25.789799+0000","last_undegraded":"2024-09-19T12:02:25.789799+0000","last_fullsized":"2024-09-19T12:02:25.789799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:05.347375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'34","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.812522+0000","last_change":"2024-09-19T11:35:31.610796+0000","last_active":"2024-09-19T12:03:05.812522+0000","last_peered":"2024-09-19T12:03:05.812522+0000","last_clean":"2024-09-19T12:03:05.812522+0000","last_became_active":"2024-09-19T11:35:31.609885+0000","last_became_peered":"2024-09-19T11:35:31.609885+0000","last_unstale":"2024-09-19T12:03:05.812522+0000","last_undegraded":"2024-09-19T12:03:05.812522+0000","last_fullsized":"2024-09-19T12:03:05.812522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:34:42.272784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":83,"num_write":119,"num_write_kb":10337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'127","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.616101+0000","last_change":"2024-09-19T11:35:33.620724+0000","last_active":"2024-09-19T12:00:21.616101+0000","last_peered":"2024-09-19T12:00:21.616101+0000","last_clean":"2024-09-19T12:00:21.616101+0000","last_became_active":"2024-09-19T11:35:33.620326+0000","last_became_peered":"2024-09-19T11:35:33.620326+0000","last_unstale":"2024-09-19T12:00:21.616101+0000","last_undegraded":"2024-09-19T12:00:21.616101+0000","last_fullsized":"2024-09-19T12:00:21.616101+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:14.282141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":393,"num_write":181,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'43","reported_seq":557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.905176+0000","last_change":"2024-09-19T11:35:31.625519+0000","last_active":"2024-09-19T12:03:05.905176+0000","last_peered":"2024-09-19T12:03:05.905176+0000","last_clean":"2024-09-19T12:03:05.905176+0000","last_became_active":"2024-09-19T11:35:31.620566+0000","last_became_peered":"2024-09-19T11:35:31.620566+0000","last_unstale":"2024-09-19T12:03:05.905176+0000","last_undegraded":"2024-09-19T12:03:05.905176+0000","last_fullsized":"2024-09-19T12:03:05.905176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:37.899900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":90,"num_read_kb":69,"num_write":200,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'47","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.610388+0000","last_change":"2024-09-19T11:35:33.618657+0000","last_active":"2024-09-19T12:00:21.610388+0000","last_peered":"2024-09-19T12:00:21.610388+0000","last_clean":"2024-09-19T12:00:21.610388+0000","last_became_active":"2024-09-19T11:35:33.618247+0000","last_became_peered":"2024-09-19T11:35:33.618247+0000","last_unstale":"2024-09-19T12:00:21.610388+0000","last_undegraded":"2024-09-19T12:00:21.610388+0000","last_fullsized":"2024-09-19T12:00:21.610388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:16.980284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":141,"num_write":67,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'24","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.802644+0000","last_change":"2024-09-19T11:35:31.602891+0000","last_active":"2024-09-19T12:03:05.802644+0000","last_peered":"2024-09-19T12:03:05.802644+0000","last_clean":"2024-09-19T12:03:05.802644+0000","last_became_active":"2024-09-19T11:35:31.602248+0000","last_became_peered":"2024-09-19T11:35:31.602248+0000","last_unstale":"2024-09-19T12:03:05.802644+0000","last_undegraded":"2024-09-19T12:03:05.802644+0000","last_fullsized":"2024-09-19T12:03:05.802644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:05.964360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":5134,"num_write":78,"num_write_kb":5127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'37","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.376218+0000","last_change":"2024-09-19T11:35:33.625242+0000","last_active":"2024-09-19T12:02:19.376218+0000","last_peered":"2024-09-19T12:02:19.376218+0000","last_clean":"2024-09-19T12:02:19.376218+0000","last_became_active":"2024-09-19T11:35:33.624412+0000","last_became_peered":"2024-09-19T11:35:33.624412+0000","last_unstale":"2024-09-19T12:02:19.376218+0000","last_undegraded":"2024-09-19T12:02:19.376218+0000","last_fullsized":"2024-09-19T12:02:19.376218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:08.098513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":98,"num_write":42,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'30","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.808638+0000","last_change":"2024-09-19T11:35:31.609553+0000","last_active":"2024-09-19T12:03:05.808638+0000","last_peered":"2024-09-19T12:03:05.808638+0000","last_clean":"2024-09-19T12:03:05.808638+0000","last_became_active":"2024-09-19T11:35:31.607037+0000","last_became_peered":"2024-09-19T11:35:31.607037+0000","last_unstale":"2024-09-19T12:03:05.808638+0000","last_undegraded":"2024-09-19T12:03:05.808638+0000","last_fullsized":"2024-09-19T12:03:05.808638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:33.501423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":51,"num_read_kb":53,"num_write":115,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'42","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.792019+0000","last_change":"2024-09-19T11:35:31.608404+0000","last_active":"2024-09-19T12:03:05.792019+0000","last_peered":"2024-09-19T12:03:05.792019+0000","last_clean":"2024-09-19T12:03:05.792019+0000","last_became_active":"2024-09-19T11:35:31.607805+0000","last_became_peered":"2024-09-19T11:35:31.607805+0000","last_unstale":"2024-09-19T12:03:05.792019+0000","last_undegraded":"2024-09-19T12:03:05.792019+0000","last_fullsized":"2024-09-19T12:03:05.792019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:55.223047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":66,"num_write":147,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.609215+0000","last_change":"2024-09-19T11:35:33.630383+0000","last_active":"2024-09-19T11:59:51.609215+0000","last_peered":"2024-09-19T11:59:51.609215+0000","last_clean":"2024-09-19T11:59:51.609215+0000","last_became_active":"2024-09-19T11:35:33.630100+0000","last_became_peered":"2024-09-19T11:35:33.630100+0000","last_unstale":"2024-09-19T11:59:51.609215+0000","last_undegraded":"2024-09-19T11:59:51.609215+0000","last_fullsized":"2024-09-19T11:59:51.609215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:23.578224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'27","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.943633+0000","last_change":"2024-09-19T11:35:31.588948+0000","last_active":"2024-09-19T12:03:05.943633+0000","last_peered":"2024-09-19T12:03:05.943633+0000","last_clean":"2024-09-19T12:03:05.943633+0000","last_became_active":"2024-09-19T11:35:31.588328+0000","last_became_peered":"2024-09-19T11:35:31.588328+0000","last_unstale":"2024-09-19T12:03:05.943633+0000","last_undegraded":"2024-09-19T12:03:05.943633+0000","last_fullsized":"2024-09-19T12:03:05.943633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:30.517882+0000","last_clean_scrub_stamp":"2024-09-19T11:35:30.517882+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:49.468879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":33,"num_write":109,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'232","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:43.939022+0000","last_change":"2024-09-19T11:35:33.612825+0000","last_active":"2024-09-19T12:01:43.939022+0000","last_peered":"2024-09-19T12:01:43.939022+0000","last_clean":"2024-09-19T12:01:43.939022+0000","last_became_active":"2024-09-19T11:35:33.612152+0000","last_became_peered":"2024-09-19T11:35:33.612152+0000","last_unstale":"2024-09-19T12:01:43.939022+0000","last_undegraded":"2024-09-19T12:01:43.939022+0000","last_fullsized":"2024-09-19T12:01:43.939022+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:31.538563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":962,"num_read_kb":742,"num_write":392,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1228,"num_read_kb":871,"num_write":344,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":8631,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2810,"num_read_kb":2559,"num_write":1797,"num_write_kb":496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":17262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":694,"ondisk_log_size":694,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":155085,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":4671,"num_read_kb":6549,"num_write":3033,"num_write_kb":1354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2090,"ondisk_log_size":2090,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2082,"num_read_kb":2479,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":14003,"num_read_kb":11442,"num_write":5494,"num_write_kb":2900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2398,"ondisk_log_size":2398,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":28939990,"num_objects":275,"num_object_clones":0,"num_object_copies":1100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":275,"num_whiteouts":0,"num_read":5003,"num_read_kb":236980,"num_write":9889,"num_write_kb":271206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40419328,"data_stored":40419328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2792,"ondisk_log_size":2792,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":114698,"num_write":81,"num_write_kb":65538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":120842,"num_write":81,"num_write_kb":65538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542483,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202196,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94169644,"statfs":{"total":96636764160,"available":96429715456,"internally_reserved":0,"allocated":8683520,"data_stored":6718512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":198244810},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542482,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200416,"kb_used_data":10908,"kb_used_omap":1,"kb_used_meta":189438,"kb_avail":94171424,"statfs":{"total":96636764160,"available":96431538176,"internally_reserved":0,"allocated":11169792,"data_stored":9233803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":193984966},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542483,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58584,"kb_used_data":9248,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313256,"statfs":{"total":96636764160,"available":96576774144,"internally_reserved":0,"allocated":9469952,"data_stored":7492221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542485,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67436,"kb_used_data":9868,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94304404,"statfs":{"total":96636764160,"available":96567709696,"internally_reserved":0,"allocated":10104832,"data_stored":8206396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542483,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":215524,"kb_used_data":39900,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":94156316,"statfs":{"total":96636764160,"available":96416067584,"internally_reserved":0,"allocated":40857600,"data_stored":38894520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179763655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542483,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56676,"kb_used_data":7420,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94315164,"statfs":{"total":96636764160,"available":96578727936,"internally_reserved":0,"allocated":7598080,"data_stored":5684279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542482,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101424,"kb_used_data":7816,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94270416,"statfs":{"total":96636764160,"available":96532905984,"internally_reserved":0,"allocated":8003584,"data_stored":6065036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542484,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216568,"kb_used_data":9064,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94155272,"statfs":{"total":96636764160,"available":96414998528,"internally_reserved":0,"allocated":9281536,"data_stored":7337278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212400581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4489216,"data_stored":4489216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3809280,"data_stored":3809280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6660096,"data_stored":6660096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5951488,"data_stored":5951488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6975488,"data_stored":6975488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3870720,"data_stored":3870720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T12:03:12.693 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.693 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.693 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.694 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.694 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.694 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.694 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.694 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.694 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.695 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.695 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.695 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.695 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.695 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.696 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.696 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.696 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.696 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.696 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.696 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.697 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.697 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.697 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.697 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.697 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.697 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.698 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.698 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.698 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.698 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.698 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.698 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.699 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.699 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.699 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.699 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.699 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.699 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.700 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.700 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.700 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.700 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.700 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.701 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.701 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.701 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.701 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.701 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.702 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.702 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.702 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.702 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.702 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.702 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.703 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.703 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.703 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.703 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.703 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.703 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.704 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.704 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.704 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.704 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.704 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.705 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.705 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.705 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.705 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.705 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.705 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.706 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.706 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.706 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.706 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.706 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.706 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.707 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.707 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.707 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.707 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.707 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.707 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.708 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.708 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.708 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.708 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.708 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.709 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.709 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.709 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.709 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.709 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.710 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.710 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.710 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.710 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.710 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.710 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.711 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.711 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.711 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.711 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.711 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.711 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.712 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.712 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.712 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.712 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.712 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.713 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.713 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.713 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.713 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.713 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.714 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.714 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.714 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.714 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.714 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.714 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.715 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.715 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.715 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.715 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.715 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.716 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.716 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.716 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.716 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.716 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.716 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.717 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.717 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.717 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.717 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.717 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.717 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.718 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.718 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.718 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.718 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.718 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.718 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.719 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.719 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.719 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.719 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.719 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.719 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.719 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.720 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.720 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.720 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.720 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.720 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.720 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.721 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.721 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.721 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.721 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.721 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.721 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.722 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.722 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.722 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.722 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.722 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.722 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.722 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.723 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.723 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.723 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.723 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.723 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.723 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.724 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.724 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.724 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.724 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.724 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.724 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.725 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.725 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.725 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.725 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.725 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.725 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.726 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.726 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.726 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.726 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.726 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.726 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.726 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.727 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.727 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.727 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-19T11:35:13.080179+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=13, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.727 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-19T11:35:18.126175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.727 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.727 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.728 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.728 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.728 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.728 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.728 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-19T11:35:18.126175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.728 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.729 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.729 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.729 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.729 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.729 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.729 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-19T11:35:18.126175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.730 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.730 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.730 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.730 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.730 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.730 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.730 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-19T11:35:18.126175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.731 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.731 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.731 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.731 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.731 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.731 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.732 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.732 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-19T11:35:18.126175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.732 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.732 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.732 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.732 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.733 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.733 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.733 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-19T11:35:18.126175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.733 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.733 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.733 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.733 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.734 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.734 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.734 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-19T11:35:18.126175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.734 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.734 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.734 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.735 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.735 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.735 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.735 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-19T11:35:18.126175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.735 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.735 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.735 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.736 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.736 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.736 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.736 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.736 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.736 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.737 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.737 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.737 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.737 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.737 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.738 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.738 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.738 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.738 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.738 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.738 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.738 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.739 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.739 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.739 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.739 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.739 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.739 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.739 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.740 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.740 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.740 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.740 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.740 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.740 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.740 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.741 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.741 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.741 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.741 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.741 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.741 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.741 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.742 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.742 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.742 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.742 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.742 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.742 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.742 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.743 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.743 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.743 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.743 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.743 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.743 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.743 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.744 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.744 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.744 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.744 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.744 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.744 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.745 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.745 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.745 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.745 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.745 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.745 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.745 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.746 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.746 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.746 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.746 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.746 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.746 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.746 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.747 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.747 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.747 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.747 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.747 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.747 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.748 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.748 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.748 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.748 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.748 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.748 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.749 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.749 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.749 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.749 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.749 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.749 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.750 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.750 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.750 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.750 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.750 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.750 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.751 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.751 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.751 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.751 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.751 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.751 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.752 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.752 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.752 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.752 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.752 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-19T11:35:30.517882+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.753 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:12.753 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T12:03:32.754 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T12:03:33.119 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T12:03:33.130 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T12:03:33.136 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":1107,"stamp":"2024-09-19T12:03:31.401654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29695886,"num_objects":525,"num_object_clones":0,"num_object_copies":1600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":525,"num_whiteouts":0,"num_read":30044,"num_read_kb":496475,"num_write":20844,"num_write_kb":408787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34993,"num_omap_keys":141,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8473,"ondisk_log_size":8473,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1093256,"kb_used_data":73416,"kb_used_omap":12,"kb_used_meta":1019699,"kb_avail":753881464,"statfs":{"total":773094113280,"available":771974619136,"internally_reserved":0,"allocated":75177984,"data_stored":59655058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1044172336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34993,"num_omap_keys":141,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007337"},"pg_stats":[{"pgid":"67.1d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.590975+0000","last_change":"2024-09-19T11:53:37.745334+0000","last_active":"2024-09-19T11:58:36.590975+0000","last_peered":"2024-09-19T11:58:36.590975+0000","last_clean":"2024-09-19T11:58:36.590975+0000","last_became_active":"2024-09-19T11:53:37.744679+0000","last_became_peered":"2024-09-19T11:53:37.744679+0000","last_unstale":"2024-09-19T11:58:36.590975+0000","last_undegraded":"2024-09-19T11:58:36.590975+0000","last_fullsized":"2024-09-19T11:58:36.590975+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:29.888364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.586691+0000","last_change":"2024-09-19T11:53:34.715828+0000","last_active":"2024-09-19T11:58:36.586691+0000","last_peered":"2024-09-19T11:58:36.586691+0000","last_clean":"2024-09-19T11:58:36.586691+0000","last_became_active":"2024-09-19T11:53:34.714946+0000","last_became_peered":"2024-09-19T11:53:34.714946+0000","last_unstale":"2024-09-19T11:58:36.586691+0000","last_undegraded":"2024-09-19T11:58:36.586691+0000","last_fullsized":"2024-09-19T11:58:36.586691+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:46.457012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"256'14","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.615105+0000","last_change":"2024-09-19T11:51:53.494561+0000","last_active":"2024-09-19T12:00:16.615105+0000","last_peered":"2024-09-19T12:00:16.615105+0000","last_clean":"2024-09-19T12:00:16.615105+0000","last_became_active":"2024-09-19T11:51:53.493294+0000","last_became_peered":"2024-09-19T11:51:53.493294+0000","last_unstale":"2024-09-19T12:00:16.615105+0000","last_undegraded":"2024-09-19T12:00:16.615105+0000","last_fullsized":"2024-09-19T12:00:16.615105+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:25.608106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":86,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.785305+0000","last_change":"2024-09-19T11:53:37.715171+0000","last_active":"2024-09-19T11:58:41.785305+0000","last_peered":"2024-09-19T11:58:41.785305+0000","last_clean":"2024-09-19T11:58:41.785305+0000","last_became_active":"2024-09-19T11:53:37.714526+0000","last_became_peered":"2024-09-19T11:53:37.714526+0000","last_unstale":"2024-09-19T11:58:41.785305+0000","last_undegraded":"2024-09-19T11:58:41.785305+0000","last_fullsized":"2024-09-19T11:58:41.785305+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:47:00.837259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.579334+0000","last_change":"2024-09-19T11:53:34.730623+0000","last_active":"2024-09-19T11:58:36.579334+0000","last_peered":"2024-09-19T11:58:36.579334+0000","last_clean":"2024-09-19T11:58:36.579334+0000","last_became_active":"2024-09-19T11:53:34.730025+0000","last_became_peered":"2024-09-19T11:53:34.730025+0000","last_unstale":"2024-09-19T11:58:36.579334+0000","last_undegraded":"2024-09-19T11:58:36.579334+0000","last_fullsized":"2024-09-19T11:58:36.579334+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:52.233686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.596619+0000","last_change":"2024-09-19T11:51:53.495233+0000","last_active":"2024-09-19T11:59:56.596619+0000","last_peered":"2024-09-19T11:59:56.596619+0000","last_clean":"2024-09-19T11:59:56.596619+0000","last_became_active":"2024-09-19T11:51:53.494552+0000","last_became_peered":"2024-09-19T11:51:53.494552+0000","last_unstale":"2024-09-19T11:59:56.596619+0000","last_undegraded":"2024-09-19T11:59:56.596619+0000","last_fullsized":"2024-09-19T11:59:56.596619+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:17.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.610306+0000","last_change":"2024-09-19T11:53:37.760242+0000","last_active":"2024-09-19T11:59:56.610306+0000","last_peered":"2024-09-19T11:59:56.610306+0000","last_clean":"2024-09-19T11:59:56.610306+0000","last_became_active":"2024-09-19T11:53:37.757767+0000","last_became_peered":"2024-09-19T11:53:37.757767+0000","last_unstale":"2024-09-19T11:59:56.610306+0000","last_undegraded":"2024-09-19T11:59:56.610306+0000","last_fullsized":"2024-09-19T11:59:56.610306+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:53:27.455399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.592459+0000","last_change":"2024-09-19T11:53:34.712290+0000","last_active":"2024-09-19T11:59:36.592459+0000","last_peered":"2024-09-19T11:59:36.592459+0000","last_clean":"2024-09-19T11:59:36.592459+0000","last_became_active":"2024-09-19T11:53:34.711510+0000","last_became_peered":"2024-09-19T11:53:34.711510+0000","last_unstale":"2024-09-19T11:59:36.592459+0000","last_undegraded":"2024-09-19T11:59:36.592459+0000","last_fullsized":"2024-09-19T11:59:36.592459+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:51.007502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.603011+0000","last_change":"2024-09-19T11:51:53.480345+0000","last_active":"2024-09-19T11:59:26.603011+0000","last_peered":"2024-09-19T11:59:26.603011+0000","last_clean":"2024-09-19T11:59:26.603011+0000","last_became_active":"2024-09-19T11:51:53.479659+0000","last_became_peered":"2024-09-19T11:51:53.479659+0000","last_unstale":"2024-09-19T11:59:26.603011+0000","last_undegraded":"2024-09-19T11:59:26.603011+0000","last_fullsized":"2024-09-19T11:59:26.603011+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:02.230797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.601507+0000","last_change":"2024-09-19T11:53:37.758685+0000","last_active":"2024-09-19T11:59:41.601507+0000","last_peered":"2024-09-19T11:59:41.601507+0000","last_clean":"2024-09-19T11:59:41.601507+0000","last_became_active":"2024-09-19T11:53:37.756047+0000","last_became_peered":"2024-09-19T11:53:37.756047+0000","last_unstale":"2024-09-19T11:59:41.601507+0000","last_undegraded":"2024-09-19T11:59:41.601507+0000","last_fullsized":"2024-09-19T11:59:41.601507+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:44.645097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:56.828737+0000","last_change":"2024-09-19T11:53:34.706109+0000","last_active":"2024-09-19T12:01:56.828737+0000","last_peered":"2024-09-19T12:01:56.828737+0000","last_clean":"2024-09-19T12:01:56.828737+0000","last_became_active":"2024-09-19T11:53:34.705364+0000","last_became_peered":"2024-09-19T11:53:34.705364+0000","last_unstale":"2024-09-19T12:01:56.828737+0000","last_undegraded":"2024-09-19T12:01:56.828737+0000","last_fullsized":"2024-09-19T12:01:56.828737+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:58:24.677448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.597881+0000","last_change":"2024-09-19T11:51:53.477170+0000","last_active":"2024-09-19T11:59:26.597881+0000","last_peered":"2024-09-19T11:59:26.597881+0000","last_clean":"2024-09-19T11:59:26.597881+0000","last_became_active":"2024-09-19T11:51:53.475807+0000","last_became_peered":"2024-09-19T11:51:53.475807+0000","last_unstale":"2024-09-19T11:59:26.597881+0000","last_undegraded":"2024-09-19T11:59:26.597881+0000","last_fullsized":"2024-09-19T11:59:26.597881+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:44.084226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:56.622534+0000","last_change":"2024-09-19T11:53:37.733871+0000","last_active":"2024-09-19T12:00:56.622534+0000","last_peered":"2024-09-19T12:00:56.622534+0000","last_clean":"2024-09-19T12:00:56.622534+0000","last_became_active":"2024-09-19T11:53:37.733244+0000","last_became_peered":"2024-09-19T11:53:37.733244+0000","last_unstale":"2024-09-19T12:00:56.622534+0000","last_undegraded":"2024-09-19T12:00:56.622534+0000","last_fullsized":"2024-09-19T12:00:56.622534+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:51.623197+0000","last_change":"2024-09-19T11:53:34.723027+0000","last_active":"2024-09-19T12:00:51.623197+0000","last_peered":"2024-09-19T12:00:51.623197+0000","last_clean":"2024-09-19T12:00:51.623197+0000","last_became_active":"2024-09-19T11:53:34.722143+0000","last_became_peered":"2024-09-19T11:53:34.722143+0000","last_unstale":"2024-09-19T12:00:51.623197+0000","last_undegraded":"2024-09-19T12:00:51.623197+0000","last_fullsized":"2024-09-19T12:00:51.623197+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"256'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.597786+0000","last_change":"2024-09-19T11:51:53.497903+0000","last_active":"2024-09-19T11:59:26.597786+0000","last_peered":"2024-09-19T11:59:26.597786+0000","last_clean":"2024-09-19T11:59:26.597786+0000","last_became_active":"2024-09-19T11:51:53.496828+0000","last_became_peered":"2024-09-19T11:51:53.496828+0000","last_unstale":"2024-09-19T11:59:26.597786+0000","last_undegraded":"2024-09-19T11:59:26.597786+0000","last_fullsized":"2024-09-19T11:59:26.597786+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:33:53.888475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.18","version":"264'5","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.905106+0000","last_change":"2024-09-19T11:53:37.752259+0000","last_active":"2024-09-19T12:03:05.905106+0000","last_peered":"2024-09-19T12:03:05.905106+0000","last_clean":"2024-09-19T12:03:05.905106+0000","last_became_active":"2024-09-19T11:53:37.751550+0000","last_became_peered":"2024-09-19T11:53:37.751550+0000","last_unstale":"2024-09-19T12:03:05.905106+0000","last_undegraded":"2024-09-19T12:03:05.905106+0000","last_fullsized":"2024-09-19T12:03:05.905106+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.526803+0000","last_change":"2024-09-19T11:53:34.700220+0000","last_active":"2024-09-19T12:03:05.526803+0000","last_peered":"2024-09-19T12:03:05.526803+0000","last_clean":"2024-09-19T12:03:05.526803+0000","last_became_active":"2024-09-19T11:53:34.699476+0000","last_became_peered":"2024-09-19T11:53:34.699476+0000","last_unstale":"2024-09-19T12:03:05.526803+0000","last_undegraded":"2024-09-19T12:03:05.526803+0000","last_fullsized":"2024-09-19T12:03:05.526803+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.602602+0000","last_change":"2024-09-19T11:51:53.469668+0000","last_active":"2024-09-19T11:59:26.602602+0000","last_peered":"2024-09-19T11:59:26.602602+0000","last_clean":"2024-09-19T11:59:26.602602+0000","last_became_active":"2024-09-19T11:51:53.468220+0000","last_became_peered":"2024-09-19T11:51:53.468220+0000","last_unstale":"2024-09-19T11:59:26.602602+0000","last_undegraded":"2024-09-19T11:59:26.602602+0000","last_fullsized":"2024-09-19T11:59:26.602602+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:15.153859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.592905+0000","last_change":"2024-09-19T11:53:37.734780+0000","last_active":"2024-09-19T11:58:41.592905+0000","last_peered":"2024-09-19T11:58:41.592905+0000","last_clean":"2024-09-19T11:58:41.592905+0000","last_became_active":"2024-09-19T11:53:37.733461+0000","last_became_peered":"2024-09-19T11:53:37.733461+0000","last_unstale":"2024-09-19T11:58:41.592905+0000","last_undegraded":"2024-09-19T11:58:41.592905+0000","last_fullsized":"2024-09-19T11:58:41.592905+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:09.138836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:36.784017+0000","last_change":"2024-09-19T11:53:34.711700+0000","last_active":"2024-09-19T11:58:36.784017+0000","last_peered":"2024-09-19T11:58:36.784017+0000","last_clean":"2024-09-19T11:58:36.784017+0000","last_became_active":"2024-09-19T11:53:34.711125+0000","last_became_peered":"2024-09-19T11:53:34.711125+0000","last_unstale":"2024-09-19T11:58:36.784017+0000","last_undegraded":"2024-09-19T11:58:36.784017+0000","last_fullsized":"2024-09-19T11:58:36.784017+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:23.766743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.599515+0000","last_change":"2024-09-19T11:51:53.498330+0000","last_active":"2024-09-19T11:59:11.599515+0000","last_peered":"2024-09-19T11:59:11.599515+0000","last_clean":"2024-09-19T11:59:11.599515+0000","last_became_active":"2024-09-19T11:51:53.497559+0000","last_became_peered":"2024-09-19T11:51:53.497559+0000","last_unstale":"2024-09-19T11:59:11.599515+0000","last_undegraded":"2024-09-19T11:59:11.599515+0000","last_fullsized":"2024-09-19T11:59:11.599515+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:57.123428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:41.587788+0000","last_change":"2024-09-19T11:53:37.760079+0000","last_active":"2024-09-19T11:58:41.587788+0000","last_peered":"2024-09-19T11:58:41.587788+0000","last_clean":"2024-09-19T11:58:41.587788+0000","last_became_active":"2024-09-19T11:53:37.759079+0000","last_became_peered":"2024-09-19T11:53:37.759079+0000","last_unstale":"2024-09-19T11:58:41.587788+0000","last_undegraded":"2024-09-19T11:58:41.587788+0000","last_fullsized":"2024-09-19T11:58:41.587788+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:55.874038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'8","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.643331+0000","last_change":"2024-09-19T11:53:34.732158+0000","last_active":"2024-09-19T12:03:05.643331+0000","last_peered":"2024-09-19T12:03:05.643331+0000","last_clean":"2024-09-19T12:03:05.643331+0000","last_became_active":"2024-09-19T11:53:34.722675+0000","last_became_peered":"2024-09-19T11:53:34.722675+0000","last_unstale":"2024-09-19T12:03:05.643331+0000","last_undegraded":"2024-09-19T12:03:05.643331+0000","last_fullsized":"2024-09-19T12:03:05.643331+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:13.301780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.586361+0000","last_change":"2024-09-19T11:51:53.486009+0000","last_active":"2024-09-19T11:59:11.586361+0000","last_peered":"2024-09-19T11:59:11.586361+0000","last_clean":"2024-09-19T11:59:11.586361+0000","last_became_active":"2024-09-19T11:51:53.485176+0000","last_became_peered":"2024-09-19T11:51:53.485176+0000","last_unstale":"2024-09-19T11:59:11.586361+0000","last_undegraded":"2024-09-19T11:59:11.586361+0000","last_fullsized":"2024-09-19T11:59:11.586361+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:32.437601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:56.618658+0000","last_change":"2024-09-19T11:53:37.738229+0000","last_active":"2024-09-19T12:00:56.618658+0000","last_peered":"2024-09-19T12:00:56.618658+0000","last_clean":"2024-09-19T12:00:56.618658+0000","last_became_active":"2024-09-19T11:53:37.735681+0000","last_became_peered":"2024-09-19T11:53:37.735681+0000","last_unstale":"2024-09-19T12:00:56.618658+0000","last_undegraded":"2024-09-19T12:00:56.618658+0000","last_fullsized":"2024-09-19T12:00:56.618658+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619176+0000","last_change":"2024-09-19T11:53:34.709295+0000","last_active":"2024-09-19T12:00:41.619176+0000","last_peered":"2024-09-19T12:00:41.619176+0000","last_clean":"2024-09-19T12:00:41.619176+0000","last_became_active":"2024-09-19T11:53:34.708831+0000","last_became_peered":"2024-09-19T11:53:34.708831+0000","last_unstale":"2024-09-19T12:00:41.619176+0000","last_undegraded":"2024-09-19T12:00:41.619176+0000","last_fullsized":"2024-09-19T12:00:41.619176+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:25.795767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.599708+0000","last_change":"2024-09-19T11:51:53.499050+0000","last_active":"2024-09-19T11:59:11.599708+0000","last_peered":"2024-09-19T11:59:11.599708+0000","last_clean":"2024-09-19T11:59:11.599708+0000","last_became_active":"2024-09-19T11:51:53.498327+0000","last_became_peered":"2024-09-19T11:51:53.498327+0000","last_unstale":"2024-09-19T11:59:11.599708+0000","last_undegraded":"2024-09-19T11:59:11.599708+0000","last_fullsized":"2024-09-19T11:59:11.599708+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:49.722787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615207+0000","last_change":"2024-09-19T11:53:37.755767+0000","last_active":"2024-09-19T12:00:41.615207+0000","last_peered":"2024-09-19T12:00:41.615207+0000","last_clean":"2024-09-19T12:00:41.615207+0000","last_became_active":"2024-09-19T11:53:37.754753+0000","last_became_peered":"2024-09-19T11:53:37.754753+0000","last_unstale":"2024-09-19T12:00:41.615207+0000","last_undegraded":"2024-09-19T12:00:41.615207+0000","last_fullsized":"2024-09-19T12:00:41.615207+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:22.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:51.624791+0000","last_change":"2024-09-19T11:53:34.720643+0000","last_active":"2024-09-19T12:00:51.624791+0000","last_peered":"2024-09-19T12:00:51.624791+0000","last_clean":"2024-09-19T12:00:51.624791+0000","last_became_active":"2024-09-19T11:53:34.720273+0000","last_became_peered":"2024-09-19T11:53:34.720273+0000","last_unstale":"2024-09-19T12:00:51.624791+0000","last_undegraded":"2024-09-19T12:00:51.624791+0000","last_fullsized":"2024-09-19T12:00:51.624791+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"255'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.594417+0000","last_change":"2024-09-19T11:51:53.497665+0000","last_active":"2024-09-19T11:59:11.594417+0000","last_peered":"2024-09-19T11:59:11.594417+0000","last_clean":"2024-09-19T11:59:11.594417+0000","last_became_active":"2024-09-19T11:51:53.496988+0000","last_became_peered":"2024-09-19T11:51:53.496988+0000","last_unstale":"2024-09-19T11:59:11.594417+0000","last_undegraded":"2024-09-19T11:59:11.594417+0000","last_fullsized":"2024-09-19T11:59:11.594417+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:42.583270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.17","version":"264'5","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.908508+0000","last_change":"2024-09-19T11:53:37.759921+0000","last_active":"2024-09-19T12:03:05.908508+0000","last_peered":"2024-09-19T12:03:05.908508+0000","last_clean":"2024-09-19T12:03:05.908508+0000","last_became_active":"2024-09-19T11:53:37.759275+0000","last_became_peered":"2024-09-19T11:53:37.759275+0000","last_unstale":"2024-09-19T12:03:05.908508+0000","last_undegraded":"2024-09-19T12:03:05.908508+0000","last_fullsized":"2024-09-19T12:03:05.908508+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:51.608274+0000","last_change":"2024-09-19T11:53:34.700207+0000","last_active":"2024-09-19T12:00:51.608274+0000","last_peered":"2024-09-19T12:00:51.608274+0000","last_clean":"2024-09-19T12:00:51.608274+0000","last_became_active":"2024-09-19T11:53:34.699437+0000","last_became_peered":"2024-09-19T11:53:34.699437+0000","last_unstale":"2024-09-19T12:00:51.608274+0000","last_undegraded":"2024-09-19T12:00:51.608274+0000","last_fullsized":"2024-09-19T12:00:51.608274+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"256'23","reported_seq":100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.587246+0000","last_change":"2024-09-19T11:51:53.479917+0000","last_active":"2024-09-19T11:59:11.587246+0000","last_peered":"2024-09-19T11:59:11.587246+0000","last_clean":"2024-09-19T11:59:11.587246+0000","last_became_active":"2024-09-19T11:51:53.478643+0000","last_became_peered":"2024-09-19T11:51:53.478643+0000","last_unstale":"2024-09-19T11:59:11.587246+0000","last_undegraded":"2024-09-19T11:59:11.587246+0000","last_fullsized":"2024-09-19T11:59:11.587246+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:31.580713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":169,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:56.815499+0000","last_change":"2024-09-19T11:53:37.737666+0000","last_active":"2024-09-19T12:00:56.815499+0000","last_peered":"2024-09-19T12:00:56.815499+0000","last_clean":"2024-09-19T12:00:56.815499+0000","last_became_active":"2024-09-19T11:53:37.737215+0000","last_became_peered":"2024-09-19T11:53:37.737215+0000","last_unstale":"2024-09-19T12:00:56.815499+0000","last_undegraded":"2024-09-19T12:00:56.815499+0000","last_fullsized":"2024-09-19T12:00:56.815499+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.894371+0000","last_change":"2024-09-19T11:53:34.732001+0000","last_active":"2024-09-19T12:03:05.894371+0000","last_peered":"2024-09-19T12:03:05.894371+0000","last_clean":"2024-09-19T12:03:05.894371+0000","last_became_active":"2024-09-19T11:53:34.723850+0000","last_became_peered":"2024-09-19T11:53:34.723850+0000","last_unstale":"2024-09-19T12:03:05.894371+0000","last_undegraded":"2024-09-19T12:03:05.894371+0000","last_fullsized":"2024-09-19T12:03:05.894371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599872+0000","last_change":"2024-09-19T11:51:53.479627+0000","last_active":"2024-09-19T11:58:56.599872+0000","last_peered":"2024-09-19T11:58:56.599872+0000","last_clean":"2024-09-19T11:58:56.599872+0000","last_became_active":"2024-09-19T11:51:53.478922+0000","last_became_peered":"2024-09-19T11:51:53.478922+0000","last_unstale":"2024-09-19T11:58:56.599872+0000","last_undegraded":"2024-09-19T11:58:56.599872+0000","last_fullsized":"2024-09-19T11:58:56.599872+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:56.192816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607351+0000","last_change":"2024-09-19T11:53:37.742835+0000","last_active":"2024-09-19T12:00:41.607351+0000","last_peered":"2024-09-19T12:00:41.607351+0000","last_clean":"2024-09-19T12:00:41.607351+0000","last_became_active":"2024-09-19T11:53:37.734844+0000","last_became_peered":"2024-09-19T11:53:37.734844+0000","last_unstale":"2024-09-19T12:00:41.607351+0000","last_undegraded":"2024-09-19T12:00:41.607351+0000","last_fullsized":"2024-09-19T12:00:41.607351+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:22.920456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810733+0000","last_change":"2024-09-19T11:53:34.707106+0000","last_active":"2024-09-19T12:00:36.810733+0000","last_peered":"2024-09-19T12:00:36.810733+0000","last_clean":"2024-09-19T12:00:36.810733+0000","last_became_active":"2024-09-19T11:53:34.704150+0000","last_became_peered":"2024-09-19T11:53:34.704150+0000","last_unstale":"2024-09-19T12:00:36.810733+0000","last_undegraded":"2024-09-19T12:00:36.810733+0000","last_fullsized":"2024-09-19T12:00:36.810733+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:33.641088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599814+0000","last_change":"2024-09-19T11:51:53.481885+0000","last_active":"2024-09-19T11:58:56.599814+0000","last_peered":"2024-09-19T11:58:56.599814+0000","last_clean":"2024-09-19T11:58:56.599814+0000","last_became_active":"2024-09-19T11:51:53.481154+0000","last_became_peered":"2024-09-19T11:51:53.481154+0000","last_unstale":"2024-09-19T11:58:56.599814+0000","last_undegraded":"2024-09-19T11:58:56.599814+0000","last_fullsized":"2024-09-19T11:58:56.599814+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:33.647811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607252+0000","last_change":"2024-09-19T11:53:37.731071+0000","last_active":"2024-09-19T12:00:41.607252+0000","last_peered":"2024-09-19T12:00:41.607252+0000","last_clean":"2024-09-19T12:00:41.607252+0000","last_became_active":"2024-09-19T11:53:37.730152+0000","last_became_peered":"2024-09-19T11:53:37.730152+0000","last_unstale":"2024-09-19T12:00:41.607252+0000","last_undegraded":"2024-09-19T12:00:41.607252+0000","last_fullsized":"2024-09-19T12:00:41.607252+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:14:21.099777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.613805+0000","last_change":"2024-09-19T11:53:34.704187+0000","last_active":"2024-09-19T12:00:36.613805+0000","last_peered":"2024-09-19T12:00:36.613805+0000","last_clean":"2024-09-19T12:00:36.613805+0000","last_became_active":"2024-09-19T11:53:34.703463+0000","last_became_peered":"2024-09-19T11:53:34.703463+0000","last_unstale":"2024-09-19T12:00:36.613805+0000","last_undegraded":"2024-09-19T12:00:36.613805+0000","last_fullsized":"2024-09-19T12:00:36.613805+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:28.756801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.595963+0000","last_change":"2024-09-19T11:51:53.491344+0000","last_active":"2024-09-19T11:58:56.595963+0000","last_peered":"2024-09-19T11:58:56.595963+0000","last_clean":"2024-09-19T11:58:56.595963+0000","last_became_active":"2024-09-19T11:51:53.490650+0000","last_became_peered":"2024-09-19T11:51:53.490650+0000","last_unstale":"2024-09-19T11:58:56.595963+0000","last_undegraded":"2024-09-19T11:58:56.595963+0000","last_fullsized":"2024-09-19T11:58:56.595963+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:53.773642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.711153+0000","last_change":"2024-09-19T11:53:37.759763+0000","last_active":"2024-09-19T12:03:05.711153+0000","last_peered":"2024-09-19T12:03:05.711153+0000","last_clean":"2024-09-19T12:03:05.711153+0000","last_became_active":"2024-09-19T11:53:37.755628+0000","last_became_peered":"2024-09-19T11:53:37.755628+0000","last_unstale":"2024-09-19T12:03:05.711153+0000","last_undegraded":"2024-09-19T12:03:05.711153+0000","last_fullsized":"2024-09-19T12:03:05.711153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:25.674366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5122,"num_write":10,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618477+0000","last_change":"2024-09-19T11:53:34.708167+0000","last_active":"2024-09-19T12:00:36.618477+0000","last_peered":"2024-09-19T12:00:36.618477+0000","last_clean":"2024-09-19T12:00:36.618477+0000","last_became_active":"2024-09-19T11:53:34.707412+0000","last_became_peered":"2024-09-19T11:53:34.707412+0000","last_unstale":"2024-09-19T12:00:36.618477+0000","last_undegraded":"2024-09-19T12:00:36.618477+0000","last_fullsized":"2024-09-19T12:00:36.618477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:27.815287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"256'7","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.788702+0000","last_change":"2024-09-19T11:51:53.464544+0000","last_active":"2024-09-19T11:58:56.788702+0000","last_peered":"2024-09-19T11:58:56.788702+0000","last_clean":"2024-09-19T11:58:56.788702+0000","last_became_active":"2024-09-19T11:51:53.463784+0000","last_became_peered":"2024-09-19T11:51:53.463784+0000","last_unstale":"2024-09-19T11:58:56.788702+0000","last_undegraded":"2024-09-19T11:58:56.788702+0000","last_fullsized":"2024-09-19T11:58:56.788702+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:17.326366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.12","version":"264'3","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:01.650911+0000","last_change":"2024-09-19T11:53:37.744463+0000","last_active":"2024-09-19T12:03:01.650911+0000","last_peered":"2024-09-19T12:03:01.650911+0000","last_clean":"2024-09-19T12:03:01.650911+0000","last_became_active":"2024-09-19T11:53:37.743807+0000","last_became_peered":"2024-09-19T11:53:37.743807+0000","last_unstale":"2024-09-19T12:03:01.650911+0000","last_undegraded":"2024-09-19T12:03:01.650911+0000","last_fullsized":"2024-09-19T12:03:01.650911+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:37.688342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.617873+0000","last_change":"2024-09-19T11:53:34.706511+0000","last_active":"2024-09-19T12:00:36.617873+0000","last_peered":"2024-09-19T12:00:36.617873+0000","last_clean":"2024-09-19T12:00:36.617873+0000","last_became_active":"2024-09-19T11:53:34.705705+0000","last_became_peered":"2024-09-19T11:53:34.705705+0000","last_unstale":"2024-09-19T12:00:36.617873+0000","last_undegraded":"2024-09-19T12:00:36.617873+0000","last_fullsized":"2024-09-19T12:00:36.617873+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:28.349619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.590471+0000","last_change":"2024-09-19T11:51:53.488994+0000","last_active":"2024-09-19T11:58:56.590471+0000","last_peered":"2024-09-19T11:58:56.590471+0000","last_clean":"2024-09-19T11:58:56.590471+0000","last_became_active":"2024-09-19T11:51:53.488252+0000","last_became_peered":"2024-09-19T11:51:53.488252+0000","last_unstale":"2024-09-19T11:58:56.590471+0000","last_undegraded":"2024-09-19T11:58:56.590471+0000","last_fullsized":"2024-09-19T11:58:56.590471+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:14.331678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.551446+0000","last_change":"2024-09-19T11:53:37.755108+0000","last_active":"2024-09-19T12:03:05.551446+0000","last_peered":"2024-09-19T12:03:05.551446+0000","last_clean":"2024-09-19T12:03:05.551446+0000","last_became_active":"2024-09-19T11:53:37.754497+0000","last_became_peered":"2024-09-19T11:53:37.754497+0000","last_unstale":"2024-09-19T12:03:05.551446+0000","last_undegraded":"2024-09-19T12:03:05.551446+0000","last_fullsized":"2024-09-19T12:03:05.551446+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:38.404433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.886651+0000","last_change":"2024-09-19T11:53:34.721569+0000","last_active":"2024-09-19T12:03:05.886651+0000","last_peered":"2024-09-19T12:03:05.886651+0000","last_clean":"2024-09-19T12:03:05.886651+0000","last_became_active":"2024-09-19T11:53:34.721070+0000","last_became_peered":"2024-09-19T11:53:34.721070+0000","last_unstale":"2024-09-19T12:03:05.886651+0000","last_undegraded":"2024-09-19T12:03:05.886651+0000","last_fullsized":"2024-09-19T12:03:05.886651+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:11.145675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"256'23","reported_seq":100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:56.618746+0000","last_change":"2024-09-19T11:51:53.490847+0000","last_active":"2024-09-19T12:00:56.618746+0000","last_peered":"2024-09-19T12:00:56.618746+0000","last_clean":"2024-09-19T12:00:56.618746+0000","last_became_active":"2024-09-19T11:51:53.490074+0000","last_became_peered":"2024-09-19T11:51:53.490074+0000","last_unstale":"2024-09-19T12:00:56.618746+0000","last_undegraded":"2024-09-19T12:00:56.618746+0000","last_fullsized":"2024-09-19T12:00:56.618746+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":156,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611634+0000","last_change":"2024-09-19T11:53:37.759926+0000","last_active":"2024-09-19T12:00:26.611634+0000","last_peered":"2024-09-19T12:00:26.611634+0000","last_clean":"2024-09-19T12:00:26.611634+0000","last_became_active":"2024-09-19T11:53:37.758965+0000","last_became_peered":"2024-09-19T11:53:37.758965+0000","last_unstale":"2024-09-19T12:00:26.611634+0000","last_undegraded":"2024-09-19T12:00:26.611634+0000","last_fullsized":"2024-09-19T12:00:26.611634+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:35.768438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.601997+0000","last_change":"2024-09-19T11:53:34.730214+0000","last_active":"2024-09-19T12:00:21.601997+0000","last_peered":"2024-09-19T12:00:21.601997+0000","last_clean":"2024-09-19T12:00:21.601997+0000","last_became_active":"2024-09-19T11:53:34.729772+0000","last_became_peered":"2024-09-19T11:53:34.729772+0000","last_unstale":"2024-09-19T12:00:21.601997+0000","last_undegraded":"2024-09-19T12:00:21.601997+0000","last_fullsized":"2024-09-19T12:00:21.601997+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:08.302177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:56.622722+0000","last_change":"2024-09-19T11:51:53.480445+0000","last_active":"2024-09-19T12:00:56.622722+0000","last_peered":"2024-09-19T12:00:56.622722+0000","last_clean":"2024-09-19T12:00:56.622722+0000","last_became_active":"2024-09-19T11:51:53.479490+0000","last_became_peered":"2024-09-19T11:51:53.479490+0000","last_unstale":"2024-09-19T12:00:56.622722+0000","last_undegraded":"2024-09-19T12:00:56.622722+0000","last_fullsized":"2024-09-19T12:00:56.622722+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.605040+0000","last_change":"2024-09-19T11:53:37.731450+0000","last_active":"2024-09-19T12:00:31.605040+0000","last_peered":"2024-09-19T12:00:31.605040+0000","last_clean":"2024-09-19T12:00:31.605040+0000","last_became_active":"2024-09-19T11:53:37.730671+0000","last_became_peered":"2024-09-19T11:53:37.730671+0000","last_unstale":"2024-09-19T12:00:31.605040+0000","last_undegraded":"2024-09-19T12:00:31.605040+0000","last_fullsized":"2024-09-19T12:00:31.605040+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:37.080584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'5","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.892067+0000","last_change":"2024-09-19T11:53:34.722175+0000","last_active":"2024-09-19T12:03:05.892067+0000","last_peered":"2024-09-19T12:03:05.892067+0000","last_clean":"2024-09-19T12:03:05.892067+0000","last_became_active":"2024-09-19T11:53:34.720160+0000","last_became_peered":"2024-09-19T11:53:34.720160+0000","last_unstale":"2024-09-19T12:03:05.892067+0000","last_undegraded":"2024-09-19T12:03:05.892067+0000","last_fullsized":"2024-09-19T12:03:05.892067+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:52:58.935663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:56.623202+0000","last_change":"2024-09-19T11:51:53.484469+0000","last_active":"2024-09-19T12:00:56.623202+0000","last_peered":"2024-09-19T12:00:56.623202+0000","last_clean":"2024-09-19T12:00:56.623202+0000","last_became_active":"2024-09-19T11:51:53.483786+0000","last_became_peered":"2024-09-19T11:51:53.483786+0000","last_unstale":"2024-09-19T12:00:56.623202+0000","last_undegraded":"2024-09-19T12:00:56.623202+0000","last_fullsized":"2024-09-19T12:00:56.623202+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:34.978547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611748+0000","last_change":"2024-09-19T11:53:37.745246+0000","last_active":"2024-09-19T12:00:26.611748+0000","last_peered":"2024-09-19T12:00:26.611748+0000","last_clean":"2024-09-19T12:00:26.611748+0000","last_became_active":"2024-09-19T11:53:37.739838+0000","last_became_peered":"2024-09-19T11:53:37.739838+0000","last_unstale":"2024-09-19T12:00:26.611748+0000","last_undegraded":"2024-09-19T12:00:26.611748+0000","last_fullsized":"2024-09-19T12:00:26.611748+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:07.343317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603804+0000","last_change":"2024-09-19T11:53:34.709512+0000","last_active":"2024-09-19T12:00:26.603804+0000","last_peered":"2024-09-19T12:00:26.603804+0000","last_clean":"2024-09-19T12:00:26.603804+0000","last_became_active":"2024-09-19T11:53:34.708542+0000","last_became_peered":"2024-09-19T11:53:34.708542+0000","last_unstale":"2024-09-19T12:00:26.603804+0000","last_undegraded":"2024-09-19T12:00:26.603804+0000","last_fullsized":"2024-09-19T12:00:26.603804+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:09.314949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:56.609267+0000","last_change":"2024-09-19T11:51:53.479663+0000","last_active":"2024-09-19T12:00:56.609267+0000","last_peered":"2024-09-19T12:00:56.609267+0000","last_clean":"2024-09-19T12:00:56.609267+0000","last_became_active":"2024-09-19T11:51:53.478940+0000","last_became_peered":"2024-09-19T11:51:53.478940+0000","last_unstale":"2024-09-19T12:00:56.609267+0000","last_undegraded":"2024-09-19T12:00:56.609267+0000","last_fullsized":"2024-09-19T12:00:56.609267+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.9","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.904415+0000","last_change":"2024-09-19T11:54:08.215698+0000","last_active":"2024-09-19T12:03:05.904415+0000","last_peered":"2024-09-19T12:03:05.904415+0000","last_clean":"2024-09-19T12:03:05.904415+0000","last_became_active":"2024-09-19T11:54:08.143092+0000","last_became_peered":"2024-09-19T11:54:08.143092+0000","last_unstale":"2024-09-19T12:03:05.904415+0000","last_undegraded":"2024-09-19T12:03:05.904415+0000","last_fullsized":"2024-09-19T12:03:05.904415+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:06.545326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.612462+0000","last_change":"2024-09-19T11:53:34.723264+0000","last_active":"2024-09-19T12:00:06.612462+0000","last_peered":"2024-09-19T12:00:06.612462+0000","last_clean":"2024-09-19T12:00:06.612462+0000","last_became_active":"2024-09-19T11:53:34.722786+0000","last_became_peered":"2024-09-19T11:53:34.722786+0000","last_unstale":"2024-09-19T12:00:06.612462+0000","last_undegraded":"2024-09-19T12:00:06.612462+0000","last_fullsized":"2024-09-19T12:00:06.612462+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:25:14.671300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:56.624416+0000","last_change":"2024-09-19T11:51:53.491094+0000","last_active":"2024-09-19T12:00:56.624416+0000","last_peered":"2024-09-19T12:00:56.624416+0000","last_clean":"2024-09-19T12:00:56.624416+0000","last_became_active":"2024-09-19T11:51:53.490467+0000","last_became_peered":"2024-09-19T11:51:53.490467+0000","last_unstale":"2024-09-19T12:00:56.624416+0000","last_undegraded":"2024-09-19T12:00:56.624416+0000","last_fullsized":"2024-09-19T12:00:56.624416+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.615854+0000","last_change":"2024-09-19T11:53:37.739452+0000","last_active":"2024-09-19T12:00:11.615854+0000","last_peered":"2024-09-19T12:00:11.615854+0000","last_clean":"2024-09-19T12:00:11.615854+0000","last_became_active":"2024-09-19T11:53:37.738652+0000","last_became_peered":"2024-09-19T11:53:37.738652+0000","last_unstale":"2024-09-19T12:00:11.615854+0000","last_undegraded":"2024-09-19T12:00:11.615854+0000","last_fullsized":"2024-09-19T12:00:11.615854+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.598691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:16.626692+0000","last_change":"2024-09-19T11:53:34.709704+0000","last_active":"2024-09-19T12:02:16.626692+0000","last_peered":"2024-09-19T12:02:16.626692+0000","last_clean":"2024-09-19T12:02:16.626692+0000","last_became_active":"2024-09-19T11:53:34.708971+0000","last_became_peered":"2024-09-19T11:53:34.708971+0000","last_unstale":"2024-09-19T12:02:16.626692+0000","last_undegraded":"2024-09-19T12:02:16.626692+0000","last_fullsized":"2024-09-19T12:02:16.626692+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:31.763785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"256'7","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.621385+0000","last_change":"2024-09-19T11:51:53.482164+0000","last_active":"2024-09-19T12:00:36.621385+0000","last_peered":"2024-09-19T12:00:36.621385+0000","last_clean":"2024-09-19T12:00:36.621385+0000","last_became_active":"2024-09-19T11:51:53.481429+0000","last_became_peered":"2024-09-19T11:51:53.481429+0000","last_unstale":"2024-09-19T12:00:36.621385+0000","last_undegraded":"2024-09-19T12:00:36.621385+0000","last_fullsized":"2024-09-19T12:00:36.621385+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:29.346644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":44,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603698+0000","last_change":"2024-09-19T11:53:37.743123+0000","last_active":"2024-09-19T12:00:26.603698+0000","last_peered":"2024-09-19T12:00:26.603698+0000","last_clean":"2024-09-19T12:00:26.603698+0000","last_became_active":"2024-09-19T11:53:37.742403+0000","last_became_peered":"2024-09-19T11:53:37.742403+0000","last_unstale":"2024-09-19T12:00:26.603698+0000","last_undegraded":"2024-09-19T12:00:26.603698+0000","last_fullsized":"2024-09-19T12:00:26.603698+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:17.009971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.612531+0000","last_change":"2024-09-19T11:53:34.731804+0000","last_active":"2024-09-19T12:00:06.612531+0000","last_peered":"2024-09-19T12:00:06.612531+0000","last_clean":"2024-09-19T12:00:06.612531+0000","last_became_active":"2024-09-19T11:53:34.728959+0000","last_became_peered":"2024-09-19T11:53:34.728959+0000","last_unstale":"2024-09-19T12:00:06.612531+0000","last_undegraded":"2024-09-19T12:00:06.612531+0000","last_fullsized":"2024-09-19T12:00:06.612531+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:26.270496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.613843+0000","last_change":"2024-09-19T11:51:53.473143+0000","last_active":"2024-09-19T12:00:36.613843+0000","last_peered":"2024-09-19T12:00:36.613843+0000","last_clean":"2024-09-19T12:00:36.613843+0000","last_became_active":"2024-09-19T11:51:53.472485+0000","last_became_peered":"2024-09-19T11:51:53.472485+0000","last_unstale":"2024-09-19T12:00:36.613843+0000","last_undegraded":"2024-09-19T12:00:36.613843+0000","last_fullsized":"2024-09-19T12:00:36.613843+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:05:05.000749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.615948+0000","last_change":"2024-09-19T11:53:37.737715+0000","last_active":"2024-09-19T12:00:11.615948+0000","last_peered":"2024-09-19T12:00:11.615948+0000","last_clean":"2024-09-19T12:00:11.615948+0000","last_became_active":"2024-09-19T11:53:37.736772+0000","last_became_peered":"2024-09-19T11:53:37.736772+0000","last_unstale":"2024-09-19T12:00:11.615948+0000","last_undegraded":"2024-09-19T12:00:11.615948+0000","last_fullsized":"2024-09-19T12:00:11.615948+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:02.929650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'6","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.721991+0000","last_change":"2024-09-19T11:53:34.711999+0000","last_active":"2024-09-19T12:03:05.721991+0000","last_peered":"2024-09-19T12:03:05.721991+0000","last_clean":"2024-09-19T12:03:05.721991+0000","last_became_active":"2024-09-19T11:53:34.711382+0000","last_became_peered":"2024-09-19T11:53:34.711382+0000","last_unstale":"2024-09-19T12:03:05.721991+0000","last_undegraded":"2024-09-19T12:03:05.721991+0000","last_fullsized":"2024-09-19T12:03:05.721991+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:31.348728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618375+0000","last_change":"2024-09-19T11:51:53.487166+0000","last_active":"2024-09-19T12:00:36.618375+0000","last_peered":"2024-09-19T12:00:36.618375+0000","last_clean":"2024-09-19T12:00:36.618375+0000","last_became_active":"2024-09-19T11:51:53.486236+0000","last_became_peered":"2024-09-19T11:51:53.486236+0000","last_unstale":"2024-09-19T12:00:36.618375+0000","last_undegraded":"2024-09-19T12:00:36.618375+0000","last_fullsized":"2024-09-19T12:00:36.618375+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:19.897372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.610219+0000","last_change":"2024-09-19T11:53:37.747251+0000","last_active":"2024-09-19T11:59:56.610219+0000","last_peered":"2024-09-19T11:59:56.610219+0000","last_clean":"2024-09-19T11:59:56.610219+0000","last_became_active":"2024-09-19T11:53:37.745076+0000","last_became_peered":"2024-09-19T11:53:37.745076+0000","last_unstale":"2024-09-19T11:59:56.610219+0000","last_undegraded":"2024-09-19T11:59:56.610219+0000","last_fullsized":"2024-09-19T11:59:56.610219+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:16.840839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611669+0000","last_change":"2024-09-19T11:53:34.720400+0000","last_active":"2024-09-19T11:59:51.611669+0000","last_peered":"2024-09-19T11:59:51.611669+0000","last_clean":"2024-09-19T11:59:51.611669+0000","last_became_active":"2024-09-19T11:53:34.719535+0000","last_became_peered":"2024-09-19T11:53:34.719535+0000","last_unstale":"2024-09-19T11:59:51.611669+0000","last_undegraded":"2024-09-19T11:59:51.611669+0000","last_fullsized":"2024-09-19T11:59:51.611669+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:53.909023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'11","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.619919+0000","last_change":"2024-09-19T11:51:53.486865+0000","last_active":"2024-09-19T12:00:36.619919+0000","last_peered":"2024-09-19T12:00:36.619919+0000","last_clean":"2024-09-19T12:00:36.619919+0000","last_became_active":"2024-09-19T11:51:53.486126+0000","last_became_peered":"2024-09-19T11:51:53.486126+0000","last_unstale":"2024-09-19T12:00:36.619919+0000","last_undegraded":"2024-09-19T12:00:36.619919+0000","last_fullsized":"2024-09-19T12:00:36.619919+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:29.272674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":56,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:01.639128+0000","last_change":"2024-09-19T11:53:37.749405+0000","last_active":"2024-09-19T12:02:01.639128+0000","last_peered":"2024-09-19T12:02:01.639128+0000","last_clean":"2024-09-19T12:02:01.639128+0000","last_became_active":"2024-09-19T11:53:37.748479+0000","last_became_peered":"2024-09-19T11:53:37.748479+0000","last_unstale":"2024-09-19T12:02:01.639128+0000","last_undegraded":"2024-09-19T12:02:01.639128+0000","last_fullsized":"2024-09-19T12:02:01.639128+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:55.422274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:56.621015+0000","last_change":"2024-09-19T11:53:34.721846+0000","last_active":"2024-09-19T12:01:56.621015+0000","last_peered":"2024-09-19T12:01:56.621015+0000","last_clean":"2024-09-19T12:01:56.621015+0000","last_became_active":"2024-09-19T11:53:34.721421+0000","last_became_peered":"2024-09-19T11:53:34.721421+0000","last_unstale":"2024-09-19T12:01:56.621015+0000","last_undegraded":"2024-09-19T12:01:56.621015+0000","last_fullsized":"2024-09-19T12:01:56.621015+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:43:44.169249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618564+0000","last_change":"2024-09-19T11:51:53.469628+0000","last_active":"2024-09-19T12:00:36.618564+0000","last_peered":"2024-09-19T12:00:36.618564+0000","last_clean":"2024-09-19T12:00:36.618564+0000","last_became_active":"2024-09-19T11:51:53.468768+0000","last_became_peered":"2024-09-19T11:51:53.468768+0000","last_unstale":"2024-09-19T12:00:36.618564+0000","last_undegraded":"2024-09-19T12:00:36.618564+0000","last_fullsized":"2024-09-19T12:00:36.618564+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:35.828878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.616066+0000","last_change":"2024-09-19T11:53:37.749695+0000","last_active":"2024-09-19T12:00:11.616066+0000","last_peered":"2024-09-19T12:00:11.616066+0000","last_clean":"2024-09-19T12:00:11.616066+0000","last_became_active":"2024-09-19T11:53:37.749246+0000","last_became_peered":"2024-09-19T11:53:37.749246+0000","last_unstale":"2024-09-19T12:00:11.616066+0000","last_undegraded":"2024-09-19T12:00:11.616066+0000","last_fullsized":"2024-09-19T12:00:11.616066+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:35.006918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.610837+0000","last_change":"2024-09-19T11:53:34.703535+0000","last_active":"2024-09-19T12:00:06.610837+0000","last_peered":"2024-09-19T12:00:06.610837+0000","last_clean":"2024-09-19T12:00:06.610837+0000","last_became_active":"2024-09-19T11:53:34.702356+0000","last_became_peered":"2024-09-19T11:53:34.702356+0000","last_unstale":"2024-09-19T12:00:06.610837+0000","last_undegraded":"2024-09-19T12:00:06.610837+0000","last_fullsized":"2024-09-19T12:00:06.610837+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:05.738912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.617011+0000","last_change":"2024-09-19T11:51:53.484021+0000","last_active":"2024-09-19T12:00:16.617011+0000","last_peered":"2024-09-19T12:00:16.617011+0000","last_clean":"2024-09-19T12:00:16.617011+0000","last_became_active":"2024-09-19T11:51:53.483350+0000","last_became_peered":"2024-09-19T11:51:53.483350+0000","last_unstale":"2024-09-19T12:00:16.617011+0000","last_undegraded":"2024-09-19T12:00:16.617011+0000","last_fullsized":"2024-09-19T12:00:16.617011+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:32.695646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"264'9","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.872856+0000","last_change":"2024-09-19T11:53:37.731037+0000","last_active":"2024-09-19T12:03:05.872856+0000","last_peered":"2024-09-19T12:03:05.872856+0000","last_clean":"2024-09-19T12:03:05.872856+0000","last_became_active":"2024-09-19T11:53:37.730641+0000","last_became_peered":"2024-09-19T11:53:37.730641+0000","last_unstale":"2024-09-19T12:03:05.872856+0000","last_undegraded":"2024-09-19T12:03:05.872856+0000","last_fullsized":"2024-09-19T12:03:05.872856+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:40.518527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15360,"num_write":14,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.614943+0000","last_change":"2024-09-19T11:53:34.719873+0000","last_active":"2024-09-19T12:00:06.614943+0000","last_peered":"2024-09-19T12:00:06.614943+0000","last_clean":"2024-09-19T12:00:06.614943+0000","last_became_active":"2024-09-19T11:53:34.719193+0000","last_became_peered":"2024-09-19T11:53:34.719193+0000","last_unstale":"2024-09-19T12:00:06.614943+0000","last_undegraded":"2024-09-19T12:00:06.614943+0000","last_fullsized":"2024-09-19T12:00:06.614943+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:17.922208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"256'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.601313+0000","last_change":"2024-09-19T11:51:53.479626+0000","last_active":"2024-09-19T12:00:16.601313+0000","last_peered":"2024-09-19T12:00:16.601313+0000","last_clean":"2024-09-19T12:00:16.601313+0000","last_became_active":"2024-09-19T11:51:53.476953+0000","last_became_peered":"2024-09-19T11:51:53.476953+0000","last_unstale":"2024-09-19T12:00:16.601313+0000","last_undegraded":"2024-09-19T12:00:16.601313+0000","last_fullsized":"2024-09-19T12:00:16.601313+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:40.063157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:01.623954+0000","last_change":"2024-09-19T11:53:37.736521+0000","last_active":"2024-09-19T12:02:01.623954+0000","last_peered":"2024-09-19T12:02:01.623954+0000","last_clean":"2024-09-19T12:02:01.623954+0000","last_became_active":"2024-09-19T11:53:37.731400+0000","last_became_peered":"2024-09-19T11:53:37.731400+0000","last_unstale":"2024-09-19T12:02:01.623954+0000","last_undegraded":"2024-09-19T12:02:01.623954+0000","last_fullsized":"2024-09-19T12:02:01.623954+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:04.607485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.886887+0000","last_change":"2024-09-19T11:53:34.724933+0000","last_active":"2024-09-19T12:03:05.886887+0000","last_peered":"2024-09-19T12:03:05.886887+0000","last_clean":"2024-09-19T12:03:05.886887+0000","last_became_active":"2024-09-19T11:53:34.724406+0000","last_became_peered":"2024-09-19T11:53:34.724406+0000","last_unstale":"2024-09-19T12:03:05.886887+0000","last_undegraded":"2024-09-19T12:03:05.886887+0000","last_fullsized":"2024-09-19T12:03:05.886887+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:26.998520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":21506,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.612913+0000","last_change":"2024-09-19T11:51:53.495205+0000","last_active":"2024-09-19T12:00:16.612913+0000","last_peered":"2024-09-19T12:00:16.612913+0000","last_clean":"2024-09-19T12:00:16.612913+0000","last_became_active":"2024-09-19T11:51:53.494443+0000","last_became_peered":"2024-09-19T11:51:53.494443+0000","last_unstale":"2024-09-19T12:00:16.612913+0000","last_undegraded":"2024-09-19T12:00:16.612913+0000","last_fullsized":"2024-09-19T12:00:16.612913+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:22.980807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.0","version":"264'2","reported_seq":25,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:41.633179+0000","last_change":"2024-09-19T11:53:37.729810+0000","last_active":"2024-09-19T12:01:41.633179+0000","last_peered":"2024-09-19T12:01:41.633179+0000","last_clean":"2024-09-19T12:01:41.633179+0000","last_became_active":"2024-09-19T11:53:37.729101+0000","last_became_peered":"2024-09-19T11:53:37.729101+0000","last_unstale":"2024-09-19T12:01:41.633179+0000","last_undegraded":"2024-09-19T12:01:41.633179+0000","last_fullsized":"2024-09-19T12:01:41.633179+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:23.824167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:56.639147+0000","last_change":"2024-09-19T11:53:34.719029+0000","last_active":"2024-09-19T12:01:56.639147+0000","last_peered":"2024-09-19T12:01:56.639147+0000","last_clean":"2024-09-19T12:01:56.639147+0000","last_became_active":"2024-09-19T11:53:34.715905+0000","last_became_peered":"2024-09-19T11:53:34.715905+0000","last_unstale":"2024-09-19T12:01:56.639147+0000","last_undegraded":"2024-09-19T12:01:56.639147+0000","last_fullsized":"2024-09-19T12:01:56.639147+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:06.085056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.806309+0000","last_change":"2024-09-19T11:51:53.485332+0000","last_active":"2024-09-19T12:00:16.806309+0000","last_peered":"2024-09-19T12:00:16.806309+0000","last_clean":"2024-09-19T12:00:16.806309+0000","last_became_active":"2024-09-19T11:51:53.479975+0000","last_became_peered":"2024-09-19T11:51:53.479975+0000","last_unstale":"2024-09-19T12:00:16.806309+0000","last_undegraded":"2024-09-19T12:00:16.806309+0000","last_fullsized":"2024-09-19T12:00:16.806309+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:54.383913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.609354+0000","last_change":"2024-09-19T11:53:37.752407+0000","last_active":"2024-09-19T11:59:56.609354+0000","last_peered":"2024-09-19T11:59:56.609354+0000","last_clean":"2024-09-19T11:59:56.609354+0000","last_became_active":"2024-09-19T11:53:37.751835+0000","last_became_peered":"2024-09-19T11:53:37.751835+0000","last_unstale":"2024-09-19T11:59:56.609354+0000","last_undegraded":"2024-09-19T11:59:56.609354+0000","last_fullsized":"2024-09-19T11:59:56.609354+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:44.756436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:56.623014+0000","last_change":"2024-09-19T11:53:34.722088+0000","last_active":"2024-09-19T12:01:56.623014+0000","last_peered":"2024-09-19T12:01:56.623014+0000","last_clean":"2024-09-19T12:01:56.623014+0000","last_became_active":"2024-09-19T11:53:34.721659+0000","last_became_peered":"2024-09-19T11:53:34.721659+0000","last_unstale":"2024-09-19T12:01:56.623014+0000","last_undegraded":"2024-09-19T12:01:56.623014+0000","last_fullsized":"2024-09-19T12:01:56.623014+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:52.673209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.613783+0000","last_change":"2024-09-19T11:51:53.488636+0000","last_active":"2024-09-19T12:00:16.613783+0000","last_peered":"2024-09-19T12:00:16.613783+0000","last_clean":"2024-09-19T12:00:16.613783+0000","last_became_active":"2024-09-19T11:51:53.487416+0000","last_became_peered":"2024-09-19T11:51:53.487416+0000","last_unstale":"2024-09-19T12:00:16.613783+0000","last_undegraded":"2024-09-19T12:00:16.613783+0000","last_fullsized":"2024-09-19T12:00:16.613783+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:28.039923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"264'3","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:01.829672+0000","last_change":"2024-09-19T11:53:37.722872+0000","last_active":"2024-09-19T12:02:01.829672+0000","last_peered":"2024-09-19T12:02:01.829672+0000","last_clean":"2024-09-19T12:02:01.829672+0000","last_became_active":"2024-09-19T11:53:37.722160+0000","last_became_peered":"2024-09-19T11:53:37.722160+0000","last_unstale":"2024-09-19T12:02:01.829672+0000","last_undegraded":"2024-09-19T12:02:01.829672+0000","last_fullsized":"2024-09-19T12:02:01.829672+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:39.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.608199+0000","last_change":"2024-09-19T11:53:34.699925+0000","last_active":"2024-09-19T11:59:51.608199+0000","last_peered":"2024-09-19T11:59:51.608199+0000","last_clean":"2024-09-19T11:59:51.608199+0000","last_became_active":"2024-09-19T11:53:34.699127+0000","last_became_peered":"2024-09-19T11:53:34.699127+0000","last_unstale":"2024-09-19T11:59:51.608199+0000","last_undegraded":"2024-09-19T11:59:51.608199+0000","last_fullsized":"2024-09-19T11:59:51.608199+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:49.808733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"256'15","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.612683+0000","last_change":"2024-09-19T11:51:53.485393+0000","last_active":"2024-09-19T11:59:56.612683+0000","last_peered":"2024-09-19T11:59:56.612683+0000","last_clean":"2024-09-19T11:59:56.612683+0000","last_became_active":"2024-09-19T11:51:53.484630+0000","last_became_peered":"2024-09-19T11:51:53.484630+0000","last_unstale":"2024-09-19T11:59:56.612683+0000","last_undegraded":"2024-09-19T11:59:56.612683+0000","last_fullsized":"2024-09-19T11:59:56.612683+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:33.200357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":95,"num_write":34,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'29","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.468513+0000","last_change":"2024-09-19T12:03:23.468513+0000","last_active":"2024-09-19T12:03:23.468513+0000","last_peered":"2024-09-19T12:03:23.468513+0000","last_clean":"2024-09-19T12:03:23.468513+0000","last_became_active":"2024-09-19T11:35:31.628800+0000","last_became_peered":"2024-09-19T11:35:31.628800+0000","last_unstale":"2024-09-19T12:03:23.468513+0000","last_undegraded":"2024-09-19T12:03:23.468513+0000","last_fullsized":"2024-09-19T12:03:23.468513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-19T12:03:23.468293+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-19T12:03:23.468293+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.468293+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:18.549190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":38,"num_write":120,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'47","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.617744+0000","last_change":"2024-09-19T11:35:33.628736+0000","last_active":"2024-09-19T12:00:36.617744+0000","last_peered":"2024-09-19T12:00:36.617744+0000","last_clean":"2024-09-19T12:00:36.617744+0000","last_became_active":"2024-09-19T11:35:33.627994+0000","last_became_peered":"2024-09-19T11:35:33.627994+0000","last_unstale":"2024-09-19T12:00:36.617744+0000","last_undegraded":"2024-09-19T12:00:36.617744+0000","last_fullsized":"2024-09-19T12:00:36.617744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:58.580017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":154,"num_write":67,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'64","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.634908+0000","last_change":"2024-09-19T12:03:16.634908+0000","last_active":"2024-09-19T12:03:16.634908+0000","last_peered":"2024-09-19T12:03:16.634908+0000","last_clean":"2024-09-19T12:03:16.634908+0000","last_became_active":"2024-09-19T11:35:31.608158+0000","last_became_peered":"2024-09-19T11:35:31.608158+0000","last_unstale":"2024-09-19T12:03:16.634908+0000","last_undegraded":"2024-09-19T12:03:16.634908+0000","last_fullsized":"2024-09-19T12:03:16.634908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'64","last_scrub_stamp":"2024-09-19T12:03:16.634685+0000","last_deep_scrub":"264'64","last_deep_scrub_stamp":"2024-09-19T12:03:16.634685+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.634685+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:56.893267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":661,"num_write":209,"num_write_kb":4683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'27","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.621331+0000","last_change":"2024-09-19T11:35:33.621664+0000","last_active":"2024-09-19T12:00:36.621331+0000","last_peered":"2024-09-19T12:00:36.621331+0000","last_clean":"2024-09-19T12:00:36.621331+0000","last_became_active":"2024-09-19T11:35:33.618098+0000","last_became_peered":"2024-09-19T11:35:33.618098+0000","last_unstale":"2024-09-19T12:00:36.621331+0000","last_undegraded":"2024-09-19T12:00:36.621331+0000","last_fullsized":"2024-09-19T12:00:36.621331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:51.714564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":93,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'44","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.399942+0000","last_change":"2024-09-19T12:03:14.399942+0000","last_active":"2024-09-19T12:03:14.399942+0000","last_peered":"2024-09-19T12:03:14.399942+0000","last_clean":"2024-09-19T12:03:14.399942+0000","last_became_active":"2024-09-19T11:35:31.613678+0000","last_became_peered":"2024-09-19T11:35:31.613678+0000","last_unstale":"2024-09-19T12:03:14.399942+0000","last_undegraded":"2024-09-19T12:03:14.399942+0000","last_fullsized":"2024-09-19T12:03:14.399942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-19T12:03:14.399627+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-19T12:03:14.399627+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.399627+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:09.098923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":82,"num_read_kb":12351,"num_write":140,"num_write_kb":6154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'42","reported_seq":543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810975+0000","last_change":"2024-09-19T11:35:33.614046+0000","last_active":"2024-09-19T12:00:36.810975+0000","last_peered":"2024-09-19T12:00:36.810975+0000","last_clean":"2024-09-19T12:00:36.810975+0000","last_became_active":"2024-09-19T11:35:33.613298+0000","last_became_peered":"2024-09-19T11:35:33.613298+0000","last_unstale":"2024-09-19T12:00:36.810975+0000","last_undegraded":"2024-09-19T12:00:36.810975+0000","last_fullsized":"2024-09-19T12:00:36.810975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:34.924557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":123,"num_write":79,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'25","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.480251+0000","last_change":"2024-09-19T12:03:22.480251+0000","last_active":"2024-09-19T12:03:22.480251+0000","last_peered":"2024-09-19T12:03:22.480251+0000","last_clean":"2024-09-19T12:03:22.480251+0000","last_became_active":"2024-09-19T11:35:31.608115+0000","last_became_peered":"2024-09-19T11:35:31.608115+0000","last_unstale":"2024-09-19T12:03:22.480251+0000","last_undegraded":"2024-09-19T12:03:22.480251+0000","last_fullsized":"2024-09-19T12:03:22.480251+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-19T12:03:22.480019+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-19T12:03:22.480019+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.480019+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:10.348744+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":1089,"num_write":119,"num_write_kb":1059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'55","reported_seq":587,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.371828+0000","last_change":"2024-09-19T12:03:26.371828+0000","last_active":"2024-09-19T12:03:26.371828+0000","last_peered":"2024-09-19T12:03:26.371828+0000","last_clean":"2024-09-19T12:03:26.371828+0000","last_became_active":"2024-09-19T11:35:33.625528+0000","last_became_peered":"2024-09-19T11:35:33.625528+0000","last_unstale":"2024-09-19T12:03:26.371828+0000","last_undegraded":"2024-09-19T12:03:26.371828+0000","last_fullsized":"2024-09-19T12:03:26.371828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-09-19T12:03:26.371631+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-09-19T12:03:26.371631+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.371631+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:27.169927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":230,"num_read_kb":188,"num_write":85,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'71","reported_seq":599,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.447650+0000","last_change":"2024-09-19T12:03:22.447650+0000","last_active":"2024-09-19T12:03:22.447650+0000","last_peered":"2024-09-19T12:03:22.447650+0000","last_clean":"2024-09-19T12:03:22.447650+0000","last_became_active":"2024-09-19T11:35:31.618555+0000","last_became_peered":"2024-09-19T11:35:31.618555+0000","last_unstale":"2024-09-19T12:03:22.447650+0000","last_undegraded":"2024-09-19T12:03:22.447650+0000","last_fullsized":"2024-09-19T12:03:22.447650+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'71","last_scrub_stamp":"2024-09-19T12:03:22.447441+0000","last_deep_scrub":"264'71","last_deep_scrub_stamp":"2024-09-19T12:03:22.447441+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.447441+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:02.660150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":29375,"num_write":187,"num_write_kb":13979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'27","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.155247+0000","last_change":"2024-09-19T12:03:23.155247+0000","last_active":"2024-09-19T12:03:23.155247+0000","last_peered":"2024-09-19T12:03:23.155247+0000","last_clean":"2024-09-19T12:03:23.155247+0000","last_became_active":"2024-09-19T11:35:33.624952+0000","last_became_peered":"2024-09-19T11:35:33.624952+0000","last_unstale":"2024-09-19T12:03:23.155247+0000","last_undegraded":"2024-09-19T12:03:23.155247+0000","last_fullsized":"2024-09-19T12:03:23.155247+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-19T12:03:23.155029+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-19T12:03:23.155029+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.155029+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:07.075048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":112,"num_write":47,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'51","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.495308+0000","last_change":"2024-09-19T12:03:23.495308+0000","last_active":"2024-09-19T12:03:23.495308+0000","last_peered":"2024-09-19T12:03:23.495308+0000","last_clean":"2024-09-19T12:03:23.495308+0000","last_became_active":"2024-09-19T11:35:31.587016+0000","last_became_peered":"2024-09-19T11:35:31.587016+0000","last_unstale":"2024-09-19T12:03:23.495308+0000","last_undegraded":"2024-09-19T12:03:23.495308+0000","last_fullsized":"2024-09-19T12:03:23.495308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-09-19T12:03:23.495109+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-09-19T12:03:23.495109+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.495109+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:27.504609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":3127,"num_write":134,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"253'2","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.811093+0000","last_change":"2024-09-19T11:35:33.614181+0000","last_active":"2024-09-19T12:00:36.811093+0000","last_peered":"2024-09-19T12:00:36.811093+0000","last_clean":"2024-09-19T12:00:36.811093+0000","last_became_active":"2024-09-19T11:35:33.612338+0000","last_became_peered":"2024-09-19T11:35:33.612338+0000","last_unstale":"2024-09-19T12:00:36.811093+0000","last_undegraded":"2024-09-19T12:00:36.811093+0000","last_fullsized":"2024-09-19T12:00:36.811093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:01.117001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'39","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.426910+0000","last_change":"2024-09-19T12:03:21.426910+0000","last_active":"2024-09-19T12:03:21.426910+0000","last_peered":"2024-09-19T12:03:21.426910+0000","last_clean":"2024-09-19T12:03:21.426910+0000","last_became_active":"2024-09-19T11:35:31.619730+0000","last_became_peered":"2024-09-19T11:35:31.619730+0000","last_unstale":"2024-09-19T12:03:21.426910+0000","last_undegraded":"2024-09-19T12:03:21.426910+0000","last_fullsized":"2024-09-19T12:03:21.426910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-19T12:03:21.426671+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-19T12:03:21.426671+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.426671+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:19.990519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":33,"num_write":114,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'48","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618078+0000","last_change":"2024-09-19T11:35:33.612223+0000","last_active":"2024-09-19T12:00:36.618078+0000","last_peered":"2024-09-19T12:00:36.618078+0000","last_clean":"2024-09-19T12:00:36.618078+0000","last_became_active":"2024-09-19T11:35:33.611495+0000","last_became_peered":"2024-09-19T11:35:33.611495+0000","last_unstale":"2024-09-19T12:00:36.618078+0000","last_undegraded":"2024-09-19T12:00:36.618078+0000","last_fullsized":"2024-09-19T12:00:36.618078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:50.704291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":135,"num_write":76,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'38","reported_seq":557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.835009+0000","last_change":"2024-09-19T12:03:18.835009+0000","last_active":"2024-09-19T12:03:18.835009+0000","last_peered":"2024-09-19T12:03:18.835009+0000","last_clean":"2024-09-19T12:03:18.835009+0000","last_became_active":"2024-09-19T11:35:31.593765+0000","last_became_peered":"2024-09-19T11:35:31.593765+0000","last_unstale":"2024-09-19T12:03:18.835009+0000","last_undegraded":"2024-09-19T12:03:18.835009+0000","last_fullsized":"2024-09-19T12:03:18.835009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-19T12:03:18.834783+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-19T12:03:18.834783+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.834783+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:50.647398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":57,"num_read_kb":47,"num_write":117,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'46","reported_seq":572,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.236236+0000","last_change":"2024-09-19T12:03:22.236236+0000","last_active":"2024-09-19T12:03:22.236236+0000","last_peered":"2024-09-19T12:03:22.236236+0000","last_clean":"2024-09-19T12:03:22.236236+0000","last_became_active":"2024-09-19T11:35:33.604505+0000","last_became_peered":"2024-09-19T11:35:33.604505+0000","last_unstale":"2024-09-19T12:03:22.236236+0000","last_undegraded":"2024-09-19T12:03:22.236236+0000","last_fullsized":"2024-09-19T12:03:22.236236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'46","last_scrub_stamp":"2024-09-19T12:03:22.236038+0000","last_deep_scrub":"264'46","last_deep_scrub_stamp":"2024-09-19T12:03:22.236038+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.236038+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:46.941280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":158,"num_write":84,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'76","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.163064+0000","last_change":"2024-09-19T11:35:33.608564+0000","last_active":"2024-09-19T12:02:33.163064+0000","last_peered":"2024-09-19T12:02:33.163064+0000","last_clean":"2024-09-19T12:02:33.163064+0000","last_became_active":"2024-09-19T11:35:33.607843+0000","last_became_peered":"2024-09-19T11:35:33.607843+0000","last_unstale":"2024-09-19T12:02:33.163064+0000","last_undegraded":"2024-09-19T12:02:33.163064+0000","last_fullsized":"2024-09-19T12:02:33.163064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:40.705119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":241,"num_write":113,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'43","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.182034+0000","last_change":"2024-09-19T12:03:15.182034+0000","last_active":"2024-09-19T12:03:15.182034+0000","last_peered":"2024-09-19T12:03:15.182034+0000","last_clean":"2024-09-19T12:03:15.182034+0000","last_became_active":"2024-09-19T11:36:06.680794+0000","last_became_peered":"2024-09-19T11:36:06.680794+0000","last_unstale":"2024-09-19T12:03:15.182034+0000","last_undegraded":"2024-09-19T12:03:15.182034+0000","last_fullsized":"2024-09-19T12:03:15.182034+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'43","last_scrub_stamp":"2024-09-19T12:03:15.181797+0000","last_deep_scrub":"264'43","last_deep_scrub_stamp":"2024-09-19T12:03:15.181797+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.181797+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:02.405820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":3338,"num_write":153,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,1],"acting":[2,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599773+0000","last_change":"2024-09-19T11:35:33.622666+0000","last_active":"2024-09-19T11:58:56.599773+0000","last_peered":"2024-09-19T11:58:56.599773+0000","last_clean":"2024-09-19T11:58:56.599773+0000","last_became_active":"2024-09-19T11:35:33.621522+0000","last_became_peered":"2024-09-19T11:35:33.621522+0000","last_unstale":"2024-09-19T11:58:56.599773+0000","last_undegraded":"2024-09-19T11:58:56.599773+0000","last_fullsized":"2024-09-19T11:58:56.599773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:16.770624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'38","reported_seq":562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.100506+0000","last_change":"2024-09-19T12:03:18.100506+0000","last_active":"2024-09-19T12:03:18.100506+0000","last_peered":"2024-09-19T12:03:18.100506+0000","last_clean":"2024-09-19T12:03:18.100506+0000","last_became_active":"2024-09-19T11:35:31.598016+0000","last_became_peered":"2024-09-19T11:35:31.598016+0000","last_unstale":"2024-09-19T12:03:18.100506+0000","last_undegraded":"2024-09-19T12:03:18.100506+0000","last_fullsized":"2024-09-19T12:03:18.100506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-19T12:03:18.100202+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-19T12:03:18.100202+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.100202+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:16.805533+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159780,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":2182,"num_write":164,"num_write_kb":2115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'48","reported_seq":554,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.596523+0000","last_change":"2024-09-19T11:35:33.612612+0000","last_active":"2024-09-19T11:59:01.596523+0000","last_peered":"2024-09-19T11:59:01.596523+0000","last_clean":"2024-09-19T11:59:01.596523+0000","last_became_active":"2024-09-19T11:35:33.610072+0000","last_became_peered":"2024-09-19T11:35:33.610072+0000","last_unstale":"2024-09-19T11:59:01.596523+0000","last_undegraded":"2024-09-19T11:59:01.596523+0000","last_fullsized":"2024-09-19T11:59:01.596523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:22.254214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":149,"num_write":86,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'38","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.072223+0000","last_change":"2024-09-19T12:03:17.072223+0000","last_active":"2024-09-19T12:03:17.072223+0000","last_peered":"2024-09-19T12:03:17.072223+0000","last_clean":"2024-09-19T12:03:17.072223+0000","last_became_active":"2024-09-19T11:35:31.614263+0000","last_became_peered":"2024-09-19T11:35:31.614263+0000","last_unstale":"2024-09-19T12:03:17.072223+0000","last_undegraded":"2024-09-19T12:03:17.072223+0000","last_fullsized":"2024-09-19T12:03:17.072223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-19T12:03:17.072026+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-19T12:03:17.072026+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.072026+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:59.461838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":5162,"num_write":130,"num_write_kb":10269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'149","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.264548+0000","last_change":"2024-09-19T12:03:19.264548+0000","last_active":"2024-09-19T12:03:19.264548+0000","last_peered":"2024-09-19T12:03:19.264548+0000","last_clean":"2024-09-19T12:03:19.264548+0000","last_became_active":"2024-09-19T11:35:33.611240+0000","last_became_peered":"2024-09-19T11:35:33.611240+0000","last_unstale":"2024-09-19T12:03:19.264548+0000","last_undegraded":"2024-09-19T12:03:19.264548+0000","last_fullsized":"2024-09-19T12:03:19.264548+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-19T12:03:19.264365+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-19T12:03:19.264365+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.264365+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:15.800283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":454,"num_write":234,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'36","reported_seq":552,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.192398+0000","last_change":"2024-09-19T12:03:15.192398+0000","last_active":"2024-09-19T12:03:15.192398+0000","last_peered":"2024-09-19T12:03:15.192398+0000","last_clean":"2024-09-19T12:03:15.192398+0000","last_became_active":"2024-09-19T11:35:31.591932+0000","last_became_peered":"2024-09-19T11:35:31.591932+0000","last_unstale":"2024-09-19T12:03:15.192398+0000","last_undegraded":"2024-09-19T12:03:15.192398+0000","last_fullsized":"2024-09-19T12:03:15.192398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-19T12:03:15.192152+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-19T12:03:15.192152+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.192152+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:34.198854+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291468,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":7804,"num_write":105,"num_write_kb":7776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'26","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.262570+0000","last_change":"2024-09-19T12:03:20.262570+0000","last_active":"2024-09-19T12:03:20.262570+0000","last_peered":"2024-09-19T12:03:20.262570+0000","last_clean":"2024-09-19T12:03:20.262570+0000","last_became_active":"2024-09-19T11:35:33.625698+0000","last_became_peered":"2024-09-19T11:35:33.625698+0000","last_unstale":"2024-09-19T12:03:20.262570+0000","last_undegraded":"2024-09-19T12:03:20.262570+0000","last_fullsized":"2024-09-19T12:03:20.262570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-19T12:03:20.262382+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-19T12:03:20.262382+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.262382+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:46.069587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":73,"num_write":57,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'25","reported_seq":555,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.790984+0000","last_change":"2024-09-19T12:03:19.790984+0000","last_active":"2024-09-19T12:03:19.790984+0000","last_peered":"2024-09-19T12:03:19.790984+0000","last_clean":"2024-09-19T12:03:19.790984+0000","last_became_active":"2024-09-19T11:35:31.600939+0000","last_became_peered":"2024-09-19T11:35:31.600939+0000","last_unstale":"2024-09-19T12:03:19.790984+0000","last_undegraded":"2024-09-19T12:03:19.790984+0000","last_fullsized":"2024-09-19T12:03:19.790984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-19T12:03:19.790722+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-19T12:03:19.790722+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.790722+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:46.880166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":6211,"num_write":103,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.799672+0000","last_change":"2024-09-19T11:35:33.605918+0000","last_active":"2024-09-19T11:59:46.799672+0000","last_peered":"2024-09-19T11:59:46.799672+0000","last_clean":"2024-09-19T11:59:46.799672+0000","last_became_active":"2024-09-19T11:35:33.605215+0000","last_became_peered":"2024-09-19T11:35:33.605215+0000","last_unstale":"2024-09-19T11:59:46.799672+0000","last_undegraded":"2024-09-19T11:59:46.799672+0000","last_fullsized":"2024-09-19T11:59:46.799672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:06.551820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'50","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.341918+0000","last_change":"2024-09-19T12:03:18.341918+0000","last_active":"2024-09-19T12:03:18.341918+0000","last_peered":"2024-09-19T12:03:18.341918+0000","last_clean":"2024-09-19T12:03:18.341918+0000","last_became_active":"2024-09-19T11:35:31.597035+0000","last_became_peered":"2024-09-19T11:35:31.597035+0000","last_unstale":"2024-09-19T12:03:18.341918+0000","last_undegraded":"2024-09-19T12:03:18.341918+0000","last_fullsized":"2024-09-19T12:03:18.341918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-19T12:03:18.341715+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-19T12:03:18.341715+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.341715+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:21.241927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":25670,"num_write":130,"num_write_kb":10245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'16","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.800682+0000","last_change":"2024-09-19T11:35:41.674446+0000","last_active":"2024-09-19T11:59:51.800682+0000","last_peered":"2024-09-19T11:59:51.800682+0000","last_clean":"2024-09-19T11:59:51.800682+0000","last_became_active":"2024-09-19T11:35:41.673420+0000","last_became_peered":"2024-09-19T11:35:41.673420+0000","last_unstale":"2024-09-19T11:59:51.800682+0000","last_undegraded":"2024-09-19T11:59:51.800682+0000","last_fullsized":"2024-09-19T11:59:51.800682+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:40.611862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":47,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.915760+0000","last_change":"2024-09-19T12:03:24.915760+0000","last_active":"2024-09-19T12:03:24.915760+0000","last_peered":"2024-09-19T12:03:24.915760+0000","last_clean":"2024-09-19T12:03:24.915760+0000","last_became_active":"2024-09-19T11:35:33.613437+0000","last_became_peered":"2024-09-19T11:35:33.613437+0000","last_unstale":"2024-09-19T12:03:24.915760+0000","last_undegraded":"2024-09-19T12:03:24.915760+0000","last_fullsized":"2024-09-19T12:03:24.915760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:24.915574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:24.915574+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.915574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:40.177888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'59","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.461837+0000","last_change":"2024-09-19T12:03:19.461837+0000","last_active":"2024-09-19T12:03:19.461837+0000","last_peered":"2024-09-19T12:03:19.461837+0000","last_clean":"2024-09-19T12:03:19.461837+0000","last_became_active":"2024-09-19T11:35:31.599314+0000","last_became_peered":"2024-09-19T11:35:31.599314+0000","last_unstale":"2024-09-19T12:03:19.461837+0000","last_undegraded":"2024-09-19T12:03:19.461837+0000","last_fullsized":"2024-09-19T12:03:19.461837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'59","last_scrub_stamp":"2024-09-19T12:03:19.461575+0000","last_deep_scrub":"264'59","last_deep_scrub_stamp":"2024-09-19T12:03:19.461575+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.461575+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:11.460791+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":96,"num_read_kb":1688,"num_write":199,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.606494+0000","last_change":"2024-09-19T11:35:35.617353+0000","last_active":"2024-09-19T11:59:46.606494+0000","last_peered":"2024-09-19T11:59:46.606494+0000","last_clean":"2024-09-19T11:59:46.606494+0000","last_became_active":"2024-09-19T11:35:35.616351+0000","last_became_peered":"2024-09-19T11:35:35.616351+0000","last_unstale":"2024-09-19T11:59:46.606494+0000","last_undegraded":"2024-09-19T11:59:46.606494+0000","last_fullsized":"2024-09-19T11:59:46.606494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:15.938562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'123","reported_seq":656,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.649912+0000","last_change":"2024-09-19T11:35:37.651194+0000","last_active":"2024-09-19T12:03:05.649912+0000","last_peered":"2024-09-19T12:03:05.649912+0000","last_clean":"2024-09-19T12:03:05.649912+0000","last_became_active":"2024-09-19T11:35:37.650685+0000","last_became_peered":"2024-09-19T11:35:37.650685+0000","last_unstale":"2024-09-19T12:03:05.649912+0000","last_undegraded":"2024-09-19T12:03:05.649912+0000","last_fullsized":"2024-09-19T12:03:05.649912+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:53.348943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":226,"num_write":120,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611862+0000","last_change":"2024-09-19T11:35:39.676563+0000","last_active":"2024-09-19T11:59:51.611862+0000","last_peered":"2024-09-19T11:59:51.611862+0000","last_clean":"2024-09-19T11:59:51.611862+0000","last_became_active":"2024-09-19T11:35:39.676033+0000","last_became_peered":"2024-09-19T11:35:39.676033+0000","last_unstale":"2024-09-19T11:59:51.611862+0000","last_undegraded":"2024-09-19T11:59:51.611862+0000","last_fullsized":"2024-09-19T11:59:51.611862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:44.059170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'15","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.608623+0000","last_change":"2024-09-19T11:35:41.682580+0000","last_active":"2024-09-19T11:59:56.608623+0000","last_peered":"2024-09-19T11:59:56.608623+0000","last_clean":"2024-09-19T11:59:56.608623+0000","last_became_active":"2024-09-19T11:35:41.680497+0000","last_became_peered":"2024-09-19T11:35:41.680497+0000","last_unstale":"2024-09-19T11:59:56.608623+0000","last_undegraded":"2024-09-19T11:59:56.608623+0000","last_fullsized":"2024-09-19T11:59:56.608623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:55.800690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":49,"num_write":53,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'2","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.518618+0000","last_change":"2024-09-19T12:03:25.518618+0000","last_active":"2024-09-19T12:03:25.518618+0000","last_peered":"2024-09-19T12:03:25.518618+0000","last_clean":"2024-09-19T12:03:25.518618+0000","last_became_active":"2024-09-19T11:35:33.615138+0000","last_became_peered":"2024-09-19T11:35:33.615138+0000","last_unstale":"2024-09-19T12:03:25.518618+0000","last_undegraded":"2024-09-19T12:03:25.518618+0000","last_fullsized":"2024-09-19T12:03:25.518618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:25.518441+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:25.518441+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.518441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:30.047762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'37","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.381754+0000","last_change":"2024-09-19T12:03:15.381754+0000","last_active":"2024-09-19T12:03:15.381754+0000","last_peered":"2024-09-19T12:03:15.381754+0000","last_clean":"2024-09-19T12:03:15.381754+0000","last_became_active":"2024-09-19T11:35:31.612424+0000","last_became_peered":"2024-09-19T11:35:31.612424+0000","last_unstale":"2024-09-19T12:03:15.381754+0000","last_undegraded":"2024-09-19T12:03:15.381754+0000","last_fullsized":"2024-09-19T12:03:15.381754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:15.381564+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:15.381564+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.381564+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:57.076212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":5150,"num_write":106,"num_write_kb":10271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.592095+0000","last_change":"2024-09-19T11:35:35.627312+0000","last_active":"2024-09-19T11:59:01.592095+0000","last_peered":"2024-09-19T11:59:01.592095+0000","last_clean":"2024-09-19T11:59:01.592095+0000","last_became_active":"2024-09-19T11:35:35.626979+0000","last_became_peered":"2024-09-19T11:35:35.626979+0000","last_unstale":"2024-09-19T11:59:01.592095+0000","last_undegraded":"2024-09-19T11:59:01.592095+0000","last_fullsized":"2024-09-19T11:59:01.592095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:42.288842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'48","reported_seq":554,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:16.833482+0000","last_change":"2024-09-19T11:35:37.630326+0000","last_active":"2024-09-19T12:02:16.833482+0000","last_peered":"2024-09-19T12:02:16.833482+0000","last_clean":"2024-09-19T12:02:16.833482+0000","last_became_active":"2024-09-19T11:35:37.624916+0000","last_became_peered":"2024-09-19T11:35:37.624916+0000","last_unstale":"2024-09-19T12:02:16.833482+0000","last_undegraded":"2024-09-19T12:02:16.833482+0000","last_fullsized":"2024-09-19T12:02:16.833482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:40.009132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":68,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.800889+0000","last_change":"2024-09-19T11:35:39.670488+0000","last_active":"2024-09-19T11:59:51.800889+0000","last_peered":"2024-09-19T11:59:51.800889+0000","last_clean":"2024-09-19T11:59:51.800889+0000","last_became_active":"2024-09-19T11:35:39.669732+0000","last_became_peered":"2024-09-19T11:35:39.669732+0000","last_unstale":"2024-09-19T11:59:51.800889+0000","last_undegraded":"2024-09-19T11:59:51.800889+0000","last_fullsized":"2024-09-19T11:59:51.800889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:15.697637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'26","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.620959+0000","last_change":"2024-09-19T11:35:41.695806+0000","last_active":"2024-09-19T12:00:41.620959+0000","last_peered":"2024-09-19T12:00:41.620959+0000","last_clean":"2024-09-19T12:00:41.620959+0000","last_became_active":"2024-09-19T11:35:41.693197+0000","last_became_peered":"2024-09-19T11:35:41.693197+0000","last_unstale":"2024-09-19T12:00:41.620959+0000","last_undegraded":"2024-09-19T12:00:41.620959+0000","last_fullsized":"2024-09-19T12:00:41.620959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":93,"num_write":83,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'5","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.312254+0000","last_change":"2024-09-19T12:03:22.312254+0000","last_active":"2024-09-19T12:03:22.312254+0000","last_peered":"2024-09-19T12:03:22.312254+0000","last_clean":"2024-09-19T12:03:22.312254+0000","last_became_active":"2024-09-19T11:35:33.625606+0000","last_became_peered":"2024-09-19T11:35:33.625606+0000","last_unstale":"2024-09-19T12:03:22.312254+0000","last_undegraded":"2024-09-19T12:03:22.312254+0000","last_fullsized":"2024-09-19T12:03:22.312254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:03:22.312041+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:03:22.312041+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.312041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:00.306623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'49","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.444132+0000","last_change":"2024-09-19T12:03:18.444132+0000","last_active":"2024-09-19T12:03:18.444132+0000","last_peered":"2024-09-19T12:03:18.444132+0000","last_clean":"2024-09-19T12:03:18.444132+0000","last_became_active":"2024-09-19T11:35:31.621190+0000","last_became_peered":"2024-09-19T11:35:31.621190+0000","last_unstale":"2024-09-19T12:03:18.444132+0000","last_undegraded":"2024-09-19T12:03:18.444132+0000","last_fullsized":"2024-09-19T12:03:18.444132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-19T12:03:18.443898+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-19T12:03:18.443898+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.443898+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:55.033263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":65,"num_read_kb":198,"num_write":164,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"38'3","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.052304+0000","last_change":"2024-09-19T11:35:35.624498+0000","last_active":"2024-09-19T12:03:05.052304+0000","last_peered":"2024-09-19T12:03:05.052304+0000","last_clean":"2024-09-19T12:03:05.052304+0000","last_became_active":"2024-09-19T11:35:35.623997+0000","last_became_peered":"2024-09-19T11:35:35.623997+0000","last_unstale":"2024-09-19T12:03:05.052304+0000","last_undegraded":"2024-09-19T12:03:05.052304+0000","last_fullsized":"2024-09-19T12:03:05.052304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:39.064327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":628,"num_read_kb":626,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'64","reported_seq":579,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:26.614835+0000","last_change":"2024-09-19T11:35:37.628761+0000","last_active":"2024-09-19T12:01:26.614835+0000","last_peered":"2024-09-19T12:01:26.614835+0000","last_clean":"2024-09-19T12:01:26.614835+0000","last_became_active":"2024-09-19T11:35:37.628124+0000","last_became_peered":"2024-09-19T11:35:37.628124+0000","last_unstale":"2024-09-19T12:01:26.614835+0000","last_undegraded":"2024-09-19T12:01:26.614835+0000","last_fullsized":"2024-09-19T12:01:26.614835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:14.165078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'615","reported_seq":1504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.307146+0000","last_change":"2024-09-19T11:35:39.682448+0000","last_active":"2024-09-19T12:03:05.307146+0000","last_peered":"2024-09-19T12:03:05.307146+0000","last_clean":"2024-09-19T12:03:05.307146+0000","last_became_active":"2024-09-19T11:35:39.681867+0000","last_became_peered":"2024-09-19T11:35:39.681867+0000","last_unstale":"2024-09-19T12:03:05.307146+0000","last_undegraded":"2024-09-19T12:03:05.307146+0000","last_fullsized":"2024-09-19T12:03:05.307146+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:29.322118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'20","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812282+0000","last_change":"2024-09-19T11:35:41.677700+0000","last_active":"2024-09-19T12:00:41.812282+0000","last_peered":"2024-09-19T12:00:41.812282+0000","last_clean":"2024-09-19T12:00:41.812282+0000","last_became_active":"2024-09-19T11:35:41.676988+0000","last_became_peered":"2024-09-19T11:35:41.676988+0000","last_unstale":"2024-09-19T12:00:41.812282+0000","last_undegraded":"2024-09-19T12:00:41.812282+0000","last_fullsized":"2024-09-19T12:00:41.812282+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'23","reported_seq":530,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.177039+0000","last_change":"2024-09-19T11:35:33.614935+0000","last_active":"2024-09-19T12:02:33.177039+0000","last_peered":"2024-09-19T12:02:33.177039+0000","last_clean":"2024-09-19T12:02:33.177039+0000","last_became_active":"2024-09-19T11:35:33.614168+0000","last_became_peered":"2024-09-19T11:35:33.614168+0000","last_unstale":"2024-09-19T12:02:33.177039+0000","last_undegraded":"2024-09-19T12:02:33.177039+0000","last_fullsized":"2024-09-19T12:02:33.177039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:40.524246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":86,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'51","reported_seq":577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.965204+0000","last_change":"2024-09-19T12:03:13.965204+0000","last_active":"2024-09-19T12:03:13.965204+0000","last_peered":"2024-09-19T12:03:13.965204+0000","last_clean":"2024-09-19T12:03:13.965204+0000","last_became_active":"2024-09-19T11:35:31.610808+0000","last_became_peered":"2024-09-19T11:35:31.610808+0000","last_unstale":"2024-09-19T12:03:13.965204+0000","last_undegraded":"2024-09-19T12:03:13.965204+0000","last_fullsized":"2024-09-19T12:03:13.965204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-09-19T12:03:13.964934+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-09-19T12:03:13.964934+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.964934+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:35.104668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2128531,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":7272,"num_write":187,"num_write_kb":7210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.606549+0000","last_change":"2024-09-19T11:35:35.624368+0000","last_active":"2024-09-19T11:59:46.606549+0000","last_peered":"2024-09-19T11:59:46.606549+0000","last_clean":"2024-09-19T11:59:46.606549+0000","last_became_active":"2024-09-19T11:35:35.623608+0000","last_became_peered":"2024-09-19T11:35:35.623608+0000","last_unstale":"2024-09-19T11:59:46.606549+0000","last_undegraded":"2024-09-19T11:59:46.606549+0000","last_fullsized":"2024-09-19T11:59:46.606549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:32.921728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'67","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.575793+0000","last_change":"2024-09-19T11:35:37.646654+0000","last_active":"2024-09-19T12:03:05.575793+0000","last_peered":"2024-09-19T12:03:05.575793+0000","last_clean":"2024-09-19T12:03:05.575793+0000","last_became_active":"2024-09-19T11:35:37.645933+0000","last_became_peered":"2024-09-19T11:35:37.645933+0000","last_unstale":"2024-09-19T12:03:05.575793+0000","last_undegraded":"2024-09-19T12:03:05.575793+0000","last_fullsized":"2024-09-19T12:03:05.575793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:49.367677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":136,"num_write":66,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'622","reported_seq":1491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.701167+0000","last_change":"2024-09-19T11:35:39.655107+0000","last_active":"2024-09-19T12:03:05.701167+0000","last_peered":"2024-09-19T12:03:05.701167+0000","last_clean":"2024-09-19T12:03:05.701167+0000","last_became_active":"2024-09-19T11:35:39.654205+0000","last_became_peered":"2024-09-19T11:35:39.654205+0000","last_unstale":"2024-09-19T12:03:05.701167+0000","last_undegraded":"2024-09-19T12:03:05.701167+0000","last_fullsized":"2024-09-19T12:03:05.701167+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:09.266023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'23","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.509263+0000","last_change":"2024-09-19T12:03:24.509263+0000","last_active":"2024-09-19T12:03:24.509263+0000","last_peered":"2024-09-19T12:03:24.509263+0000","last_clean":"2024-09-19T12:03:24.509263+0000","last_became_active":"2024-09-19T11:35:33.624883+0000","last_became_peered":"2024-09-19T11:35:33.624883+0000","last_unstale":"2024-09-19T12:03:24.509263+0000","last_undegraded":"2024-09-19T12:03:24.509263+0000","last_fullsized":"2024-09-19T12:03:24.509263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-19T12:03:24.509080+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-19T12:03:24.509080+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.509080+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:51:19.432316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":86,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'37","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.413381+0000","last_change":"2024-09-19T12:03:16.413381+0000","last_active":"2024-09-19T12:03:16.413381+0000","last_peered":"2024-09-19T12:03:16.413381+0000","last_clean":"2024-09-19T12:03:16.413381+0000","last_became_active":"2024-09-19T11:35:31.609658+0000","last_became_peered":"2024-09-19T11:35:31.609658+0000","last_unstale":"2024-09-19T12:03:16.413381+0000","last_undegraded":"2024-09-19T12:03:16.413381+0000","last_fullsized":"2024-09-19T12:03:16.413381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:16.413160+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:16.413160+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.413160+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:25.039067+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":54,"num_read_kb":38,"num_write":106,"num_write_kb":5152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.606363+0000","last_change":"2024-09-19T11:35:35.622091+0000","last_active":"2024-09-19T11:59:26.606363+0000","last_peered":"2024-09-19T11:59:26.606363+0000","last_clean":"2024-09-19T11:59:26.606363+0000","last_became_active":"2024-09-19T11:35:35.621170+0000","last_became_peered":"2024-09-19T11:35:35.621170+0000","last_unstale":"2024-09-19T11:59:26.606363+0000","last_undegraded":"2024-09-19T11:59:26.606363+0000","last_fullsized":"2024-09-19T11:59:26.606363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:48.687735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'121","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.699213+0000","last_change":"2024-09-19T11:35:37.636324+0000","last_active":"2024-09-19T12:03:05.699213+0000","last_peered":"2024-09-19T12:03:05.699213+0000","last_clean":"2024-09-19T12:03:05.699213+0000","last_became_active":"2024-09-19T11:35:37.635359+0000","last_became_peered":"2024-09-19T11:35:37.635359+0000","last_unstale":"2024-09-19T12:03:05.699213+0000","last_undegraded":"2024-09-19T12:03:05.699213+0000","last_fullsized":"2024-09-19T12:03:05.699213+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:43.517566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4817,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":176,"num_read_kb":225,"num_write":122,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.603640+0000","last_change":"2024-09-19T11:35:39.683859+0000","last_active":"2024-09-19T12:00:26.603640+0000","last_peered":"2024-09-19T12:00:26.603640+0000","last_clean":"2024-09-19T12:00:26.603640+0000","last_became_active":"2024-09-19T11:35:39.683300+0000","last_became_peered":"2024-09-19T11:35:39.683300+0000","last_unstale":"2024-09-19T12:00:26.603640+0000","last_undegraded":"2024-09-19T12:00:26.603640+0000","last_fullsized":"2024-09-19T12:00:26.603640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:56.978681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"262'6","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619273+0000","last_change":"2024-09-19T11:35:41.685251+0000","last_active":"2024-09-19T12:00:41.619273+0000","last_peered":"2024-09-19T12:00:41.619273+0000","last_clean":"2024-09-19T12:00:41.619273+0000","last_became_active":"2024-09-19T11:35:41.684698+0000","last_became_peered":"2024-09-19T11:35:41.684698+0000","last_unstale":"2024-09-19T12:00:41.619273+0000","last_undegraded":"2024-09-19T12:00:41.619273+0000","last_fullsized":"2024-09-19T12:00:41.619273+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:43.679226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'10","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.228863+0000","last_change":"2024-09-19T12:03:17.228863+0000","last_active":"2024-09-19T12:03:17.228863+0000","last_peered":"2024-09-19T12:03:17.228863+0000","last_clean":"2024-09-19T12:03:17.228863+0000","last_became_active":"2024-09-19T11:35:33.617778+0000","last_became_peered":"2024-09-19T11:35:33.617778+0000","last_unstale":"2024-09-19T12:03:17.228863+0000","last_undegraded":"2024-09-19T12:03:17.228863+0000","last_fullsized":"2024-09-19T12:03:17.228863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-19T12:03:17.228686+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-19T12:03:17.228686+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.228686+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:43.560036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":12,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'64","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.439975+0000","last_change":"2024-09-19T12:03:17.439975+0000","last_active":"2024-09-19T12:03:17.439975+0000","last_peered":"2024-09-19T12:03:17.439975+0000","last_clean":"2024-09-19T12:03:17.439975+0000","last_became_active":"2024-09-19T11:35:31.609243+0000","last_became_peered":"2024-09-19T11:35:31.609243+0000","last_unstale":"2024-09-19T12:03:17.439975+0000","last_undegraded":"2024-09-19T12:03:17.439975+0000","last_fullsized":"2024-09-19T12:03:17.439975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'64","last_scrub_stamp":"2024-09-19T12:03:17.439587+0000","last_deep_scrub":"264'64","last_deep_scrub_stamp":"2024-09-19T12:03:17.439587+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.439587+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:54.098273+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":103,"num_read_kb":6258,"num_write":261,"num_write_kb":6195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.253561+0000","last_change":"2024-09-19T12:03:24.253561+0000","last_active":"2024-09-19T12:03:24.253561+0000","last_peered":"2024-09-19T12:03:24.253561+0000","last_clean":"2024-09-19T12:03:24.253561+0000","last_became_active":"2024-09-19T11:35:35.617934+0000","last_became_peered":"2024-09-19T11:35:35.617934+0000","last_unstale":"2024-09-19T12:03:24.253561+0000","last_undegraded":"2024-09-19T12:03:24.253561+0000","last_fullsized":"2024-09-19T12:03:24.253561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:24.253369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:24.253369+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.253369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:32.295766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'67","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.903208+0000","last_change":"2024-09-19T11:35:37.643864+0000","last_active":"2024-09-19T12:03:05.903208+0000","last_peered":"2024-09-19T12:03:05.903208+0000","last_clean":"2024-09-19T12:03:05.903208+0000","last_became_active":"2024-09-19T11:35:37.643236+0000","last_became_peered":"2024-09-19T11:35:37.643236+0000","last_unstale":"2024-09-19T12:03:05.903208+0000","last_undegraded":"2024-09-19T12:03:05.903208+0000","last_fullsized":"2024-09-19T12:03:05.903208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:47.647100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":101,"num_read_kb":192,"num_write":78,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.600120+0000","last_change":"2024-09-19T11:35:39.653781+0000","last_active":"2024-09-19T11:59:36.600120+0000","last_peered":"2024-09-19T11:59:36.600120+0000","last_clean":"2024-09-19T11:59:36.600120+0000","last_became_active":"2024-09-19T11:35:39.652920+0000","last_became_peered":"2024-09-19T11:35:39.652920+0000","last_unstale":"2024-09-19T11:59:36.600120+0000","last_undegraded":"2024-09-19T11:59:36.600120+0000","last_fullsized":"2024-09-19T11:59:36.600120+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:26.583277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'12","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:46.620891+0000","last_change":"2024-09-19T11:35:41.678791+0000","last_active":"2024-09-19T12:00:46.620891+0000","last_peered":"2024-09-19T12:00:46.620891+0000","last_clean":"2024-09-19T12:00:46.620891+0000","last_became_active":"2024-09-19T11:35:41.678055+0000","last_became_peered":"2024-09-19T11:35:41.678055+0000","last_unstale":"2024-09-19T12:00:46.620891+0000","last_undegraded":"2024-09-19T12:00:46.620891+0000","last_fullsized":"2024-09-19T12:00:46.620891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:27.826190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":59,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'47","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.108229+0000","last_change":"2024-09-19T12:03:20.108229+0000","last_active":"2024-09-19T12:03:20.108229+0000","last_peered":"2024-09-19T12:03:20.108229+0000","last_clean":"2024-09-19T12:03:20.108229+0000","last_became_active":"2024-09-19T11:35:33.624015+0000","last_became_peered":"2024-09-19T11:35:33.624015+0000","last_unstale":"2024-09-19T12:03:20.108229+0000","last_undegraded":"2024-09-19T12:03:20.108229+0000","last_fullsized":"2024-09-19T12:03:20.108229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-09-19T12:03:20.108047+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-09-19T12:03:20.108047+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.108047+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:57.493258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":170,"num_write":76,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'56","reported_seq":587,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.410916+0000","last_change":"2024-09-19T12:03:15.410916+0000","last_active":"2024-09-19T12:03:15.410916+0000","last_peered":"2024-09-19T12:03:15.410916+0000","last_clean":"2024-09-19T12:03:15.410916+0000","last_became_active":"2024-09-19T11:35:31.627232+0000","last_became_peered":"2024-09-19T11:35:31.627232+0000","last_unstale":"2024-09-19T12:03:15.410916+0000","last_undegraded":"2024-09-19T12:03:15.410916+0000","last_fullsized":"2024-09-19T12:03:15.410916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'56","last_scrub_stamp":"2024-09-19T12:03:15.410628+0000","last_deep_scrub":"264'56","last_deep_scrub_stamp":"2024-09-19T12:03:15.410628+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.410628+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:37.621254+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":114,"num_read_kb":6226,"num_write":211,"num_write_kb":11300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.219613+0000","last_change":"2024-09-19T12:03:25.219613+0000","last_active":"2024-09-19T12:03:25.219613+0000","last_peered":"2024-09-19T12:03:25.219613+0000","last_clean":"2024-09-19T12:03:25.219613+0000","last_became_active":"2024-09-19T11:35:35.623852+0000","last_became_peered":"2024-09-19T11:35:35.623852+0000","last_unstale":"2024-09-19T12:03:25.219613+0000","last_undegraded":"2024-09-19T12:03:25.219613+0000","last_fullsized":"2024-09-19T12:03:25.219613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:25.219432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:25.219432+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.219432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:46:03.404112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'76","reported_seq":585,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.728361+0000","last_change":"2024-09-19T11:35:37.641622+0000","last_active":"2024-09-19T12:03:05.728361+0000","last_peered":"2024-09-19T12:03:05.728361+0000","last_clean":"2024-09-19T12:03:05.728361+0000","last_became_active":"2024-09-19T11:35:37.640906+0000","last_became_peered":"2024-09-19T11:35:37.640906+0000","last_unstale":"2024-09-19T12:03:05.728361+0000","last_undegraded":"2024-09-19T12:03:05.728361+0000","last_fullsized":"2024-09-19T12:03:05.728361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:36.736085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":103,"num_read_kb":144,"num_write":72,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'616","reported_seq":1456,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.502971+0000","last_change":"2024-09-19T11:35:39.673666+0000","last_active":"2024-09-19T12:03:05.502971+0000","last_peered":"2024-09-19T12:03:05.502971+0000","last_clean":"2024-09-19T12:03:05.502971+0000","last_became_active":"2024-09-19T11:35:39.672054+0000","last_became_peered":"2024-09-19T11:35:39.672054+0000","last_unstale":"2024-09-19T12:03:05.502971+0000","last_undegraded":"2024-09-19T12:03:05.502971+0000","last_fullsized":"2024-09-19T12:03:05.502971+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":600,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:26.938497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"262'4","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.604432+0000","last_change":"2024-09-19T11:35:41.696920+0000","last_active":"2024-09-19T11:59:31.604432+0000","last_peered":"2024-09-19T11:59:31.604432+0000","last_clean":"2024-09-19T11:59:31.604432+0000","last_became_active":"2024-09-19T11:35:41.693623+0000","last_became_peered":"2024-09-19T11:35:41.693623+0000","last_unstale":"2024-09-19T11:59:31.604432+0000","last_undegraded":"2024-09-19T11:59:31.604432+0000","last_fullsized":"2024-09-19T11:59:31.604432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:36:17.971489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'3","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.344346+0000","last_change":"2024-09-19T12:03:21.344346+0000","last_active":"2024-09-19T12:03:21.344346+0000","last_peered":"2024-09-19T12:03:21.344346+0000","last_clean":"2024-09-19T12:03:21.344346+0000","last_became_active":"2024-09-19T11:35:33.620252+0000","last_became_peered":"2024-09-19T11:35:33.620252+0000","last_unstale":"2024-09-19T12:03:21.344346+0000","last_undegraded":"2024-09-19T12:03:21.344346+0000","last_fullsized":"2024-09-19T12:03:21.344346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:21.344164+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:21.344164+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.344164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:11.838750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'28","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.643635+0000","last_change":"2024-09-19T12:03:13.643635+0000","last_active":"2024-09-19T12:03:13.643635+0000","last_peered":"2024-09-19T12:03:13.643635+0000","last_clean":"2024-09-19T12:03:13.643635+0000","last_became_active":"2024-09-19T11:35:31.606137+0000","last_became_peered":"2024-09-19T11:35:31.606137+0000","last_unstale":"2024-09-19T12:03:13.643635+0000","last_undegraded":"2024-09-19T12:03:13.643635+0000","last_fullsized":"2024-09-19T12:03:13.643635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-09-19T12:03:13.643394+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-09-19T12:03:13.643394+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.643394+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:34.124245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":99,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.591409+0000","last_change":"2024-09-19T11:35:35.620661+0000","last_active":"2024-09-19T11:59:31.591409+0000","last_peered":"2024-09-19T11:59:31.591409+0000","last_clean":"2024-09-19T11:59:31.591409+0000","last_became_active":"2024-09-19T11:35:35.619995+0000","last_became_peered":"2024-09-19T11:35:35.619995+0000","last_unstale":"2024-09-19T11:59:31.591409+0000","last_undegraded":"2024-09-19T11:59:31.591409+0000","last_fullsized":"2024-09-19T11:59:31.591409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:20.831305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'99","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.951104+0000","last_change":"2024-09-19T11:35:37.647073+0000","last_active":"2024-09-19T12:03:05.951104+0000","last_peered":"2024-09-19T12:03:05.951104+0000","last_clean":"2024-09-19T12:03:05.951104+0000","last_became_active":"2024-09-19T11:35:37.646446+0000","last_became_peered":"2024-09-19T11:35:37.646446+0000","last_unstale":"2024-09-19T12:03:05.951104+0000","last_undegraded":"2024-09-19T12:03:05.951104+0000","last_fullsized":"2024-09-19T12:03:05.951104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:26.769867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":252,"num_write":102,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.591328+0000","last_change":"2024-09-19T11:35:39.658936+0000","last_active":"2024-09-19T11:59:31.591328+0000","last_peered":"2024-09-19T11:59:31.591328+0000","last_clean":"2024-09-19T11:59:31.591328+0000","last_became_active":"2024-09-19T11:35:39.658173+0000","last_became_peered":"2024-09-19T11:35:39.658173+0000","last_unstale":"2024-09-19T11:59:31.591328+0000","last_undegraded":"2024-09-19T11:59:31.591328+0000","last_fullsized":"2024-09-19T11:59:31.591328+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:40.200085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'7","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.993549+0000","last_change":"2024-09-19T11:35:41.679566+0000","last_active":"2024-09-19T12:02:32.993549+0000","last_peered":"2024-09-19T12:02:32.993549+0000","last_clean":"2024-09-19T12:02:32.993549+0000","last_became_active":"2024-09-19T11:35:41.678765+0000","last_became_peered":"2024-09-19T11:35:41.678765+0000","last_unstale":"2024-09-19T12:02:32.993549+0000","last_undegraded":"2024-09-19T12:02:32.993549+0000","last_fullsized":"2024-09-19T12:02:32.993549+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:11.159416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":41,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'2","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.209216+0000","last_change":"2024-09-19T12:03:18.209216+0000","last_active":"2024-09-19T12:03:18.209216+0000","last_peered":"2024-09-19T12:03:18.209216+0000","last_clean":"2024-09-19T12:03:18.209216+0000","last_became_active":"2024-09-19T11:35:33.612279+0000","last_became_peered":"2024-09-19T11:35:33.612279+0000","last_unstale":"2024-09-19T12:03:18.209216+0000","last_undegraded":"2024-09-19T12:03:18.209216+0000","last_fullsized":"2024-09-19T12:03:18.209216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:18.209042+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:18.209042+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.209042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:08.056928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'100","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.878737+0000","last_change":"2024-09-19T12:03:11.878737+0000","last_active":"2024-09-19T12:03:11.878737+0000","last_peered":"2024-09-19T12:03:11.878737+0000","last_clean":"2024-09-19T12:03:11.878737+0000","last_became_active":"2024-09-19T11:35:31.584188+0000","last_became_peered":"2024-09-19T11:35:31.584188+0000","last_unstale":"2024-09-19T12:03:11.878737+0000","last_undegraded":"2024-09-19T12:03:11.878737+0000","last_fullsized":"2024-09-19T12:03:11.878737+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-19T12:03:11.878638+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-19T12:03:11.878638+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.878638+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:00.975718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":280,"num_read_kb":3453,"num_write":516,"num_write_kb":3250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.602050+0000","last_change":"2024-09-19T11:35:35.615386+0000","last_active":"2024-09-19T12:00:21.602050+0000","last_peered":"2024-09-19T12:00:21.602050+0000","last_clean":"2024-09-19T12:00:21.602050+0000","last_became_active":"2024-09-19T11:35:35.614650+0000","last_became_peered":"2024-09-19T11:35:35.614650+0000","last_unstale":"2024-09-19T12:00:21.602050+0000","last_undegraded":"2024-09-19T12:00:21.602050+0000","last_fullsized":"2024-09-19T12:00:21.602050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:10.129352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'78","reported_seq":584,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.958138+0000","last_change":"2024-09-19T11:35:37.632361+0000","last_active":"2024-09-19T12:03:05.958138+0000","last_peered":"2024-09-19T12:03:05.958138+0000","last_clean":"2024-09-19T12:03:05.958138+0000","last_became_active":"2024-09-19T11:35:37.624951+0000","last_became_peered":"2024-09-19T11:35:37.624951+0000","last_unstale":"2024-09-19T12:03:05.958138+0000","last_undegraded":"2024-09-19T12:03:05.958138+0000","last_fullsized":"2024-09-19T12:03:05.958138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:24.797414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4425,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":175,"num_write":138,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":475,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.618781+0000","last_change":"2024-09-19T11:35:39.671990+0000","last_active":"2024-09-19T12:00:31.618781+0000","last_peered":"2024-09-19T12:00:31.618781+0000","last_clean":"2024-09-19T12:00:31.618781+0000","last_became_active":"2024-09-19T11:35:39.671181+0000","last_became_peered":"2024-09-19T11:35:39.671181+0000","last_unstale":"2024-09-19T12:00:31.618781+0000","last_undegraded":"2024-09-19T12:00:31.618781+0000","last_fullsized":"2024-09-19T12:00:31.618781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:41.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'18","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.602486+0000","last_change":"2024-09-19T11:35:41.685909+0000","last_active":"2024-09-19T11:59:46.602486+0000","last_peered":"2024-09-19T11:59:46.602486+0000","last_clean":"2024-09-19T11:59:46.602486+0000","last_became_active":"2024-09-19T11:35:41.684966+0000","last_became_peered":"2024-09-19T11:35:41.684966+0000","last_unstale":"2024-09-19T11:59:46.602486+0000","last_undegraded":"2024-09-19T11:59:46.602486+0000","last_fullsized":"2024-09-19T11:59:46.602486+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:36.205278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":94,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'76","reported_seq":585,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.188684+0000","last_change":"2024-09-19T12:03:19.188684+0000","last_active":"2024-09-19T12:03:19.188684+0000","last_peered":"2024-09-19T12:03:19.188684+0000","last_clean":"2024-09-19T12:03:19.188684+0000","last_became_active":"2024-09-19T11:35:33.613369+0000","last_became_peered":"2024-09-19T11:35:33.613369+0000","last_unstale":"2024-09-19T12:03:19.188684+0000","last_undegraded":"2024-09-19T12:03:19.188684+0000","last_fullsized":"2024-09-19T12:03:19.188684+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'76","last_scrub_stamp":"2024-09-19T12:03:19.188503+0000","last_deep_scrub":"264'76","last_deep_scrub_stamp":"2024-09-19T12:03:19.188503+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.188503+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:38.489920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":221,"num_write":116,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'36","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:10.209055+0000","last_change":"2024-09-19T12:03:10.209055+0000","last_active":"2024-09-19T12:03:10.209055+0000","last_peered":"2024-09-19T12:03:10.209055+0000","last_clean":"2024-09-19T12:03:10.209055+0000","last_became_active":"2024-09-19T11:36:06.674998+0000","last_became_peered":"2024-09-19T11:36:06.674998+0000","last_unstale":"2024-09-19T12:03:10.209055+0000","last_undegraded":"2024-09-19T12:03:10.209055+0000","last_fullsized":"2024-09-19T12:03:10.209055+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-19T12:03:10.208928+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-19T12:03:10.208928+0000","last_clean_scrub_stamp":"2024-09-19T12:03:10.208928+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:37.689946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159858,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":7484,"num_write":135,"num_write_kb":7462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,7],"acting":[2,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.610447+0000","last_change":"2024-09-19T12:03:26.610447+0000","last_active":"2024-09-19T12:03:26.610447+0000","last_peered":"2024-09-19T12:03:26.610447+0000","last_clean":"2024-09-19T12:03:26.610447+0000","last_became_active":"2024-09-19T11:35:35.631702+0000","last_became_peered":"2024-09-19T11:35:35.631702+0000","last_unstale":"2024-09-19T12:03:26.610447+0000","last_undegraded":"2024-09-19T12:03:26.610447+0000","last_fullsized":"2024-09-19T12:03:26.610447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:26.610210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:26.610210+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.610210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:04.830912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'85","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.250375+0000","last_change":"2024-09-19T12:03:26.250375+0000","last_active":"2024-09-19T12:03:26.250375+0000","last_peered":"2024-09-19T12:03:26.250375+0000","last_clean":"2024-09-19T12:03:26.250375+0000","last_became_active":"2024-09-19T11:35:37.627720+0000","last_became_peered":"2024-09-19T11:35:37.627720+0000","last_unstale":"2024-09-19T12:03:26.250375+0000","last_undegraded":"2024-09-19T12:03:26.250375+0000","last_fullsized":"2024-09-19T12:03:26.250375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'85","last_scrub_stamp":"2024-09-19T12:03:26.250152+0000","last_deep_scrub":"264'85","last_deep_scrub_stamp":"2024-09-19T12:03:26.250152+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.250152+0000","objects_scrubbed":7,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:08.259486+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":113,"num_read_kb":175,"num_write":82,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'617","reported_seq":1628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.315965+0000","last_change":"2024-09-19T11:35:39.651921+0000","last_active":"2024-09-19T12:03:05.315965+0000","last_peered":"2024-09-19T12:03:05.315965+0000","last_clean":"2024-09-19T12:03:05.315965+0000","last_became_active":"2024-09-19T11:35:39.651203+0000","last_became_peered":"2024-09-19T11:35:39.651203+0000","last_unstale":"2024-09-19T12:03:05.315965+0000","last_undegraded":"2024-09-19T12:03:05.315965+0000","last_fullsized":"2024-09-19T12:03:05.315965+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:01.951944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'8","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607324+0000","last_change":"2024-09-19T11:35:41.691885+0000","last_active":"2024-09-19T12:00:41.607324+0000","last_peered":"2024-09-19T12:00:41.607324+0000","last_clean":"2024-09-19T12:00:41.607324+0000","last_became_active":"2024-09-19T11:35:41.691146+0000","last_became_peered":"2024-09-19T11:35:41.691146+0000","last_unstale":"2024-09-19T12:00:41.607324+0000","last_undegraded":"2024-09-19T12:00:41.607324+0000","last_fullsized":"2024-09-19T12:00:41.607324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:13.054334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":44,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'23","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.178016+0000","last_change":"2024-09-19T12:03:20.178016+0000","last_active":"2024-09-19T12:03:20.178016+0000","last_peered":"2024-09-19T12:03:20.178016+0000","last_clean":"2024-09-19T12:03:20.178016+0000","last_became_active":"2024-09-19T11:35:33.628232+0000","last_became_peered":"2024-09-19T11:35:33.628232+0000","last_unstale":"2024-09-19T12:03:20.178016+0000","last_undegraded":"2024-09-19T12:03:20.178016+0000","last_fullsized":"2024-09-19T12:03:20.178016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-19T12:03:20.177838+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-19T12:03:20.177838+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.177838+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:24.986969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'45","reported_seq":568,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.174080+0000","last_change":"2024-09-19T12:03:13.174080+0000","last_active":"2024-09-19T12:03:13.174080+0000","last_peered":"2024-09-19T12:03:13.174080+0000","last_clean":"2024-09-19T12:03:13.174080+0000","last_became_active":"2024-09-19T11:35:31.583509+0000","last_became_peered":"2024-09-19T11:35:31.583509+0000","last_unstale":"2024-09-19T12:03:13.174080+0000","last_undegraded":"2024-09-19T12:03:13.174080+0000","last_fullsized":"2024-09-19T12:03:13.174080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-19T12:03:13.173748+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-19T12:03:13.173748+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.173748+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:56.811201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":273,"num_write":141,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1308,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.059604+0000","last_change":"2024-09-19T11:35:35.630576+0000","last_active":"2024-09-19T12:03:05.059604+0000","last_peered":"2024-09-19T12:03:05.059604+0000","last_clean":"2024-09-19T12:03:05.059604+0000","last_became_active":"2024-09-19T11:35:35.629728+0000","last_became_peered":"2024-09-19T11:35:35.629728+0000","last_unstale":"2024-09-19T12:03:05.059604+0000","last_undegraded":"2024-09-19T12:03:05.059604+0000","last_fullsized":"2024-09-19T12:03:05.059604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:45.444265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":824,"num_read_kb":824,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'34","reported_seq":532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611679+0000","last_change":"2024-09-19T11:35:37.618793+0000","last_active":"2024-09-19T12:00:26.611679+0000","last_peered":"2024-09-19T12:00:26.611679+0000","last_clean":"2024-09-19T12:00:26.611679+0000","last_became_active":"2024-09-19T11:35:37.618061+0000","last_became_peered":"2024-09-19T11:35:37.618061+0000","last_unstale":"2024-09-19T12:00:26.611679+0000","last_undegraded":"2024-09-19T12:00:26.611679+0000","last_fullsized":"2024-09-19T12:00:26.611679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:25.182817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'617","reported_seq":1668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.313355+0000","last_change":"2024-09-19T11:35:39.670880+0000","last_active":"2024-09-19T12:03:05.313355+0000","last_peered":"2024-09-19T12:03:05.313355+0000","last_clean":"2024-09-19T12:03:05.313355+0000","last_became_active":"2024-09-19T11:35:39.670211+0000","last_became_peered":"2024-09-19T11:35:39.670211+0000","last_unstale":"2024-09-19T12:03:05.313355+0000","last_undegraded":"2024-09-19T12:03:05.313355+0000","last_fullsized":"2024-09-19T12:03:05.313355+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:33.137968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'12","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812121+0000","last_change":"2024-09-19T11:35:41.688504+0000","last_active":"2024-09-19T12:00:41.812121+0000","last_peered":"2024-09-19T12:00:41.812121+0000","last_clean":"2024-09-19T12:00:41.812121+0000","last_became_active":"2024-09-19T11:35:41.687793+0000","last_became_peered":"2024-09-19T11:35:41.687793+0000","last_unstale":"2024-09-19T12:00:41.812121+0000","last_undegraded":"2024-09-19T12:00:41.812121+0000","last_fullsized":"2024-09-19T12:00:41.812121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:01.111100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":22,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'40","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.635623+0000","last_change":"2024-09-19T12:03:19.635623+0000","last_active":"2024-09-19T12:03:19.635623+0000","last_peered":"2024-09-19T12:03:19.635623+0000","last_clean":"2024-09-19T12:03:19.635623+0000","last_became_active":"2024-09-19T11:35:33.602988+0000","last_became_peered":"2024-09-19T11:35:33.602988+0000","last_unstale":"2024-09-19T12:03:19.635623+0000","last_undegraded":"2024-09-19T12:03:19.635623+0000","last_fullsized":"2024-09-19T12:03:19.635623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-19T12:03:19.635443+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-19T12:03:19.635443+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.635443+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:03.547575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":120,"num_write":65,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'40","reported_seq":570,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.802138+0000","last_change":"2024-09-19T12:03:13.802138+0000","last_active":"2024-09-19T12:03:13.802138+0000","last_peered":"2024-09-19T12:03:13.802138+0000","last_clean":"2024-09-19T12:03:13.802138+0000","last_became_active":"2024-09-19T11:36:06.675863+0000","last_became_peered":"2024-09-19T11:36:06.675863+0000","last_unstale":"2024-09-19T12:03:13.802138+0000","last_undegraded":"2024-09-19T12:03:13.802138+0000","last_fullsized":"2024-09-19T12:03:13.802138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-19T12:03:13.801874+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-19T12:03:13.801874+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.801874+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:21.385518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":74,"num_read_kb":59,"num_write":161,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.807544+0000","last_change":"2024-09-19T11:35:35.624735+0000","last_active":"2024-09-19T12:00:21.807544+0000","last_peered":"2024-09-19T12:00:21.807544+0000","last_clean":"2024-09-19T12:00:21.807544+0000","last_became_active":"2024-09-19T11:35:35.623987+0000","last_became_peered":"2024-09-19T11:35:35.623987+0000","last_unstale":"2024-09-19T12:00:21.807544+0000","last_undegraded":"2024-09-19T12:00:21.807544+0000","last_fullsized":"2024-09-19T12:00:21.807544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:01.328886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'115","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.655776+0000","last_change":"2024-09-19T11:35:37.628778+0000","last_active":"2024-09-19T12:03:05.655776+0000","last_peered":"2024-09-19T12:03:05.655776+0000","last_clean":"2024-09-19T12:03:05.655776+0000","last_became_active":"2024-09-19T11:35:37.627374+0000","last_became_peered":"2024-09-19T11:35:37.627374+0000","last_unstale":"2024-09-19T12:03:05.655776+0000","last_undegraded":"2024-09-19T12:03:05.655776+0000","last_fullsized":"2024-09-19T12:03:05.655776+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:40.224279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4881,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":162,"num_read_kb":205,"num_write":112,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.616096+0000","last_change":"2024-09-19T11:35:39.666833+0000","last_active":"2024-09-19T12:00:26.616096+0000","last_peered":"2024-09-19T12:00:26.616096+0000","last_clean":"2024-09-19T12:00:26.616096+0000","last_became_active":"2024-09-19T11:35:39.666071+0000","last_became_peered":"2024-09-19T11:35:39.666071+0000","last_unstale":"2024-09-19T12:00:26.616096+0000","last_undegraded":"2024-09-19T12:00:26.616096+0000","last_fullsized":"2024-09-19T12:00:26.616096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:55.544445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"253'10","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607413+0000","last_change":"2024-09-19T11:35:41.681654+0000","last_active":"2024-09-19T12:00:41.607413+0000","last_peered":"2024-09-19T12:00:41.607413+0000","last_clean":"2024-09-19T12:00:41.607413+0000","last_became_active":"2024-09-19T11:35:41.680850+0000","last_became_peered":"2024-09-19T11:35:41.680850+0000","last_unstale":"2024-09-19T12:00:41.607413+0000","last_undegraded":"2024-09-19T12:00:41.607413+0000","last_fullsized":"2024-09-19T12:00:41.607413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:38.701888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":41,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'9","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.078394+0000","last_change":"2024-09-19T12:03:19.078394+0000","last_active":"2024-09-19T12:03:19.078394+0000","last_peered":"2024-09-19T12:03:19.078394+0000","last_clean":"2024-09-19T12:03:19.078394+0000","last_became_active":"2024-09-19T11:35:33.632623+0000","last_became_peered":"2024-09-19T11:35:33.632623+0000","last_unstale":"2024-09-19T12:03:19.078394+0000","last_undegraded":"2024-09-19T12:03:19.078394+0000","last_fullsized":"2024-09-19T12:03:19.078394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-19T12:03:19.078208+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-19T12:03:19.078208+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.078208+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:23.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.394892+0000","last_change":"2024-09-19T12:03:12.394743+0000","last_active":"2024-09-19T12:03:12.394892+0000","last_peered":"2024-09-19T12:03:12.394892+0000","last_clean":"2024-09-19T12:03:12.394892+0000","last_became_active":"2024-09-19T11:35:14.133710+0000","last_became_peered":"2024-09-19T11:35:14.133710+0000","last_unstale":"2024-09-19T12:03:12.394892+0000","last_undegraded":"2024-09-19T12:03:12.394892+0000","last_fullsized":"2024-09-19T12:03:12.394892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-19T12:03:12.394517+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-19T12:03:12.394517+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.394517+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:38.496999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.633137+0000","last_change":"2024-09-19T12:03:12.633137+0000","last_active":"2024-09-19T12:03:12.633137+0000","last_peered":"2024-09-19T12:03:12.633137+0000","last_clean":"2024-09-19T12:03:12.633137+0000","last_became_active":"2024-09-19T11:35:19.150393+0000","last_became_peered":"2024-09-19T11:35:19.150393+0000","last_unstale":"2024-09-19T12:03:12.633137+0000","last_undegraded":"2024-09-19T12:03:12.633137+0000","last_fullsized":"2024-09-19T12:03:12.633137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:12.632962+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:12.632962+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.632962+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:48.310693+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001387466,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'66","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:10.871111+0000","last_change":"2024-09-19T12:03:10.871111+0000","last_active":"2024-09-19T12:03:10.871111+0000","last_peered":"2024-09-19T12:03:10.871111+0000","last_clean":"2024-09-19T12:03:10.871111+0000","last_became_active":"2024-09-19T11:35:31.592913+0000","last_became_peered":"2024-09-19T11:35:31.592913+0000","last_unstale":"2024-09-19T12:03:10.871111+0000","last_undegraded":"2024-09-19T12:03:10.871111+0000","last_fullsized":"2024-09-19T12:03:10.871111+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'66","last_scrub_stamp":"2024-09-19T12:03:10.870980+0000","last_deep_scrub":"264'66","last_deep_scrub_stamp":"2024-09-19T12:03:10.870980+0000","last_clean_scrub_stamp":"2024-09-19T12:03:10.870980+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:03.024253+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":2042,"num_write":253,"num_write_kb":1946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.621462+0000","last_change":"2024-09-19T11:35:35.603629+0000","last_active":"2024-09-19T12:00:36.621462+0000","last_peered":"2024-09-19T12:00:36.621462+0000","last_clean":"2024-09-19T12:00:36.621462+0000","last_became_active":"2024-09-19T11:35:35.602892+0000","last_became_peered":"2024-09-19T11:35:35.602892+0000","last_unstale":"2024-09-19T12:00:36.621462+0000","last_undegraded":"2024-09-19T12:00:36.621462+0000","last_fullsized":"2024-09-19T12:00:36.621462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:06.994180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'187","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.816235+0000","last_change":"2024-09-19T11:35:37.638436+0000","last_active":"2024-09-19T12:03:05.816235+0000","last_peered":"2024-09-19T12:03:05.816235+0000","last_clean":"2024-09-19T12:03:05.816235+0000","last_became_active":"2024-09-19T11:35:37.636399+0000","last_became_peered":"2024-09-19T11:35:37.636399+0000","last_unstale":"2024-09-19T12:03:05.816235+0000","last_undegraded":"2024-09-19T12:03:05.816235+0000","last_fullsized":"2024-09-19T12:03:05.816235+0000","mapping_epoch":32,"log_start":"262'100","ondisk_log_start":"262'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:14:07.861992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17019,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":284,"num_read_kb":496,"num_write":256,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":475,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.604407+0000","last_change":"2024-09-19T11:35:39.681040+0000","last_active":"2024-09-19T11:59:31.604407+0000","last_peered":"2024-09-19T11:59:31.604407+0000","last_clean":"2024-09-19T11:59:31.604407+0000","last_became_active":"2024-09-19T11:35:39.680298+0000","last_became_peered":"2024-09-19T11:35:39.680298+0000","last_unstale":"2024-09-19T11:59:31.604407+0000","last_undegraded":"2024-09-19T11:59:31.604407+0000","last_fullsized":"2024-09-19T11:59:31.604407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:52.699540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'52","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.766635+0000","last_change":"2024-09-19T11:35:41.679956+0000","last_active":"2024-09-19T12:02:19.766635+0000","last_peered":"2024-09-19T12:02:19.766635+0000","last_clean":"2024-09-19T12:02:19.766635+0000","last_became_active":"2024-09-19T11:35:41.679219+0000","last_became_peered":"2024-09-19T11:35:41.679219+0000","last_unstale":"2024-09-19T12:02:19.766635+0000","last_undegraded":"2024-09-19T12:02:19.766635+0000","last_fullsized":"2024-09-19T12:02:19.766635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:30.335832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":334,"num_read_kb":278,"num_write":121,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'140","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.341912+0000","last_change":"2024-09-19T12:03:20.341912+0000","last_active":"2024-09-19T12:03:20.341912+0000","last_peered":"2024-09-19T12:03:20.341912+0000","last_clean":"2024-09-19T12:03:20.341912+0000","last_became_active":"2024-09-19T11:35:33.622065+0000","last_became_peered":"2024-09-19T11:35:33.622065+0000","last_unstale":"2024-09-19T12:03:20.341912+0000","last_undegraded":"2024-09-19T12:03:20.341912+0000","last_fullsized":"2024-09-19T12:03:20.341912+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'140","last_scrub_stamp":"2024-09-19T12:03:20.341668+0000","last_deep_scrub":"264'140","last_deep_scrub_stamp":"2024-09-19T12:03:20.341668+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.341668+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:22.627813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":557,"num_read_kb":440,"num_write":210,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.404458+0000","last_change":"2024-09-19T12:03:13.404311+0000","last_active":"2024-09-19T12:03:13.404458+0000","last_peered":"2024-09-19T12:03:13.404458+0000","last_clean":"2024-09-19T12:03:13.404458+0000","last_became_active":"2024-09-19T11:35:19.154360+0000","last_became_peered":"2024-09-19T11:35:19.154360+0000","last_unstale":"2024-09-19T12:03:13.404458+0000","last_undegraded":"2024-09-19T12:03:13.404458+0000","last_fullsized":"2024-09-19T12:03:13.404458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:13.404135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:13.404135+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.404135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:10.610779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00086516000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'39","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:10.351635+0000","last_change":"2024-09-19T12:03:10.351635+0000","last_active":"2024-09-19T12:03:10.351635+0000","last_peered":"2024-09-19T12:03:10.351635+0000","last_clean":"2024-09-19T12:03:10.351635+0000","last_became_active":"2024-09-19T11:36:06.677474+0000","last_became_peered":"2024-09-19T11:36:06.677474+0000","last_unstale":"2024-09-19T12:03:10.351635+0000","last_undegraded":"2024-09-19T12:03:10.351635+0000","last_fullsized":"2024-09-19T12:03:10.351635+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-19T12:03:10.351428+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-19T12:03:10.351428+0000","last_clean_scrub_stamp":"2024-09-19T12:03:10.351428+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:56.653131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":49,"num_write":146,"num_write_kb":5149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,5],"acting":[0,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.601906+0000","last_change":"2024-09-19T11:35:35.618073+0000","last_active":"2024-09-19T11:59:26.601906+0000","last_peered":"2024-09-19T11:59:26.601906+0000","last_clean":"2024-09-19T11:59:26.601906+0000","last_became_active":"2024-09-19T11:35:35.616382+0000","last_became_peered":"2024-09-19T11:35:35.616382+0000","last_unstale":"2024-09-19T11:59:26.601906+0000","last_undegraded":"2024-09-19T11:59:26.601906+0000","last_fullsized":"2024-09-19T11:59:26.601906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:08.281218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'570","reported_seq":1628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.917885+0000","last_change":"2024-09-19T11:35:37.641209+0000","last_active":"2024-09-19T12:03:05.917885+0000","last_peered":"2024-09-19T12:03:05.917885+0000","last_clean":"2024-09-19T12:03:05.917885+0000","last_became_active":"2024-09-19T11:35:37.640355+0000","last_became_peered":"2024-09-19T11:35:37.640355+0000","last_unstale":"2024-09-19T12:03:05.917885+0000","last_undegraded":"2024-09-19T12:03:05.917885+0000","last_fullsized":"2024-09-19T12:03:05.917885+0000","mapping_epoch":32,"log_start":"264'501","ondisk_log_start":"264'501","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":501,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:53.345519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13007,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":828,"num_read_kb":979,"num_write":162,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:46.623781+0000","last_change":"2024-09-19T11:35:39.676564+0000","last_active":"2024-09-19T12:00:46.623781+0000","last_peered":"2024-09-19T12:00:46.623781+0000","last_clean":"2024-09-19T12:00:46.623781+0000","last_became_active":"2024-09-19T11:35:39.675795+0000","last_became_peered":"2024-09-19T11:35:39.675795+0000","last_unstale":"2024-09-19T12:00:46.623781+0000","last_undegraded":"2024-09-19T12:00:46.623781+0000","last_fullsized":"2024-09-19T12:00:46.623781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:43.633195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'10","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:36.592039+0000","last_change":"2024-09-19T11:35:41.679366+0000","last_active":"2024-09-19T11:59:36.592039+0000","last_peered":"2024-09-19T11:59:36.592039+0000","last_clean":"2024-09-19T11:59:36.592039+0000","last_became_active":"2024-09-19T11:35:41.678660+0000","last_became_peered":"2024-09-19T11:35:41.678660+0000","last_unstale":"2024-09-19T11:59:36.592039+0000","last_undegraded":"2024-09-19T11:59:36.592039+0000","last_fullsized":"2024-09-19T11:59:36.592039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:59.286098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'21","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.201825+0000","last_change":"2024-09-19T12:03:16.201825+0000","last_active":"2024-09-19T12:03:16.201825+0000","last_peered":"2024-09-19T12:03:16.201825+0000","last_clean":"2024-09-19T12:03:16.201825+0000","last_became_active":"2024-09-19T11:36:06.673265+0000","last_became_peered":"2024-09-19T11:36:06.673265+0000","last_unstale":"2024-09-19T12:03:16.201825+0000","last_undegraded":"2024-09-19T12:03:16.201825+0000","last_fullsized":"2024-09-19T12:03:16.201825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'21","last_scrub_stamp":"2024-09-19T12:03:16.201641+0000","last_deep_scrub":"264'21","last_deep_scrub_stamp":"2024-09-19T12:03:16.201641+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.201641+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:05.081031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":39,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.219942+0000","last_change":"2024-09-19T12:03:11.219942+0000","last_active":"2024-09-19T12:03:11.219942+0000","last_peered":"2024-09-19T12:03:11.219942+0000","last_clean":"2024-09-19T12:03:11.219942+0000","last_became_active":"2024-09-19T11:35:19.969368+0000","last_became_peered":"2024-09-19T11:35:19.969368+0000","last_unstale":"2024-09-19T12:03:11.219942+0000","last_undegraded":"2024-09-19T12:03:11.219942+0000","last_fullsized":"2024-09-19T12:03:11.219942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:11.219865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:11.219865+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.219865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:54.638380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001160424,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'23","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.681813+0000","last_change":"2024-09-19T12:03:12.681813+0000","last_active":"2024-09-19T12:03:12.681813+0000","last_peered":"2024-09-19T12:03:12.681813+0000","last_clean":"2024-09-19T12:03:12.681813+0000","last_became_active":"2024-09-19T11:35:31.590860+0000","last_became_peered":"2024-09-19T11:35:31.590860+0000","last_unstale":"2024-09-19T12:03:12.681813+0000","last_undegraded":"2024-09-19T12:03:12.681813+0000","last_fullsized":"2024-09-19T12:03:12.681813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-19T12:03:12.681706+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-19T12:03:12.681706+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.681706+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:42.006727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":67,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.269623+0000","last_change":"2024-09-19T12:03:23.269623+0000","last_active":"2024-09-19T12:03:23.269623+0000","last_peered":"2024-09-19T12:03:23.269623+0000","last_clean":"2024-09-19T12:03:23.269623+0000","last_became_active":"2024-09-19T11:35:35.611092+0000","last_became_peered":"2024-09-19T11:35:35.611092+0000","last_unstale":"2024-09-19T12:03:23.269623+0000","last_undegraded":"2024-09-19T12:03:23.269623+0000","last_fullsized":"2024-09-19T12:03:23.269623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:23.269446+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:23.269446+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.269446+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:58.973432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'117","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:34.344688+0000","last_change":"2024-09-19T11:35:37.647865+0000","last_active":"2024-09-19T12:02:34.344688+0000","last_peered":"2024-09-19T12:02:34.344688+0000","last_clean":"2024-09-19T12:02:34.344688+0000","last_became_active":"2024-09-19T11:35:37.647356+0000","last_became_peered":"2024-09-19T11:35:37.647356+0000","last_unstale":"2024-09-19T12:02:34.344688+0000","last_undegraded":"2024-09-19T12:02:34.344688+0000","last_fullsized":"2024-09-19T12:02:34.344688+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:35.178664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":120,"num_read_kb":109,"num_write":73,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":476,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621074+0000","last_change":"2024-09-19T11:35:39.673457+0000","last_active":"2024-09-19T12:00:41.621074+0000","last_peered":"2024-09-19T12:00:41.621074+0000","last_clean":"2024-09-19T12:00:41.621074+0000","last_became_active":"2024-09-19T11:35:39.672352+0000","last_became_peered":"2024-09-19T11:35:39.672352+0000","last_unstale":"2024-09-19T12:00:41.621074+0000","last_undegraded":"2024-09-19T12:00:41.621074+0000","last_fullsized":"2024-09-19T12:00:41.621074+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:47.157668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"256'101","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611538+0000","last_change":"2024-09-19T11:35:41.689002+0000","last_active":"2024-09-19T12:00:26.611538+0000","last_peered":"2024-09-19T12:00:26.611538+0000","last_clean":"2024-09-19T12:00:26.611538+0000","last_became_active":"2024-09-19T11:35:41.688239+0000","last_became_peered":"2024-09-19T11:35:41.688239+0000","last_unstale":"2024-09-19T12:00:26.611538+0000","last_undegraded":"2024-09-19T12:00:26.611538+0000","last_fullsized":"2024-09-19T12:00:26.611538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:43:57.342380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":254,"num_write":203,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'2","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.582468+0000","last_change":"2024-09-19T12:03:21.582468+0000","last_active":"2024-09-19T12:03:21.582468+0000","last_peered":"2024-09-19T12:03:21.582468+0000","last_clean":"2024-09-19T12:03:21.582468+0000","last_became_active":"2024-09-19T11:35:33.600618+0000","last_became_peered":"2024-09-19T11:35:33.600618+0000","last_unstale":"2024-09-19T12:03:21.582468+0000","last_undegraded":"2024-09-19T12:03:21.582468+0000","last_fullsized":"2024-09-19T12:03:21.582468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:21.582273+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:21.582273+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.582273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:26.811728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.597210+0000","last_change":"2024-09-19T12:03:11.597210+0000","last_active":"2024-09-19T12:03:11.597210+0000","last_peered":"2024-09-19T12:03:11.597210+0000","last_clean":"2024-09-19T12:03:11.597210+0000","last_became_active":"2024-09-19T11:35:19.151363+0000","last_became_peered":"2024-09-19T11:35:19.151363+0000","last_unstale":"2024-09-19T12:03:11.597210+0000","last_undegraded":"2024-09-19T12:03:11.597210+0000","last_fullsized":"2024-09-19T12:03:11.597210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:11.597027+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:11.597027+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.597027+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:03.179149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0028321980000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'37","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.149677+0000","last_change":"2024-09-19T12:03:11.149677+0000","last_active":"2024-09-19T12:03:11.149677+0000","last_peered":"2024-09-19T12:03:11.149677+0000","last_clean":"2024-09-19T12:03:11.149677+0000","last_became_active":"2024-09-19T11:35:31.587649+0000","last_became_peered":"2024-09-19T11:35:31.587649+0000","last_unstale":"2024-09-19T12:03:11.149677+0000","last_undegraded":"2024-09-19T12:03:11.149677+0000","last_fullsized":"2024-09-19T12:03:11.149677+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:11.149486+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:11.149486+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.149486+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:59.305634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":1908,"num_write":132,"num_write_kb":8008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621095+0000","last_change":"2024-09-19T11:35:35.617574+0000","last_active":"2024-09-19T12:00:41.621095+0000","last_peered":"2024-09-19T12:00:41.621095+0000","last_clean":"2024-09-19T12:00:41.621095+0000","last_became_active":"2024-09-19T11:35:35.617200+0000","last_became_peered":"2024-09-19T11:35:35.617200+0000","last_unstale":"2024-09-19T12:00:41.621095+0000","last_undegraded":"2024-09-19T12:00:41.621095+0000","last_fullsized":"2024-09-19T12:00:41.621095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:13.119332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'69","reported_seq":586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:31.599082+0000","last_change":"2024-09-19T11:35:37.643925+0000","last_active":"2024-09-19T11:59:31.599082+0000","last_peered":"2024-09-19T11:59:31.599082+0000","last_clean":"2024-09-19T11:59:31.599082+0000","last_became_active":"2024-09-19T11:35:37.643310+0000","last_became_peered":"2024-09-19T11:35:37.643310+0000","last_unstale":"2024-09-19T11:59:31.599082+0000","last_undegraded":"2024-09-19T11:59:31.599082+0000","last_fullsized":"2024-09-19T11:59:31.599082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:52.522266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":101,"num_read_kb":95,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.154053+0000","last_change":"2024-09-19T12:03:26.154053+0000","last_active":"2024-09-19T12:03:26.154053+0000","last_peered":"2024-09-19T12:03:26.154053+0000","last_clean":"2024-09-19T12:03:26.154053+0000","last_became_active":"2024-09-19T11:35:39.669555+0000","last_became_peered":"2024-09-19T11:35:39.669555+0000","last_unstale":"2024-09-19T12:03:26.154053+0000","last_undegraded":"2024-09-19T12:03:26.154053+0000","last_fullsized":"2024-09-19T12:03:26.154053+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:26.153871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:26.153871+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.153871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:04.128938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'20","reported_seq":557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:19.765426+0000","last_change":"2024-09-19T11:35:41.679051+0000","last_active":"2024-09-19T12:02:19.765426+0000","last_peered":"2024-09-19T12:02:19.765426+0000","last_clean":"2024-09-19T12:02:19.765426+0000","last_became_active":"2024-09-19T11:35:41.678167+0000","last_became_peered":"2024-09-19T11:35:41.678167+0000","last_unstale":"2024-09-19T12:02:19.765426+0000","last_undegraded":"2024-09-19T12:02:19.765426+0000","last_fullsized":"2024-09-19T12:02:19.765426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:18.723092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":65,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'93","reported_seq":617,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.642760+0000","last_change":"2024-09-19T12:03:17.642760+0000","last_active":"2024-09-19T12:03:17.642760+0000","last_peered":"2024-09-19T12:03:17.642760+0000","last_clean":"2024-09-19T12:03:17.642760+0000","last_became_active":"2024-09-19T11:35:33.605504+0000","last_became_peered":"2024-09-19T11:35:33.605504+0000","last_unstale":"2024-09-19T12:03:17.642760+0000","last_undegraded":"2024-09-19T12:03:17.642760+0000","last_fullsized":"2024-09-19T12:03:17.642760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'93","last_scrub_stamp":"2024-09-19T12:03:17.642564+0000","last_deep_scrub":"264'93","last_deep_scrub_stamp":"2024-09-19T12:03:17.642564+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.642564+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:31.968881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":306,"num_write":160,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'51","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.600803+0000","last_change":"2024-09-19T12:03:14.600803+0000","last_active":"2024-09-19T12:03:14.600803+0000","last_peered":"2024-09-19T12:03:14.600803+0000","last_clean":"2024-09-19T12:03:14.600803+0000","last_became_active":"2024-09-19T11:35:31.616954+0000","last_became_peered":"2024-09-19T11:35:31.616954+0000","last_unstale":"2024-09-19T12:03:14.600803+0000","last_undegraded":"2024-09-19T12:03:14.600803+0000","last_fullsized":"2024-09-19T12:03:14.600803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-09-19T12:03:14.600577+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-09-19T12:03:14.600577+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.600577+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.062823+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":2718,"num_write":157,"num_write_kb":7832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:09.590670+0000","last_change":"2024-09-19T12:03:09.590670+0000","last_active":"2024-09-19T12:03:09.590670+0000","last_peered":"2024-09-19T12:03:09.590670+0000","last_clean":"2024-09-19T12:03:09.590670+0000","last_became_active":"2024-09-19T11:35:20.096557+0000","last_became_peered":"2024-09-19T11:35:20.096557+0000","last_unstale":"2024-09-19T12:03:09.590670+0000","last_undegraded":"2024-09-19T12:03:09.590670+0000","last_fullsized":"2024-09-19T12:03:09.590670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:09.590597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:09.590597+0000","last_clean_scrub_stamp":"2024-09-19T12:03:09.590597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:47.764407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010463289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.619805+0000","last_change":"2024-09-19T11:35:35.624242+0000","last_active":"2024-09-19T12:00:36.619805+0000","last_peered":"2024-09-19T12:00:36.619805+0000","last_clean":"2024-09-19T12:00:36.619805+0000","last_became_active":"2024-09-19T11:35:35.623450+0000","last_became_peered":"2024-09-19T11:35:35.623450+0000","last_unstale":"2024-09-19T12:00:36.619805+0000","last_undegraded":"2024-09-19T12:00:36.619805+0000","last_fullsized":"2024-09-19T12:00:36.619805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:29.438228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'151","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.835530+0000","last_change":"2024-09-19T11:35:37.638304+0000","last_active":"2024-09-19T12:03:05.835530+0000","last_peered":"2024-09-19T12:03:05.835530+0000","last_clean":"2024-09-19T12:03:05.835530+0000","last_became_active":"2024-09-19T11:35:37.637234+0000","last_became_peered":"2024-09-19T11:35:37.637234+0000","last_unstale":"2024-09-19T12:03:05.835530+0000","last_undegraded":"2024-09-19T12:03:05.835530+0000","last_fullsized":"2024-09-19T12:03:05.835530+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:56.332709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9930,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":215,"num_read_kb":331,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812070+0000","last_change":"2024-09-19T11:35:39.671642+0000","last_active":"2024-09-19T12:00:41.812070+0000","last_peered":"2024-09-19T12:00:41.812070+0000","last_clean":"2024-09-19T12:00:41.812070+0000","last_became_active":"2024-09-19T11:35:39.669914+0000","last_became_peered":"2024-09-19T11:35:39.669914+0000","last_unstale":"2024-09-19T12:00:41.812070+0000","last_undegraded":"2024-09-19T12:00:41.812070+0000","last_fullsized":"2024-09-19T12:00:41.812070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:43.678369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'12","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.617421+0000","last_change":"2024-09-19T11:35:41.692653+0000","last_active":"2024-09-19T12:00:26.617421+0000","last_peered":"2024-09-19T12:00:26.617421+0000","last_clean":"2024-09-19T12:00:26.617421+0000","last_became_active":"2024-09-19T11:35:41.690257+0000","last_became_peered":"2024-09-19T11:35:41.690257+0000","last_unstale":"2024-09-19T12:00:26.617421+0000","last_undegraded":"2024-09-19T12:00:26.617421+0000","last_fullsized":"2024-09-19T12:00:26.617421+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:24.125004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'203","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.356932+0000","last_change":"2024-09-19T12:03:19.356932+0000","last_active":"2024-09-19T12:03:19.356932+0000","last_peered":"2024-09-19T12:03:19.356932+0000","last_clean":"2024-09-19T12:03:19.356932+0000","last_became_active":"2024-09-19T11:35:33.614327+0000","last_became_peered":"2024-09-19T11:35:33.614327+0000","last_unstale":"2024-09-19T12:03:19.356932+0000","last_undegraded":"2024-09-19T12:03:19.356932+0000","last_fullsized":"2024-09-19T12:03:19.356932+0000","mapping_epoch":28,"log_start":"256'100","ondisk_log_start":"256'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-19T12:03:19.356748+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-19T12:03:19.356748+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.356748+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:19.180282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":855,"num_read_kb":681,"num_write":310,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4002,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'50","reported_seq":574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.664317+0000","last_change":"2024-09-19T12:03:11.664317+0000","last_active":"2024-09-19T12:03:11.664317+0000","last_peered":"2024-09-19T12:03:11.664317+0000","last_clean":"2024-09-19T12:03:11.664317+0000","last_became_active":"2024-09-19T11:35:31.598447+0000","last_became_peered":"2024-09-19T11:35:31.598447+0000","last_unstale":"2024-09-19T12:03:11.664317+0000","last_undegraded":"2024-09-19T12:03:11.664317+0000","last_fullsized":"2024-09-19T12:03:11.664317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-19T12:03:11.664190+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-19T12:03:11.664190+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.664190+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:30.648508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":9296,"num_write":144,"num_write_kb":14398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.367464+0000","last_change":"2024-09-19T12:03:14.367464+0000","last_active":"2024-09-19T12:03:14.367464+0000","last_peered":"2024-09-19T12:03:14.367464+0000","last_clean":"2024-09-19T12:03:14.367464+0000","last_became_active":"2024-09-19T11:35:20.094400+0000","last_became_peered":"2024-09-19T11:35:20.094400+0000","last_unstale":"2024-09-19T12:03:14.367464+0000","last_undegraded":"2024-09-19T12:03:14.367464+0000","last_fullsized":"2024-09-19T12:03:14.367464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:14.367287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:14.367287+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.367287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:29.641318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088955000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"264'6","reported_seq":905,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.136790+0000","last_change":"2024-09-19T12:03:24.136790+0000","last_active":"2024-09-19T12:03:24.136790+0000","last_peered":"2024-09-19T12:03:24.136790+0000","last_clean":"2024-09-19T12:03:24.136790+0000","last_became_active":"2024-09-19T11:35:35.619212+0000","last_became_peered":"2024-09-19T11:35:35.619212+0000","last_unstale":"2024-09-19T12:03:24.136790+0000","last_undegraded":"2024-09-19T12:03:24.136790+0000","last_fullsized":"2024-09-19T12:03:24.136790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-19T12:03:24.136614+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-19T12:03:24.136614+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.136614+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:13.802174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":630,"num_read_kb":1029,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'100","reported_seq":631,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607374+0000","last_change":"2024-09-19T11:35:37.633269+0000","last_active":"2024-09-19T12:00:41.607374+0000","last_peered":"2024-09-19T12:00:41.607374+0000","last_clean":"2024-09-19T12:00:41.607374+0000","last_became_active":"2024-09-19T11:35:37.629547+0000","last_became_peered":"2024-09-19T11:35:37.629547+0000","last_unstale":"2024-09-19T12:00:41.607374+0000","last_undegraded":"2024-09-19T12:00:41.607374+0000","last_fullsized":"2024-09-19T12:00:41.607374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:55.759738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":151,"num_read_kb":144,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'620","reported_seq":1654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.304142+0000","last_change":"2024-09-19T11:35:39.683282+0000","last_active":"2024-09-19T12:03:05.304142+0000","last_peered":"2024-09-19T12:03:05.304142+0000","last_clean":"2024-09-19T12:03:05.304142+0000","last_became_active":"2024-09-19T11:35:39.681476+0000","last_became_peered":"2024-09-19T11:35:39.681476+0000","last_unstale":"2024-09-19T12:03:05.304142+0000","last_undegraded":"2024-09-19T12:03:05.304142+0000","last_fullsized":"2024-09-19T12:03:05.304142+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":600,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:03.143481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'15","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:31.612867+0000","last_change":"2024-09-19T11:35:41.671140+0000","last_active":"2024-09-19T12:00:31.612867+0000","last_peered":"2024-09-19T12:00:31.612867+0000","last_clean":"2024-09-19T12:00:31.612867+0000","last_became_active":"2024-09-19T11:35:41.670410+0000","last_became_peered":"2024-09-19T11:35:41.670410+0000","last_unstale":"2024-09-19T12:00:31.612867+0000","last_undegraded":"2024-09-19T12:00:31.612867+0000","last_fullsized":"2024-09-19T12:00:31.612867+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:12:45.264833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":68,"num_write":44,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'111","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.828943+0000","last_change":"2024-09-19T12:03:20.828943+0000","last_active":"2024-09-19T12:03:20.828943+0000","last_peered":"2024-09-19T12:03:20.828943+0000","last_clean":"2024-09-19T12:03:20.828943+0000","last_became_active":"2024-09-19T11:35:33.624885+0000","last_became_peered":"2024-09-19T11:35:33.624885+0000","last_unstale":"2024-09-19T12:03:20.828943+0000","last_undegraded":"2024-09-19T12:03:20.828943+0000","last_fullsized":"2024-09-19T12:03:20.828943+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'111","last_scrub_stamp":"2024-09-19T12:03:20.828759+0000","last_deep_scrub":"264'111","last_deep_scrub_stamp":"2024-09-19T12:03:20.828759+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.828759+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:06.866014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":317,"num_write":191,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'36","reported_seq":562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.845432+0000","last_change":"2024-09-19T12:03:12.845432+0000","last_active":"2024-09-19T12:03:12.845432+0000","last_peered":"2024-09-19T12:03:12.845432+0000","last_clean":"2024-09-19T12:03:12.845432+0000","last_became_active":"2024-09-19T11:36:06.649117+0000","last_became_peered":"2024-09-19T11:36:06.649117+0000","last_unstale":"2024-09-19T12:03:12.845432+0000","last_undegraded":"2024-09-19T12:03:12.845432+0000","last_fullsized":"2024-09-19T12:03:12.845432+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-19T12:03:12.845221+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-19T12:03:12.845221+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.845221+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:23.774171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":54,"num_write":158,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:10.622538+0000","last_change":"2024-09-19T12:03:10.622538+0000","last_active":"2024-09-19T12:03:10.622538+0000","last_peered":"2024-09-19T12:03:10.622538+0000","last_clean":"2024-09-19T12:03:10.622538+0000","last_became_active":"2024-09-19T11:35:19.152195+0000","last_became_peered":"2024-09-19T11:35:19.152195+0000","last_unstale":"2024-09-19T12:03:10.622538+0000","last_undegraded":"2024-09-19T12:03:10.622538+0000","last_fullsized":"2024-09-19T12:03:10.622538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:10.622455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:10.622455+0000","last_clean_scrub_stamp":"2024-09-19T12:03:10.622455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:40:26.610822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00094930600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.810796+0000","last_change":"2024-09-19T11:35:35.625999+0000","last_active":"2024-09-19T12:00:36.810796+0000","last_peered":"2024-09-19T12:00:36.810796+0000","last_clean":"2024-09-19T12:00:36.810796+0000","last_became_active":"2024-09-19T11:35:35.625385+0000","last_became_peered":"2024-09-19T11:35:35.625385+0000","last_unstale":"2024-09-19T12:00:36.810796+0000","last_undegraded":"2024-09-19T12:00:36.810796+0000","last_fullsized":"2024-09-19T12:00:36.810796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:58.273564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'58","reported_seq":572,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812198+0000","last_change":"2024-09-19T11:35:37.642580+0000","last_active":"2024-09-19T12:00:41.812198+0000","last_peered":"2024-09-19T12:00:41.812198+0000","last_clean":"2024-09-19T12:00:41.812198+0000","last_became_active":"2024-09-19T11:35:37.641855+0000","last_became_peered":"2024-09-19T11:35:37.641855+0000","last_unstale":"2024-09-19T12:00:41.812198+0000","last_undegraded":"2024-09-19T12:00:41.812198+0000","last_fullsized":"2024-09-19T12:00:41.812198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:09.995922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":89,"num_read_kb":84,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'622","reported_seq":1538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.700894+0000","last_change":"2024-09-19T11:35:39.663385+0000","last_active":"2024-09-19T12:03:05.700894+0000","last_peered":"2024-09-19T12:03:05.700894+0000","last_clean":"2024-09-19T12:03:05.700894+0000","last_became_active":"2024-09-19T11:35:39.662678+0000","last_became_peered":"2024-09-19T11:35:39.662678+0000","last_unstale":"2024-09-19T12:03:05.700894+0000","last_undegraded":"2024-09-19T12:03:05.700894+0000","last_fullsized":"2024-09-19T12:03:05.700894+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:49.009964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'101","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.205987+0000","last_change":"2024-09-19T11:35:41.684355+0000","last_active":"2024-09-19T12:02:33.205987+0000","last_peered":"2024-09-19T12:02:33.205987+0000","last_clean":"2024-09-19T12:02:33.205987+0000","last_became_active":"2024-09-19T11:35:41.683629+0000","last_became_peered":"2024-09-19T11:35:41.683629+0000","last_unstale":"2024-09-19T12:02:33.205987+0000","last_undegraded":"2024-09-19T12:02:33.205987+0000","last_fullsized":"2024-09-19T12:02:33.205987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:47.007366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":202,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'36","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.181835+0000","last_change":"2024-09-19T12:03:16.181835+0000","last_active":"2024-09-19T12:03:16.181835+0000","last_peered":"2024-09-19T12:03:16.181835+0000","last_clean":"2024-09-19T12:03:16.181835+0000","last_became_active":"2024-09-19T11:35:33.616079+0000","last_became_peered":"2024-09-19T11:35:33.616079+0000","last_unstale":"2024-09-19T12:03:16.181835+0000","last_undegraded":"2024-09-19T12:03:16.181835+0000","last_fullsized":"2024-09-19T12:03:16.181835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-19T12:03:16.181556+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-19T12:03:16.181556+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.181556+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:34.068776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":147,"num_write":69,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'45","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:09.388294+0000","last_change":"2024-09-19T12:03:09.388294+0000","last_active":"2024-09-19T12:03:09.388294+0000","last_peered":"2024-09-19T12:03:09.388294+0000","last_clean":"2024-09-19T12:03:09.388294+0000","last_became_active":"2024-09-19T11:35:31.612706+0000","last_became_peered":"2024-09-19T11:35:31.612706+0000","last_unstale":"2024-09-19T12:03:09.388294+0000","last_undegraded":"2024-09-19T12:03:09.388294+0000","last_fullsized":"2024-09-19T12:03:09.388294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-19T12:03:09.388188+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-19T12:03:09.388188+0000","last_clean_scrub_stamp":"2024-09-19T12:03:09.388188+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:21.341691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":6249,"num_write":158,"num_write_kb":6206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.055270+0000","last_change":"2024-09-19T12:03:12.055270+0000","last_active":"2024-09-19T12:03:12.055270+0000","last_peered":"2024-09-19T12:03:12.055270+0000","last_clean":"2024-09-19T12:03:12.055270+0000","last_became_active":"2024-09-19T11:35:19.152446+0000","last_became_peered":"2024-09-19T11:35:19.152446+0000","last_unstale":"2024-09-19T12:03:12.055270+0000","last_undegraded":"2024-09-19T12:03:12.055270+0000","last_fullsized":"2024-09-19T12:03:12.055270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:12.055058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:12.055058+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.055058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:03.585811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.601284+0000","last_change":"2024-09-19T11:35:35.624664+0000","last_active":"2024-09-19T11:59:41.601284+0000","last_peered":"2024-09-19T11:59:41.601284+0000","last_clean":"2024-09-19T11:59:41.601284+0000","last_became_active":"2024-09-19T11:35:35.624322+0000","last_became_peered":"2024-09-19T11:35:35.624322+0000","last_unstale":"2024-09-19T11:59:41.601284+0000","last_undegraded":"2024-09-19T11:59:41.601284+0000","last_fullsized":"2024-09-19T11:59:41.601284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:10.112342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'196","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.931684+0000","last_change":"2024-09-19T11:35:37.646919+0000","last_active":"2024-09-19T12:03:05.931684+0000","last_peered":"2024-09-19T12:03:05.931684+0000","last_clean":"2024-09-19T12:03:05.931684+0000","last_became_active":"2024-09-19T11:35:37.646158+0000","last_became_peered":"2024-09-19T11:35:37.646158+0000","last_unstale":"2024-09-19T12:03:05.931684+0000","last_undegraded":"2024-09-19T12:03:05.931684+0000","last_fullsized":"2024-09-19T12:03:05.931684+0000","mapping_epoch":32,"log_start":"256'100","ondisk_log_start":"256'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:25.054477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20533,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":287,"num_read_kb":516,"num_write":214,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615042+0000","last_change":"2024-09-19T11:35:39.684662+0000","last_active":"2024-09-19T12:00:41.615042+0000","last_peered":"2024-09-19T12:00:41.615042+0000","last_clean":"2024-09-19T12:00:41.615042+0000","last_became_active":"2024-09-19T11:35:39.684034+0000","last_became_peered":"2024-09-19T11:35:39.684034+0000","last_unstale":"2024-09-19T12:00:41.615042+0000","last_undegraded":"2024-09-19T12:00:41.615042+0000","last_fullsized":"2024-09-19T12:00:41.615042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:00.499255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'21","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.615420+0000","last_change":"2024-09-19T11:35:41.690412+0000","last_active":"2024-09-19T12:00:26.615420+0000","last_peered":"2024-09-19T12:00:26.615420+0000","last_clean":"2024-09-19T12:00:26.615420+0000","last_became_active":"2024-09-19T11:35:41.689764+0000","last_became_peered":"2024-09-19T11:35:41.689764+0000","last_unstale":"2024-09-19T12:00:26.615420+0000","last_undegraded":"2024-09-19T12:00:26.615420+0000","last_fullsized":"2024-09-19T12:00:26.615420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:54.147943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":78,"num_write":61,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'13","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621213+0000","last_change":"2024-09-19T11:35:41.691619+0000","last_active":"2024-09-19T12:00:41.621213+0000","last_peered":"2024-09-19T12:00:41.621213+0000","last_clean":"2024-09-19T12:00:41.621213+0000","last_became_active":"2024-09-19T11:35:41.691032+0000","last_became_peered":"2024-09-19T11:35:41.691032+0000","last_unstale":"2024-09-19T12:00:41.621213+0000","last_undegraded":"2024-09-19T12:00:41.621213+0000","last_fullsized":"2024-09-19T12:00:41.621213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:56.262332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":124,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'71","reported_seq":589,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.184351+0000","last_change":"2024-09-19T12:03:21.184351+0000","last_active":"2024-09-19T12:03:21.184351+0000","last_peered":"2024-09-19T12:03:21.184351+0000","last_clean":"2024-09-19T12:03:21.184351+0000","last_became_active":"2024-09-19T11:35:33.629606+0000","last_became_peered":"2024-09-19T11:35:33.629606+0000","last_unstale":"2024-09-19T12:03:21.184351+0000","last_undegraded":"2024-09-19T12:03:21.184351+0000","last_fullsized":"2024-09-19T12:03:21.184351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'71","last_scrub_stamp":"2024-09-19T12:03:21.184165+0000","last_deep_scrub":"264'71","last_deep_scrub_stamp":"2024-09-19T12:03:21.184165+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.184165+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:07.903624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":210,"num_write":129,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'37","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.150255+0000","last_change":"2024-09-19T12:03:12.150255+0000","last_active":"2024-09-19T12:03:12.150255+0000","last_peered":"2024-09-19T12:03:12.150255+0000","last_clean":"2024-09-19T12:03:12.150255+0000","last_became_active":"2024-09-19T11:35:31.591519+0000","last_became_peered":"2024-09-19T11:35:31.591519+0000","last_unstale":"2024-09-19T12:03:12.150255+0000","last_undegraded":"2024-09-19T12:03:12.150255+0000","last_fullsized":"2024-09-19T12:03:12.150255+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:12.150010+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:12.150010+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.150010+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:46.241961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":3273,"num_write":135,"num_write_kb":3245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.609952+0000","last_change":"2024-09-19T12:03:24.609952+0000","last_active":"2024-09-19T12:03:24.609952+0000","last_peered":"2024-09-19T12:03:24.609952+0000","last_clean":"2024-09-19T12:03:24.609952+0000","last_became_active":"2024-09-19T11:35:35.612405+0000","last_became_peered":"2024-09-19T11:35:35.612405+0000","last_unstale":"2024-09-19T12:03:24.609952+0000","last_undegraded":"2024-09-19T12:03:24.609952+0000","last_fullsized":"2024-09-19T12:03:24.609952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:24.609593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:24.609593+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.609593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:08.908515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'84","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.720757+0000","last_change":"2024-09-19T11:35:37.633337+0000","last_active":"2024-09-19T12:03:05.720757+0000","last_peered":"2024-09-19T12:03:05.720757+0000","last_clean":"2024-09-19T12:03:05.720757+0000","last_became_active":"2024-09-19T11:35:37.632543+0000","last_became_peered":"2024-09-19T11:35:37.632543+0000","last_unstale":"2024-09-19T12:03:05.720757+0000","last_undegraded":"2024-09-19T12:03:05.720757+0000","last_fullsized":"2024-09-19T12:03:05.720757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:04.865458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4752,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":182,"num_write":88,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.591731+0000","last_change":"2024-09-19T11:35:39.654809+0000","last_active":"2024-09-19T11:59:01.591731+0000","last_peered":"2024-09-19T11:59:01.591731+0000","last_clean":"2024-09-19T11:59:01.591731+0000","last_became_active":"2024-09-19T11:35:39.654012+0000","last_became_peered":"2024-09-19T11:35:39.654012+0000","last_unstale":"2024-09-19T11:59:01.591731+0000","last_undegraded":"2024-09-19T11:59:01.591731+0000","last_fullsized":"2024-09-19T11:59:01.591731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:29.043987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'11","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.602664+0000","last_change":"2024-09-19T11:35:41.676591+0000","last_active":"2024-09-19T11:59:46.602664+0000","last_peered":"2024-09-19T11:59:46.602664+0000","last_clean":"2024-09-19T11:59:46.602664+0000","last_became_active":"2024-09-19T11:35:41.675506+0000","last_became_peered":"2024-09-19T11:35:41.675506+0000","last_unstale":"2024-09-19T11:59:46.602664+0000","last_undegraded":"2024-09-19T11:59:46.602664+0000","last_fullsized":"2024-09-19T11:59:46.602664+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:14.936561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":25,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'13","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.672534+0000","last_change":"2024-09-19T12:03:18.672534+0000","last_active":"2024-09-19T12:03:18.672534+0000","last_peered":"2024-09-19T12:03:18.672534+0000","last_clean":"2024-09-19T12:03:18.672534+0000","last_became_active":"2024-09-19T11:35:33.634606+0000","last_became_peered":"2024-09-19T11:35:33.634606+0000","last_unstale":"2024-09-19T12:03:18.672534+0000","last_undegraded":"2024-09-19T12:03:18.672534+0000","last_fullsized":"2024-09-19T12:03:18.672534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-19T12:03:18.672343+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-19T12:03:18.672343+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.672343+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:50.311993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":71,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'47","reported_seq":570,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.422931+0000","last_change":"2024-09-19T12:03:20.422931+0000","last_active":"2024-09-19T12:03:20.422931+0000","last_peered":"2024-09-19T12:03:20.422931+0000","last_clean":"2024-09-19T12:03:20.422931+0000","last_became_active":"2024-09-19T11:35:31.602343+0000","last_became_peered":"2024-09-19T11:35:31.602343+0000","last_unstale":"2024-09-19T12:03:20.422931+0000","last_undegraded":"2024-09-19T12:03:20.422931+0000","last_fullsized":"2024-09-19T12:03:20.422931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-09-19T12:03:20.422669+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-09-19T12:03:20.422669+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.422669+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:58.197082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":10301,"num_write":159,"num_write_kb":15391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.590693+0000","last_change":"2024-09-19T11:35:35.630500+0000","last_active":"2024-09-19T11:58:56.590693+0000","last_peered":"2024-09-19T11:58:56.590693+0000","last_clean":"2024-09-19T11:58:56.590693+0000","last_became_active":"2024-09-19T11:35:35.630183+0000","last_became_peered":"2024-09-19T11:35:35.630183+0000","last_unstale":"2024-09-19T11:58:56.590693+0000","last_undegraded":"2024-09-19T11:58:56.590693+0000","last_fullsized":"2024-09-19T11:58:56.590693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:46.826155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'15","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.597192+0000","last_change":"2024-09-19T11:35:37.642215+0000","last_active":"2024-09-19T11:59:01.597192+0000","last_peered":"2024-09-19T11:59:01.597192+0000","last_clean":"2024-09-19T11:59:01.597192+0000","last_became_active":"2024-09-19T11:35:37.640723+0000","last_became_peered":"2024-09-19T11:35:37.640723+0000","last_unstale":"2024-09-19T11:59:01.597192+0000","last_undegraded":"2024-09-19T11:59:01.597192+0000","last_fullsized":"2024-09-19T11:59:01.597192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:00.528966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.600886+0000","last_change":"2024-09-19T11:35:39.668057+0000","last_active":"2024-09-19T11:59:01.600886+0000","last_peered":"2024-09-19T11:59:01.600886+0000","last_clean":"2024-09-19T11:59:01.600886+0000","last_became_active":"2024-09-19T11:35:39.667286+0000","last_became_peered":"2024-09-19T11:35:39.667286+0000","last_unstale":"2024-09-19T11:59:01.600886+0000","last_undegraded":"2024-09-19T11:59:01.600886+0000","last_fullsized":"2024-09-19T11:59:01.600886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:36.821583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'8","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621121+0000","last_change":"2024-09-19T11:35:41.698132+0000","last_active":"2024-09-19T12:00:41.621121+0000","last_peered":"2024-09-19T12:00:41.621121+0000","last_clean":"2024-09-19T12:00:41.621121+0000","last_became_active":"2024-09-19T11:35:41.696369+0000","last_became_peered":"2024-09-19T11:35:41.696369+0000","last_unstale":"2024-09-19T12:00:41.621121+0000","last_undegraded":"2024-09-19T12:00:41.621121+0000","last_fullsized":"2024-09-19T12:00:41.621121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'69","reported_seq":596,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.909800+0000","last_change":"2024-09-19T12:03:22.909800+0000","last_active":"2024-09-19T12:03:22.909800+0000","last_peered":"2024-09-19T12:03:22.909800+0000","last_clean":"2024-09-19T12:03:22.909800+0000","last_became_active":"2024-09-19T11:35:33.614693+0000","last_became_peered":"2024-09-19T11:35:33.614693+0000","last_unstale":"2024-09-19T12:03:22.909800+0000","last_undegraded":"2024-09-19T12:03:22.909800+0000","last_fullsized":"2024-09-19T12:03:22.909800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'69","last_scrub_stamp":"2024-09-19T12:03:22.909619+0000","last_deep_scrub":"264'69","last_deep_scrub_stamp":"2024-09-19T12:03:22.909619+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.909619+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:13.544034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":230,"num_write":111,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'49","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.176623+0000","last_change":"2024-09-19T12:03:12.176623+0000","last_active":"2024-09-19T12:03:12.176623+0000","last_peered":"2024-09-19T12:03:12.176623+0000","last_clean":"2024-09-19T12:03:12.176623+0000","last_became_active":"2024-09-19T11:36:06.677102+0000","last_became_peered":"2024-09-19T11:36:06.677102+0000","last_unstale":"2024-09-19T12:03:12.176623+0000","last_undegraded":"2024-09-19T12:03:12.176623+0000","last_fullsized":"2024-09-19T12:03:12.176623+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-19T12:03:12.176533+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-19T12:03:12.176533+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.176533+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:03.972788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":91,"num_read_kb":1744,"num_write":157,"num_write_kb":1703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.599682+0000","last_change":"2024-09-19T11:35:35.618146+0000","last_active":"2024-09-19T11:58:56.599682+0000","last_peered":"2024-09-19T11:58:56.599682+0000","last_clean":"2024-09-19T11:58:56.599682+0000","last_became_active":"2024-09-19T11:35:35.617374+0000","last_became_peered":"2024-09-19T11:35:35.617374+0000","last_unstale":"2024-09-19T11:58:56.599682+0000","last_undegraded":"2024-09-19T11:58:56.599682+0000","last_fullsized":"2024-09-19T11:58:56.599682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:21.640183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'97","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.561936+0000","last_change":"2024-09-19T11:35:37.637365+0000","last_active":"2024-09-19T12:03:05.561936+0000","last_peered":"2024-09-19T12:03:05.561936+0000","last_clean":"2024-09-19T12:03:05.561936+0000","last_became_active":"2024-09-19T11:35:37.636913+0000","last_became_peered":"2024-09-19T11:35:37.636913+0000","last_unstale":"2024-09-19T12:03:05.561936+0000","last_undegraded":"2024-09-19T12:03:05.561936+0000","last_fullsized":"2024-09-19T12:03:05.561936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:19.745629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4489,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":210,"num_write":100,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":470,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.597548+0000","last_change":"2024-09-19T11:35:39.673878+0000","last_active":"2024-09-19T11:59:01.597548+0000","last_peered":"2024-09-19T11:59:01.597548+0000","last_clean":"2024-09-19T11:59:01.597548+0000","last_became_active":"2024-09-19T11:35:39.673172+0000","last_became_peered":"2024-09-19T11:35:39.673172+0000","last_unstale":"2024-09-19T11:59:01.597548+0000","last_undegraded":"2024-09-19T11:59:01.597548+0000","last_fullsized":"2024-09-19T11:59:01.597548+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:06:47.106673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'13","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619227+0000","last_change":"2024-09-19T11:35:41.678676+0000","last_active":"2024-09-19T12:00:41.619227+0000","last_peered":"2024-09-19T12:00:41.619227+0000","last_clean":"2024-09-19T12:00:41.619227+0000","last_became_active":"2024-09-19T11:35:41.677991+0000","last_became_peered":"2024-09-19T11:35:41.677991+0000","last_unstale":"2024-09-19T12:00:41.619227+0000","last_undegraded":"2024-09-19T12:00:41.619227+0000","last_fullsized":"2024-09-19T12:00:41.619227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":90,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.231795+0000","last_change":"2024-09-19T12:03:17.231795+0000","last_active":"2024-09-19T12:03:17.231795+0000","last_peered":"2024-09-19T12:03:17.231795+0000","last_clean":"2024-09-19T12:03:17.231795+0000","last_became_active":"2024-09-19T11:36:06.674947+0000","last_became_peered":"2024-09-19T11:36:06.674947+0000","last_unstale":"2024-09-19T12:03:17.231795+0000","last_undegraded":"2024-09-19T12:03:17.231795+0000","last_fullsized":"2024-09-19T12:03:17.231795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:17.231570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:17.231570+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.231570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:32.772458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"264'32","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.318659+0000","last_change":"2024-09-19T12:03:11.318659+0000","last_active":"2024-09-19T12:03:11.318659+0000","last_peered":"2024-09-19T12:03:11.318659+0000","last_clean":"2024-09-19T12:03:11.318659+0000","last_became_active":"2024-09-19T11:35:31.589077+0000","last_became_peered":"2024-09-19T11:35:31.589077+0000","last_unstale":"2024-09-19T12:03:11.318659+0000","last_undegraded":"2024-09-19T12:03:11.318659+0000","last_fullsized":"2024-09-19T12:03:11.318659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-19T12:03:11.318438+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-19T12:03:11.318438+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.318438+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:43.791532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":45,"num_read_kb":7227,"num_write":97,"num_write_kb":7207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.108563+0000","last_change":"2024-09-19T12:03:25.108563+0000","last_active":"2024-09-19T12:03:25.108563+0000","last_peered":"2024-09-19T12:03:25.108563+0000","last_clean":"2024-09-19T12:03:25.108563+0000","last_became_active":"2024-09-19T11:35:35.629798+0000","last_became_peered":"2024-09-19T11:35:35.629798+0000","last_unstale":"2024-09-19T12:03:25.108563+0000","last_undegraded":"2024-09-19T12:03:25.108563+0000","last_fullsized":"2024-09-19T12:03:25.108563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:25.108374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:25.108374+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.108374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:13:16.547584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'69","reported_seq":568,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.486498+0000","last_change":"2024-09-19T11:35:37.640794+0000","last_active":"2024-09-19T12:03:05.486498+0000","last_peered":"2024-09-19T12:03:05.486498+0000","last_clean":"2024-09-19T12:03:05.486498+0000","last_became_active":"2024-09-19T11:35:37.640008+0000","last_became_peered":"2024-09-19T11:35:37.640008+0000","last_unstale":"2024-09-19T12:03:05.486498+0000","last_undegraded":"2024-09-19T12:03:05.486498+0000","last_fullsized":"2024-09-19T12:03:05.486498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:27.014754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":172,"num_write":74,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.597356+0000","last_change":"2024-09-19T11:35:39.676685+0000","last_active":"2024-09-19T11:59:01.597356+0000","last_peered":"2024-09-19T11:59:01.597356+0000","last_clean":"2024-09-19T11:59:01.597356+0000","last_became_active":"2024-09-19T11:35:39.675913+0000","last_became_peered":"2024-09-19T11:35:39.675913+0000","last_unstale":"2024-09-19T11:59:01.597356+0000","last_undegraded":"2024-09-19T11:59:01.597356+0000","last_fullsized":"2024-09-19T11:59:01.597356+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:50.470241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'73","reported_seq":589,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.113812+0000","last_change":"2024-09-19T12:03:21.113812+0000","last_active":"2024-09-19T12:03:21.113812+0000","last_peered":"2024-09-19T12:03:21.113812+0000","last_clean":"2024-09-19T12:03:21.113812+0000","last_became_active":"2024-09-19T11:35:33.624358+0000","last_became_peered":"2024-09-19T11:35:33.624358+0000","last_unstale":"2024-09-19T12:03:21.113812+0000","last_undegraded":"2024-09-19T12:03:21.113812+0000","last_fullsized":"2024-09-19T12:03:21.113812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'73","last_scrub_stamp":"2024-09-19T12:03:21.113588+0000","last_deep_scrub":"264'73","last_deep_scrub_stamp":"2024-09-19T12:03:21.113588+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.113588+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:37.273797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":316,"num_read_kb":286,"num_write":104,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2877,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'41","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.876573+0000","last_change":"2024-09-19T12:03:15.876573+0000","last_active":"2024-09-19T12:03:15.876573+0000","last_peered":"2024-09-19T12:03:15.876573+0000","last_clean":"2024-09-19T12:03:15.876573+0000","last_became_active":"2024-09-19T11:35:31.574673+0000","last_became_peered":"2024-09-19T11:35:31.574673+0000","last_unstale":"2024-09-19T12:03:15.876573+0000","last_undegraded":"2024-09-19T12:03:15.876573+0000","last_fullsized":"2024-09-19T12:03:15.876573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-19T12:03:15.876312+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-19T12:03:15.876312+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.876312+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:09.652364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":49,"num_write":124,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.606673+0000","last_change":"2024-09-19T11:35:35.620065+0000","last_active":"2024-09-19T11:59:41.606673+0000","last_peered":"2024-09-19T11:59:41.606673+0000","last_clean":"2024-09-19T11:59:41.606673+0000","last_became_active":"2024-09-19T11:35:35.617643+0000","last_became_peered":"2024-09-19T11:35:35.617643+0000","last_unstale":"2024-09-19T11:59:41.606673+0000","last_undegraded":"2024-09-19T11:59:41.606673+0000","last_fullsized":"2024-09-19T11:59:41.606673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:41.917586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'103","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.806541+0000","last_change":"2024-09-19T11:35:37.640664+0000","last_active":"2024-09-19T12:03:05.806541+0000","last_peered":"2024-09-19T12:03:05.806541+0000","last_clean":"2024-09-19T12:03:05.806541+0000","last_became_active":"2024-09-19T11:35:37.640147+0000","last_became_peered":"2024-09-19T11:35:37.640147+0000","last_unstale":"2024-09-19T12:03:05.806541+0000","last_undegraded":"2024-09-19T12:03:05.806541+0000","last_fullsized":"2024-09-19T12:03:05.806541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9836,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":276,"num_write":110,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619313+0000","last_change":"2024-09-19T11:35:39.652153+0000","last_active":"2024-09-19T12:00:41.619313+0000","last_peered":"2024-09-19T12:00:41.619313+0000","last_clean":"2024-09-19T12:00:41.619313+0000","last_became_active":"2024-09-19T11:35:39.651426+0000","last_became_peered":"2024-09-19T11:35:39.651426+0000","last_unstale":"2024-09-19T12:00:41.619313+0000","last_undegraded":"2024-09-19T12:00:41.619313+0000","last_fullsized":"2024-09-19T12:00:41.619313+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'72","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:28.052035+0000","last_change":"2024-09-19T11:35:41.676328+0000","last_active":"2024-09-19T11:59:28.052035+0000","last_peered":"2024-09-19T11:59:28.052035+0000","last_clean":"2024-09-19T11:59:28.052035+0000","last_became_active":"2024-09-19T11:35:41.674006+0000","last_became_peered":"2024-09-19T11:35:41.674006+0000","last_unstale":"2024-09-19T11:59:28.052035+0000","last_undegraded":"2024-09-19T11:59:28.052035+0000","last_fullsized":"2024-09-19T11:59:28.052035+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:43.399242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'110","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.333458+0000","last_change":"2024-09-19T12:03:23.333458+0000","last_active":"2024-09-19T12:03:23.333458+0000","last_peered":"2024-09-19T12:03:23.333458+0000","last_clean":"2024-09-19T12:03:23.333458+0000","last_became_active":"2024-09-19T11:35:33.611732+0000","last_became_peered":"2024-09-19T11:35:33.611732+0000","last_unstale":"2024-09-19T12:03:23.333458+0000","last_undegraded":"2024-09-19T12:03:23.333458+0000","last_fullsized":"2024-09-19T12:03:23.333458+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-19T12:03:23.333232+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-19T12:03:23.333232+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.333232+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.621387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":312,"num_write":153,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'50","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.674076+0000","last_change":"2024-09-19T12:03:13.674076+0000","last_active":"2024-09-19T12:03:13.674076+0000","last_peered":"2024-09-19T12:03:13.674076+0000","last_clean":"2024-09-19T12:03:13.674076+0000","last_became_active":"2024-09-19T11:35:31.585423+0000","last_became_peered":"2024-09-19T11:35:31.585423+0000","last_unstale":"2024-09-19T12:03:13.674076+0000","last_undegraded":"2024-09-19T12:03:13.674076+0000","last_fullsized":"2024-09-19T12:03:13.674076+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-19T12:03:13.673866+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-19T12:03:13.673866+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.673866+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:32.590993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":1132,"num_write":175,"num_write_kb":1063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.618616+0000","last_change":"2024-09-19T11:35:35.633072+0000","last_active":"2024-09-19T12:00:36.618616+0000","last_peered":"2024-09-19T12:00:36.618616+0000","last_clean":"2024-09-19T12:00:36.618616+0000","last_became_active":"2024-09-19T11:35:35.632384+0000","last_became_peered":"2024-09-19T11:35:35.632384+0000","last_unstale":"2024-09-19T12:00:36.618616+0000","last_undegraded":"2024-09-19T12:00:36.618616+0000","last_fullsized":"2024-09-19T12:00:36.618616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:13.028878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'76","reported_seq":584,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.515697+0000","last_change":"2024-09-19T11:35:37.642378+0000","last_active":"2024-09-19T12:03:05.515697+0000","last_peered":"2024-09-19T12:03:05.515697+0000","last_clean":"2024-09-19T12:03:05.515697+0000","last_became_active":"2024-09-19T11:35:37.641603+0000","last_became_peered":"2024-09-19T11:35:37.641603+0000","last_unstale":"2024-09-19T12:03:05.515697+0000","last_undegraded":"2024-09-19T12:03:05.515697+0000","last_fullsized":"2024-09-19T12:03:05.515697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:06.984305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":118,"num_read_kb":160,"num_write":100,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":472,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.607494+0000","last_change":"2024-09-19T11:35:39.684040+0000","last_active":"2024-09-19T12:00:41.607494+0000","last_peered":"2024-09-19T12:00:41.607494+0000","last_clean":"2024-09-19T12:00:41.607494+0000","last_became_active":"2024-09-19T11:35:39.683564+0000","last_became_peered":"2024-09-19T11:35:39.683564+0000","last_unstale":"2024-09-19T12:00:41.607494+0000","last_undegraded":"2024-09-19T12:00:41.607494+0000","last_fullsized":"2024-09-19T12:00:41.607494+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'25","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:32.989255+0000","last_change":"2024-09-19T11:35:41.665955+0000","last_active":"2024-09-19T12:02:32.989255+0000","last_peered":"2024-09-19T12:02:32.989255+0000","last_clean":"2024-09-19T12:02:32.989255+0000","last_became_active":"2024-09-19T11:35:41.665262+0000","last_became_peered":"2024-09-19T11:35:41.665262+0000","last_unstale":"2024-09-19T12:02:32.989255+0000","last_undegraded":"2024-09-19T12:02:32.989255+0000","last_fullsized":"2024-09-19T12:02:32.989255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:27.405987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":132,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'2","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.939755+0000","last_change":"2024-09-19T12:03:25.939755+0000","last_active":"2024-09-19T12:03:25.939755+0000","last_peered":"2024-09-19T12:03:25.939755+0000","last_clean":"2024-09-19T12:03:25.939755+0000","last_became_active":"2024-09-19T11:35:33.613712+0000","last_became_peered":"2024-09-19T11:35:33.613712+0000","last_unstale":"2024-09-19T12:03:25.939755+0000","last_undegraded":"2024-09-19T12:03:25.939755+0000","last_fullsized":"2024-09-19T12:03:25.939755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:25.939569+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:25.939569+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.939569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:24.600578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'48","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.168534+0000","last_change":"2024-09-19T12:03:14.168534+0000","last_active":"2024-09-19T12:03:14.168534+0000","last_peered":"2024-09-19T12:03:14.168534+0000","last_clean":"2024-09-19T12:03:14.168534+0000","last_became_active":"2024-09-19T11:35:31.579680+0000","last_became_peered":"2024-09-19T11:35:31.579680+0000","last_unstale":"2024-09-19T12:03:14.168534+0000","last_undegraded":"2024-09-19T12:03:14.168534+0000","last_fullsized":"2024-09-19T12:03:14.168534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'48","last_scrub_stamp":"2024-09-19T12:03:14.168295+0000","last_deep_scrub":"264'48","last_deep_scrub_stamp":"2024-09-19T12:03:14.168295+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.168295+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:40.012360+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":1771,"num_write":190,"num_write_kb":1706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.811062+0000","last_change":"2024-09-19T11:35:35.628919+0000","last_active":"2024-09-19T12:00:36.811062+0000","last_peered":"2024-09-19T12:00:36.811062+0000","last_clean":"2024-09-19T12:00:36.811062+0000","last_became_active":"2024-09-19T11:35:35.625446+0000","last_became_peered":"2024-09-19T11:35:35.625446+0000","last_unstale":"2024-09-19T12:00:36.811062+0000","last_undegraded":"2024-09-19T12:00:36.811062+0000","last_fullsized":"2024-09-19T12:00:36.811062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:40.113640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'72","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.773417+0000","last_change":"2024-09-19T11:35:37.617373+0000","last_active":"2024-09-19T12:03:05.773417+0000","last_peered":"2024-09-19T12:03:05.773417+0000","last_clean":"2024-09-19T12:03:05.773417+0000","last_became_active":"2024-09-19T11:35:37.616602+0000","last_became_peered":"2024-09-19T11:35:37.616602+0000","last_unstale":"2024-09-19T12:03:05.773417+0000","last_undegraded":"2024-09-19T12:03:05.773417+0000","last_fullsized":"2024-09-19T12:03:05.773417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:47.275427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4880,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":165,"num_write":74,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.594472+0000","last_change":"2024-09-19T11:35:39.686747+0000","last_active":"2024-09-19T11:59:46.594472+0000","last_peered":"2024-09-19T11:59:46.594472+0000","last_clean":"2024-09-19T11:59:46.594472+0000","last_became_active":"2024-09-19T11:35:39.686225+0000","last_became_peered":"2024-09-19T11:35:39.686225+0000","last_unstale":"2024-09-19T11:59:46.594472+0000","last_undegraded":"2024-09-19T11:59:46.594472+0000","last_fullsized":"2024-09-19T11:59:46.594472+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:38.757638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"256'2","reported_seq":471,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.596457+0000","last_change":"2024-09-19T11:35:41.683491+0000","last_active":"2024-09-19T11:59:01.596457+0000","last_peered":"2024-09-19T11:59:01.596457+0000","last_clean":"2024-09-19T11:59:01.596457+0000","last_became_active":"2024-09-19T11:35:41.682440+0000","last_became_peered":"2024-09-19T11:35:41.682440+0000","last_unstale":"2024-09-19T11:59:01.596457+0000","last_undegraded":"2024-09-19T11:59:01.596457+0000","last_fullsized":"2024-09-19T11:59:01.596457+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:15.584265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'93","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.239877+0000","last_change":"2024-09-19T12:03:18.239877+0000","last_active":"2024-09-19T12:03:18.239877+0000","last_peered":"2024-09-19T12:03:18.239877+0000","last_clean":"2024-09-19T12:03:18.239877+0000","last_became_active":"2024-09-19T11:35:33.605161+0000","last_became_peered":"2024-09-19T11:35:33.605161+0000","last_unstale":"2024-09-19T12:03:18.239877+0000","last_undegraded":"2024-09-19T12:03:18.239877+0000","last_fullsized":"2024-09-19T12:03:18.239877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'93","last_scrub_stamp":"2024-09-19T12:03:18.239701+0000","last_deep_scrub":"264'93","last_deep_scrub_stamp":"2024-09-19T12:03:18.239701+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.239701+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:08:10.377092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":359,"num_read_kb":288,"num_write":158,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'32","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.315615+0000","last_change":"2024-09-19T12:03:12.315615+0000","last_active":"2024-09-19T12:03:12.315615+0000","last_peered":"2024-09-19T12:03:12.315615+0000","last_clean":"2024-09-19T12:03:12.315615+0000","last_became_active":"2024-09-19T11:35:31.602466+0000","last_became_peered":"2024-09-19T11:35:31.602466+0000","last_unstale":"2024-09-19T12:03:12.315615+0000","last_undegraded":"2024-09-19T12:03:12.315615+0000","last_fullsized":"2024-09-19T12:03:12.315615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-19T12:03:12.315539+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-19T12:03:12.315539+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.315539+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:37.501317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":124,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.595939+0000","last_change":"2024-09-19T12:03:25.595939+0000","last_active":"2024-09-19T12:03:25.595939+0000","last_peered":"2024-09-19T12:03:25.595939+0000","last_clean":"2024-09-19T12:03:25.595939+0000","last_became_active":"2024-09-19T11:35:35.631573+0000","last_became_peered":"2024-09-19T11:35:35.631573+0000","last_unstale":"2024-09-19T12:03:25.595939+0000","last_undegraded":"2024-09-19T12:03:25.595939+0000","last_fullsized":"2024-09-19T12:03:25.595939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:25.595749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:25.595749+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.595749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:33.449047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'40","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:41.798513+0000","last_change":"2024-09-19T11:35:37.633680+0000","last_active":"2024-09-19T11:59:41.798513+0000","last_peered":"2024-09-19T11:59:41.798513+0000","last_clean":"2024-09-19T11:59:41.798513+0000","last_became_active":"2024-09-19T11:35:37.632562+0000","last_became_peered":"2024-09-19T11:35:37.632562+0000","last_unstale":"2024-09-19T11:59:41.798513+0000","last_undegraded":"2024-09-19T11:59:41.798513+0000","last_fullsized":"2024-09-19T11:59:41.798513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:18.066710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":55,"num_read_kb":48,"num_write":46,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'617","reported_seq":1540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.301211+0000","last_change":"2024-09-19T11:35:39.660361+0000","last_active":"2024-09-19T12:03:05.301211+0000","last_peered":"2024-09-19T12:03:05.301211+0000","last_clean":"2024-09-19T12:03:05.301211+0000","last_became_active":"2024-09-19T11:35:39.659602+0000","last_became_peered":"2024-09-19T11:35:39.659602+0000","last_unstale":"2024-09-19T12:03:05.301211+0000","last_undegraded":"2024-09-19T12:03:05.301211+0000","last_fullsized":"2024-09-19T12:03:05.301211+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:19.524182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'7","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.600833+0000","last_change":"2024-09-19T11:35:41.682361+0000","last_active":"2024-09-19T11:59:01.600833+0000","last_peered":"2024-09-19T11:59:01.600833+0000","last_clean":"2024-09-19T11:59:01.600833+0000","last_became_active":"2024-09-19T11:35:41.681567+0000","last_became_peered":"2024-09-19T11:35:41.681567+0000","last_unstale":"2024-09-19T11:59:01.600833+0000","last_undegraded":"2024-09-19T11:59:01.600833+0000","last_fullsized":"2024-09-19T11:59:01.600833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:05.849048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'69","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.248021+0000","last_change":"2024-09-19T12:03:24.248021+0000","last_active":"2024-09-19T12:03:24.248021+0000","last_peered":"2024-09-19T12:03:24.248021+0000","last_clean":"2024-09-19T12:03:24.248021+0000","last_became_active":"2024-09-19T11:35:33.617414+0000","last_became_peered":"2024-09-19T11:35:33.617414+0000","last_unstale":"2024-09-19T12:03:24.248021+0000","last_undegraded":"2024-09-19T12:03:24.248021+0000","last_fullsized":"2024-09-19T12:03:24.248021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'69","last_scrub_stamp":"2024-09-19T12:03:24.247784+0000","last_deep_scrub":"264'69","last_deep_scrub_stamp":"2024-09-19T12:03:24.247784+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.247784+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:57.608796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":201,"num_write":115,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'34","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.581458+0000","last_change":"2024-09-19T12:03:16.581458+0000","last_active":"2024-09-19T12:03:16.581458+0000","last_peered":"2024-09-19T12:03:16.581458+0000","last_clean":"2024-09-19T12:03:16.581458+0000","last_became_active":"2024-09-19T11:35:31.613260+0000","last_became_peered":"2024-09-19T11:35:31.613260+0000","last_unstale":"2024-09-19T12:03:16.581458+0000","last_undegraded":"2024-09-19T12:03:16.581458+0000","last_fullsized":"2024-09-19T12:03:16.581458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-19T12:03:16.581208+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-19T12:03:16.581208+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.581208+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:46.072831+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":9290,"num_write":82,"num_write_kb":7234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.621410+0000","last_change":"2024-09-19T11:35:35.618214+0000","last_active":"2024-09-19T12:00:36.621410+0000","last_peered":"2024-09-19T12:00:36.621410+0000","last_clean":"2024-09-19T12:00:36.621410+0000","last_became_active":"2024-09-19T11:35:35.617489+0000","last_became_peered":"2024-09-19T11:35:35.617489+0000","last_unstale":"2024-09-19T12:00:36.621410+0000","last_undegraded":"2024-09-19T12:00:36.621410+0000","last_fullsized":"2024-09-19T12:00:36.621410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:05.845518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'91","reported_seq":598,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.865956+0000","last_change":"2024-09-19T11:35:37.625579+0000","last_active":"2024-09-19T12:03:05.865956+0000","last_peered":"2024-09-19T12:03:05.865956+0000","last_clean":"2024-09-19T12:03:05.865956+0000","last_became_active":"2024-09-19T11:35:37.624101+0000","last_became_peered":"2024-09-19T11:35:37.624101+0000","last_unstale":"2024-09-19T12:03:05.865956+0000","last_undegraded":"2024-09-19T12:03:05.865956+0000","last_fullsized":"2024-09-19T12:03:05.865956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:13:17.073803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4425,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":123,"num_read_kb":188,"num_write":92,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.608983+0000","last_change":"2024-09-19T11:35:39.674060+0000","last_active":"2024-09-19T11:59:51.608983+0000","last_peered":"2024-09-19T11:59:51.608983+0000","last_clean":"2024-09-19T11:59:51.608983+0000","last_became_active":"2024-09-19T11:35:39.671474+0000","last_became_peered":"2024-09-19T11:35:39.671474+0000","last_unstale":"2024-09-19T11:59:51.608983+0000","last_undegraded":"2024-09-19T11:59:51.608983+0000","last_fullsized":"2024-09-19T11:59:51.608983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:49.787232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'16","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611804+0000","last_change":"2024-09-19T11:35:41.694646+0000","last_active":"2024-09-19T11:59:51.611804+0000","last_peered":"2024-09-19T11:59:51.611804+0000","last_clean":"2024-09-19T11:59:51.611804+0000","last_became_active":"2024-09-19T11:35:41.693900+0000","last_became_peered":"2024-09-19T11:35:41.693900+0000","last_unstale":"2024-09-19T11:59:51.611804+0000","last_undegraded":"2024-09-19T11:59:51.611804+0000","last_fullsized":"2024-09-19T11:59:51.611804+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:06.653849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'84","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.222123+0000","last_change":"2024-09-19T12:03:23.222123+0000","last_active":"2024-09-19T12:03:23.222123+0000","last_peered":"2024-09-19T12:03:23.222123+0000","last_clean":"2024-09-19T12:03:23.222123+0000","last_became_active":"2024-09-19T11:35:33.605259+0000","last_became_peered":"2024-09-19T11:35:33.605259+0000","last_unstale":"2024-09-19T12:03:23.222123+0000","last_undegraded":"2024-09-19T12:03:23.222123+0000","last_fullsized":"2024-09-19T12:03:23.222123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-19T12:03:23.221939+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-19T12:03:23.221939+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.221939+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:03.856307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":291,"num_write":128,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'46","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.566095+0000","last_change":"2024-09-19T12:03:17.566095+0000","last_active":"2024-09-19T12:03:17.566095+0000","last_peered":"2024-09-19T12:03:17.566095+0000","last_clean":"2024-09-19T12:03:17.566095+0000","last_became_active":"2024-09-19T11:35:31.622688+0000","last_became_peered":"2024-09-19T11:35:31.622688+0000","last_unstale":"2024-09-19T12:03:17.566095+0000","last_undegraded":"2024-09-19T12:03:17.566095+0000","last_fullsized":"2024-09-19T12:03:17.566095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'46","last_scrub_stamp":"2024-09-19T12:03:17.565856+0000","last_deep_scrub":"264'46","last_deep_scrub_stamp":"2024-09-19T12:03:17.565856+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.565856+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:16.319910+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":10950,"num_write":217,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.617902+0000","last_change":"2024-09-19T11:35:35.622260+0000","last_active":"2024-09-19T12:00:36.617902+0000","last_peered":"2024-09-19T12:00:36.617902+0000","last_clean":"2024-09-19T12:00:36.617902+0000","last_became_active":"2024-09-19T11:35:35.621518+0000","last_became_peered":"2024-09-19T11:35:35.621518+0000","last_unstale":"2024-09-19T12:00:36.617902+0000","last_undegraded":"2024-09-19T12:00:36.617902+0000","last_fullsized":"2024-09-19T12:00:36.617902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:30.262378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'92","reported_seq":591,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.886317+0000","last_change":"2024-09-19T11:35:37.641470+0000","last_active":"2024-09-19T12:03:05.886317+0000","last_peered":"2024-09-19T12:03:05.886317+0000","last_clean":"2024-09-19T12:03:05.886317+0000","last_became_active":"2024-09-19T11:35:37.639833+0000","last_became_peered":"2024-09-19T11:35:37.639833+0000","last_unstale":"2024-09-19T12:03:05.886317+0000","last_undegraded":"2024-09-19T12:03:05.886317+0000","last_fullsized":"2024-09-19T12:03:05.886317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:25.377817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5142,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":105,"num_read_kb":164,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":470,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.609264+0000","last_change":"2024-09-19T11:35:39.659799+0000","last_active":"2024-09-19T11:59:56.609264+0000","last_peered":"2024-09-19T11:59:56.609264+0000","last_clean":"2024-09-19T11:59:56.609264+0000","last_became_active":"2024-09-19T11:35:39.659011+0000","last_became_peered":"2024-09-19T11:35:39.659011+0000","last_unstale":"2024-09-19T11:59:56.609264+0000","last_undegraded":"2024-09-19T11:59:56.609264+0000","last_fullsized":"2024-09-19T11:59:56.609264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:33.261718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'15","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.603923+0000","last_change":"2024-09-19T11:35:41.675429+0000","last_active":"2024-09-19T11:59:51.603923+0000","last_peered":"2024-09-19T11:59:51.603923+0000","last_clean":"2024-09-19T11:59:51.603923+0000","last_became_active":"2024-09-19T11:35:41.674818+0000","last_became_peered":"2024-09-19T11:35:41.674818+0000","last_unstale":"2024-09-19T11:59:51.603923+0000","last_undegraded":"2024-09-19T11:59:51.603923+0000","last_fullsized":"2024-09-19T11:59:51.603923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:12.876595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":90,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'44","reported_seq":556,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.881067+0000","last_change":"2024-09-19T12:03:23.881067+0000","last_active":"2024-09-19T12:03:23.881067+0000","last_peered":"2024-09-19T12:03:23.881067+0000","last_clean":"2024-09-19T12:03:23.881067+0000","last_became_active":"2024-09-19T11:35:33.603610+0000","last_became_peered":"2024-09-19T11:35:33.603610+0000","last_unstale":"2024-09-19T12:03:23.881067+0000","last_undegraded":"2024-09-19T12:03:23.881067+0000","last_fullsized":"2024-09-19T12:03:23.881067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-19T12:03:23.880876+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-19T12:03:23.880876+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.880876+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:55.046789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":138,"num_write":82,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'50","reported_seq":572,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.839686+0000","last_change":"2024-09-19T12:03:14.839686+0000","last_active":"2024-09-19T12:03:14.839686+0000","last_peered":"2024-09-19T12:03:14.839686+0000","last_clean":"2024-09-19T12:03:14.839686+0000","last_became_active":"2024-09-19T11:35:31.620504+0000","last_became_peered":"2024-09-19T11:35:31.620504+0000","last_unstale":"2024-09-19T12:03:14.839686+0000","last_undegraded":"2024-09-19T12:03:14.839686+0000","last_fullsized":"2024-09-19T12:03:14.839686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-19T12:03:14.839475+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-19T12:03:14.839475+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.839475+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:52.284729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":1683,"num_write":177,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:46.799503+0000","last_change":"2024-09-19T11:35:35.624137+0000","last_active":"2024-09-19T11:59:46.799503+0000","last_peered":"2024-09-19T11:59:46.799503+0000","last_clean":"2024-09-19T11:59:46.799503+0000","last_became_active":"2024-09-19T11:35:35.623348+0000","last_became_peered":"2024-09-19T11:35:35.623348+0000","last_unstale":"2024-09-19T11:59:46.799503+0000","last_undegraded":"2024-09-19T11:59:46.799503+0000","last_fullsized":"2024-09-19T11:59:46.799503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:43.589134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'43","reported_seq":540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.746269+0000","last_change":"2024-09-19T11:35:37.643750+0000","last_active":"2024-09-19T12:03:05.746269+0000","last_peered":"2024-09-19T12:03:05.746269+0000","last_clean":"2024-09-19T12:03:05.746269+0000","last_became_active":"2024-09-19T11:35:37.643249+0000","last_became_peered":"2024-09-19T11:35:37.643249+0000","last_unstale":"2024-09-19T12:03:05.746269+0000","last_undegraded":"2024-09-19T12:03:05.746269+0000","last_fullsized":"2024-09-19T12:03:05.746269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":104,"num_write":42,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.812250+0000","last_change":"2024-09-19T11:35:39.675950+0000","last_active":"2024-09-19T12:00:41.812250+0000","last_peered":"2024-09-19T12:00:41.812250+0000","last_clean":"2024-09-19T12:00:41.812250+0000","last_became_active":"2024-09-19T11:35:39.675285+0000","last_became_peered":"2024-09-19T11:35:39.675285+0000","last_unstale":"2024-09-19T12:00:41.812250+0000","last_undegraded":"2024-09-19T12:00:41.812250+0000","last_fullsized":"2024-09-19T12:00:41.812250+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'22","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.336022+0000","last_change":"2024-09-19T11:35:41.695355+0000","last_active":"2024-09-19T12:00:06.336022+0000","last_peered":"2024-09-19T12:00:06.336022+0000","last_clean":"2024-09-19T12:00:06.336022+0000","last_became_active":"2024-09-19T11:35:41.694201+0000","last_became_peered":"2024-09-19T11:35:41.694201+0000","last_unstale":"2024-09-19T12:00:06.336022+0000","last_undegraded":"2024-09-19T12:00:06.336022+0000","last_fullsized":"2024-09-19T12:00:06.336022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:09.844137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":56,"num_write":68,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'84","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.212198+0000","last_change":"2024-09-19T12:03:22.212198+0000","last_active":"2024-09-19T12:03:22.212198+0000","last_peered":"2024-09-19T12:03:22.212198+0000","last_clean":"2024-09-19T12:03:22.212198+0000","last_became_active":"2024-09-19T11:35:33.628283+0000","last_became_peered":"2024-09-19T11:35:33.628283+0000","last_unstale":"2024-09-19T12:03:22.212198+0000","last_undegraded":"2024-09-19T12:03:22.212198+0000","last_fullsized":"2024-09-19T12:03:22.212198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-19T12:03:22.211993+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-19T12:03:22.211993+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.211993+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:56:25.321214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":329,"num_read_kb":270,"num_write":117,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'31","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.370653+0000","last_change":"2024-09-19T12:03:13.370653+0000","last_active":"2024-09-19T12:03:13.370653+0000","last_peered":"2024-09-19T12:03:13.370653+0000","last_clean":"2024-09-19T12:03:13.370653+0000","last_became_active":"2024-09-19T11:36:06.649652+0000","last_became_peered":"2024-09-19T11:36:06.649652+0000","last_unstale":"2024-09-19T12:03:13.370653+0000","last_undegraded":"2024-09-19T12:03:13.370653+0000","last_fullsized":"2024-09-19T12:03:13.370653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-19T12:03:13.370381+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-19T12:03:13.370381+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.370381+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:51.332104+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079957,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":43,"num_read_kb":1095,"num_write":138,"num_write_kb":1067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,7],"acting":[0,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.595482+0000","last_change":"2024-09-19T11:35:35.612806+0000","last_active":"2024-09-19T11:59:51.595482+0000","last_peered":"2024-09-19T11:59:51.595482+0000","last_clean":"2024-09-19T11:59:51.595482+0000","last_became_active":"2024-09-19T11:35:35.612450+0000","last_became_peered":"2024-09-19T11:35:35.612450+0000","last_unstale":"2024-09-19T11:59:51.595482+0000","last_undegraded":"2024-09-19T11:59:51.595482+0000","last_fullsized":"2024-09-19T11:59:51.595482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:34.579596+0000","last_clean_scrub_stamp":"2024-09-19T11:35:34.579596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:02.776959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'90","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.784626+0000","last_change":"2024-09-19T11:35:37.639560+0000","last_active":"2024-09-19T12:03:05.784626+0000","last_peered":"2024-09-19T12:03:05.784626+0000","last_clean":"2024-09-19T12:03:05.784626+0000","last_became_active":"2024-09-19T11:35:37.638771+0000","last_became_peered":"2024-09-19T11:35:37.638771+0000","last_unstale":"2024-09-19T12:03:05.784626+0000","last_undegraded":"2024-09-19T12:03:05.784626+0000","last_fullsized":"2024-09-19T12:03:05.784626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:36.588203+0000","last_clean_scrub_stamp":"2024-09-19T11:35:36.588203+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4489,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":185,"num_write":92,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.621014+0000","last_change":"2024-09-19T11:35:39.663318+0000","last_active":"2024-09-19T12:00:41.621014+0000","last_peered":"2024-09-19T12:00:41.621014+0000","last_clean":"2024-09-19T12:00:41.621014+0000","last_became_active":"2024-09-19T11:35:39.662405+0000","last_became_peered":"2024-09-19T11:35:39.662405+0000","last_unstale":"2024-09-19T12:00:41.621014+0000","last_undegraded":"2024-09-19T12:00:41.621014+0000","last_fullsized":"2024-09-19T12:00:41.621014+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:38.617436+0000","last_clean_scrub_stamp":"2024-09-19T11:35:38.617436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"253'4","reported_seq":477,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:01.789890+0000","last_change":"2024-09-19T11:35:41.688704+0000","last_active":"2024-09-19T11:59:01.789890+0000","last_peered":"2024-09-19T11:59:01.789890+0000","last_clean":"2024-09-19T11:59:01.789890+0000","last_became_active":"2024-09-19T11:35:41.687549+0000","last_became_peered":"2024-09-19T11:35:41.687549+0000","last_unstale":"2024-09-19T11:59:01.789890+0000","last_undegraded":"2024-09-19T11:59:01.789890+0000","last_fullsized":"2024-09-19T11:59:01.789890+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:56.527265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'79","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.562775+0000","last_change":"2024-09-19T12:03:23.562775+0000","last_active":"2024-09-19T12:03:23.562775+0000","last_peered":"2024-09-19T12:03:23.562775+0000","last_clean":"2024-09-19T12:03:23.562775+0000","last_became_active":"2024-09-19T11:35:33.629186+0000","last_became_peered":"2024-09-19T11:35:33.629186+0000","last_unstale":"2024-09-19T12:03:23.562775+0000","last_undegraded":"2024-09-19T12:03:23.562775+0000","last_fullsized":"2024-09-19T12:03:23.562775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'79","last_scrub_stamp":"2024-09-19T12:03:23.562590+0000","last_deep_scrub":"264'79","last_deep_scrub_stamp":"2024-09-19T12:03:23.562590+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.562590+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:34.865041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":235,"num_write":161,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'77","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.040384+0000","last_change":"2024-09-19T12:03:16.040384+0000","last_active":"2024-09-19T12:03:16.040384+0000","last_peered":"2024-09-19T12:03:16.040384+0000","last_clean":"2024-09-19T12:03:16.040384+0000","last_became_active":"2024-09-19T11:35:31.611719+0000","last_became_peered":"2024-09-19T11:35:31.611719+0000","last_unstale":"2024-09-19T12:03:16.040384+0000","last_undegraded":"2024-09-19T12:03:16.040384+0000","last_fullsized":"2024-09-19T12:03:16.040384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'77","last_scrub_stamp":"2024-09-19T12:03:16.040181+0000","last_deep_scrub":"264'77","last_deep_scrub_stamp":"2024-09-19T12:03:16.040181+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.040181+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:20.926088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":5196,"num_write":200,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'356","reported_seq":1061,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.626129+0000","last_change":"2024-09-19T12:03:20.626129+0000","last_active":"2024-09-19T12:03:20.626129+0000","last_peered":"2024-09-19T12:03:20.626129+0000","last_clean":"2024-09-19T12:03:20.626129+0000","last_became_active":"2024-09-19T11:35:33.603938+0000","last_became_peered":"2024-09-19T11:35:33.603938+0000","last_unstale":"2024-09-19T12:03:20.626129+0000","last_undegraded":"2024-09-19T12:03:20.626129+0000","last_fullsized":"2024-09-19T12:03:20.626129+0000","mapping_epoch":28,"log_start":"253'300","ondisk_log_start":"253'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-19T12:03:20.625945+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-19T12:03:20.625945+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.625945+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:23.605332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1936,"num_read_kb":1745,"num_write":575,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25754,"num_omap_keys":101,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'39","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.131069+0000","last_change":"2024-09-19T12:03:13.131069+0000","last_active":"2024-09-19T12:03:13.131069+0000","last_peered":"2024-09-19T12:03:13.131069+0000","last_clean":"2024-09-19T12:03:13.131069+0000","last_became_active":"2024-09-19T11:35:31.602046+0000","last_became_peered":"2024-09-19T11:35:31.602046+0000","last_unstale":"2024-09-19T12:03:13.131069+0000","last_undegraded":"2024-09-19T12:03:13.131069+0000","last_fullsized":"2024-09-19T12:03:13.131069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-19T12:03:13.130878+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-19T12:03:13.130878+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.130878+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:22.035681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":1671,"num_write":116,"num_write_kb":1627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'4","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.541496+0000","last_change":"2024-09-19T12:03:26.541496+0000","last_active":"2024-09-19T12:03:26.541496+0000","last_peered":"2024-09-19T12:03:26.541496+0000","last_clean":"2024-09-19T12:03:26.541496+0000","last_became_active":"2024-09-19T11:35:33.616104+0000","last_became_peered":"2024-09-19T11:35:33.616104+0000","last_unstale":"2024-09-19T12:03:26.541496+0000","last_undegraded":"2024-09-19T12:03:26.541496+0000","last_fullsized":"2024-09-19T12:03:26.541496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-19T12:03:26.541258+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-19T12:03:26.541258+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.541258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:34.987591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'37","reported_seq":552,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.554014+0000","last_change":"2024-09-19T12:03:15.554014+0000","last_active":"2024-09-19T12:03:15.554014+0000","last_peered":"2024-09-19T12:03:15.554014+0000","last_clean":"2024-09-19T12:03:15.554014+0000","last_became_active":"2024-09-19T11:35:31.613195+0000","last_became_peered":"2024-09-19T11:35:31.613195+0000","last_unstale":"2024-09-19T12:03:15.554014+0000","last_undegraded":"2024-09-19T12:03:15.554014+0000","last_fullsized":"2024-09-19T12:03:15.554014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:15.553759+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:15.553759+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.553759+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:58.104806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":62,"num_read_kb":44,"num_write":136,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'20","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.567098+0000","last_change":"2024-09-19T12:03:22.567098+0000","last_active":"2024-09-19T12:03:22.567098+0000","last_peered":"2024-09-19T12:03:22.567098+0000","last_clean":"2024-09-19T12:03:22.567098+0000","last_became_active":"2024-09-19T11:35:33.619302+0000","last_became_peered":"2024-09-19T11:35:33.619302+0000","last_unstale":"2024-09-19T12:03:22.567098+0000","last_undegraded":"2024-09-19T12:03:22.567098+0000","last_fullsized":"2024-09-19T12:03:22.567098+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'20","last_scrub_stamp":"2024-09-19T12:03:22.566882+0000","last_deep_scrub":"264'20","last_deep_scrub_stamp":"2024-09-19T12:03:22.566882+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.566882+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:29.013184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'66","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.360205+0000","last_change":"2024-09-19T12:03:17.360205+0000","last_active":"2024-09-19T12:03:17.360205+0000","last_peered":"2024-09-19T12:03:17.360205+0000","last_clean":"2024-09-19T12:03:17.360205+0000","last_became_active":"2024-09-19T11:35:31.590651+0000","last_became_peered":"2024-09-19T11:35:31.590651+0000","last_unstale":"2024-09-19T12:03:17.360205+0000","last_undegraded":"2024-09-19T12:03:17.360205+0000","last_fullsized":"2024-09-19T12:03:17.360205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'66","last_scrub_stamp":"2024-09-19T12:03:17.359961+0000","last_deep_scrub":"264'66","last_deep_scrub_stamp":"2024-09-19T12:03:17.359961+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.359961+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:33.016521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":163,"num_read_kb":1977,"num_write":243,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615123+0000","last_change":"2024-09-19T11:35:33.619828+0000","last_active":"2024-09-19T12:00:41.615123+0000","last_peered":"2024-09-19T12:00:41.615123+0000","last_clean":"2024-09-19T12:00:41.615123+0000","last_became_active":"2024-09-19T11:35:33.619372+0000","last_became_peered":"2024-09-19T11:35:33.619372+0000","last_unstale":"2024-09-19T12:00:41.615123+0000","last_undegraded":"2024-09-19T12:00:41.615123+0000","last_fullsized":"2024-09-19T12:00:41.615123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:25.554628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'17","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.875042+0000","last_change":"2024-09-19T12:03:21.875042+0000","last_active":"2024-09-19T12:03:21.875042+0000","last_peered":"2024-09-19T12:03:21.875042+0000","last_clean":"2024-09-19T12:03:21.875042+0000","last_became_active":"2024-09-19T11:35:31.584316+0000","last_became_peered":"2024-09-19T11:35:31.584316+0000","last_unstale":"2024-09-19T12:03:21.875042+0000","last_undegraded":"2024-09-19T12:03:21.875042+0000","last_fullsized":"2024-09-19T12:03:21.875042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-19T12:03:21.874788+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-19T12:03:21.874788+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.874788+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:13:03.876466+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079915,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":1065,"num_write":66,"num_write_kb":1060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.233496+0000","last_change":"2024-09-19T12:03:25.233496+0000","last_active":"2024-09-19T12:03:25.233496+0000","last_peered":"2024-09-19T12:03:25.233496+0000","last_clean":"2024-09-19T12:03:25.233496+0000","last_became_active":"2024-09-19T11:35:33.626872+0000","last_became_peered":"2024-09-19T11:35:33.626872+0000","last_unstale":"2024-09-19T12:03:25.233496+0000","last_undegraded":"2024-09-19T12:03:25.233496+0000","last_fullsized":"2024-09-19T12:03:25.233496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:25.233308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:25.233308+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.233308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:10:23.945915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'31","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.620612+0000","last_change":"2024-09-19T12:03:15.620612+0000","last_active":"2024-09-19T12:03:15.620612+0000","last_peered":"2024-09-19T12:03:15.620612+0000","last_clean":"2024-09-19T12:03:15.620612+0000","last_became_active":"2024-09-19T11:35:31.591724+0000","last_became_peered":"2024-09-19T11:35:31.591724+0000","last_unstale":"2024-09-19T12:03:15.620612+0000","last_undegraded":"2024-09-19T12:03:15.620612+0000","last_fullsized":"2024-09-19T12:03:15.620612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-19T12:03:15.620320+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-19T12:03:15.620320+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.620320+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:00.450806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079955,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":1149,"num_write":140,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'52","reported_seq":560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:33.197816+0000","last_change":"2024-09-19T11:35:33.614983+0000","last_active":"2024-09-19T12:02:33.197816+0000","last_peered":"2024-09-19T12:02:33.197816+0000","last_clean":"2024-09-19T12:02:33.197816+0000","last_became_active":"2024-09-19T11:35:33.614316+0000","last_became_peered":"2024-09-19T11:35:33.614316+0000","last_unstale":"2024-09-19T12:02:33.197816+0000","last_undegraded":"2024-09-19T12:02:33.197816+0000","last_fullsized":"2024-09-19T12:02:33.197816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:38.763908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":175,"num_write":74,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'46","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.008163+0000","last_change":"2024-09-19T12:03:13.008163+0000","last_active":"2024-09-19T12:03:13.008163+0000","last_peered":"2024-09-19T12:03:13.008163+0000","last_clean":"2024-09-19T12:03:13.008163+0000","last_became_active":"2024-09-19T11:35:31.612367+0000","last_became_peered":"2024-09-19T11:35:31.612367+0000","last_unstale":"2024-09-19T12:03:13.008163+0000","last_undegraded":"2024-09-19T12:03:13.008163+0000","last_fullsized":"2024-09-19T12:03:13.008163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'46","last_scrub_stamp":"2024-09-19T12:03:13.007880+0000","last_deep_scrub":"264'46","last_deep_scrub_stamp":"2024-09-19T12:03:13.007880+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.007880+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:16.799470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":319,"num_write":186,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'50","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.137052+0000","last_change":"2024-09-19T12:03:22.137052+0000","last_active":"2024-09-19T12:03:22.137052+0000","last_peered":"2024-09-19T12:03:22.137052+0000","last_clean":"2024-09-19T12:03:22.137052+0000","last_became_active":"2024-09-19T11:35:33.625249+0000","last_became_peered":"2024-09-19T11:35:33.625249+0000","last_unstale":"2024-09-19T12:03:22.137052+0000","last_undegraded":"2024-09-19T12:03:22.137052+0000","last_fullsized":"2024-09-19T12:03:22.137052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'50","last_scrub_stamp":"2024-09-19T12:03:22.136758+0000","last_deep_scrub":"262'50","last_deep_scrub_stamp":"2024-09-19T12:03:22.136758+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.136758+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:25.098457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":159,"num_write":74,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'52","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.868272+0000","last_change":"2024-09-19T12:03:16.868272+0000","last_active":"2024-09-19T12:03:16.868272+0000","last_peered":"2024-09-19T12:03:16.868272+0000","last_clean":"2024-09-19T12:03:16.868272+0000","last_became_active":"2024-09-19T11:35:31.588705+0000","last_became_peered":"2024-09-19T11:35:31.588705+0000","last_unstale":"2024-09-19T12:03:16.868272+0000","last_undegraded":"2024-09-19T12:03:16.868272+0000","last_fullsized":"2024-09-19T12:03:16.868272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-19T12:03:16.868041+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-19T12:03:16.868041+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.868041+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:40.261460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":83,"num_read_kb":4157,"num_write":184,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'73","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.347586+0000","last_change":"2024-09-19T12:03:25.347586+0000","last_active":"2024-09-19T12:03:25.347586+0000","last_peered":"2024-09-19T12:03:25.347586+0000","last_clean":"2024-09-19T12:03:25.347586+0000","last_became_active":"2024-09-19T11:35:33.625874+0000","last_became_peered":"2024-09-19T11:35:33.625874+0000","last_unstale":"2024-09-19T12:03:25.347586+0000","last_undegraded":"2024-09-19T12:03:25.347586+0000","last_fullsized":"2024-09-19T12:03:25.347586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'73","last_scrub_stamp":"2024-09-19T12:03:25.347361+0000","last_deep_scrub":"264'73","last_deep_scrub_stamp":"2024-09-19T12:03:25.347361+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.347361+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:09.483565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":214,"num_write":124,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'30","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.538592+0000","last_change":"2024-09-19T12:03:18.538592+0000","last_active":"2024-09-19T12:03:18.538592+0000","last_peered":"2024-09-19T12:03:18.538592+0000","last_clean":"2024-09-19T12:03:18.538592+0000","last_became_active":"2024-09-19T11:35:31.593067+0000","last_became_peered":"2024-09-19T11:35:31.593067+0000","last_unstale":"2024-09-19T12:03:18.538592+0000","last_undegraded":"2024-09-19T12:03:18.538592+0000","last_fullsized":"2024-09-19T12:03:18.538592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-19T12:03:18.538359+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-19T12:03:18.538359+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.538359+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:10.521160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079937,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":48,"num_read_kb":1085,"num_write":114,"num_write_kb":1065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:58:56.788881+0000","last_change":"2024-09-19T11:35:33.613879+0000","last_active":"2024-09-19T11:58:56.788881+0000","last_peered":"2024-09-19T11:58:56.788881+0000","last_clean":"2024-09-19T11:58:56.788881+0000","last_became_active":"2024-09-19T11:35:33.612924+0000","last_became_peered":"2024-09-19T11:35:33.612924+0000","last_unstale":"2024-09-19T11:58:56.788881+0000","last_undegraded":"2024-09-19T11:58:56.788881+0000","last_fullsized":"2024-09-19T11:58:56.788881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:49.021618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'63","reported_seq":584,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.823681+0000","last_change":"2024-09-19T12:03:17.823681+0000","last_active":"2024-09-19T12:03:17.823681+0000","last_peered":"2024-09-19T12:03:17.823681+0000","last_clean":"2024-09-19T12:03:17.823681+0000","last_became_active":"2024-09-19T11:35:31.581058+0000","last_became_peered":"2024-09-19T11:35:31.581058+0000","last_unstale":"2024-09-19T12:03:17.823681+0000","last_undegraded":"2024-09-19T12:03:17.823681+0000","last_fullsized":"2024-09-19T12:03:17.823681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'63","last_scrub_stamp":"2024-09-19T12:03:17.823463+0000","last_deep_scrub":"264'63","last_deep_scrub_stamp":"2024-09-19T12:03:17.823463+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.823463+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:53.718849+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":310,"num_write":200,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'63","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.277810+0000","last_change":"2024-09-19T12:03:21.277810+0000","last_active":"2024-09-19T12:03:21.277810+0000","last_peered":"2024-09-19T12:03:21.277810+0000","last_clean":"2024-09-19T12:03:21.277810+0000","last_became_active":"2024-09-19T11:35:33.628335+0000","last_became_peered":"2024-09-19T11:35:33.628335+0000","last_unstale":"2024-09-19T12:03:21.277810+0000","last_undegraded":"2024-09-19T12:03:21.277810+0000","last_fullsized":"2024-09-19T12:03:21.277810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'63","last_scrub_stamp":"2024-09-19T12:03:21.277541+0000","last_deep_scrub":"264'63","last_deep_scrub_stamp":"2024-09-19T12:03:21.277541+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.277541+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:38.808707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":184,"num_write":116,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'40","reported_seq":560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.501988+0000","last_change":"2024-09-19T12:03:19.501988+0000","last_active":"2024-09-19T12:03:19.501988+0000","last_peered":"2024-09-19T12:03:19.501988+0000","last_clean":"2024-09-19T12:03:19.501988+0000","last_became_active":"2024-09-19T11:35:31.623733+0000","last_became_peered":"2024-09-19T11:35:31.623733+0000","last_unstale":"2024-09-19T12:03:19.501988+0000","last_undegraded":"2024-09-19T12:03:19.501988+0000","last_fullsized":"2024-09-19T12:03:19.501988+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-19T12:03:19.501752+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-19T12:03:19.501752+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.501752+0000","objects_scrubbed":9,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:34.279646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159904,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":74,"num_read_kb":2163,"num_write":163,"num_write_kb":2120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'86","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.191248+0000","last_change":"2024-09-19T12:03:26.191248+0000","last_active":"2024-09-19T12:03:26.191248+0000","last_peered":"2024-09-19T12:03:26.191248+0000","last_clean":"2024-09-19T12:03:26.191248+0000","last_became_active":"2024-09-19T11:35:33.628184+0000","last_became_peered":"2024-09-19T11:35:33.628184+0000","last_unstale":"2024-09-19T12:03:26.191248+0000","last_undegraded":"2024-09-19T12:03:26.191248+0000","last_fullsized":"2024-09-19T12:03:26.191248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-19T12:03:26.191061+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-19T12:03:26.191061+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.191061+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:52.403398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":344,"num_read_kb":269,"num_write":142,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'57","reported_seq":579,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.379290+0000","last_change":"2024-09-19T12:03:16.379290+0000","last_active":"2024-09-19T12:03:16.379290+0000","last_peered":"2024-09-19T12:03:16.379290+0000","last_clean":"2024-09-19T12:03:16.379290+0000","last_became_active":"2024-09-19T11:35:31.612601+0000","last_became_peered":"2024-09-19T11:35:31.612601+0000","last_unstale":"2024-09-19T12:03:16.379290+0000","last_undegraded":"2024-09-19T12:03:16.379290+0000","last_fullsized":"2024-09-19T12:03:16.379290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'57","last_scrub_stamp":"2024-09-19T12:03:16.379072+0000","last_deep_scrub":"264'57","last_deep_scrub_stamp":"2024-09-19T12:03:16.379072+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.379072+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:19.650443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":6286,"num_write":172,"num_write_kb":11381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'7","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.404056+0000","last_change":"2024-09-19T12:03:26.404056+0000","last_active":"2024-09-19T12:03:26.404056+0000","last_peered":"2024-09-19T12:03:26.404056+0000","last_clean":"2024-09-19T12:03:26.404056+0000","last_became_active":"2024-09-19T11:35:33.624149+0000","last_became_peered":"2024-09-19T11:35:33.624149+0000","last_unstale":"2024-09-19T12:03:26.404056+0000","last_undegraded":"2024-09-19T12:03:26.404056+0000","last_fullsized":"2024-09-19T12:03:26.404056+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-19T12:03:26.403849+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-19T12:03:26.403849+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.403849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:14.799208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'34","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.999808+0000","last_change":"2024-09-19T12:03:14.999808+0000","last_active":"2024-09-19T12:03:14.999808+0000","last_peered":"2024-09-19T12:03:14.999808+0000","last_clean":"2024-09-19T12:03:14.999808+0000","last_became_active":"2024-09-19T11:35:31.609885+0000","last_became_peered":"2024-09-19T11:35:31.609885+0000","last_unstale":"2024-09-19T12:03:14.999808+0000","last_undegraded":"2024-09-19T12:03:14.999808+0000","last_fullsized":"2024-09-19T12:03:14.999808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-19T12:03:14.999554+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-19T12:03:14.999554+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.999554+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:58.998133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":83,"num_write":119,"num_write_kb":10337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'127","reported_seq":659,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.363258+0000","last_change":"2024-09-19T12:03:24.363258+0000","last_active":"2024-09-19T12:03:24.363258+0000","last_peered":"2024-09-19T12:03:24.363258+0000","last_clean":"2024-09-19T12:03:24.363258+0000","last_became_active":"2024-09-19T11:35:33.620326+0000","last_became_peered":"2024-09-19T11:35:33.620326+0000","last_unstale":"2024-09-19T12:03:24.363258+0000","last_undegraded":"2024-09-19T12:03:24.363258+0000","last_fullsized":"2024-09-19T12:03:24.363258+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-19T12:03:24.363078+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-19T12:03:24.363078+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.363078+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:58.950026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":393,"num_write":181,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'43","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.445831+0000","last_change":"2024-09-19T12:03:25.445831+0000","last_active":"2024-09-19T12:03:25.445831+0000","last_peered":"2024-09-19T12:03:25.445831+0000","last_clean":"2024-09-19T12:03:25.445831+0000","last_became_active":"2024-09-19T11:35:31.620566+0000","last_became_peered":"2024-09-19T11:35:31.620566+0000","last_unstale":"2024-09-19T12:03:25.445831+0000","last_undegraded":"2024-09-19T12:03:25.445831+0000","last_fullsized":"2024-09-19T12:03:25.445831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'43","last_scrub_stamp":"2024-09-19T12:03:25.445605+0000","last_deep_scrub":"264'43","last_deep_scrub_stamp":"2024-09-19T12:03:25.445605+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.445605+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:05.496684+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":90,"num_read_kb":69,"num_write":200,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'47","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:21.610388+0000","last_change":"2024-09-19T11:35:33.618657+0000","last_active":"2024-09-19T12:00:21.610388+0000","last_peered":"2024-09-19T12:00:21.610388+0000","last_clean":"2024-09-19T12:00:21.610388+0000","last_became_active":"2024-09-19T11:35:33.618247+0000","last_became_peered":"2024-09-19T11:35:33.618247+0000","last_unstale":"2024-09-19T12:00:21.610388+0000","last_undegraded":"2024-09-19T12:00:21.610388+0000","last_fullsized":"2024-09-19T12:00:21.610388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:16.980284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":141,"num_write":67,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'24","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.148668+0000","last_change":"2024-09-19T12:03:14.148668+0000","last_active":"2024-09-19T12:03:14.148668+0000","last_peered":"2024-09-19T12:03:14.148668+0000","last_clean":"2024-09-19T12:03:14.148668+0000","last_became_active":"2024-09-19T11:35:31.602248+0000","last_became_peered":"2024-09-19T11:35:31.602248+0000","last_unstale":"2024-09-19T12:03:14.148668+0000","last_undegraded":"2024-09-19T12:03:14.148668+0000","last_fullsized":"2024-09-19T12:03:14.148668+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-19T12:03:14.148443+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-19T12:03:14.148443+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.148443+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:22.593414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":5134,"num_write":78,"num_write_kb":5127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'37","reported_seq":559,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.417258+0000","last_change":"2024-09-19T12:03:24.417258+0000","last_active":"2024-09-19T12:03:24.417258+0000","last_peered":"2024-09-19T12:03:24.417258+0000","last_clean":"2024-09-19T12:03:24.417258+0000","last_became_active":"2024-09-19T11:35:33.624412+0000","last_became_peered":"2024-09-19T11:35:33.624412+0000","last_unstale":"2024-09-19T12:03:24.417258+0000","last_undegraded":"2024-09-19T12:03:24.417258+0000","last_fullsized":"2024-09-19T12:03:24.417258+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:24.417066+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:24.417066+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.417066+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:45.238270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":98,"num_write":42,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'30","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.465783+0000","last_change":"2024-09-19T12:03:20.465783+0000","last_active":"2024-09-19T12:03:20.465783+0000","last_peered":"2024-09-19T12:03:20.465783+0000","last_clean":"2024-09-19T12:03:20.465783+0000","last_became_active":"2024-09-19T11:35:31.607037+0000","last_became_peered":"2024-09-19T11:35:31.607037+0000","last_unstale":"2024-09-19T12:03:20.465783+0000","last_undegraded":"2024-09-19T12:03:20.465783+0000","last_fullsized":"2024-09-19T12:03:20.465783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-19T12:03:20.465565+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-19T12:03:20.465565+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.465565+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:53.230652+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":51,"num_read_kb":53,"num_write":115,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'42","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.451050+0000","last_change":"2024-09-19T12:03:21.451050+0000","last_active":"2024-09-19T12:03:21.451050+0000","last_peered":"2024-09-19T12:03:21.451050+0000","last_clean":"2024-09-19T12:03:21.451050+0000","last_became_active":"2024-09-19T11:35:31.607805+0000","last_became_peered":"2024-09-19T11:35:31.607805+0000","last_unstale":"2024-09-19T12:03:21.451050+0000","last_undegraded":"2024-09-19T12:03:21.451050+0000","last_fullsized":"2024-09-19T12:03:21.451050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-09-19T12:03:21.450834+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-09-19T12:03:21.450834+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.450834+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:38.340283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":66,"num_write":147,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.609215+0000","last_change":"2024-09-19T11:35:33.630383+0000","last_active":"2024-09-19T11:59:51.609215+0000","last_peered":"2024-09-19T11:59:51.609215+0000","last_clean":"2024-09-19T11:59:51.609215+0000","last_became_active":"2024-09-19T11:35:33.630100+0000","last_became_peered":"2024-09-19T11:35:33.630100+0000","last_unstale":"2024-09-19T11:59:51.609215+0000","last_undegraded":"2024-09-19T11:59:51.609215+0000","last_fullsized":"2024-09-19T11:59:51.609215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:23.578224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'27","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.640003+0000","last_change":"2024-09-19T12:03:14.640003+0000","last_active":"2024-09-19T12:03:14.640003+0000","last_peered":"2024-09-19T12:03:14.640003+0000","last_clean":"2024-09-19T12:03:14.640003+0000","last_became_active":"2024-09-19T11:35:31.588328+0000","last_became_peered":"2024-09-19T11:35:31.588328+0000","last_unstale":"2024-09-19T12:03:14.640003+0000","last_undegraded":"2024-09-19T12:03:14.640003+0000","last_fullsized":"2024-09-19T12:03:14.640003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-19T12:03:14.639761+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-19T12:03:14.639761+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.639761+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:57.221214+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":33,"num_write":109,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'232","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:43.939022+0000","last_change":"2024-09-19T11:35:33.612825+0000","last_active":"2024-09-19T12:01:43.939022+0000","last_peered":"2024-09-19T12:01:43.939022+0000","last_clean":"2024-09-19T12:01:43.939022+0000","last_became_active":"2024-09-19T11:35:33.612152+0000","last_became_peered":"2024-09-19T11:35:33.612152+0000","last_unstale":"2024-09-19T12:01:43.939022+0000","last_undegraded":"2024-09-19T12:01:43.939022+0000","last_fullsized":"2024-09-19T12:01:43.939022+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:32.567121+0000","last_clean_scrub_stamp":"2024-09-19T11:35:32.567121+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:31.538563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":962,"num_read_kb":742,"num_write":392,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1228,"num_read_kb":871,"num_write":344,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":8631,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2810,"num_read_kb":2559,"num_write":1797,"num_write_kb":496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":17262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":694,"ondisk_log_size":694,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":155085,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":4671,"num_read_kb":6549,"num_write":3033,"num_write_kb":1354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2096,"ondisk_log_size":2096,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2082,"num_read_kb":2479,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":14003,"num_read_kb":11442,"num_write":5494,"num_write_kb":2900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34993,"num_omap_keys":141,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2407,"ondisk_log_size":2407,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":28939990,"num_objects":275,"num_object_clones":0,"num_object_copies":1100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":275,"num_whiteouts":0,"num_read":5003,"num_read_kb":236980,"num_write":9889,"num_write_kb":271206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40419328,"data_stored":40419328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2792,"ondisk_log_size":2792,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":114698,"num_write":81,"num_write_kb":65538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":120842,"num_write":81,"num_write_kb":65538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542487,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202096,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94169744,"statfs":{"total":96636764160,"available":96429817856,"internally_reserved":0,"allocated":8683520,"data_stored":6718512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":198244810},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542486,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":204524,"kb_used_data":10908,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94167316,"statfs":{"total":96636764160,"available":96427331584,"internally_reserved":0,"allocated":11169792,"data_stored":9233803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":198244806},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542487,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58480,"kb_used_data":9248,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313360,"statfs":{"total":96636764160,"available":96576880640,"internally_reserved":0,"allocated":9469952,"data_stored":7492221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542489,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67420,"kb_used_data":9868,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94304420,"statfs":{"total":96636764160,"available":96567726080,"internally_reserved":0,"allocated":10104832,"data_stored":8206396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542487,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":186180,"kb_used_data":10612,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":94185660,"statfs":{"total":96636764160,"available":96446115840,"internally_reserved":0,"allocated":10866688,"data_stored":8917533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179763655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542487,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56652,"kb_used_data":7420,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94315188,"statfs":{"total":96636764160,"available":96578752512,"internally_reserved":0,"allocated":7598080,"data_stored":5684279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542486,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101400,"kb_used_data":7816,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94270440,"statfs":{"total":96636764160,"available":96532930560,"internally_reserved":0,"allocated":8003584,"data_stored":6065036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542488,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216504,"kb_used_data":9064,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94155336,"statfs":{"total":96636764160,"available":96415064064,"internally_reserved":0,"allocated":9281536,"data_stored":7337278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212400581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4489216,"data_stored":4489216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3809280,"data_stored":3809280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6660096,"data_stored":6660096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5951488,"data_stored":5951488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6975488,"data_stored":6975488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3870720,"data_stored":3870720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T12:03:33.152 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.152 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.152 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.152 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.153 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.153 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.153 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.153 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.153 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.154 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.154 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.154 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.154 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.154 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.155 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.155 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.155 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.155 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.155 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.155 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.156 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.156 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.157 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.157 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.157 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.157 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.158 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.158 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.158 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.158 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.158 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.158 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.159 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.159 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.159 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.159 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.159 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.159 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.160 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.160 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.160 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.160 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.160 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.160 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.161 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.161 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.161 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.161 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.161 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.161 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.162 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.162 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.162 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.162 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.162 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.162 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.163 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.163 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.163 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.163 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.163 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.163 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.164 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.164 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.164 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.164 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.164 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.164 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.165 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.165 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.165 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.165 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.165 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.166 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.166 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.166 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.166 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.168 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.169 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.169 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.169 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.169 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.169 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.169 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.170 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.170 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.170 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.170 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.171 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.171 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.171 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.171 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.171 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.171 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.172 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.172 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.172 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.172 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.172 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.173 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.173 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.173 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.173 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.173 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.174 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.174 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.174 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.174 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.174 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.174 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.175 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.175 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.175 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.175 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.175 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.176 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.176 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.176 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.176 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.176 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.176 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.177 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.177 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.177 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.177 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.177 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.177 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.178 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.178 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.178 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.178 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.178 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.178 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.179 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.179 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.179 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.179 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.179 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.179 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.180 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.180 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.180 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.180 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.180 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.181 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.181 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.181 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.181 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.181 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.182 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.182 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.182 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.182 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.182 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.182 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.183 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.183 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.183 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.183 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.183 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.184 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.184 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.184 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.184 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.184 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.185 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.185 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.185 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.185 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.185 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.185 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.186 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.186 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.186 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.186 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.186 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.187 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.187 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.187 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.187 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.187 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.187 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.188 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.188 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.188 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.188 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.188 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.188 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.189 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.189 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.189 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.189 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.189 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.190 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.190 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.190 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.190 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.190 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.190 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.191 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.191 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.191 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.191 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.191 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.191 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.192 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.192 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.192 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.192 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.192 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.192 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.193 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.193 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.193 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.193 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.193 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.193 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.194 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.194 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.194 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.194 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-19T11:35:34.579596+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.194 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-19T11:35:36.588203+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.194 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-19T11:35:38.617436+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.195 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.195 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.195 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.195 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.196 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.196 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.196 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-19T11:35:32.567121+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:33.196 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T12:03:53.198 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T12:03:53.565 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T12:03:53.576 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T12:03:53.585 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":1118,"stamp":"2024-09-19T12:03:53.416364+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29695886,"num_objects":525,"num_object_clones":0,"num_object_copies":1600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":525,"num_whiteouts":0,"num_read":30044,"num_read_kb":496475,"num_write":20844,"num_write_kb":408787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":86806,"num_omap_keys":274,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8679,"ondisk_log_size":8679,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1097416,"kb_used_data":73416,"kb_used_omap":12,"kb_used_meta":1023859,"kb_avail":753877304,"statfs":{"total":773094113280,"available":771970359296,"internally_reserved":0,"allocated":75177984,"data_stored":59655058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1048432176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30925,"num_omap_keys":78,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007892"},"pg_stats":[{"pgid":"67.1d","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:06.625128+0000","last_change":"2024-09-19T11:53:37.745334+0000","last_active":"2024-09-19T12:01:06.625128+0000","last_peered":"2024-09-19T12:01:06.625128+0000","last_clean":"2024-09-19T12:01:06.625128+0000","last_became_active":"2024-09-19T11:53:37.744679+0000","last_became_peered":"2024-09-19T11:53:37.744679+0000","last_unstale":"2024-09-19T12:01:06.625128+0000","last_undegraded":"2024-09-19T12:01:06.625128+0000","last_fullsized":"2024-09-19T12:01:06.625128+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:06.621027+0000","last_change":"2024-09-19T11:53:34.715828+0000","last_active":"2024-09-19T12:01:06.621027+0000","last_peered":"2024-09-19T12:01:06.621027+0000","last_clean":"2024-09-19T12:01:06.621027+0000","last_became_active":"2024-09-19T11:53:34.714946+0000","last_became_peered":"2024-09-19T11:53:34.714946+0000","last_unstale":"2024-09-19T12:01:06.621027+0000","last_undegraded":"2024-09-19T12:01:06.621027+0000","last_fullsized":"2024-09-19T12:01:06.621027+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"256'14","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.615105+0000","last_change":"2024-09-19T11:51:53.494561+0000","last_active":"2024-09-19T12:00:16.615105+0000","last_peered":"2024-09-19T12:00:16.615105+0000","last_clean":"2024-09-19T12:00:16.615105+0000","last_became_active":"2024-09-19T11:51:53.493294+0000","last_became_peered":"2024-09-19T11:51:53.493294+0000","last_unstale":"2024-09-19T12:00:16.615105+0000","last_undegraded":"2024-09-19T12:00:16.615105+0000","last_fullsized":"2024-09-19T12:00:16.615105+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:25.608106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":86,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:11.818669+0000","last_change":"2024-09-19T11:53:37.715171+0000","last_active":"2024-09-19T12:01:11.818669+0000","last_peered":"2024-09-19T12:01:11.818669+0000","last_clean":"2024-09-19T12:01:11.818669+0000","last_became_active":"2024-09-19T11:53:37.714526+0000","last_became_peered":"2024-09-19T11:53:37.714526+0000","last_unstale":"2024-09-19T12:01:11.818669+0000","last_undegraded":"2024-09-19T12:01:11.818669+0000","last_fullsized":"2024-09-19T12:01:11.818669+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.551513+0000","last_change":"2024-09-19T12:03:43.551513+0000","last_active":"2024-09-19T12:03:43.551513+0000","last_peered":"2024-09-19T12:03:43.551513+0000","last_clean":"2024-09-19T12:03:43.551513+0000","last_became_active":"2024-09-19T11:53:34.730025+0000","last_became_peered":"2024-09-19T11:53:34.730025+0000","last_unstale":"2024-09-19T12:03:43.551513+0000","last_undegraded":"2024-09-19T12:03:43.551513+0000","last_fullsized":"2024-09-19T12:03:43.551513+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:43.551340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:43.551340+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.551340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:33.497631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.262471+0000","last_change":"2024-09-19T12:03:33.262471+0000","last_active":"2024-09-19T12:03:33.262471+0000","last_peered":"2024-09-19T12:03:33.262471+0000","last_clean":"2024-09-19T12:03:33.262471+0000","last_became_active":"2024-09-19T11:51:53.494552+0000","last_became_peered":"2024-09-19T11:51:53.494552+0000","last_unstale":"2024-09-19T12:03:33.262471+0000","last_undegraded":"2024-09-19T12:03:33.262471+0000","last_fullsized":"2024-09-19T12:03:33.262471+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:33.262271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:33.262271+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.262271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:35.620518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.610306+0000","last_change":"2024-09-19T11:53:37.760242+0000","last_active":"2024-09-19T11:59:56.610306+0000","last_peered":"2024-09-19T11:59:56.610306+0000","last_clean":"2024-09-19T11:59:56.610306+0000","last_became_active":"2024-09-19T11:53:37.757767+0000","last_became_peered":"2024-09-19T11:53:37.757767+0000","last_unstale":"2024-09-19T11:59:56.610306+0000","last_undegraded":"2024-09-19T11:59:56.610306+0000","last_fullsized":"2024-09-19T11:59:56.610306+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:53:27.455399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.313102+0000","last_change":"2024-09-19T12:03:37.313102+0000","last_active":"2024-09-19T12:03:37.313102+0000","last_peered":"2024-09-19T12:03:37.313102+0000","last_clean":"2024-09-19T12:03:37.313102+0000","last_became_active":"2024-09-19T11:53:34.711510+0000","last_became_peered":"2024-09-19T11:53:34.711510+0000","last_unstale":"2024-09-19T12:03:37.313102+0000","last_undegraded":"2024-09-19T12:03:37.313102+0000","last_fullsized":"2024-09-19T12:03:37.313102+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:37.312882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:37.312882+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.312882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:58.227973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.603011+0000","last_change":"2024-09-19T11:51:53.480345+0000","last_active":"2024-09-19T11:59:26.603011+0000","last_peered":"2024-09-19T11:59:26.603011+0000","last_clean":"2024-09-19T11:59:26.603011+0000","last_became_active":"2024-09-19T11:51:53.479659+0000","last_became_peered":"2024-09-19T11:51:53.479659+0000","last_unstale":"2024-09-19T11:59:26.603011+0000","last_undegraded":"2024-09-19T11:59:26.603011+0000","last_fullsized":"2024-09-19T11:59:26.603011+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:02.230797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:41.628743+0000","last_change":"2024-09-19T11:53:37.758685+0000","last_active":"2024-09-19T12:01:41.628743+0000","last_peered":"2024-09-19T12:01:41.628743+0000","last_clean":"2024-09-19T12:01:41.628743+0000","last_became_active":"2024-09-19T11:53:37.756047+0000","last_became_peered":"2024-09-19T11:53:37.756047+0000","last_unstale":"2024-09-19T12:01:41.628743+0000","last_undegraded":"2024-09-19T12:01:41.628743+0000","last_fullsized":"2024-09-19T12:01:41.628743+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:56.828737+0000","last_change":"2024-09-19T11:53:34.706109+0000","last_active":"2024-09-19T12:01:56.828737+0000","last_peered":"2024-09-19T12:01:56.828737+0000","last_clean":"2024-09-19T12:01:56.828737+0000","last_became_active":"2024-09-19T11:53:34.705364+0000","last_became_peered":"2024-09-19T11:53:34.705364+0000","last_unstale":"2024-09-19T12:01:56.828737+0000","last_undegraded":"2024-09-19T12:01:56.828737+0000","last_fullsized":"2024-09-19T12:01:56.828737+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:58:24.677448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.597881+0000","last_change":"2024-09-19T11:51:53.477170+0000","last_active":"2024-09-19T11:59:26.597881+0000","last_peered":"2024-09-19T11:59:26.597881+0000","last_clean":"2024-09-19T11:59:26.597881+0000","last_became_active":"2024-09-19T11:51:53.475807+0000","last_became_peered":"2024-09-19T11:51:53.475807+0000","last_unstale":"2024-09-19T11:59:26.597881+0000","last_undegraded":"2024-09-19T11:59:26.597881+0000","last_fullsized":"2024-09-19T11:59:26.597881+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:44.084226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:56.622534+0000","last_change":"2024-09-19T11:53:37.733871+0000","last_active":"2024-09-19T12:00:56.622534+0000","last_peered":"2024-09-19T12:00:56.622534+0000","last_clean":"2024-09-19T12:00:56.622534+0000","last_became_active":"2024-09-19T11:53:37.733244+0000","last_became_peered":"2024-09-19T11:53:37.733244+0000","last_unstale":"2024-09-19T12:00:56.622534+0000","last_undegraded":"2024-09-19T12:00:56.622534+0000","last_fullsized":"2024-09-19T12:00:56.622534+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:51.623197+0000","last_change":"2024-09-19T11:53:34.723027+0000","last_active":"2024-09-19T12:00:51.623197+0000","last_peered":"2024-09-19T12:00:51.623197+0000","last_clean":"2024-09-19T12:00:51.623197+0000","last_became_active":"2024-09-19T11:53:34.722143+0000","last_became_peered":"2024-09-19T11:53:34.722143+0000","last_unstale":"2024-09-19T12:00:51.623197+0000","last_undegraded":"2024-09-19T12:00:51.623197+0000","last_fullsized":"2024-09-19T12:00:51.623197+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"256'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:26.597786+0000","last_change":"2024-09-19T11:51:53.497903+0000","last_active":"2024-09-19T11:59:26.597786+0000","last_peered":"2024-09-19T11:59:26.597786+0000","last_clean":"2024-09-19T11:59:26.597786+0000","last_became_active":"2024-09-19T11:51:53.496828+0000","last_became_peered":"2024-09-19T11:51:53.496828+0000","last_unstale":"2024-09-19T11:59:26.597786+0000","last_undegraded":"2024-09-19T11:59:26.597786+0000","last_fullsized":"2024-09-19T11:59:26.597786+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:33:53.888475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.18","version":"264'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:44.972777+0000","last_change":"2024-09-19T12:03:44.972777+0000","last_active":"2024-09-19T12:03:44.972777+0000","last_peered":"2024-09-19T12:03:44.972777+0000","last_clean":"2024-09-19T12:03:44.972777+0000","last_became_active":"2024-09-19T11:53:37.751550+0000","last_became_peered":"2024-09-19T11:53:37.751550+0000","last_unstale":"2024-09-19T12:03:44.972777+0000","last_undegraded":"2024-09-19T12:03:44.972777+0000","last_fullsized":"2024-09-19T12:03:44.972777+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:03:44.972596+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:03:44.972596+0000","last_clean_scrub_stamp":"2024-09-19T12:03:44.972596+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:02.344028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:51.270052+0000","last_change":"2024-09-19T12:03:51.270052+0000","last_active":"2024-09-19T12:03:51.270052+0000","last_peered":"2024-09-19T12:03:51.270052+0000","last_clean":"2024-09-19T12:03:51.270052+0000","last_became_active":"2024-09-19T11:53:34.699476+0000","last_became_peered":"2024-09-19T11:53:34.699476+0000","last_unstale":"2024-09-19T12:03:51.270052+0000","last_undegraded":"2024-09-19T12:03:51.270052+0000","last_fullsized":"2024-09-19T12:03:51.270052+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:51.269835+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:51.269835+0000","last_clean_scrub_stamp":"2024-09-19T12:03:51.269835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:58.899900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:40.015918+0000","last_change":"2024-09-19T12:03:40.015918+0000","last_active":"2024-09-19T12:03:40.015918+0000","last_peered":"2024-09-19T12:03:40.015918+0000","last_clean":"2024-09-19T12:03:40.015918+0000","last_became_active":"2024-09-19T11:51:53.468220+0000","last_became_peered":"2024-09-19T11:51:53.468220+0000","last_unstale":"2024-09-19T12:03:40.015918+0000","last_undegraded":"2024-09-19T12:03:40.015918+0000","last_fullsized":"2024-09-19T12:03:40.015918+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:40.015667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:40.015667+0000","last_clean_scrub_stamp":"2024-09-19T12:03:40.015667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:04.004534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:45.958155+0000","last_change":"2024-09-19T12:03:45.958155+0000","last_active":"2024-09-19T12:03:45.958155+0000","last_peered":"2024-09-19T12:03:45.958155+0000","last_clean":"2024-09-19T12:03:45.958155+0000","last_became_active":"2024-09-19T11:53:37.733461+0000","last_became_peered":"2024-09-19T11:53:37.733461+0000","last_unstale":"2024-09-19T12:03:45.958155+0000","last_undegraded":"2024-09-19T12:03:45.958155+0000","last_fullsized":"2024-09-19T12:03:45.958155+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:45.957980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:45.957980+0000","last_clean_scrub_stamp":"2024-09-19T12:03:45.957980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:40.128334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:06.817556+0000","last_change":"2024-09-19T11:53:34.711700+0000","last_active":"2024-09-19T12:01:06.817556+0000","last_peered":"2024-09-19T12:01:06.817556+0000","last_clean":"2024-09-19T12:01:06.817556+0000","last_became_active":"2024-09-19T11:53:34.711125+0000","last_became_peered":"2024-09-19T11:53:34.711125+0000","last_unstale":"2024-09-19T12:01:06.817556+0000","last_undegraded":"2024-09-19T12:01:06.817556+0000","last_fullsized":"2024-09-19T12:01:06.817556+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.599515+0000","last_change":"2024-09-19T11:51:53.498330+0000","last_active":"2024-09-19T11:59:11.599515+0000","last_peered":"2024-09-19T11:59:11.599515+0000","last_clean":"2024-09-19T11:59:11.599515+0000","last_became_active":"2024-09-19T11:51:53.497559+0000","last_became_peered":"2024-09-19T11:51:53.497559+0000","last_unstale":"2024-09-19T11:59:11.599515+0000","last_undegraded":"2024-09-19T11:59:11.599515+0000","last_fullsized":"2024-09-19T11:59:11.599515+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:57.123428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:11.621739+0000","last_change":"2024-09-19T11:53:37.760079+0000","last_active":"2024-09-19T12:01:11.621739+0000","last_peered":"2024-09-19T12:01:11.621739+0000","last_clean":"2024-09-19T12:01:11.621739+0000","last_became_active":"2024-09-19T11:53:37.759079+0000","last_became_peered":"2024-09-19T11:53:37.759079+0000","last_unstale":"2024-09-19T12:01:11.621739+0000","last_undegraded":"2024-09-19T12:01:11.621739+0000","last_fullsized":"2024-09-19T12:01:11.621739+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'8","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.726198+0000","last_change":"2024-09-19T11:53:34.732158+0000","last_active":"2024-09-19T12:03:05.726198+0000","last_peered":"2024-09-19T12:03:05.726198+0000","last_clean":"2024-09-19T12:03:05.726198+0000","last_became_active":"2024-09-19T11:53:34.722675+0000","last_became_peered":"2024-09-19T11:53:34.722675+0000","last_unstale":"2024-09-19T12:03:05.726198+0000","last_undegraded":"2024-09-19T12:03:05.726198+0000","last_fullsized":"2024-09-19T12:03:05.726198+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.568287+0000","last_change":"2024-09-19T12:03:38.568287+0000","last_active":"2024-09-19T12:03:38.568287+0000","last_peered":"2024-09-19T12:03:38.568287+0000","last_clean":"2024-09-19T12:03:38.568287+0000","last_became_active":"2024-09-19T11:51:53.485176+0000","last_became_peered":"2024-09-19T11:51:53.485176+0000","last_unstale":"2024-09-19T12:03:38.568287+0000","last_undegraded":"2024-09-19T12:03:38.568287+0000","last_fullsized":"2024-09-19T12:03:38.568287+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:38.568100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:38.568100+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.568100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:55.401799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:56.618658+0000","last_change":"2024-09-19T11:53:37.738229+0000","last_active":"2024-09-19T12:00:56.618658+0000","last_peered":"2024-09-19T12:00:56.618658+0000","last_clean":"2024-09-19T12:00:56.618658+0000","last_became_active":"2024-09-19T11:53:37.735681+0000","last_became_peered":"2024-09-19T11:53:37.735681+0000","last_unstale":"2024-09-19T12:00:56.618658+0000","last_undegraded":"2024-09-19T12:00:56.618658+0000","last_fullsized":"2024-09-19T12:00:56.618658+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.619176+0000","last_change":"2024-09-19T11:53:34.709295+0000","last_active":"2024-09-19T12:00:41.619176+0000","last_peered":"2024-09-19T12:00:41.619176+0000","last_clean":"2024-09-19T12:00:41.619176+0000","last_became_active":"2024-09-19T11:53:34.708831+0000","last_became_peered":"2024-09-19T11:53:34.708831+0000","last_unstale":"2024-09-19T12:00:41.619176+0000","last_undegraded":"2024-09-19T12:00:41.619176+0000","last_fullsized":"2024-09-19T12:00:41.619176+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:25.795767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:51.545370+0000","last_change":"2024-09-19T12:03:51.545370+0000","last_active":"2024-09-19T12:03:51.545370+0000","last_peered":"2024-09-19T12:03:51.545370+0000","last_clean":"2024-09-19T12:03:51.545370+0000","last_became_active":"2024-09-19T11:51:53.498327+0000","last_became_peered":"2024-09-19T11:51:53.498327+0000","last_unstale":"2024-09-19T12:03:51.545370+0000","last_undegraded":"2024-09-19T12:03:51.545370+0000","last_fullsized":"2024-09-19T12:03:51.545370+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:51.545193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:51.545193+0000","last_clean_scrub_stamp":"2024-09-19T12:03:51.545193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:49.395558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:41.615207+0000","last_change":"2024-09-19T11:53:37.755767+0000","last_active":"2024-09-19T12:00:41.615207+0000","last_peered":"2024-09-19T12:00:41.615207+0000","last_clean":"2024-09-19T12:00:41.615207+0000","last_became_active":"2024-09-19T11:53:37.754753+0000","last_became_peered":"2024-09-19T11:53:37.754753+0000","last_unstale":"2024-09-19T12:00:41.615207+0000","last_undegraded":"2024-09-19T12:00:41.615207+0000","last_fullsized":"2024-09-19T12:00:41.615207+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:22.955540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:51.624791+0000","last_change":"2024-09-19T11:53:34.720643+0000","last_active":"2024-09-19T12:00:51.624791+0000","last_peered":"2024-09-19T12:00:51.624791+0000","last_clean":"2024-09-19T12:00:51.624791+0000","last_became_active":"2024-09-19T11:53:34.720273+0000","last_became_peered":"2024-09-19T11:53:34.720273+0000","last_unstale":"2024-09-19T12:00:51.624791+0000","last_undegraded":"2024-09-19T12:00:51.624791+0000","last_fullsized":"2024-09-19T12:00:51.624791+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"255'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:11.594417+0000","last_change":"2024-09-19T11:51:53.497665+0000","last_active":"2024-09-19T11:59:11.594417+0000","last_peered":"2024-09-19T11:59:11.594417+0000","last_clean":"2024-09-19T11:59:11.594417+0000","last_became_active":"2024-09-19T11:51:53.496988+0000","last_became_peered":"2024-09-19T11:51:53.496988+0000","last_unstale":"2024-09-19T11:59:11.594417+0000","last_undegraded":"2024-09-19T11:59:11.594417+0000","last_fullsized":"2024-09-19T11:59:11.594417+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:42.583270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.17","version":"264'5","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.908508+0000","last_change":"2024-09-19T11:53:37.759921+0000","last_active":"2024-09-19T12:03:05.908508+0000","last_peered":"2024-09-19T12:03:05.908508+0000","last_clean":"2024-09-19T12:03:05.908508+0000","last_became_active":"2024-09-19T11:53:37.759275+0000","last_became_peered":"2024-09-19T11:53:37.759275+0000","last_unstale":"2024-09-19T12:03:05.908508+0000","last_undegraded":"2024-09-19T12:03:05.908508+0000","last_fullsized":"2024-09-19T12:03:05.908508+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.281180+0000","last_change":"2024-09-19T12:03:35.281180+0000","last_active":"2024-09-19T12:03:35.281180+0000","last_peered":"2024-09-19T12:03:35.281180+0000","last_clean":"2024-09-19T12:03:35.281180+0000","last_became_active":"2024-09-19T11:53:34.699437+0000","last_became_peered":"2024-09-19T11:53:34.699437+0000","last_unstale":"2024-09-19T12:03:35.281180+0000","last_undegraded":"2024-09-19T12:03:35.281180+0000","last_fullsized":"2024-09-19T12:03:35.281180+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:35.280997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:35.280997+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.280997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:37:37.064342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"256'23","reported_seq":108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.233008+0000","last_change":"2024-09-19T12:03:34.233008+0000","last_active":"2024-09-19T12:03:34.233008+0000","last_peered":"2024-09-19T12:03:34.233008+0000","last_clean":"2024-09-19T12:03:34.233008+0000","last_became_active":"2024-09-19T11:51:53.478643+0000","last_became_peered":"2024-09-19T11:51:53.478643+0000","last_unstale":"2024-09-19T12:03:34.233008+0000","last_undegraded":"2024-09-19T12:03:34.233008+0000","last_fullsized":"2024-09-19T12:03:34.233008+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'23","last_scrub_stamp":"2024-09-19T12:03:34.232755+0000","last_deep_scrub":"256'23","last_deep_scrub_stamp":"2024-09-19T12:03:34.232755+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.232755+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:36:04.255326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":169,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:56.815499+0000","last_change":"2024-09-19T11:53:37.737666+0000","last_active":"2024-09-19T12:00:56.815499+0000","last_peered":"2024-09-19T12:00:56.815499+0000","last_clean":"2024-09-19T12:00:56.815499+0000","last_became_active":"2024-09-19T11:53:37.737215+0000","last_became_peered":"2024-09-19T11:53:37.737215+0000","last_unstale":"2024-09-19T12:00:56.815499+0000","last_undegraded":"2024-09-19T12:00:56.815499+0000","last_fullsized":"2024-09-19T12:00:56.815499+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.894371+0000","last_change":"2024-09-19T11:53:34.732001+0000","last_active":"2024-09-19T12:03:05.894371+0000","last_peered":"2024-09-19T12:03:05.894371+0000","last_clean":"2024-09-19T12:03:05.894371+0000","last_became_active":"2024-09-19T11:53:34.723850+0000","last_became_peered":"2024-09-19T11:53:34.723850+0000","last_unstale":"2024-09-19T12:03:05.894371+0000","last_undegraded":"2024-09-19T12:03:05.894371+0000","last_fullsized":"2024-09-19T12:03:05.894371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:50.352671+0000","last_change":"2024-09-19T12:03:50.352671+0000","last_active":"2024-09-19T12:03:50.352671+0000","last_peered":"2024-09-19T12:03:50.352671+0000","last_clean":"2024-09-19T12:03:50.352671+0000","last_became_active":"2024-09-19T11:51:53.478922+0000","last_became_peered":"2024-09-19T11:51:53.478922+0000","last_unstale":"2024-09-19T12:03:50.352671+0000","last_undegraded":"2024-09-19T12:03:50.352671+0000","last_fullsized":"2024-09-19T12:03:50.352671+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:50.352486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:50.352486+0000","last_clean_scrub_stamp":"2024-09-19T12:03:50.352486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:56.678042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:46.440461+0000","last_change":"2024-09-19T12:03:46.440461+0000","last_active":"2024-09-19T12:03:46.440461+0000","last_peered":"2024-09-19T12:03:46.440461+0000","last_clean":"2024-09-19T12:03:46.440461+0000","last_became_active":"2024-09-19T11:53:37.734844+0000","last_became_peered":"2024-09-19T11:53:37.734844+0000","last_unstale":"2024-09-19T12:03:46.440461+0000","last_undegraded":"2024-09-19T12:03:46.440461+0000","last_fullsized":"2024-09-19T12:03:46.440461+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:46.440252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:46.440252+0000","last_clean_scrub_stamp":"2024-09-19T12:03:46.440252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:54.466305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:49.268280+0000","last_change":"2024-09-19T12:03:49.268280+0000","last_active":"2024-09-19T12:03:49.268280+0000","last_peered":"2024-09-19T12:03:49.268280+0000","last_clean":"2024-09-19T12:03:49.268280+0000","last_became_active":"2024-09-19T11:53:34.704150+0000","last_became_peered":"2024-09-19T11:53:34.704150+0000","last_unstale":"2024-09-19T12:03:49.268280+0000","last_undegraded":"2024-09-19T12:03:49.268280+0000","last_fullsized":"2024-09-19T12:03:49.268280+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:49.268075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:49.268075+0000","last_clean_scrub_stamp":"2024-09-19T12:03:49.268075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:34.835959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:49.367958+0000","last_change":"2024-09-19T12:03:49.367958+0000","last_active":"2024-09-19T12:03:49.367958+0000","last_peered":"2024-09-19T12:03:49.367958+0000","last_clean":"2024-09-19T12:03:49.367958+0000","last_became_active":"2024-09-19T11:51:53.481154+0000","last_became_peered":"2024-09-19T11:51:53.481154+0000","last_unstale":"2024-09-19T12:03:49.367958+0000","last_undegraded":"2024-09-19T12:03:49.367958+0000","last_fullsized":"2024-09-19T12:03:49.367958+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:49.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:49.367757+0000","last_clean_scrub_stamp":"2024-09-19T12:03:49.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:30.048796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:47.454122+0000","last_change":"2024-09-19T12:03:47.454122+0000","last_active":"2024-09-19T12:03:47.454122+0000","last_peered":"2024-09-19T12:03:47.454122+0000","last_clean":"2024-09-19T12:03:47.454122+0000","last_became_active":"2024-09-19T11:53:37.730152+0000","last_became_peered":"2024-09-19T11:53:37.730152+0000","last_unstale":"2024-09-19T12:03:47.454122+0000","last_undegraded":"2024-09-19T12:03:47.454122+0000","last_fullsized":"2024-09-19T12:03:47.454122+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:47.453929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:47.453929+0000","last_clean_scrub_stamp":"2024-09-19T12:03:47.453929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:03.891649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:36.613805+0000","last_change":"2024-09-19T11:53:34.704187+0000","last_active":"2024-09-19T12:00:36.613805+0000","last_peered":"2024-09-19T12:00:36.613805+0000","last_clean":"2024-09-19T12:00:36.613805+0000","last_became_active":"2024-09-19T11:53:34.703463+0000","last_became_peered":"2024-09-19T11:53:34.703463+0000","last_unstale":"2024-09-19T12:00:36.613805+0000","last_undegraded":"2024-09-19T12:00:36.613805+0000","last_fullsized":"2024-09-19T12:00:36.613805+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:19:28.756801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:16.628401+0000","last_change":"2024-09-19T11:51:53.491344+0000","last_active":"2024-09-19T12:01:16.628401+0000","last_peered":"2024-09-19T12:01:16.628401+0000","last_clean":"2024-09-19T12:01:16.628401+0000","last_became_active":"2024-09-19T11:51:53.490650+0000","last_became_peered":"2024-09-19T11:51:53.490650+0000","last_unstale":"2024-09-19T12:01:16.628401+0000","last_undegraded":"2024-09-19T12:01:16.628401+0000","last_fullsized":"2024-09-19T12:01:16.628401+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.711153+0000","last_change":"2024-09-19T11:53:37.759763+0000","last_active":"2024-09-19T12:03:05.711153+0000","last_peered":"2024-09-19T12:03:05.711153+0000","last_clean":"2024-09-19T12:03:05.711153+0000","last_became_active":"2024-09-19T11:53:37.755628+0000","last_became_peered":"2024-09-19T11:53:37.755628+0000","last_unstale":"2024-09-19T12:03:05.711153+0000","last_undegraded":"2024-09-19T12:03:05.711153+0000","last_fullsized":"2024-09-19T12:03:05.711153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:25.674366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5122,"num_write":10,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:42.024141+0000","last_change":"2024-09-19T12:03:42.024141+0000","last_active":"2024-09-19T12:03:42.024141+0000","last_peered":"2024-09-19T12:03:42.024141+0000","last_clean":"2024-09-19T12:03:42.024141+0000","last_became_active":"2024-09-19T11:53:34.707412+0000","last_became_peered":"2024-09-19T11:53:34.707412+0000","last_unstale":"2024-09-19T12:03:42.024141+0000","last_undegraded":"2024-09-19T12:03:42.024141+0000","last_fullsized":"2024-09-19T12:03:42.024141+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:42.023959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:42.023959+0000","last_clean_scrub_stamp":"2024-09-19T12:03:42.023959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:03.044262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"256'7","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:48.223729+0000","last_change":"2024-09-19T12:03:48.223729+0000","last_active":"2024-09-19T12:03:48.223729+0000","last_peered":"2024-09-19T12:03:48.223729+0000","last_clean":"2024-09-19T12:03:48.223729+0000","last_became_active":"2024-09-19T11:51:53.463784+0000","last_became_peered":"2024-09-19T11:51:53.463784+0000","last_unstale":"2024-09-19T12:03:48.223729+0000","last_undegraded":"2024-09-19T12:03:48.223729+0000","last_fullsized":"2024-09-19T12:03:48.223729+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-09-19T12:03:48.223529+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-09-19T12:03:48.223529+0000","last_clean_scrub_stamp":"2024-09-19T12:03:48.223529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:06.419307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.12","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.966483+0000","last_change":"2024-09-19T12:03:43.966483+0000","last_active":"2024-09-19T12:03:43.966483+0000","last_peered":"2024-09-19T12:03:43.966483+0000","last_clean":"2024-09-19T12:03:43.966483+0000","last_became_active":"2024-09-19T11:53:37.743807+0000","last_became_peered":"2024-09-19T11:53:37.743807+0000","last_unstale":"2024-09-19T12:03:43.966483+0000","last_undegraded":"2024-09-19T12:03:43.966483+0000","last_fullsized":"2024-09-19T12:03:43.966483+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:43.966296+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:43.966296+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.966296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:02.165260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:51.450211+0000","last_change":"2024-09-19T12:03:51.450211+0000","last_active":"2024-09-19T12:03:51.450211+0000","last_peered":"2024-09-19T12:03:51.450211+0000","last_clean":"2024-09-19T12:03:51.450211+0000","last_became_active":"2024-09-19T11:53:34.705705+0000","last_became_peered":"2024-09-19T11:53:34.705705+0000","last_unstale":"2024-09-19T12:03:51.450211+0000","last_undegraded":"2024-09-19T12:03:51.450211+0000","last_fullsized":"2024-09-19T12:03:51.450211+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:51.450030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:51.450030+0000","last_clean_scrub_stamp":"2024-09-19T12:03:51.450030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:41.504972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:16.622642+0000","last_change":"2024-09-19T11:51:53.488994+0000","last_active":"2024-09-19T12:01:16.622642+0000","last_peered":"2024-09-19T12:01:16.622642+0000","last_clean":"2024-09-19T12:01:16.622642+0000","last_became_active":"2024-09-19T11:51:53.488252+0000","last_became_peered":"2024-09-19T11:51:53.488252+0000","last_unstale":"2024-09-19T12:01:16.622642+0000","last_undegraded":"2024-09-19T12:01:16.622642+0000","last_fullsized":"2024-09-19T12:01:16.622642+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.551446+0000","last_change":"2024-09-19T11:53:37.755108+0000","last_active":"2024-09-19T12:03:05.551446+0000","last_peered":"2024-09-19T12:03:05.551446+0000","last_clean":"2024-09-19T12:03:05.551446+0000","last_became_active":"2024-09-19T11:53:37.754497+0000","last_became_peered":"2024-09-19T11:53:37.754497+0000","last_unstale":"2024-09-19T12:03:05.551446+0000","last_undegraded":"2024-09-19T12:03:05.551446+0000","last_fullsized":"2024-09-19T12:03:05.551446+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:38.404433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.886651+0000","last_change":"2024-09-19T11:53:34.721569+0000","last_active":"2024-09-19T12:03:05.886651+0000","last_peered":"2024-09-19T12:03:05.886651+0000","last_clean":"2024-09-19T12:03:05.886651+0000","last_became_active":"2024-09-19T11:53:34.721070+0000","last_became_peered":"2024-09-19T11:53:34.721070+0000","last_unstale":"2024-09-19T12:03:05.886651+0000","last_undegraded":"2024-09-19T12:03:05.886651+0000","last_fullsized":"2024-09-19T12:03:05.886651+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:11.145675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"256'23","reported_seq":108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:49.042366+0000","last_change":"2024-09-19T12:03:49.042366+0000","last_active":"2024-09-19T12:03:49.042366+0000","last_peered":"2024-09-19T12:03:49.042366+0000","last_clean":"2024-09-19T12:03:49.042366+0000","last_became_active":"2024-09-19T11:51:53.490074+0000","last_became_peered":"2024-09-19T11:51:53.490074+0000","last_unstale":"2024-09-19T12:03:49.042366+0000","last_undegraded":"2024-09-19T12:03:49.042366+0000","last_fullsized":"2024-09-19T12:03:49.042366+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'23","last_scrub_stamp":"2024-09-19T12:03:49.042156+0000","last_deep_scrub":"256'23","last_deep_scrub_stamp":"2024-09-19T12:03:49.042156+0000","last_clean_scrub_stamp":"2024-09-19T12:03:49.042156+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:54.883981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":156,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611634+0000","last_change":"2024-09-19T11:53:37.759926+0000","last_active":"2024-09-19T12:00:26.611634+0000","last_peered":"2024-09-19T12:00:26.611634+0000","last_clean":"2024-09-19T12:00:26.611634+0000","last_became_active":"2024-09-19T11:53:37.758965+0000","last_became_peered":"2024-09-19T11:53:37.758965+0000","last_unstale":"2024-09-19T12:00:26.611634+0000","last_undegraded":"2024-09-19T12:00:26.611634+0000","last_fullsized":"2024-09-19T12:00:26.611634+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:35.768438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.292593+0000","last_change":"2024-09-19T12:03:38.292593+0000","last_active":"2024-09-19T12:03:38.292593+0000","last_peered":"2024-09-19T12:03:38.292593+0000","last_clean":"2024-09-19T12:03:38.292593+0000","last_became_active":"2024-09-19T11:53:34.729772+0000","last_became_peered":"2024-09-19T11:53:34.729772+0000","last_unstale":"2024-09-19T12:03:38.292593+0000","last_undegraded":"2024-09-19T12:03:38.292593+0000","last_fullsized":"2024-09-19T12:03:38.292593+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:38.292417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:38.292417+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.292417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:06.132371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:49.481052+0000","last_change":"2024-09-19T12:03:49.481052+0000","last_active":"2024-09-19T12:03:49.481052+0000","last_peered":"2024-09-19T12:03:49.481052+0000","last_clean":"2024-09-19T12:03:49.481052+0000","last_became_active":"2024-09-19T11:51:53.479490+0000","last_became_peered":"2024-09-19T11:51:53.479490+0000","last_unstale":"2024-09-19T12:03:49.481052+0000","last_undegraded":"2024-09-19T12:03:49.481052+0000","last_fullsized":"2024-09-19T12:03:49.481052+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-19T12:03:49.480796+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-19T12:03:49.480796+0000","last_clean_scrub_stamp":"2024-09-19T12:03:49.480796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:59.372923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:45.460538+0000","last_change":"2024-09-19T12:03:45.460538+0000","last_active":"2024-09-19T12:03:45.460538+0000","last_peered":"2024-09-19T12:03:45.460538+0000","last_clean":"2024-09-19T12:03:45.460538+0000","last_became_active":"2024-09-19T11:53:37.730671+0000","last_became_peered":"2024-09-19T11:53:37.730671+0000","last_unstale":"2024-09-19T12:03:45.460538+0000","last_undegraded":"2024-09-19T12:03:45.460538+0000","last_fullsized":"2024-09-19T12:03:45.460538+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:45.460355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:45.460355+0000","last_clean_scrub_stamp":"2024-09-19T12:03:45.460355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:21.052784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'5","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.892067+0000","last_change":"2024-09-19T11:53:34.722175+0000","last_active":"2024-09-19T12:03:05.892067+0000","last_peered":"2024-09-19T12:03:05.892067+0000","last_clean":"2024-09-19T12:03:05.892067+0000","last_became_active":"2024-09-19T11:53:34.720160+0000","last_became_peered":"2024-09-19T11:53:34.720160+0000","last_unstale":"2024-09-19T12:03:05.892067+0000","last_undegraded":"2024-09-19T12:03:05.892067+0000","last_fullsized":"2024-09-19T12:03:05.892067+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:52:58.935663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:39.043936+0000","last_change":"2024-09-19T12:03:39.043936+0000","last_active":"2024-09-19T12:03:39.043936+0000","last_peered":"2024-09-19T12:03:39.043936+0000","last_clean":"2024-09-19T12:03:39.043936+0000","last_became_active":"2024-09-19T11:51:53.483786+0000","last_became_peered":"2024-09-19T11:51:53.483786+0000","last_unstale":"2024-09-19T12:03:39.043936+0000","last_undegraded":"2024-09-19T12:03:39.043936+0000","last_fullsized":"2024-09-19T12:03:39.043936+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:39.043729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:39.043729+0000","last_clean_scrub_stamp":"2024-09-19T12:03:39.043729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:52.152922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:26.611748+0000","last_change":"2024-09-19T11:53:37.745246+0000","last_active":"2024-09-19T12:00:26.611748+0000","last_peered":"2024-09-19T12:00:26.611748+0000","last_clean":"2024-09-19T12:00:26.611748+0000","last_became_active":"2024-09-19T11:53:37.739838+0000","last_became_peered":"2024-09-19T11:53:37.739838+0000","last_unstale":"2024-09-19T12:00:26.611748+0000","last_undegraded":"2024-09-19T12:00:26.611748+0000","last_fullsized":"2024-09-19T12:00:26.611748+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:07.343317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:42.599118+0000","last_change":"2024-09-19T12:03:42.599118+0000","last_active":"2024-09-19T12:03:42.599118+0000","last_peered":"2024-09-19T12:03:42.599118+0000","last_clean":"2024-09-19T12:03:42.599118+0000","last_became_active":"2024-09-19T11:53:34.708542+0000","last_became_peered":"2024-09-19T11:53:34.708542+0000","last_unstale":"2024-09-19T12:03:42.599118+0000","last_undegraded":"2024-09-19T12:03:42.599118+0000","last_fullsized":"2024-09-19T12:03:42.599118+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:42.598902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:42.598902+0000","last_clean_scrub_stamp":"2024-09-19T12:03:42.598902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:58.103214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.231321+0000","last_change":"2024-09-19T12:03:32.231321+0000","last_active":"2024-09-19T12:03:32.231321+0000","last_peered":"2024-09-19T12:03:32.231321+0000","last_clean":"2024-09-19T12:03:32.231321+0000","last_became_active":"2024-09-19T11:51:53.478940+0000","last_became_peered":"2024-09-19T11:51:53.478940+0000","last_unstale":"2024-09-19T12:03:32.231321+0000","last_undegraded":"2024-09-19T12:03:32.231321+0000","last_fullsized":"2024-09-19T12:03:32.231321+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:32.231148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:32.231148+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.231148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:11.191687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.9","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.904415+0000","last_change":"2024-09-19T11:54:08.215698+0000","last_active":"2024-09-19T12:03:05.904415+0000","last_peered":"2024-09-19T12:03:05.904415+0000","last_clean":"2024-09-19T12:03:05.904415+0000","last_became_active":"2024-09-19T11:54:08.143092+0000","last_became_peered":"2024-09-19T11:54:08.143092+0000","last_unstale":"2024-09-19T12:03:05.904415+0000","last_undegraded":"2024-09-19T12:03:05.904415+0000","last_fullsized":"2024-09-19T12:03:05.904415+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:06.545326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.612462+0000","last_change":"2024-09-19T11:53:34.723264+0000","last_active":"2024-09-19T12:00:06.612462+0000","last_peered":"2024-09-19T12:00:06.612462+0000","last_clean":"2024-09-19T12:00:06.612462+0000","last_became_active":"2024-09-19T11:53:34.722786+0000","last_became_peered":"2024-09-19T11:53:34.722786+0000","last_unstale":"2024-09-19T12:00:06.612462+0000","last_undegraded":"2024-09-19T12:00:06.612462+0000","last_fullsized":"2024-09-19T12:00:06.612462+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:25:14.671300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:49.533251+0000","last_change":"2024-09-19T12:03:49.533251+0000","last_active":"2024-09-19T12:03:49.533251+0000","last_peered":"2024-09-19T12:03:49.533251+0000","last_clean":"2024-09-19T12:03:49.533251+0000","last_became_active":"2024-09-19T11:51:53.490467+0000","last_became_peered":"2024-09-19T11:51:53.490467+0000","last_unstale":"2024-09-19T12:03:49.533251+0000","last_undegraded":"2024-09-19T12:03:49.533251+0000","last_fullsized":"2024-09-19T12:03:49.533251+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:49.533069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:49.533069+0000","last_clean_scrub_stamp":"2024-09-19T12:03:49.533069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:56:07.858245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.615854+0000","last_change":"2024-09-19T11:53:37.739452+0000","last_active":"2024-09-19T12:00:11.615854+0000","last_peered":"2024-09-19T12:00:11.615854+0000","last_clean":"2024-09-19T12:00:11.615854+0000","last_became_active":"2024-09-19T11:53:37.738652+0000","last_became_peered":"2024-09-19T11:53:37.738652+0000","last_unstale":"2024-09-19T12:00:11.615854+0000","last_undegraded":"2024-09-19T12:00:11.615854+0000","last_fullsized":"2024-09-19T12:00:11.615854+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.598691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:41.611867+0000","last_change":"2024-09-19T12:03:41.611867+0000","last_active":"2024-09-19T12:03:41.611867+0000","last_peered":"2024-09-19T12:03:41.611867+0000","last_clean":"2024-09-19T12:03:41.611867+0000","last_became_active":"2024-09-19T11:53:34.708971+0000","last_became_peered":"2024-09-19T11:53:34.708971+0000","last_unstale":"2024-09-19T12:03:41.611867+0000","last_undegraded":"2024-09-19T12:03:41.611867+0000","last_fullsized":"2024-09-19T12:03:41.611867+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:41.611645+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:41.611645+0000","last_clean_scrub_stamp":"2024-09-19T12:03:41.611645+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:33.776492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"256'7","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:48.323918+0000","last_change":"2024-09-19T12:03:48.323918+0000","last_active":"2024-09-19T12:03:48.323918+0000","last_peered":"2024-09-19T12:03:48.323918+0000","last_clean":"2024-09-19T12:03:48.323918+0000","last_became_active":"2024-09-19T11:51:53.481429+0000","last_became_peered":"2024-09-19T11:51:53.481429+0000","last_unstale":"2024-09-19T12:03:48.323918+0000","last_undegraded":"2024-09-19T12:03:48.323918+0000","last_fullsized":"2024-09-19T12:03:48.323918+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-09-19T12:03:48.323654+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-09-19T12:03:48.323654+0000","last_clean_scrub_stamp":"2024-09-19T12:03:48.323654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:38.951037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":44,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:48.438733+0000","last_change":"2024-09-19T12:03:48.438733+0000","last_active":"2024-09-19T12:03:48.438733+0000","last_peered":"2024-09-19T12:03:48.438733+0000","last_clean":"2024-09-19T12:03:48.438733+0000","last_became_active":"2024-09-19T11:53:37.742403+0000","last_became_peered":"2024-09-19T11:53:37.742403+0000","last_unstale":"2024-09-19T12:03:48.438733+0000","last_undegraded":"2024-09-19T12:03:48.438733+0000","last_fullsized":"2024-09-19T12:03:48.438733+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:48.438549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:48.438549+0000","last_clean_scrub_stamp":"2024-09-19T12:03:48.438549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:05.247713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.612531+0000","last_change":"2024-09-19T11:53:34.731804+0000","last_active":"2024-09-19T12:00:06.612531+0000","last_peered":"2024-09-19T12:00:06.612531+0000","last_clean":"2024-09-19T12:00:06.612531+0000","last_became_active":"2024-09-19T11:53:34.728959+0000","last_became_peered":"2024-09-19T11:53:34.728959+0000","last_unstale":"2024-09-19T12:00:06.612531+0000","last_undegraded":"2024-09-19T12:00:06.612531+0000","last_fullsized":"2024-09-19T12:00:06.612531+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:26.270496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:51.096510+0000","last_change":"2024-09-19T12:03:51.096510+0000","last_active":"2024-09-19T12:03:51.096510+0000","last_peered":"2024-09-19T12:03:51.096510+0000","last_clean":"2024-09-19T12:03:51.096510+0000","last_became_active":"2024-09-19T11:51:53.472485+0000","last_became_peered":"2024-09-19T11:51:53.472485+0000","last_unstale":"2024-09-19T12:03:51.096510+0000","last_undegraded":"2024-09-19T12:03:51.096510+0000","last_fullsized":"2024-09-19T12:03:51.096510+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:51.096323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:51.096323+0000","last_clean_scrub_stamp":"2024-09-19T12:03:51.096323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:45.804648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.615948+0000","last_change":"2024-09-19T11:53:37.737715+0000","last_active":"2024-09-19T12:00:11.615948+0000","last_peered":"2024-09-19T12:00:11.615948+0000","last_clean":"2024-09-19T12:00:11.615948+0000","last_became_active":"2024-09-19T11:53:37.736772+0000","last_became_peered":"2024-09-19T11:53:37.736772+0000","last_unstale":"2024-09-19T12:00:11.615948+0000","last_undegraded":"2024-09-19T12:00:11.615948+0000","last_fullsized":"2024-09-19T12:00:11.615948+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:02.929650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'6","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:50.232013+0000","last_change":"2024-09-19T12:03:50.232013+0000","last_active":"2024-09-19T12:03:50.232013+0000","last_peered":"2024-09-19T12:03:50.232013+0000","last_clean":"2024-09-19T12:03:50.232013+0000","last_became_active":"2024-09-19T11:53:34.711382+0000","last_became_peered":"2024-09-19T11:53:34.711382+0000","last_unstale":"2024-09-19T12:03:50.232013+0000","last_undegraded":"2024-09-19T12:03:50.232013+0000","last_fullsized":"2024-09-19T12:03:50.232013+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-19T12:03:50.231802+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-19T12:03:50.231802+0000","last_clean_scrub_stamp":"2024-09-19T12:03:50.231802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:37.412347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.013559+0000","last_change":"2024-09-19T12:03:38.013559+0000","last_active":"2024-09-19T12:03:38.013559+0000","last_peered":"2024-09-19T12:03:38.013559+0000","last_clean":"2024-09-19T12:03:38.013559+0000","last_became_active":"2024-09-19T11:51:53.486236+0000","last_became_peered":"2024-09-19T11:51:53.486236+0000","last_unstale":"2024-09-19T12:03:38.013559+0000","last_undegraded":"2024-09-19T12:03:38.013559+0000","last_fullsized":"2024-09-19T12:03:38.013559+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:38.013314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:38.013314+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.013314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:45.542318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:56.610219+0000","last_change":"2024-09-19T11:53:37.747251+0000","last_active":"2024-09-19T11:59:56.610219+0000","last_peered":"2024-09-19T11:59:56.610219+0000","last_clean":"2024-09-19T11:59:56.610219+0000","last_became_active":"2024-09-19T11:53:37.745076+0000","last_became_peered":"2024-09-19T11:53:37.745076+0000","last_unstale":"2024-09-19T11:59:56.610219+0000","last_undegraded":"2024-09-19T11:59:56.610219+0000","last_fullsized":"2024-09-19T11:59:56.610219+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:16.840839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.611669+0000","last_change":"2024-09-19T11:53:34.720400+0000","last_active":"2024-09-19T11:59:51.611669+0000","last_peered":"2024-09-19T11:59:51.611669+0000","last_clean":"2024-09-19T11:59:51.611669+0000","last_became_active":"2024-09-19T11:53:34.719535+0000","last_became_peered":"2024-09-19T11:53:34.719535+0000","last_unstale":"2024-09-19T11:59:51.611669+0000","last_undegraded":"2024-09-19T11:59:51.611669+0000","last_fullsized":"2024-09-19T11:59:51.611669+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:53.909023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'11","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:50.560507+0000","last_change":"2024-09-19T12:03:50.560507+0000","last_active":"2024-09-19T12:03:50.560507+0000","last_peered":"2024-09-19T12:03:50.560507+0000","last_clean":"2024-09-19T12:03:50.560507+0000","last_became_active":"2024-09-19T11:51:53.486126+0000","last_became_peered":"2024-09-19T11:51:53.486126+0000","last_unstale":"2024-09-19T12:03:50.560507+0000","last_undegraded":"2024-09-19T12:03:50.560507+0000","last_fullsized":"2024-09-19T12:03:50.560507+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'11","last_scrub_stamp":"2024-09-19T12:03:50.560199+0000","last_deep_scrub":"262'11","last_deep_scrub_stamp":"2024-09-19T12:03:50.560199+0000","last_clean_scrub_stamp":"2024-09-19T12:03:50.560199+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:38.281640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":56,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:01.639128+0000","last_change":"2024-09-19T11:53:37.749405+0000","last_active":"2024-09-19T12:02:01.639128+0000","last_peered":"2024-09-19T12:02:01.639128+0000","last_clean":"2024-09-19T12:02:01.639128+0000","last_became_active":"2024-09-19T11:53:37.748479+0000","last_became_peered":"2024-09-19T11:53:37.748479+0000","last_unstale":"2024-09-19T12:02:01.639128+0000","last_undegraded":"2024-09-19T12:02:01.639128+0000","last_fullsized":"2024-09-19T12:02:01.639128+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:55.422274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.317457+0000","last_change":"2024-09-19T12:03:36.317457+0000","last_active":"2024-09-19T12:03:36.317457+0000","last_peered":"2024-09-19T12:03:36.317457+0000","last_clean":"2024-09-19T12:03:36.317457+0000","last_became_active":"2024-09-19T11:53:34.721421+0000","last_became_peered":"2024-09-19T11:53:34.721421+0000","last_unstale":"2024-09-19T12:03:36.317457+0000","last_undegraded":"2024-09-19T12:03:36.317457+0000","last_fullsized":"2024-09-19T12:03:36.317457+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:36.317280+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:36.317280+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.317280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:29.816352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.059227+0000","last_change":"2024-09-19T12:03:37.059227+0000","last_active":"2024-09-19T12:03:37.059227+0000","last_peered":"2024-09-19T12:03:37.059227+0000","last_clean":"2024-09-19T12:03:37.059227+0000","last_became_active":"2024-09-19T11:51:53.468768+0000","last_became_peered":"2024-09-19T11:51:53.468768+0000","last_unstale":"2024-09-19T12:03:37.059227+0000","last_undegraded":"2024-09-19T12:03:37.059227+0000","last_fullsized":"2024-09-19T12:03:37.059227+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:37.059042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:37.059042+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.059042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:38.709192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:11.616066+0000","last_change":"2024-09-19T11:53:37.749695+0000","last_active":"2024-09-19T12:00:11.616066+0000","last_peered":"2024-09-19T12:00:11.616066+0000","last_clean":"2024-09-19T12:00:11.616066+0000","last_became_active":"2024-09-19T11:53:37.749246+0000","last_became_peered":"2024-09-19T11:53:37.749246+0000","last_unstale":"2024-09-19T12:00:11.616066+0000","last_undegraded":"2024-09-19T12:00:11.616066+0000","last_fullsized":"2024-09-19T12:00:11.616066+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:35.006918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:50.447545+0000","last_change":"2024-09-19T12:03:50.447545+0000","last_active":"2024-09-19T12:03:50.447545+0000","last_peered":"2024-09-19T12:03:50.447545+0000","last_clean":"2024-09-19T12:03:50.447545+0000","last_became_active":"2024-09-19T11:53:34.702356+0000","last_became_peered":"2024-09-19T11:53:34.702356+0000","last_unstale":"2024-09-19T12:03:50.447545+0000","last_undegraded":"2024-09-19T12:03:50.447545+0000","last_fullsized":"2024-09-19T12:03:50.447545+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:50.447358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:50.447358+0000","last_clean_scrub_stamp":"2024-09-19T12:03:50.447358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:01:51.589624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:47.346556+0000","last_change":"2024-09-19T12:03:47.346556+0000","last_active":"2024-09-19T12:03:47.346556+0000","last_peered":"2024-09-19T12:03:47.346556+0000","last_clean":"2024-09-19T12:03:47.346556+0000","last_became_active":"2024-09-19T11:51:53.483350+0000","last_became_peered":"2024-09-19T11:51:53.483350+0000","last_unstale":"2024-09-19T12:03:47.346556+0000","last_undegraded":"2024-09-19T12:03:47.346556+0000","last_fullsized":"2024-09-19T12:03:47.346556+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-19T12:03:47.346332+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-19T12:03:47.346332+0000","last_clean_scrub_stamp":"2024-09-19T12:03:47.346332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:12.872441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"264'9","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.872856+0000","last_change":"2024-09-19T11:53:37.731037+0000","last_active":"2024-09-19T12:03:05.872856+0000","last_peered":"2024-09-19T12:03:05.872856+0000","last_clean":"2024-09-19T12:03:05.872856+0000","last_became_active":"2024-09-19T11:53:37.730641+0000","last_became_peered":"2024-09-19T11:53:37.730641+0000","last_unstale":"2024-09-19T12:03:05.872856+0000","last_undegraded":"2024-09-19T12:03:05.872856+0000","last_fullsized":"2024-09-19T12:03:05.872856+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:40.518527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15360,"num_write":14,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:06.614943+0000","last_change":"2024-09-19T11:53:34.719873+0000","last_active":"2024-09-19T12:00:06.614943+0000","last_peered":"2024-09-19T12:00:06.614943+0000","last_clean":"2024-09-19T12:00:06.614943+0000","last_became_active":"2024-09-19T11:53:34.719193+0000","last_became_peered":"2024-09-19T11:53:34.719193+0000","last_unstale":"2024-09-19T12:00:06.614943+0000","last_undegraded":"2024-09-19T12:00:06.614943+0000","last_fullsized":"2024-09-19T12:00:06.614943+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:17.922208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"256'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:40.584176+0000","last_change":"2024-09-19T12:03:40.584176+0000","last_active":"2024-09-19T12:03:40.584176+0000","last_peered":"2024-09-19T12:03:40.584176+0000","last_clean":"2024-09-19T12:03:40.584176+0000","last_became_active":"2024-09-19T11:51:53.476953+0000","last_became_peered":"2024-09-19T11:51:53.476953+0000","last_unstale":"2024-09-19T12:03:40.584176+0000","last_undegraded":"2024-09-19T12:03:40.584176+0000","last_fullsized":"2024-09-19T12:03:40.584176+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-09-19T12:03:40.583951+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-09-19T12:03:40.583951+0000","last_clean_scrub_stamp":"2024-09-19T12:03:40.583951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:33.938684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:44.505238+0000","last_change":"2024-09-19T12:03:44.505238+0000","last_active":"2024-09-19T12:03:44.505238+0000","last_peered":"2024-09-19T12:03:44.505238+0000","last_clean":"2024-09-19T12:03:44.505238+0000","last_became_active":"2024-09-19T11:53:37.731400+0000","last_became_peered":"2024-09-19T11:53:37.731400+0000","last_unstale":"2024-09-19T12:03:44.505238+0000","last_undegraded":"2024-09-19T12:03:44.505238+0000","last_fullsized":"2024-09-19T12:03:44.505238+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:44.505046+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:44.505046+0000","last_clean_scrub_stamp":"2024-09-19T12:03:44.505046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:40:13.866952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:51.387191+0000","last_change":"2024-09-19T12:03:51.387191+0000","last_active":"2024-09-19T12:03:51.387191+0000","last_peered":"2024-09-19T12:03:51.387191+0000","last_clean":"2024-09-19T12:03:51.387191+0000","last_became_active":"2024-09-19T11:53:34.724406+0000","last_became_peered":"2024-09-19T11:53:34.724406+0000","last_unstale":"2024-09-19T12:03:51.387191+0000","last_undegraded":"2024-09-19T12:03:51.387191+0000","last_fullsized":"2024-09-19T12:03:51.387191+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:03:51.387002+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:03:51.387002+0000","last_clean_scrub_stamp":"2024-09-19T12:03:51.387002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:35.816920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":21506,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:48.431585+0000","last_change":"2024-09-19T12:03:48.431585+0000","last_active":"2024-09-19T12:03:48.431585+0000","last_peered":"2024-09-19T12:03:48.431585+0000","last_clean":"2024-09-19T12:03:48.431585+0000","last_became_active":"2024-09-19T11:51:53.494443+0000","last_became_peered":"2024-09-19T11:51:53.494443+0000","last_unstale":"2024-09-19T12:03:48.431585+0000","last_undegraded":"2024-09-19T12:03:48.431585+0000","last_fullsized":"2024-09-19T12:03:48.431585+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:48.431404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:48.431404+0000","last_clean_scrub_stamp":"2024-09-19T12:03:48.431404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:09:11.896738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.0","version":"264'2","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:05.938321+0000","last_change":"2024-09-19T11:53:37.729810+0000","last_active":"2024-09-19T12:03:05.938321+0000","last_peered":"2024-09-19T12:03:05.938321+0000","last_clean":"2024-09-19T12:03:05.938321+0000","last_became_active":"2024-09-19T11:53:37.729101+0000","last_became_peered":"2024-09-19T11:53:37.729101+0000","last_unstale":"2024-09-19T12:03:05.938321+0000","last_undegraded":"2024-09-19T12:03:05.938321+0000","last_fullsized":"2024-09-19T12:03:05.938321+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'3","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:56.639147+0000","last_change":"2024-09-19T11:53:34.719029+0000","last_active":"2024-09-19T12:01:56.639147+0000","last_peered":"2024-09-19T12:01:56.639147+0000","last_clean":"2024-09-19T12:01:56.639147+0000","last_became_active":"2024-09-19T11:53:34.715905+0000","last_became_peered":"2024-09-19T11:53:34.715905+0000","last_unstale":"2024-09-19T12:01:56.639147+0000","last_undegraded":"2024-09-19T12:01:56.639147+0000","last_fullsized":"2024-09-19T12:01:56.639147+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:33.651081+0000","last_clean_scrub_stamp":"2024-09-19T11:53:33.651081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:06.085056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:00:16.806309+0000","last_change":"2024-09-19T11:51:53.485332+0000","last_active":"2024-09-19T12:00:16.806309+0000","last_peered":"2024-09-19T12:00:16.806309+0000","last_clean":"2024-09-19T12:00:16.806309+0000","last_became_active":"2024-09-19T11:51:53.479975+0000","last_became_peered":"2024-09-19T11:51:53.479975+0000","last_unstale":"2024-09-19T12:00:16.806309+0000","last_undegraded":"2024-09-19T12:00:16.806309+0000","last_fullsized":"2024-09-19T12:00:16.806309+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:51:52.426742+0000","last_clean_scrub_stamp":"2024-09-19T11:51:52.426742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:54.383913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.012104+0000","last_change":"2024-09-19T12:03:43.012104+0000","last_active":"2024-09-19T12:03:43.012104+0000","last_peered":"2024-09-19T12:03:43.012104+0000","last_clean":"2024-09-19T12:03:43.012104+0000","last_became_active":"2024-09-19T11:53:37.751835+0000","last_became_peered":"2024-09-19T11:53:37.751835+0000","last_unstale":"2024-09-19T12:03:43.012104+0000","last_undegraded":"2024-09-19T12:03:43.012104+0000","last_fullsized":"2024-09-19T12:03:43.012104+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:43.011892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:43.011892+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.011892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:30.578950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:39.595598+0000","last_change":"2024-09-19T12:03:39.595598+0000","last_active":"2024-09-19T12:03:39.595598+0000","last_peered":"2024-09-19T12:03:39.595598+0000","last_clean":"2024-09-19T12:03:39.595598+0000","last_became_active":"2024-09-19T11:53:34.721659+0000","last_became_peered":"2024-09-19T11:53:34.721659+0000","last_unstale":"2024-09-19T12:03:39.595598+0000","last_undegraded":"2024-09-19T12:03:39.595598+0000","last_fullsized":"2024-09-19T12:03:39.595598+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:39.595416+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:39.595416+0000","last_clean_scrub_stamp":"2024-09-19T12:03:39.595416+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:56.599619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.093403+0000","last_change":"2024-09-19T12:03:36.093403+0000","last_active":"2024-09-19T12:03:36.093403+0000","last_peered":"2024-09-19T12:03:36.093403+0000","last_clean":"2024-09-19T12:03:36.093403+0000","last_became_active":"2024-09-19T11:51:53.487416+0000","last_became_peered":"2024-09-19T11:51:53.487416+0000","last_unstale":"2024-09-19T12:03:36.093403+0000","last_undegraded":"2024-09-19T12:03:36.093403+0000","last_fullsized":"2024-09-19T12:03:36.093403+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-19T12:03:36.093200+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-19T12:03:36.093200+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.093200+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:15.847965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"264'3","reported_seq":26,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:02:01.829672+0000","last_change":"2024-09-19T11:53:37.722872+0000","last_active":"2024-09-19T12:02:01.829672+0000","last_peered":"2024-09-19T12:02:01.829672+0000","last_clean":"2024-09-19T12:02:01.829672+0000","last_became_active":"2024-09-19T11:53:37.722160+0000","last_became_peered":"2024-09-19T11:53:37.722160+0000","last_unstale":"2024-09-19T12:02:01.829672+0000","last_undegraded":"2024-09-19T12:02:01.829672+0000","last_fullsized":"2024-09-19T12:02:01.829672+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:53:36.683650+0000","last_clean_scrub_stamp":"2024-09-19T11:53:36.683650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:39.249568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:41.013917+0000","last_change":"2024-09-19T12:03:41.013917+0000","last_active":"2024-09-19T12:03:41.013917+0000","last_peered":"2024-09-19T12:03:41.013917+0000","last_clean":"2024-09-19T12:03:41.013917+0000","last_became_active":"2024-09-19T11:53:34.699127+0000","last_became_peered":"2024-09-19T11:53:34.699127+0000","last_unstale":"2024-09-19T12:03:41.013917+0000","last_undegraded":"2024-09-19T12:03:41.013917+0000","last_fullsized":"2024-09-19T12:03:41.013917+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:41.013738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:41.013738+0000","last_clean_scrub_stamp":"2024-09-19T12:03:41.013738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:34.339022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"256'15","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:46.352556+0000","last_change":"2024-09-19T12:03:46.352556+0000","last_active":"2024-09-19T12:03:46.352556+0000","last_peered":"2024-09-19T12:03:46.352556+0000","last_clean":"2024-09-19T12:03:46.352556+0000","last_became_active":"2024-09-19T11:51:53.484630+0000","last_became_peered":"2024-09-19T11:51:53.484630+0000","last_unstale":"2024-09-19T12:03:46.352556+0000","last_undegraded":"2024-09-19T12:03:46.352556+0000","last_fullsized":"2024-09-19T12:03:46.352556+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'15","last_scrub_stamp":"2024-09-19T12:03:46.352368+0000","last_deep_scrub":"256'15","last_deep_scrub_stamp":"2024-09-19T12:03:46.352368+0000","last_clean_scrub_stamp":"2024-09-19T12:03:46.352368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:26.503503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":95,"num_write":34,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'29","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.468513+0000","last_change":"2024-09-19T12:03:23.468513+0000","last_active":"2024-09-19T12:03:23.468513+0000","last_peered":"2024-09-19T12:03:23.468513+0000","last_clean":"2024-09-19T12:03:23.468513+0000","last_became_active":"2024-09-19T11:35:31.628800+0000","last_became_peered":"2024-09-19T11:35:31.628800+0000","last_unstale":"2024-09-19T12:03:23.468513+0000","last_undegraded":"2024-09-19T12:03:23.468513+0000","last_fullsized":"2024-09-19T12:03:23.468513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-19T12:03:23.468293+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-19T12:03:23.468293+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.468293+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:18.549190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":38,"num_write":120,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'47","reported_seq":556,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:28.537173+0000","last_change":"2024-09-19T12:03:28.537173+0000","last_active":"2024-09-19T12:03:28.537173+0000","last_peered":"2024-09-19T12:03:28.537173+0000","last_clean":"2024-09-19T12:03:28.537173+0000","last_became_active":"2024-09-19T11:35:33.627994+0000","last_became_peered":"2024-09-19T11:35:33.627994+0000","last_unstale":"2024-09-19T12:03:28.537173+0000","last_undegraded":"2024-09-19T12:03:28.537173+0000","last_fullsized":"2024-09-19T12:03:28.537173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-09-19T12:03:28.536989+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-09-19T12:03:28.536989+0000","last_clean_scrub_stamp":"2024-09-19T12:03:28.536989+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:22.092687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":154,"num_write":67,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'64","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.634908+0000","last_change":"2024-09-19T12:03:16.634908+0000","last_active":"2024-09-19T12:03:16.634908+0000","last_peered":"2024-09-19T12:03:16.634908+0000","last_clean":"2024-09-19T12:03:16.634908+0000","last_became_active":"2024-09-19T11:35:31.608158+0000","last_became_peered":"2024-09-19T11:35:31.608158+0000","last_unstale":"2024-09-19T12:03:16.634908+0000","last_undegraded":"2024-09-19T12:03:16.634908+0000","last_fullsized":"2024-09-19T12:03:16.634908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'64","last_scrub_stamp":"2024-09-19T12:03:16.634685+0000","last_deep_scrub":"264'64","last_deep_scrub_stamp":"2024-09-19T12:03:16.634685+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.634685+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:56.893267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":661,"num_write":209,"num_write_kb":4683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'27","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:28.357372+0000","last_change":"2024-09-19T12:03:28.357372+0000","last_active":"2024-09-19T12:03:28.357372+0000","last_peered":"2024-09-19T12:03:28.357372+0000","last_clean":"2024-09-19T12:03:28.357372+0000","last_became_active":"2024-09-19T11:35:33.618098+0000","last_became_peered":"2024-09-19T11:35:33.618098+0000","last_unstale":"2024-09-19T12:03:28.357372+0000","last_undegraded":"2024-09-19T12:03:28.357372+0000","last_fullsized":"2024-09-19T12:03:28.357372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-19T12:03:28.357192+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-19T12:03:28.357192+0000","last_clean_scrub_stamp":"2024-09-19T12:03:28.357192+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:18.884693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":93,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'44","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.399942+0000","last_change":"2024-09-19T12:03:14.399942+0000","last_active":"2024-09-19T12:03:14.399942+0000","last_peered":"2024-09-19T12:03:14.399942+0000","last_clean":"2024-09-19T12:03:14.399942+0000","last_became_active":"2024-09-19T11:35:31.613678+0000","last_became_peered":"2024-09-19T11:35:31.613678+0000","last_unstale":"2024-09-19T12:03:14.399942+0000","last_undegraded":"2024-09-19T12:03:14.399942+0000","last_fullsized":"2024-09-19T12:03:14.399942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-19T12:03:14.399627+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-19T12:03:14.399627+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.399627+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:09.098923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":82,"num_read_kb":12351,"num_write":140,"num_write_kb":6154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'42","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.145358+0000","last_change":"2024-09-19T12:03:30.145358+0000","last_active":"2024-09-19T12:03:30.145358+0000","last_peered":"2024-09-19T12:03:30.145358+0000","last_clean":"2024-09-19T12:03:30.145358+0000","last_became_active":"2024-09-19T11:35:33.613298+0000","last_became_peered":"2024-09-19T11:35:33.613298+0000","last_unstale":"2024-09-19T12:03:30.145358+0000","last_undegraded":"2024-09-19T12:03:30.145358+0000","last_fullsized":"2024-09-19T12:03:30.145358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-09-19T12:03:30.145086+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-09-19T12:03:30.145086+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.145086+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:40.579601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":123,"num_write":79,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'25","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.480438+0000","last_change":"2024-09-19T12:03:22.480251+0000","last_active":"2024-09-19T12:03:22.480438+0000","last_peered":"2024-09-19T12:03:22.480438+0000","last_clean":"2024-09-19T12:03:22.480438+0000","last_became_active":"2024-09-19T11:35:31.608115+0000","last_became_peered":"2024-09-19T11:35:31.608115+0000","last_unstale":"2024-09-19T12:03:22.480438+0000","last_undegraded":"2024-09-19T12:03:22.480438+0000","last_fullsized":"2024-09-19T12:03:22.480438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-19T12:03:22.480019+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-19T12:03:22.480019+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.480019+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:10.348744+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":1089,"num_write":119,"num_write_kb":1059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'55","reported_seq":587,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.371828+0000","last_change":"2024-09-19T12:03:26.371828+0000","last_active":"2024-09-19T12:03:26.371828+0000","last_peered":"2024-09-19T12:03:26.371828+0000","last_clean":"2024-09-19T12:03:26.371828+0000","last_became_active":"2024-09-19T11:35:33.625528+0000","last_became_peered":"2024-09-19T11:35:33.625528+0000","last_unstale":"2024-09-19T12:03:26.371828+0000","last_undegraded":"2024-09-19T12:03:26.371828+0000","last_fullsized":"2024-09-19T12:03:26.371828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-09-19T12:03:26.371631+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-09-19T12:03:26.371631+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.371631+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:27.169927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":230,"num_read_kb":188,"num_write":85,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'71","reported_seq":599,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.447650+0000","last_change":"2024-09-19T12:03:22.447650+0000","last_active":"2024-09-19T12:03:22.447650+0000","last_peered":"2024-09-19T12:03:22.447650+0000","last_clean":"2024-09-19T12:03:22.447650+0000","last_became_active":"2024-09-19T11:35:31.618555+0000","last_became_peered":"2024-09-19T11:35:31.618555+0000","last_unstale":"2024-09-19T12:03:22.447650+0000","last_undegraded":"2024-09-19T12:03:22.447650+0000","last_fullsized":"2024-09-19T12:03:22.447650+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'71","last_scrub_stamp":"2024-09-19T12:03:22.447441+0000","last_deep_scrub":"264'71","last_deep_scrub_stamp":"2024-09-19T12:03:22.447441+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.447441+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:02.660150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":29375,"num_write":187,"num_write_kb":13979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'27","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.155526+0000","last_change":"2024-09-19T12:03:23.155247+0000","last_active":"2024-09-19T12:03:23.155526+0000","last_peered":"2024-09-19T12:03:23.155526+0000","last_clean":"2024-09-19T12:03:23.155526+0000","last_became_active":"2024-09-19T11:35:33.624952+0000","last_became_peered":"2024-09-19T11:35:33.624952+0000","last_unstale":"2024-09-19T12:03:23.155526+0000","last_undegraded":"2024-09-19T12:03:23.155526+0000","last_fullsized":"2024-09-19T12:03:23.155526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-19T12:03:23.155029+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-19T12:03:23.155029+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.155029+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:07.075048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":112,"num_write":47,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'51","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.495308+0000","last_change":"2024-09-19T12:03:23.495308+0000","last_active":"2024-09-19T12:03:23.495308+0000","last_peered":"2024-09-19T12:03:23.495308+0000","last_clean":"2024-09-19T12:03:23.495308+0000","last_became_active":"2024-09-19T11:35:31.587016+0000","last_became_peered":"2024-09-19T11:35:31.587016+0000","last_unstale":"2024-09-19T12:03:23.495308+0000","last_undegraded":"2024-09-19T12:03:23.495308+0000","last_fullsized":"2024-09-19T12:03:23.495308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-09-19T12:03:23.495109+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-09-19T12:03:23.495109+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.495109+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:27.504609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":3127,"num_write":134,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"253'2","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.164861+0000","last_change":"2024-09-19T12:03:32.164861+0000","last_active":"2024-09-19T12:03:32.164861+0000","last_peered":"2024-09-19T12:03:32.164861+0000","last_clean":"2024-09-19T12:03:32.164861+0000","last_became_active":"2024-09-19T11:35:33.612338+0000","last_became_peered":"2024-09-19T11:35:33.612338+0000","last_unstale":"2024-09-19T12:03:32.164861+0000","last_undegraded":"2024-09-19T12:03:32.164861+0000","last_fullsized":"2024-09-19T12:03:32.164861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"253'2","last_scrub_stamp":"2024-09-19T12:03:32.164660+0000","last_deep_scrub":"253'2","last_deep_scrub_stamp":"2024-09-19T12:03:32.164660+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.164660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:05:27.595069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'39","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.426910+0000","last_change":"2024-09-19T12:03:21.426910+0000","last_active":"2024-09-19T12:03:21.426910+0000","last_peered":"2024-09-19T12:03:21.426910+0000","last_clean":"2024-09-19T12:03:21.426910+0000","last_became_active":"2024-09-19T11:35:31.619730+0000","last_became_peered":"2024-09-19T11:35:31.619730+0000","last_unstale":"2024-09-19T12:03:21.426910+0000","last_undegraded":"2024-09-19T12:03:21.426910+0000","last_fullsized":"2024-09-19T12:03:21.426910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-19T12:03:21.426671+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-19T12:03:21.426671+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.426671+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:19.990519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":33,"num_write":114,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'48","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.500337+0000","last_change":"2024-09-19T12:03:29.500337+0000","last_active":"2024-09-19T12:03:29.500337+0000","last_peered":"2024-09-19T12:03:29.500337+0000","last_clean":"2024-09-19T12:03:29.500337+0000","last_became_active":"2024-09-19T11:35:33.611495+0000","last_became_peered":"2024-09-19T11:35:33.611495+0000","last_unstale":"2024-09-19T12:03:29.500337+0000","last_undegraded":"2024-09-19T12:03:29.500337+0000","last_fullsized":"2024-09-19T12:03:29.500337+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'48","last_scrub_stamp":"2024-09-19T12:03:29.500155+0000","last_deep_scrub":"264'48","last_deep_scrub_stamp":"2024-09-19T12:03:29.500155+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.500155+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:03.959370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":135,"num_write":76,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'38","reported_seq":557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.835009+0000","last_change":"2024-09-19T12:03:18.835009+0000","last_active":"2024-09-19T12:03:18.835009+0000","last_peered":"2024-09-19T12:03:18.835009+0000","last_clean":"2024-09-19T12:03:18.835009+0000","last_became_active":"2024-09-19T11:35:31.593765+0000","last_became_peered":"2024-09-19T11:35:31.593765+0000","last_unstale":"2024-09-19T12:03:18.835009+0000","last_undegraded":"2024-09-19T12:03:18.835009+0000","last_fullsized":"2024-09-19T12:03:18.835009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-19T12:03:18.834783+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-19T12:03:18.834783+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.834783+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:50.647398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":57,"num_read_kb":47,"num_write":117,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'46","reported_seq":572,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.236236+0000","last_change":"2024-09-19T12:03:22.236236+0000","last_active":"2024-09-19T12:03:22.236236+0000","last_peered":"2024-09-19T12:03:22.236236+0000","last_clean":"2024-09-19T12:03:22.236236+0000","last_became_active":"2024-09-19T11:35:33.604505+0000","last_became_peered":"2024-09-19T11:35:33.604505+0000","last_unstale":"2024-09-19T12:03:22.236236+0000","last_undegraded":"2024-09-19T12:03:22.236236+0000","last_fullsized":"2024-09-19T12:03:22.236236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'46","last_scrub_stamp":"2024-09-19T12:03:22.236038+0000","last_deep_scrub":"264'46","last_deep_scrub_stamp":"2024-09-19T12:03:22.236038+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.236038+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:46.941280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":158,"num_write":84,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'76","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:28.151936+0000","last_change":"2024-09-19T12:03:28.151772+0000","last_active":"2024-09-19T12:03:28.151936+0000","last_peered":"2024-09-19T12:03:28.151936+0000","last_clean":"2024-09-19T12:03:28.151936+0000","last_became_active":"2024-09-19T11:35:33.607843+0000","last_became_peered":"2024-09-19T11:35:33.607843+0000","last_unstale":"2024-09-19T12:03:28.151936+0000","last_undegraded":"2024-09-19T12:03:28.151936+0000","last_fullsized":"2024-09-19T12:03:28.151936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'76","last_scrub_stamp":"2024-09-19T12:03:28.151578+0000","last_deep_scrub":"264'76","last_deep_scrub_stamp":"2024-09-19T12:03:28.151578+0000","last_clean_scrub_stamp":"2024-09-19T12:03:28.151578+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:18.526285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":241,"num_write":113,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'43","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.182034+0000","last_change":"2024-09-19T12:03:15.182034+0000","last_active":"2024-09-19T12:03:15.182034+0000","last_peered":"2024-09-19T12:03:15.182034+0000","last_clean":"2024-09-19T12:03:15.182034+0000","last_became_active":"2024-09-19T11:36:06.680794+0000","last_became_peered":"2024-09-19T11:36:06.680794+0000","last_unstale":"2024-09-19T12:03:15.182034+0000","last_undegraded":"2024-09-19T12:03:15.182034+0000","last_fullsized":"2024-09-19T12:03:15.182034+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'43","last_scrub_stamp":"2024-09-19T12:03:15.181797+0000","last_deep_scrub":"264'43","last_deep_scrub_stamp":"2024-09-19T12:03:15.181797+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.181797+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:02.405820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":3338,"num_write":153,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,1],"acting":[2,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.389200+0000","last_change":"2024-09-19T12:03:27.389066+0000","last_active":"2024-09-19T12:03:27.389200+0000","last_peered":"2024-09-19T12:03:27.389200+0000","last_clean":"2024-09-19T12:03:27.389200+0000","last_became_active":"2024-09-19T11:35:33.621522+0000","last_became_peered":"2024-09-19T11:35:33.621522+0000","last_unstale":"2024-09-19T12:03:27.389200+0000","last_undegraded":"2024-09-19T12:03:27.389200+0000","last_fullsized":"2024-09-19T12:03:27.389200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:27.388888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:27.388888+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.388888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:42.682803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'38","reported_seq":562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.100506+0000","last_change":"2024-09-19T12:03:18.100506+0000","last_active":"2024-09-19T12:03:18.100506+0000","last_peered":"2024-09-19T12:03:18.100506+0000","last_clean":"2024-09-19T12:03:18.100506+0000","last_became_active":"2024-09-19T11:35:31.598016+0000","last_became_peered":"2024-09-19T11:35:31.598016+0000","last_unstale":"2024-09-19T12:03:18.100506+0000","last_undegraded":"2024-09-19T12:03:18.100506+0000","last_fullsized":"2024-09-19T12:03:18.100506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-19T12:03:18.100202+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-19T12:03:18.100202+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.100202+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:16.805533+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159780,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":2182,"num_write":164,"num_write_kb":2115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'48","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.565850+0000","last_change":"2024-09-19T12:03:27.565655+0000","last_active":"2024-09-19T12:03:27.565850+0000","last_peered":"2024-09-19T12:03:27.565850+0000","last_clean":"2024-09-19T12:03:27.565850+0000","last_became_active":"2024-09-19T11:35:33.610072+0000","last_became_peered":"2024-09-19T11:35:33.610072+0000","last_unstale":"2024-09-19T12:03:27.565850+0000","last_undegraded":"2024-09-19T12:03:27.565850+0000","last_fullsized":"2024-09-19T12:03:27.565850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'48","last_scrub_stamp":"2024-09-19T12:03:27.565474+0000","last_deep_scrub":"264'48","last_deep_scrub_stamp":"2024-09-19T12:03:27.565474+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.565474+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:31.604798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":149,"num_write":86,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'38","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.072223+0000","last_change":"2024-09-19T12:03:17.072223+0000","last_active":"2024-09-19T12:03:17.072223+0000","last_peered":"2024-09-19T12:03:17.072223+0000","last_clean":"2024-09-19T12:03:17.072223+0000","last_became_active":"2024-09-19T11:35:31.614263+0000","last_became_peered":"2024-09-19T11:35:31.614263+0000","last_unstale":"2024-09-19T12:03:17.072223+0000","last_undegraded":"2024-09-19T12:03:17.072223+0000","last_fullsized":"2024-09-19T12:03:17.072223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-19T12:03:17.072026+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-19T12:03:17.072026+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.072026+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:59.461838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":5162,"num_write":130,"num_write_kb":10269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'149","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.264548+0000","last_change":"2024-09-19T12:03:19.264548+0000","last_active":"2024-09-19T12:03:19.264548+0000","last_peered":"2024-09-19T12:03:19.264548+0000","last_clean":"2024-09-19T12:03:19.264548+0000","last_became_active":"2024-09-19T11:35:33.611240+0000","last_became_peered":"2024-09-19T11:35:33.611240+0000","last_unstale":"2024-09-19T12:03:19.264548+0000","last_undegraded":"2024-09-19T12:03:19.264548+0000","last_fullsized":"2024-09-19T12:03:19.264548+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-19T12:03:19.264365+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-19T12:03:19.264365+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.264365+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:15.800283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":454,"num_write":234,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'36","reported_seq":552,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.192398+0000","last_change":"2024-09-19T12:03:15.192398+0000","last_active":"2024-09-19T12:03:15.192398+0000","last_peered":"2024-09-19T12:03:15.192398+0000","last_clean":"2024-09-19T12:03:15.192398+0000","last_became_active":"2024-09-19T11:35:31.591932+0000","last_became_peered":"2024-09-19T11:35:31.591932+0000","last_unstale":"2024-09-19T12:03:15.192398+0000","last_undegraded":"2024-09-19T12:03:15.192398+0000","last_fullsized":"2024-09-19T12:03:15.192398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-19T12:03:15.192152+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-19T12:03:15.192152+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.192152+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:34.198854+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291468,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":7804,"num_write":105,"num_write_kb":7776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'26","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.262570+0000","last_change":"2024-09-19T12:03:20.262570+0000","last_active":"2024-09-19T12:03:20.262570+0000","last_peered":"2024-09-19T12:03:20.262570+0000","last_clean":"2024-09-19T12:03:20.262570+0000","last_became_active":"2024-09-19T11:35:33.625698+0000","last_became_peered":"2024-09-19T11:35:33.625698+0000","last_unstale":"2024-09-19T12:03:20.262570+0000","last_undegraded":"2024-09-19T12:03:20.262570+0000","last_fullsized":"2024-09-19T12:03:20.262570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-19T12:03:20.262382+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-19T12:03:20.262382+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.262382+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:46.069587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":73,"num_write":57,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'25","reported_seq":555,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.790984+0000","last_change":"2024-09-19T12:03:19.790984+0000","last_active":"2024-09-19T12:03:19.790984+0000","last_peered":"2024-09-19T12:03:19.790984+0000","last_clean":"2024-09-19T12:03:19.790984+0000","last_became_active":"2024-09-19T11:35:31.600939+0000","last_became_peered":"2024-09-19T11:35:31.600939+0000","last_unstale":"2024-09-19T12:03:19.790984+0000","last_undegraded":"2024-09-19T12:03:19.790984+0000","last_fullsized":"2024-09-19T12:03:19.790984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-19T12:03:19.790722+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-19T12:03:19.790722+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.790722+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:46.880166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":6211,"num_write":103,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.130214+0000","last_change":"2024-09-19T12:03:29.130214+0000","last_active":"2024-09-19T12:03:29.130214+0000","last_peered":"2024-09-19T12:03:29.130214+0000","last_clean":"2024-09-19T12:03:29.130214+0000","last_became_active":"2024-09-19T11:35:33.605215+0000","last_became_peered":"2024-09-19T11:35:33.605215+0000","last_unstale":"2024-09-19T12:03:29.130214+0000","last_undegraded":"2024-09-19T12:03:29.130214+0000","last_fullsized":"2024-09-19T12:03:29.130214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:29.130006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:29.130006+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.130006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:40.238295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'50","reported_seq":584,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.342068+0000","last_change":"2024-09-19T12:03:18.341918+0000","last_active":"2024-09-19T12:03:18.342068+0000","last_peered":"2024-09-19T12:03:18.342068+0000","last_clean":"2024-09-19T12:03:18.342068+0000","last_became_active":"2024-09-19T11:35:31.597035+0000","last_became_peered":"2024-09-19T11:35:31.597035+0000","last_unstale":"2024-09-19T12:03:18.342068+0000","last_undegraded":"2024-09-19T12:03:18.342068+0000","last_fullsized":"2024-09-19T12:03:18.342068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-19T12:03:18.341715+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-19T12:03:18.341715+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.341715+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:21.241927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":25670,"num_write":130,"num_write_kb":10245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'17","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:44.213015+0000","last_change":"2024-09-19T12:03:44.213015+0000","last_active":"2024-09-19T12:03:44.213015+0000","last_peered":"2024-09-19T12:03:44.213015+0000","last_clean":"2024-09-19T12:03:44.213015+0000","last_became_active":"2024-09-19T11:35:41.673420+0000","last_became_peered":"2024-09-19T11:35:41.673420+0000","last_unstale":"2024-09-19T12:03:44.213015+0000","last_undegraded":"2024-09-19T12:03:44.213015+0000","last_fullsized":"2024-09-19T12:03:44.213015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-19T12:03:44.212796+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-19T12:03:44.212796+0000","last_clean_scrub_stamp":"2024-09-19T12:03:44.212796+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:16.814295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":47,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.915918+0000","last_change":"2024-09-19T12:03:24.915760+0000","last_active":"2024-09-19T12:03:24.915918+0000","last_peered":"2024-09-19T12:03:24.915918+0000","last_clean":"2024-09-19T12:03:24.915918+0000","last_became_active":"2024-09-19T11:35:33.613437+0000","last_became_peered":"2024-09-19T11:35:33.613437+0000","last_unstale":"2024-09-19T12:03:24.915918+0000","last_undegraded":"2024-09-19T12:03:24.915918+0000","last_fullsized":"2024-09-19T12:03:24.915918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:24.915574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:24.915574+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.915574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:40.177888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'59","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.462001+0000","last_change":"2024-09-19T12:03:19.461837+0000","last_active":"2024-09-19T12:03:19.462001+0000","last_peered":"2024-09-19T12:03:19.462001+0000","last_clean":"2024-09-19T12:03:19.462001+0000","last_became_active":"2024-09-19T11:35:31.599314+0000","last_became_peered":"2024-09-19T11:35:31.599314+0000","last_unstale":"2024-09-19T12:03:19.462001+0000","last_undegraded":"2024-09-19T12:03:19.462001+0000","last_fullsized":"2024-09-19T12:03:19.462001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'59","last_scrub_stamp":"2024-09-19T12:03:19.461575+0000","last_deep_scrub":"264'59","last_deep_scrub_stamp":"2024-09-19T12:03:19.461575+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.461575+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:11.460791+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":96,"num_read_kb":1688,"num_write":199,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.460581+0000","last_change":"2024-09-19T12:03:33.460581+0000","last_active":"2024-09-19T12:03:33.460581+0000","last_peered":"2024-09-19T12:03:33.460581+0000","last_clean":"2024-09-19T12:03:33.460581+0000","last_became_active":"2024-09-19T11:35:35.616351+0000","last_became_peered":"2024-09-19T11:35:35.616351+0000","last_unstale":"2024-09-19T12:03:33.460581+0000","last_undegraded":"2024-09-19T12:03:33.460581+0000","last_fullsized":"2024-09-19T12:03:33.460581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:33.460391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:33.460391+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.460391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:39.816629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'126","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.392856+0000","last_change":"2024-09-19T12:03:33.392856+0000","last_active":"2024-09-19T12:03:33.392856+0000","last_peered":"2024-09-19T12:03:33.392856+0000","last_clean":"2024-09-19T12:03:33.392856+0000","last_became_active":"2024-09-19T11:35:37.650685+0000","last_became_peered":"2024-09-19T11:35:37.650685+0000","last_unstale":"2024-09-19T12:03:33.392856+0000","last_undegraded":"2024-09-19T12:03:33.392856+0000","last_fullsized":"2024-09-19T12:03:33.392856+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-19T12:03:33.392661+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-19T12:03:33.392661+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.392661+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:51.506860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":226,"num_write":120,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:42.341127+0000","last_change":"2024-09-19T12:03:42.341127+0000","last_active":"2024-09-19T12:03:42.341127+0000","last_peered":"2024-09-19T12:03:42.341127+0000","last_clean":"2024-09-19T12:03:42.341127+0000","last_became_active":"2024-09-19T11:35:39.676033+0000","last_became_peered":"2024-09-19T11:35:39.676033+0000","last_unstale":"2024-09-19T12:03:42.341127+0000","last_undegraded":"2024-09-19T12:03:42.341127+0000","last_fullsized":"2024-09-19T12:03:42.341127+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:42.340926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:42.340926+0000","last_clean_scrub_stamp":"2024-09-19T12:03:42.340926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:45.912330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'16","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:46.414269+0000","last_change":"2024-09-19T12:03:46.414269+0000","last_active":"2024-09-19T12:03:46.414269+0000","last_peered":"2024-09-19T12:03:46.414269+0000","last_clean":"2024-09-19T12:03:46.414269+0000","last_became_active":"2024-09-19T11:35:41.680497+0000","last_became_peered":"2024-09-19T11:35:41.680497+0000","last_unstale":"2024-09-19T12:03:46.414269+0000","last_undegraded":"2024-09-19T12:03:46.414269+0000","last_fullsized":"2024-09-19T12:03:46.414269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-19T12:03:46.414066+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-19T12:03:46.414066+0000","last_clean_scrub_stamp":"2024-09-19T12:03:46.414066+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:26.455259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":49,"num_write":53,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'2","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.518618+0000","last_change":"2024-09-19T12:03:25.518618+0000","last_active":"2024-09-19T12:03:25.518618+0000","last_peered":"2024-09-19T12:03:25.518618+0000","last_clean":"2024-09-19T12:03:25.518618+0000","last_became_active":"2024-09-19T11:35:33.615138+0000","last_became_peered":"2024-09-19T11:35:33.615138+0000","last_unstale":"2024-09-19T12:03:25.518618+0000","last_undegraded":"2024-09-19T12:03:25.518618+0000","last_fullsized":"2024-09-19T12:03:25.518618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:25.518441+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:25.518441+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.518441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:30.047762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'37","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.381945+0000","last_change":"2024-09-19T12:03:15.381754+0000","last_active":"2024-09-19T12:03:15.381945+0000","last_peered":"2024-09-19T12:03:15.381945+0000","last_clean":"2024-09-19T12:03:15.381945+0000","last_became_active":"2024-09-19T11:35:31.612424+0000","last_became_peered":"2024-09-19T11:35:31.612424+0000","last_unstale":"2024-09-19T12:03:15.381945+0000","last_undegraded":"2024-09-19T12:03:15.381945+0000","last_fullsized":"2024-09-19T12:03:15.381945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:15.381564+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:15.381564+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.381564+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:57.076212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":5150,"num_write":106,"num_write_kb":10271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.068603+0000","last_change":"2024-09-19T12:03:31.068436+0000","last_active":"2024-09-19T12:03:31.068603+0000","last_peered":"2024-09-19T12:03:31.068603+0000","last_clean":"2024-09-19T12:03:31.068603+0000","last_became_active":"2024-09-19T11:35:35.626979+0000","last_became_peered":"2024-09-19T11:35:35.626979+0000","last_unstale":"2024-09-19T12:03:31.068603+0000","last_undegraded":"2024-09-19T12:03:31.068603+0000","last_fullsized":"2024-09-19T12:03:31.068603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:31.068247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:31.068247+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.068247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:05.280814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'51","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:39.243358+0000","last_change":"2024-09-19T12:03:39.243358+0000","last_active":"2024-09-19T12:03:39.243358+0000","last_peered":"2024-09-19T12:03:39.243358+0000","last_clean":"2024-09-19T12:03:39.243358+0000","last_became_active":"2024-09-19T11:35:37.624916+0000","last_became_peered":"2024-09-19T11:35:37.624916+0000","last_unstale":"2024-09-19T12:03:39.243358+0000","last_undegraded":"2024-09-19T12:03:39.243358+0000","last_fullsized":"2024-09-19T12:03:39.243358+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-09-19T12:03:39.243111+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-09-19T12:03:39.243111+0000","last_clean_scrub_stamp":"2024-09-19T12:03:39.243111+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:37.716377+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":68,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:41.241730+0000","last_change":"2024-09-19T12:03:41.241730+0000","last_active":"2024-09-19T12:03:41.241730+0000","last_peered":"2024-09-19T12:03:41.241730+0000","last_clean":"2024-09-19T12:03:41.241730+0000","last_became_active":"2024-09-19T11:35:39.669732+0000","last_became_peered":"2024-09-19T11:35:39.669732+0000","last_unstale":"2024-09-19T12:03:41.241730+0000","last_undegraded":"2024-09-19T12:03:41.241730+0000","last_fullsized":"2024-09-19T12:03:41.241730+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:41.241551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:41.241551+0000","last_clean_scrub_stamp":"2024-09-19T12:03:41.241551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:38.013113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'30","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:47.475300+0000","last_change":"2024-09-19T12:03:47.475300+0000","last_active":"2024-09-19T12:03:47.475300+0000","last_peered":"2024-09-19T12:03:47.475300+0000","last_clean":"2024-09-19T12:03:47.475300+0000","last_became_active":"2024-09-19T11:35:41.693197+0000","last_became_peered":"2024-09-19T11:35:41.693197+0000","last_unstale":"2024-09-19T12:03:47.475300+0000","last_undegraded":"2024-09-19T12:03:47.475300+0000","last_fullsized":"2024-09-19T12:03:47.475300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-19T12:03:47.475131+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-19T12:03:47.475131+0000","last_clean_scrub_stamp":"2024-09-19T12:03:47.475131+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:55.060618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":93,"num_write":83,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'5","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.312254+0000","last_change":"2024-09-19T12:03:22.312254+0000","last_active":"2024-09-19T12:03:22.312254+0000","last_peered":"2024-09-19T12:03:22.312254+0000","last_clean":"2024-09-19T12:03:22.312254+0000","last_became_active":"2024-09-19T11:35:33.625606+0000","last_became_peered":"2024-09-19T11:35:33.625606+0000","last_unstale":"2024-09-19T12:03:22.312254+0000","last_undegraded":"2024-09-19T12:03:22.312254+0000","last_fullsized":"2024-09-19T12:03:22.312254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:03:22.312041+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:03:22.312041+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.312041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:00.306623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'49","reported_seq":564,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.444273+0000","last_change":"2024-09-19T12:03:18.444132+0000","last_active":"2024-09-19T12:03:18.444273+0000","last_peered":"2024-09-19T12:03:18.444273+0000","last_clean":"2024-09-19T12:03:18.444273+0000","last_became_active":"2024-09-19T11:35:31.621190+0000","last_became_peered":"2024-09-19T11:35:31.621190+0000","last_unstale":"2024-09-19T12:03:18.444273+0000","last_undegraded":"2024-09-19T12:03:18.444273+0000","last_fullsized":"2024-09-19T12:03:18.444273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-19T12:03:18.443898+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-19T12:03:18.443898+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.443898+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:55.033263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":65,"num_read_kb":198,"num_write":164,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"264'4","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.130426+0000","last_change":"2024-09-19T12:03:35.130426+0000","last_active":"2024-09-19T12:03:35.130426+0000","last_peered":"2024-09-19T12:03:35.130426+0000","last_clean":"2024-09-19T12:03:35.130426+0000","last_became_active":"2024-09-19T11:35:35.623997+0000","last_became_peered":"2024-09-19T11:35:35.623997+0000","last_unstale":"2024-09-19T12:03:35.130426+0000","last_undegraded":"2024-09-19T12:03:35.130426+0000","last_fullsized":"2024-09-19T12:03:35.130426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-19T12:03:35.130235+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-19T12:03:35.130235+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.130235+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:06.342067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":628,"num_read_kb":626,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'69","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.178949+0000","last_change":"2024-09-19T12:03:29.178798+0000","last_active":"2024-09-19T12:03:29.178949+0000","last_peered":"2024-09-19T12:03:29.178949+0000","last_clean":"2024-09-19T12:03:29.178949+0000","last_became_active":"2024-09-19T11:35:37.628124+0000","last_became_peered":"2024-09-19T11:35:37.628124+0000","last_unstale":"2024-09-19T12:03:29.178949+0000","last_undegraded":"2024-09-19T12:03:29.178949+0000","last_fullsized":"2024-09-19T12:03:29.178949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'69","last_scrub_stamp":"2024-09-19T12:03:29.178625+0000","last_deep_scrub":"264'69","last_deep_scrub_stamp":"2024-09-19T12:03:29.178625+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.178625+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:13.464739+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'616","reported_seq":1513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:41.353449+0000","last_change":"2024-09-19T12:03:41.353449+0000","last_active":"2024-09-19T12:03:41.353449+0000","last_peered":"2024-09-19T12:03:41.353449+0000","last_clean":"2024-09-19T12:03:41.353449+0000","last_became_active":"2024-09-19T11:35:39.681867+0000","last_became_peered":"2024-09-19T11:35:39.681867+0000","last_unstale":"2024-09-19T12:03:41.353449+0000","last_undegraded":"2024-09-19T12:03:41.353449+0000","last_fullsized":"2024-09-19T12:03:41.353449+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'616","last_scrub_stamp":"2024-09-19T12:03:41.353274+0000","last_deep_scrub":"264'616","last_deep_scrub_stamp":"2024-09-19T12:03:41.353274+0000","last_clean_scrub_stamp":"2024-09-19T12:03:41.353274+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":600,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:37.547454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'22","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:46.208627+0000","last_change":"2024-09-19T12:03:46.208627+0000","last_active":"2024-09-19T12:03:46.208627+0000","last_peered":"2024-09-19T12:03:46.208627+0000","last_clean":"2024-09-19T12:03:46.208627+0000","last_became_active":"2024-09-19T11:35:41.676988+0000","last_became_peered":"2024-09-19T11:35:41.676988+0000","last_unstale":"2024-09-19T12:03:46.208627+0000","last_undegraded":"2024-09-19T12:03:46.208627+0000","last_fullsized":"2024-09-19T12:03:46.208627+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-19T12:03:46.208424+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-19T12:03:46.208424+0000","last_clean_scrub_stamp":"2024-09-19T12:03:46.208424+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:08:21.080331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'23","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.099911+0000","last_change":"2024-09-19T12:03:32.099911+0000","last_active":"2024-09-19T12:03:32.099911+0000","last_peered":"2024-09-19T12:03:32.099911+0000","last_clean":"2024-09-19T12:03:32.099911+0000","last_became_active":"2024-09-19T11:35:33.614168+0000","last_became_peered":"2024-09-19T11:35:33.614168+0000","last_unstale":"2024-09-19T12:03:32.099911+0000","last_undegraded":"2024-09-19T12:03:32.099911+0000","last_fullsized":"2024-09-19T12:03:32.099911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-19T12:03:32.099689+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-19T12:03:32.099689+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.099689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:00:57.890206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":86,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'51","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.965354+0000","last_change":"2024-09-19T12:03:13.965204+0000","last_active":"2024-09-19T12:03:13.965354+0000","last_peered":"2024-09-19T12:03:13.965354+0000","last_clean":"2024-09-19T12:03:13.965354+0000","last_became_active":"2024-09-19T11:35:31.610808+0000","last_became_peered":"2024-09-19T11:35:31.610808+0000","last_unstale":"2024-09-19T12:03:13.965354+0000","last_undegraded":"2024-09-19T12:03:13.965354+0000","last_fullsized":"2024-09-19T12:03:13.965354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-09-19T12:03:13.964934+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-09-19T12:03:13.964934+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.964934+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:35.104668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2128531,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":7272,"num_write":187,"num_write_kb":7210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.451019+0000","last_change":"2024-09-19T12:03:34.451019+0000","last_active":"2024-09-19T12:03:34.451019+0000","last_peered":"2024-09-19T12:03:34.451019+0000","last_clean":"2024-09-19T12:03:34.451019+0000","last_became_active":"2024-09-19T11:35:35.623608+0000","last_became_peered":"2024-09-19T11:35:35.623608+0000","last_unstale":"2024-09-19T12:03:34.451019+0000","last_undegraded":"2024-09-19T12:03:34.451019+0000","last_fullsized":"2024-09-19T12:03:34.451019+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:34.450830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:34.450830+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.450830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:43.578742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'71","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.276185+0000","last_change":"2024-09-19T12:03:37.276185+0000","last_active":"2024-09-19T12:03:37.276185+0000","last_peered":"2024-09-19T12:03:37.276185+0000","last_clean":"2024-09-19T12:03:37.276185+0000","last_became_active":"2024-09-19T11:35:37.645933+0000","last_became_peered":"2024-09-19T11:35:37.645933+0000","last_unstale":"2024-09-19T12:03:37.276185+0000","last_undegraded":"2024-09-19T12:03:37.276185+0000","last_fullsized":"2024-09-19T12:03:37.276185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'71","last_scrub_stamp":"2024-09-19T12:03:37.276002+0000","last_deep_scrub":"264'71","last_deep_scrub_stamp":"2024-09-19T12:03:37.276002+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.276002+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:07.640576+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":136,"num_write":66,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'623","reported_seq":1501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:44.068417+0000","last_change":"2024-09-19T12:03:44.068188+0000","last_active":"2024-09-19T12:03:44.068417+0000","last_peered":"2024-09-19T12:03:44.068417+0000","last_clean":"2024-09-19T12:03:44.068417+0000","last_became_active":"2024-09-19T11:35:39.654205+0000","last_became_peered":"2024-09-19T11:35:39.654205+0000","last_unstale":"2024-09-19T12:03:44.068417+0000","last_undegraded":"2024-09-19T12:03:44.068417+0000","last_fullsized":"2024-09-19T12:03:44.068417+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'623","last_scrub_stamp":"2024-09-19T12:03:44.067981+0000","last_deep_scrub":"264'623","last_deep_scrub_stamp":"2024-09-19T12:03:44.067981+0000","last_clean_scrub_stamp":"2024-09-19T12:03:44.067981+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":600,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:52:57.278573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'23","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.509402+0000","last_change":"2024-09-19T12:03:24.509263+0000","last_active":"2024-09-19T12:03:24.509402+0000","last_peered":"2024-09-19T12:03:24.509402+0000","last_clean":"2024-09-19T12:03:24.509402+0000","last_became_active":"2024-09-19T11:35:33.624883+0000","last_became_peered":"2024-09-19T11:35:33.624883+0000","last_unstale":"2024-09-19T12:03:24.509402+0000","last_undegraded":"2024-09-19T12:03:24.509402+0000","last_fullsized":"2024-09-19T12:03:24.509402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-19T12:03:24.509080+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-19T12:03:24.509080+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.509080+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:51:19.432316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":86,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'37","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.413381+0000","last_change":"2024-09-19T12:03:16.413381+0000","last_active":"2024-09-19T12:03:16.413381+0000","last_peered":"2024-09-19T12:03:16.413381+0000","last_clean":"2024-09-19T12:03:16.413381+0000","last_became_active":"2024-09-19T11:35:31.609658+0000","last_became_peered":"2024-09-19T11:35:31.609658+0000","last_unstale":"2024-09-19T12:03:16.413381+0000","last_undegraded":"2024-09-19T12:03:16.413381+0000","last_fullsized":"2024-09-19T12:03:16.413381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:16.413160+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:16.413160+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.413160+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:25.039067+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":54,"num_read_kb":38,"num_write":106,"num_write_kb":5152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.325912+0000","last_change":"2024-09-19T12:03:30.325769+0000","last_active":"2024-09-19T12:03:30.325912+0000","last_peered":"2024-09-19T12:03:30.325912+0000","last_clean":"2024-09-19T12:03:30.325912+0000","last_became_active":"2024-09-19T11:35:35.621170+0000","last_became_peered":"2024-09-19T11:35:35.621170+0000","last_unstale":"2024-09-19T12:03:30.325912+0000","last_undegraded":"2024-09-19T12:03:30.325912+0000","last_fullsized":"2024-09-19T12:03:30.325912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:30.325601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:30.325601+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.325601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:35.632602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'130","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.439340+0000","last_change":"2024-09-19T12:03:37.439340+0000","last_active":"2024-09-19T12:03:37.439340+0000","last_peered":"2024-09-19T12:03:37.439340+0000","last_clean":"2024-09-19T12:03:37.439340+0000","last_became_active":"2024-09-19T11:35:37.635359+0000","last_became_peered":"2024-09-19T11:35:37.635359+0000","last_unstale":"2024-09-19T12:03:37.439340+0000","last_undegraded":"2024-09-19T12:03:37.439340+0000","last_fullsized":"2024-09-19T12:03:37.439340+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-19T12:03:37.439112+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-19T12:03:37.439112+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.439112+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:58.196626+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4817,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":176,"num_read_kb":225,"num_write":122,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.608894+0000","last_change":"2024-09-19T12:03:29.608894+0000","last_active":"2024-09-19T12:03:29.608894+0000","last_peered":"2024-09-19T12:03:29.608894+0000","last_clean":"2024-09-19T12:03:29.608894+0000","last_became_active":"2024-09-19T11:35:39.683300+0000","last_became_peered":"2024-09-19T11:35:39.683300+0000","last_unstale":"2024-09-19T12:03:29.608894+0000","last_undegraded":"2024-09-19T12:03:29.608894+0000","last_fullsized":"2024-09-19T12:03:29.608894+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:29.608706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:29.608706+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.608706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:11.666638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'7","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:42.448871+0000","last_change":"2024-09-19T12:03:42.448871+0000","last_active":"2024-09-19T12:03:42.448871+0000","last_peered":"2024-09-19T12:03:42.448871+0000","last_clean":"2024-09-19T12:03:42.448871+0000","last_became_active":"2024-09-19T11:35:41.684698+0000","last_became_peered":"2024-09-19T11:35:41.684698+0000","last_unstale":"2024-09-19T12:03:42.448871+0000","last_undegraded":"2024-09-19T12:03:42.448871+0000","last_fullsized":"2024-09-19T12:03:42.448871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-19T12:03:42.448672+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-19T12:03:42.448672+0000","last_clean_scrub_stamp":"2024-09-19T12:03:42.448672+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:00.507923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'10","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.229047+0000","last_change":"2024-09-19T12:03:17.228863+0000","last_active":"2024-09-19T12:03:17.229047+0000","last_peered":"2024-09-19T12:03:17.229047+0000","last_clean":"2024-09-19T12:03:17.229047+0000","last_became_active":"2024-09-19T11:35:33.617778+0000","last_became_peered":"2024-09-19T11:35:33.617778+0000","last_unstale":"2024-09-19T12:03:17.229047+0000","last_undegraded":"2024-09-19T12:03:17.229047+0000","last_fullsized":"2024-09-19T12:03:17.229047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-19T12:03:17.228686+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-19T12:03:17.228686+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.228686+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:43.560036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":12,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'64","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.439975+0000","last_change":"2024-09-19T12:03:17.439975+0000","last_active":"2024-09-19T12:03:17.439975+0000","last_peered":"2024-09-19T12:03:17.439975+0000","last_clean":"2024-09-19T12:03:17.439975+0000","last_became_active":"2024-09-19T11:35:31.609243+0000","last_became_peered":"2024-09-19T11:35:31.609243+0000","last_unstale":"2024-09-19T12:03:17.439975+0000","last_undegraded":"2024-09-19T12:03:17.439975+0000","last_fullsized":"2024-09-19T12:03:17.439975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'64","last_scrub_stamp":"2024-09-19T12:03:17.439587+0000","last_deep_scrub":"264'64","last_deep_scrub_stamp":"2024-09-19T12:03:17.439587+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.439587+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:54.098273+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":103,"num_read_kb":6258,"num_write":261,"num_write_kb":6195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.253781+0000","last_change":"2024-09-19T12:03:24.253561+0000","last_active":"2024-09-19T12:03:24.253781+0000","last_peered":"2024-09-19T12:03:24.253781+0000","last_clean":"2024-09-19T12:03:24.253781+0000","last_became_active":"2024-09-19T11:35:35.617934+0000","last_became_peered":"2024-09-19T11:35:35.617934+0000","last_unstale":"2024-09-19T12:03:24.253781+0000","last_undegraded":"2024-09-19T12:03:24.253781+0000","last_fullsized":"2024-09-19T12:03:24.253781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:24.253369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:24.253369+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.253369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:32.295766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'71","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.167436+0000","last_change":"2024-09-19T12:03:38.167436+0000","last_active":"2024-09-19T12:03:38.167436+0000","last_peered":"2024-09-19T12:03:38.167436+0000","last_clean":"2024-09-19T12:03:38.167436+0000","last_became_active":"2024-09-19T11:35:37.643236+0000","last_became_peered":"2024-09-19T11:35:37.643236+0000","last_unstale":"2024-09-19T12:03:38.167436+0000","last_undegraded":"2024-09-19T12:03:38.167436+0000","last_fullsized":"2024-09-19T12:03:38.167436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'71","last_scrub_stamp":"2024-09-19T12:03:38.167224+0000","last_deep_scrub":"264'71","last_deep_scrub_stamp":"2024-09-19T12:03:38.167224+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.167224+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:56.708140+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":101,"num_read_kb":192,"num_write":78,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.101410+0000","last_change":"2024-09-19T12:03:43.101410+0000","last_active":"2024-09-19T12:03:43.101410+0000","last_peered":"2024-09-19T12:03:43.101410+0000","last_clean":"2024-09-19T12:03:43.101410+0000","last_became_active":"2024-09-19T11:35:39.652920+0000","last_became_peered":"2024-09-19T11:35:39.652920+0000","last_unstale":"2024-09-19T12:03:43.101410+0000","last_undegraded":"2024-09-19T12:03:43.101410+0000","last_fullsized":"2024-09-19T12:03:43.101410+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:43.101230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:43.101230+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.101230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:27:46.915692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'12","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.123630+0000","last_change":"2024-09-19T12:03:32.123630+0000","last_active":"2024-09-19T12:03:32.123630+0000","last_peered":"2024-09-19T12:03:32.123630+0000","last_clean":"2024-09-19T12:03:32.123630+0000","last_became_active":"2024-09-19T11:35:41.678055+0000","last_became_peered":"2024-09-19T11:35:41.678055+0000","last_unstale":"2024-09-19T12:03:32.123630+0000","last_undegraded":"2024-09-19T12:03:32.123630+0000","last_fullsized":"2024-09-19T12:03:32.123630+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-19T12:03:32.123443+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-19T12:03:32.123443+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.123443+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:48.753601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":59,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'47","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.108382+0000","last_change":"2024-09-19T12:03:20.108229+0000","last_active":"2024-09-19T12:03:20.108382+0000","last_peered":"2024-09-19T12:03:20.108382+0000","last_clean":"2024-09-19T12:03:20.108382+0000","last_became_active":"2024-09-19T11:35:33.624015+0000","last_became_peered":"2024-09-19T11:35:33.624015+0000","last_unstale":"2024-09-19T12:03:20.108382+0000","last_undegraded":"2024-09-19T12:03:20.108382+0000","last_fullsized":"2024-09-19T12:03:20.108382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-09-19T12:03:20.108047+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-09-19T12:03:20.108047+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.108047+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:57.493258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":170,"num_write":76,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'56","reported_seq":587,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.410916+0000","last_change":"2024-09-19T12:03:15.410916+0000","last_active":"2024-09-19T12:03:15.410916+0000","last_peered":"2024-09-19T12:03:15.410916+0000","last_clean":"2024-09-19T12:03:15.410916+0000","last_became_active":"2024-09-19T11:35:31.627232+0000","last_became_peered":"2024-09-19T11:35:31.627232+0000","last_unstale":"2024-09-19T12:03:15.410916+0000","last_undegraded":"2024-09-19T12:03:15.410916+0000","last_fullsized":"2024-09-19T12:03:15.410916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'56","last_scrub_stamp":"2024-09-19T12:03:15.410628+0000","last_deep_scrub":"264'56","last_deep_scrub_stamp":"2024-09-19T12:03:15.410628+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.410628+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:37.621254+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":114,"num_read_kb":6226,"num_write":211,"num_write_kb":11300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.219613+0000","last_change":"2024-09-19T12:03:25.219613+0000","last_active":"2024-09-19T12:03:25.219613+0000","last_peered":"2024-09-19T12:03:25.219613+0000","last_clean":"2024-09-19T12:03:25.219613+0000","last_became_active":"2024-09-19T11:35:35.623852+0000","last_became_peered":"2024-09-19T11:35:35.623852+0000","last_unstale":"2024-09-19T12:03:25.219613+0000","last_undegraded":"2024-09-19T12:03:25.219613+0000","last_fullsized":"2024-09-19T12:03:25.219613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:25.219432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:25.219432+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.219432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:46:03.404112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'82","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.347909+0000","last_change":"2024-09-19T12:03:35.347748+0000","last_active":"2024-09-19T12:03:35.347909+0000","last_peered":"2024-09-19T12:03:35.347909+0000","last_clean":"2024-09-19T12:03:35.347909+0000","last_became_active":"2024-09-19T11:35:37.640906+0000","last_became_peered":"2024-09-19T11:35:37.640906+0000","last_unstale":"2024-09-19T12:03:35.347909+0000","last_undegraded":"2024-09-19T12:03:35.347909+0000","last_fullsized":"2024-09-19T12:03:35.347909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'82","last_scrub_stamp":"2024-09-19T12:03:35.347572+0000","last_deep_scrub":"264'82","last_deep_scrub_stamp":"2024-09-19T12:03:35.347572+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.347572+0000","objects_scrubbed":7,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:34.965283+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":103,"num_read_kb":144,"num_write":72,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'617","reported_seq":1466,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.418952+0000","last_change":"2024-09-19T12:03:38.418779+0000","last_active":"2024-09-19T12:03:38.418952+0000","last_peered":"2024-09-19T12:03:38.418952+0000","last_clean":"2024-09-19T12:03:38.418952+0000","last_became_active":"2024-09-19T11:35:39.672054+0000","last_became_peered":"2024-09-19T11:35:39.672054+0000","last_unstale":"2024-09-19T12:03:38.418952+0000","last_undegraded":"2024-09-19T12:03:38.418952+0000","last_fullsized":"2024-09-19T12:03:38.418952+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'617","last_scrub_stamp":"2024-09-19T12:03:38.418602+0000","last_deep_scrub":"264'617","last_deep_scrub_stamp":"2024-09-19T12:03:38.418602+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.418602+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:16.573897+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'5","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.420922+0000","last_change":"2024-09-19T12:03:43.420710+0000","last_active":"2024-09-19T12:03:43.420922+0000","last_peered":"2024-09-19T12:03:43.420922+0000","last_clean":"2024-09-19T12:03:43.420922+0000","last_became_active":"2024-09-19T11:35:41.693623+0000","last_became_peered":"2024-09-19T11:35:41.693623+0000","last_unstale":"2024-09-19T12:03:43.420922+0000","last_undegraded":"2024-09-19T12:03:43.420922+0000","last_fullsized":"2024-09-19T12:03:43.420922+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:03:43.420443+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:03:43.420443+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.420443+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:00.225897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'3","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.344346+0000","last_change":"2024-09-19T12:03:21.344346+0000","last_active":"2024-09-19T12:03:21.344346+0000","last_peered":"2024-09-19T12:03:21.344346+0000","last_clean":"2024-09-19T12:03:21.344346+0000","last_became_active":"2024-09-19T11:35:33.620252+0000","last_became_peered":"2024-09-19T11:35:33.620252+0000","last_unstale":"2024-09-19T12:03:21.344346+0000","last_undegraded":"2024-09-19T12:03:21.344346+0000","last_fullsized":"2024-09-19T12:03:21.344346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:21.344164+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:21.344164+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.344164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:11.838750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'28","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.643635+0000","last_change":"2024-09-19T12:03:13.643635+0000","last_active":"2024-09-19T12:03:13.643635+0000","last_peered":"2024-09-19T12:03:13.643635+0000","last_clean":"2024-09-19T12:03:13.643635+0000","last_became_active":"2024-09-19T11:35:31.606137+0000","last_became_peered":"2024-09-19T11:35:31.606137+0000","last_unstale":"2024-09-19T12:03:13.643635+0000","last_undegraded":"2024-09-19T12:03:13.643635+0000","last_fullsized":"2024-09-19T12:03:13.643635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-09-19T12:03:13.643394+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-09-19T12:03:13.643394+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.643394+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:34.124245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":99,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:28.204367+0000","last_change":"2024-09-19T12:03:28.204220+0000","last_active":"2024-09-19T12:03:28.204367+0000","last_peered":"2024-09-19T12:03:28.204367+0000","last_clean":"2024-09-19T12:03:28.204367+0000","last_became_active":"2024-09-19T11:35:35.619995+0000","last_became_peered":"2024-09-19T11:35:35.619995+0000","last_unstale":"2024-09-19T12:03:28.204367+0000","last_undegraded":"2024-09-19T12:03:28.204367+0000","last_fullsized":"2024-09-19T12:03:28.204367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:28.204014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:28.204014+0000","last_clean_scrub_stamp":"2024-09-19T12:03:28.204014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:57.625089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'102","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.411371+0000","last_change":"2024-09-19T12:03:32.411214+0000","last_active":"2024-09-19T12:03:32.411371+0000","last_peered":"2024-09-19T12:03:32.411371+0000","last_clean":"2024-09-19T12:03:32.411371+0000","last_became_active":"2024-09-19T11:35:37.646446+0000","last_became_peered":"2024-09-19T11:35:37.646446+0000","last_unstale":"2024-09-19T12:03:32.411371+0000","last_undegraded":"2024-09-19T12:03:32.411371+0000","last_fullsized":"2024-09-19T12:03:32.411371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-19T12:03:32.411017+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-19T12:03:32.411017+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.411017+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:39.875364+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":252,"num_write":102,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.211607+0000","last_change":"2024-09-19T12:03:30.211446+0000","last_active":"2024-09-19T12:03:30.211607+0000","last_peered":"2024-09-19T12:03:30.211607+0000","last_clean":"2024-09-19T12:03:30.211607+0000","last_became_active":"2024-09-19T11:35:39.658173+0000","last_became_peered":"2024-09-19T11:35:39.658173+0000","last_unstale":"2024-09-19T12:03:30.211607+0000","last_undegraded":"2024-09-19T12:03:30.211607+0000","last_fullsized":"2024-09-19T12:03:30.211607+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:30.211269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:30.211269+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.211269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:09.293357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'7","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.543295+0000","last_change":"2024-09-19T12:03:34.543155+0000","last_active":"2024-09-19T12:03:34.543295+0000","last_peered":"2024-09-19T12:03:34.543295+0000","last_clean":"2024-09-19T12:03:34.543295+0000","last_became_active":"2024-09-19T11:35:41.678765+0000","last_became_peered":"2024-09-19T11:35:41.678765+0000","last_unstale":"2024-09-19T12:03:34.543295+0000","last_undegraded":"2024-09-19T12:03:34.543295+0000","last_fullsized":"2024-09-19T12:03:34.543295+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-19T12:03:34.542965+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-19T12:03:34.542965+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.542965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:42.939058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":41,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'2","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.209216+0000","last_change":"2024-09-19T12:03:18.209216+0000","last_active":"2024-09-19T12:03:18.209216+0000","last_peered":"2024-09-19T12:03:18.209216+0000","last_clean":"2024-09-19T12:03:18.209216+0000","last_became_active":"2024-09-19T11:35:33.612279+0000","last_became_peered":"2024-09-19T11:35:33.612279+0000","last_unstale":"2024-09-19T12:03:18.209216+0000","last_undegraded":"2024-09-19T12:03:18.209216+0000","last_fullsized":"2024-09-19T12:03:18.209216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:18.209042+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:18.209042+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.209042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:08.056928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'100","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.878737+0000","last_change":"2024-09-19T12:03:11.878737+0000","last_active":"2024-09-19T12:03:11.878737+0000","last_peered":"2024-09-19T12:03:11.878737+0000","last_clean":"2024-09-19T12:03:11.878737+0000","last_became_active":"2024-09-19T11:35:31.584188+0000","last_became_peered":"2024-09-19T11:35:31.584188+0000","last_unstale":"2024-09-19T12:03:11.878737+0000","last_undegraded":"2024-09-19T12:03:11.878737+0000","last_fullsized":"2024-09-19T12:03:11.878737+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-19T12:03:11.878638+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-19T12:03:11.878638+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.878638+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:00.975718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":280,"num_read_kb":3453,"num_write":516,"num_write_kb":3250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.252949+0000","last_change":"2024-09-19T12:03:27.252949+0000","last_active":"2024-09-19T12:03:27.252949+0000","last_peered":"2024-09-19T12:03:27.252949+0000","last_clean":"2024-09-19T12:03:27.252949+0000","last_became_active":"2024-09-19T11:35:35.614650+0000","last_became_peered":"2024-09-19T11:35:35.614650+0000","last_unstale":"2024-09-19T12:03:27.252949+0000","last_undegraded":"2024-09-19T12:03:27.252949+0000","last_fullsized":"2024-09-19T12:03:27.252949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:27.252757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:27.252757+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.252757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:59.499972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'84","reported_seq":598,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.290551+0000","last_change":"2024-09-19T12:03:37.290551+0000","last_active":"2024-09-19T12:03:37.290551+0000","last_peered":"2024-09-19T12:03:37.290551+0000","last_clean":"2024-09-19T12:03:37.290551+0000","last_became_active":"2024-09-19T11:35:37.624951+0000","last_became_peered":"2024-09-19T11:35:37.624951+0000","last_unstale":"2024-09-19T12:03:37.290551+0000","last_undegraded":"2024-09-19T12:03:37.290551+0000","last_fullsized":"2024-09-19T12:03:37.290551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-19T12:03:37.290233+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-19T12:03:37.290233+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.290233+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:31.731550+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4425,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":175,"num_write":138,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:40.420849+0000","last_change":"2024-09-19T12:03:40.420849+0000","last_active":"2024-09-19T12:03:40.420849+0000","last_peered":"2024-09-19T12:03:40.420849+0000","last_clean":"2024-09-19T12:03:40.420849+0000","last_became_active":"2024-09-19T11:35:39.671181+0000","last_became_peered":"2024-09-19T11:35:39.671181+0000","last_unstale":"2024-09-19T12:03:40.420849+0000","last_undegraded":"2024-09-19T12:03:40.420849+0000","last_fullsized":"2024-09-19T12:03:40.420849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:40.420640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:40.420640+0000","last_clean_scrub_stamp":"2024-09-19T12:03:40.420640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:01.789165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'19","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:47.042410+0000","last_change":"2024-09-19T12:03:47.042410+0000","last_active":"2024-09-19T12:03:47.042410+0000","last_peered":"2024-09-19T12:03:47.042410+0000","last_clean":"2024-09-19T12:03:47.042410+0000","last_became_active":"2024-09-19T11:35:41.684966+0000","last_became_peered":"2024-09-19T11:35:41.684966+0000","last_unstale":"2024-09-19T12:03:47.042410+0000","last_undegraded":"2024-09-19T12:03:47.042410+0000","last_fullsized":"2024-09-19T12:03:47.042410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'19","last_scrub_stamp":"2024-09-19T12:03:47.042203+0000","last_deep_scrub":"264'19","last_deep_scrub_stamp":"2024-09-19T12:03:47.042203+0000","last_clean_scrub_stamp":"2024-09-19T12:03:47.042203+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:55.245020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":94,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'76","reported_seq":585,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.188684+0000","last_change":"2024-09-19T12:03:19.188684+0000","last_active":"2024-09-19T12:03:19.188684+0000","last_peered":"2024-09-19T12:03:19.188684+0000","last_clean":"2024-09-19T12:03:19.188684+0000","last_became_active":"2024-09-19T11:35:33.613369+0000","last_became_peered":"2024-09-19T11:35:33.613369+0000","last_unstale":"2024-09-19T12:03:19.188684+0000","last_undegraded":"2024-09-19T12:03:19.188684+0000","last_fullsized":"2024-09-19T12:03:19.188684+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'76","last_scrub_stamp":"2024-09-19T12:03:19.188503+0000","last_deep_scrub":"264'76","last_deep_scrub_stamp":"2024-09-19T12:03:19.188503+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.188503+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:38.489920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":221,"num_write":116,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'36","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:10.209055+0000","last_change":"2024-09-19T12:03:10.209055+0000","last_active":"2024-09-19T12:03:10.209055+0000","last_peered":"2024-09-19T12:03:10.209055+0000","last_clean":"2024-09-19T12:03:10.209055+0000","last_became_active":"2024-09-19T11:36:06.674998+0000","last_became_peered":"2024-09-19T11:36:06.674998+0000","last_unstale":"2024-09-19T12:03:10.209055+0000","last_undegraded":"2024-09-19T12:03:10.209055+0000","last_fullsized":"2024-09-19T12:03:10.209055+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-19T12:03:10.208928+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-19T12:03:10.208928+0000","last_clean_scrub_stamp":"2024-09-19T12:03:10.208928+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:37.689946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159858,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":7484,"num_write":135,"num_write_kb":7462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,7],"acting":[2,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.610447+0000","last_change":"2024-09-19T12:03:26.610447+0000","last_active":"2024-09-19T12:03:26.610447+0000","last_peered":"2024-09-19T12:03:26.610447+0000","last_clean":"2024-09-19T12:03:26.610447+0000","last_became_active":"2024-09-19T11:35:35.631702+0000","last_became_peered":"2024-09-19T11:35:35.631702+0000","last_unstale":"2024-09-19T12:03:26.610447+0000","last_undegraded":"2024-09-19T12:03:26.610447+0000","last_fullsized":"2024-09-19T12:03:26.610447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:26.610210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:26.610210+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.610210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:04.830912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'85","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.250375+0000","last_change":"2024-09-19T12:03:26.250375+0000","last_active":"2024-09-19T12:03:26.250375+0000","last_peered":"2024-09-19T12:03:26.250375+0000","last_clean":"2024-09-19T12:03:26.250375+0000","last_became_active":"2024-09-19T11:35:37.627720+0000","last_became_peered":"2024-09-19T11:35:37.627720+0000","last_unstale":"2024-09-19T12:03:26.250375+0000","last_undegraded":"2024-09-19T12:03:26.250375+0000","last_fullsized":"2024-09-19T12:03:26.250375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'85","last_scrub_stamp":"2024-09-19T12:03:26.250152+0000","last_deep_scrub":"264'85","last_deep_scrub_stamp":"2024-09-19T12:03:26.250152+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.250152+0000","objects_scrubbed":7,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:08.259486+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":113,"num_read_kb":175,"num_write":82,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'617","reported_seq":1636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.261666+0000","last_change":"2024-09-19T12:03:31.261666+0000","last_active":"2024-09-19T12:03:31.261666+0000","last_peered":"2024-09-19T12:03:31.261666+0000","last_clean":"2024-09-19T12:03:31.261666+0000","last_became_active":"2024-09-19T11:35:39.651203+0000","last_became_peered":"2024-09-19T11:35:39.651203+0000","last_unstale":"2024-09-19T12:03:31.261666+0000","last_undegraded":"2024-09-19T12:03:31.261666+0000","last_fullsized":"2024-09-19T12:03:31.261666+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'617","last_scrub_stamp":"2024-09-19T12:03:31.261479+0000","last_deep_scrub":"264'617","last_deep_scrub_stamp":"2024-09-19T12:03:31.261479+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.261479+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:29.161420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'9","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.526604+0000","last_change":"2024-09-19T12:03:35.526604+0000","last_active":"2024-09-19T12:03:35.526604+0000","last_peered":"2024-09-19T12:03:35.526604+0000","last_clean":"2024-09-19T12:03:35.526604+0000","last_became_active":"2024-09-19T11:35:41.691146+0000","last_became_peered":"2024-09-19T11:35:41.691146+0000","last_unstale":"2024-09-19T12:03:35.526604+0000","last_undegraded":"2024-09-19T12:03:35.526604+0000","last_fullsized":"2024-09-19T12:03:35.526604+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-19T12:03:35.526385+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-19T12:03:35.526385+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.526385+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:10:21.147182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":44,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'23","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.178016+0000","last_change":"2024-09-19T12:03:20.178016+0000","last_active":"2024-09-19T12:03:20.178016+0000","last_peered":"2024-09-19T12:03:20.178016+0000","last_clean":"2024-09-19T12:03:20.178016+0000","last_became_active":"2024-09-19T11:35:33.628232+0000","last_became_peered":"2024-09-19T11:35:33.628232+0000","last_unstale":"2024-09-19T12:03:20.178016+0000","last_undegraded":"2024-09-19T12:03:20.178016+0000","last_fullsized":"2024-09-19T12:03:20.178016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-19T12:03:20.177838+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-19T12:03:20.177838+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.177838+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:24.986969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'45","reported_seq":569,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.174331+0000","last_change":"2024-09-19T12:03:13.174080+0000","last_active":"2024-09-19T12:03:13.174331+0000","last_peered":"2024-09-19T12:03:13.174331+0000","last_clean":"2024-09-19T12:03:13.174331+0000","last_became_active":"2024-09-19T11:35:31.583509+0000","last_became_peered":"2024-09-19T11:35:31.583509+0000","last_unstale":"2024-09-19T12:03:13.174331+0000","last_undegraded":"2024-09-19T12:03:13.174331+0000","last_fullsized":"2024-09-19T12:03:13.174331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-19T12:03:13.173748+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-19T12:03:13.173748+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.173748+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:56.811201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":273,"num_write":141,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1318,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.428436+0000","last_change":"2024-09-19T12:03:32.428436+0000","last_active":"2024-09-19T12:03:32.428436+0000","last_peered":"2024-09-19T12:03:32.428436+0000","last_clean":"2024-09-19T12:03:32.428436+0000","last_became_active":"2024-09-19T11:35:35.629728+0000","last_became_peered":"2024-09-19T11:35:35.629728+0000","last_unstale":"2024-09-19T12:03:32.428436+0000","last_undegraded":"2024-09-19T12:03:32.428436+0000","last_fullsized":"2024-09-19T12:03:32.428436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-19T12:03:32.428222+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-19T12:03:32.428222+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.428222+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:26.448603+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":824,"num_read_kb":824,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'39","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.157841+0000","last_change":"2024-09-19T12:03:36.157841+0000","last_active":"2024-09-19T12:03:36.157841+0000","last_peered":"2024-09-19T12:03:36.157841+0000","last_clean":"2024-09-19T12:03:36.157841+0000","last_became_active":"2024-09-19T11:35:37.618061+0000","last_became_peered":"2024-09-19T11:35:37.618061+0000","last_unstale":"2024-09-19T12:03:36.157841+0000","last_undegraded":"2024-09-19T12:03:36.157841+0000","last_fullsized":"2024-09-19T12:03:36.157841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-19T12:03:36.157594+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-19T12:03:36.157594+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.157594+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:12.255735+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'617","reported_seq":1676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:28.170174+0000","last_change":"2024-09-19T12:03:28.170174+0000","last_active":"2024-09-19T12:03:28.170174+0000","last_peered":"2024-09-19T12:03:28.170174+0000","last_clean":"2024-09-19T12:03:28.170174+0000","last_became_active":"2024-09-19T11:35:39.670211+0000","last_became_peered":"2024-09-19T11:35:39.670211+0000","last_unstale":"2024-09-19T12:03:28.170174+0000","last_undegraded":"2024-09-19T12:03:28.170174+0000","last_fullsized":"2024-09-19T12:03:28.170174+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'617","last_scrub_stamp":"2024-09-19T12:03:28.169989+0000","last_deep_scrub":"264'617","last_deep_scrub_stamp":"2024-09-19T12:03:28.169989+0000","last_clean_scrub_stamp":"2024-09-19T12:03:28.169989+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:05.839158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'12","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:47.234199+0000","last_change":"2024-09-19T12:03:47.234199+0000","last_active":"2024-09-19T12:03:47.234199+0000","last_peered":"2024-09-19T12:03:47.234199+0000","last_clean":"2024-09-19T12:03:47.234199+0000","last_became_active":"2024-09-19T11:35:41.687793+0000","last_became_peered":"2024-09-19T11:35:41.687793+0000","last_unstale":"2024-09-19T12:03:47.234199+0000","last_undegraded":"2024-09-19T12:03:47.234199+0000","last_fullsized":"2024-09-19T12:03:47.234199+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'12","last_scrub_stamp":"2024-09-19T12:03:47.234010+0000","last_deep_scrub":"262'12","last_deep_scrub_stamp":"2024-09-19T12:03:47.234010+0000","last_clean_scrub_stamp":"2024-09-19T12:03:47.234010+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:35.638383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":22,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'40","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.635623+0000","last_change":"2024-09-19T12:03:19.635623+0000","last_active":"2024-09-19T12:03:19.635623+0000","last_peered":"2024-09-19T12:03:19.635623+0000","last_clean":"2024-09-19T12:03:19.635623+0000","last_became_active":"2024-09-19T11:35:33.602988+0000","last_became_peered":"2024-09-19T11:35:33.602988+0000","last_unstale":"2024-09-19T12:03:19.635623+0000","last_undegraded":"2024-09-19T12:03:19.635623+0000","last_fullsized":"2024-09-19T12:03:19.635623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-19T12:03:19.635443+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-19T12:03:19.635443+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.635443+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:03.547575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":120,"num_write":65,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'40","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.802310+0000","last_change":"2024-09-19T12:03:13.802138+0000","last_active":"2024-09-19T12:03:13.802310+0000","last_peered":"2024-09-19T12:03:13.802310+0000","last_clean":"2024-09-19T12:03:13.802310+0000","last_became_active":"2024-09-19T11:36:06.675863+0000","last_became_peered":"2024-09-19T11:36:06.675863+0000","last_unstale":"2024-09-19T12:03:13.802310+0000","last_undegraded":"2024-09-19T12:03:13.802310+0000","last_fullsized":"2024-09-19T12:03:13.802310+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-19T12:03:13.801874+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-19T12:03:13.801874+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.801874+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:21.385518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":74,"num_read_kb":59,"num_write":161,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.193009+0000","last_change":"2024-09-19T12:03:33.193009+0000","last_active":"2024-09-19T12:03:33.193009+0000","last_peered":"2024-09-19T12:03:33.193009+0000","last_clean":"2024-09-19T12:03:33.193009+0000","last_became_active":"2024-09-19T11:35:35.623987+0000","last_became_peered":"2024-09-19T11:35:35.623987+0000","last_unstale":"2024-09-19T12:03:33.193009+0000","last_undegraded":"2024-09-19T12:03:33.193009+0000","last_fullsized":"2024-09-19T12:03:33.193009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:33.192820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:33.192820+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.192820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:58:23.778586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'123","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.386730+0000","last_change":"2024-09-19T12:03:38.386730+0000","last_active":"2024-09-19T12:03:38.386730+0000","last_peered":"2024-09-19T12:03:38.386730+0000","last_clean":"2024-09-19T12:03:38.386730+0000","last_became_active":"2024-09-19T11:35:37.627374+0000","last_became_peered":"2024-09-19T11:35:37.627374+0000","last_unstale":"2024-09-19T12:03:38.386730+0000","last_undegraded":"2024-09-19T12:03:38.386730+0000","last_fullsized":"2024-09-19T12:03:38.386730+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'123","last_scrub_stamp":"2024-09-19T12:03:38.386540+0000","last_deep_scrub":"264'123","last_deep_scrub_stamp":"2024-09-19T12:03:38.386540+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.386540+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:36.148408+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4881,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":162,"num_read_kb":205,"num_write":112,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.172745+0000","last_change":"2024-09-19T12:03:33.172745+0000","last_active":"2024-09-19T12:03:33.172745+0000","last_peered":"2024-09-19T12:03:33.172745+0000","last_clean":"2024-09-19T12:03:33.172745+0000","last_became_active":"2024-09-19T11:35:39.666071+0000","last_became_peered":"2024-09-19T11:35:39.666071+0000","last_unstale":"2024-09-19T12:03:33.172745+0000","last_undegraded":"2024-09-19T12:03:33.172745+0000","last_fullsized":"2024-09-19T12:03:33.172745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:33.172561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:33.172561+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.172561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:02.174773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'11","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.542054+0000","last_change":"2024-09-19T12:03:33.542054+0000","last_active":"2024-09-19T12:03:33.542054+0000","last_peered":"2024-09-19T12:03:33.542054+0000","last_clean":"2024-09-19T12:03:33.542054+0000","last_became_active":"2024-09-19T11:35:41.680850+0000","last_became_peered":"2024-09-19T11:35:41.680850+0000","last_unstale":"2024-09-19T12:03:33.542054+0000","last_undegraded":"2024-09-19T12:03:33.542054+0000","last_fullsized":"2024-09-19T12:03:33.542054+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-19T12:03:33.541879+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-19T12:03:33.541879+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.541879+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:15.736623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":41,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'9","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.078394+0000","last_change":"2024-09-19T12:03:19.078394+0000","last_active":"2024-09-19T12:03:19.078394+0000","last_peered":"2024-09-19T12:03:19.078394+0000","last_clean":"2024-09-19T12:03:19.078394+0000","last_became_active":"2024-09-19T11:35:33.632623+0000","last_became_peered":"2024-09-19T11:35:33.632623+0000","last_unstale":"2024-09-19T12:03:19.078394+0000","last_undegraded":"2024-09-19T12:03:19.078394+0000","last_fullsized":"2024-09-19T12:03:19.078394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-19T12:03:19.078208+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-19T12:03:19.078208+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.078208+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:23.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.394892+0000","last_change":"2024-09-19T12:03:12.394743+0000","last_active":"2024-09-19T12:03:12.394892+0000","last_peered":"2024-09-19T12:03:12.394892+0000","last_clean":"2024-09-19T12:03:12.394892+0000","last_became_active":"2024-09-19T11:35:14.133710+0000","last_became_peered":"2024-09-19T11:35:14.133710+0000","last_unstale":"2024-09-19T12:03:12.394892+0000","last_undegraded":"2024-09-19T12:03:12.394892+0000","last_fullsized":"2024-09-19T12:03:12.394892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-19T12:03:12.394517+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-19T12:03:12.394517+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.394517+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:38.496999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.633137+0000","last_change":"2024-09-19T12:03:12.633137+0000","last_active":"2024-09-19T12:03:12.633137+0000","last_peered":"2024-09-19T12:03:12.633137+0000","last_clean":"2024-09-19T12:03:12.633137+0000","last_became_active":"2024-09-19T11:35:19.150393+0000","last_became_peered":"2024-09-19T11:35:19.150393+0000","last_unstale":"2024-09-19T12:03:12.633137+0000","last_undegraded":"2024-09-19T12:03:12.633137+0000","last_fullsized":"2024-09-19T12:03:12.633137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:12.632962+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:12.632962+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.632962+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:48.310693+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001387466,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'66","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:10.871111+0000","last_change":"2024-09-19T12:03:10.871111+0000","last_active":"2024-09-19T12:03:10.871111+0000","last_peered":"2024-09-19T12:03:10.871111+0000","last_clean":"2024-09-19T12:03:10.871111+0000","last_became_active":"2024-09-19T11:35:31.592913+0000","last_became_peered":"2024-09-19T11:35:31.592913+0000","last_unstale":"2024-09-19T12:03:10.871111+0000","last_undegraded":"2024-09-19T12:03:10.871111+0000","last_fullsized":"2024-09-19T12:03:10.871111+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'66","last_scrub_stamp":"2024-09-19T12:03:10.870980+0000","last_deep_scrub":"264'66","last_deep_scrub_stamp":"2024-09-19T12:03:10.870980+0000","last_clean_scrub_stamp":"2024-09-19T12:03:10.870980+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:03.024253+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":2042,"num_write":253,"num_write_kb":1946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.344639+0000","last_change":"2024-09-19T12:03:29.344639+0000","last_active":"2024-09-19T12:03:29.344639+0000","last_peered":"2024-09-19T12:03:29.344639+0000","last_clean":"2024-09-19T12:03:29.344639+0000","last_became_active":"2024-09-19T11:35:35.602892+0000","last_became_peered":"2024-09-19T11:35:35.602892+0000","last_unstale":"2024-09-19T12:03:29.344639+0000","last_undegraded":"2024-09-19T12:03:29.344639+0000","last_fullsized":"2024-09-19T12:03:29.344639+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:29.344460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:29.344460+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.344460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:37.393924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'193","reported_seq":738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.458741+0000","last_change":"2024-09-19T12:03:36.458610+0000","last_active":"2024-09-19T12:03:36.458741+0000","last_peered":"2024-09-19T12:03:36.458741+0000","last_clean":"2024-09-19T12:03:36.458741+0000","last_became_active":"2024-09-19T11:35:37.636399+0000","last_became_peered":"2024-09-19T11:35:37.636399+0000","last_unstale":"2024-09-19T12:03:36.458741+0000","last_undegraded":"2024-09-19T12:03:36.458741+0000","last_fullsized":"2024-09-19T12:03:36.458741+0000","mapping_epoch":32,"log_start":"262'100","ondisk_log_start":"262'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-19T12:03:36.458426+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-19T12:03:36.458426+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.458426+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:32.128453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17019,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":284,"num_read_kb":496,"num_write":256,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18696,"num_omap_keys":48,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:42.397733+0000","last_change":"2024-09-19T12:03:42.397563+0000","last_active":"2024-09-19T12:03:42.397733+0000","last_peered":"2024-09-19T12:03:42.397733+0000","last_clean":"2024-09-19T12:03:42.397733+0000","last_became_active":"2024-09-19T11:35:39.680298+0000","last_became_peered":"2024-09-19T11:35:39.680298+0000","last_unstale":"2024-09-19T12:03:42.397733+0000","last_undegraded":"2024-09-19T12:03:42.397733+0000","last_fullsized":"2024-09-19T12:03:42.397733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:42.397384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:42.397384+0000","last_clean_scrub_stamp":"2024-09-19T12:03:42.397384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:34.274736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'53","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.156045+0000","last_change":"2024-09-19T12:03:34.155875+0000","last_active":"2024-09-19T12:03:34.156045+0000","last_peered":"2024-09-19T12:03:34.156045+0000","last_clean":"2024-09-19T12:03:34.156045+0000","last_became_active":"2024-09-19T11:35:41.679219+0000","last_became_peered":"2024-09-19T11:35:41.679219+0000","last_unstale":"2024-09-19T12:03:34.156045+0000","last_undegraded":"2024-09-19T12:03:34.156045+0000","last_fullsized":"2024-09-19T12:03:34.156045+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'53","last_scrub_stamp":"2024-09-19T12:03:34.155648+0000","last_deep_scrub":"264'53","last_deep_scrub_stamp":"2024-09-19T12:03:34.155648+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.155648+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:10.140550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":334,"num_read_kb":278,"num_write":121,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'140","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.342183+0000","last_change":"2024-09-19T12:03:20.341912+0000","last_active":"2024-09-19T12:03:20.342183+0000","last_peered":"2024-09-19T12:03:20.342183+0000","last_clean":"2024-09-19T12:03:20.342183+0000","last_became_active":"2024-09-19T11:35:33.622065+0000","last_became_peered":"2024-09-19T11:35:33.622065+0000","last_unstale":"2024-09-19T12:03:20.342183+0000","last_undegraded":"2024-09-19T12:03:20.342183+0000","last_fullsized":"2024-09-19T12:03:20.342183+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'140","last_scrub_stamp":"2024-09-19T12:03:20.341668+0000","last_deep_scrub":"264'140","last_deep_scrub_stamp":"2024-09-19T12:03:20.341668+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.341668+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:22.627813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":557,"num_read_kb":440,"num_write":210,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.404458+0000","last_change":"2024-09-19T12:03:13.404311+0000","last_active":"2024-09-19T12:03:13.404458+0000","last_peered":"2024-09-19T12:03:13.404458+0000","last_clean":"2024-09-19T12:03:13.404458+0000","last_became_active":"2024-09-19T11:35:19.154360+0000","last_became_peered":"2024-09-19T11:35:19.154360+0000","last_unstale":"2024-09-19T12:03:13.404458+0000","last_undegraded":"2024-09-19T12:03:13.404458+0000","last_fullsized":"2024-09-19T12:03:13.404458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:13.404135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:13.404135+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.404135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:10.610779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00086516000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'39","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:10.351635+0000","last_change":"2024-09-19T12:03:10.351635+0000","last_active":"2024-09-19T12:03:10.351635+0000","last_peered":"2024-09-19T12:03:10.351635+0000","last_clean":"2024-09-19T12:03:10.351635+0000","last_became_active":"2024-09-19T11:36:06.677474+0000","last_became_peered":"2024-09-19T11:36:06.677474+0000","last_unstale":"2024-09-19T12:03:10.351635+0000","last_undegraded":"2024-09-19T12:03:10.351635+0000","last_fullsized":"2024-09-19T12:03:10.351635+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-19T12:03:10.351428+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-19T12:03:10.351428+0000","last_clean_scrub_stamp":"2024-09-19T12:03:10.351428+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:56.653131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":49,"num_write":146,"num_write_kb":5149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,5],"acting":[0,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.456265+0000","last_change":"2024-09-19T12:03:30.456114+0000","last_active":"2024-09-19T12:03:30.456265+0000","last_peered":"2024-09-19T12:03:30.456265+0000","last_clean":"2024-09-19T12:03:30.456265+0000","last_became_active":"2024-09-19T11:35:35.616382+0000","last_became_peered":"2024-09-19T11:35:35.616382+0000","last_unstale":"2024-09-19T12:03:30.456265+0000","last_undegraded":"2024-09-19T12:03:30.456265+0000","last_fullsized":"2024-09-19T12:03:30.456265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:30.455919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:30.455919+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.455919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:26.198826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'576","reported_seq":1642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.670142+0000","last_change":"2024-09-19T12:03:27.670142+0000","last_active":"2024-09-19T12:03:27.670142+0000","last_peered":"2024-09-19T12:03:27.670142+0000","last_clean":"2024-09-19T12:03:27.670142+0000","last_became_active":"2024-09-19T11:35:37.640355+0000","last_became_peered":"2024-09-19T11:35:37.640355+0000","last_unstale":"2024-09-19T12:03:27.670142+0000","last_undegraded":"2024-09-19T12:03:27.670142+0000","last_fullsized":"2024-09-19T12:03:27.670142+0000","mapping_epoch":32,"log_start":"264'501","ondisk_log_start":"264'501","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'576","last_scrub_stamp":"2024-09-19T12:03:27.669943+0000","last_deep_scrub":"264'576","last_deep_scrub_stamp":"2024-09-19T12:03:27.669943+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.669943+0000","objects_scrubbed":10,"log_size":75,"log_dups_size":501,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:37.864311+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13007,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":828,"num_read_kb":979,"num_write":162,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:39.296576+0000","last_change":"2024-09-19T12:03:39.296576+0000","last_active":"2024-09-19T12:03:39.296576+0000","last_peered":"2024-09-19T12:03:39.296576+0000","last_clean":"2024-09-19T12:03:39.296576+0000","last_became_active":"2024-09-19T11:35:39.675795+0000","last_became_peered":"2024-09-19T11:35:39.675795+0000","last_unstale":"2024-09-19T12:03:39.296576+0000","last_undegraded":"2024-09-19T12:03:39.296576+0000","last_fullsized":"2024-09-19T12:03:39.296576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:39.296395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:39.296395+0000","last_clean_scrub_stamp":"2024-09-19T12:03:39.296395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:34.481429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'11","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.558986+0000","last_change":"2024-09-19T12:03:37.558986+0000","last_active":"2024-09-19T12:03:37.558986+0000","last_peered":"2024-09-19T12:03:37.558986+0000","last_clean":"2024-09-19T12:03:37.558986+0000","last_became_active":"2024-09-19T11:35:41.678660+0000","last_became_peered":"2024-09-19T11:35:41.678660+0000","last_unstale":"2024-09-19T12:03:37.558986+0000","last_undegraded":"2024-09-19T12:03:37.558986+0000","last_fullsized":"2024-09-19T12:03:37.558986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-19T12:03:37.558701+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-19T12:03:37.558701+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.558701+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:49.642530+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'21","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.201825+0000","last_change":"2024-09-19T12:03:16.201825+0000","last_active":"2024-09-19T12:03:16.201825+0000","last_peered":"2024-09-19T12:03:16.201825+0000","last_clean":"2024-09-19T12:03:16.201825+0000","last_became_active":"2024-09-19T11:36:06.673265+0000","last_became_peered":"2024-09-19T11:36:06.673265+0000","last_unstale":"2024-09-19T12:03:16.201825+0000","last_undegraded":"2024-09-19T12:03:16.201825+0000","last_fullsized":"2024-09-19T12:03:16.201825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'21","last_scrub_stamp":"2024-09-19T12:03:16.201641+0000","last_deep_scrub":"264'21","last_deep_scrub_stamp":"2024-09-19T12:03:16.201641+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.201641+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:05.081031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":39,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.219942+0000","last_change":"2024-09-19T12:03:11.219942+0000","last_active":"2024-09-19T12:03:11.219942+0000","last_peered":"2024-09-19T12:03:11.219942+0000","last_clean":"2024-09-19T12:03:11.219942+0000","last_became_active":"2024-09-19T11:35:19.969368+0000","last_became_peered":"2024-09-19T11:35:19.969368+0000","last_unstale":"2024-09-19T12:03:11.219942+0000","last_undegraded":"2024-09-19T12:03:11.219942+0000","last_fullsized":"2024-09-19T12:03:11.219942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:11.219865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:11.219865+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.219865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:54.638380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001160424,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'23","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.681897+0000","last_change":"2024-09-19T12:03:12.681813+0000","last_active":"2024-09-19T12:03:12.681897+0000","last_peered":"2024-09-19T12:03:12.681897+0000","last_clean":"2024-09-19T12:03:12.681897+0000","last_became_active":"2024-09-19T11:35:31.590860+0000","last_became_peered":"2024-09-19T11:35:31.590860+0000","last_unstale":"2024-09-19T12:03:12.681897+0000","last_undegraded":"2024-09-19T12:03:12.681897+0000","last_fullsized":"2024-09-19T12:03:12.681897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-19T12:03:12.681706+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-19T12:03:12.681706+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.681706+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:42.006727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":67,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.269779+0000","last_change":"2024-09-19T12:03:23.269623+0000","last_active":"2024-09-19T12:03:23.269779+0000","last_peered":"2024-09-19T12:03:23.269779+0000","last_clean":"2024-09-19T12:03:23.269779+0000","last_became_active":"2024-09-19T11:35:35.611092+0000","last_became_peered":"2024-09-19T11:35:35.611092+0000","last_unstale":"2024-09-19T12:03:23.269779+0000","last_undegraded":"2024-09-19T12:03:23.269779+0000","last_fullsized":"2024-09-19T12:03:23.269779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:23.269446+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:23.269446+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.269446+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:58.973432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'125","reported_seq":981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.355751+0000","last_change":"2024-09-19T12:03:34.355751+0000","last_active":"2024-09-19T12:03:34.355751+0000","last_peered":"2024-09-19T12:03:34.355751+0000","last_clean":"2024-09-19T12:03:34.355751+0000","last_became_active":"2024-09-19T11:35:37.647356+0000","last_became_peered":"2024-09-19T11:35:37.647356+0000","last_unstale":"2024-09-19T12:03:34.355751+0000","last_undegraded":"2024-09-19T12:03:34.355751+0000","last_fullsized":"2024-09-19T12:03:34.355751+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-19T12:03:34.355541+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-19T12:03:34.355541+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.355541+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:14.828090+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":120,"num_read_kb":109,"num_write":73,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.417241+0000","last_change":"2024-09-19T12:03:34.417241+0000","last_active":"2024-09-19T12:03:34.417241+0000","last_peered":"2024-09-19T12:03:34.417241+0000","last_clean":"2024-09-19T12:03:34.417241+0000","last_became_active":"2024-09-19T11:35:39.672352+0000","last_became_peered":"2024-09-19T11:35:39.672352+0000","last_unstale":"2024-09-19T12:03:34.417241+0000","last_undegraded":"2024-09-19T12:03:34.417241+0000","last_fullsized":"2024-09-19T12:03:34.417241+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:34.417054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:34.417054+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.417054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:26.370739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'102","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:50.054520+0000","last_change":"2024-09-19T12:03:50.054520+0000","last_active":"2024-09-19T12:03:50.054520+0000","last_peered":"2024-09-19T12:03:50.054520+0000","last_clean":"2024-09-19T12:03:50.054520+0000","last_became_active":"2024-09-19T11:35:41.688239+0000","last_became_peered":"2024-09-19T11:35:41.688239+0000","last_unstale":"2024-09-19T12:03:50.054520+0000","last_undegraded":"2024-09-19T12:03:50.054520+0000","last_fullsized":"2024-09-19T12:03:50.054520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-19T12:03:50.054287+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-19T12:03:50.054287+0000","last_clean_scrub_stamp":"2024-09-19T12:03:50.054287+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:57.056674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":254,"num_write":203,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'2","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.582468+0000","last_change":"2024-09-19T12:03:21.582468+0000","last_active":"2024-09-19T12:03:21.582468+0000","last_peered":"2024-09-19T12:03:21.582468+0000","last_clean":"2024-09-19T12:03:21.582468+0000","last_became_active":"2024-09-19T11:35:33.600618+0000","last_became_peered":"2024-09-19T11:35:33.600618+0000","last_unstale":"2024-09-19T12:03:21.582468+0000","last_undegraded":"2024-09-19T12:03:21.582468+0000","last_fullsized":"2024-09-19T12:03:21.582468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:21.582273+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:21.582273+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.582273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:26.811728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.597210+0000","last_change":"2024-09-19T12:03:11.597210+0000","last_active":"2024-09-19T12:03:11.597210+0000","last_peered":"2024-09-19T12:03:11.597210+0000","last_clean":"2024-09-19T12:03:11.597210+0000","last_became_active":"2024-09-19T11:35:19.151363+0000","last_became_peered":"2024-09-19T11:35:19.151363+0000","last_unstale":"2024-09-19T12:03:11.597210+0000","last_undegraded":"2024-09-19T12:03:11.597210+0000","last_fullsized":"2024-09-19T12:03:11.597210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:11.597027+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:11.597027+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.597027+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:03.179149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0028321980000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'37","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.149677+0000","last_change":"2024-09-19T12:03:11.149677+0000","last_active":"2024-09-19T12:03:11.149677+0000","last_peered":"2024-09-19T12:03:11.149677+0000","last_clean":"2024-09-19T12:03:11.149677+0000","last_became_active":"2024-09-19T11:35:31.587649+0000","last_became_peered":"2024-09-19T11:35:31.587649+0000","last_unstale":"2024-09-19T12:03:11.149677+0000","last_undegraded":"2024-09-19T12:03:11.149677+0000","last_fullsized":"2024-09-19T12:03:11.149677+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:11.149486+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:11.149486+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.149486+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:59.305634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":1908,"num_write":132,"num_write_kb":8008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.364818+0000","last_change":"2024-09-19T12:03:31.364818+0000","last_active":"2024-09-19T12:03:31.364818+0000","last_peered":"2024-09-19T12:03:31.364818+0000","last_clean":"2024-09-19T12:03:31.364818+0000","last_became_active":"2024-09-19T11:35:35.617200+0000","last_became_peered":"2024-09-19T11:35:35.617200+0000","last_unstale":"2024-09-19T12:03:31.364818+0000","last_undegraded":"2024-09-19T12:03:31.364818+0000","last_fullsized":"2024-09-19T12:03:31.364818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:31.364643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:31.364643+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.364643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:59.320407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'76","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.174885+0000","last_change":"2024-09-19T12:03:34.174706+0000","last_active":"2024-09-19T12:03:34.174885+0000","last_peered":"2024-09-19T12:03:34.174885+0000","last_clean":"2024-09-19T12:03:34.174885+0000","last_became_active":"2024-09-19T11:35:37.643310+0000","last_became_peered":"2024-09-19T11:35:37.643310+0000","last_unstale":"2024-09-19T12:03:34.174885+0000","last_undegraded":"2024-09-19T12:03:34.174885+0000","last_fullsized":"2024-09-19T12:03:34.174885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'76","last_scrub_stamp":"2024-09-19T12:03:34.174513+0000","last_deep_scrub":"264'76","last_deep_scrub_stamp":"2024-09-19T12:03:34.174513+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.174513+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:28.148897+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":101,"num_read_kb":95,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1630,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.154187+0000","last_change":"2024-09-19T12:03:26.154053+0000","last_active":"2024-09-19T12:03:26.154187+0000","last_peered":"2024-09-19T12:03:26.154187+0000","last_clean":"2024-09-19T12:03:26.154187+0000","last_became_active":"2024-09-19T11:35:39.669555+0000","last_became_peered":"2024-09-19T11:35:39.669555+0000","last_unstale":"2024-09-19T12:03:26.154187+0000","last_undegraded":"2024-09-19T12:03:26.154187+0000","last_fullsized":"2024-09-19T12:03:26.154187+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:26.153871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:26.153871+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.153871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:04.128938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'22","reported_seq":568,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.415159+0000","last_change":"2024-09-19T12:03:43.414989+0000","last_active":"2024-09-19T12:03:43.415159+0000","last_peered":"2024-09-19T12:03:43.415159+0000","last_clean":"2024-09-19T12:03:43.415159+0000","last_became_active":"2024-09-19T11:35:41.678167+0000","last_became_peered":"2024-09-19T11:35:41.678167+0000","last_unstale":"2024-09-19T12:03:43.415159+0000","last_undegraded":"2024-09-19T12:03:43.415159+0000","last_fullsized":"2024-09-19T12:03:43.415159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-19T12:03:43.414805+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-19T12:03:43.414805+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.414805+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:59.296157+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":65,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'93","reported_seq":617,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.642760+0000","last_change":"2024-09-19T12:03:17.642760+0000","last_active":"2024-09-19T12:03:17.642760+0000","last_peered":"2024-09-19T12:03:17.642760+0000","last_clean":"2024-09-19T12:03:17.642760+0000","last_became_active":"2024-09-19T11:35:33.605504+0000","last_became_peered":"2024-09-19T11:35:33.605504+0000","last_unstale":"2024-09-19T12:03:17.642760+0000","last_undegraded":"2024-09-19T12:03:17.642760+0000","last_fullsized":"2024-09-19T12:03:17.642760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'93","last_scrub_stamp":"2024-09-19T12:03:17.642564+0000","last_deep_scrub":"264'93","last_deep_scrub_stamp":"2024-09-19T12:03:17.642564+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.642564+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:31.968881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":306,"num_write":160,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'51","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.600803+0000","last_change":"2024-09-19T12:03:14.600803+0000","last_active":"2024-09-19T12:03:14.600803+0000","last_peered":"2024-09-19T12:03:14.600803+0000","last_clean":"2024-09-19T12:03:14.600803+0000","last_became_active":"2024-09-19T11:35:31.616954+0000","last_became_peered":"2024-09-19T11:35:31.616954+0000","last_unstale":"2024-09-19T12:03:14.600803+0000","last_undegraded":"2024-09-19T12:03:14.600803+0000","last_fullsized":"2024-09-19T12:03:14.600803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-09-19T12:03:14.600577+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-09-19T12:03:14.600577+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.600577+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.062823+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":2718,"num_write":157,"num_write_kb":7832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:09.590670+0000","last_change":"2024-09-19T12:03:09.590670+0000","last_active":"2024-09-19T12:03:09.590670+0000","last_peered":"2024-09-19T12:03:09.590670+0000","last_clean":"2024-09-19T12:03:09.590670+0000","last_became_active":"2024-09-19T11:35:20.096557+0000","last_became_peered":"2024-09-19T11:35:20.096557+0000","last_unstale":"2024-09-19T12:03:09.590670+0000","last_undegraded":"2024-09-19T12:03:09.590670+0000","last_fullsized":"2024-09-19T12:03:09.590670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:09.590597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:09.590597+0000","last_clean_scrub_stamp":"2024-09-19T12:03:09.590597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:47.764407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010463289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:28.401242+0000","last_change":"2024-09-19T12:03:28.401242+0000","last_active":"2024-09-19T12:03:28.401242+0000","last_peered":"2024-09-19T12:03:28.401242+0000","last_clean":"2024-09-19T12:03:28.401242+0000","last_became_active":"2024-09-19T11:35:35.623450+0000","last_became_peered":"2024-09-19T11:35:35.623450+0000","last_unstale":"2024-09-19T12:03:28.401242+0000","last_undegraded":"2024-09-19T12:03:28.401242+0000","last_fullsized":"2024-09-19T12:03:28.401242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:28.401070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:28.401070+0000","last_clean_scrub_stamp":"2024-09-19T12:03:28.401070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:05.593501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'157","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.381152+0000","last_change":"2024-09-19T12:03:30.381007+0000","last_active":"2024-09-19T12:03:30.381152+0000","last_peered":"2024-09-19T12:03:30.381152+0000","last_clean":"2024-09-19T12:03:30.381152+0000","last_became_active":"2024-09-19T11:35:37.637234+0000","last_became_peered":"2024-09-19T11:35:37.637234+0000","last_unstale":"2024-09-19T12:03:30.381152+0000","last_undegraded":"2024-09-19T12:03:30.381152+0000","last_fullsized":"2024-09-19T12:03:30.381152+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'157","last_scrub_stamp":"2024-09-19T12:03:30.380809+0000","last_deep_scrub":"264'157","last_deep_scrub_stamp":"2024-09-19T12:03:30.380809+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.380809+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:29.098974+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9930,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":215,"num_read_kb":331,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:40.239687+0000","last_change":"2024-09-19T12:03:40.239687+0000","last_active":"2024-09-19T12:03:40.239687+0000","last_peered":"2024-09-19T12:03:40.239687+0000","last_clean":"2024-09-19T12:03:40.239687+0000","last_became_active":"2024-09-19T11:35:39.669914+0000","last_became_peered":"2024-09-19T11:35:39.669914+0000","last_unstale":"2024-09-19T12:03:40.239687+0000","last_undegraded":"2024-09-19T12:03:40.239687+0000","last_fullsized":"2024-09-19T12:03:40.239687+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:40.239501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:40.239501+0000","last_clean_scrub_stamp":"2024-09-19T12:03:40.239501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:17.796385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'13","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:45.420294+0000","last_change":"2024-09-19T12:03:45.420294+0000","last_active":"2024-09-19T12:03:45.420294+0000","last_peered":"2024-09-19T12:03:45.420294+0000","last_clean":"2024-09-19T12:03:45.420294+0000","last_became_active":"2024-09-19T11:35:41.690257+0000","last_became_peered":"2024-09-19T11:35:41.690257+0000","last_unstale":"2024-09-19T12:03:45.420294+0000","last_undegraded":"2024-09-19T12:03:45.420294+0000","last_fullsized":"2024-09-19T12:03:45.420294+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-19T12:03:45.420109+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-19T12:03:45.420109+0000","last_clean_scrub_stamp":"2024-09-19T12:03:45.420109+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:02:55.611588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'203","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.356932+0000","last_change":"2024-09-19T12:03:19.356932+0000","last_active":"2024-09-19T12:03:19.356932+0000","last_peered":"2024-09-19T12:03:19.356932+0000","last_clean":"2024-09-19T12:03:19.356932+0000","last_became_active":"2024-09-19T11:35:33.614327+0000","last_became_peered":"2024-09-19T11:35:33.614327+0000","last_unstale":"2024-09-19T12:03:19.356932+0000","last_undegraded":"2024-09-19T12:03:19.356932+0000","last_fullsized":"2024-09-19T12:03:19.356932+0000","mapping_epoch":28,"log_start":"256'100","ondisk_log_start":"256'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-19T12:03:19.356748+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-19T12:03:19.356748+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.356748+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:19.180282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":855,"num_read_kb":681,"num_write":310,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4002,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'50","reported_seq":574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.664317+0000","last_change":"2024-09-19T12:03:11.664317+0000","last_active":"2024-09-19T12:03:11.664317+0000","last_peered":"2024-09-19T12:03:11.664317+0000","last_clean":"2024-09-19T12:03:11.664317+0000","last_became_active":"2024-09-19T11:35:31.598447+0000","last_became_peered":"2024-09-19T11:35:31.598447+0000","last_unstale":"2024-09-19T12:03:11.664317+0000","last_undegraded":"2024-09-19T12:03:11.664317+0000","last_fullsized":"2024-09-19T12:03:11.664317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-19T12:03:11.664190+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-19T12:03:11.664190+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.664190+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:30.648508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":9296,"num_write":144,"num_write_kb":14398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.367464+0000","last_change":"2024-09-19T12:03:14.367464+0000","last_active":"2024-09-19T12:03:14.367464+0000","last_peered":"2024-09-19T12:03:14.367464+0000","last_clean":"2024-09-19T12:03:14.367464+0000","last_became_active":"2024-09-19T11:35:20.094400+0000","last_became_peered":"2024-09-19T11:35:20.094400+0000","last_unstale":"2024-09-19T12:03:14.367464+0000","last_undegraded":"2024-09-19T12:03:14.367464+0000","last_fullsized":"2024-09-19T12:03:14.367464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:14.367287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:14.367287+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.367287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:29.641318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088955000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"264'6","reported_seq":905,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.136790+0000","last_change":"2024-09-19T12:03:24.136790+0000","last_active":"2024-09-19T12:03:24.136790+0000","last_peered":"2024-09-19T12:03:24.136790+0000","last_clean":"2024-09-19T12:03:24.136790+0000","last_became_active":"2024-09-19T11:35:35.619212+0000","last_became_peered":"2024-09-19T11:35:35.619212+0000","last_unstale":"2024-09-19T12:03:24.136790+0000","last_undegraded":"2024-09-19T12:03:24.136790+0000","last_fullsized":"2024-09-19T12:03:24.136790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-19T12:03:24.136614+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-19T12:03:24.136614+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.136614+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:13.802174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":630,"num_read_kb":1029,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'107","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.570164+0000","last_change":"2024-09-19T12:03:32.570164+0000","last_active":"2024-09-19T12:03:32.570164+0000","last_peered":"2024-09-19T12:03:32.570164+0000","last_clean":"2024-09-19T12:03:32.570164+0000","last_became_active":"2024-09-19T11:35:37.629547+0000","last_became_peered":"2024-09-19T11:35:37.629547+0000","last_unstale":"2024-09-19T12:03:32.570164+0000","last_undegraded":"2024-09-19T12:03:32.570164+0000","last_fullsized":"2024-09-19T12:03:32.570164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-19T12:03:32.569956+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-19T12:03:32.569956+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.569956+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:59.624944+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":151,"num_read_kb":144,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'621","reported_seq":1664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:40.387347+0000","last_change":"2024-09-19T12:03:40.387168+0000","last_active":"2024-09-19T12:03:40.387347+0000","last_peered":"2024-09-19T12:03:40.387347+0000","last_clean":"2024-09-19T12:03:40.387347+0000","last_became_active":"2024-09-19T11:35:39.681476+0000","last_became_peered":"2024-09-19T11:35:39.681476+0000","last_unstale":"2024-09-19T12:03:40.387347+0000","last_undegraded":"2024-09-19T12:03:40.387347+0000","last_fullsized":"2024-09-19T12:03:40.387347+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'621","last_scrub_stamp":"2024-09-19T12:03:40.386984+0000","last_deep_scrub":"264'621","last_deep_scrub_stamp":"2024-09-19T12:03:40.386984+0000","last_clean_scrub_stamp":"2024-09-19T12:03:40.386984+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":600,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:18.703854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'16","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:48.089358+0000","last_change":"2024-09-19T12:03:48.089358+0000","last_active":"2024-09-19T12:03:48.089358+0000","last_peered":"2024-09-19T12:03:48.089358+0000","last_clean":"2024-09-19T12:03:48.089358+0000","last_became_active":"2024-09-19T11:35:41.670410+0000","last_became_peered":"2024-09-19T11:35:41.670410+0000","last_unstale":"2024-09-19T12:03:48.089358+0000","last_undegraded":"2024-09-19T12:03:48.089358+0000","last_fullsized":"2024-09-19T12:03:48.089358+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-19T12:03:48.089146+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-19T12:03:48.089146+0000","last_clean_scrub_stamp":"2024-09-19T12:03:48.089146+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:19.902829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":68,"num_write":44,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'111","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.829095+0000","last_change":"2024-09-19T12:03:20.828943+0000","last_active":"2024-09-19T12:03:20.829095+0000","last_peered":"2024-09-19T12:03:20.829095+0000","last_clean":"2024-09-19T12:03:20.829095+0000","last_became_active":"2024-09-19T11:35:33.624885+0000","last_became_peered":"2024-09-19T11:35:33.624885+0000","last_unstale":"2024-09-19T12:03:20.829095+0000","last_undegraded":"2024-09-19T12:03:20.829095+0000","last_fullsized":"2024-09-19T12:03:20.829095+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'111","last_scrub_stamp":"2024-09-19T12:03:20.828759+0000","last_deep_scrub":"264'111","last_deep_scrub_stamp":"2024-09-19T12:03:20.828759+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.828759+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:06.866014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":317,"num_write":191,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'36","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.845577+0000","last_change":"2024-09-19T12:03:12.845432+0000","last_active":"2024-09-19T12:03:12.845577+0000","last_peered":"2024-09-19T12:03:12.845577+0000","last_clean":"2024-09-19T12:03:12.845577+0000","last_became_active":"2024-09-19T11:36:06.649117+0000","last_became_peered":"2024-09-19T11:36:06.649117+0000","last_unstale":"2024-09-19T12:03:12.845577+0000","last_undegraded":"2024-09-19T12:03:12.845577+0000","last_fullsized":"2024-09-19T12:03:12.845577+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-19T12:03:12.845221+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-19T12:03:12.845221+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.845221+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:23.774171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":54,"num_write":158,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:10.622630+0000","last_change":"2024-09-19T12:03:10.622538+0000","last_active":"2024-09-19T12:03:10.622630+0000","last_peered":"2024-09-19T12:03:10.622630+0000","last_clean":"2024-09-19T12:03:10.622630+0000","last_became_active":"2024-09-19T11:35:19.152195+0000","last_became_peered":"2024-09-19T11:35:19.152195+0000","last_unstale":"2024-09-19T12:03:10.622630+0000","last_undegraded":"2024-09-19T12:03:10.622630+0000","last_fullsized":"2024-09-19T12:03:10.622630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:10.622455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:10.622455+0000","last_clean_scrub_stamp":"2024-09-19T12:03:10.622455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:40:26.610822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00094930600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.156108+0000","last_change":"2024-09-19T12:03:31.156108+0000","last_active":"2024-09-19T12:03:31.156108+0000","last_peered":"2024-09-19T12:03:31.156108+0000","last_clean":"2024-09-19T12:03:31.156108+0000","last_became_active":"2024-09-19T11:35:35.625385+0000","last_became_peered":"2024-09-19T11:35:35.625385+0000","last_unstale":"2024-09-19T12:03:31.156108+0000","last_undegraded":"2024-09-19T12:03:31.156108+0000","last_fullsized":"2024-09-19T12:03:31.156108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:31.155933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:31.155933+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.155933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:09.841671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'63","reported_seq":585,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.237037+0000","last_change":"2024-09-19T12:03:36.237037+0000","last_active":"2024-09-19T12:03:36.237037+0000","last_peered":"2024-09-19T12:03:36.237037+0000","last_clean":"2024-09-19T12:03:36.237037+0000","last_became_active":"2024-09-19T11:35:37.641855+0000","last_became_peered":"2024-09-19T11:35:37.641855+0000","last_unstale":"2024-09-19T12:03:36.237037+0000","last_undegraded":"2024-09-19T12:03:36.237037+0000","last_fullsized":"2024-09-19T12:03:36.237037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'63","last_scrub_stamp":"2024-09-19T12:03:36.236753+0000","last_deep_scrub":"264'63","last_deep_scrub_stamp":"2024-09-19T12:03:36.236753+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.236753+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:23.393797+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":89,"num_read_kb":84,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'623","reported_seq":1547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:45.022119+0000","last_change":"2024-09-19T12:03:45.022119+0000","last_active":"2024-09-19T12:03:45.022119+0000","last_peered":"2024-09-19T12:03:45.022119+0000","last_clean":"2024-09-19T12:03:45.022119+0000","last_became_active":"2024-09-19T11:35:39.662678+0000","last_became_peered":"2024-09-19T11:35:39.662678+0000","last_unstale":"2024-09-19T12:03:45.022119+0000","last_undegraded":"2024-09-19T12:03:45.022119+0000","last_fullsized":"2024-09-19T12:03:45.022119+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'623","last_scrub_stamp":"2024-09-19T12:03:45.021932+0000","last_deep_scrub":"264'623","last_deep_scrub_stamp":"2024-09-19T12:03:45.021932+0000","last_clean_scrub_stamp":"2024-09-19T12:03:45.021932+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":600,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:22.192591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'102","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:44.412055+0000","last_change":"2024-09-19T12:03:44.412055+0000","last_active":"2024-09-19T12:03:44.412055+0000","last_peered":"2024-09-19T12:03:44.412055+0000","last_clean":"2024-09-19T12:03:44.412055+0000","last_became_active":"2024-09-19T11:35:41.683629+0000","last_became_peered":"2024-09-19T11:35:41.683629+0000","last_unstale":"2024-09-19T12:03:44.412055+0000","last_undegraded":"2024-09-19T12:03:44.412055+0000","last_fullsized":"2024-09-19T12:03:44.412055+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-19T12:03:44.411870+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-19T12:03:44.411870+0000","last_clean_scrub_stamp":"2024-09-19T12:03:44.411870+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:08.187695+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":202,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'36","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.181835+0000","last_change":"2024-09-19T12:03:16.181835+0000","last_active":"2024-09-19T12:03:16.181835+0000","last_peered":"2024-09-19T12:03:16.181835+0000","last_clean":"2024-09-19T12:03:16.181835+0000","last_became_active":"2024-09-19T11:35:33.616079+0000","last_became_peered":"2024-09-19T11:35:33.616079+0000","last_unstale":"2024-09-19T12:03:16.181835+0000","last_undegraded":"2024-09-19T12:03:16.181835+0000","last_fullsized":"2024-09-19T12:03:16.181835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-19T12:03:16.181556+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-19T12:03:16.181556+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.181556+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:34.068776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":147,"num_write":69,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'45","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:09.388391+0000","last_change":"2024-09-19T12:03:09.388294+0000","last_active":"2024-09-19T12:03:09.388391+0000","last_peered":"2024-09-19T12:03:09.388391+0000","last_clean":"2024-09-19T12:03:09.388391+0000","last_became_active":"2024-09-19T11:35:31.612706+0000","last_became_peered":"2024-09-19T11:35:31.612706+0000","last_unstale":"2024-09-19T12:03:09.388391+0000","last_undegraded":"2024-09-19T12:03:09.388391+0000","last_fullsized":"2024-09-19T12:03:09.388391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-19T12:03:09.388188+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-19T12:03:09.388188+0000","last_clean_scrub_stamp":"2024-09-19T12:03:09.388188+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:21.341691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":6249,"num_write":158,"num_write_kb":6206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.055509+0000","last_change":"2024-09-19T12:03:12.055270+0000","last_active":"2024-09-19T12:03:12.055509+0000","last_peered":"2024-09-19T12:03:12.055509+0000","last_clean":"2024-09-19T12:03:12.055509+0000","last_became_active":"2024-09-19T11:35:19.152446+0000","last_became_peered":"2024-09-19T11:35:19.152446+0000","last_unstale":"2024-09-19T12:03:12.055509+0000","last_undegraded":"2024-09-19T12:03:12.055509+0000","last_fullsized":"2024-09-19T12:03:12.055509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:12.055058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:12.055058+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.055058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:03.585811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.990021+0000","last_change":"2024-09-19T12:03:26.989883+0000","last_active":"2024-09-19T12:03:26.990021+0000","last_peered":"2024-09-19T12:03:26.990021+0000","last_clean":"2024-09-19T12:03:26.990021+0000","last_became_active":"2024-09-19T11:35:35.624322+0000","last_became_peered":"2024-09-19T11:35:35.624322+0000","last_unstale":"2024-09-19T12:03:26.990021+0000","last_undegraded":"2024-09-19T12:03:26.990021+0000","last_fullsized":"2024-09-19T12:03:26.990021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:26.989686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:26.989686+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.989686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:43.901193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'201","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.318239+0000","last_change":"2024-09-19T12:03:33.318239+0000","last_active":"2024-09-19T12:03:33.318239+0000","last_peered":"2024-09-19T12:03:33.318239+0000","last_clean":"2024-09-19T12:03:33.318239+0000","last_became_active":"2024-09-19T11:35:37.646158+0000","last_became_peered":"2024-09-19T11:35:37.646158+0000","last_unstale":"2024-09-19T12:03:33.318239+0000","last_undegraded":"2024-09-19T12:03:33.318239+0000","last_fullsized":"2024-09-19T12:03:33.318239+0000","mapping_epoch":32,"log_start":"256'100","ondisk_log_start":"256'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-19T12:03:33.318024+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-19T12:03:33.318024+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.318024+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:24:19.628657+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20533,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":287,"num_read_kb":516,"num_write":214,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:42.110392+0000","last_change":"2024-09-19T12:03:42.110392+0000","last_active":"2024-09-19T12:03:42.110392+0000","last_peered":"2024-09-19T12:03:42.110392+0000","last_clean":"2024-09-19T12:03:42.110392+0000","last_became_active":"2024-09-19T11:35:39.684034+0000","last_became_peered":"2024-09-19T11:35:39.684034+0000","last_unstale":"2024-09-19T12:03:42.110392+0000","last_undegraded":"2024-09-19T12:03:42.110392+0000","last_fullsized":"2024-09-19T12:03:42.110392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:42.110171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:42.110171+0000","last_clean_scrub_stamp":"2024-09-19T12:03:42.110171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:32.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'23","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:44.380253+0000","last_change":"2024-09-19T12:03:44.380253+0000","last_active":"2024-09-19T12:03:44.380253+0000","last_peered":"2024-09-19T12:03:44.380253+0000","last_clean":"2024-09-19T12:03:44.380253+0000","last_became_active":"2024-09-19T11:35:41.689764+0000","last_became_peered":"2024-09-19T11:35:41.689764+0000","last_unstale":"2024-09-19T12:03:44.380253+0000","last_undegraded":"2024-09-19T12:03:44.380253+0000","last_fullsized":"2024-09-19T12:03:44.380253+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-19T12:03:44.380078+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-19T12:03:44.380078+0000","last_clean_scrub_stamp":"2024-09-19T12:03:44.380078+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:50.245203+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":78,"num_write":61,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'13","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:46.445469+0000","last_change":"2024-09-19T12:03:46.445469+0000","last_active":"2024-09-19T12:03:46.445469+0000","last_peered":"2024-09-19T12:03:46.445469+0000","last_clean":"2024-09-19T12:03:46.445469+0000","last_became_active":"2024-09-19T11:35:41.691032+0000","last_became_peered":"2024-09-19T11:35:41.691032+0000","last_unstale":"2024-09-19T12:03:46.445469+0000","last_undegraded":"2024-09-19T12:03:46.445469+0000","last_fullsized":"2024-09-19T12:03:46.445469+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-19T12:03:46.445280+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-19T12:03:46.445280+0000","last_clean_scrub_stamp":"2024-09-19T12:03:46.445280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:39.736235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":124,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'71","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.184521+0000","last_change":"2024-09-19T12:03:21.184351+0000","last_active":"2024-09-19T12:03:21.184521+0000","last_peered":"2024-09-19T12:03:21.184521+0000","last_clean":"2024-09-19T12:03:21.184521+0000","last_became_active":"2024-09-19T11:35:33.629606+0000","last_became_peered":"2024-09-19T11:35:33.629606+0000","last_unstale":"2024-09-19T12:03:21.184521+0000","last_undegraded":"2024-09-19T12:03:21.184521+0000","last_fullsized":"2024-09-19T12:03:21.184521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'71","last_scrub_stamp":"2024-09-19T12:03:21.184165+0000","last_deep_scrub":"264'71","last_deep_scrub_stamp":"2024-09-19T12:03:21.184165+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.184165+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:07.903624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":210,"num_write":129,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'37","reported_seq":554,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.150393+0000","last_change":"2024-09-19T12:03:12.150255+0000","last_active":"2024-09-19T12:03:12.150393+0000","last_peered":"2024-09-19T12:03:12.150393+0000","last_clean":"2024-09-19T12:03:12.150393+0000","last_became_active":"2024-09-19T11:35:31.591519+0000","last_became_peered":"2024-09-19T11:35:31.591519+0000","last_unstale":"2024-09-19T12:03:12.150393+0000","last_undegraded":"2024-09-19T12:03:12.150393+0000","last_fullsized":"2024-09-19T12:03:12.150393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:12.150010+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:12.150010+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.150010+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:46.241961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":3273,"num_write":135,"num_write_kb":3245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.610181+0000","last_change":"2024-09-19T12:03:24.609952+0000","last_active":"2024-09-19T12:03:24.610181+0000","last_peered":"2024-09-19T12:03:24.610181+0000","last_clean":"2024-09-19T12:03:24.610181+0000","last_became_active":"2024-09-19T11:35:35.612405+0000","last_became_peered":"2024-09-19T11:35:35.612405+0000","last_unstale":"2024-09-19T12:03:24.610181+0000","last_undegraded":"2024-09-19T12:03:24.610181+0000","last_fullsized":"2024-09-19T12:03:24.610181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:24.609593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:24.609593+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.609593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:08.908515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'89","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.122260+0000","last_change":"2024-09-19T12:03:37.122124+0000","last_active":"2024-09-19T12:03:37.122260+0000","last_peered":"2024-09-19T12:03:37.122260+0000","last_clean":"2024-09-19T12:03:37.122260+0000","last_became_active":"2024-09-19T11:35:37.632543+0000","last_became_peered":"2024-09-19T11:35:37.632543+0000","last_unstale":"2024-09-19T12:03:37.122260+0000","last_undegraded":"2024-09-19T12:03:37.122260+0000","last_fullsized":"2024-09-19T12:03:37.122260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'89","last_scrub_stamp":"2024-09-19T12:03:37.121904+0000","last_deep_scrub":"264'89","last_deep_scrub_stamp":"2024-09-19T12:03:37.121904+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.121904+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:36.647748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4752,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":182,"num_write":88,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:46.043858+0000","last_change":"2024-09-19T12:03:46.043858+0000","last_active":"2024-09-19T12:03:46.043858+0000","last_peered":"2024-09-19T12:03:46.043858+0000","last_clean":"2024-09-19T12:03:46.043858+0000","last_became_active":"2024-09-19T11:35:39.654012+0000","last_became_peered":"2024-09-19T11:35:39.654012+0000","last_unstale":"2024-09-19T12:03:46.043858+0000","last_undegraded":"2024-09-19T12:03:46.043858+0000","last_fullsized":"2024-09-19T12:03:46.043858+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:46.043648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:46.043648+0000","last_clean_scrub_stamp":"2024-09-19T12:03:46.043648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:34.717697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'11","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:46.629915+0000","last_change":"2024-09-19T11:35:41.676591+0000","last_active":"2024-09-19T12:01:46.629915+0000","last_peered":"2024-09-19T12:01:46.629915+0000","last_clean":"2024-09-19T12:01:46.629915+0000","last_became_active":"2024-09-19T11:35:41.675506+0000","last_became_peered":"2024-09-19T11:35:41.675506+0000","last_unstale":"2024-09-19T12:01:46.629915+0000","last_undegraded":"2024-09-19T12:01:46.629915+0000","last_fullsized":"2024-09-19T12:01:46.629915+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":25,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'13","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.672691+0000","last_change":"2024-09-19T12:03:18.672534+0000","last_active":"2024-09-19T12:03:18.672691+0000","last_peered":"2024-09-19T12:03:18.672691+0000","last_clean":"2024-09-19T12:03:18.672691+0000","last_became_active":"2024-09-19T11:35:33.634606+0000","last_became_peered":"2024-09-19T11:35:33.634606+0000","last_unstale":"2024-09-19T12:03:18.672691+0000","last_undegraded":"2024-09-19T12:03:18.672691+0000","last_fullsized":"2024-09-19T12:03:18.672691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-19T12:03:18.672343+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-19T12:03:18.672343+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.672343+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:50.311993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":71,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'47","reported_seq":570,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.422931+0000","last_change":"2024-09-19T12:03:20.422931+0000","last_active":"2024-09-19T12:03:20.422931+0000","last_peered":"2024-09-19T12:03:20.422931+0000","last_clean":"2024-09-19T12:03:20.422931+0000","last_became_active":"2024-09-19T11:35:31.602343+0000","last_became_peered":"2024-09-19T11:35:31.602343+0000","last_unstale":"2024-09-19T12:03:20.422931+0000","last_undegraded":"2024-09-19T12:03:20.422931+0000","last_fullsized":"2024-09-19T12:03:20.422931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-09-19T12:03:20.422669+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-09-19T12:03:20.422669+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.422669+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:58.197082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":10301,"num_write":159,"num_write_kb":15391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.018029+0000","last_change":"2024-09-19T12:03:30.017902+0000","last_active":"2024-09-19T12:03:30.018029+0000","last_peered":"2024-09-19T12:03:30.018029+0000","last_clean":"2024-09-19T12:03:30.018029+0000","last_became_active":"2024-09-19T11:35:35.630183+0000","last_became_peered":"2024-09-19T11:35:35.630183+0000","last_unstale":"2024-09-19T12:03:30.018029+0000","last_undegraded":"2024-09-19T12:03:30.018029+0000","last_fullsized":"2024-09-19T12:03:30.018029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:30.017710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:30.017710+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.017710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:10.114635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'18","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.437544+0000","last_change":"2024-09-19T12:03:35.437374+0000","last_active":"2024-09-19T12:03:35.437544+0000","last_peered":"2024-09-19T12:03:35.437544+0000","last_clean":"2024-09-19T12:03:35.437544+0000","last_became_active":"2024-09-19T11:35:37.640723+0000","last_became_peered":"2024-09-19T11:35:37.640723+0000","last_unstale":"2024-09-19T12:03:35.437544+0000","last_undegraded":"2024-09-19T12:03:35.437544+0000","last_fullsized":"2024-09-19T12:03:35.437544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-19T12:03:35.437187+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-19T12:03:35.437187+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.437187+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:22.198910+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:40.343713+0000","last_change":"2024-09-19T12:03:40.343583+0000","last_active":"2024-09-19T12:03:40.343713+0000","last_peered":"2024-09-19T12:03:40.343713+0000","last_clean":"2024-09-19T12:03:40.343713+0000","last_became_active":"2024-09-19T11:35:39.667286+0000","last_became_peered":"2024-09-19T11:35:39.667286+0000","last_unstale":"2024-09-19T12:03:40.343713+0000","last_undegraded":"2024-09-19T12:03:40.343713+0000","last_fullsized":"2024-09-19T12:03:40.343713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:40.343399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:40.343399+0000","last_clean_scrub_stamp":"2024-09-19T12:03:40.343399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:43.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'8","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:48.507322+0000","last_change":"2024-09-19T12:03:48.507322+0000","last_active":"2024-09-19T12:03:48.507322+0000","last_peered":"2024-09-19T12:03:48.507322+0000","last_clean":"2024-09-19T12:03:48.507322+0000","last_became_active":"2024-09-19T11:35:41.696369+0000","last_became_peered":"2024-09-19T11:35:41.696369+0000","last_unstale":"2024-09-19T12:03:48.507322+0000","last_undegraded":"2024-09-19T12:03:48.507322+0000","last_fullsized":"2024-09-19T12:03:48.507322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-19T12:03:48.507146+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-19T12:03:48.507146+0000","last_clean_scrub_stamp":"2024-09-19T12:03:48.507146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:36.282544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'69","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.909934+0000","last_change":"2024-09-19T12:03:22.909800+0000","last_active":"2024-09-19T12:03:22.909934+0000","last_peered":"2024-09-19T12:03:22.909934+0000","last_clean":"2024-09-19T12:03:22.909934+0000","last_became_active":"2024-09-19T11:35:33.614693+0000","last_became_peered":"2024-09-19T11:35:33.614693+0000","last_unstale":"2024-09-19T12:03:22.909934+0000","last_undegraded":"2024-09-19T12:03:22.909934+0000","last_fullsized":"2024-09-19T12:03:22.909934+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'69","last_scrub_stamp":"2024-09-19T12:03:22.909619+0000","last_deep_scrub":"264'69","last_deep_scrub_stamp":"2024-09-19T12:03:22.909619+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.909619+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:13.544034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":230,"num_write":111,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'49","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.176623+0000","last_change":"2024-09-19T12:03:12.176623+0000","last_active":"2024-09-19T12:03:12.176623+0000","last_peered":"2024-09-19T12:03:12.176623+0000","last_clean":"2024-09-19T12:03:12.176623+0000","last_became_active":"2024-09-19T11:36:06.677102+0000","last_became_peered":"2024-09-19T11:36:06.677102+0000","last_unstale":"2024-09-19T12:03:12.176623+0000","last_undegraded":"2024-09-19T12:03:12.176623+0000","last_fullsized":"2024-09-19T12:03:12.176623+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-19T12:03:12.176533+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-19T12:03:12.176533+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.176533+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:03.972788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":91,"num_read_kb":1744,"num_write":157,"num_write_kb":1703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.288190+0000","last_change":"2024-09-19T12:03:31.288065+0000","last_active":"2024-09-19T12:03:31.288190+0000","last_peered":"2024-09-19T12:03:31.288190+0000","last_clean":"2024-09-19T12:03:31.288190+0000","last_became_active":"2024-09-19T11:35:35.617374+0000","last_became_peered":"2024-09-19T11:35:35.617374+0000","last_unstale":"2024-09-19T12:03:31.288190+0000","last_undegraded":"2024-09-19T12:03:31.288190+0000","last_fullsized":"2024-09-19T12:03:31.288190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:31.287897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:31.287897+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.287897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:51.291514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'102","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:39.158203+0000","last_change":"2024-09-19T12:03:39.157971+0000","last_active":"2024-09-19T12:03:39.158203+0000","last_peered":"2024-09-19T12:03:39.158203+0000","last_clean":"2024-09-19T12:03:39.158203+0000","last_became_active":"2024-09-19T11:35:37.636913+0000","last_became_peered":"2024-09-19T11:35:37.636913+0000","last_unstale":"2024-09-19T12:03:39.158203+0000","last_undegraded":"2024-09-19T12:03:39.158203+0000","last_fullsized":"2024-09-19T12:03:39.158203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-19T12:03:39.157739+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-19T12:03:39.157739+0000","last_clean_scrub_stamp":"2024-09-19T12:03:39.157739+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:20:55.117974+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4489,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":210,"num_write":100,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.095142+0000","last_change":"2024-09-19T12:03:30.094860+0000","last_active":"2024-09-19T12:03:30.095142+0000","last_peered":"2024-09-19T12:03:30.095142+0000","last_clean":"2024-09-19T12:03:30.095142+0000","last_became_active":"2024-09-19T11:35:39.673172+0000","last_became_peered":"2024-09-19T11:35:39.673172+0000","last_unstale":"2024-09-19T12:03:30.095142+0000","last_undegraded":"2024-09-19T12:03:30.095142+0000","last_fullsized":"2024-09-19T12:03:30.095142+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:30.094657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:30.094657+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.094657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:05.891743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'13","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:47.397509+0000","last_change":"2024-09-19T12:03:47.397509+0000","last_active":"2024-09-19T12:03:47.397509+0000","last_peered":"2024-09-19T12:03:47.397509+0000","last_clean":"2024-09-19T12:03:47.397509+0000","last_became_active":"2024-09-19T11:35:41.677991+0000","last_became_peered":"2024-09-19T11:35:41.677991+0000","last_unstale":"2024-09-19T12:03:47.397509+0000","last_undegraded":"2024-09-19T12:03:47.397509+0000","last_fullsized":"2024-09-19T12:03:47.397509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-19T12:03:47.397329+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-19T12:03:47.397329+0000","last_clean_scrub_stamp":"2024-09-19T12:03:47.397329+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:12.386458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":90,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.231795+0000","last_change":"2024-09-19T12:03:17.231795+0000","last_active":"2024-09-19T12:03:17.231795+0000","last_peered":"2024-09-19T12:03:17.231795+0000","last_clean":"2024-09-19T12:03:17.231795+0000","last_became_active":"2024-09-19T11:36:06.674947+0000","last_became_peered":"2024-09-19T11:36:06.674947+0000","last_unstale":"2024-09-19T12:03:17.231795+0000","last_undegraded":"2024-09-19T12:03:17.231795+0000","last_fullsized":"2024-09-19T12:03:17.231795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:17.231570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:17.231570+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.231570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:32.772458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"264'32","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.318659+0000","last_change":"2024-09-19T12:03:11.318659+0000","last_active":"2024-09-19T12:03:11.318659+0000","last_peered":"2024-09-19T12:03:11.318659+0000","last_clean":"2024-09-19T12:03:11.318659+0000","last_became_active":"2024-09-19T11:35:31.589077+0000","last_became_peered":"2024-09-19T11:35:31.589077+0000","last_unstale":"2024-09-19T12:03:11.318659+0000","last_undegraded":"2024-09-19T12:03:11.318659+0000","last_fullsized":"2024-09-19T12:03:11.318659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-19T12:03:11.318438+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-19T12:03:11.318438+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.318438+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:43.791532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":45,"num_read_kb":7227,"num_write":97,"num_write_kb":7207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.108696+0000","last_change":"2024-09-19T12:03:25.108563+0000","last_active":"2024-09-19T12:03:25.108696+0000","last_peered":"2024-09-19T12:03:25.108696+0000","last_clean":"2024-09-19T12:03:25.108696+0000","last_became_active":"2024-09-19T11:35:35.629798+0000","last_became_peered":"2024-09-19T11:35:35.629798+0000","last_unstale":"2024-09-19T12:03:25.108696+0000","last_undegraded":"2024-09-19T12:03:25.108696+0000","last_fullsized":"2024-09-19T12:03:25.108696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:25.108374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:25.108374+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.108374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:13:16.547584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'73","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.307714+0000","last_change":"2024-09-19T12:03:36.307578+0000","last_active":"2024-09-19T12:03:36.307714+0000","last_peered":"2024-09-19T12:03:36.307714+0000","last_clean":"2024-09-19T12:03:36.307714+0000","last_became_active":"2024-09-19T11:35:37.640008+0000","last_became_peered":"2024-09-19T11:35:37.640008+0000","last_unstale":"2024-09-19T12:03:36.307714+0000","last_undegraded":"2024-09-19T12:03:36.307714+0000","last_fullsized":"2024-09-19T12:03:36.307714+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'73","last_scrub_stamp":"2024-09-19T12:03:36.307378+0000","last_deep_scrub":"264'73","last_deep_scrub_stamp":"2024-09-19T12:03:36.307378+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.307378+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:11.616881+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":172,"num_write":74,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.391743+0000","last_change":"2024-09-19T12:03:37.391576+0000","last_active":"2024-09-19T12:03:37.391743+0000","last_peered":"2024-09-19T12:03:37.391743+0000","last_clean":"2024-09-19T12:03:37.391743+0000","last_became_active":"2024-09-19T11:35:39.675913+0000","last_became_peered":"2024-09-19T11:35:39.675913+0000","last_unstale":"2024-09-19T12:03:37.391743+0000","last_undegraded":"2024-09-19T12:03:37.391743+0000","last_fullsized":"2024-09-19T12:03:37.391743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:37.391395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:37.391395+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.391395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:26.854978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'73","reported_seq":589,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.113812+0000","last_change":"2024-09-19T12:03:21.113812+0000","last_active":"2024-09-19T12:03:21.113812+0000","last_peered":"2024-09-19T12:03:21.113812+0000","last_clean":"2024-09-19T12:03:21.113812+0000","last_became_active":"2024-09-19T11:35:33.624358+0000","last_became_peered":"2024-09-19T11:35:33.624358+0000","last_unstale":"2024-09-19T12:03:21.113812+0000","last_undegraded":"2024-09-19T12:03:21.113812+0000","last_fullsized":"2024-09-19T12:03:21.113812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'73","last_scrub_stamp":"2024-09-19T12:03:21.113588+0000","last_deep_scrub":"264'73","last_deep_scrub_stamp":"2024-09-19T12:03:21.113588+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.113588+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:37.273797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":316,"num_read_kb":286,"num_write":104,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2877,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'41","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.876573+0000","last_change":"2024-09-19T12:03:15.876573+0000","last_active":"2024-09-19T12:03:15.876573+0000","last_peered":"2024-09-19T12:03:15.876573+0000","last_clean":"2024-09-19T12:03:15.876573+0000","last_became_active":"2024-09-19T11:35:31.574673+0000","last_became_peered":"2024-09-19T11:35:31.574673+0000","last_unstale":"2024-09-19T12:03:15.876573+0000","last_undegraded":"2024-09-19T12:03:15.876573+0000","last_fullsized":"2024-09-19T12:03:15.876573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-19T12:03:15.876312+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-19T12:03:15.876312+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.876312+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:09.652364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":49,"num_write":124,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.389854+0000","last_change":"2024-09-19T12:03:29.389707+0000","last_active":"2024-09-19T12:03:29.389854+0000","last_peered":"2024-09-19T12:03:29.389854+0000","last_clean":"2024-09-19T12:03:29.389854+0000","last_became_active":"2024-09-19T11:35:35.617643+0000","last_became_peered":"2024-09-19T11:35:35.617643+0000","last_unstale":"2024-09-19T12:03:29.389854+0000","last_undegraded":"2024-09-19T12:03:29.389854+0000","last_fullsized":"2024-09-19T12:03:29.389854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:29.389529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:29.389529+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.389529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:07.829457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'106","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:28.654722+0000","last_change":"2024-09-19T12:03:28.654722+0000","last_active":"2024-09-19T12:03:28.654722+0000","last_peered":"2024-09-19T12:03:28.654722+0000","last_clean":"2024-09-19T12:03:28.654722+0000","last_became_active":"2024-09-19T11:35:37.640147+0000","last_became_peered":"2024-09-19T11:35:37.640147+0000","last_unstale":"2024-09-19T12:03:28.654722+0000","last_undegraded":"2024-09-19T12:03:28.654722+0000","last_fullsized":"2024-09-19T12:03:28.654722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'106","last_scrub_stamp":"2024-09-19T12:03:28.654523+0000","last_deep_scrub":"264'106","last_deep_scrub_stamp":"2024-09-19T12:03:28.654523+0000","last_clean_scrub_stamp":"2024-09-19T12:03:28.654523+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:50.635509+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9836,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":276,"num_write":110,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:41.415146+0000","last_change":"2024-09-19T12:03:41.415146+0000","last_active":"2024-09-19T12:03:41.415146+0000","last_peered":"2024-09-19T12:03:41.415146+0000","last_clean":"2024-09-19T12:03:41.415146+0000","last_became_active":"2024-09-19T11:35:39.651426+0000","last_became_peered":"2024-09-19T11:35:39.651426+0000","last_unstale":"2024-09-19T12:03:41.415146+0000","last_undegraded":"2024-09-19T12:03:41.415146+0000","last_fullsized":"2024-09-19T12:03:41.415146+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:41.414967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:41.414967+0000","last_clean_scrub_stamp":"2024-09-19T12:03:41.414967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:11.850992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'72","reported_seq":582,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:01:21.623996+0000","last_change":"2024-09-19T11:35:41.676328+0000","last_active":"2024-09-19T12:01:21.623996+0000","last_peered":"2024-09-19T12:01:21.623996+0000","last_clean":"2024-09-19T12:01:21.623996+0000","last_became_active":"2024-09-19T11:35:41.674006+0000","last_became_peered":"2024-09-19T11:35:41.674006+0000","last_unstale":"2024-09-19T12:01:21.623996+0000","last_undegraded":"2024-09-19T12:01:21.623996+0000","last_fullsized":"2024-09-19T12:01:21.623996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'110","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.333687+0000","last_change":"2024-09-19T12:03:23.333458+0000","last_active":"2024-09-19T12:03:23.333687+0000","last_peered":"2024-09-19T12:03:23.333687+0000","last_clean":"2024-09-19T12:03:23.333687+0000","last_became_active":"2024-09-19T11:35:33.611732+0000","last_became_peered":"2024-09-19T11:35:33.611732+0000","last_unstale":"2024-09-19T12:03:23.333687+0000","last_undegraded":"2024-09-19T12:03:23.333687+0000","last_fullsized":"2024-09-19T12:03:23.333687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-19T12:03:23.333232+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-19T12:03:23.333232+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.333232+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.621387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":312,"num_write":153,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'50","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.674076+0000","last_change":"2024-09-19T12:03:13.674076+0000","last_active":"2024-09-19T12:03:13.674076+0000","last_peered":"2024-09-19T12:03:13.674076+0000","last_clean":"2024-09-19T12:03:13.674076+0000","last_became_active":"2024-09-19T11:35:31.585423+0000","last_became_peered":"2024-09-19T11:35:31.585423+0000","last_unstale":"2024-09-19T12:03:13.674076+0000","last_undegraded":"2024-09-19T12:03:13.674076+0000","last_fullsized":"2024-09-19T12:03:13.674076+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-19T12:03:13.673866+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-19T12:03:13.673866+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.673866+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:32.590993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":1132,"num_write":175,"num_write_kb":1063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.119551+0000","last_change":"2024-09-19T12:03:27.119551+0000","last_active":"2024-09-19T12:03:27.119551+0000","last_peered":"2024-09-19T12:03:27.119551+0000","last_clean":"2024-09-19T12:03:27.119551+0000","last_became_active":"2024-09-19T11:35:35.632384+0000","last_became_peered":"2024-09-19T11:35:35.632384+0000","last_unstale":"2024-09-19T12:03:27.119551+0000","last_undegraded":"2024-09-19T12:03:27.119551+0000","last_fullsized":"2024-09-19T12:03:27.119551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:27.119375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:27.119375+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.119375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:03.270132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'84","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.293483+0000","last_change":"2024-09-19T12:03:38.293483+0000","last_active":"2024-09-19T12:03:38.293483+0000","last_peered":"2024-09-19T12:03:38.293483+0000","last_clean":"2024-09-19T12:03:38.293483+0000","last_became_active":"2024-09-19T11:35:37.641603+0000","last_became_peered":"2024-09-19T11:35:37.641603+0000","last_unstale":"2024-09-19T12:03:38.293483+0000","last_undegraded":"2024-09-19T12:03:38.293483+0000","last_fullsized":"2024-09-19T12:03:38.293483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-19T12:03:38.293270+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-19T12:03:38.293270+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.293270+0000","objects_scrubbed":8,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:03.705413+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":118,"num_read_kb":160,"num_write":100,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.559018+0000","last_change":"2024-09-19T12:03:36.559018+0000","last_active":"2024-09-19T12:03:36.559018+0000","last_peered":"2024-09-19T12:03:36.559018+0000","last_clean":"2024-09-19T12:03:36.559018+0000","last_became_active":"2024-09-19T11:35:39.683564+0000","last_became_peered":"2024-09-19T11:35:39.683564+0000","last_unstale":"2024-09-19T12:03:36.559018+0000","last_undegraded":"2024-09-19T12:03:36.559018+0000","last_fullsized":"2024-09-19T12:03:36.559018+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:36.558812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:36.558812+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.558812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:45.887514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'29","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.126533+0000","last_change":"2024-09-19T12:03:35.126263+0000","last_active":"2024-09-19T12:03:35.126533+0000","last_peered":"2024-09-19T12:03:35.126533+0000","last_clean":"2024-09-19T12:03:35.126533+0000","last_became_active":"2024-09-19T11:35:41.665262+0000","last_became_peered":"2024-09-19T11:35:41.665262+0000","last_unstale":"2024-09-19T12:03:35.126533+0000","last_undegraded":"2024-09-19T12:03:35.126533+0000","last_fullsized":"2024-09-19T12:03:35.126533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-19T12:03:35.125984+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-19T12:03:35.125984+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.125984+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:40.520346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":132,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'2","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.939755+0000","last_change":"2024-09-19T12:03:25.939755+0000","last_active":"2024-09-19T12:03:25.939755+0000","last_peered":"2024-09-19T12:03:25.939755+0000","last_clean":"2024-09-19T12:03:25.939755+0000","last_became_active":"2024-09-19T11:35:33.613712+0000","last_became_peered":"2024-09-19T11:35:33.613712+0000","last_unstale":"2024-09-19T12:03:25.939755+0000","last_undegraded":"2024-09-19T12:03:25.939755+0000","last_fullsized":"2024-09-19T12:03:25.939755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:25.939569+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:25.939569+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.939569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:24.600578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'48","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.168534+0000","last_change":"2024-09-19T12:03:14.168534+0000","last_active":"2024-09-19T12:03:14.168534+0000","last_peered":"2024-09-19T12:03:14.168534+0000","last_clean":"2024-09-19T12:03:14.168534+0000","last_became_active":"2024-09-19T11:35:31.579680+0000","last_became_peered":"2024-09-19T11:35:31.579680+0000","last_unstale":"2024-09-19T12:03:14.168534+0000","last_undegraded":"2024-09-19T12:03:14.168534+0000","last_fullsized":"2024-09-19T12:03:14.168534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'48","last_scrub_stamp":"2024-09-19T12:03:14.168295+0000","last_deep_scrub":"264'48","last_deep_scrub_stamp":"2024-09-19T12:03:14.168295+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.168295+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:40.012360+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":1771,"num_write":190,"num_write_kb":1706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.221078+0000","last_change":"2024-09-19T12:03:35.221078+0000","last_active":"2024-09-19T12:03:35.221078+0000","last_peered":"2024-09-19T12:03:35.221078+0000","last_clean":"2024-09-19T12:03:35.221078+0000","last_became_active":"2024-09-19T11:35:35.625446+0000","last_became_peered":"2024-09-19T11:35:35.625446+0000","last_unstale":"2024-09-19T12:03:35.221078+0000","last_undegraded":"2024-09-19T12:03:35.221078+0000","last_fullsized":"2024-09-19T12:03:35.221078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:35.220895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:35.220895+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.220895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:14.166973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'77","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:40.108262+0000","last_change":"2024-09-19T12:03:40.108262+0000","last_active":"2024-09-19T12:03:40.108262+0000","last_peered":"2024-09-19T12:03:40.108262+0000","last_clean":"2024-09-19T12:03:40.108262+0000","last_became_active":"2024-09-19T11:35:37.616602+0000","last_became_peered":"2024-09-19T11:35:37.616602+0000","last_unstale":"2024-09-19T12:03:40.108262+0000","last_undegraded":"2024-09-19T12:03:40.108262+0000","last_fullsized":"2024-09-19T12:03:40.108262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'77","last_scrub_stamp":"2024-09-19T12:03:40.108057+0000","last_deep_scrub":"264'77","last_deep_scrub_stamp":"2024-09-19T12:03:40.108057+0000","last_clean_scrub_stamp":"2024-09-19T12:03:40.108057+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:33.493365+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4880,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":165,"num_write":74,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.616618+0000","last_change":"2024-09-19T12:03:30.616479+0000","last_active":"2024-09-19T12:03:30.616618+0000","last_peered":"2024-09-19T12:03:30.616618+0000","last_clean":"2024-09-19T12:03:30.616618+0000","last_became_active":"2024-09-19T11:35:39.686225+0000","last_became_peered":"2024-09-19T11:35:39.686225+0000","last_unstale":"2024-09-19T12:03:30.616618+0000","last_undegraded":"2024-09-19T12:03:30.616618+0000","last_fullsized":"2024-09-19T12:03:30.616618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:30.616299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:30.616299+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.616299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:21.834894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'4","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:45.368632+0000","last_change":"2024-09-19T12:03:45.368632+0000","last_active":"2024-09-19T12:03:45.368632+0000","last_peered":"2024-09-19T12:03:45.368632+0000","last_clean":"2024-09-19T12:03:45.368632+0000","last_became_active":"2024-09-19T11:35:41.682440+0000","last_became_peered":"2024-09-19T11:35:41.682440+0000","last_unstale":"2024-09-19T12:03:45.368632+0000","last_undegraded":"2024-09-19T12:03:45.368632+0000","last_fullsized":"2024-09-19T12:03:45.368632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-19T12:03:45.368367+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-19T12:03:45.368367+0000","last_clean_scrub_stamp":"2024-09-19T12:03:45.368367+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:31.866847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'93","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.239877+0000","last_change":"2024-09-19T12:03:18.239877+0000","last_active":"2024-09-19T12:03:18.239877+0000","last_peered":"2024-09-19T12:03:18.239877+0000","last_clean":"2024-09-19T12:03:18.239877+0000","last_became_active":"2024-09-19T11:35:33.605161+0000","last_became_peered":"2024-09-19T11:35:33.605161+0000","last_unstale":"2024-09-19T12:03:18.239877+0000","last_undegraded":"2024-09-19T12:03:18.239877+0000","last_fullsized":"2024-09-19T12:03:18.239877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'93","last_scrub_stamp":"2024-09-19T12:03:18.239701+0000","last_deep_scrub":"264'93","last_deep_scrub_stamp":"2024-09-19T12:03:18.239701+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.239701+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:08:10.377092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":359,"num_read_kb":288,"num_write":158,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'32","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.315615+0000","last_change":"2024-09-19T12:03:12.315615+0000","last_active":"2024-09-19T12:03:12.315615+0000","last_peered":"2024-09-19T12:03:12.315615+0000","last_clean":"2024-09-19T12:03:12.315615+0000","last_became_active":"2024-09-19T11:35:31.602466+0000","last_became_peered":"2024-09-19T11:35:31.602466+0000","last_unstale":"2024-09-19T12:03:12.315615+0000","last_undegraded":"2024-09-19T12:03:12.315615+0000","last_fullsized":"2024-09-19T12:03:12.315615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-19T12:03:12.315539+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-19T12:03:12.315539+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.315539+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:37.501317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":124,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.595939+0000","last_change":"2024-09-19T12:03:25.595939+0000","last_active":"2024-09-19T12:03:25.595939+0000","last_peered":"2024-09-19T12:03:25.595939+0000","last_clean":"2024-09-19T12:03:25.595939+0000","last_became_active":"2024-09-19T11:35:35.631573+0000","last_became_peered":"2024-09-19T11:35:35.631573+0000","last_unstale":"2024-09-19T12:03:25.595939+0000","last_undegraded":"2024-09-19T12:03:25.595939+0000","last_fullsized":"2024-09-19T12:03:25.595939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:25.595749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:25.595749+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.595749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:33.449047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'46","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:42.298469+0000","last_change":"2024-09-19T12:03:42.298469+0000","last_active":"2024-09-19T12:03:42.298469+0000","last_peered":"2024-09-19T12:03:42.298469+0000","last_clean":"2024-09-19T12:03:42.298469+0000","last_became_active":"2024-09-19T11:35:37.632562+0000","last_became_peered":"2024-09-19T11:35:37.632562+0000","last_unstale":"2024-09-19T12:03:42.298469+0000","last_undegraded":"2024-09-19T12:03:42.298469+0000","last_fullsized":"2024-09-19T12:03:42.298469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'46","last_scrub_stamp":"2024-09-19T12:03:42.298265+0000","last_deep_scrub":"264'46","last_deep_scrub_stamp":"2024-09-19T12:03:42.298265+0000","last_clean_scrub_stamp":"2024-09-19T12:03:42.298265+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:07.451508+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":55,"num_read_kb":48,"num_write":46,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'617","reported_seq":1548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.092168+0000","last_change":"2024-09-19T12:03:31.092168+0000","last_active":"2024-09-19T12:03:31.092168+0000","last_peered":"2024-09-19T12:03:31.092168+0000","last_clean":"2024-09-19T12:03:31.092168+0000","last_became_active":"2024-09-19T11:35:39.659602+0000","last_became_peered":"2024-09-19T11:35:39.659602+0000","last_unstale":"2024-09-19T12:03:31.092168+0000","last_undegraded":"2024-09-19T12:03:31.092168+0000","last_fullsized":"2024-09-19T12:03:31.092168+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'617","last_scrub_stamp":"2024-09-19T12:03:31.091985+0000","last_deep_scrub":"264'617","last_deep_scrub_stamp":"2024-09-19T12:03:31.091985+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.091985+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:24.959348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'7","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.369871+0000","last_change":"2024-09-19T12:03:43.369871+0000","last_active":"2024-09-19T12:03:43.369871+0000","last_peered":"2024-09-19T12:03:43.369871+0000","last_clean":"2024-09-19T12:03:43.369871+0000","last_became_active":"2024-09-19T11:35:41.681567+0000","last_became_peered":"2024-09-19T11:35:41.681567+0000","last_unstale":"2024-09-19T12:03:43.369871+0000","last_undegraded":"2024-09-19T12:03:43.369871+0000","last_fullsized":"2024-09-19T12:03:43.369871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-19T12:03:43.369705+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-19T12:03:43.369705+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.369705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:27.875990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'69","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.248021+0000","last_change":"2024-09-19T12:03:24.248021+0000","last_active":"2024-09-19T12:03:24.248021+0000","last_peered":"2024-09-19T12:03:24.248021+0000","last_clean":"2024-09-19T12:03:24.248021+0000","last_became_active":"2024-09-19T11:35:33.617414+0000","last_became_peered":"2024-09-19T11:35:33.617414+0000","last_unstale":"2024-09-19T12:03:24.248021+0000","last_undegraded":"2024-09-19T12:03:24.248021+0000","last_fullsized":"2024-09-19T12:03:24.248021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'69","last_scrub_stamp":"2024-09-19T12:03:24.247784+0000","last_deep_scrub":"264'69","last_deep_scrub_stamp":"2024-09-19T12:03:24.247784+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.247784+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:57.608796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":201,"num_write":115,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'34","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.581458+0000","last_change":"2024-09-19T12:03:16.581458+0000","last_active":"2024-09-19T12:03:16.581458+0000","last_peered":"2024-09-19T12:03:16.581458+0000","last_clean":"2024-09-19T12:03:16.581458+0000","last_became_active":"2024-09-19T11:35:31.613260+0000","last_became_peered":"2024-09-19T11:35:31.613260+0000","last_unstale":"2024-09-19T12:03:16.581458+0000","last_undegraded":"2024-09-19T12:03:16.581458+0000","last_fullsized":"2024-09-19T12:03:16.581458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-19T12:03:16.581208+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-19T12:03:16.581208+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.581208+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:46.072831+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":9290,"num_write":82,"num_write_kb":7234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.263960+0000","last_change":"2024-09-19T12:03:32.263960+0000","last_active":"2024-09-19T12:03:32.263960+0000","last_peered":"2024-09-19T12:03:32.263960+0000","last_clean":"2024-09-19T12:03:32.263960+0000","last_became_active":"2024-09-19T11:35:35.617489+0000","last_became_peered":"2024-09-19T11:35:35.617489+0000","last_unstale":"2024-09-19T12:03:32.263960+0000","last_undegraded":"2024-09-19T12:03:32.263960+0000","last_fullsized":"2024-09-19T12:03:32.263960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:32.263756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:32.263756+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.263756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:15.095540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'98","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:39.351862+0000","last_change":"2024-09-19T12:03:39.351862+0000","last_active":"2024-09-19T12:03:39.351862+0000","last_peered":"2024-09-19T12:03:39.351862+0000","last_clean":"2024-09-19T12:03:39.351862+0000","last_became_active":"2024-09-19T11:35:37.624101+0000","last_became_peered":"2024-09-19T11:35:37.624101+0000","last_unstale":"2024-09-19T12:03:39.351862+0000","last_undegraded":"2024-09-19T12:03:39.351862+0000","last_fullsized":"2024-09-19T12:03:39.351862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'98","last_scrub_stamp":"2024-09-19T12:03:39.351636+0000","last_deep_scrub":"264'98","last_deep_scrub_stamp":"2024-09-19T12:03:39.351636+0000","last_clean_scrub_stamp":"2024-09-19T12:03:39.351636+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:10.145768+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4425,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":123,"num_read_kb":188,"num_write":92,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:41.413613+0000","last_change":"2024-09-19T12:03:41.413613+0000","last_active":"2024-09-19T12:03:41.413613+0000","last_peered":"2024-09-19T12:03:41.413613+0000","last_clean":"2024-09-19T12:03:41.413613+0000","last_became_active":"2024-09-19T11:35:39.671474+0000","last_became_peered":"2024-09-19T11:35:39.671474+0000","last_unstale":"2024-09-19T12:03:41.413613+0000","last_undegraded":"2024-09-19T12:03:41.413613+0000","last_fullsized":"2024-09-19T12:03:41.413613+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:41.413408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:41.413408+0000","last_clean_scrub_stamp":"2024-09-19T12:03:41.413408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:35.195876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'18","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:45.386001+0000","last_change":"2024-09-19T12:03:45.386001+0000","last_active":"2024-09-19T12:03:45.386001+0000","last_peered":"2024-09-19T12:03:45.386001+0000","last_clean":"2024-09-19T12:03:45.386001+0000","last_became_active":"2024-09-19T11:35:41.693900+0000","last_became_peered":"2024-09-19T11:35:41.693900+0000","last_unstale":"2024-09-19T12:03:45.386001+0000","last_undegraded":"2024-09-19T12:03:45.386001+0000","last_fullsized":"2024-09-19T12:03:45.386001+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-19T12:03:45.385807+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-19T12:03:45.385807+0000","last_clean_scrub_stamp":"2024-09-19T12:03:45.385807+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:53.491987+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'84","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.222123+0000","last_change":"2024-09-19T12:03:23.222123+0000","last_active":"2024-09-19T12:03:23.222123+0000","last_peered":"2024-09-19T12:03:23.222123+0000","last_clean":"2024-09-19T12:03:23.222123+0000","last_became_active":"2024-09-19T11:35:33.605259+0000","last_became_peered":"2024-09-19T11:35:33.605259+0000","last_unstale":"2024-09-19T12:03:23.222123+0000","last_undegraded":"2024-09-19T12:03:23.222123+0000","last_fullsized":"2024-09-19T12:03:23.222123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-19T12:03:23.221939+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-19T12:03:23.221939+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.221939+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:03.856307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":291,"num_write":128,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'46","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.566095+0000","last_change":"2024-09-19T12:03:17.566095+0000","last_active":"2024-09-19T12:03:17.566095+0000","last_peered":"2024-09-19T12:03:17.566095+0000","last_clean":"2024-09-19T12:03:17.566095+0000","last_became_active":"2024-09-19T11:35:31.622688+0000","last_became_peered":"2024-09-19T11:35:31.622688+0000","last_unstale":"2024-09-19T12:03:17.566095+0000","last_undegraded":"2024-09-19T12:03:17.566095+0000","last_fullsized":"2024-09-19T12:03:17.566095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'46","last_scrub_stamp":"2024-09-19T12:03:17.565856+0000","last_deep_scrub":"264'46","last_deep_scrub_stamp":"2024-09-19T12:03:17.565856+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.565856+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:16.319910+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":10950,"num_write":217,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.452711+0000","last_change":"2024-09-19T12:03:35.452711+0000","last_active":"2024-09-19T12:03:35.452711+0000","last_peered":"2024-09-19T12:03:35.452711+0000","last_clean":"2024-09-19T12:03:35.452711+0000","last_became_active":"2024-09-19T11:35:35.621518+0000","last_became_peered":"2024-09-19T11:35:35.621518+0000","last_unstale":"2024-09-19T12:03:35.452711+0000","last_undegraded":"2024-09-19T12:03:35.452711+0000","last_fullsized":"2024-09-19T12:03:35.452711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:35.452526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:35.452526+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.452526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:37:15.891912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'96","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.425162+0000","last_change":"2024-09-19T12:03:36.425162+0000","last_active":"2024-09-19T12:03:36.425162+0000","last_peered":"2024-09-19T12:03:36.425162+0000","last_clean":"2024-09-19T12:03:36.425162+0000","last_became_active":"2024-09-19T11:35:37.639833+0000","last_became_peered":"2024-09-19T11:35:37.639833+0000","last_unstale":"2024-09-19T12:03:36.425162+0000","last_undegraded":"2024-09-19T12:03:36.425162+0000","last_fullsized":"2024-09-19T12:03:36.425162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'96","last_scrub_stamp":"2024-09-19T12:03:36.424910+0000","last_deep_scrub":"264'96","last_deep_scrub_stamp":"2024-09-19T12:03:36.424910+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.424910+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:12.676734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5142,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":105,"num_read_kb":164,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.121385+0000","last_change":"2024-09-19T12:03:29.121385+0000","last_active":"2024-09-19T12:03:29.121385+0000","last_peered":"2024-09-19T12:03:29.121385+0000","last_clean":"2024-09-19T12:03:29.121385+0000","last_became_active":"2024-09-19T11:35:39.659011+0000","last_became_peered":"2024-09-19T11:35:39.659011+0000","last_unstale":"2024-09-19T12:03:29.121385+0000","last_undegraded":"2024-09-19T12:03:29.121385+0000","last_fullsized":"2024-09-19T12:03:29.121385+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:29.121214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:29.121214+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.121214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:43.379624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'15","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T11:59:51.603923+0000","last_change":"2024-09-19T11:35:41.675429+0000","last_active":"2024-09-19T11:59:51.603923+0000","last_peered":"2024-09-19T11:59:51.603923+0000","last_clean":"2024-09-19T11:59:51.603923+0000","last_became_active":"2024-09-19T11:35:41.674818+0000","last_became_peered":"2024-09-19T11:35:41.674818+0000","last_unstale":"2024-09-19T11:59:51.603923+0000","last_undegraded":"2024-09-19T11:59:51.603923+0000","last_fullsized":"2024-09-19T11:59:51.603923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:35:40.635133+0000","last_clean_scrub_stamp":"2024-09-19T11:35:40.635133+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:12.876595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":90,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'44","reported_seq":556,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.881067+0000","last_change":"2024-09-19T12:03:23.881067+0000","last_active":"2024-09-19T12:03:23.881067+0000","last_peered":"2024-09-19T12:03:23.881067+0000","last_clean":"2024-09-19T12:03:23.881067+0000","last_became_active":"2024-09-19T11:35:33.603610+0000","last_became_peered":"2024-09-19T11:35:33.603610+0000","last_unstale":"2024-09-19T12:03:23.881067+0000","last_undegraded":"2024-09-19T12:03:23.881067+0000","last_fullsized":"2024-09-19T12:03:23.881067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-19T12:03:23.880876+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-19T12:03:23.880876+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.880876+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:55.046789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":138,"num_write":82,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'50","reported_seq":573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.839834+0000","last_change":"2024-09-19T12:03:14.839686+0000","last_active":"2024-09-19T12:03:14.839834+0000","last_peered":"2024-09-19T12:03:14.839834+0000","last_clean":"2024-09-19T12:03:14.839834+0000","last_became_active":"2024-09-19T11:35:31.620504+0000","last_became_peered":"2024-09-19T11:35:31.620504+0000","last_unstale":"2024-09-19T12:03:14.839834+0000","last_undegraded":"2024-09-19T12:03:14.839834+0000","last_fullsized":"2024-09-19T12:03:14.839834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-19T12:03:14.839475+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-19T12:03:14.839475+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.839475+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:52.284729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":1683,"num_write":177,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.196586+0000","last_change":"2024-09-19T12:03:34.196586+0000","last_active":"2024-09-19T12:03:34.196586+0000","last_peered":"2024-09-19T12:03:34.196586+0000","last_clean":"2024-09-19T12:03:34.196586+0000","last_became_active":"2024-09-19T11:35:35.623348+0000","last_became_peered":"2024-09-19T11:35:35.623348+0000","last_unstale":"2024-09-19T12:03:34.196586+0000","last_undegraded":"2024-09-19T12:03:34.196586+0000","last_fullsized":"2024-09-19T12:03:34.196586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:34.196399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:34.196399+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.196399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:55:02.848981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'45","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:41.131616+0000","last_change":"2024-09-19T12:03:41.131616+0000","last_active":"2024-09-19T12:03:41.131616+0000","last_peered":"2024-09-19T12:03:41.131616+0000","last_clean":"2024-09-19T12:03:41.131616+0000","last_became_active":"2024-09-19T11:35:37.643249+0000","last_became_peered":"2024-09-19T11:35:37.643249+0000","last_unstale":"2024-09-19T12:03:41.131616+0000","last_undegraded":"2024-09-19T12:03:41.131616+0000","last_fullsized":"2024-09-19T12:03:41.131616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-19T12:03:41.131431+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-19T12:03:41.131431+0000","last_clean_scrub_stamp":"2024-09-19T12:03:41.131431+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:06.620351+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":104,"num_write":42,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.249989+0000","last_change":"2024-09-19T12:03:43.249989+0000","last_active":"2024-09-19T12:03:43.249989+0000","last_peered":"2024-09-19T12:03:43.249989+0000","last_clean":"2024-09-19T12:03:43.249989+0000","last_became_active":"2024-09-19T11:35:39.675285+0000","last_became_peered":"2024-09-19T11:35:39.675285+0000","last_unstale":"2024-09-19T12:03:43.249989+0000","last_undegraded":"2024-09-19T12:03:43.249989+0000","last_fullsized":"2024-09-19T12:03:43.249989+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:43.249782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:43.249782+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.249782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:12.747657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'24","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:44.364890+0000","last_change":"2024-09-19T12:03:44.364890+0000","last_active":"2024-09-19T12:03:44.364890+0000","last_peered":"2024-09-19T12:03:44.364890+0000","last_clean":"2024-09-19T12:03:44.364890+0000","last_became_active":"2024-09-19T11:35:41.694201+0000","last_became_peered":"2024-09-19T11:35:41.694201+0000","last_unstale":"2024-09-19T12:03:44.364890+0000","last_undegraded":"2024-09-19T12:03:44.364890+0000","last_fullsized":"2024-09-19T12:03:44.364890+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-19T12:03:44.364708+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-19T12:03:44.364708+0000","last_clean_scrub_stamp":"2024-09-19T12:03:44.364708+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:45.047687+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":56,"num_write":68,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'84","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.212198+0000","last_change":"2024-09-19T12:03:22.212198+0000","last_active":"2024-09-19T12:03:22.212198+0000","last_peered":"2024-09-19T12:03:22.212198+0000","last_clean":"2024-09-19T12:03:22.212198+0000","last_became_active":"2024-09-19T11:35:33.628283+0000","last_became_peered":"2024-09-19T11:35:33.628283+0000","last_unstale":"2024-09-19T12:03:22.212198+0000","last_undegraded":"2024-09-19T12:03:22.212198+0000","last_fullsized":"2024-09-19T12:03:22.212198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-19T12:03:22.211993+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-19T12:03:22.211993+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.211993+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:56:25.321214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":329,"num_read_kb":270,"num_write":117,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'31","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.370653+0000","last_change":"2024-09-19T12:03:13.370653+0000","last_active":"2024-09-19T12:03:13.370653+0000","last_peered":"2024-09-19T12:03:13.370653+0000","last_clean":"2024-09-19T12:03:13.370653+0000","last_became_active":"2024-09-19T11:36:06.649652+0000","last_became_peered":"2024-09-19T11:36:06.649652+0000","last_unstale":"2024-09-19T12:03:13.370653+0000","last_undegraded":"2024-09-19T12:03:13.370653+0000","last_fullsized":"2024-09-19T12:03:13.370653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-19T12:03:13.370381+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-19T12:03:13.370381+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.370381+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:51.332104+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079957,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":43,"num_read_kb":1095,"num_write":138,"num_write_kb":1067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,7],"acting":[0,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.578419+0000","last_change":"2024-09-19T12:03:31.578419+0000","last_active":"2024-09-19T12:03:31.578419+0000","last_peered":"2024-09-19T12:03:31.578419+0000","last_clean":"2024-09-19T12:03:31.578419+0000","last_became_active":"2024-09-19T11:35:35.612450+0000","last_became_peered":"2024-09-19T11:35:35.612450+0000","last_unstale":"2024-09-19T12:03:31.578419+0000","last_undegraded":"2024-09-19T12:03:31.578419+0000","last_fullsized":"2024-09-19T12:03:31.578419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:31.578193+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:31.578193+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.578193+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:28:05.874385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'94","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.280041+0000","last_change":"2024-09-19T12:03:38.280041+0000","last_active":"2024-09-19T12:03:38.280041+0000","last_peered":"2024-09-19T12:03:38.280041+0000","last_clean":"2024-09-19T12:03:38.280041+0000","last_became_active":"2024-09-19T11:35:37.638771+0000","last_became_peered":"2024-09-19T11:35:37.638771+0000","last_unstale":"2024-09-19T12:03:38.280041+0000","last_undegraded":"2024-09-19T12:03:38.280041+0000","last_fullsized":"2024-09-19T12:03:38.280041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'94","last_scrub_stamp":"2024-09-19T12:03:38.279801+0000","last_deep_scrub":"264'94","last_deep_scrub_stamp":"2024-09-19T12:03:38.279801+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.279801+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:42.145735+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4489,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":185,"num_write":92,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:39.463893+0000","last_change":"2024-09-19T12:03:39.463893+0000","last_active":"2024-09-19T12:03:39.463893+0000","last_peered":"2024-09-19T12:03:39.463893+0000","last_clean":"2024-09-19T12:03:39.463893+0000","last_became_active":"2024-09-19T11:35:39.662405+0000","last_became_peered":"2024-09-19T11:35:39.662405+0000","last_unstale":"2024-09-19T12:03:39.463893+0000","last_undegraded":"2024-09-19T12:03:39.463893+0000","last_fullsized":"2024-09-19T12:03:39.463893+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:39.463727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:39.463727+0000","last_clean_scrub_stamp":"2024-09-19T12:03:39.463727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:01.077359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'5","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:45.226127+0000","last_change":"2024-09-19T12:03:45.226127+0000","last_active":"2024-09-19T12:03:45.226127+0000","last_peered":"2024-09-19T12:03:45.226127+0000","last_clean":"2024-09-19T12:03:45.226127+0000","last_became_active":"2024-09-19T11:35:41.687549+0000","last_became_peered":"2024-09-19T11:35:41.687549+0000","last_unstale":"2024-09-19T12:03:45.226127+0000","last_undegraded":"2024-09-19T12:03:45.226127+0000","last_fullsized":"2024-09-19T12:03:45.226127+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:03:45.225935+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:03:45.225935+0000","last_clean_scrub_stamp":"2024-09-19T12:03:45.225935+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:06.084398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'79","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.562924+0000","last_change":"2024-09-19T12:03:23.562775+0000","last_active":"2024-09-19T12:03:23.562924+0000","last_peered":"2024-09-19T12:03:23.562924+0000","last_clean":"2024-09-19T12:03:23.562924+0000","last_became_active":"2024-09-19T11:35:33.629186+0000","last_became_peered":"2024-09-19T11:35:33.629186+0000","last_unstale":"2024-09-19T12:03:23.562924+0000","last_undegraded":"2024-09-19T12:03:23.562924+0000","last_fullsized":"2024-09-19T12:03:23.562924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'79","last_scrub_stamp":"2024-09-19T12:03:23.562590+0000","last_deep_scrub":"264'79","last_deep_scrub_stamp":"2024-09-19T12:03:23.562590+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.562590+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:34.865041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":235,"num_write":161,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'77","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.040384+0000","last_change":"2024-09-19T12:03:16.040384+0000","last_active":"2024-09-19T12:03:16.040384+0000","last_peered":"2024-09-19T12:03:16.040384+0000","last_clean":"2024-09-19T12:03:16.040384+0000","last_became_active":"2024-09-19T11:35:31.611719+0000","last_became_peered":"2024-09-19T11:35:31.611719+0000","last_unstale":"2024-09-19T12:03:16.040384+0000","last_undegraded":"2024-09-19T12:03:16.040384+0000","last_fullsized":"2024-09-19T12:03:16.040384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'77","last_scrub_stamp":"2024-09-19T12:03:16.040181+0000","last_deep_scrub":"264'77","last_deep_scrub_stamp":"2024-09-19T12:03:16.040181+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.040181+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:20.926088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":5196,"num_write":200,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'356","reported_seq":1062,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.626287+0000","last_change":"2024-09-19T12:03:20.626129+0000","last_active":"2024-09-19T12:03:20.626287+0000","last_peered":"2024-09-19T12:03:20.626287+0000","last_clean":"2024-09-19T12:03:20.626287+0000","last_became_active":"2024-09-19T11:35:33.603938+0000","last_became_peered":"2024-09-19T11:35:33.603938+0000","last_unstale":"2024-09-19T12:03:20.626287+0000","last_undegraded":"2024-09-19T12:03:20.626287+0000","last_fullsized":"2024-09-19T12:03:20.626287+0000","mapping_epoch":28,"log_start":"253'300","ondisk_log_start":"253'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-19T12:03:20.625945+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-19T12:03:20.625945+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.625945+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:23.605332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1936,"num_read_kb":1745,"num_write":575,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25754,"num_omap_keys":101,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'39","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.131069+0000","last_change":"2024-09-19T12:03:13.131069+0000","last_active":"2024-09-19T12:03:13.131069+0000","last_peered":"2024-09-19T12:03:13.131069+0000","last_clean":"2024-09-19T12:03:13.131069+0000","last_became_active":"2024-09-19T11:35:31.602046+0000","last_became_peered":"2024-09-19T11:35:31.602046+0000","last_unstale":"2024-09-19T12:03:13.131069+0000","last_undegraded":"2024-09-19T12:03:13.131069+0000","last_fullsized":"2024-09-19T12:03:13.131069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-19T12:03:13.130878+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-19T12:03:13.130878+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.130878+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:22.035681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":1671,"num_write":116,"num_write_kb":1627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'4","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.541740+0000","last_change":"2024-09-19T12:03:26.541496+0000","last_active":"2024-09-19T12:03:26.541740+0000","last_peered":"2024-09-19T12:03:26.541740+0000","last_clean":"2024-09-19T12:03:26.541740+0000","last_became_active":"2024-09-19T11:35:33.616104+0000","last_became_peered":"2024-09-19T11:35:33.616104+0000","last_unstale":"2024-09-19T12:03:26.541740+0000","last_undegraded":"2024-09-19T12:03:26.541740+0000","last_fullsized":"2024-09-19T12:03:26.541740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-19T12:03:26.541258+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-19T12:03:26.541258+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.541258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:34.987591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'37","reported_seq":552,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.554014+0000","last_change":"2024-09-19T12:03:15.554014+0000","last_active":"2024-09-19T12:03:15.554014+0000","last_peered":"2024-09-19T12:03:15.554014+0000","last_clean":"2024-09-19T12:03:15.554014+0000","last_became_active":"2024-09-19T11:35:31.613195+0000","last_became_peered":"2024-09-19T11:35:31.613195+0000","last_unstale":"2024-09-19T12:03:15.554014+0000","last_undegraded":"2024-09-19T12:03:15.554014+0000","last_fullsized":"2024-09-19T12:03:15.554014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:15.553759+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:15.553759+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.553759+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:58.104806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":62,"num_read_kb":44,"num_write":136,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'20","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.567353+0000","last_change":"2024-09-19T12:03:22.567098+0000","last_active":"2024-09-19T12:03:22.567353+0000","last_peered":"2024-09-19T12:03:22.567353+0000","last_clean":"2024-09-19T12:03:22.567353+0000","last_became_active":"2024-09-19T11:35:33.619302+0000","last_became_peered":"2024-09-19T11:35:33.619302+0000","last_unstale":"2024-09-19T12:03:22.567353+0000","last_undegraded":"2024-09-19T12:03:22.567353+0000","last_fullsized":"2024-09-19T12:03:22.567353+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'20","last_scrub_stamp":"2024-09-19T12:03:22.566882+0000","last_deep_scrub":"264'20","last_deep_scrub_stamp":"2024-09-19T12:03:22.566882+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.566882+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:29.013184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'66","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.360205+0000","last_change":"2024-09-19T12:03:17.360205+0000","last_active":"2024-09-19T12:03:17.360205+0000","last_peered":"2024-09-19T12:03:17.360205+0000","last_clean":"2024-09-19T12:03:17.360205+0000","last_became_active":"2024-09-19T11:35:31.590651+0000","last_became_peered":"2024-09-19T11:35:31.590651+0000","last_unstale":"2024-09-19T12:03:17.360205+0000","last_undegraded":"2024-09-19T12:03:17.360205+0000","last_fullsized":"2024-09-19T12:03:17.360205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'66","last_scrub_stamp":"2024-09-19T12:03:17.359961+0000","last_deep_scrub":"264'66","last_deep_scrub_stamp":"2024-09-19T12:03:17.359961+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.359961+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:33.016521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":163,"num_read_kb":1977,"num_write":243,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.984193+0000","last_change":"2024-09-19T12:03:27.984193+0000","last_active":"2024-09-19T12:03:27.984193+0000","last_peered":"2024-09-19T12:03:27.984193+0000","last_clean":"2024-09-19T12:03:27.984193+0000","last_became_active":"2024-09-19T11:35:33.619372+0000","last_became_peered":"2024-09-19T11:35:33.619372+0000","last_unstale":"2024-09-19T12:03:27.984193+0000","last_undegraded":"2024-09-19T12:03:27.984193+0000","last_fullsized":"2024-09-19T12:03:27.984193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:27.983993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:27.983993+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.983993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:39.204138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'17","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.875181+0000","last_change":"2024-09-19T12:03:21.875042+0000","last_active":"2024-09-19T12:03:21.875181+0000","last_peered":"2024-09-19T12:03:21.875181+0000","last_clean":"2024-09-19T12:03:21.875181+0000","last_became_active":"2024-09-19T11:35:31.584316+0000","last_became_peered":"2024-09-19T11:35:31.584316+0000","last_unstale":"2024-09-19T12:03:21.875181+0000","last_undegraded":"2024-09-19T12:03:21.875181+0000","last_fullsized":"2024-09-19T12:03:21.875181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-19T12:03:21.874788+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-19T12:03:21.874788+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.874788+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:13:03.876466+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079915,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":1065,"num_write":66,"num_write_kb":1060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.233496+0000","last_change":"2024-09-19T12:03:25.233496+0000","last_active":"2024-09-19T12:03:25.233496+0000","last_peered":"2024-09-19T12:03:25.233496+0000","last_clean":"2024-09-19T12:03:25.233496+0000","last_became_active":"2024-09-19T11:35:33.626872+0000","last_became_peered":"2024-09-19T11:35:33.626872+0000","last_unstale":"2024-09-19T12:03:25.233496+0000","last_undegraded":"2024-09-19T12:03:25.233496+0000","last_fullsized":"2024-09-19T12:03:25.233496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:25.233308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:25.233308+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.233308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:10:23.945915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'31","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.620767+0000","last_change":"2024-09-19T12:03:15.620612+0000","last_active":"2024-09-19T12:03:15.620767+0000","last_peered":"2024-09-19T12:03:15.620767+0000","last_clean":"2024-09-19T12:03:15.620767+0000","last_became_active":"2024-09-19T11:35:31.591724+0000","last_became_peered":"2024-09-19T11:35:31.591724+0000","last_unstale":"2024-09-19T12:03:15.620767+0000","last_undegraded":"2024-09-19T12:03:15.620767+0000","last_fullsized":"2024-09-19T12:03:15.620767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-19T12:03:15.620320+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-19T12:03:15.620320+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.620320+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:00.450806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079955,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":1149,"num_write":140,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'52","reported_seq":568,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.005096+0000","last_change":"2024-09-19T12:03:29.005096+0000","last_active":"2024-09-19T12:03:29.005096+0000","last_peered":"2024-09-19T12:03:29.005096+0000","last_clean":"2024-09-19T12:03:29.005096+0000","last_became_active":"2024-09-19T11:35:33.614316+0000","last_became_peered":"2024-09-19T11:35:33.614316+0000","last_unstale":"2024-09-19T12:03:29.005096+0000","last_undegraded":"2024-09-19T12:03:29.005096+0000","last_fullsized":"2024-09-19T12:03:29.005096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-19T12:03:29.004884+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-19T12:03:29.004884+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.004884+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:13.358873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":175,"num_write":74,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'46","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.008428+0000","last_change":"2024-09-19T12:03:13.008163+0000","last_active":"2024-09-19T12:03:13.008428+0000","last_peered":"2024-09-19T12:03:13.008428+0000","last_clean":"2024-09-19T12:03:13.008428+0000","last_became_active":"2024-09-19T11:35:31.612367+0000","last_became_peered":"2024-09-19T11:35:31.612367+0000","last_unstale":"2024-09-19T12:03:13.008428+0000","last_undegraded":"2024-09-19T12:03:13.008428+0000","last_fullsized":"2024-09-19T12:03:13.008428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'46","last_scrub_stamp":"2024-09-19T12:03:13.007880+0000","last_deep_scrub":"264'46","last_deep_scrub_stamp":"2024-09-19T12:03:13.007880+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.007880+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:16.799470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":319,"num_write":186,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'50","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.137052+0000","last_change":"2024-09-19T12:03:22.137052+0000","last_active":"2024-09-19T12:03:22.137052+0000","last_peered":"2024-09-19T12:03:22.137052+0000","last_clean":"2024-09-19T12:03:22.137052+0000","last_became_active":"2024-09-19T11:35:33.625249+0000","last_became_peered":"2024-09-19T11:35:33.625249+0000","last_unstale":"2024-09-19T12:03:22.137052+0000","last_undegraded":"2024-09-19T12:03:22.137052+0000","last_fullsized":"2024-09-19T12:03:22.137052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'50","last_scrub_stamp":"2024-09-19T12:03:22.136758+0000","last_deep_scrub":"262'50","last_deep_scrub_stamp":"2024-09-19T12:03:22.136758+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.136758+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:25.098457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":159,"num_write":74,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'52","reported_seq":577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.868423+0000","last_change":"2024-09-19T12:03:16.868272+0000","last_active":"2024-09-19T12:03:16.868423+0000","last_peered":"2024-09-19T12:03:16.868423+0000","last_clean":"2024-09-19T12:03:16.868423+0000","last_became_active":"2024-09-19T11:35:31.588705+0000","last_became_peered":"2024-09-19T11:35:31.588705+0000","last_unstale":"2024-09-19T12:03:16.868423+0000","last_undegraded":"2024-09-19T12:03:16.868423+0000","last_fullsized":"2024-09-19T12:03:16.868423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-19T12:03:16.868041+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-19T12:03:16.868041+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.868041+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:40.261460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":83,"num_read_kb":4157,"num_write":184,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'73","reported_seq":579,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.347834+0000","last_change":"2024-09-19T12:03:25.347586+0000","last_active":"2024-09-19T12:03:25.347834+0000","last_peered":"2024-09-19T12:03:25.347834+0000","last_clean":"2024-09-19T12:03:25.347834+0000","last_became_active":"2024-09-19T11:35:33.625874+0000","last_became_peered":"2024-09-19T11:35:33.625874+0000","last_unstale":"2024-09-19T12:03:25.347834+0000","last_undegraded":"2024-09-19T12:03:25.347834+0000","last_fullsized":"2024-09-19T12:03:25.347834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'73","last_scrub_stamp":"2024-09-19T12:03:25.347361+0000","last_deep_scrub":"264'73","last_deep_scrub_stamp":"2024-09-19T12:03:25.347361+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.347361+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:09.483565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":214,"num_write":124,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'30","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.538735+0000","last_change":"2024-09-19T12:03:18.538592+0000","last_active":"2024-09-19T12:03:18.538735+0000","last_peered":"2024-09-19T12:03:18.538735+0000","last_clean":"2024-09-19T12:03:18.538735+0000","last_became_active":"2024-09-19T11:35:31.593067+0000","last_became_peered":"2024-09-19T11:35:31.593067+0000","last_unstale":"2024-09-19T12:03:18.538735+0000","last_undegraded":"2024-09-19T12:03:18.538735+0000","last_fullsized":"2024-09-19T12:03:18.538735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-19T12:03:18.538359+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-19T12:03:18.538359+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.538359+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:10.521160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079937,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":48,"num_read_kb":1085,"num_write":114,"num_write_kb":1065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.194013+0000","last_change":"2024-09-19T12:03:27.193871+0000","last_active":"2024-09-19T12:03:27.194013+0000","last_peered":"2024-09-19T12:03:27.194013+0000","last_clean":"2024-09-19T12:03:27.194013+0000","last_became_active":"2024-09-19T11:35:33.612924+0000","last_became_peered":"2024-09-19T11:35:33.612924+0000","last_unstale":"2024-09-19T12:03:27.194013+0000","last_undegraded":"2024-09-19T12:03:27.194013+0000","last_fullsized":"2024-09-19T12:03:27.194013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:27.193693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:27.193693+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.193693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:06.323463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'63","reported_seq":584,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.823681+0000","last_change":"2024-09-19T12:03:17.823681+0000","last_active":"2024-09-19T12:03:17.823681+0000","last_peered":"2024-09-19T12:03:17.823681+0000","last_clean":"2024-09-19T12:03:17.823681+0000","last_became_active":"2024-09-19T11:35:31.581058+0000","last_became_peered":"2024-09-19T11:35:31.581058+0000","last_unstale":"2024-09-19T12:03:17.823681+0000","last_undegraded":"2024-09-19T12:03:17.823681+0000","last_fullsized":"2024-09-19T12:03:17.823681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'63","last_scrub_stamp":"2024-09-19T12:03:17.823463+0000","last_deep_scrub":"264'63","last_deep_scrub_stamp":"2024-09-19T12:03:17.823463+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.823463+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:53.718849+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":310,"num_write":200,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'63","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.277810+0000","last_change":"2024-09-19T12:03:21.277810+0000","last_active":"2024-09-19T12:03:21.277810+0000","last_peered":"2024-09-19T12:03:21.277810+0000","last_clean":"2024-09-19T12:03:21.277810+0000","last_became_active":"2024-09-19T11:35:33.628335+0000","last_became_peered":"2024-09-19T11:35:33.628335+0000","last_unstale":"2024-09-19T12:03:21.277810+0000","last_undegraded":"2024-09-19T12:03:21.277810+0000","last_fullsized":"2024-09-19T12:03:21.277810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'63","last_scrub_stamp":"2024-09-19T12:03:21.277541+0000","last_deep_scrub":"264'63","last_deep_scrub_stamp":"2024-09-19T12:03:21.277541+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.277541+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:38.808707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":184,"num_write":116,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'40","reported_seq":560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.501988+0000","last_change":"2024-09-19T12:03:19.501988+0000","last_active":"2024-09-19T12:03:19.501988+0000","last_peered":"2024-09-19T12:03:19.501988+0000","last_clean":"2024-09-19T12:03:19.501988+0000","last_became_active":"2024-09-19T11:35:31.623733+0000","last_became_peered":"2024-09-19T11:35:31.623733+0000","last_unstale":"2024-09-19T12:03:19.501988+0000","last_undegraded":"2024-09-19T12:03:19.501988+0000","last_fullsized":"2024-09-19T12:03:19.501988+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-19T12:03:19.501752+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-19T12:03:19.501752+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.501752+0000","objects_scrubbed":9,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:34.279646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159904,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":74,"num_read_kb":2163,"num_write":163,"num_write_kb":2120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'86","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.191248+0000","last_change":"2024-09-19T12:03:26.191248+0000","last_active":"2024-09-19T12:03:26.191248+0000","last_peered":"2024-09-19T12:03:26.191248+0000","last_clean":"2024-09-19T12:03:26.191248+0000","last_became_active":"2024-09-19T11:35:33.628184+0000","last_became_peered":"2024-09-19T11:35:33.628184+0000","last_unstale":"2024-09-19T12:03:26.191248+0000","last_undegraded":"2024-09-19T12:03:26.191248+0000","last_fullsized":"2024-09-19T12:03:26.191248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-19T12:03:26.191061+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-19T12:03:26.191061+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.191061+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:52.403398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":344,"num_read_kb":269,"num_write":142,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'57","reported_seq":579,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.379290+0000","last_change":"2024-09-19T12:03:16.379290+0000","last_active":"2024-09-19T12:03:16.379290+0000","last_peered":"2024-09-19T12:03:16.379290+0000","last_clean":"2024-09-19T12:03:16.379290+0000","last_became_active":"2024-09-19T11:35:31.612601+0000","last_became_peered":"2024-09-19T11:35:31.612601+0000","last_unstale":"2024-09-19T12:03:16.379290+0000","last_undegraded":"2024-09-19T12:03:16.379290+0000","last_fullsized":"2024-09-19T12:03:16.379290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'57","last_scrub_stamp":"2024-09-19T12:03:16.379072+0000","last_deep_scrub":"264'57","last_deep_scrub_stamp":"2024-09-19T12:03:16.379072+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.379072+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:19.650443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":6286,"num_write":172,"num_write_kb":11381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'7","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.404056+0000","last_change":"2024-09-19T12:03:26.404056+0000","last_active":"2024-09-19T12:03:26.404056+0000","last_peered":"2024-09-19T12:03:26.404056+0000","last_clean":"2024-09-19T12:03:26.404056+0000","last_became_active":"2024-09-19T11:35:33.624149+0000","last_became_peered":"2024-09-19T11:35:33.624149+0000","last_unstale":"2024-09-19T12:03:26.404056+0000","last_undegraded":"2024-09-19T12:03:26.404056+0000","last_fullsized":"2024-09-19T12:03:26.404056+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-19T12:03:26.403849+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-19T12:03:26.403849+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.403849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:14.799208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'34","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.999808+0000","last_change":"2024-09-19T12:03:14.999808+0000","last_active":"2024-09-19T12:03:14.999808+0000","last_peered":"2024-09-19T12:03:14.999808+0000","last_clean":"2024-09-19T12:03:14.999808+0000","last_became_active":"2024-09-19T11:35:31.609885+0000","last_became_peered":"2024-09-19T11:35:31.609885+0000","last_unstale":"2024-09-19T12:03:14.999808+0000","last_undegraded":"2024-09-19T12:03:14.999808+0000","last_fullsized":"2024-09-19T12:03:14.999808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-19T12:03:14.999554+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-19T12:03:14.999554+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.999554+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:58.998133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":83,"num_write":119,"num_write_kb":10337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'127","reported_seq":659,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.363258+0000","last_change":"2024-09-19T12:03:24.363258+0000","last_active":"2024-09-19T12:03:24.363258+0000","last_peered":"2024-09-19T12:03:24.363258+0000","last_clean":"2024-09-19T12:03:24.363258+0000","last_became_active":"2024-09-19T11:35:33.620326+0000","last_became_peered":"2024-09-19T11:35:33.620326+0000","last_unstale":"2024-09-19T12:03:24.363258+0000","last_undegraded":"2024-09-19T12:03:24.363258+0000","last_fullsized":"2024-09-19T12:03:24.363258+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-19T12:03:24.363078+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-19T12:03:24.363078+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.363078+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:58.950026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":393,"num_write":181,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'43","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.445831+0000","last_change":"2024-09-19T12:03:25.445831+0000","last_active":"2024-09-19T12:03:25.445831+0000","last_peered":"2024-09-19T12:03:25.445831+0000","last_clean":"2024-09-19T12:03:25.445831+0000","last_became_active":"2024-09-19T11:35:31.620566+0000","last_became_peered":"2024-09-19T11:35:31.620566+0000","last_unstale":"2024-09-19T12:03:25.445831+0000","last_undegraded":"2024-09-19T12:03:25.445831+0000","last_fullsized":"2024-09-19T12:03:25.445831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'43","last_scrub_stamp":"2024-09-19T12:03:25.445605+0000","last_deep_scrub":"264'43","last_deep_scrub_stamp":"2024-09-19T12:03:25.445605+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.445605+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:05.496684+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":90,"num_read_kb":69,"num_write":200,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'47","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.142570+0000","last_change":"2024-09-19T12:03:33.142570+0000","last_active":"2024-09-19T12:03:33.142570+0000","last_peered":"2024-09-19T12:03:33.142570+0000","last_clean":"2024-09-19T12:03:33.142570+0000","last_became_active":"2024-09-19T11:35:33.618247+0000","last_became_peered":"2024-09-19T11:35:33.618247+0000","last_unstale":"2024-09-19T12:03:33.142570+0000","last_undegraded":"2024-09-19T12:03:33.142570+0000","last_fullsized":"2024-09-19T12:03:33.142570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-09-19T12:03:33.142416+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-09-19T12:03:33.142416+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.142416+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:37.202857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":141,"num_write":67,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'24","reported_seq":539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.148827+0000","last_change":"2024-09-19T12:03:14.148668+0000","last_active":"2024-09-19T12:03:14.148827+0000","last_peered":"2024-09-19T12:03:14.148827+0000","last_clean":"2024-09-19T12:03:14.148827+0000","last_became_active":"2024-09-19T11:35:31.602248+0000","last_became_peered":"2024-09-19T11:35:31.602248+0000","last_unstale":"2024-09-19T12:03:14.148827+0000","last_undegraded":"2024-09-19T12:03:14.148827+0000","last_fullsized":"2024-09-19T12:03:14.148827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-19T12:03:14.148443+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-19T12:03:14.148443+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.148443+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:22.593414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":5134,"num_write":78,"num_write_kb":5127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'37","reported_seq":560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.417440+0000","last_change":"2024-09-19T12:03:24.417258+0000","last_active":"2024-09-19T12:03:24.417440+0000","last_peered":"2024-09-19T12:03:24.417440+0000","last_clean":"2024-09-19T12:03:24.417440+0000","last_became_active":"2024-09-19T11:35:33.624412+0000","last_became_peered":"2024-09-19T11:35:33.624412+0000","last_unstale":"2024-09-19T12:03:24.417440+0000","last_undegraded":"2024-09-19T12:03:24.417440+0000","last_fullsized":"2024-09-19T12:03:24.417440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:24.417066+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:24.417066+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.417066+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:45.238270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":98,"num_write":42,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'30","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.465953+0000","last_change":"2024-09-19T12:03:20.465783+0000","last_active":"2024-09-19T12:03:20.465953+0000","last_peered":"2024-09-19T12:03:20.465953+0000","last_clean":"2024-09-19T12:03:20.465953+0000","last_became_active":"2024-09-19T11:35:31.607037+0000","last_became_peered":"2024-09-19T11:35:31.607037+0000","last_unstale":"2024-09-19T12:03:20.465953+0000","last_undegraded":"2024-09-19T12:03:20.465953+0000","last_fullsized":"2024-09-19T12:03:20.465953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-19T12:03:20.465565+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-19T12:03:20.465565+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.465565+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:53.230652+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":51,"num_read_kb":53,"num_write":115,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'42","reported_seq":562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.451199+0000","last_change":"2024-09-19T12:03:21.451050+0000","last_active":"2024-09-19T12:03:21.451199+0000","last_peered":"2024-09-19T12:03:21.451199+0000","last_clean":"2024-09-19T12:03:21.451199+0000","last_became_active":"2024-09-19T11:35:31.607805+0000","last_became_peered":"2024-09-19T11:35:31.607805+0000","last_unstale":"2024-09-19T12:03:21.451199+0000","last_undegraded":"2024-09-19T12:03:21.451199+0000","last_fullsized":"2024-09-19T12:03:21.451199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-09-19T12:03:21.450834+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-09-19T12:03:21.450834+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.450834+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:38.340283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":66,"num_write":147,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.379034+0000","last_change":"2024-09-19T12:03:27.379034+0000","last_active":"2024-09-19T12:03:27.379034+0000","last_peered":"2024-09-19T12:03:27.379034+0000","last_clean":"2024-09-19T12:03:27.379034+0000","last_became_active":"2024-09-19T11:35:33.630100+0000","last_became_peered":"2024-09-19T11:35:33.630100+0000","last_unstale":"2024-09-19T12:03:27.379034+0000","last_undegraded":"2024-09-19T12:03:27.379034+0000","last_fullsized":"2024-09-19T12:03:27.379034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:27.378846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:27.378846+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.378846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:57.992134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'27","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.640146+0000","last_change":"2024-09-19T12:03:14.640003+0000","last_active":"2024-09-19T12:03:14.640146+0000","last_peered":"2024-09-19T12:03:14.640146+0000","last_clean":"2024-09-19T12:03:14.640146+0000","last_became_active":"2024-09-19T11:35:31.588328+0000","last_became_peered":"2024-09-19T11:35:31.588328+0000","last_unstale":"2024-09-19T12:03:14.640146+0000","last_undegraded":"2024-09-19T12:03:14.640146+0000","last_fullsized":"2024-09-19T12:03:14.640146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-19T12:03:14.639761+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-19T12:03:14.639761+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.639761+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:57.221214+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":33,"num_write":109,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'233","reported_seq":738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.418629+0000","last_change":"2024-09-19T12:03:31.418629+0000","last_active":"2024-09-19T12:03:31.418629+0000","last_peered":"2024-09-19T12:03:31.418629+0000","last_clean":"2024-09-19T12:03:31.418629+0000","last_became_active":"2024-09-19T11:35:33.612152+0000","last_became_peered":"2024-09-19T11:35:33.612152+0000","last_unstale":"2024-09-19T12:03:31.418629+0000","last_undegraded":"2024-09-19T12:03:31.418629+0000","last_fullsized":"2024-09-19T12:03:31.418629+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'233","last_scrub_stamp":"2024-09-19T12:03:31.418441+0000","last_deep_scrub":"264'233","last_deep_scrub_stamp":"2024-09-19T12:03:31.418441+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.418441+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:47.091951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":962,"num_read_kb":742,"num_write":392,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1228,"num_read_kb":871,"num_write":344,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":8631,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2810,"num_read_kb":2559,"num_write":1797,"num_write_kb":496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1721,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":17262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":728,"ondisk_log_size":728,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":155085,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":4671,"num_read_kb":6549,"num_write":3033,"num_write_kb":1354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":49824,"num_omap_keys":122,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2258,"ondisk_log_size":2258,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2082,"num_read_kb":2479,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":14003,"num_read_kb":11442,"num_write":5494,"num_write_kb":2900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35261,"num_omap_keys":142,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2408,"ondisk_log_size":2408,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":28939990,"num_objects":275,"num_object_clones":0,"num_object_copies":1100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":275,"num_whiteouts":0,"num_read":5003,"num_read_kb":236980,"num_write":9889,"num_write_kb":271206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40419328,"data_stored":40419328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2792,"ondisk_log_size":2792,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":114698,"num_write":81,"num_write_kb":65538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":120842,"num_write":81,"num_write_kb":65538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542492,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202096,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94169744,"statfs":{"total":96636764160,"available":96429817856,"internally_reserved":0,"allocated":8683520,"data_stored":6718512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":198244810},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542491,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":204524,"kb_used_data":10908,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94167316,"statfs":{"total":96636764160,"available":96427331584,"internally_reserved":0,"allocated":11169792,"data_stored":9233803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":198244806},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542492,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58480,"kb_used_data":9248,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313360,"statfs":{"total":96636764160,"available":96576880640,"internally_reserved":0,"allocated":9469952,"data_stored":7492221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542494,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67420,"kb_used_data":9868,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94304420,"statfs":{"total":96636764160,"available":96567726080,"internally_reserved":0,"allocated":10104832,"data_stored":8206396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542492,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":186180,"kb_used_data":10612,"kb_used_omap":1,"kb_used_meta":175550,"kb_avail":94185660,"statfs":{"total":96636764160,"available":96446115840,"internally_reserved":0,"allocated":10866688,"data_stored":8917533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179763655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542492,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56652,"kb_used_data":7420,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94315188,"statfs":{"total":96636764160,"available":96578752512,"internally_reserved":0,"allocated":7598080,"data_stored":5684279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542491,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105560,"kb_used_data":7816,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94266280,"statfs":{"total":96636764160,"available":96528670720,"internally_reserved":0,"allocated":8003584,"data_stored":6065036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542493,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216504,"kb_used_data":9064,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94155336,"statfs":{"total":96636764160,"available":96415064064,"internally_reserved":0,"allocated":9281536,"data_stored":7337278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212400581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4489216,"data_stored":4489216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3809280,"data_stored":3809280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6660096,"data_stored":6660096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5951488,"data_stored":5951488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6975488,"data_stored":6975488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3870720,"data_stored":3870720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T12:03:53.601 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.601 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.601 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.602 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.602 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.602 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.602 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.602 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.602 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.603 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.603 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.603 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.603 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.603 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.604 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.604 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.604 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.604 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.604 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.605 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.605 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.605 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.605 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.605 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.605 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.606 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.606 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.606 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.606 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.606 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.607 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.607 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.607 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.607 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.607 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.607 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.608 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.608 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.608 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.608 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.608 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.609 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.609 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.609 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.609 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.609 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-19T11:53:33.651081+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.610 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-19T11:51:52.426742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=51, tm_sec=52, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.610 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-19T11:53:36.683650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=53, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.612 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.612 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.613 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-19T11:35:40.635133+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=35, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=12, tm_min=3, tm_sec=7, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T12:03:53.613 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T12:04:13.614 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T12:04:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T12:04:13.991 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T12:04:13.997 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":1128,"stamp":"2024-09-19T12:04:13.429580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29695886,"num_objects":525,"num_object_clones":0,"num_object_copies":1600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":525,"num_whiteouts":0,"num_read":30044,"num_read_kb":496475,"num_write":20844,"num_write_kb":408787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":86806,"num_omap_keys":274,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8683,"ondisk_log_size":8683,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1115464,"kb_used_data":73416,"kb_used_omap":12,"kb_used_meta":1041907,"kb_avail":753859256,"statfs":{"total":773094113280,"available":771951878144,"internally_reserved":0,"allocated":75177984,"data_stored":59655058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1066913328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007254"},"pg_stats":[{"pgid":"67.1d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:55.524472+0000","last_change":"2024-09-19T12:03:55.524472+0000","last_active":"2024-09-19T12:03:55.524472+0000","last_peered":"2024-09-19T12:03:55.524472+0000","last_clean":"2024-09-19T12:03:55.524472+0000","last_became_active":"2024-09-19T11:53:37.744679+0000","last_became_peered":"2024-09-19T11:53:37.744679+0000","last_unstale":"2024-09-19T12:03:55.524472+0000","last_undegraded":"2024-09-19T12:03:55.524472+0000","last_fullsized":"2024-09-19T12:03:55.524472+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:55.524285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:55.524285+0000","last_clean_scrub_stamp":"2024-09-19T12:03:55.524285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:40.729828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:04:00.029293+0000","last_change":"2024-09-19T12:04:00.029293+0000","last_active":"2024-09-19T12:04:00.029293+0000","last_peered":"2024-09-19T12:04:00.029293+0000","last_clean":"2024-09-19T12:04:00.029293+0000","last_became_active":"2024-09-19T11:53:34.714946+0000","last_became_peered":"2024-09-19T11:53:34.714946+0000","last_unstale":"2024-09-19T12:04:00.029293+0000","last_undegraded":"2024-09-19T12:04:00.029293+0000","last_fullsized":"2024-09-19T12:04:00.029293+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:04:00.029117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:04:00.029117+0000","last_clean_scrub_stamp":"2024-09-19T12:04:00.029117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:49:10.038856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"256'14","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:52.529021+0000","last_change":"2024-09-19T12:03:52.529021+0000","last_active":"2024-09-19T12:03:52.529021+0000","last_peered":"2024-09-19T12:03:52.529021+0000","last_clean":"2024-09-19T12:03:52.529021+0000","last_became_active":"2024-09-19T11:51:53.493294+0000","last_became_peered":"2024-09-19T11:51:53.493294+0000","last_unstale":"2024-09-19T12:03:52.529021+0000","last_undegraded":"2024-09-19T12:03:52.529021+0000","last_fullsized":"2024-09-19T12:03:52.529021+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'14","last_scrub_stamp":"2024-09-19T12:03:52.528818+0000","last_deep_scrub":"256'14","last_deep_scrub_stamp":"2024-09-19T12:03:52.528818+0000","last_clean_scrub_stamp":"2024-09-19T12:03:52.528818+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:03.863441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":86,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:59.190463+0000","last_change":"2024-09-19T12:03:59.190463+0000","last_active":"2024-09-19T12:03:59.190463+0000","last_peered":"2024-09-19T12:03:59.190463+0000","last_clean":"2024-09-19T12:03:59.190463+0000","last_became_active":"2024-09-19T11:53:37.714526+0000","last_became_peered":"2024-09-19T11:53:37.714526+0000","last_unstale":"2024-09-19T12:03:59.190463+0000","last_undegraded":"2024-09-19T12:03:59.190463+0000","last_fullsized":"2024-09-19T12:03:59.190463+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:59.190247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:59.190247+0000","last_clean_scrub_stamp":"2024-09-19T12:03:59.190247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:22:29.061387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.551513+0000","last_change":"2024-09-19T12:03:43.551513+0000","last_active":"2024-09-19T12:03:43.551513+0000","last_peered":"2024-09-19T12:03:43.551513+0000","last_clean":"2024-09-19T12:03:43.551513+0000","last_became_active":"2024-09-19T11:53:34.730025+0000","last_became_peered":"2024-09-19T11:53:34.730025+0000","last_unstale":"2024-09-19T12:03:43.551513+0000","last_undegraded":"2024-09-19T12:03:43.551513+0000","last_fullsized":"2024-09-19T12:03:43.551513+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:43.551340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:43.551340+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.551340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:33.497631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.262623+0000","last_change":"2024-09-19T12:03:33.262471+0000","last_active":"2024-09-19T12:03:33.262623+0000","last_peered":"2024-09-19T12:03:33.262623+0000","last_clean":"2024-09-19T12:03:33.262623+0000","last_became_active":"2024-09-19T11:51:53.494552+0000","last_became_peered":"2024-09-19T11:51:53.494552+0000","last_unstale":"2024-09-19T12:03:33.262623+0000","last_undegraded":"2024-09-19T12:03:33.262623+0000","last_fullsized":"2024-09-19T12:03:33.262623+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:33.262271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:33.262271+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.262271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:35.620518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:04:04.514460+0000","last_change":"2024-09-19T12:04:04.514288+0000","last_active":"2024-09-19T12:04:04.514460+0000","last_peered":"2024-09-19T12:04:04.514460+0000","last_clean":"2024-09-19T12:04:04.514460+0000","last_became_active":"2024-09-19T11:53:37.757767+0000","last_became_peered":"2024-09-19T11:53:37.757767+0000","last_unstale":"2024-09-19T12:04:04.514460+0000","last_undegraded":"2024-09-19T12:04:04.514460+0000","last_fullsized":"2024-09-19T12:04:04.514460+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:04:04.514099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:04:04.514099+0000","last_clean_scrub_stamp":"2024-09-19T12:04:04.514099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:57.420948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.313102+0000","last_change":"2024-09-19T12:03:37.313102+0000","last_active":"2024-09-19T12:03:37.313102+0000","last_peered":"2024-09-19T12:03:37.313102+0000","last_clean":"2024-09-19T12:03:37.313102+0000","last_became_active":"2024-09-19T11:53:34.711510+0000","last_became_peered":"2024-09-19T11:53:34.711510+0000","last_unstale":"2024-09-19T12:03:37.313102+0000","last_undegraded":"2024-09-19T12:03:37.313102+0000","last_fullsized":"2024-09-19T12:03:37.313102+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:37.312882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:37.312882+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.312882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:58.227973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:54.509428+0000","last_change":"2024-09-19T12:03:54.509428+0000","last_active":"2024-09-19T12:03:54.509428+0000","last_peered":"2024-09-19T12:03:54.509428+0000","last_clean":"2024-09-19T12:03:54.509428+0000","last_became_active":"2024-09-19T11:51:53.479659+0000","last_became_peered":"2024-09-19T11:51:53.479659+0000","last_unstale":"2024-09-19T12:03:54.509428+0000","last_undegraded":"2024-09-19T12:03:54.509428+0000","last_fullsized":"2024-09-19T12:03:54.509428+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:54.509261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:54.509261+0000","last_clean_scrub_stamp":"2024-09-19T12:03:54.509261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:37.252144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:04:06.929019+0000","last_change":"2024-09-19T12:04:06.929019+0000","last_active":"2024-09-19T12:04:06.929019+0000","last_peered":"2024-09-19T12:04:06.929019+0000","last_clean":"2024-09-19T12:04:06.929019+0000","last_became_active":"2024-09-19T11:53:37.756047+0000","last_became_peered":"2024-09-19T11:53:37.756047+0000","last_unstale":"2024-09-19T12:04:06.929019+0000","last_undegraded":"2024-09-19T12:04:06.929019+0000","last_fullsized":"2024-09-19T12:04:06.929019+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:04:06.928834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:04:06.928834+0000","last_clean_scrub_stamp":"2024-09-19T12:04:06.928834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:00.832544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:53.242828+0000","last_change":"2024-09-19T12:03:53.242688+0000","last_active":"2024-09-19T12:03:53.242828+0000","last_peered":"2024-09-19T12:03:53.242828+0000","last_clean":"2024-09-19T12:03:53.242828+0000","last_became_active":"2024-09-19T11:53:34.705364+0000","last_became_peered":"2024-09-19T11:53:34.705364+0000","last_unstale":"2024-09-19T12:03:53.242828+0000","last_undegraded":"2024-09-19T12:03:53.242828+0000","last_fullsized":"2024-09-19T12:03:53.242828+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:53.242484+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:53.242484+0000","last_clean_scrub_stamp":"2024-09-19T12:03:53.242484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:14.285596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:55.110284+0000","last_change":"2024-09-19T12:03:55.110284+0000","last_active":"2024-09-19T12:03:55.110284+0000","last_peered":"2024-09-19T12:03:55.110284+0000","last_clean":"2024-09-19T12:03:55.110284+0000","last_became_active":"2024-09-19T11:51:53.475807+0000","last_became_peered":"2024-09-19T11:51:53.475807+0000","last_unstale":"2024-09-19T12:03:55.110284+0000","last_undegraded":"2024-09-19T12:03:55.110284+0000","last_fullsized":"2024-09-19T12:03:55.110284+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:55.110095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:55.110095+0000","last_clean_scrub_stamp":"2024-09-19T12:03:55.110095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:21.275976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:54.500602+0000","last_change":"2024-09-19T12:03:54.500602+0000","last_active":"2024-09-19T12:03:54.500602+0000","last_peered":"2024-09-19T12:03:54.500602+0000","last_clean":"2024-09-19T12:03:54.500602+0000","last_became_active":"2024-09-19T11:53:37.733244+0000","last_became_peered":"2024-09-19T11:53:37.733244+0000","last_unstale":"2024-09-19T12:03:54.500602+0000","last_undegraded":"2024-09-19T12:03:54.500602+0000","last_fullsized":"2024-09-19T12:03:54.500602+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:54.500417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:54.500417+0000","last_clean_scrub_stamp":"2024-09-19T12:03:54.500417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:23.564438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:59.449825+0000","last_change":"2024-09-19T12:03:59.449825+0000","last_active":"2024-09-19T12:03:59.449825+0000","last_peered":"2024-09-19T12:03:59.449825+0000","last_clean":"2024-09-19T12:03:59.449825+0000","last_became_active":"2024-09-19T11:53:34.722143+0000","last_became_peered":"2024-09-19T11:53:34.722143+0000","last_unstale":"2024-09-19T12:03:59.449825+0000","last_undegraded":"2024-09-19T12:03:59.449825+0000","last_fullsized":"2024-09-19T12:03:59.449825+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:59.449645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:59.449645+0000","last_clean_scrub_stamp":"2024-09-19T12:03:59.449645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:36.756950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"256'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:56.066020+0000","last_change":"2024-09-19T12:03:56.066020+0000","last_active":"2024-09-19T12:03:56.066020+0000","last_peered":"2024-09-19T12:03:56.066020+0000","last_clean":"2024-09-19T12:03:56.066020+0000","last_became_active":"2024-09-19T11:51:53.496828+0000","last_became_peered":"2024-09-19T11:51:53.496828+0000","last_unstale":"2024-09-19T12:03:56.066020+0000","last_undegraded":"2024-09-19T12:03:56.066020+0000","last_fullsized":"2024-09-19T12:03:56.066020+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'5","last_scrub_stamp":"2024-09-19T12:03:56.065810+0000","last_deep_scrub":"256'5","last_deep_scrub_stamp":"2024-09-19T12:03:56.065810+0000","last_clean_scrub_stamp":"2024-09-19T12:03:56.065810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:12.274292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":21,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.18","version":"264'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:44.972777+0000","last_change":"2024-09-19T12:03:44.972777+0000","last_active":"2024-09-19T12:03:44.972777+0000","last_peered":"2024-09-19T12:03:44.972777+0000","last_clean":"2024-09-19T12:03:44.972777+0000","last_became_active":"2024-09-19T11:53:37.751550+0000","last_became_peered":"2024-09-19T11:53:37.751550+0000","last_unstale":"2024-09-19T12:03:44.972777+0000","last_undegraded":"2024-09-19T12:03:44.972777+0000","last_fullsized":"2024-09-19T12:03:44.972777+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:03:44.972596+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:03:44.972596+0000","last_clean_scrub_stamp":"2024-09-19T12:03:44.972596+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:02.344028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:51.270052+0000","last_change":"2024-09-19T12:03:51.270052+0000","last_active":"2024-09-19T12:03:51.270052+0000","last_peered":"2024-09-19T12:03:51.270052+0000","last_clean":"2024-09-19T12:03:51.270052+0000","last_became_active":"2024-09-19T11:53:34.699476+0000","last_became_peered":"2024-09-19T11:53:34.699476+0000","last_unstale":"2024-09-19T12:03:51.270052+0000","last_undegraded":"2024-09-19T12:03:51.270052+0000","last_fullsized":"2024-09-19T12:03:51.270052+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:51.269835+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:51.269835+0000","last_clean_scrub_stamp":"2024-09-19T12:03:51.269835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:58.899900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:40.015918+0000","last_change":"2024-09-19T12:03:40.015918+0000","last_active":"2024-09-19T12:03:40.015918+0000","last_peered":"2024-09-19T12:03:40.015918+0000","last_clean":"2024-09-19T12:03:40.015918+0000","last_became_active":"2024-09-19T11:51:53.468220+0000","last_became_peered":"2024-09-19T11:51:53.468220+0000","last_unstale":"2024-09-19T12:03:40.015918+0000","last_undegraded":"2024-09-19T12:03:40.015918+0000","last_fullsized":"2024-09-19T12:03:40.015918+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:40.015667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:40.015667+0000","last_clean_scrub_stamp":"2024-09-19T12:03:40.015667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:04.004534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:45.958155+0000","last_change":"2024-09-19T12:03:45.958155+0000","last_active":"2024-09-19T12:03:45.958155+0000","last_peered":"2024-09-19T12:03:45.958155+0000","last_clean":"2024-09-19T12:03:45.958155+0000","last_became_active":"2024-09-19T11:53:37.733461+0000","last_became_peered":"2024-09-19T11:53:37.733461+0000","last_unstale":"2024-09-19T12:03:45.958155+0000","last_undegraded":"2024-09-19T12:03:45.958155+0000","last_fullsized":"2024-09-19T12:03:45.958155+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:45.957980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:45.957980+0000","last_clean_scrub_stamp":"2024-09-19T12:03:45.957980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:40.128334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:54.269103+0000","last_change":"2024-09-19T12:03:54.269103+0000","last_active":"2024-09-19T12:03:54.269103+0000","last_peered":"2024-09-19T12:03:54.269103+0000","last_clean":"2024-09-19T12:03:54.269103+0000","last_became_active":"2024-09-19T11:53:34.711125+0000","last_became_peered":"2024-09-19T11:53:34.711125+0000","last_unstale":"2024-09-19T12:03:54.269103+0000","last_undegraded":"2024-09-19T12:03:54.269103+0000","last_fullsized":"2024-09-19T12:03:54.269103+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:54.268906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:54.268906+0000","last_clean_scrub_stamp":"2024-09-19T12:03:54.268906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:23.391813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:53.488763+0000","last_change":"2024-09-19T12:03:53.488534+0000","last_active":"2024-09-19T12:03:53.488763+0000","last_peered":"2024-09-19T12:03:53.488763+0000","last_clean":"2024-09-19T12:03:53.488763+0000","last_became_active":"2024-09-19T11:51:53.497559+0000","last_became_peered":"2024-09-19T11:51:53.497559+0000","last_unstale":"2024-09-19T12:03:53.488763+0000","last_undegraded":"2024-09-19T12:03:53.488763+0000","last_fullsized":"2024-09-19T12:03:53.488763+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:53.488252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:53.488252+0000","last_clean_scrub_stamp":"2024-09-19T12:03:53.488252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:39:58.609996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:04:05.917344+0000","last_change":"2024-09-19T12:04:05.917344+0000","last_active":"2024-09-19T12:04:05.917344+0000","last_peered":"2024-09-19T12:04:05.917344+0000","last_clean":"2024-09-19T12:04:05.917344+0000","last_became_active":"2024-09-19T11:53:37.759079+0000","last_became_peered":"2024-09-19T11:53:37.759079+0000","last_unstale":"2024-09-19T12:04:05.917344+0000","last_undegraded":"2024-09-19T12:04:05.917344+0000","last_fullsized":"2024-09-19T12:04:05.917344+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:04:05.917152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:04:05.917152+0000","last_clean_scrub_stamp":"2024-09-19T12:04:05.917152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:23.462234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'8","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:04:01.467188+0000","last_change":"2024-09-19T12:04:01.467188+0000","last_active":"2024-09-19T12:04:01.467188+0000","last_peered":"2024-09-19T12:04:01.467188+0000","last_clean":"2024-09-19T12:04:01.467188+0000","last_became_active":"2024-09-19T11:53:34.722675+0000","last_became_peered":"2024-09-19T11:53:34.722675+0000","last_unstale":"2024-09-19T12:04:01.467188+0000","last_undegraded":"2024-09-19T12:04:01.467188+0000","last_fullsized":"2024-09-19T12:04:01.467188+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-19T12:04:01.467017+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-19T12:04:01.467017+0000","last_clean_scrub_stamp":"2024-09-19T12:04:01.467017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:15.462554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.568426+0000","last_change":"2024-09-19T12:03:38.568287+0000","last_active":"2024-09-19T12:03:38.568426+0000","last_peered":"2024-09-19T12:03:38.568426+0000","last_clean":"2024-09-19T12:03:38.568426+0000","last_became_active":"2024-09-19T11:51:53.485176+0000","last_became_peered":"2024-09-19T11:51:53.485176+0000","last_unstale":"2024-09-19T12:03:38.568426+0000","last_undegraded":"2024-09-19T12:03:38.568426+0000","last_fullsized":"2024-09-19T12:03:38.568426+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:38.568100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:38.568100+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.568100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:55.401799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:04:08.961184+0000","last_change":"2024-09-19T12:04:08.961184+0000","last_active":"2024-09-19T12:04:08.961184+0000","last_peered":"2024-09-19T12:04:08.961184+0000","last_clean":"2024-09-19T12:04:08.961184+0000","last_became_active":"2024-09-19T11:53:37.735681+0000","last_became_peered":"2024-09-19T11:53:37.735681+0000","last_unstale":"2024-09-19T12:04:08.961184+0000","last_undegraded":"2024-09-19T12:04:08.961184+0000","last_fullsized":"2024-09-19T12:04:08.961184+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:04:08.960998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:04:08.960998+0000","last_clean_scrub_stamp":"2024-09-19T12:04:08.960998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:08.645703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:52.443269+0000","last_change":"2024-09-19T12:03:52.443269+0000","last_active":"2024-09-19T12:03:52.443269+0000","last_peered":"2024-09-19T12:03:52.443269+0000","last_clean":"2024-09-19T12:03:52.443269+0000","last_became_active":"2024-09-19T11:53:34.708831+0000","last_became_peered":"2024-09-19T11:53:34.708831+0000","last_unstale":"2024-09-19T12:03:52.443269+0000","last_undegraded":"2024-09-19T12:03:52.443269+0000","last_fullsized":"2024-09-19T12:03:52.443269+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:52.443098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:52.443098+0000","last_clean_scrub_stamp":"2024-09-19T12:03:52.443098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:25.785768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:51.545516+0000","last_change":"2024-09-19T12:03:51.545370+0000","last_active":"2024-09-19T12:03:51.545516+0000","last_peered":"2024-09-19T12:03:51.545516+0000","last_clean":"2024-09-19T12:03:51.545516+0000","last_became_active":"2024-09-19T11:51:53.498327+0000","last_became_peered":"2024-09-19T11:51:53.498327+0000","last_unstale":"2024-09-19T12:03:51.545516+0000","last_undegraded":"2024-09-19T12:03:51.545516+0000","last_fullsized":"2024-09-19T12:03:51.545516+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:51.545193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:51.545193+0000","last_clean_scrub_stamp":"2024-09-19T12:03:51.545193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:49.395558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:04:02.960650+0000","last_change":"2024-09-19T12:04:02.960650+0000","last_active":"2024-09-19T12:04:02.960650+0000","last_peered":"2024-09-19T12:04:02.960650+0000","last_clean":"2024-09-19T12:04:02.960650+0000","last_became_active":"2024-09-19T11:53:37.754753+0000","last_became_peered":"2024-09-19T11:53:37.754753+0000","last_unstale":"2024-09-19T12:04:02.960650+0000","last_undegraded":"2024-09-19T12:04:02.960650+0000","last_fullsized":"2024-09-19T12:04:02.960650+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:04:02.960463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:04:02.960463+0000","last_clean_scrub_stamp":"2024-09-19T12:04:02.960463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:30.722282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:56.349812+0000","last_change":"2024-09-19T12:03:56.349812+0000","last_active":"2024-09-19T12:03:56.349812+0000","last_peered":"2024-09-19T12:03:56.349812+0000","last_clean":"2024-09-19T12:03:56.349812+0000","last_became_active":"2024-09-19T11:53:34.720273+0000","last_became_peered":"2024-09-19T11:53:34.720273+0000","last_unstale":"2024-09-19T12:03:56.349812+0000","last_undegraded":"2024-09-19T12:03:56.349812+0000","last_fullsized":"2024-09-19T12:03:56.349812+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:56.349633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:56.349633+0000","last_clean_scrub_stamp":"2024-09-19T12:03:56.349633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:19.995376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"255'4","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:57.088634+0000","last_change":"2024-09-19T12:03:57.088406+0000","last_active":"2024-09-19T12:03:57.088634+0000","last_peered":"2024-09-19T12:03:57.088634+0000","last_clean":"2024-09-19T12:03:57.088634+0000","last_became_active":"2024-09-19T11:51:53.496988+0000","last_became_peered":"2024-09-19T11:51:53.496988+0000","last_unstale":"2024-09-19T12:03:57.088634+0000","last_undegraded":"2024-09-19T12:03:57.088634+0000","last_fullsized":"2024-09-19T12:03:57.088634+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'4","last_scrub_stamp":"2024-09-19T12:03:57.088191+0000","last_deep_scrub":"255'4","last_deep_scrub_stamp":"2024-09-19T12:03:57.088191+0000","last_clean_scrub_stamp":"2024-09-19T12:03:57.088191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:02.761678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.17","version":"264'5","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:04:04.932791+0000","last_change":"2024-09-19T12:04:04.932791+0000","last_active":"2024-09-19T12:04:04.932791+0000","last_peered":"2024-09-19T12:04:04.932791+0000","last_clean":"2024-09-19T12:04:04.932791+0000","last_became_active":"2024-09-19T11:53:37.759275+0000","last_became_peered":"2024-09-19T11:53:37.759275+0000","last_unstale":"2024-09-19T12:04:04.932791+0000","last_undegraded":"2024-09-19T12:04:04.932791+0000","last_fullsized":"2024-09-19T12:04:04.932791+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:04:04.932600+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:04:04.932600+0000","last_clean_scrub_stamp":"2024-09-19T12:04:04.932600+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:26.495235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.281180+0000","last_change":"2024-09-19T12:03:35.281180+0000","last_active":"2024-09-19T12:03:35.281180+0000","last_peered":"2024-09-19T12:03:35.281180+0000","last_clean":"2024-09-19T12:03:35.281180+0000","last_became_active":"2024-09-19T11:53:34.699437+0000","last_became_peered":"2024-09-19T11:53:34.699437+0000","last_unstale":"2024-09-19T12:03:35.281180+0000","last_undegraded":"2024-09-19T12:03:35.281180+0000","last_fullsized":"2024-09-19T12:03:35.281180+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:35.280997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:35.280997+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.280997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:37:37.064342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"256'23","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.233224+0000","last_change":"2024-09-19T12:03:34.233008+0000","last_active":"2024-09-19T12:03:34.233224+0000","last_peered":"2024-09-19T12:03:34.233224+0000","last_clean":"2024-09-19T12:03:34.233224+0000","last_became_active":"2024-09-19T11:51:53.478643+0000","last_became_peered":"2024-09-19T11:51:53.478643+0000","last_unstale":"2024-09-19T12:03:34.233224+0000","last_undegraded":"2024-09-19T12:03:34.233224+0000","last_fullsized":"2024-09-19T12:03:34.233224+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'23","last_scrub_stamp":"2024-09-19T12:03:34.232755+0000","last_deep_scrub":"256'23","last_deep_scrub_stamp":"2024-09-19T12:03:34.232755+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.232755+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:36:04.255326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":169,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:58.231197+0000","last_change":"2024-09-19T12:03:58.231197+0000","last_active":"2024-09-19T12:03:58.231197+0000","last_peered":"2024-09-19T12:03:58.231197+0000","last_clean":"2024-09-19T12:03:58.231197+0000","last_became_active":"2024-09-19T11:53:37.737215+0000","last_became_peered":"2024-09-19T11:53:37.737215+0000","last_unstale":"2024-09-19T12:03:58.231197+0000","last_undegraded":"2024-09-19T12:03:58.231197+0000","last_fullsized":"2024-09-19T12:03:58.231197+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:58.231014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:58.231014+0000","last_clean_scrub_stamp":"2024-09-19T12:03:58.231014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:59.236680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:04:02.506000+0000","last_change":"2024-09-19T12:04:02.506000+0000","last_active":"2024-09-19T12:04:02.506000+0000","last_peered":"2024-09-19T12:04:02.506000+0000","last_clean":"2024-09-19T12:04:02.506000+0000","last_became_active":"2024-09-19T11:53:34.723850+0000","last_became_peered":"2024-09-19T11:53:34.723850+0000","last_unstale":"2024-09-19T12:04:02.506000+0000","last_undegraded":"2024-09-19T12:04:02.506000+0000","last_fullsized":"2024-09-19T12:04:02.506000+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-19T12:04:02.505805+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-19T12:04:02.505805+0000","last_clean_scrub_stamp":"2024-09-19T12:04:02.505805+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:27.065335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:50.352671+0000","last_change":"2024-09-19T12:03:50.352671+0000","last_active":"2024-09-19T12:03:50.352671+0000","last_peered":"2024-09-19T12:03:50.352671+0000","last_clean":"2024-09-19T12:03:50.352671+0000","last_became_active":"2024-09-19T11:51:53.478922+0000","last_became_peered":"2024-09-19T11:51:53.478922+0000","last_unstale":"2024-09-19T12:03:50.352671+0000","last_undegraded":"2024-09-19T12:03:50.352671+0000","last_fullsized":"2024-09-19T12:03:50.352671+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:50.352486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:50.352486+0000","last_clean_scrub_stamp":"2024-09-19T12:03:50.352486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:56.678042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:46.440461+0000","last_change":"2024-09-19T12:03:46.440461+0000","last_active":"2024-09-19T12:03:46.440461+0000","last_peered":"2024-09-19T12:03:46.440461+0000","last_clean":"2024-09-19T12:03:46.440461+0000","last_became_active":"2024-09-19T11:53:37.734844+0000","last_became_peered":"2024-09-19T11:53:37.734844+0000","last_unstale":"2024-09-19T12:03:46.440461+0000","last_undegraded":"2024-09-19T12:03:46.440461+0000","last_fullsized":"2024-09-19T12:03:46.440461+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:46.440252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:46.440252+0000","last_clean_scrub_stamp":"2024-09-19T12:03:46.440252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:54.466305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:49.268280+0000","last_change":"2024-09-19T12:03:49.268280+0000","last_active":"2024-09-19T12:03:49.268280+0000","last_peered":"2024-09-19T12:03:49.268280+0000","last_clean":"2024-09-19T12:03:49.268280+0000","last_became_active":"2024-09-19T11:53:34.704150+0000","last_became_peered":"2024-09-19T11:53:34.704150+0000","last_unstale":"2024-09-19T12:03:49.268280+0000","last_undegraded":"2024-09-19T12:03:49.268280+0000","last_fullsized":"2024-09-19T12:03:49.268280+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:49.268075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:49.268075+0000","last_clean_scrub_stamp":"2024-09-19T12:03:49.268075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:34.835959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:49.367958+0000","last_change":"2024-09-19T12:03:49.367958+0000","last_active":"2024-09-19T12:03:49.367958+0000","last_peered":"2024-09-19T12:03:49.367958+0000","last_clean":"2024-09-19T12:03:49.367958+0000","last_became_active":"2024-09-19T11:51:53.481154+0000","last_became_peered":"2024-09-19T11:51:53.481154+0000","last_unstale":"2024-09-19T12:03:49.367958+0000","last_undegraded":"2024-09-19T12:03:49.367958+0000","last_fullsized":"2024-09-19T12:03:49.367958+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:49.367757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:49.367757+0000","last_clean_scrub_stamp":"2024-09-19T12:03:49.367757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:30.048796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:47.454122+0000","last_change":"2024-09-19T12:03:47.454122+0000","last_active":"2024-09-19T12:03:47.454122+0000","last_peered":"2024-09-19T12:03:47.454122+0000","last_clean":"2024-09-19T12:03:47.454122+0000","last_became_active":"2024-09-19T11:53:37.730152+0000","last_became_peered":"2024-09-19T11:53:37.730152+0000","last_unstale":"2024-09-19T12:03:47.454122+0000","last_undegraded":"2024-09-19T12:03:47.454122+0000","last_fullsized":"2024-09-19T12:03:47.454122+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:47.453929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:47.453929+0000","last_clean_scrub_stamp":"2024-09-19T12:03:47.453929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:03.891649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:59.078031+0000","last_change":"2024-09-19T12:03:59.078031+0000","last_active":"2024-09-19T12:03:59.078031+0000","last_peered":"2024-09-19T12:03:59.078031+0000","last_clean":"2024-09-19T12:03:59.078031+0000","last_became_active":"2024-09-19T11:53:34.703463+0000","last_became_peered":"2024-09-19T11:53:34.703463+0000","last_unstale":"2024-09-19T12:03:59.078031+0000","last_undegraded":"2024-09-19T12:03:59.078031+0000","last_fullsized":"2024-09-19T12:03:59.078031+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:59.077832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:59.077832+0000","last_clean_scrub_stamp":"2024-09-19T12:03:59.077832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:30.953161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:55.461833+0000","last_change":"2024-09-19T12:03:55.461833+0000","last_active":"2024-09-19T12:03:55.461833+0000","last_peered":"2024-09-19T12:03:55.461833+0000","last_clean":"2024-09-19T12:03:55.461833+0000","last_became_active":"2024-09-19T11:51:53.490650+0000","last_became_peered":"2024-09-19T11:51:53.490650+0000","last_unstale":"2024-09-19T12:03:55.461833+0000","last_undegraded":"2024-09-19T12:03:55.461833+0000","last_fullsized":"2024-09-19T12:03:55.461833+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-19T12:03:55.461548+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-19T12:03:55.461548+0000","last_clean_scrub_stamp":"2024-09-19T12:03:55.461548+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:39.556799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:04:07.973234+0000","last_change":"2024-09-19T12:04:07.973234+0000","last_active":"2024-09-19T12:04:07.973234+0000","last_peered":"2024-09-19T12:04:07.973234+0000","last_clean":"2024-09-19T12:04:07.973234+0000","last_became_active":"2024-09-19T11:53:37.755628+0000","last_became_peered":"2024-09-19T11:53:37.755628+0000","last_unstale":"2024-09-19T12:04:07.973234+0000","last_undegraded":"2024-09-19T12:04:07.973234+0000","last_fullsized":"2024-09-19T12:04:07.973234+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:04:07.973049+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:04:07.973049+0000","last_clean_scrub_stamp":"2024-09-19T12:04:07.973049+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:01.602230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5122,"num_write":10,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:42.024141+0000","last_change":"2024-09-19T12:03:42.024141+0000","last_active":"2024-09-19T12:03:42.024141+0000","last_peered":"2024-09-19T12:03:42.024141+0000","last_clean":"2024-09-19T12:03:42.024141+0000","last_became_active":"2024-09-19T11:53:34.707412+0000","last_became_peered":"2024-09-19T11:53:34.707412+0000","last_unstale":"2024-09-19T12:03:42.024141+0000","last_undegraded":"2024-09-19T12:03:42.024141+0000","last_fullsized":"2024-09-19T12:03:42.024141+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:42.023959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:42.023959+0000","last_clean_scrub_stamp":"2024-09-19T12:03:42.023959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:03.044262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"256'7","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:48.223729+0000","last_change":"2024-09-19T12:03:48.223729+0000","last_active":"2024-09-19T12:03:48.223729+0000","last_peered":"2024-09-19T12:03:48.223729+0000","last_clean":"2024-09-19T12:03:48.223729+0000","last_became_active":"2024-09-19T11:51:53.463784+0000","last_became_peered":"2024-09-19T11:51:53.463784+0000","last_unstale":"2024-09-19T12:03:48.223729+0000","last_undegraded":"2024-09-19T12:03:48.223729+0000","last_fullsized":"2024-09-19T12:03:48.223729+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-09-19T12:03:48.223529+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-09-19T12:03:48.223529+0000","last_clean_scrub_stamp":"2024-09-19T12:03:48.223529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:06.419307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":42,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.12","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.966483+0000","last_change":"2024-09-19T12:03:43.966483+0000","last_active":"2024-09-19T12:03:43.966483+0000","last_peered":"2024-09-19T12:03:43.966483+0000","last_clean":"2024-09-19T12:03:43.966483+0000","last_became_active":"2024-09-19T11:53:37.743807+0000","last_became_peered":"2024-09-19T11:53:37.743807+0000","last_unstale":"2024-09-19T12:03:43.966483+0000","last_undegraded":"2024-09-19T12:03:43.966483+0000","last_fullsized":"2024-09-19T12:03:43.966483+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:43.966296+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:43.966296+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.966296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:02.165260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:51.450211+0000","last_change":"2024-09-19T12:03:51.450211+0000","last_active":"2024-09-19T12:03:51.450211+0000","last_peered":"2024-09-19T12:03:51.450211+0000","last_clean":"2024-09-19T12:03:51.450211+0000","last_became_active":"2024-09-19T11:53:34.705705+0000","last_became_peered":"2024-09-19T11:53:34.705705+0000","last_unstale":"2024-09-19T12:03:51.450211+0000","last_undegraded":"2024-09-19T12:03:51.450211+0000","last_fullsized":"2024-09-19T12:03:51.450211+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:51.450030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:51.450030+0000","last_clean_scrub_stamp":"2024-09-19T12:03:51.450030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:41.504972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"262'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:58.101508+0000","last_change":"2024-09-19T12:03:58.101508+0000","last_active":"2024-09-19T12:03:58.101508+0000","last_peered":"2024-09-19T12:03:58.101508+0000","last_clean":"2024-09-19T12:03:58.101508+0000","last_became_active":"2024-09-19T11:51:53.488252+0000","last_became_peered":"2024-09-19T11:51:53.488252+0000","last_unstale":"2024-09-19T12:03:58.101508+0000","last_undegraded":"2024-09-19T12:03:58.101508+0000","last_fullsized":"2024-09-19T12:03:58.101508+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-19T12:03:58.101305+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-19T12:03:58.101305+0000","last_clean_scrub_stamp":"2024-09-19T12:03:58.101305+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:10:47.555121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:04:03.950670+0000","last_change":"2024-09-19T12:04:03.950670+0000","last_active":"2024-09-19T12:04:03.950670+0000","last_peered":"2024-09-19T12:04:03.950670+0000","last_clean":"2024-09-19T12:04:03.950670+0000","last_became_active":"2024-09-19T11:53:37.754497+0000","last_became_peered":"2024-09-19T11:53:37.754497+0000","last_unstale":"2024-09-19T12:04:03.950670+0000","last_undegraded":"2024-09-19T12:04:03.950670+0000","last_fullsized":"2024-09-19T12:04:03.950670+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:04:03.950488+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:04:03.950488+0000","last_clean_scrub_stamp":"2024-09-19T12:04:03.950488+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:28.172930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:55.386358+0000","last_change":"2024-09-19T12:03:55.386358+0000","last_active":"2024-09-19T12:03:55.386358+0000","last_peered":"2024-09-19T12:03:55.386358+0000","last_clean":"2024-09-19T12:03:55.386358+0000","last_became_active":"2024-09-19T11:53:34.721070+0000","last_became_peered":"2024-09-19T11:53:34.721070+0000","last_unstale":"2024-09-19T12:03:55.386358+0000","last_undegraded":"2024-09-19T12:03:55.386358+0000","last_fullsized":"2024-09-19T12:03:55.386358+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:03:55.386146+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:03:55.386146+0000","last_clean_scrub_stamp":"2024-09-19T12:03:55.386146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:45.791478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"256'23","reported_seq":108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:49.042366+0000","last_change":"2024-09-19T12:03:49.042366+0000","last_active":"2024-09-19T12:03:49.042366+0000","last_peered":"2024-09-19T12:03:49.042366+0000","last_clean":"2024-09-19T12:03:49.042366+0000","last_became_active":"2024-09-19T11:51:53.490074+0000","last_became_peered":"2024-09-19T11:51:53.490074+0000","last_unstale":"2024-09-19T12:03:49.042366+0000","last_undegraded":"2024-09-19T12:03:49.042366+0000","last_fullsized":"2024-09-19T12:03:49.042366+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'23","last_scrub_stamp":"2024-09-19T12:03:49.042156+0000","last_deep_scrub":"256'23","last_deep_scrub_stamp":"2024-09-19T12:03:49.042156+0000","last_clean_scrub_stamp":"2024-09-19T12:03:49.042156+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:54.883981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":156,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:04:02.002429+0000","last_change":"2024-09-19T12:04:02.002429+0000","last_active":"2024-09-19T12:04:02.002429+0000","last_peered":"2024-09-19T12:04:02.002429+0000","last_clean":"2024-09-19T12:04:02.002429+0000","last_became_active":"2024-09-19T11:53:37.758965+0000","last_became_peered":"2024-09-19T11:53:37.758965+0000","last_unstale":"2024-09-19T12:04:02.002429+0000","last_undegraded":"2024-09-19T12:04:02.002429+0000","last_fullsized":"2024-09-19T12:04:02.002429+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:04:02.002194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:04:02.002194+0000","last_clean_scrub_stamp":"2024-09-19T12:04:02.002194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:33:49.366351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.292593+0000","last_change":"2024-09-19T12:03:38.292593+0000","last_active":"2024-09-19T12:03:38.292593+0000","last_peered":"2024-09-19T12:03:38.292593+0000","last_clean":"2024-09-19T12:03:38.292593+0000","last_became_active":"2024-09-19T11:53:34.729772+0000","last_became_peered":"2024-09-19T11:53:34.729772+0000","last_unstale":"2024-09-19T12:03:38.292593+0000","last_undegraded":"2024-09-19T12:03:38.292593+0000","last_fullsized":"2024-09-19T12:03:38.292593+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:38.292417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:38.292417+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.292417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:06.132371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"262'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:49.481052+0000","last_change":"2024-09-19T12:03:49.481052+0000","last_active":"2024-09-19T12:03:49.481052+0000","last_peered":"2024-09-19T12:03:49.481052+0000","last_clean":"2024-09-19T12:03:49.481052+0000","last_became_active":"2024-09-19T11:51:53.479490+0000","last_became_peered":"2024-09-19T11:51:53.479490+0000","last_unstale":"2024-09-19T12:03:49.481052+0000","last_undegraded":"2024-09-19T12:03:49.481052+0000","last_fullsized":"2024-09-19T12:03:49.481052+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-19T12:03:49.480796+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-19T12:03:49.480796+0000","last_clean_scrub_stamp":"2024-09-19T12:03:49.480796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:59.372923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:45.460538+0000","last_change":"2024-09-19T12:03:45.460538+0000","last_active":"2024-09-19T12:03:45.460538+0000","last_peered":"2024-09-19T12:03:45.460538+0000","last_clean":"2024-09-19T12:03:45.460538+0000","last_became_active":"2024-09-19T11:53:37.730671+0000","last_became_peered":"2024-09-19T11:53:37.730671+0000","last_unstale":"2024-09-19T12:03:45.460538+0000","last_undegraded":"2024-09-19T12:03:45.460538+0000","last_fullsized":"2024-09-19T12:03:45.460538+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:45.460355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:45.460355+0000","last_clean_scrub_stamp":"2024-09-19T12:03:45.460355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:21.052784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:58.469149+0000","last_change":"2024-09-19T12:03:58.469149+0000","last_active":"2024-09-19T12:03:58.469149+0000","last_peered":"2024-09-19T12:03:58.469149+0000","last_clean":"2024-09-19T12:03:58.469149+0000","last_became_active":"2024-09-19T11:53:34.720160+0000","last_became_peered":"2024-09-19T11:53:34.720160+0000","last_unstale":"2024-09-19T12:03:58.469149+0000","last_undegraded":"2024-09-19T12:03:58.469149+0000","last_fullsized":"2024-09-19T12:03:58.469149+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:03:58.468967+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:03:58.468967+0000","last_clean_scrub_stamp":"2024-09-19T12:03:58.468967+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:21.044134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:39.043936+0000","last_change":"2024-09-19T12:03:39.043936+0000","last_active":"2024-09-19T12:03:39.043936+0000","last_peered":"2024-09-19T12:03:39.043936+0000","last_clean":"2024-09-19T12:03:39.043936+0000","last_became_active":"2024-09-19T11:51:53.483786+0000","last_became_peered":"2024-09-19T11:51:53.483786+0000","last_unstale":"2024-09-19T12:03:39.043936+0000","last_undegraded":"2024-09-19T12:03:39.043936+0000","last_fullsized":"2024-09-19T12:03:39.043936+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:39.043729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:39.043729+0000","last_clean_scrub_stamp":"2024-09-19T12:03:39.043729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:52.152922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:04:01.042599+0000","last_change":"2024-09-19T12:04:01.042599+0000","last_active":"2024-09-19T12:04:01.042599+0000","last_peered":"2024-09-19T12:04:01.042599+0000","last_clean":"2024-09-19T12:04:01.042599+0000","last_became_active":"2024-09-19T11:53:37.739838+0000","last_became_peered":"2024-09-19T11:53:37.739838+0000","last_unstale":"2024-09-19T12:04:01.042599+0000","last_undegraded":"2024-09-19T12:04:01.042599+0000","last_fullsized":"2024-09-19T12:04:01.042599+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:04:01.042408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:04:01.042408+0000","last_clean_scrub_stamp":"2024-09-19T12:04:01.042408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:59.748493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:42.599118+0000","last_change":"2024-09-19T12:03:42.599118+0000","last_active":"2024-09-19T12:03:42.599118+0000","last_peered":"2024-09-19T12:03:42.599118+0000","last_clean":"2024-09-19T12:03:42.599118+0000","last_became_active":"2024-09-19T11:53:34.708542+0000","last_became_peered":"2024-09-19T11:53:34.708542+0000","last_unstale":"2024-09-19T12:03:42.599118+0000","last_undegraded":"2024-09-19T12:03:42.599118+0000","last_fullsized":"2024-09-19T12:03:42.599118+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:42.598902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:42.598902+0000","last_clean_scrub_stamp":"2024-09-19T12:03:42.598902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:58.103214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.231321+0000","last_change":"2024-09-19T12:03:32.231321+0000","last_active":"2024-09-19T12:03:32.231321+0000","last_peered":"2024-09-19T12:03:32.231321+0000","last_clean":"2024-09-19T12:03:32.231321+0000","last_became_active":"2024-09-19T11:51:53.478940+0000","last_became_peered":"2024-09-19T11:51:53.478940+0000","last_unstale":"2024-09-19T12:03:32.231321+0000","last_undegraded":"2024-09-19T12:03:32.231321+0000","last_fullsized":"2024-09-19T12:03:32.231321+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:32.231148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:32.231148+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.231148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:11.191687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.9","version":"264'8","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:57.208496+0000","last_change":"2024-09-19T12:03:57.208496+0000","last_active":"2024-09-19T12:03:57.208496+0000","last_peered":"2024-09-19T12:03:57.208496+0000","last_clean":"2024-09-19T12:03:57.208496+0000","last_became_active":"2024-09-19T11:54:08.143092+0000","last_became_peered":"2024-09-19T11:54:08.143092+0000","last_unstale":"2024-09-19T12:03:57.208496+0000","last_undegraded":"2024-09-19T12:03:57.208496+0000","last_fullsized":"2024-09-19T12:03:57.208496+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-19T12:03:57.208312+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-19T12:03:57.208312+0000","last_clean_scrub_stamp":"2024-09-19T12:03:57.208312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:48:55.120800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:56.434307+0000","last_change":"2024-09-19T12:03:56.434307+0000","last_active":"2024-09-19T12:03:56.434307+0000","last_peered":"2024-09-19T12:03:56.434307+0000","last_clean":"2024-09-19T12:03:56.434307+0000","last_became_active":"2024-09-19T11:53:34.722786+0000","last_became_peered":"2024-09-19T11:53:34.722786+0000","last_unstale":"2024-09-19T12:03:56.434307+0000","last_undegraded":"2024-09-19T12:03:56.434307+0000","last_fullsized":"2024-09-19T12:03:56.434307+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:56.434096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:56.434096+0000","last_clean_scrub_stamp":"2024-09-19T12:03:56.434096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:47.491419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:49.533251+0000","last_change":"2024-09-19T12:03:49.533251+0000","last_active":"2024-09-19T12:03:49.533251+0000","last_peered":"2024-09-19T12:03:49.533251+0000","last_clean":"2024-09-19T12:03:49.533251+0000","last_became_active":"2024-09-19T11:51:53.490467+0000","last_became_peered":"2024-09-19T11:51:53.490467+0000","last_unstale":"2024-09-19T12:03:49.533251+0000","last_undegraded":"2024-09-19T12:03:49.533251+0000","last_fullsized":"2024-09-19T12:03:49.533251+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:49.533069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:49.533069+0000","last_clean_scrub_stamp":"2024-09-19T12:03:49.533069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:56:07.858245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:59.384601+0000","last_change":"2024-09-19T12:03:59.384601+0000","last_active":"2024-09-19T12:03:59.384601+0000","last_peered":"2024-09-19T12:03:59.384601+0000","last_clean":"2024-09-19T12:03:59.384601+0000","last_became_active":"2024-09-19T11:53:37.738652+0000","last_became_peered":"2024-09-19T11:53:37.738652+0000","last_unstale":"2024-09-19T12:03:59.384601+0000","last_undegraded":"2024-09-19T12:03:59.384601+0000","last_fullsized":"2024-09-19T12:03:59.384601+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:59.384432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:59.384432+0000","last_clean_scrub_stamp":"2024-09-19T12:03:59.384432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:05.970342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"264'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:41.611867+0000","last_change":"2024-09-19T12:03:41.611867+0000","last_active":"2024-09-19T12:03:41.611867+0000","last_peered":"2024-09-19T12:03:41.611867+0000","last_clean":"2024-09-19T12:03:41.611867+0000","last_became_active":"2024-09-19T11:53:34.708971+0000","last_became_peered":"2024-09-19T11:53:34.708971+0000","last_unstale":"2024-09-19T12:03:41.611867+0000","last_undegraded":"2024-09-19T12:03:41.611867+0000","last_fullsized":"2024-09-19T12:03:41.611867+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:41.611645+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:41.611645+0000","last_clean_scrub_stamp":"2024-09-19T12:03:41.611645+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:33.776492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"256'7","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:48.323918+0000","last_change":"2024-09-19T12:03:48.323918+0000","last_active":"2024-09-19T12:03:48.323918+0000","last_peered":"2024-09-19T12:03:48.323918+0000","last_clean":"2024-09-19T12:03:48.323918+0000","last_became_active":"2024-09-19T11:51:53.481429+0000","last_became_peered":"2024-09-19T11:51:53.481429+0000","last_unstale":"2024-09-19T12:03:48.323918+0000","last_undegraded":"2024-09-19T12:03:48.323918+0000","last_fullsized":"2024-09-19T12:03:48.323918+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'7","last_scrub_stamp":"2024-09-19T12:03:48.323654+0000","last_deep_scrub":"256'7","last_deep_scrub_stamp":"2024-09-19T12:03:48.323654+0000","last_clean_scrub_stamp":"2024-09-19T12:03:48.323654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:38.951037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":44,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:48.438733+0000","last_change":"2024-09-19T12:03:48.438733+0000","last_active":"2024-09-19T12:03:48.438733+0000","last_peered":"2024-09-19T12:03:48.438733+0000","last_clean":"2024-09-19T12:03:48.438733+0000","last_became_active":"2024-09-19T11:53:37.742403+0000","last_became_peered":"2024-09-19T11:53:37.742403+0000","last_unstale":"2024-09-19T12:03:48.438733+0000","last_undegraded":"2024-09-19T12:03:48.438733+0000","last_fullsized":"2024-09-19T12:03:48.438733+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:48.438549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:48.438549+0000","last_clean_scrub_stamp":"2024-09-19T12:03:48.438549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:05.247713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:57.448298+0000","last_change":"2024-09-19T12:03:57.448298+0000","last_active":"2024-09-19T12:03:57.448298+0000","last_peered":"2024-09-19T12:03:57.448298+0000","last_clean":"2024-09-19T12:03:57.448298+0000","last_became_active":"2024-09-19T11:53:34.728959+0000","last_became_peered":"2024-09-19T11:53:34.728959+0000","last_unstale":"2024-09-19T12:03:57.448298+0000","last_undegraded":"2024-09-19T12:03:57.448298+0000","last_fullsized":"2024-09-19T12:03:57.448298+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:57.448115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:57.448115+0000","last_clean_scrub_stamp":"2024-09-19T12:03:57.448115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:22.862983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:51.096510+0000","last_change":"2024-09-19T12:03:51.096510+0000","last_active":"2024-09-19T12:03:51.096510+0000","last_peered":"2024-09-19T12:03:51.096510+0000","last_clean":"2024-09-19T12:03:51.096510+0000","last_became_active":"2024-09-19T11:51:53.472485+0000","last_became_peered":"2024-09-19T11:51:53.472485+0000","last_unstale":"2024-09-19T12:03:51.096510+0000","last_undegraded":"2024-09-19T12:03:51.096510+0000","last_fullsized":"2024-09-19T12:03:51.096510+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:51.096323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:51.096323+0000","last_clean_scrub_stamp":"2024-09-19T12:03:51.096323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:45.804648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:58.421415+0000","last_change":"2024-09-19T12:03:58.421415+0000","last_active":"2024-09-19T12:03:58.421415+0000","last_peered":"2024-09-19T12:03:58.421415+0000","last_clean":"2024-09-19T12:03:58.421415+0000","last_became_active":"2024-09-19T11:53:37.736772+0000","last_became_peered":"2024-09-19T11:53:37.736772+0000","last_unstale":"2024-09-19T12:03:58.421415+0000","last_undegraded":"2024-09-19T12:03:58.421415+0000","last_fullsized":"2024-09-19T12:03:58.421415+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:58.421229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:58.421229+0000","last_clean_scrub_stamp":"2024-09-19T12:03:58.421229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:57.854254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'6","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:50.232013+0000","last_change":"2024-09-19T12:03:50.232013+0000","last_active":"2024-09-19T12:03:50.232013+0000","last_peered":"2024-09-19T12:03:50.232013+0000","last_clean":"2024-09-19T12:03:50.232013+0000","last_became_active":"2024-09-19T11:53:34.711382+0000","last_became_peered":"2024-09-19T11:53:34.711382+0000","last_unstale":"2024-09-19T12:03:50.232013+0000","last_undegraded":"2024-09-19T12:03:50.232013+0000","last_fullsized":"2024-09-19T12:03:50.232013+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-19T12:03:50.231802+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-19T12:03:50.231802+0000","last_clean_scrub_stamp":"2024-09-19T12:03:50.231802+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:37.412347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.013559+0000","last_change":"2024-09-19T12:03:38.013559+0000","last_active":"2024-09-19T12:03:38.013559+0000","last_peered":"2024-09-19T12:03:38.013559+0000","last_clean":"2024-09-19T12:03:38.013559+0000","last_became_active":"2024-09-19T11:51:53.486236+0000","last_became_peered":"2024-09-19T11:51:53.486236+0000","last_unstale":"2024-09-19T12:03:38.013559+0000","last_undegraded":"2024-09-19T12:03:38.013559+0000","last_fullsized":"2024-09-19T12:03:38.013559+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:38.013314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:38.013314+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.013314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:45.542318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:04:00.419028+0000","last_change":"2024-09-19T12:04:00.418874+0000","last_active":"2024-09-19T12:04:00.419028+0000","last_peered":"2024-09-19T12:04:00.419028+0000","last_clean":"2024-09-19T12:04:00.419028+0000","last_became_active":"2024-09-19T11:53:37.745076+0000","last_became_peered":"2024-09-19T11:53:37.745076+0000","last_unstale":"2024-09-19T12:04:00.419028+0000","last_undegraded":"2024-09-19T12:04:00.419028+0000","last_fullsized":"2024-09-19T12:04:00.419028+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:04:00.418682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:04:00.418682+0000","last_clean_scrub_stamp":"2024-09-19T12:04:00.418682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:45.612502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:52.412476+0000","last_change":"2024-09-19T12:03:52.412352+0000","last_active":"2024-09-19T12:03:52.412476+0000","last_peered":"2024-09-19T12:03:52.412476+0000","last_clean":"2024-09-19T12:03:52.412476+0000","last_became_active":"2024-09-19T11:53:34.719535+0000","last_became_peered":"2024-09-19T11:53:34.719535+0000","last_unstale":"2024-09-19T12:03:52.412476+0000","last_undegraded":"2024-09-19T12:03:52.412476+0000","last_fullsized":"2024-09-19T12:03:52.412476+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:52.412164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:52.412164+0000","last_clean_scrub_stamp":"2024-09-19T12:03:52.412164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:39.042363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"262'11","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:50.560507+0000","last_change":"2024-09-19T12:03:50.560507+0000","last_active":"2024-09-19T12:03:50.560507+0000","last_peered":"2024-09-19T12:03:50.560507+0000","last_clean":"2024-09-19T12:03:50.560507+0000","last_became_active":"2024-09-19T11:51:53.486126+0000","last_became_peered":"2024-09-19T11:51:53.486126+0000","last_unstale":"2024-09-19T12:03:50.560507+0000","last_undegraded":"2024-09-19T12:03:50.560507+0000","last_fullsized":"2024-09-19T12:03:50.560507+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'11","last_scrub_stamp":"2024-09-19T12:03:50.560199+0000","last_deep_scrub":"262'11","last_deep_scrub_stamp":"2024-09-19T12:03:50.560199+0000","last_clean_scrub_stamp":"2024-09-19T12:03:50.560199+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:38.281640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":56,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:04:03.493046+0000","last_change":"2024-09-19T12:04:03.492856+0000","last_active":"2024-09-19T12:04:03.493046+0000","last_peered":"2024-09-19T12:04:03.493046+0000","last_clean":"2024-09-19T12:04:03.493046+0000","last_became_active":"2024-09-19T11:53:37.748479+0000","last_became_peered":"2024-09-19T11:53:37.748479+0000","last_unstale":"2024-09-19T12:04:03.493046+0000","last_undegraded":"2024-09-19T12:04:03.493046+0000","last_fullsized":"2024-09-19T12:04:03.493046+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:04:03.492665+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:04:03.492665+0000","last_clean_scrub_stamp":"2024-09-19T12:04:03.492665+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:43.281614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.317630+0000","last_change":"2024-09-19T12:03:36.317457+0000","last_active":"2024-09-19T12:03:36.317630+0000","last_peered":"2024-09-19T12:03:36.317630+0000","last_clean":"2024-09-19T12:03:36.317630+0000","last_became_active":"2024-09-19T11:53:34.721421+0000","last_became_peered":"2024-09-19T11:53:34.721421+0000","last_unstale":"2024-09-19T12:03:36.317630+0000","last_undegraded":"2024-09-19T12:03:36.317630+0000","last_fullsized":"2024-09-19T12:03:36.317630+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:36.317280+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:36.317280+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.317280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:29.816352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.059227+0000","last_change":"2024-09-19T12:03:37.059227+0000","last_active":"2024-09-19T12:03:37.059227+0000","last_peered":"2024-09-19T12:03:37.059227+0000","last_clean":"2024-09-19T12:03:37.059227+0000","last_became_active":"2024-09-19T11:51:53.468768+0000","last_became_peered":"2024-09-19T11:51:53.468768+0000","last_unstale":"2024-09-19T12:03:37.059227+0000","last_undegraded":"2024-09-19T12:03:37.059227+0000","last_fullsized":"2024-09-19T12:03:37.059227+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:37.059042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:37.059042+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.059042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:38.709192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:57.377554+0000","last_change":"2024-09-19T12:03:57.377554+0000","last_active":"2024-09-19T12:03:57.377554+0000","last_peered":"2024-09-19T12:03:57.377554+0000","last_clean":"2024-09-19T12:03:57.377554+0000","last_became_active":"2024-09-19T11:53:37.749246+0000","last_became_peered":"2024-09-19T11:53:37.749246+0000","last_unstale":"2024-09-19T12:03:57.377554+0000","last_undegraded":"2024-09-19T12:03:57.377554+0000","last_fullsized":"2024-09-19T12:03:57.377554+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:57.377369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:57.377369+0000","last_clean_scrub_stamp":"2024-09-19T12:03:57.377369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:42.451989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:50.447545+0000","last_change":"2024-09-19T12:03:50.447545+0000","last_active":"2024-09-19T12:03:50.447545+0000","last_peered":"2024-09-19T12:03:50.447545+0000","last_clean":"2024-09-19T12:03:50.447545+0000","last_became_active":"2024-09-19T11:53:34.702356+0000","last_became_peered":"2024-09-19T11:53:34.702356+0000","last_unstale":"2024-09-19T12:03:50.447545+0000","last_undegraded":"2024-09-19T12:03:50.447545+0000","last_fullsized":"2024-09-19T12:03:50.447545+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:50.447358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:50.447358+0000","last_clean_scrub_stamp":"2024-09-19T12:03:50.447358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:01:51.589624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"262'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:47.346556+0000","last_change":"2024-09-19T12:03:47.346556+0000","last_active":"2024-09-19T12:03:47.346556+0000","last_peered":"2024-09-19T12:03:47.346556+0000","last_clean":"2024-09-19T12:03:47.346556+0000","last_became_active":"2024-09-19T11:51:53.483350+0000","last_became_peered":"2024-09-19T11:51:53.483350+0000","last_unstale":"2024-09-19T12:03:47.346556+0000","last_undegraded":"2024-09-19T12:03:47.346556+0000","last_fullsized":"2024-09-19T12:03:47.346556+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-19T12:03:47.346332+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-19T12:03:47.346332+0000","last_clean_scrub_stamp":"2024-09-19T12:03:47.346332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:12.872441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"264'9","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:55.305553+0000","last_change":"2024-09-19T12:03:55.305553+0000","last_active":"2024-09-19T12:03:55.305553+0000","last_peered":"2024-09-19T12:03:55.305553+0000","last_clean":"2024-09-19T12:03:55.305553+0000","last_became_active":"2024-09-19T11:53:37.730641+0000","last_became_peered":"2024-09-19T11:53:37.730641+0000","last_unstale":"2024-09-19T12:03:55.305553+0000","last_undegraded":"2024-09-19T12:03:55.305553+0000","last_fullsized":"2024-09-19T12:03:55.305553+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-19T12:03:55.305376+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-19T12:03:55.305376+0000","last_clean_scrub_stamp":"2024-09-19T12:03:55.305376+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:09.683568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15360,"num_write":14,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:54.399973+0000","last_change":"2024-09-19T12:03:54.399973+0000","last_active":"2024-09-19T12:03:54.399973+0000","last_peered":"2024-09-19T12:03:54.399973+0000","last_clean":"2024-09-19T12:03:54.399973+0000","last_became_active":"2024-09-19T11:53:34.719193+0000","last_became_peered":"2024-09-19T11:53:34.719193+0000","last_unstale":"2024-09-19T12:03:54.399973+0000","last_undegraded":"2024-09-19T12:03:54.399973+0000","last_fullsized":"2024-09-19T12:03:54.399973+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:54.399784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:54.399784+0000","last_clean_scrub_stamp":"2024-09-19T12:03:54.399784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:58.006513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"256'4","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:40.584176+0000","last_change":"2024-09-19T12:03:40.584176+0000","last_active":"2024-09-19T12:03:40.584176+0000","last_peered":"2024-09-19T12:03:40.584176+0000","last_clean":"2024-09-19T12:03:40.584176+0000","last_became_active":"2024-09-19T11:51:53.476953+0000","last_became_peered":"2024-09-19T11:51:53.476953+0000","last_unstale":"2024-09-19T12:03:40.584176+0000","last_undegraded":"2024-09-19T12:03:40.584176+0000","last_fullsized":"2024-09-19T12:03:40.584176+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'4","last_scrub_stamp":"2024-09-19T12:03:40.583951+0000","last_deep_scrub":"256'4","last_deep_scrub_stamp":"2024-09-19T12:03:40.583951+0000","last_clean_scrub_stamp":"2024-09-19T12:03:40.583951+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:33.938684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:44.505433+0000","last_change":"2024-09-19T12:03:44.505238+0000","last_active":"2024-09-19T12:03:44.505433+0000","last_peered":"2024-09-19T12:03:44.505433+0000","last_clean":"2024-09-19T12:03:44.505433+0000","last_became_active":"2024-09-19T11:53:37.731400+0000","last_became_peered":"2024-09-19T11:53:37.731400+0000","last_unstale":"2024-09-19T12:03:44.505433+0000","last_undegraded":"2024-09-19T12:03:44.505433+0000","last_fullsized":"2024-09-19T12:03:44.505433+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:44.505046+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:44.505046+0000","last_clean_scrub_stamp":"2024-09-19T12:03:44.505046+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:40:13.866952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:51.387191+0000","last_change":"2024-09-19T12:03:51.387191+0000","last_active":"2024-09-19T12:03:51.387191+0000","last_peered":"2024-09-19T12:03:51.387191+0000","last_clean":"2024-09-19T12:03:51.387191+0000","last_became_active":"2024-09-19T11:53:34.724406+0000","last_became_peered":"2024-09-19T11:53:34.724406+0000","last_unstale":"2024-09-19T12:03:51.387191+0000","last_undegraded":"2024-09-19T12:03:51.387191+0000","last_fullsized":"2024-09-19T12:03:51.387191+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:03:51.387002+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:03:51.387002+0000","last_clean_scrub_stamp":"2024-09-19T12:03:51.387002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:35.816920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":21506,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:48.431585+0000","last_change":"2024-09-19T12:03:48.431585+0000","last_active":"2024-09-19T12:03:48.431585+0000","last_peered":"2024-09-19T12:03:48.431585+0000","last_clean":"2024-09-19T12:03:48.431585+0000","last_became_active":"2024-09-19T11:51:53.494443+0000","last_became_peered":"2024-09-19T11:51:53.494443+0000","last_unstale":"2024-09-19T12:03:48.431585+0000","last_undegraded":"2024-09-19T12:03:48.431585+0000","last_fullsized":"2024-09-19T12:03:48.431585+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:48.431404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:48.431404+0000","last_clean_scrub_stamp":"2024-09-19T12:03:48.431404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:09:11.896738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.0","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:53.465264+0000","last_change":"2024-09-19T12:03:53.465264+0000","last_active":"2024-09-19T12:03:53.465264+0000","last_peered":"2024-09-19T12:03:53.465264+0000","last_clean":"2024-09-19T12:03:53.465264+0000","last_became_active":"2024-09-19T11:53:37.729101+0000","last_became_peered":"2024-09-19T11:53:37.729101+0000","last_unstale":"2024-09-19T12:03:53.465264+0000","last_undegraded":"2024-09-19T12:03:53.465264+0000","last_fullsized":"2024-09-19T12:03:53.465264+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:53.465072+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:53.465072+0000","last_clean_scrub_stamp":"2024-09-19T12:03:53.465072+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:42.603800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:53.369138+0000","last_change":"2024-09-19T12:03:53.368962+0000","last_active":"2024-09-19T12:03:53.369138+0000","last_peered":"2024-09-19T12:03:53.369138+0000","last_clean":"2024-09-19T12:03:53.369138+0000","last_became_active":"2024-09-19T11:53:34.715905+0000","last_became_peered":"2024-09-19T11:53:34.715905+0000","last_unstale":"2024-09-19T12:03:53.369138+0000","last_undegraded":"2024-09-19T12:03:53.369138+0000","last_fullsized":"2024-09-19T12:03:53.369138+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:53.368798+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:53.368798+0000","last_clean_scrub_stamp":"2024-09-19T12:03:53.368798+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:24.898164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:52.262619+0000","last_change":"2024-09-19T12:03:52.262619+0000","last_active":"2024-09-19T12:03:52.262619+0000","last_peered":"2024-09-19T12:03:52.262619+0000","last_clean":"2024-09-19T12:03:52.262619+0000","last_became_active":"2024-09-19T11:51:53.479975+0000","last_became_peered":"2024-09-19T11:51:53.479975+0000","last_unstale":"2024-09-19T12:03:52.262619+0000","last_undegraded":"2024-09-19T12:03:52.262619+0000","last_fullsized":"2024-09-19T12:03:52.262619+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:52.262412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:52.262412+0000","last_clean_scrub_stamp":"2024-09-19T12:03:52.262412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:54.605214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.012333+0000","last_change":"2024-09-19T12:03:43.012104+0000","last_active":"2024-09-19T12:03:43.012333+0000","last_peered":"2024-09-19T12:03:43.012333+0000","last_clean":"2024-09-19T12:03:43.012333+0000","last_became_active":"2024-09-19T11:53:37.751835+0000","last_became_peered":"2024-09-19T11:53:37.751835+0000","last_unstale":"2024-09-19T12:03:43.012333+0000","last_undegraded":"2024-09-19T12:03:43.012333+0000","last_fullsized":"2024-09-19T12:03:43.012333+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:43.011892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:43.011892+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.011892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:30.578950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:39.595758+0000","last_change":"2024-09-19T12:03:39.595598+0000","last_active":"2024-09-19T12:03:39.595758+0000","last_peered":"2024-09-19T12:03:39.595758+0000","last_clean":"2024-09-19T12:03:39.595758+0000","last_became_active":"2024-09-19T11:53:34.721659+0000","last_became_peered":"2024-09-19T11:53:34.721659+0000","last_unstale":"2024-09-19T12:03:39.595758+0000","last_undegraded":"2024-09-19T12:03:39.595758+0000","last_fullsized":"2024-09-19T12:03:39.595758+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:39.595416+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:39.595416+0000","last_clean_scrub_stamp":"2024-09-19T12:03:39.595416+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:56.599619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"262'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.093403+0000","last_change":"2024-09-19T12:03:36.093403+0000","last_active":"2024-09-19T12:03:36.093403+0000","last_peered":"2024-09-19T12:03:36.093403+0000","last_clean":"2024-09-19T12:03:36.093403+0000","last_became_active":"2024-09-19T11:51:53.487416+0000","last_became_peered":"2024-09-19T11:51:53.487416+0000","last_unstale":"2024-09-19T12:03:36.093403+0000","last_undegraded":"2024-09-19T12:03:36.093403+0000","last_fullsized":"2024-09-19T12:03:36.093403+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-19T12:03:36.093200+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-19T12:03:36.093200+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.093200+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:15.847965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:56.257268+0000","last_change":"2024-09-19T12:03:56.257110+0000","last_active":"2024-09-19T12:03:56.257268+0000","last_peered":"2024-09-19T12:03:56.257268+0000","last_clean":"2024-09-19T12:03:56.257268+0000","last_became_active":"2024-09-19T11:53:37.722160+0000","last_became_peered":"2024-09-19T11:53:37.722160+0000","last_unstale":"2024-09-19T12:03:56.257268+0000","last_undegraded":"2024-09-19T12:03:56.257268+0000","last_fullsized":"2024-09-19T12:03:56.257268+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:56.256928+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:56.256928+0000","last_clean_scrub_stamp":"2024-09-19T12:03:56.256928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:50.275398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:41.014053+0000","last_change":"2024-09-19T12:03:41.013917+0000","last_active":"2024-09-19T12:03:41.014053+0000","last_peered":"2024-09-19T12:03:41.014053+0000","last_clean":"2024-09-19T12:03:41.014053+0000","last_became_active":"2024-09-19T11:53:34.699127+0000","last_became_peered":"2024-09-19T11:53:34.699127+0000","last_unstale":"2024-09-19T12:03:41.014053+0000","last_undegraded":"2024-09-19T12:03:41.014053+0000","last_fullsized":"2024-09-19T12:03:41.014053+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:41.013738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:41.013738+0000","last_clean_scrub_stamp":"2024-09-19T12:03:41.013738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:34.339022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"256'15","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:46.352690+0000","last_change":"2024-09-19T12:03:46.352556+0000","last_active":"2024-09-19T12:03:46.352690+0000","last_peered":"2024-09-19T12:03:46.352690+0000","last_clean":"2024-09-19T12:03:46.352690+0000","last_became_active":"2024-09-19T11:51:53.484630+0000","last_became_peered":"2024-09-19T11:51:53.484630+0000","last_unstale":"2024-09-19T12:03:46.352690+0000","last_undegraded":"2024-09-19T12:03:46.352690+0000","last_fullsized":"2024-09-19T12:03:46.352690+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'15","last_scrub_stamp":"2024-09-19T12:03:46.352368+0000","last_deep_scrub":"256'15","last_deep_scrub_stamp":"2024-09-19T12:03:46.352368+0000","last_clean_scrub_stamp":"2024-09-19T12:03:46.352368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:02:26.503503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":95,"num_write":34,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'29","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.468513+0000","last_change":"2024-09-19T12:03:23.468513+0000","last_active":"2024-09-19T12:03:23.468513+0000","last_peered":"2024-09-19T12:03:23.468513+0000","last_clean":"2024-09-19T12:03:23.468513+0000","last_became_active":"2024-09-19T11:35:31.628800+0000","last_became_peered":"2024-09-19T11:35:31.628800+0000","last_unstale":"2024-09-19T12:03:23.468513+0000","last_undegraded":"2024-09-19T12:03:23.468513+0000","last_fullsized":"2024-09-19T12:03:23.468513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-19T12:03:23.468293+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-19T12:03:23.468293+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.468293+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:18.549190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":38,"num_write":120,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'47","reported_seq":556,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:28.537173+0000","last_change":"2024-09-19T12:03:28.537173+0000","last_active":"2024-09-19T12:03:28.537173+0000","last_peered":"2024-09-19T12:03:28.537173+0000","last_clean":"2024-09-19T12:03:28.537173+0000","last_became_active":"2024-09-19T11:35:33.627994+0000","last_became_peered":"2024-09-19T11:35:33.627994+0000","last_unstale":"2024-09-19T12:03:28.537173+0000","last_undegraded":"2024-09-19T12:03:28.537173+0000","last_fullsized":"2024-09-19T12:03:28.537173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-09-19T12:03:28.536989+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-09-19T12:03:28.536989+0000","last_clean_scrub_stamp":"2024-09-19T12:03:28.536989+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:22.092687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":154,"num_write":67,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'64","reported_seq":592,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.634908+0000","last_change":"2024-09-19T12:03:16.634908+0000","last_active":"2024-09-19T12:03:16.634908+0000","last_peered":"2024-09-19T12:03:16.634908+0000","last_clean":"2024-09-19T12:03:16.634908+0000","last_became_active":"2024-09-19T11:35:31.608158+0000","last_became_peered":"2024-09-19T11:35:31.608158+0000","last_unstale":"2024-09-19T12:03:16.634908+0000","last_undegraded":"2024-09-19T12:03:16.634908+0000","last_fullsized":"2024-09-19T12:03:16.634908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'64","last_scrub_stamp":"2024-09-19T12:03:16.634685+0000","last_deep_scrub":"264'64","last_deep_scrub_stamp":"2024-09-19T12:03:16.634685+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.634685+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:56.893267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":661,"num_write":209,"num_write_kb":4683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'27","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:28.357372+0000","last_change":"2024-09-19T12:03:28.357372+0000","last_active":"2024-09-19T12:03:28.357372+0000","last_peered":"2024-09-19T12:03:28.357372+0000","last_clean":"2024-09-19T12:03:28.357372+0000","last_became_active":"2024-09-19T11:35:33.618098+0000","last_became_peered":"2024-09-19T11:35:33.618098+0000","last_unstale":"2024-09-19T12:03:28.357372+0000","last_undegraded":"2024-09-19T12:03:28.357372+0000","last_fullsized":"2024-09-19T12:03:28.357372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-19T12:03:28.357192+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-19T12:03:28.357192+0000","last_clean_scrub_stamp":"2024-09-19T12:03:28.357192+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:18.884693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":93,"num_write":47,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'44","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.399942+0000","last_change":"2024-09-19T12:03:14.399942+0000","last_active":"2024-09-19T12:03:14.399942+0000","last_peered":"2024-09-19T12:03:14.399942+0000","last_clean":"2024-09-19T12:03:14.399942+0000","last_became_active":"2024-09-19T11:35:31.613678+0000","last_became_peered":"2024-09-19T11:35:31.613678+0000","last_unstale":"2024-09-19T12:03:14.399942+0000","last_undegraded":"2024-09-19T12:03:14.399942+0000","last_fullsized":"2024-09-19T12:03:14.399942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-19T12:03:14.399627+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-19T12:03:14.399627+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.399627+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:09.098923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":82,"num_read_kb":12351,"num_write":140,"num_write_kb":6154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'42","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.145358+0000","last_change":"2024-09-19T12:03:30.145358+0000","last_active":"2024-09-19T12:03:30.145358+0000","last_peered":"2024-09-19T12:03:30.145358+0000","last_clean":"2024-09-19T12:03:30.145358+0000","last_became_active":"2024-09-19T11:35:33.613298+0000","last_became_peered":"2024-09-19T11:35:33.613298+0000","last_unstale":"2024-09-19T12:03:30.145358+0000","last_undegraded":"2024-09-19T12:03:30.145358+0000","last_fullsized":"2024-09-19T12:03:30.145358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-09-19T12:03:30.145086+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-09-19T12:03:30.145086+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.145086+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:40.579601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":123,"num_write":79,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'25","reported_seq":536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.480438+0000","last_change":"2024-09-19T12:03:22.480251+0000","last_active":"2024-09-19T12:03:22.480438+0000","last_peered":"2024-09-19T12:03:22.480438+0000","last_clean":"2024-09-19T12:03:22.480438+0000","last_became_active":"2024-09-19T11:35:31.608115+0000","last_became_peered":"2024-09-19T11:35:31.608115+0000","last_unstale":"2024-09-19T12:03:22.480438+0000","last_undegraded":"2024-09-19T12:03:22.480438+0000","last_fullsized":"2024-09-19T12:03:22.480438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-19T12:03:22.480019+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-19T12:03:22.480019+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.480019+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:10.348744+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":1089,"num_write":119,"num_write_kb":1059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'55","reported_seq":587,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.371828+0000","last_change":"2024-09-19T12:03:26.371828+0000","last_active":"2024-09-19T12:03:26.371828+0000","last_peered":"2024-09-19T12:03:26.371828+0000","last_clean":"2024-09-19T12:03:26.371828+0000","last_became_active":"2024-09-19T11:35:33.625528+0000","last_became_peered":"2024-09-19T11:35:33.625528+0000","last_unstale":"2024-09-19T12:03:26.371828+0000","last_undegraded":"2024-09-19T12:03:26.371828+0000","last_fullsized":"2024-09-19T12:03:26.371828+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-09-19T12:03:26.371631+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-09-19T12:03:26.371631+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.371631+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:27.169927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":230,"num_read_kb":188,"num_write":85,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'71","reported_seq":599,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.447650+0000","last_change":"2024-09-19T12:03:22.447650+0000","last_active":"2024-09-19T12:03:22.447650+0000","last_peered":"2024-09-19T12:03:22.447650+0000","last_clean":"2024-09-19T12:03:22.447650+0000","last_became_active":"2024-09-19T11:35:31.618555+0000","last_became_peered":"2024-09-19T11:35:31.618555+0000","last_unstale":"2024-09-19T12:03:22.447650+0000","last_undegraded":"2024-09-19T12:03:22.447650+0000","last_fullsized":"2024-09-19T12:03:22.447650+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'71","last_scrub_stamp":"2024-09-19T12:03:22.447441+0000","last_deep_scrub":"264'71","last_deep_scrub_stamp":"2024-09-19T12:03:22.447441+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.447441+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:02.660150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":29375,"num_write":187,"num_write_kb":13979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'27","reported_seq":547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.155526+0000","last_change":"2024-09-19T12:03:23.155247+0000","last_active":"2024-09-19T12:03:23.155526+0000","last_peered":"2024-09-19T12:03:23.155526+0000","last_clean":"2024-09-19T12:03:23.155526+0000","last_became_active":"2024-09-19T11:35:33.624952+0000","last_became_peered":"2024-09-19T11:35:33.624952+0000","last_unstale":"2024-09-19T12:03:23.155526+0000","last_undegraded":"2024-09-19T12:03:23.155526+0000","last_fullsized":"2024-09-19T12:03:23.155526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-19T12:03:23.155029+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-19T12:03:23.155029+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.155029+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:07.075048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":112,"num_write":47,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'51","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.495308+0000","last_change":"2024-09-19T12:03:23.495308+0000","last_active":"2024-09-19T12:03:23.495308+0000","last_peered":"2024-09-19T12:03:23.495308+0000","last_clean":"2024-09-19T12:03:23.495308+0000","last_became_active":"2024-09-19T11:35:31.587016+0000","last_became_peered":"2024-09-19T11:35:31.587016+0000","last_unstale":"2024-09-19T12:03:23.495308+0000","last_undegraded":"2024-09-19T12:03:23.495308+0000","last_fullsized":"2024-09-19T12:03:23.495308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-09-19T12:03:23.495109+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-09-19T12:03:23.495109+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.495109+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:27.504609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":3127,"num_write":134,"num_write_kb":8223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"253'2","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.164861+0000","last_change":"2024-09-19T12:03:32.164861+0000","last_active":"2024-09-19T12:03:32.164861+0000","last_peered":"2024-09-19T12:03:32.164861+0000","last_clean":"2024-09-19T12:03:32.164861+0000","last_became_active":"2024-09-19T11:35:33.612338+0000","last_became_peered":"2024-09-19T11:35:33.612338+0000","last_unstale":"2024-09-19T12:03:32.164861+0000","last_undegraded":"2024-09-19T12:03:32.164861+0000","last_fullsized":"2024-09-19T12:03:32.164861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"253'2","last_scrub_stamp":"2024-09-19T12:03:32.164660+0000","last_deep_scrub":"253'2","last_deep_scrub_stamp":"2024-09-19T12:03:32.164660+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.164660+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:05:27.595069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'39","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.426910+0000","last_change":"2024-09-19T12:03:21.426910+0000","last_active":"2024-09-19T12:03:21.426910+0000","last_peered":"2024-09-19T12:03:21.426910+0000","last_clean":"2024-09-19T12:03:21.426910+0000","last_became_active":"2024-09-19T11:35:31.619730+0000","last_became_peered":"2024-09-19T11:35:31.619730+0000","last_unstale":"2024-09-19T12:03:21.426910+0000","last_undegraded":"2024-09-19T12:03:21.426910+0000","last_fullsized":"2024-09-19T12:03:21.426910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-19T12:03:21.426671+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-19T12:03:21.426671+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.426671+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:19.990519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":33,"num_write":114,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'48","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.500337+0000","last_change":"2024-09-19T12:03:29.500337+0000","last_active":"2024-09-19T12:03:29.500337+0000","last_peered":"2024-09-19T12:03:29.500337+0000","last_clean":"2024-09-19T12:03:29.500337+0000","last_became_active":"2024-09-19T11:35:33.611495+0000","last_became_peered":"2024-09-19T11:35:33.611495+0000","last_unstale":"2024-09-19T12:03:29.500337+0000","last_undegraded":"2024-09-19T12:03:29.500337+0000","last_fullsized":"2024-09-19T12:03:29.500337+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'48","last_scrub_stamp":"2024-09-19T12:03:29.500155+0000","last_deep_scrub":"264'48","last_deep_scrub_stamp":"2024-09-19T12:03:29.500155+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.500155+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:03.959370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":135,"num_write":76,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'38","reported_seq":557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.835009+0000","last_change":"2024-09-19T12:03:18.835009+0000","last_active":"2024-09-19T12:03:18.835009+0000","last_peered":"2024-09-19T12:03:18.835009+0000","last_clean":"2024-09-19T12:03:18.835009+0000","last_became_active":"2024-09-19T11:35:31.593765+0000","last_became_peered":"2024-09-19T11:35:31.593765+0000","last_unstale":"2024-09-19T12:03:18.835009+0000","last_undegraded":"2024-09-19T12:03:18.835009+0000","last_fullsized":"2024-09-19T12:03:18.835009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-19T12:03:18.834783+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-19T12:03:18.834783+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.834783+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:50.647398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":57,"num_read_kb":47,"num_write":117,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'46","reported_seq":572,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.236236+0000","last_change":"2024-09-19T12:03:22.236236+0000","last_active":"2024-09-19T12:03:22.236236+0000","last_peered":"2024-09-19T12:03:22.236236+0000","last_clean":"2024-09-19T12:03:22.236236+0000","last_became_active":"2024-09-19T11:35:33.604505+0000","last_became_peered":"2024-09-19T11:35:33.604505+0000","last_unstale":"2024-09-19T12:03:22.236236+0000","last_undegraded":"2024-09-19T12:03:22.236236+0000","last_fullsized":"2024-09-19T12:03:22.236236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'46","last_scrub_stamp":"2024-09-19T12:03:22.236038+0000","last_deep_scrub":"264'46","last_deep_scrub_stamp":"2024-09-19T12:03:22.236038+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.236038+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:46.941280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":158,"num_write":84,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'76","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:28.151936+0000","last_change":"2024-09-19T12:03:28.151772+0000","last_active":"2024-09-19T12:03:28.151936+0000","last_peered":"2024-09-19T12:03:28.151936+0000","last_clean":"2024-09-19T12:03:28.151936+0000","last_became_active":"2024-09-19T11:35:33.607843+0000","last_became_peered":"2024-09-19T11:35:33.607843+0000","last_unstale":"2024-09-19T12:03:28.151936+0000","last_undegraded":"2024-09-19T12:03:28.151936+0000","last_fullsized":"2024-09-19T12:03:28.151936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'76","last_scrub_stamp":"2024-09-19T12:03:28.151578+0000","last_deep_scrub":"264'76","last_deep_scrub_stamp":"2024-09-19T12:03:28.151578+0000","last_clean_scrub_stamp":"2024-09-19T12:03:28.151578+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:18.526285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":241,"num_write":113,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'43","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.182034+0000","last_change":"2024-09-19T12:03:15.182034+0000","last_active":"2024-09-19T12:03:15.182034+0000","last_peered":"2024-09-19T12:03:15.182034+0000","last_clean":"2024-09-19T12:03:15.182034+0000","last_became_active":"2024-09-19T11:36:06.680794+0000","last_became_peered":"2024-09-19T11:36:06.680794+0000","last_unstale":"2024-09-19T12:03:15.182034+0000","last_undegraded":"2024-09-19T12:03:15.182034+0000","last_fullsized":"2024-09-19T12:03:15.182034+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'43","last_scrub_stamp":"2024-09-19T12:03:15.181797+0000","last_deep_scrub":"264'43","last_deep_scrub_stamp":"2024-09-19T12:03:15.181797+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.181797+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:02.405820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":3338,"num_write":153,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,1],"acting":[2,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.389200+0000","last_change":"2024-09-19T12:03:27.389066+0000","last_active":"2024-09-19T12:03:27.389200+0000","last_peered":"2024-09-19T12:03:27.389200+0000","last_clean":"2024-09-19T12:03:27.389200+0000","last_became_active":"2024-09-19T11:35:33.621522+0000","last_became_peered":"2024-09-19T11:35:33.621522+0000","last_unstale":"2024-09-19T12:03:27.389200+0000","last_undegraded":"2024-09-19T12:03:27.389200+0000","last_fullsized":"2024-09-19T12:03:27.389200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:27.388888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:27.388888+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.388888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:22:42.682803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'38","reported_seq":562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.100506+0000","last_change":"2024-09-19T12:03:18.100506+0000","last_active":"2024-09-19T12:03:18.100506+0000","last_peered":"2024-09-19T12:03:18.100506+0000","last_clean":"2024-09-19T12:03:18.100506+0000","last_became_active":"2024-09-19T11:35:31.598016+0000","last_became_peered":"2024-09-19T11:35:31.598016+0000","last_unstale":"2024-09-19T12:03:18.100506+0000","last_undegraded":"2024-09-19T12:03:18.100506+0000","last_fullsized":"2024-09-19T12:03:18.100506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-19T12:03:18.100202+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-19T12:03:18.100202+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.100202+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:16.805533+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159780,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":2182,"num_write":164,"num_write_kb":2115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'48","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.565850+0000","last_change":"2024-09-19T12:03:27.565655+0000","last_active":"2024-09-19T12:03:27.565850+0000","last_peered":"2024-09-19T12:03:27.565850+0000","last_clean":"2024-09-19T12:03:27.565850+0000","last_became_active":"2024-09-19T11:35:33.610072+0000","last_became_peered":"2024-09-19T11:35:33.610072+0000","last_unstale":"2024-09-19T12:03:27.565850+0000","last_undegraded":"2024-09-19T12:03:27.565850+0000","last_fullsized":"2024-09-19T12:03:27.565850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'48","last_scrub_stamp":"2024-09-19T12:03:27.565474+0000","last_deep_scrub":"264'48","last_deep_scrub_stamp":"2024-09-19T12:03:27.565474+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.565474+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:31.604798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":149,"num_write":86,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'38","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.072223+0000","last_change":"2024-09-19T12:03:17.072223+0000","last_active":"2024-09-19T12:03:17.072223+0000","last_peered":"2024-09-19T12:03:17.072223+0000","last_clean":"2024-09-19T12:03:17.072223+0000","last_became_active":"2024-09-19T11:35:31.614263+0000","last_became_peered":"2024-09-19T11:35:31.614263+0000","last_unstale":"2024-09-19T12:03:17.072223+0000","last_undegraded":"2024-09-19T12:03:17.072223+0000","last_fullsized":"2024-09-19T12:03:17.072223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-19T12:03:17.072026+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-19T12:03:17.072026+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.072026+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:59.461838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":5162,"num_write":130,"num_write_kb":10269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'149","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.264548+0000","last_change":"2024-09-19T12:03:19.264548+0000","last_active":"2024-09-19T12:03:19.264548+0000","last_peered":"2024-09-19T12:03:19.264548+0000","last_clean":"2024-09-19T12:03:19.264548+0000","last_became_active":"2024-09-19T11:35:33.611240+0000","last_became_peered":"2024-09-19T11:35:33.611240+0000","last_unstale":"2024-09-19T12:03:19.264548+0000","last_undegraded":"2024-09-19T12:03:19.264548+0000","last_fullsized":"2024-09-19T12:03:19.264548+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-19T12:03:19.264365+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-19T12:03:19.264365+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.264365+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:15.800283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":454,"num_write":234,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'36","reported_seq":552,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.192398+0000","last_change":"2024-09-19T12:03:15.192398+0000","last_active":"2024-09-19T12:03:15.192398+0000","last_peered":"2024-09-19T12:03:15.192398+0000","last_clean":"2024-09-19T12:03:15.192398+0000","last_became_active":"2024-09-19T11:35:31.591932+0000","last_became_peered":"2024-09-19T11:35:31.591932+0000","last_unstale":"2024-09-19T12:03:15.192398+0000","last_undegraded":"2024-09-19T12:03:15.192398+0000","last_fullsized":"2024-09-19T12:03:15.192398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-19T12:03:15.192152+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-19T12:03:15.192152+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.192152+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:34.198854+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291468,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":7804,"num_write":105,"num_write_kb":7776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'26","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.262570+0000","last_change":"2024-09-19T12:03:20.262570+0000","last_active":"2024-09-19T12:03:20.262570+0000","last_peered":"2024-09-19T12:03:20.262570+0000","last_clean":"2024-09-19T12:03:20.262570+0000","last_became_active":"2024-09-19T11:35:33.625698+0000","last_became_peered":"2024-09-19T11:35:33.625698+0000","last_unstale":"2024-09-19T12:03:20.262570+0000","last_undegraded":"2024-09-19T12:03:20.262570+0000","last_fullsized":"2024-09-19T12:03:20.262570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-19T12:03:20.262382+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-19T12:03:20.262382+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.262382+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:46.069587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":73,"num_write":57,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'25","reported_seq":555,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.790984+0000","last_change":"2024-09-19T12:03:19.790984+0000","last_active":"2024-09-19T12:03:19.790984+0000","last_peered":"2024-09-19T12:03:19.790984+0000","last_clean":"2024-09-19T12:03:19.790984+0000","last_became_active":"2024-09-19T11:35:31.600939+0000","last_became_peered":"2024-09-19T11:35:31.600939+0000","last_unstale":"2024-09-19T12:03:19.790984+0000","last_undegraded":"2024-09-19T12:03:19.790984+0000","last_fullsized":"2024-09-19T12:03:19.790984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-19T12:03:19.790722+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-19T12:03:19.790722+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.790722+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:46.880166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":6211,"num_write":103,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.130214+0000","last_change":"2024-09-19T12:03:29.130214+0000","last_active":"2024-09-19T12:03:29.130214+0000","last_peered":"2024-09-19T12:03:29.130214+0000","last_clean":"2024-09-19T12:03:29.130214+0000","last_became_active":"2024-09-19T11:35:33.605215+0000","last_became_peered":"2024-09-19T11:35:33.605215+0000","last_unstale":"2024-09-19T12:03:29.130214+0000","last_undegraded":"2024-09-19T12:03:29.130214+0000","last_fullsized":"2024-09-19T12:03:29.130214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:29.130006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:29.130006+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.130006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:40.238295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'50","reported_seq":584,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.342068+0000","last_change":"2024-09-19T12:03:18.341918+0000","last_active":"2024-09-19T12:03:18.342068+0000","last_peered":"2024-09-19T12:03:18.342068+0000","last_clean":"2024-09-19T12:03:18.342068+0000","last_became_active":"2024-09-19T11:35:31.597035+0000","last_became_peered":"2024-09-19T11:35:31.597035+0000","last_unstale":"2024-09-19T12:03:18.342068+0000","last_undegraded":"2024-09-19T12:03:18.342068+0000","last_fullsized":"2024-09-19T12:03:18.342068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-19T12:03:18.341715+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-19T12:03:18.341715+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.341715+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:21.241927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":25670,"num_write":130,"num_write_kb":10245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'17","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:44.213015+0000","last_change":"2024-09-19T12:03:44.213015+0000","last_active":"2024-09-19T12:03:44.213015+0000","last_peered":"2024-09-19T12:03:44.213015+0000","last_clean":"2024-09-19T12:03:44.213015+0000","last_became_active":"2024-09-19T11:35:41.673420+0000","last_became_peered":"2024-09-19T11:35:41.673420+0000","last_unstale":"2024-09-19T12:03:44.213015+0000","last_undegraded":"2024-09-19T12:03:44.213015+0000","last_fullsized":"2024-09-19T12:03:44.213015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-19T12:03:44.212796+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-19T12:03:44.212796+0000","last_clean_scrub_stamp":"2024-09-19T12:03:44.212796+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:16.814295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":72,"num_read_kb":64,"num_write":47,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.915918+0000","last_change":"2024-09-19T12:03:24.915760+0000","last_active":"2024-09-19T12:03:24.915918+0000","last_peered":"2024-09-19T12:03:24.915918+0000","last_clean":"2024-09-19T12:03:24.915918+0000","last_became_active":"2024-09-19T11:35:33.613437+0000","last_became_peered":"2024-09-19T11:35:33.613437+0000","last_unstale":"2024-09-19T12:03:24.915918+0000","last_undegraded":"2024-09-19T12:03:24.915918+0000","last_fullsized":"2024-09-19T12:03:24.915918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:24.915574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:24.915574+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.915574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:40.177888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'59","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.462001+0000","last_change":"2024-09-19T12:03:19.461837+0000","last_active":"2024-09-19T12:03:19.462001+0000","last_peered":"2024-09-19T12:03:19.462001+0000","last_clean":"2024-09-19T12:03:19.462001+0000","last_became_active":"2024-09-19T11:35:31.599314+0000","last_became_peered":"2024-09-19T11:35:31.599314+0000","last_unstale":"2024-09-19T12:03:19.462001+0000","last_undegraded":"2024-09-19T12:03:19.462001+0000","last_fullsized":"2024-09-19T12:03:19.462001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'59","last_scrub_stamp":"2024-09-19T12:03:19.461575+0000","last_deep_scrub":"264'59","last_deep_scrub_stamp":"2024-09-19T12:03:19.461575+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.461575+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:11.460791+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":96,"num_read_kb":1688,"num_write":199,"num_write_kb":1634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.460581+0000","last_change":"2024-09-19T12:03:33.460581+0000","last_active":"2024-09-19T12:03:33.460581+0000","last_peered":"2024-09-19T12:03:33.460581+0000","last_clean":"2024-09-19T12:03:33.460581+0000","last_became_active":"2024-09-19T11:35:35.616351+0000","last_became_peered":"2024-09-19T11:35:35.616351+0000","last_unstale":"2024-09-19T12:03:33.460581+0000","last_undegraded":"2024-09-19T12:03:33.460581+0000","last_fullsized":"2024-09-19T12:03:33.460581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:33.460391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:33.460391+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.460391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:39.816629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'126","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.392856+0000","last_change":"2024-09-19T12:03:33.392856+0000","last_active":"2024-09-19T12:03:33.392856+0000","last_peered":"2024-09-19T12:03:33.392856+0000","last_clean":"2024-09-19T12:03:33.392856+0000","last_became_active":"2024-09-19T11:35:37.650685+0000","last_became_peered":"2024-09-19T11:35:37.650685+0000","last_unstale":"2024-09-19T12:03:33.392856+0000","last_undegraded":"2024-09-19T12:03:33.392856+0000","last_fullsized":"2024-09-19T12:03:33.392856+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-19T12:03:33.392661+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-19T12:03:33.392661+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.392661+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:51.506860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":226,"num_write":120,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:42.341127+0000","last_change":"2024-09-19T12:03:42.341127+0000","last_active":"2024-09-19T12:03:42.341127+0000","last_peered":"2024-09-19T12:03:42.341127+0000","last_clean":"2024-09-19T12:03:42.341127+0000","last_became_active":"2024-09-19T11:35:39.676033+0000","last_became_peered":"2024-09-19T11:35:39.676033+0000","last_unstale":"2024-09-19T12:03:42.341127+0000","last_undegraded":"2024-09-19T12:03:42.341127+0000","last_fullsized":"2024-09-19T12:03:42.341127+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:42.340926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:42.340926+0000","last_clean_scrub_stamp":"2024-09-19T12:03:42.340926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:45.912330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'16","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:46.414269+0000","last_change":"2024-09-19T12:03:46.414269+0000","last_active":"2024-09-19T12:03:46.414269+0000","last_peered":"2024-09-19T12:03:46.414269+0000","last_clean":"2024-09-19T12:03:46.414269+0000","last_became_active":"2024-09-19T11:35:41.680497+0000","last_became_peered":"2024-09-19T11:35:41.680497+0000","last_unstale":"2024-09-19T12:03:46.414269+0000","last_undegraded":"2024-09-19T12:03:46.414269+0000","last_fullsized":"2024-09-19T12:03:46.414269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-19T12:03:46.414066+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-19T12:03:46.414066+0000","last_clean_scrub_stamp":"2024-09-19T12:03:46.414066+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:26.455259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":49,"num_write":53,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'2","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.518618+0000","last_change":"2024-09-19T12:03:25.518618+0000","last_active":"2024-09-19T12:03:25.518618+0000","last_peered":"2024-09-19T12:03:25.518618+0000","last_clean":"2024-09-19T12:03:25.518618+0000","last_became_active":"2024-09-19T11:35:33.615138+0000","last_became_peered":"2024-09-19T11:35:33.615138+0000","last_unstale":"2024-09-19T12:03:25.518618+0000","last_undegraded":"2024-09-19T12:03:25.518618+0000","last_fullsized":"2024-09-19T12:03:25.518618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:25.518441+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:25.518441+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.518441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:30.047762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'37","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.381945+0000","last_change":"2024-09-19T12:03:15.381754+0000","last_active":"2024-09-19T12:03:15.381945+0000","last_peered":"2024-09-19T12:03:15.381945+0000","last_clean":"2024-09-19T12:03:15.381945+0000","last_became_active":"2024-09-19T11:35:31.612424+0000","last_became_peered":"2024-09-19T11:35:31.612424+0000","last_unstale":"2024-09-19T12:03:15.381945+0000","last_undegraded":"2024-09-19T12:03:15.381945+0000","last_fullsized":"2024-09-19T12:03:15.381945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:15.381564+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:15.381564+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.381564+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:57.076212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":5150,"num_write":106,"num_write_kb":10271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.068603+0000","last_change":"2024-09-19T12:03:31.068436+0000","last_active":"2024-09-19T12:03:31.068603+0000","last_peered":"2024-09-19T12:03:31.068603+0000","last_clean":"2024-09-19T12:03:31.068603+0000","last_became_active":"2024-09-19T11:35:35.626979+0000","last_became_peered":"2024-09-19T11:35:35.626979+0000","last_unstale":"2024-09-19T12:03:31.068603+0000","last_undegraded":"2024-09-19T12:03:31.068603+0000","last_fullsized":"2024-09-19T12:03:31.068603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:31.068247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:31.068247+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.068247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:05.280814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'51","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:39.243358+0000","last_change":"2024-09-19T12:03:39.243358+0000","last_active":"2024-09-19T12:03:39.243358+0000","last_peered":"2024-09-19T12:03:39.243358+0000","last_clean":"2024-09-19T12:03:39.243358+0000","last_became_active":"2024-09-19T11:35:37.624916+0000","last_became_peered":"2024-09-19T11:35:37.624916+0000","last_unstale":"2024-09-19T12:03:39.243358+0000","last_undegraded":"2024-09-19T12:03:39.243358+0000","last_fullsized":"2024-09-19T12:03:39.243358+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-09-19T12:03:39.243111+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-09-19T12:03:39.243111+0000","last_clean_scrub_stamp":"2024-09-19T12:03:39.243111+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:37.716377+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":68,"num_write":46,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:41.241730+0000","last_change":"2024-09-19T12:03:41.241730+0000","last_active":"2024-09-19T12:03:41.241730+0000","last_peered":"2024-09-19T12:03:41.241730+0000","last_clean":"2024-09-19T12:03:41.241730+0000","last_became_active":"2024-09-19T11:35:39.669732+0000","last_became_peered":"2024-09-19T11:35:39.669732+0000","last_unstale":"2024-09-19T12:03:41.241730+0000","last_undegraded":"2024-09-19T12:03:41.241730+0000","last_fullsized":"2024-09-19T12:03:41.241730+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:41.241551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:41.241551+0000","last_clean_scrub_stamp":"2024-09-19T12:03:41.241551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:38.013113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'30","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:47.475300+0000","last_change":"2024-09-19T12:03:47.475300+0000","last_active":"2024-09-19T12:03:47.475300+0000","last_peered":"2024-09-19T12:03:47.475300+0000","last_clean":"2024-09-19T12:03:47.475300+0000","last_became_active":"2024-09-19T11:35:41.693197+0000","last_became_peered":"2024-09-19T11:35:41.693197+0000","last_unstale":"2024-09-19T12:03:47.475300+0000","last_undegraded":"2024-09-19T12:03:47.475300+0000","last_fullsized":"2024-09-19T12:03:47.475300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-19T12:03:47.475131+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-19T12:03:47.475131+0000","last_clean_scrub_stamp":"2024-09-19T12:03:47.475131+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:55.060618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":658,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":93,"num_write":83,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'5","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.312254+0000","last_change":"2024-09-19T12:03:22.312254+0000","last_active":"2024-09-19T12:03:22.312254+0000","last_peered":"2024-09-19T12:03:22.312254+0000","last_clean":"2024-09-19T12:03:22.312254+0000","last_became_active":"2024-09-19T11:35:33.625606+0000","last_became_peered":"2024-09-19T11:35:33.625606+0000","last_unstale":"2024-09-19T12:03:22.312254+0000","last_undegraded":"2024-09-19T12:03:22.312254+0000","last_fullsized":"2024-09-19T12:03:22.312254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:03:22.312041+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:03:22.312041+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.312041+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:00.306623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'49","reported_seq":564,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.444273+0000","last_change":"2024-09-19T12:03:18.444132+0000","last_active":"2024-09-19T12:03:18.444273+0000","last_peered":"2024-09-19T12:03:18.444273+0000","last_clean":"2024-09-19T12:03:18.444273+0000","last_became_active":"2024-09-19T11:35:31.621190+0000","last_became_peered":"2024-09-19T11:35:31.621190+0000","last_unstale":"2024-09-19T12:03:18.444273+0000","last_undegraded":"2024-09-19T12:03:18.444273+0000","last_fullsized":"2024-09-19T12:03:18.444273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-19T12:03:18.443898+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-19T12:03:18.443898+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.443898+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:55.033263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":65,"num_read_kb":198,"num_write":164,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"264'4","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.130426+0000","last_change":"2024-09-19T12:03:35.130426+0000","last_active":"2024-09-19T12:03:35.130426+0000","last_peered":"2024-09-19T12:03:35.130426+0000","last_clean":"2024-09-19T12:03:35.130426+0000","last_became_active":"2024-09-19T11:35:35.623997+0000","last_became_peered":"2024-09-19T11:35:35.623997+0000","last_unstale":"2024-09-19T12:03:35.130426+0000","last_undegraded":"2024-09-19T12:03:35.130426+0000","last_fullsized":"2024-09-19T12:03:35.130426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-19T12:03:35.130235+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-19T12:03:35.130235+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.130235+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:06.342067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":628,"num_read_kb":626,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'69","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.178949+0000","last_change":"2024-09-19T12:03:29.178798+0000","last_active":"2024-09-19T12:03:29.178949+0000","last_peered":"2024-09-19T12:03:29.178949+0000","last_clean":"2024-09-19T12:03:29.178949+0000","last_became_active":"2024-09-19T11:35:37.628124+0000","last_became_peered":"2024-09-19T11:35:37.628124+0000","last_unstale":"2024-09-19T12:03:29.178949+0000","last_undegraded":"2024-09-19T12:03:29.178949+0000","last_fullsized":"2024-09-19T12:03:29.178949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'69","last_scrub_stamp":"2024-09-19T12:03:29.178625+0000","last_deep_scrub":"264'69","last_deep_scrub_stamp":"2024-09-19T12:03:29.178625+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.178625+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:13.464739+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'616","reported_seq":1513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:41.353449+0000","last_change":"2024-09-19T12:03:41.353449+0000","last_active":"2024-09-19T12:03:41.353449+0000","last_peered":"2024-09-19T12:03:41.353449+0000","last_clean":"2024-09-19T12:03:41.353449+0000","last_became_active":"2024-09-19T11:35:39.681867+0000","last_became_peered":"2024-09-19T11:35:39.681867+0000","last_unstale":"2024-09-19T12:03:41.353449+0000","last_undegraded":"2024-09-19T12:03:41.353449+0000","last_fullsized":"2024-09-19T12:03:41.353449+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'616","last_scrub_stamp":"2024-09-19T12:03:41.353274+0000","last_deep_scrub":"264'616","last_deep_scrub_stamp":"2024-09-19T12:03:41.353274+0000","last_clean_scrub_stamp":"2024-09-19T12:03:41.353274+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":600,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:37.547454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'22","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:46.208627+0000","last_change":"2024-09-19T12:03:46.208627+0000","last_active":"2024-09-19T12:03:46.208627+0000","last_peered":"2024-09-19T12:03:46.208627+0000","last_clean":"2024-09-19T12:03:46.208627+0000","last_became_active":"2024-09-19T11:35:41.676988+0000","last_became_peered":"2024-09-19T11:35:41.676988+0000","last_unstale":"2024-09-19T12:03:46.208627+0000","last_undegraded":"2024-09-19T12:03:46.208627+0000","last_fullsized":"2024-09-19T12:03:46.208627+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-19T12:03:46.208424+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-19T12:03:46.208424+0000","last_clean_scrub_stamp":"2024-09-19T12:03:46.208424+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:08:21.080331+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":46,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'23","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.099911+0000","last_change":"2024-09-19T12:03:32.099911+0000","last_active":"2024-09-19T12:03:32.099911+0000","last_peered":"2024-09-19T12:03:32.099911+0000","last_clean":"2024-09-19T12:03:32.099911+0000","last_became_active":"2024-09-19T11:35:33.614168+0000","last_became_peered":"2024-09-19T11:35:33.614168+0000","last_unstale":"2024-09-19T12:03:32.099911+0000","last_undegraded":"2024-09-19T12:03:32.099911+0000","last_fullsized":"2024-09-19T12:03:32.099911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-19T12:03:32.099689+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-19T12:03:32.099689+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.099689+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:00:57.890206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":86,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'51","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.965354+0000","last_change":"2024-09-19T12:03:13.965204+0000","last_active":"2024-09-19T12:03:13.965354+0000","last_peered":"2024-09-19T12:03:13.965354+0000","last_clean":"2024-09-19T12:03:13.965354+0000","last_became_active":"2024-09-19T11:35:31.610808+0000","last_became_peered":"2024-09-19T11:35:31.610808+0000","last_unstale":"2024-09-19T12:03:13.965354+0000","last_undegraded":"2024-09-19T12:03:13.965354+0000","last_fullsized":"2024-09-19T12:03:13.965354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-09-19T12:03:13.964934+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-09-19T12:03:13.964934+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.964934+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:35.104668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2128531,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":108,"num_read_kb":7272,"num_write":187,"num_write_kb":7210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.451019+0000","last_change":"2024-09-19T12:03:34.451019+0000","last_active":"2024-09-19T12:03:34.451019+0000","last_peered":"2024-09-19T12:03:34.451019+0000","last_clean":"2024-09-19T12:03:34.451019+0000","last_became_active":"2024-09-19T11:35:35.623608+0000","last_became_peered":"2024-09-19T11:35:35.623608+0000","last_unstale":"2024-09-19T12:03:34.451019+0000","last_undegraded":"2024-09-19T12:03:34.451019+0000","last_fullsized":"2024-09-19T12:03:34.451019+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:34.450830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:34.450830+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.450830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:43.578742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'71","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.276185+0000","last_change":"2024-09-19T12:03:37.276185+0000","last_active":"2024-09-19T12:03:37.276185+0000","last_peered":"2024-09-19T12:03:37.276185+0000","last_clean":"2024-09-19T12:03:37.276185+0000","last_became_active":"2024-09-19T11:35:37.645933+0000","last_became_peered":"2024-09-19T11:35:37.645933+0000","last_unstale":"2024-09-19T12:03:37.276185+0000","last_undegraded":"2024-09-19T12:03:37.276185+0000","last_fullsized":"2024-09-19T12:03:37.276185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'71","last_scrub_stamp":"2024-09-19T12:03:37.276002+0000","last_deep_scrub":"264'71","last_deep_scrub_stamp":"2024-09-19T12:03:37.276002+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.276002+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:07.640576+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":88,"num_read_kb":136,"num_write":66,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'623","reported_seq":1501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:44.068417+0000","last_change":"2024-09-19T12:03:44.068188+0000","last_active":"2024-09-19T12:03:44.068417+0000","last_peered":"2024-09-19T12:03:44.068417+0000","last_clean":"2024-09-19T12:03:44.068417+0000","last_became_active":"2024-09-19T11:35:39.654205+0000","last_became_peered":"2024-09-19T11:35:39.654205+0000","last_unstale":"2024-09-19T12:03:44.068417+0000","last_undegraded":"2024-09-19T12:03:44.068417+0000","last_fullsized":"2024-09-19T12:03:44.068417+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'623","last_scrub_stamp":"2024-09-19T12:03:44.067981+0000","last_deep_scrub":"264'623","last_deep_scrub_stamp":"2024-09-19T12:03:44.067981+0000","last_clean_scrub_stamp":"2024-09-19T12:03:44.067981+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":600,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:52:57.278573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'23","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.509402+0000","last_change":"2024-09-19T12:03:24.509263+0000","last_active":"2024-09-19T12:03:24.509402+0000","last_peered":"2024-09-19T12:03:24.509402+0000","last_clean":"2024-09-19T12:03:24.509402+0000","last_became_active":"2024-09-19T11:35:33.624883+0000","last_became_peered":"2024-09-19T11:35:33.624883+0000","last_unstale":"2024-09-19T12:03:24.509402+0000","last_undegraded":"2024-09-19T12:03:24.509402+0000","last_fullsized":"2024-09-19T12:03:24.509402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-19T12:03:24.509080+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-19T12:03:24.509080+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.509080+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:51:19.432316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":86,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'37","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.413381+0000","last_change":"2024-09-19T12:03:16.413381+0000","last_active":"2024-09-19T12:03:16.413381+0000","last_peered":"2024-09-19T12:03:16.413381+0000","last_clean":"2024-09-19T12:03:16.413381+0000","last_became_active":"2024-09-19T11:35:31.609658+0000","last_became_peered":"2024-09-19T11:35:31.609658+0000","last_unstale":"2024-09-19T12:03:16.413381+0000","last_undegraded":"2024-09-19T12:03:16.413381+0000","last_fullsized":"2024-09-19T12:03:16.413381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:16.413160+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:16.413160+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.413160+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:25.039067+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":54,"num_read_kb":38,"num_write":106,"num_write_kb":5152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.325912+0000","last_change":"2024-09-19T12:03:30.325769+0000","last_active":"2024-09-19T12:03:30.325912+0000","last_peered":"2024-09-19T12:03:30.325912+0000","last_clean":"2024-09-19T12:03:30.325912+0000","last_became_active":"2024-09-19T11:35:35.621170+0000","last_became_peered":"2024-09-19T11:35:35.621170+0000","last_unstale":"2024-09-19T12:03:30.325912+0000","last_undegraded":"2024-09-19T12:03:30.325912+0000","last_fullsized":"2024-09-19T12:03:30.325912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:30.325601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:30.325601+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.325601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:35.632602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'130","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.439506+0000","last_change":"2024-09-19T12:03:37.439340+0000","last_active":"2024-09-19T12:03:37.439506+0000","last_peered":"2024-09-19T12:03:37.439506+0000","last_clean":"2024-09-19T12:03:37.439506+0000","last_became_active":"2024-09-19T11:35:37.635359+0000","last_became_peered":"2024-09-19T11:35:37.635359+0000","last_unstale":"2024-09-19T12:03:37.439506+0000","last_undegraded":"2024-09-19T12:03:37.439506+0000","last_fullsized":"2024-09-19T12:03:37.439506+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-19T12:03:37.439112+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-19T12:03:37.439112+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.439112+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:58.196626+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4817,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":176,"num_read_kb":225,"num_write":122,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.608894+0000","last_change":"2024-09-19T12:03:29.608894+0000","last_active":"2024-09-19T12:03:29.608894+0000","last_peered":"2024-09-19T12:03:29.608894+0000","last_clean":"2024-09-19T12:03:29.608894+0000","last_became_active":"2024-09-19T11:35:39.683300+0000","last_became_peered":"2024-09-19T11:35:39.683300+0000","last_unstale":"2024-09-19T12:03:29.608894+0000","last_undegraded":"2024-09-19T12:03:29.608894+0000","last_fullsized":"2024-09-19T12:03:29.608894+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:29.608706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:29.608706+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.608706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:11.666638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'7","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:42.448871+0000","last_change":"2024-09-19T12:03:42.448871+0000","last_active":"2024-09-19T12:03:42.448871+0000","last_peered":"2024-09-19T12:03:42.448871+0000","last_clean":"2024-09-19T12:03:42.448871+0000","last_became_active":"2024-09-19T11:35:41.684698+0000","last_became_peered":"2024-09-19T11:35:41.684698+0000","last_unstale":"2024-09-19T12:03:42.448871+0000","last_undegraded":"2024-09-19T12:03:42.448871+0000","last_fullsized":"2024-09-19T12:03:42.448871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-19T12:03:42.448672+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-19T12:03:42.448672+0000","last_clean_scrub_stamp":"2024-09-19T12:03:42.448672+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:00.507923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'10","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.229047+0000","last_change":"2024-09-19T12:03:17.228863+0000","last_active":"2024-09-19T12:03:17.229047+0000","last_peered":"2024-09-19T12:03:17.229047+0000","last_clean":"2024-09-19T12:03:17.229047+0000","last_became_active":"2024-09-19T11:35:33.617778+0000","last_became_peered":"2024-09-19T11:35:33.617778+0000","last_unstale":"2024-09-19T12:03:17.229047+0000","last_undegraded":"2024-09-19T12:03:17.229047+0000","last_fullsized":"2024-09-19T12:03:17.229047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-19T12:03:17.228686+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-19T12:03:17.228686+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.228686+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:43.560036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":12,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'64","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.439975+0000","last_change":"2024-09-19T12:03:17.439975+0000","last_active":"2024-09-19T12:03:17.439975+0000","last_peered":"2024-09-19T12:03:17.439975+0000","last_clean":"2024-09-19T12:03:17.439975+0000","last_became_active":"2024-09-19T11:35:31.609243+0000","last_became_peered":"2024-09-19T11:35:31.609243+0000","last_unstale":"2024-09-19T12:03:17.439975+0000","last_undegraded":"2024-09-19T12:03:17.439975+0000","last_fullsized":"2024-09-19T12:03:17.439975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'64","last_scrub_stamp":"2024-09-19T12:03:17.439587+0000","last_deep_scrub":"264'64","last_deep_scrub_stamp":"2024-09-19T12:03:17.439587+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.439587+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:54.098273+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":103,"num_read_kb":6258,"num_write":261,"num_write_kb":6195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.253781+0000","last_change":"2024-09-19T12:03:24.253561+0000","last_active":"2024-09-19T12:03:24.253781+0000","last_peered":"2024-09-19T12:03:24.253781+0000","last_clean":"2024-09-19T12:03:24.253781+0000","last_became_active":"2024-09-19T11:35:35.617934+0000","last_became_peered":"2024-09-19T11:35:35.617934+0000","last_unstale":"2024-09-19T12:03:24.253781+0000","last_undegraded":"2024-09-19T12:03:24.253781+0000","last_fullsized":"2024-09-19T12:03:24.253781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:24.253369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:24.253369+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.253369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:32.295766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'71","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.167436+0000","last_change":"2024-09-19T12:03:38.167436+0000","last_active":"2024-09-19T12:03:38.167436+0000","last_peered":"2024-09-19T12:03:38.167436+0000","last_clean":"2024-09-19T12:03:38.167436+0000","last_became_active":"2024-09-19T11:35:37.643236+0000","last_became_peered":"2024-09-19T11:35:37.643236+0000","last_unstale":"2024-09-19T12:03:38.167436+0000","last_undegraded":"2024-09-19T12:03:38.167436+0000","last_fullsized":"2024-09-19T12:03:38.167436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'71","last_scrub_stamp":"2024-09-19T12:03:38.167224+0000","last_deep_scrub":"264'71","last_deep_scrub_stamp":"2024-09-19T12:03:38.167224+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.167224+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:56.708140+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":101,"num_read_kb":192,"num_write":78,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.101564+0000","last_change":"2024-09-19T12:03:43.101410+0000","last_active":"2024-09-19T12:03:43.101564+0000","last_peered":"2024-09-19T12:03:43.101564+0000","last_clean":"2024-09-19T12:03:43.101564+0000","last_became_active":"2024-09-19T11:35:39.652920+0000","last_became_peered":"2024-09-19T11:35:39.652920+0000","last_unstale":"2024-09-19T12:03:43.101564+0000","last_undegraded":"2024-09-19T12:03:43.101564+0000","last_fullsized":"2024-09-19T12:03:43.101564+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:43.101230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:43.101230+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.101230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:27:46.915692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'12","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.123630+0000","last_change":"2024-09-19T12:03:32.123630+0000","last_active":"2024-09-19T12:03:32.123630+0000","last_peered":"2024-09-19T12:03:32.123630+0000","last_clean":"2024-09-19T12:03:32.123630+0000","last_became_active":"2024-09-19T11:35:41.678055+0000","last_became_peered":"2024-09-19T11:35:41.678055+0000","last_unstale":"2024-09-19T12:03:32.123630+0000","last_undegraded":"2024-09-19T12:03:32.123630+0000","last_fullsized":"2024-09-19T12:03:32.123630+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-19T12:03:32.123443+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-19T12:03:32.123443+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.123443+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:48.753601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":59,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'47","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.108382+0000","last_change":"2024-09-19T12:03:20.108229+0000","last_active":"2024-09-19T12:03:20.108382+0000","last_peered":"2024-09-19T12:03:20.108382+0000","last_clean":"2024-09-19T12:03:20.108382+0000","last_became_active":"2024-09-19T11:35:33.624015+0000","last_became_peered":"2024-09-19T11:35:33.624015+0000","last_unstale":"2024-09-19T12:03:20.108382+0000","last_undegraded":"2024-09-19T12:03:20.108382+0000","last_fullsized":"2024-09-19T12:03:20.108382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-09-19T12:03:20.108047+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-09-19T12:03:20.108047+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.108047+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:57.493258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":170,"num_write":76,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'56","reported_seq":587,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.410916+0000","last_change":"2024-09-19T12:03:15.410916+0000","last_active":"2024-09-19T12:03:15.410916+0000","last_peered":"2024-09-19T12:03:15.410916+0000","last_clean":"2024-09-19T12:03:15.410916+0000","last_became_active":"2024-09-19T11:35:31.627232+0000","last_became_peered":"2024-09-19T11:35:31.627232+0000","last_unstale":"2024-09-19T12:03:15.410916+0000","last_undegraded":"2024-09-19T12:03:15.410916+0000","last_fullsized":"2024-09-19T12:03:15.410916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'56","last_scrub_stamp":"2024-09-19T12:03:15.410628+0000","last_deep_scrub":"264'56","last_deep_scrub_stamp":"2024-09-19T12:03:15.410628+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.410628+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:37.621254+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":114,"num_read_kb":6226,"num_write":211,"num_write_kb":11300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.219613+0000","last_change":"2024-09-19T12:03:25.219613+0000","last_active":"2024-09-19T12:03:25.219613+0000","last_peered":"2024-09-19T12:03:25.219613+0000","last_clean":"2024-09-19T12:03:25.219613+0000","last_became_active":"2024-09-19T11:35:35.623852+0000","last_became_peered":"2024-09-19T11:35:35.623852+0000","last_unstale":"2024-09-19T12:03:25.219613+0000","last_undegraded":"2024-09-19T12:03:25.219613+0000","last_fullsized":"2024-09-19T12:03:25.219613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:25.219432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:25.219432+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.219432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:46:03.404112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'82","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.347909+0000","last_change":"2024-09-19T12:03:35.347748+0000","last_active":"2024-09-19T12:03:35.347909+0000","last_peered":"2024-09-19T12:03:35.347909+0000","last_clean":"2024-09-19T12:03:35.347909+0000","last_became_active":"2024-09-19T11:35:37.640906+0000","last_became_peered":"2024-09-19T11:35:37.640906+0000","last_unstale":"2024-09-19T12:03:35.347909+0000","last_undegraded":"2024-09-19T12:03:35.347909+0000","last_fullsized":"2024-09-19T12:03:35.347909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'82","last_scrub_stamp":"2024-09-19T12:03:35.347572+0000","last_deep_scrub":"264'82","last_deep_scrub_stamp":"2024-09-19T12:03:35.347572+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.347572+0000","objects_scrubbed":7,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:34.965283+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":103,"num_read_kb":144,"num_write":72,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'617","reported_seq":1466,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.418952+0000","last_change":"2024-09-19T12:03:38.418779+0000","last_active":"2024-09-19T12:03:38.418952+0000","last_peered":"2024-09-19T12:03:38.418952+0000","last_clean":"2024-09-19T12:03:38.418952+0000","last_became_active":"2024-09-19T11:35:39.672054+0000","last_became_peered":"2024-09-19T11:35:39.672054+0000","last_unstale":"2024-09-19T12:03:38.418952+0000","last_undegraded":"2024-09-19T12:03:38.418952+0000","last_fullsized":"2024-09-19T12:03:38.418952+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'617","last_scrub_stamp":"2024-09-19T12:03:38.418602+0000","last_deep_scrub":"264'617","last_deep_scrub_stamp":"2024-09-19T12:03:38.418602+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.418602+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:16.573897+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'5","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.420922+0000","last_change":"2024-09-19T12:03:43.420710+0000","last_active":"2024-09-19T12:03:43.420922+0000","last_peered":"2024-09-19T12:03:43.420922+0000","last_clean":"2024-09-19T12:03:43.420922+0000","last_became_active":"2024-09-19T11:35:41.693623+0000","last_became_peered":"2024-09-19T11:35:41.693623+0000","last_unstale":"2024-09-19T12:03:43.420922+0000","last_undegraded":"2024-09-19T12:03:43.420922+0000","last_fullsized":"2024-09-19T12:03:43.420922+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:03:43.420443+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:03:43.420443+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.420443+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:00.225897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'3","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.344346+0000","last_change":"2024-09-19T12:03:21.344346+0000","last_active":"2024-09-19T12:03:21.344346+0000","last_peered":"2024-09-19T12:03:21.344346+0000","last_clean":"2024-09-19T12:03:21.344346+0000","last_became_active":"2024-09-19T11:35:33.620252+0000","last_became_peered":"2024-09-19T11:35:33.620252+0000","last_unstale":"2024-09-19T12:03:21.344346+0000","last_undegraded":"2024-09-19T12:03:21.344346+0000","last_fullsized":"2024-09-19T12:03:21.344346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:21.344164+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:21.344164+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.344164+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:11.838750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'28","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.643635+0000","last_change":"2024-09-19T12:03:13.643635+0000","last_active":"2024-09-19T12:03:13.643635+0000","last_peered":"2024-09-19T12:03:13.643635+0000","last_clean":"2024-09-19T12:03:13.643635+0000","last_became_active":"2024-09-19T11:35:31.606137+0000","last_became_peered":"2024-09-19T11:35:31.606137+0000","last_unstale":"2024-09-19T12:03:13.643635+0000","last_undegraded":"2024-09-19T12:03:13.643635+0000","last_fullsized":"2024-09-19T12:03:13.643635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-09-19T12:03:13.643394+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-09-19T12:03:13.643394+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.643394+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:34.124245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":32,"num_write":99,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:28.204367+0000","last_change":"2024-09-19T12:03:28.204220+0000","last_active":"2024-09-19T12:03:28.204367+0000","last_peered":"2024-09-19T12:03:28.204367+0000","last_clean":"2024-09-19T12:03:28.204367+0000","last_became_active":"2024-09-19T11:35:35.619995+0000","last_became_peered":"2024-09-19T11:35:35.619995+0000","last_unstale":"2024-09-19T12:03:28.204367+0000","last_undegraded":"2024-09-19T12:03:28.204367+0000","last_fullsized":"2024-09-19T12:03:28.204367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:28.204014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:28.204014+0000","last_clean_scrub_stamp":"2024-09-19T12:03:28.204014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:57.625089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'102","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.411371+0000","last_change":"2024-09-19T12:03:32.411214+0000","last_active":"2024-09-19T12:03:32.411371+0000","last_peered":"2024-09-19T12:03:32.411371+0000","last_clean":"2024-09-19T12:03:32.411371+0000","last_became_active":"2024-09-19T11:35:37.646446+0000","last_became_peered":"2024-09-19T11:35:37.646446+0000","last_unstale":"2024-09-19T12:03:32.411371+0000","last_undegraded":"2024-09-19T12:03:32.411371+0000","last_fullsized":"2024-09-19T12:03:32.411371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-19T12:03:32.411017+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-19T12:03:32.411017+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.411017+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:39.875364+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":138,"num_read_kb":252,"num_write":102,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.211607+0000","last_change":"2024-09-19T12:03:30.211446+0000","last_active":"2024-09-19T12:03:30.211607+0000","last_peered":"2024-09-19T12:03:30.211607+0000","last_clean":"2024-09-19T12:03:30.211607+0000","last_became_active":"2024-09-19T11:35:39.658173+0000","last_became_peered":"2024-09-19T11:35:39.658173+0000","last_unstale":"2024-09-19T12:03:30.211607+0000","last_undegraded":"2024-09-19T12:03:30.211607+0000","last_fullsized":"2024-09-19T12:03:30.211607+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:30.211269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:30.211269+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.211269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:09.293357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'7","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.543295+0000","last_change":"2024-09-19T12:03:34.543155+0000","last_active":"2024-09-19T12:03:34.543295+0000","last_peered":"2024-09-19T12:03:34.543295+0000","last_clean":"2024-09-19T12:03:34.543295+0000","last_became_active":"2024-09-19T11:35:41.678765+0000","last_became_peered":"2024-09-19T11:35:41.678765+0000","last_unstale":"2024-09-19T12:03:34.543295+0000","last_undegraded":"2024-09-19T12:03:34.543295+0000","last_fullsized":"2024-09-19T12:03:34.543295+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-19T12:03:34.542965+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-19T12:03:34.542965+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.542965+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:42.939058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":41,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'2","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.209216+0000","last_change":"2024-09-19T12:03:18.209216+0000","last_active":"2024-09-19T12:03:18.209216+0000","last_peered":"2024-09-19T12:03:18.209216+0000","last_clean":"2024-09-19T12:03:18.209216+0000","last_became_active":"2024-09-19T11:35:33.612279+0000","last_became_peered":"2024-09-19T11:35:33.612279+0000","last_unstale":"2024-09-19T12:03:18.209216+0000","last_undegraded":"2024-09-19T12:03:18.209216+0000","last_fullsized":"2024-09-19T12:03:18.209216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:18.209042+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:18.209042+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.209042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:08.056928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'100","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.878737+0000","last_change":"2024-09-19T12:03:11.878737+0000","last_active":"2024-09-19T12:03:11.878737+0000","last_peered":"2024-09-19T12:03:11.878737+0000","last_clean":"2024-09-19T12:03:11.878737+0000","last_became_active":"2024-09-19T11:35:31.584188+0000","last_became_peered":"2024-09-19T11:35:31.584188+0000","last_unstale":"2024-09-19T12:03:11.878737+0000","last_undegraded":"2024-09-19T12:03:11.878737+0000","last_fullsized":"2024-09-19T12:03:11.878737+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'100","last_scrub_stamp":"2024-09-19T12:03:11.878638+0000","last_deep_scrub":"264'100","last_deep_scrub_stamp":"2024-09-19T12:03:11.878638+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.878638+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:00.975718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":280,"num_read_kb":3453,"num_write":516,"num_write_kb":3250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.252949+0000","last_change":"2024-09-19T12:03:27.252949+0000","last_active":"2024-09-19T12:03:27.252949+0000","last_peered":"2024-09-19T12:03:27.252949+0000","last_clean":"2024-09-19T12:03:27.252949+0000","last_became_active":"2024-09-19T11:35:35.614650+0000","last_became_peered":"2024-09-19T11:35:35.614650+0000","last_unstale":"2024-09-19T12:03:27.252949+0000","last_undegraded":"2024-09-19T12:03:27.252949+0000","last_fullsized":"2024-09-19T12:03:27.252949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:27.252757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:27.252757+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.252757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:59.499972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'84","reported_seq":598,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.290551+0000","last_change":"2024-09-19T12:03:37.290551+0000","last_active":"2024-09-19T12:03:37.290551+0000","last_peered":"2024-09-19T12:03:37.290551+0000","last_clean":"2024-09-19T12:03:37.290551+0000","last_became_active":"2024-09-19T11:35:37.624951+0000","last_became_peered":"2024-09-19T11:35:37.624951+0000","last_unstale":"2024-09-19T12:03:37.290551+0000","last_undegraded":"2024-09-19T12:03:37.290551+0000","last_fullsized":"2024-09-19T12:03:37.290551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-19T12:03:37.290233+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-19T12:03:37.290233+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.290233+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:31.731550+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4425,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":127,"num_read_kb":175,"num_write":138,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:40.420849+0000","last_change":"2024-09-19T12:03:40.420849+0000","last_active":"2024-09-19T12:03:40.420849+0000","last_peered":"2024-09-19T12:03:40.420849+0000","last_clean":"2024-09-19T12:03:40.420849+0000","last_became_active":"2024-09-19T11:35:39.671181+0000","last_became_peered":"2024-09-19T11:35:39.671181+0000","last_unstale":"2024-09-19T12:03:40.420849+0000","last_undegraded":"2024-09-19T12:03:40.420849+0000","last_fullsized":"2024-09-19T12:03:40.420849+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:40.420640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:40.420640+0000","last_clean_scrub_stamp":"2024-09-19T12:03:40.420640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:01.789165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'19","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:47.042410+0000","last_change":"2024-09-19T12:03:47.042410+0000","last_active":"2024-09-19T12:03:47.042410+0000","last_peered":"2024-09-19T12:03:47.042410+0000","last_clean":"2024-09-19T12:03:47.042410+0000","last_became_active":"2024-09-19T11:35:41.684966+0000","last_became_peered":"2024-09-19T11:35:41.684966+0000","last_unstale":"2024-09-19T12:03:47.042410+0000","last_undegraded":"2024-09-19T12:03:47.042410+0000","last_fullsized":"2024-09-19T12:03:47.042410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'19","last_scrub_stamp":"2024-09-19T12:03:47.042203+0000","last_deep_scrub":"264'19","last_deep_scrub_stamp":"2024-09-19T12:03:47.042203+0000","last_clean_scrub_stamp":"2024-09-19T12:03:47.042203+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:23:55.245020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":94,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'76","reported_seq":585,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.188684+0000","last_change":"2024-09-19T12:03:19.188684+0000","last_active":"2024-09-19T12:03:19.188684+0000","last_peered":"2024-09-19T12:03:19.188684+0000","last_clean":"2024-09-19T12:03:19.188684+0000","last_became_active":"2024-09-19T11:35:33.613369+0000","last_became_peered":"2024-09-19T11:35:33.613369+0000","last_unstale":"2024-09-19T12:03:19.188684+0000","last_undegraded":"2024-09-19T12:03:19.188684+0000","last_fullsized":"2024-09-19T12:03:19.188684+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'76","last_scrub_stamp":"2024-09-19T12:03:19.188503+0000","last_deep_scrub":"264'76","last_deep_scrub_stamp":"2024-09-19T12:03:19.188503+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.188503+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:38.489920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":221,"num_write":116,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'36","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:10.209055+0000","last_change":"2024-09-19T12:03:10.209055+0000","last_active":"2024-09-19T12:03:10.209055+0000","last_peered":"2024-09-19T12:03:10.209055+0000","last_clean":"2024-09-19T12:03:10.209055+0000","last_became_active":"2024-09-19T11:36:06.674998+0000","last_became_peered":"2024-09-19T11:36:06.674998+0000","last_unstale":"2024-09-19T12:03:10.209055+0000","last_undegraded":"2024-09-19T12:03:10.209055+0000","last_fullsized":"2024-09-19T12:03:10.209055+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-19T12:03:10.208928+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-19T12:03:10.208928+0000","last_clean_scrub_stamp":"2024-09-19T12:03:10.208928+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:37.689946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159858,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":7484,"num_write":135,"num_write_kb":7462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,7],"acting":[2,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.610447+0000","last_change":"2024-09-19T12:03:26.610447+0000","last_active":"2024-09-19T12:03:26.610447+0000","last_peered":"2024-09-19T12:03:26.610447+0000","last_clean":"2024-09-19T12:03:26.610447+0000","last_became_active":"2024-09-19T11:35:35.631702+0000","last_became_peered":"2024-09-19T11:35:35.631702+0000","last_unstale":"2024-09-19T12:03:26.610447+0000","last_undegraded":"2024-09-19T12:03:26.610447+0000","last_fullsized":"2024-09-19T12:03:26.610447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:26.610210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:26.610210+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.610210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:04.830912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'85","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.250375+0000","last_change":"2024-09-19T12:03:26.250375+0000","last_active":"2024-09-19T12:03:26.250375+0000","last_peered":"2024-09-19T12:03:26.250375+0000","last_clean":"2024-09-19T12:03:26.250375+0000","last_became_active":"2024-09-19T11:35:37.627720+0000","last_became_peered":"2024-09-19T11:35:37.627720+0000","last_unstale":"2024-09-19T12:03:26.250375+0000","last_undegraded":"2024-09-19T12:03:26.250375+0000","last_fullsized":"2024-09-19T12:03:26.250375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'85","last_scrub_stamp":"2024-09-19T12:03:26.250152+0000","last_deep_scrub":"264'85","last_deep_scrub_stamp":"2024-09-19T12:03:26.250152+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.250152+0000","objects_scrubbed":7,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:08.259486+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":113,"num_read_kb":175,"num_write":82,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'617","reported_seq":1636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.261666+0000","last_change":"2024-09-19T12:03:31.261666+0000","last_active":"2024-09-19T12:03:31.261666+0000","last_peered":"2024-09-19T12:03:31.261666+0000","last_clean":"2024-09-19T12:03:31.261666+0000","last_became_active":"2024-09-19T11:35:39.651203+0000","last_became_peered":"2024-09-19T11:35:39.651203+0000","last_unstale":"2024-09-19T12:03:31.261666+0000","last_undegraded":"2024-09-19T12:03:31.261666+0000","last_fullsized":"2024-09-19T12:03:31.261666+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'617","last_scrub_stamp":"2024-09-19T12:03:31.261479+0000","last_deep_scrub":"264'617","last_deep_scrub_stamp":"2024-09-19T12:03:31.261479+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.261479+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:29.161420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'9","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.526604+0000","last_change":"2024-09-19T12:03:35.526604+0000","last_active":"2024-09-19T12:03:35.526604+0000","last_peered":"2024-09-19T12:03:35.526604+0000","last_clean":"2024-09-19T12:03:35.526604+0000","last_became_active":"2024-09-19T11:35:41.691146+0000","last_became_peered":"2024-09-19T11:35:41.691146+0000","last_unstale":"2024-09-19T12:03:35.526604+0000","last_undegraded":"2024-09-19T12:03:35.526604+0000","last_fullsized":"2024-09-19T12:03:35.526604+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-19T12:03:35.526385+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-19T12:03:35.526385+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.526385+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:10:21.147182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":44,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'23","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.178016+0000","last_change":"2024-09-19T12:03:20.178016+0000","last_active":"2024-09-19T12:03:20.178016+0000","last_peered":"2024-09-19T12:03:20.178016+0000","last_clean":"2024-09-19T12:03:20.178016+0000","last_became_active":"2024-09-19T11:35:33.628232+0000","last_became_peered":"2024-09-19T11:35:33.628232+0000","last_unstale":"2024-09-19T12:03:20.178016+0000","last_undegraded":"2024-09-19T12:03:20.178016+0000","last_fullsized":"2024-09-19T12:03:20.178016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-19T12:03:20.177838+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-19T12:03:20.177838+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.177838+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:24.986969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":41,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'45","reported_seq":569,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.174331+0000","last_change":"2024-09-19T12:03:13.174080+0000","last_active":"2024-09-19T12:03:13.174331+0000","last_peered":"2024-09-19T12:03:13.174331+0000","last_clean":"2024-09-19T12:03:13.174331+0000","last_became_active":"2024-09-19T11:35:31.583509+0000","last_became_peered":"2024-09-19T11:35:31.583509+0000","last_unstale":"2024-09-19T12:03:13.174331+0000","last_undegraded":"2024-09-19T12:03:13.174331+0000","last_fullsized":"2024-09-19T12:03:13.174331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-19T12:03:13.173748+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-19T12:03:13.173748+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.173748+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:56.811201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":273,"num_write":141,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1318,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.428436+0000","last_change":"2024-09-19T12:03:32.428436+0000","last_active":"2024-09-19T12:03:32.428436+0000","last_peered":"2024-09-19T12:03:32.428436+0000","last_clean":"2024-09-19T12:03:32.428436+0000","last_became_active":"2024-09-19T11:35:35.629728+0000","last_became_peered":"2024-09-19T11:35:35.629728+0000","last_unstale":"2024-09-19T12:03:32.428436+0000","last_undegraded":"2024-09-19T12:03:32.428436+0000","last_fullsized":"2024-09-19T12:03:32.428436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-19T12:03:32.428222+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-19T12:03:32.428222+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.428222+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:26.448603+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":824,"num_read_kb":824,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'39","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.157841+0000","last_change":"2024-09-19T12:03:36.157841+0000","last_active":"2024-09-19T12:03:36.157841+0000","last_peered":"2024-09-19T12:03:36.157841+0000","last_clean":"2024-09-19T12:03:36.157841+0000","last_became_active":"2024-09-19T11:35:37.618061+0000","last_became_peered":"2024-09-19T11:35:37.618061+0000","last_unstale":"2024-09-19T12:03:36.157841+0000","last_undegraded":"2024-09-19T12:03:36.157841+0000","last_fullsized":"2024-09-19T12:03:36.157841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-19T12:03:36.157594+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-19T12:03:36.157594+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.157594+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:12.255735+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":40,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'617","reported_seq":1676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:28.170174+0000","last_change":"2024-09-19T12:03:28.170174+0000","last_active":"2024-09-19T12:03:28.170174+0000","last_peered":"2024-09-19T12:03:28.170174+0000","last_clean":"2024-09-19T12:03:28.170174+0000","last_became_active":"2024-09-19T11:35:39.670211+0000","last_became_peered":"2024-09-19T11:35:39.670211+0000","last_unstale":"2024-09-19T12:03:28.170174+0000","last_undegraded":"2024-09-19T12:03:28.170174+0000","last_fullsized":"2024-09-19T12:03:28.170174+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'617","last_scrub_stamp":"2024-09-19T12:03:28.169989+0000","last_deep_scrub":"264'617","last_deep_scrub_stamp":"2024-09-19T12:03:28.169989+0000","last_clean_scrub_stamp":"2024-09-19T12:03:28.169989+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:05.839158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"262'12","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:47.234199+0000","last_change":"2024-09-19T12:03:47.234199+0000","last_active":"2024-09-19T12:03:47.234199+0000","last_peered":"2024-09-19T12:03:47.234199+0000","last_clean":"2024-09-19T12:03:47.234199+0000","last_became_active":"2024-09-19T11:35:41.687793+0000","last_became_peered":"2024-09-19T11:35:41.687793+0000","last_unstale":"2024-09-19T12:03:47.234199+0000","last_undegraded":"2024-09-19T12:03:47.234199+0000","last_fullsized":"2024-09-19T12:03:47.234199+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'12","last_scrub_stamp":"2024-09-19T12:03:47.234010+0000","last_deep_scrub":"262'12","last_deep_scrub_stamp":"2024-09-19T12:03:47.234010+0000","last_clean_scrub_stamp":"2024-09-19T12:03:47.234010+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:35.638383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":22,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'40","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.635623+0000","last_change":"2024-09-19T12:03:19.635623+0000","last_active":"2024-09-19T12:03:19.635623+0000","last_peered":"2024-09-19T12:03:19.635623+0000","last_clean":"2024-09-19T12:03:19.635623+0000","last_became_active":"2024-09-19T11:35:33.602988+0000","last_became_peered":"2024-09-19T11:35:33.602988+0000","last_unstale":"2024-09-19T12:03:19.635623+0000","last_undegraded":"2024-09-19T12:03:19.635623+0000","last_fullsized":"2024-09-19T12:03:19.635623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-19T12:03:19.635443+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-19T12:03:19.635443+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.635443+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:03.547575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":120,"num_write":65,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'40","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.802310+0000","last_change":"2024-09-19T12:03:13.802138+0000","last_active":"2024-09-19T12:03:13.802310+0000","last_peered":"2024-09-19T12:03:13.802310+0000","last_clean":"2024-09-19T12:03:13.802310+0000","last_became_active":"2024-09-19T11:36:06.675863+0000","last_became_peered":"2024-09-19T11:36:06.675863+0000","last_unstale":"2024-09-19T12:03:13.802310+0000","last_undegraded":"2024-09-19T12:03:13.802310+0000","last_fullsized":"2024-09-19T12:03:13.802310+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-19T12:03:13.801874+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-19T12:03:13.801874+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.801874+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:21.385518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":74,"num_read_kb":59,"num_write":161,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.193009+0000","last_change":"2024-09-19T12:03:33.193009+0000","last_active":"2024-09-19T12:03:33.193009+0000","last_peered":"2024-09-19T12:03:33.193009+0000","last_clean":"2024-09-19T12:03:33.193009+0000","last_became_active":"2024-09-19T11:35:35.623987+0000","last_became_peered":"2024-09-19T11:35:35.623987+0000","last_unstale":"2024-09-19T12:03:33.193009+0000","last_undegraded":"2024-09-19T12:03:33.193009+0000","last_fullsized":"2024-09-19T12:03:33.193009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:33.192820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:33.192820+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.192820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:58:23.778586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'123","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.386730+0000","last_change":"2024-09-19T12:03:38.386730+0000","last_active":"2024-09-19T12:03:38.386730+0000","last_peered":"2024-09-19T12:03:38.386730+0000","last_clean":"2024-09-19T12:03:38.386730+0000","last_became_active":"2024-09-19T11:35:37.627374+0000","last_became_peered":"2024-09-19T11:35:37.627374+0000","last_unstale":"2024-09-19T12:03:38.386730+0000","last_undegraded":"2024-09-19T12:03:38.386730+0000","last_fullsized":"2024-09-19T12:03:38.386730+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'123","last_scrub_stamp":"2024-09-19T12:03:38.386540+0000","last_deep_scrub":"264'123","last_deep_scrub_stamp":"2024-09-19T12:03:38.386540+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.386540+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:36.148408+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4881,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":162,"num_read_kb":205,"num_write":112,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.172745+0000","last_change":"2024-09-19T12:03:33.172745+0000","last_active":"2024-09-19T12:03:33.172745+0000","last_peered":"2024-09-19T12:03:33.172745+0000","last_clean":"2024-09-19T12:03:33.172745+0000","last_became_active":"2024-09-19T11:35:39.666071+0000","last_became_peered":"2024-09-19T11:35:39.666071+0000","last_unstale":"2024-09-19T12:03:33.172745+0000","last_undegraded":"2024-09-19T12:03:33.172745+0000","last_fullsized":"2024-09-19T12:03:33.172745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:33.172561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:33.172561+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.172561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:02.174773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'11","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.542054+0000","last_change":"2024-09-19T12:03:33.542054+0000","last_active":"2024-09-19T12:03:33.542054+0000","last_peered":"2024-09-19T12:03:33.542054+0000","last_clean":"2024-09-19T12:03:33.542054+0000","last_became_active":"2024-09-19T11:35:41.680850+0000","last_became_peered":"2024-09-19T11:35:41.680850+0000","last_unstale":"2024-09-19T12:03:33.542054+0000","last_undegraded":"2024-09-19T12:03:33.542054+0000","last_fullsized":"2024-09-19T12:03:33.542054+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-19T12:03:33.541879+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-19T12:03:33.541879+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.541879+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:15.736623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":41,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'9","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.078394+0000","last_change":"2024-09-19T12:03:19.078394+0000","last_active":"2024-09-19T12:03:19.078394+0000","last_peered":"2024-09-19T12:03:19.078394+0000","last_clean":"2024-09-19T12:03:19.078394+0000","last_became_active":"2024-09-19T11:35:33.632623+0000","last_became_peered":"2024-09-19T11:35:33.632623+0000","last_unstale":"2024-09-19T12:03:19.078394+0000","last_undegraded":"2024-09-19T12:03:19.078394+0000","last_fullsized":"2024-09-19T12:03:19.078394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-19T12:03:19.078208+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-19T12:03:19.078208+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.078208+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:23.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.394892+0000","last_change":"2024-09-19T12:03:12.394743+0000","last_active":"2024-09-19T12:03:12.394892+0000","last_peered":"2024-09-19T12:03:12.394892+0000","last_clean":"2024-09-19T12:03:12.394892+0000","last_became_active":"2024-09-19T11:35:14.133710+0000","last_became_peered":"2024-09-19T11:35:14.133710+0000","last_unstale":"2024-09-19T12:03:12.394892+0000","last_undegraded":"2024-09-19T12:03:12.394892+0000","last_fullsized":"2024-09-19T12:03:12.394892+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-19T12:03:12.394517+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-19T12:03:12.394517+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.394517+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:38.496999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.633137+0000","last_change":"2024-09-19T12:03:12.633137+0000","last_active":"2024-09-19T12:03:12.633137+0000","last_peered":"2024-09-19T12:03:12.633137+0000","last_clean":"2024-09-19T12:03:12.633137+0000","last_became_active":"2024-09-19T11:35:19.150393+0000","last_became_peered":"2024-09-19T11:35:19.150393+0000","last_unstale":"2024-09-19T12:03:12.633137+0000","last_undegraded":"2024-09-19T12:03:12.633137+0000","last_fullsized":"2024-09-19T12:03:12.633137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:12.632962+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:12.632962+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.632962+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:48.310693+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001387466,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'66","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:10.871111+0000","last_change":"2024-09-19T12:03:10.871111+0000","last_active":"2024-09-19T12:03:10.871111+0000","last_peered":"2024-09-19T12:03:10.871111+0000","last_clean":"2024-09-19T12:03:10.871111+0000","last_became_active":"2024-09-19T11:35:31.592913+0000","last_became_peered":"2024-09-19T11:35:31.592913+0000","last_unstale":"2024-09-19T12:03:10.871111+0000","last_undegraded":"2024-09-19T12:03:10.871111+0000","last_fullsized":"2024-09-19T12:03:10.871111+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'66","last_scrub_stamp":"2024-09-19T12:03:10.870980+0000","last_deep_scrub":"264'66","last_deep_scrub_stamp":"2024-09-19T12:03:10.870980+0000","last_clean_scrub_stamp":"2024-09-19T12:03:10.870980+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:03.024253+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":2042,"num_write":253,"num_write_kb":1946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.344639+0000","last_change":"2024-09-19T12:03:29.344639+0000","last_active":"2024-09-19T12:03:29.344639+0000","last_peered":"2024-09-19T12:03:29.344639+0000","last_clean":"2024-09-19T12:03:29.344639+0000","last_became_active":"2024-09-19T11:35:35.602892+0000","last_became_peered":"2024-09-19T11:35:35.602892+0000","last_unstale":"2024-09-19T12:03:29.344639+0000","last_undegraded":"2024-09-19T12:03:29.344639+0000","last_fullsized":"2024-09-19T12:03:29.344639+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:29.344460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:29.344460+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.344460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:37.393924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'193","reported_seq":738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.458741+0000","last_change":"2024-09-19T12:03:36.458610+0000","last_active":"2024-09-19T12:03:36.458741+0000","last_peered":"2024-09-19T12:03:36.458741+0000","last_clean":"2024-09-19T12:03:36.458741+0000","last_became_active":"2024-09-19T11:35:37.636399+0000","last_became_peered":"2024-09-19T11:35:37.636399+0000","last_unstale":"2024-09-19T12:03:36.458741+0000","last_undegraded":"2024-09-19T12:03:36.458741+0000","last_fullsized":"2024-09-19T12:03:36.458741+0000","mapping_epoch":32,"log_start":"262'100","ondisk_log_start":"262'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'193","last_scrub_stamp":"2024-09-19T12:03:36.458426+0000","last_deep_scrub":"264'193","last_deep_scrub_stamp":"2024-09-19T12:03:36.458426+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.458426+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:32.128453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17019,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":284,"num_read_kb":496,"num_write":256,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18696,"num_omap_keys":48,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:42.397733+0000","last_change":"2024-09-19T12:03:42.397563+0000","last_active":"2024-09-19T12:03:42.397733+0000","last_peered":"2024-09-19T12:03:42.397733+0000","last_clean":"2024-09-19T12:03:42.397733+0000","last_became_active":"2024-09-19T11:35:39.680298+0000","last_became_peered":"2024-09-19T11:35:39.680298+0000","last_unstale":"2024-09-19T12:03:42.397733+0000","last_undegraded":"2024-09-19T12:03:42.397733+0000","last_fullsized":"2024-09-19T12:03:42.397733+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:42.397384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:42.397384+0000","last_clean_scrub_stamp":"2024-09-19T12:03:42.397384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:34.274736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'53","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.156045+0000","last_change":"2024-09-19T12:03:34.155875+0000","last_active":"2024-09-19T12:03:34.156045+0000","last_peered":"2024-09-19T12:03:34.156045+0000","last_clean":"2024-09-19T12:03:34.156045+0000","last_became_active":"2024-09-19T11:35:41.679219+0000","last_became_peered":"2024-09-19T11:35:41.679219+0000","last_unstale":"2024-09-19T12:03:34.156045+0000","last_undegraded":"2024-09-19T12:03:34.156045+0000","last_fullsized":"2024-09-19T12:03:34.156045+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'53","last_scrub_stamp":"2024-09-19T12:03:34.155648+0000","last_deep_scrub":"264'53","last_deep_scrub_stamp":"2024-09-19T12:03:34.155648+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.155648+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:10.140550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":334,"num_read_kb":278,"num_write":121,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'140","reported_seq":665,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.342183+0000","last_change":"2024-09-19T12:03:20.341912+0000","last_active":"2024-09-19T12:03:20.342183+0000","last_peered":"2024-09-19T12:03:20.342183+0000","last_clean":"2024-09-19T12:03:20.342183+0000","last_became_active":"2024-09-19T11:35:33.622065+0000","last_became_peered":"2024-09-19T11:35:33.622065+0000","last_unstale":"2024-09-19T12:03:20.342183+0000","last_undegraded":"2024-09-19T12:03:20.342183+0000","last_fullsized":"2024-09-19T12:03:20.342183+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'140","last_scrub_stamp":"2024-09-19T12:03:20.341668+0000","last_deep_scrub":"264'140","last_deep_scrub_stamp":"2024-09-19T12:03:20.341668+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.341668+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:22.627813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":557,"num_read_kb":440,"num_write":210,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.404458+0000","last_change":"2024-09-19T12:03:13.404311+0000","last_active":"2024-09-19T12:03:13.404458+0000","last_peered":"2024-09-19T12:03:13.404458+0000","last_clean":"2024-09-19T12:03:13.404458+0000","last_became_active":"2024-09-19T11:35:19.154360+0000","last_became_peered":"2024-09-19T11:35:19.154360+0000","last_unstale":"2024-09-19T12:03:13.404458+0000","last_undegraded":"2024-09-19T12:03:13.404458+0000","last_fullsized":"2024-09-19T12:03:13.404458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:13.404135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:13.404135+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.404135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:10.610779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00086516000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'39","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:10.351635+0000","last_change":"2024-09-19T12:03:10.351635+0000","last_active":"2024-09-19T12:03:10.351635+0000","last_peered":"2024-09-19T12:03:10.351635+0000","last_clean":"2024-09-19T12:03:10.351635+0000","last_became_active":"2024-09-19T11:36:06.677474+0000","last_became_peered":"2024-09-19T11:36:06.677474+0000","last_unstale":"2024-09-19T12:03:10.351635+0000","last_undegraded":"2024-09-19T12:03:10.351635+0000","last_fullsized":"2024-09-19T12:03:10.351635+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-19T12:03:10.351428+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-19T12:03:10.351428+0000","last_clean_scrub_stamp":"2024-09-19T12:03:10.351428+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:56.653131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":49,"num_write":146,"num_write_kb":5149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,5],"acting":[0,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.456265+0000","last_change":"2024-09-19T12:03:30.456114+0000","last_active":"2024-09-19T12:03:30.456265+0000","last_peered":"2024-09-19T12:03:30.456265+0000","last_clean":"2024-09-19T12:03:30.456265+0000","last_became_active":"2024-09-19T11:35:35.616382+0000","last_became_peered":"2024-09-19T11:35:35.616382+0000","last_unstale":"2024-09-19T12:03:30.456265+0000","last_undegraded":"2024-09-19T12:03:30.456265+0000","last_fullsized":"2024-09-19T12:03:30.456265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:30.455919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:30.455919+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.455919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:26.198826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'576","reported_seq":1642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.670142+0000","last_change":"2024-09-19T12:03:27.670142+0000","last_active":"2024-09-19T12:03:27.670142+0000","last_peered":"2024-09-19T12:03:27.670142+0000","last_clean":"2024-09-19T12:03:27.670142+0000","last_became_active":"2024-09-19T11:35:37.640355+0000","last_became_peered":"2024-09-19T11:35:37.640355+0000","last_unstale":"2024-09-19T12:03:27.670142+0000","last_undegraded":"2024-09-19T12:03:27.670142+0000","last_fullsized":"2024-09-19T12:03:27.670142+0000","mapping_epoch":32,"log_start":"264'501","ondisk_log_start":"264'501","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'576","last_scrub_stamp":"2024-09-19T12:03:27.669943+0000","last_deep_scrub":"264'576","last_deep_scrub_stamp":"2024-09-19T12:03:27.669943+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.669943+0000","objects_scrubbed":10,"log_size":75,"log_dups_size":501,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:37.864311+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13007,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":828,"num_read_kb":979,"num_write":162,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:39.296576+0000","last_change":"2024-09-19T12:03:39.296576+0000","last_active":"2024-09-19T12:03:39.296576+0000","last_peered":"2024-09-19T12:03:39.296576+0000","last_clean":"2024-09-19T12:03:39.296576+0000","last_became_active":"2024-09-19T11:35:39.675795+0000","last_became_peered":"2024-09-19T11:35:39.675795+0000","last_unstale":"2024-09-19T12:03:39.296576+0000","last_undegraded":"2024-09-19T12:03:39.296576+0000","last_fullsized":"2024-09-19T12:03:39.296576+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:39.296395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:39.296395+0000","last_clean_scrub_stamp":"2024-09-19T12:03:39.296395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:34.481429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'11","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.559239+0000","last_change":"2024-09-19T12:03:37.558986+0000","last_active":"2024-09-19T12:03:37.559239+0000","last_peered":"2024-09-19T12:03:37.559239+0000","last_clean":"2024-09-19T12:03:37.559239+0000","last_became_active":"2024-09-19T11:35:41.678660+0000","last_became_peered":"2024-09-19T11:35:41.678660+0000","last_unstale":"2024-09-19T12:03:37.559239+0000","last_undegraded":"2024-09-19T12:03:37.559239+0000","last_fullsized":"2024-09-19T12:03:37.559239+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'11","last_scrub_stamp":"2024-09-19T12:03:37.558701+0000","last_deep_scrub":"264'11","last_deep_scrub_stamp":"2024-09-19T12:03:37.558701+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.558701+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:49.642530+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'21","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.201825+0000","last_change":"2024-09-19T12:03:16.201825+0000","last_active":"2024-09-19T12:03:16.201825+0000","last_peered":"2024-09-19T12:03:16.201825+0000","last_clean":"2024-09-19T12:03:16.201825+0000","last_became_active":"2024-09-19T11:36:06.673265+0000","last_became_peered":"2024-09-19T11:36:06.673265+0000","last_unstale":"2024-09-19T12:03:16.201825+0000","last_undegraded":"2024-09-19T12:03:16.201825+0000","last_fullsized":"2024-09-19T12:03:16.201825+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'21","last_scrub_stamp":"2024-09-19T12:03:16.201641+0000","last_deep_scrub":"264'21","last_deep_scrub_stamp":"2024-09-19T12:03:16.201641+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.201641+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:05.081031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":39,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.219942+0000","last_change":"2024-09-19T12:03:11.219942+0000","last_active":"2024-09-19T12:03:11.219942+0000","last_peered":"2024-09-19T12:03:11.219942+0000","last_clean":"2024-09-19T12:03:11.219942+0000","last_became_active":"2024-09-19T11:35:19.969368+0000","last_became_peered":"2024-09-19T11:35:19.969368+0000","last_unstale":"2024-09-19T12:03:11.219942+0000","last_undegraded":"2024-09-19T12:03:11.219942+0000","last_fullsized":"2024-09-19T12:03:11.219942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:11.219865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:11.219865+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.219865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:54.638380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001160424,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'23","reported_seq":529,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.681897+0000","last_change":"2024-09-19T12:03:12.681813+0000","last_active":"2024-09-19T12:03:12.681897+0000","last_peered":"2024-09-19T12:03:12.681897+0000","last_clean":"2024-09-19T12:03:12.681897+0000","last_became_active":"2024-09-19T11:35:31.590860+0000","last_became_peered":"2024-09-19T11:35:31.590860+0000","last_unstale":"2024-09-19T12:03:12.681897+0000","last_undegraded":"2024-09-19T12:03:12.681897+0000","last_fullsized":"2024-09-19T12:03:12.681897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-19T12:03:12.681706+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-19T12:03:12.681706+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.681706+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:42.006727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":67,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.269779+0000","last_change":"2024-09-19T12:03:23.269623+0000","last_active":"2024-09-19T12:03:23.269779+0000","last_peered":"2024-09-19T12:03:23.269779+0000","last_clean":"2024-09-19T12:03:23.269779+0000","last_became_active":"2024-09-19T11:35:35.611092+0000","last_became_peered":"2024-09-19T11:35:35.611092+0000","last_unstale":"2024-09-19T12:03:23.269779+0000","last_undegraded":"2024-09-19T12:03:23.269779+0000","last_fullsized":"2024-09-19T12:03:23.269779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:23.269446+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:23.269446+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.269446+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:58.973432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'125","reported_seq":981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.355751+0000","last_change":"2024-09-19T12:03:34.355751+0000","last_active":"2024-09-19T12:03:34.355751+0000","last_peered":"2024-09-19T12:03:34.355751+0000","last_clean":"2024-09-19T12:03:34.355751+0000","last_became_active":"2024-09-19T11:35:37.647356+0000","last_became_peered":"2024-09-19T11:35:37.647356+0000","last_unstale":"2024-09-19T12:03:34.355751+0000","last_undegraded":"2024-09-19T12:03:34.355751+0000","last_fullsized":"2024-09-19T12:03:34.355751+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-19T12:03:34.355541+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-19T12:03:34.355541+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.355541+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:14.828090+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":120,"num_read_kb":109,"num_write":73,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.417241+0000","last_change":"2024-09-19T12:03:34.417241+0000","last_active":"2024-09-19T12:03:34.417241+0000","last_peered":"2024-09-19T12:03:34.417241+0000","last_clean":"2024-09-19T12:03:34.417241+0000","last_became_active":"2024-09-19T11:35:39.672352+0000","last_became_peered":"2024-09-19T11:35:39.672352+0000","last_unstale":"2024-09-19T12:03:34.417241+0000","last_undegraded":"2024-09-19T12:03:34.417241+0000","last_fullsized":"2024-09-19T12:03:34.417241+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:34.417054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:34.417054+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.417054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:26.370739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'102","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:50.054520+0000","last_change":"2024-09-19T12:03:50.054520+0000","last_active":"2024-09-19T12:03:50.054520+0000","last_peered":"2024-09-19T12:03:50.054520+0000","last_clean":"2024-09-19T12:03:50.054520+0000","last_became_active":"2024-09-19T11:35:41.688239+0000","last_became_peered":"2024-09-19T11:35:41.688239+0000","last_unstale":"2024-09-19T12:03:50.054520+0000","last_undegraded":"2024-09-19T12:03:50.054520+0000","last_fullsized":"2024-09-19T12:03:50.054520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-19T12:03:50.054287+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-19T12:03:50.054287+0000","last_clean_scrub_stamp":"2024-09-19T12:03:50.054287+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:57.056674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":254,"num_write":203,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'2","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.582468+0000","last_change":"2024-09-19T12:03:21.582468+0000","last_active":"2024-09-19T12:03:21.582468+0000","last_peered":"2024-09-19T12:03:21.582468+0000","last_clean":"2024-09-19T12:03:21.582468+0000","last_became_active":"2024-09-19T11:35:33.600618+0000","last_became_peered":"2024-09-19T11:35:33.600618+0000","last_unstale":"2024-09-19T12:03:21.582468+0000","last_undegraded":"2024-09-19T12:03:21.582468+0000","last_fullsized":"2024-09-19T12:03:21.582468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:21.582273+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:21.582273+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.582273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:31:26.811728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.597210+0000","last_change":"2024-09-19T12:03:11.597210+0000","last_active":"2024-09-19T12:03:11.597210+0000","last_peered":"2024-09-19T12:03:11.597210+0000","last_clean":"2024-09-19T12:03:11.597210+0000","last_became_active":"2024-09-19T11:35:19.151363+0000","last_became_peered":"2024-09-19T11:35:19.151363+0000","last_unstale":"2024-09-19T12:03:11.597210+0000","last_undegraded":"2024-09-19T12:03:11.597210+0000","last_fullsized":"2024-09-19T12:03:11.597210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-19T12:03:11.597027+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-19T12:03:11.597027+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.597027+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:03.179149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0028321980000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'37","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.149677+0000","last_change":"2024-09-19T12:03:11.149677+0000","last_active":"2024-09-19T12:03:11.149677+0000","last_peered":"2024-09-19T12:03:11.149677+0000","last_clean":"2024-09-19T12:03:11.149677+0000","last_became_active":"2024-09-19T11:35:31.587649+0000","last_became_peered":"2024-09-19T11:35:31.587649+0000","last_unstale":"2024-09-19T12:03:11.149677+0000","last_undegraded":"2024-09-19T12:03:11.149677+0000","last_fullsized":"2024-09-19T12:03:11.149677+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:11.149486+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:11.149486+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.149486+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:59.305634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":1908,"num_write":132,"num_write_kb":8008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.364818+0000","last_change":"2024-09-19T12:03:31.364818+0000","last_active":"2024-09-19T12:03:31.364818+0000","last_peered":"2024-09-19T12:03:31.364818+0000","last_clean":"2024-09-19T12:03:31.364818+0000","last_became_active":"2024-09-19T11:35:35.617200+0000","last_became_peered":"2024-09-19T11:35:35.617200+0000","last_unstale":"2024-09-19T12:03:31.364818+0000","last_undegraded":"2024-09-19T12:03:31.364818+0000","last_fullsized":"2024-09-19T12:03:31.364818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:31.364643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:31.364643+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.364643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:59.320407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'76","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.174885+0000","last_change":"2024-09-19T12:03:34.174706+0000","last_active":"2024-09-19T12:03:34.174885+0000","last_peered":"2024-09-19T12:03:34.174885+0000","last_clean":"2024-09-19T12:03:34.174885+0000","last_became_active":"2024-09-19T11:35:37.643310+0000","last_became_peered":"2024-09-19T11:35:37.643310+0000","last_unstale":"2024-09-19T12:03:34.174885+0000","last_undegraded":"2024-09-19T12:03:34.174885+0000","last_fullsized":"2024-09-19T12:03:34.174885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'76","last_scrub_stamp":"2024-09-19T12:03:34.174513+0000","last_deep_scrub":"264'76","last_deep_scrub_stamp":"2024-09-19T12:03:34.174513+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.174513+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:28.148897+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":101,"num_read_kb":95,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1630,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.154187+0000","last_change":"2024-09-19T12:03:26.154053+0000","last_active":"2024-09-19T12:03:26.154187+0000","last_peered":"2024-09-19T12:03:26.154187+0000","last_clean":"2024-09-19T12:03:26.154187+0000","last_became_active":"2024-09-19T11:35:39.669555+0000","last_became_peered":"2024-09-19T11:35:39.669555+0000","last_unstale":"2024-09-19T12:03:26.154187+0000","last_undegraded":"2024-09-19T12:03:26.154187+0000","last_fullsized":"2024-09-19T12:03:26.154187+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:26.153871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:26.153871+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.153871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:04.128938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'22","reported_seq":568,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.415159+0000","last_change":"2024-09-19T12:03:43.414989+0000","last_active":"2024-09-19T12:03:43.415159+0000","last_peered":"2024-09-19T12:03:43.415159+0000","last_clean":"2024-09-19T12:03:43.415159+0000","last_became_active":"2024-09-19T11:35:41.678167+0000","last_became_peered":"2024-09-19T11:35:41.678167+0000","last_unstale":"2024-09-19T12:03:43.415159+0000","last_undegraded":"2024-09-19T12:03:43.415159+0000","last_fullsized":"2024-09-19T12:03:43.415159+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-19T12:03:43.414805+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-19T12:03:43.414805+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.414805+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:59.296157+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":166,"num_write":65,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'93","reported_seq":617,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.642760+0000","last_change":"2024-09-19T12:03:17.642760+0000","last_active":"2024-09-19T12:03:17.642760+0000","last_peered":"2024-09-19T12:03:17.642760+0000","last_clean":"2024-09-19T12:03:17.642760+0000","last_became_active":"2024-09-19T11:35:33.605504+0000","last_became_peered":"2024-09-19T11:35:33.605504+0000","last_unstale":"2024-09-19T12:03:17.642760+0000","last_undegraded":"2024-09-19T12:03:17.642760+0000","last_fullsized":"2024-09-19T12:03:17.642760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'93","last_scrub_stamp":"2024-09-19T12:03:17.642564+0000","last_deep_scrub":"264'93","last_deep_scrub_stamp":"2024-09-19T12:03:17.642564+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.642564+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:31.968881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":306,"num_write":160,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'51","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.600803+0000","last_change":"2024-09-19T12:03:14.600803+0000","last_active":"2024-09-19T12:03:14.600803+0000","last_peered":"2024-09-19T12:03:14.600803+0000","last_clean":"2024-09-19T12:03:14.600803+0000","last_became_active":"2024-09-19T11:35:31.616954+0000","last_became_peered":"2024-09-19T11:35:31.616954+0000","last_unstale":"2024-09-19T12:03:14.600803+0000","last_undegraded":"2024-09-19T12:03:14.600803+0000","last_fullsized":"2024-09-19T12:03:14.600803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-09-19T12:03:14.600577+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-09-19T12:03:14.600577+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.600577+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:57.062823+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":2718,"num_write":157,"num_write_kb":7832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:09.590670+0000","last_change":"2024-09-19T12:03:09.590670+0000","last_active":"2024-09-19T12:03:09.590670+0000","last_peered":"2024-09-19T12:03:09.590670+0000","last_clean":"2024-09-19T12:03:09.590670+0000","last_became_active":"2024-09-19T11:35:20.096557+0000","last_became_peered":"2024-09-19T11:35:20.096557+0000","last_unstale":"2024-09-19T12:03:09.590670+0000","last_undegraded":"2024-09-19T12:03:09.590670+0000","last_fullsized":"2024-09-19T12:03:09.590670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:09.590597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:09.590597+0000","last_clean_scrub_stamp":"2024-09-19T12:03:09.590597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:47.764407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010463289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:28.401242+0000","last_change":"2024-09-19T12:03:28.401242+0000","last_active":"2024-09-19T12:03:28.401242+0000","last_peered":"2024-09-19T12:03:28.401242+0000","last_clean":"2024-09-19T12:03:28.401242+0000","last_became_active":"2024-09-19T11:35:35.623450+0000","last_became_peered":"2024-09-19T11:35:35.623450+0000","last_unstale":"2024-09-19T12:03:28.401242+0000","last_undegraded":"2024-09-19T12:03:28.401242+0000","last_fullsized":"2024-09-19T12:03:28.401242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:28.401070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:28.401070+0000","last_clean_scrub_stamp":"2024-09-19T12:03:28.401070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:05.593501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'157","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.381152+0000","last_change":"2024-09-19T12:03:30.381007+0000","last_active":"2024-09-19T12:03:30.381152+0000","last_peered":"2024-09-19T12:03:30.381152+0000","last_clean":"2024-09-19T12:03:30.381152+0000","last_became_active":"2024-09-19T11:35:37.637234+0000","last_became_peered":"2024-09-19T11:35:37.637234+0000","last_unstale":"2024-09-19T12:03:30.381152+0000","last_undegraded":"2024-09-19T12:03:30.381152+0000","last_fullsized":"2024-09-19T12:03:30.381152+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'157","last_scrub_stamp":"2024-09-19T12:03:30.380809+0000","last_deep_scrub":"264'157","last_deep_scrub_stamp":"2024-09-19T12:03:30.380809+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.380809+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:29.098974+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9930,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":215,"num_read_kb":331,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:40.239687+0000","last_change":"2024-09-19T12:03:40.239687+0000","last_active":"2024-09-19T12:03:40.239687+0000","last_peered":"2024-09-19T12:03:40.239687+0000","last_clean":"2024-09-19T12:03:40.239687+0000","last_became_active":"2024-09-19T11:35:39.669914+0000","last_became_peered":"2024-09-19T11:35:39.669914+0000","last_unstale":"2024-09-19T12:03:40.239687+0000","last_undegraded":"2024-09-19T12:03:40.239687+0000","last_fullsized":"2024-09-19T12:03:40.239687+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:40.239501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:40.239501+0000","last_clean_scrub_stamp":"2024-09-19T12:03:40.239501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:17.796385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'13","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:45.420294+0000","last_change":"2024-09-19T12:03:45.420294+0000","last_active":"2024-09-19T12:03:45.420294+0000","last_peered":"2024-09-19T12:03:45.420294+0000","last_clean":"2024-09-19T12:03:45.420294+0000","last_became_active":"2024-09-19T11:35:41.690257+0000","last_became_peered":"2024-09-19T11:35:41.690257+0000","last_unstale":"2024-09-19T12:03:45.420294+0000","last_undegraded":"2024-09-19T12:03:45.420294+0000","last_fullsized":"2024-09-19T12:03:45.420294+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-19T12:03:45.420109+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-19T12:03:45.420109+0000","last_clean_scrub_stamp":"2024-09-19T12:03:45.420109+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:02:55.611588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'203","reported_seq":771,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.356932+0000","last_change":"2024-09-19T12:03:19.356932+0000","last_active":"2024-09-19T12:03:19.356932+0000","last_peered":"2024-09-19T12:03:19.356932+0000","last_clean":"2024-09-19T12:03:19.356932+0000","last_became_active":"2024-09-19T11:35:33.614327+0000","last_became_peered":"2024-09-19T11:35:33.614327+0000","last_unstale":"2024-09-19T12:03:19.356932+0000","last_undegraded":"2024-09-19T12:03:19.356932+0000","last_fullsized":"2024-09-19T12:03:19.356932+0000","mapping_epoch":28,"log_start":"256'100","ondisk_log_start":"256'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-19T12:03:19.356748+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-19T12:03:19.356748+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.356748+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:19.180282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":855,"num_read_kb":681,"num_write":310,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4002,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'50","reported_seq":574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.664317+0000","last_change":"2024-09-19T12:03:11.664317+0000","last_active":"2024-09-19T12:03:11.664317+0000","last_peered":"2024-09-19T12:03:11.664317+0000","last_clean":"2024-09-19T12:03:11.664317+0000","last_became_active":"2024-09-19T11:35:31.598447+0000","last_became_peered":"2024-09-19T11:35:31.598447+0000","last_unstale":"2024-09-19T12:03:11.664317+0000","last_undegraded":"2024-09-19T12:03:11.664317+0000","last_fullsized":"2024-09-19T12:03:11.664317+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-19T12:03:11.664190+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-19T12:03:11.664190+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.664190+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:30.648508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":9296,"num_write":144,"num_write_kb":14398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.367464+0000","last_change":"2024-09-19T12:03:14.367464+0000","last_active":"2024-09-19T12:03:14.367464+0000","last_peered":"2024-09-19T12:03:14.367464+0000","last_clean":"2024-09-19T12:03:14.367464+0000","last_became_active":"2024-09-19T11:35:20.094400+0000","last_became_peered":"2024-09-19T11:35:20.094400+0000","last_unstale":"2024-09-19T12:03:14.367464+0000","last_undegraded":"2024-09-19T12:03:14.367464+0000","last_fullsized":"2024-09-19T12:03:14.367464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:14.367287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:14.367287+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.367287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:29.641318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088955000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"264'6","reported_seq":905,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.136790+0000","last_change":"2024-09-19T12:03:24.136790+0000","last_active":"2024-09-19T12:03:24.136790+0000","last_peered":"2024-09-19T12:03:24.136790+0000","last_clean":"2024-09-19T12:03:24.136790+0000","last_became_active":"2024-09-19T11:35:35.619212+0000","last_became_peered":"2024-09-19T11:35:35.619212+0000","last_unstale":"2024-09-19T12:03:24.136790+0000","last_undegraded":"2024-09-19T12:03:24.136790+0000","last_fullsized":"2024-09-19T12:03:24.136790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-19T12:03:24.136614+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-19T12:03:24.136614+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.136614+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:13.802174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":630,"num_read_kb":1029,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'107","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.570164+0000","last_change":"2024-09-19T12:03:32.570164+0000","last_active":"2024-09-19T12:03:32.570164+0000","last_peered":"2024-09-19T12:03:32.570164+0000","last_clean":"2024-09-19T12:03:32.570164+0000","last_became_active":"2024-09-19T11:35:37.629547+0000","last_became_peered":"2024-09-19T11:35:37.629547+0000","last_unstale":"2024-09-19T12:03:32.570164+0000","last_undegraded":"2024-09-19T12:03:32.570164+0000","last_fullsized":"2024-09-19T12:03:32.570164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-19T12:03:32.569956+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-19T12:03:32.569956+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.569956+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:59.624944+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":151,"num_read_kb":144,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'621","reported_seq":1664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:40.387347+0000","last_change":"2024-09-19T12:03:40.387168+0000","last_active":"2024-09-19T12:03:40.387347+0000","last_peered":"2024-09-19T12:03:40.387347+0000","last_clean":"2024-09-19T12:03:40.387347+0000","last_became_active":"2024-09-19T11:35:39.681476+0000","last_became_peered":"2024-09-19T11:35:39.681476+0000","last_unstale":"2024-09-19T12:03:40.387347+0000","last_undegraded":"2024-09-19T12:03:40.387347+0000","last_fullsized":"2024-09-19T12:03:40.387347+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'621","last_scrub_stamp":"2024-09-19T12:03:40.386984+0000","last_deep_scrub":"264'621","last_deep_scrub_stamp":"2024-09-19T12:03:40.386984+0000","last_clean_scrub_stamp":"2024-09-19T12:03:40.386984+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":600,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:18.703854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'16","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:48.089358+0000","last_change":"2024-09-19T12:03:48.089358+0000","last_active":"2024-09-19T12:03:48.089358+0000","last_peered":"2024-09-19T12:03:48.089358+0000","last_clean":"2024-09-19T12:03:48.089358+0000","last_became_active":"2024-09-19T11:35:41.670410+0000","last_became_peered":"2024-09-19T11:35:41.670410+0000","last_unstale":"2024-09-19T12:03:48.089358+0000","last_undegraded":"2024-09-19T12:03:48.089358+0000","last_fullsized":"2024-09-19T12:03:48.089358+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-19T12:03:48.089146+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-19T12:03:48.089146+0000","last_clean_scrub_stamp":"2024-09-19T12:03:48.089146+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:19.902829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":68,"num_write":44,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'111","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.829095+0000","last_change":"2024-09-19T12:03:20.828943+0000","last_active":"2024-09-19T12:03:20.829095+0000","last_peered":"2024-09-19T12:03:20.829095+0000","last_clean":"2024-09-19T12:03:20.829095+0000","last_became_active":"2024-09-19T11:35:33.624885+0000","last_became_peered":"2024-09-19T11:35:33.624885+0000","last_unstale":"2024-09-19T12:03:20.829095+0000","last_undegraded":"2024-09-19T12:03:20.829095+0000","last_fullsized":"2024-09-19T12:03:20.829095+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'111","last_scrub_stamp":"2024-09-19T12:03:20.828759+0000","last_deep_scrub":"264'111","last_deep_scrub_stamp":"2024-09-19T12:03:20.828759+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.828759+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:06.866014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":398,"num_read_kb":317,"num_write":191,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'36","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.845577+0000","last_change":"2024-09-19T12:03:12.845432+0000","last_active":"2024-09-19T12:03:12.845577+0000","last_peered":"2024-09-19T12:03:12.845577+0000","last_clean":"2024-09-19T12:03:12.845577+0000","last_became_active":"2024-09-19T11:36:06.649117+0000","last_became_peered":"2024-09-19T11:36:06.649117+0000","last_unstale":"2024-09-19T12:03:12.845577+0000","last_undegraded":"2024-09-19T12:03:12.845577+0000","last_fullsized":"2024-09-19T12:03:12.845577+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-19T12:03:12.845221+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-19T12:03:12.845221+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.845221+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:23.774171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":54,"num_write":158,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:10.622630+0000","last_change":"2024-09-19T12:03:10.622538+0000","last_active":"2024-09-19T12:03:10.622630+0000","last_peered":"2024-09-19T12:03:10.622630+0000","last_clean":"2024-09-19T12:03:10.622630+0000","last_became_active":"2024-09-19T11:35:19.152195+0000","last_became_peered":"2024-09-19T11:35:19.152195+0000","last_unstale":"2024-09-19T12:03:10.622630+0000","last_undegraded":"2024-09-19T12:03:10.622630+0000","last_fullsized":"2024-09-19T12:03:10.622630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:10.622455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:10.622455+0000","last_clean_scrub_stamp":"2024-09-19T12:03:10.622455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:40:26.610822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00094930600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.156108+0000","last_change":"2024-09-19T12:03:31.156108+0000","last_active":"2024-09-19T12:03:31.156108+0000","last_peered":"2024-09-19T12:03:31.156108+0000","last_clean":"2024-09-19T12:03:31.156108+0000","last_became_active":"2024-09-19T11:35:35.625385+0000","last_became_peered":"2024-09-19T11:35:35.625385+0000","last_unstale":"2024-09-19T12:03:31.156108+0000","last_undegraded":"2024-09-19T12:03:31.156108+0000","last_fullsized":"2024-09-19T12:03:31.156108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:31.155933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:31.155933+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.155933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:09.841671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'63","reported_seq":585,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.237037+0000","last_change":"2024-09-19T12:03:36.237037+0000","last_active":"2024-09-19T12:03:36.237037+0000","last_peered":"2024-09-19T12:03:36.237037+0000","last_clean":"2024-09-19T12:03:36.237037+0000","last_became_active":"2024-09-19T11:35:37.641855+0000","last_became_peered":"2024-09-19T11:35:37.641855+0000","last_unstale":"2024-09-19T12:03:36.237037+0000","last_undegraded":"2024-09-19T12:03:36.237037+0000","last_fullsized":"2024-09-19T12:03:36.237037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'63","last_scrub_stamp":"2024-09-19T12:03:36.236753+0000","last_deep_scrub":"264'63","last_deep_scrub_stamp":"2024-09-19T12:03:36.236753+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.236753+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:23.393797+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":89,"num_read_kb":84,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'623","reported_seq":1547,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:45.022119+0000","last_change":"2024-09-19T12:03:45.022119+0000","last_active":"2024-09-19T12:03:45.022119+0000","last_peered":"2024-09-19T12:03:45.022119+0000","last_clean":"2024-09-19T12:03:45.022119+0000","last_became_active":"2024-09-19T11:35:39.662678+0000","last_became_peered":"2024-09-19T11:35:39.662678+0000","last_unstale":"2024-09-19T12:03:45.022119+0000","last_undegraded":"2024-09-19T12:03:45.022119+0000","last_fullsized":"2024-09-19T12:03:45.022119+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'623","last_scrub_stamp":"2024-09-19T12:03:45.021932+0000","last_deep_scrub":"264'623","last_deep_scrub_stamp":"2024-09-19T12:03:45.021932+0000","last_clean_scrub_stamp":"2024-09-19T12:03:45.021932+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":600,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:22.192591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'102","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:44.412055+0000","last_change":"2024-09-19T12:03:44.412055+0000","last_active":"2024-09-19T12:03:44.412055+0000","last_peered":"2024-09-19T12:03:44.412055+0000","last_clean":"2024-09-19T12:03:44.412055+0000","last_became_active":"2024-09-19T11:35:41.683629+0000","last_became_peered":"2024-09-19T11:35:41.683629+0000","last_unstale":"2024-09-19T12:03:44.412055+0000","last_undegraded":"2024-09-19T12:03:44.412055+0000","last_fullsized":"2024-09-19T12:03:44.412055+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-19T12:03:44.411870+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-19T12:03:44.411870+0000","last_clean_scrub_stamp":"2024-09-19T12:03:44.411870+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:08.187695+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":202,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'36","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.181835+0000","last_change":"2024-09-19T12:03:16.181835+0000","last_active":"2024-09-19T12:03:16.181835+0000","last_peered":"2024-09-19T12:03:16.181835+0000","last_clean":"2024-09-19T12:03:16.181835+0000","last_became_active":"2024-09-19T11:35:33.616079+0000","last_became_peered":"2024-09-19T11:35:33.616079+0000","last_unstale":"2024-09-19T12:03:16.181835+0000","last_undegraded":"2024-09-19T12:03:16.181835+0000","last_fullsized":"2024-09-19T12:03:16.181835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'36","last_scrub_stamp":"2024-09-19T12:03:16.181556+0000","last_deep_scrub":"264'36","last_deep_scrub_stamp":"2024-09-19T12:03:16.181556+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.181556+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:34.068776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":147,"num_write":69,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'45","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:09.388391+0000","last_change":"2024-09-19T12:03:09.388294+0000","last_active":"2024-09-19T12:03:09.388391+0000","last_peered":"2024-09-19T12:03:09.388391+0000","last_clean":"2024-09-19T12:03:09.388391+0000","last_became_active":"2024-09-19T11:35:31.612706+0000","last_became_peered":"2024-09-19T11:35:31.612706+0000","last_unstale":"2024-09-19T12:03:09.388391+0000","last_undegraded":"2024-09-19T12:03:09.388391+0000","last_fullsized":"2024-09-19T12:03:09.388391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-19T12:03:09.388188+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-19T12:03:09.388188+0000","last_clean_scrub_stamp":"2024-09-19T12:03:09.388188+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:21.341691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":6249,"num_write":158,"num_write_kb":6206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.055509+0000","last_change":"2024-09-19T12:03:12.055270+0000","last_active":"2024-09-19T12:03:12.055509+0000","last_peered":"2024-09-19T12:03:12.055509+0000","last_clean":"2024-09-19T12:03:12.055509+0000","last_became_active":"2024-09-19T11:35:19.152446+0000","last_became_peered":"2024-09-19T11:35:19.152446+0000","last_unstale":"2024-09-19T12:03:12.055509+0000","last_undegraded":"2024-09-19T12:03:12.055509+0000","last_fullsized":"2024-09-19T12:03:12.055509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:12.055058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:12.055058+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.055058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:03.585811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032675,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.990021+0000","last_change":"2024-09-19T12:03:26.989883+0000","last_active":"2024-09-19T12:03:26.990021+0000","last_peered":"2024-09-19T12:03:26.990021+0000","last_clean":"2024-09-19T12:03:26.990021+0000","last_became_active":"2024-09-19T11:35:35.624322+0000","last_became_peered":"2024-09-19T11:35:35.624322+0000","last_unstale":"2024-09-19T12:03:26.990021+0000","last_undegraded":"2024-09-19T12:03:26.990021+0000","last_fullsized":"2024-09-19T12:03:26.990021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:26.989686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:26.989686+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.989686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:43.901193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'201","reported_seq":756,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.318239+0000","last_change":"2024-09-19T12:03:33.318239+0000","last_active":"2024-09-19T12:03:33.318239+0000","last_peered":"2024-09-19T12:03:33.318239+0000","last_clean":"2024-09-19T12:03:33.318239+0000","last_became_active":"2024-09-19T11:35:37.646158+0000","last_became_peered":"2024-09-19T11:35:37.646158+0000","last_unstale":"2024-09-19T12:03:33.318239+0000","last_undegraded":"2024-09-19T12:03:33.318239+0000","last_fullsized":"2024-09-19T12:03:33.318239+0000","mapping_epoch":32,"log_start":"256'100","ondisk_log_start":"256'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-19T12:03:33.318024+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-19T12:03:33.318024+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.318024+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:24:19.628657+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20533,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":287,"num_read_kb":516,"num_write":214,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:42.110392+0000","last_change":"2024-09-19T12:03:42.110392+0000","last_active":"2024-09-19T12:03:42.110392+0000","last_peered":"2024-09-19T12:03:42.110392+0000","last_clean":"2024-09-19T12:03:42.110392+0000","last_became_active":"2024-09-19T11:35:39.684034+0000","last_became_peered":"2024-09-19T11:35:39.684034+0000","last_unstale":"2024-09-19T12:03:42.110392+0000","last_undegraded":"2024-09-19T12:03:42.110392+0000","last_fullsized":"2024-09-19T12:03:42.110392+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:42.110171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:42.110171+0000","last_clean_scrub_stamp":"2024-09-19T12:03:42.110171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:32.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'23","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:44.380253+0000","last_change":"2024-09-19T12:03:44.380253+0000","last_active":"2024-09-19T12:03:44.380253+0000","last_peered":"2024-09-19T12:03:44.380253+0000","last_clean":"2024-09-19T12:03:44.380253+0000","last_became_active":"2024-09-19T11:35:41.689764+0000","last_became_peered":"2024-09-19T11:35:41.689764+0000","last_unstale":"2024-09-19T12:03:44.380253+0000","last_undegraded":"2024-09-19T12:03:44.380253+0000","last_fullsized":"2024-09-19T12:03:44.380253+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-19T12:03:44.380078+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-19T12:03:44.380078+0000","last_clean_scrub_stamp":"2024-09-19T12:03:44.380078+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:50.245203+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":78,"num_write":61,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'13","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:46.445469+0000","last_change":"2024-09-19T12:03:46.445469+0000","last_active":"2024-09-19T12:03:46.445469+0000","last_peered":"2024-09-19T12:03:46.445469+0000","last_clean":"2024-09-19T12:03:46.445469+0000","last_became_active":"2024-09-19T11:35:41.691032+0000","last_became_peered":"2024-09-19T11:35:41.691032+0000","last_unstale":"2024-09-19T12:03:46.445469+0000","last_undegraded":"2024-09-19T12:03:46.445469+0000","last_fullsized":"2024-09-19T12:03:46.445469+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-19T12:03:46.445280+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-19T12:03:46.445280+0000","last_clean_scrub_stamp":"2024-09-19T12:03:46.445280+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:26:39.736235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":124,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'71","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.184521+0000","last_change":"2024-09-19T12:03:21.184351+0000","last_active":"2024-09-19T12:03:21.184521+0000","last_peered":"2024-09-19T12:03:21.184521+0000","last_clean":"2024-09-19T12:03:21.184521+0000","last_became_active":"2024-09-19T11:35:33.629606+0000","last_became_peered":"2024-09-19T11:35:33.629606+0000","last_unstale":"2024-09-19T12:03:21.184521+0000","last_undegraded":"2024-09-19T12:03:21.184521+0000","last_fullsized":"2024-09-19T12:03:21.184521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'71","last_scrub_stamp":"2024-09-19T12:03:21.184165+0000","last_deep_scrub":"264'71","last_deep_scrub_stamp":"2024-09-19T12:03:21.184165+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.184165+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:07.903624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":210,"num_write":129,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'37","reported_seq":554,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.150393+0000","last_change":"2024-09-19T12:03:12.150255+0000","last_active":"2024-09-19T12:03:12.150393+0000","last_peered":"2024-09-19T12:03:12.150393+0000","last_clean":"2024-09-19T12:03:12.150393+0000","last_became_active":"2024-09-19T11:35:31.591519+0000","last_became_peered":"2024-09-19T11:35:31.591519+0000","last_unstale":"2024-09-19T12:03:12.150393+0000","last_undegraded":"2024-09-19T12:03:12.150393+0000","last_fullsized":"2024-09-19T12:03:12.150393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:12.150010+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:12.150010+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.150010+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:46.241961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":3273,"num_write":135,"num_write_kb":3245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.610181+0000","last_change":"2024-09-19T12:03:24.609952+0000","last_active":"2024-09-19T12:03:24.610181+0000","last_peered":"2024-09-19T12:03:24.610181+0000","last_clean":"2024-09-19T12:03:24.610181+0000","last_became_active":"2024-09-19T11:35:35.612405+0000","last_became_peered":"2024-09-19T11:35:35.612405+0000","last_unstale":"2024-09-19T12:03:24.610181+0000","last_undegraded":"2024-09-19T12:03:24.610181+0000","last_fullsized":"2024-09-19T12:03:24.610181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:24.609593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:24.609593+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.609593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:08.908515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'89","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.122260+0000","last_change":"2024-09-19T12:03:37.122124+0000","last_active":"2024-09-19T12:03:37.122260+0000","last_peered":"2024-09-19T12:03:37.122260+0000","last_clean":"2024-09-19T12:03:37.122260+0000","last_became_active":"2024-09-19T11:35:37.632543+0000","last_became_peered":"2024-09-19T11:35:37.632543+0000","last_unstale":"2024-09-19T12:03:37.122260+0000","last_undegraded":"2024-09-19T12:03:37.122260+0000","last_fullsized":"2024-09-19T12:03:37.122260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'89","last_scrub_stamp":"2024-09-19T12:03:37.121904+0000","last_deep_scrub":"264'89","last_deep_scrub_stamp":"2024-09-19T12:03:37.121904+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.121904+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:36.647748+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4752,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":182,"num_write":88,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:46.043858+0000","last_change":"2024-09-19T12:03:46.043858+0000","last_active":"2024-09-19T12:03:46.043858+0000","last_peered":"2024-09-19T12:03:46.043858+0000","last_clean":"2024-09-19T12:03:46.043858+0000","last_became_active":"2024-09-19T11:35:39.654012+0000","last_became_peered":"2024-09-19T11:35:39.654012+0000","last_unstale":"2024-09-19T12:03:46.043858+0000","last_undegraded":"2024-09-19T12:03:46.043858+0000","last_fullsized":"2024-09-19T12:03:46.043858+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:46.043648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:46.043648+0000","last_clean_scrub_stamp":"2024-09-19T12:03:46.043648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:34.717697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"262'11","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:54.063522+0000","last_change":"2024-09-19T12:03:54.063522+0000","last_active":"2024-09-19T12:03:54.063522+0000","last_peered":"2024-09-19T12:03:54.063522+0000","last_clean":"2024-09-19T12:03:54.063522+0000","last_became_active":"2024-09-19T11:35:41.675506+0000","last_became_peered":"2024-09-19T11:35:41.675506+0000","last_unstale":"2024-09-19T12:03:54.063522+0000","last_undegraded":"2024-09-19T12:03:54.063522+0000","last_fullsized":"2024-09-19T12:03:54.063522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'11","last_scrub_stamp":"2024-09-19T12:03:54.063316+0000","last_deep_scrub":"262'11","last_deep_scrub_stamp":"2024-09-19T12:03:54.063316+0000","last_clean_scrub_stamp":"2024-09-19T12:03:54.063316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:12.788941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":25,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'13","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.672691+0000","last_change":"2024-09-19T12:03:18.672534+0000","last_active":"2024-09-19T12:03:18.672691+0000","last_peered":"2024-09-19T12:03:18.672691+0000","last_clean":"2024-09-19T12:03:18.672691+0000","last_became_active":"2024-09-19T11:35:33.634606+0000","last_became_peered":"2024-09-19T11:35:33.634606+0000","last_unstale":"2024-09-19T12:03:18.672691+0000","last_undegraded":"2024-09-19T12:03:18.672691+0000","last_fullsized":"2024-09-19T12:03:18.672691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-19T12:03:18.672343+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-19T12:03:18.672343+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.672343+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:27:50.311993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":71,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'47","reported_seq":570,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.422931+0000","last_change":"2024-09-19T12:03:20.422931+0000","last_active":"2024-09-19T12:03:20.422931+0000","last_peered":"2024-09-19T12:03:20.422931+0000","last_clean":"2024-09-19T12:03:20.422931+0000","last_became_active":"2024-09-19T11:35:31.602343+0000","last_became_peered":"2024-09-19T11:35:31.602343+0000","last_unstale":"2024-09-19T12:03:20.422931+0000","last_undegraded":"2024-09-19T12:03:20.422931+0000","last_fullsized":"2024-09-19T12:03:20.422931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-09-19T12:03:20.422669+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-09-19T12:03:20.422669+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.422669+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:58.197082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":85,"num_read_kb":10301,"num_write":159,"num_write_kb":15391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.018029+0000","last_change":"2024-09-19T12:03:30.017902+0000","last_active":"2024-09-19T12:03:30.018029+0000","last_peered":"2024-09-19T12:03:30.018029+0000","last_clean":"2024-09-19T12:03:30.018029+0000","last_became_active":"2024-09-19T11:35:35.630183+0000","last_became_peered":"2024-09-19T11:35:35.630183+0000","last_unstale":"2024-09-19T12:03:30.018029+0000","last_undegraded":"2024-09-19T12:03:30.018029+0000","last_fullsized":"2024-09-19T12:03:30.018029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:30.017710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:30.017710+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.017710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:10.114635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'18","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.437544+0000","last_change":"2024-09-19T12:03:35.437374+0000","last_active":"2024-09-19T12:03:35.437544+0000","last_peered":"2024-09-19T12:03:35.437544+0000","last_clean":"2024-09-19T12:03:35.437544+0000","last_became_active":"2024-09-19T11:35:37.640723+0000","last_became_peered":"2024-09-19T11:35:37.640723+0000","last_unstale":"2024-09-19T12:03:35.437544+0000","last_undegraded":"2024-09-19T12:03:35.437544+0000","last_fullsized":"2024-09-19T12:03:35.437544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-19T12:03:35.437187+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-19T12:03:35.437187+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.437187+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:22.198910+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:40.343713+0000","last_change":"2024-09-19T12:03:40.343583+0000","last_active":"2024-09-19T12:03:40.343713+0000","last_peered":"2024-09-19T12:03:40.343713+0000","last_clean":"2024-09-19T12:03:40.343713+0000","last_became_active":"2024-09-19T11:35:39.667286+0000","last_became_peered":"2024-09-19T11:35:39.667286+0000","last_unstale":"2024-09-19T12:03:40.343713+0000","last_undegraded":"2024-09-19T12:03:40.343713+0000","last_fullsized":"2024-09-19T12:03:40.343713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:40.343399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:40.343399+0000","last_clean_scrub_stamp":"2024-09-19T12:03:40.343399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:43.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'8","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:48.507322+0000","last_change":"2024-09-19T12:03:48.507322+0000","last_active":"2024-09-19T12:03:48.507322+0000","last_peered":"2024-09-19T12:03:48.507322+0000","last_clean":"2024-09-19T12:03:48.507322+0000","last_became_active":"2024-09-19T11:35:41.696369+0000","last_became_peered":"2024-09-19T11:35:41.696369+0000","last_unstale":"2024-09-19T12:03:48.507322+0000","last_undegraded":"2024-09-19T12:03:48.507322+0000","last_fullsized":"2024-09-19T12:03:48.507322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-19T12:03:48.507146+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-19T12:03:48.507146+0000","last_clean_scrub_stamp":"2024-09-19T12:03:48.507146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:36.282544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'69","reported_seq":597,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.909934+0000","last_change":"2024-09-19T12:03:22.909800+0000","last_active":"2024-09-19T12:03:22.909934+0000","last_peered":"2024-09-19T12:03:22.909934+0000","last_clean":"2024-09-19T12:03:22.909934+0000","last_became_active":"2024-09-19T11:35:33.614693+0000","last_became_peered":"2024-09-19T11:35:33.614693+0000","last_unstale":"2024-09-19T12:03:22.909934+0000","last_undegraded":"2024-09-19T12:03:22.909934+0000","last_fullsized":"2024-09-19T12:03:22.909934+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'69","last_scrub_stamp":"2024-09-19T12:03:22.909619+0000","last_deep_scrub":"264'69","last_deep_scrub_stamp":"2024-09-19T12:03:22.909619+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.909619+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:13.544034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":277,"num_read_kb":230,"num_write":111,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'49","reported_seq":548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.176623+0000","last_change":"2024-09-19T12:03:12.176623+0000","last_active":"2024-09-19T12:03:12.176623+0000","last_peered":"2024-09-19T12:03:12.176623+0000","last_clean":"2024-09-19T12:03:12.176623+0000","last_became_active":"2024-09-19T11:36:06.677102+0000","last_became_peered":"2024-09-19T11:36:06.677102+0000","last_unstale":"2024-09-19T12:03:12.176623+0000","last_undegraded":"2024-09-19T12:03:12.176623+0000","last_fullsized":"2024-09-19T12:03:12.176623+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-19T12:03:12.176533+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-19T12:03:12.176533+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.176533+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:03.972788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":91,"num_read_kb":1744,"num_write":157,"num_write_kb":1703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.288190+0000","last_change":"2024-09-19T12:03:31.288065+0000","last_active":"2024-09-19T12:03:31.288190+0000","last_peered":"2024-09-19T12:03:31.288190+0000","last_clean":"2024-09-19T12:03:31.288190+0000","last_became_active":"2024-09-19T11:35:35.617374+0000","last_became_peered":"2024-09-19T11:35:35.617374+0000","last_unstale":"2024-09-19T12:03:31.288190+0000","last_undegraded":"2024-09-19T12:03:31.288190+0000","last_fullsized":"2024-09-19T12:03:31.288190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:31.287897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:31.287897+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.287897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:51.291514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'102","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:39.158203+0000","last_change":"2024-09-19T12:03:39.157971+0000","last_active":"2024-09-19T12:03:39.158203+0000","last_peered":"2024-09-19T12:03:39.158203+0000","last_clean":"2024-09-19T12:03:39.158203+0000","last_became_active":"2024-09-19T11:35:37.636913+0000","last_became_peered":"2024-09-19T11:35:37.636913+0000","last_unstale":"2024-09-19T12:03:39.158203+0000","last_undegraded":"2024-09-19T12:03:39.158203+0000","last_fullsized":"2024-09-19T12:03:39.158203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-19T12:03:39.157739+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-19T12:03:39.157739+0000","last_clean_scrub_stamp":"2024-09-19T12:03:39.157739+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:20:55.117974+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4489,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":210,"num_write":100,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.095142+0000","last_change":"2024-09-19T12:03:30.094860+0000","last_active":"2024-09-19T12:03:30.095142+0000","last_peered":"2024-09-19T12:03:30.095142+0000","last_clean":"2024-09-19T12:03:30.095142+0000","last_became_active":"2024-09-19T11:35:39.673172+0000","last_became_peered":"2024-09-19T11:35:39.673172+0000","last_unstale":"2024-09-19T12:03:30.095142+0000","last_undegraded":"2024-09-19T12:03:30.095142+0000","last_fullsized":"2024-09-19T12:03:30.095142+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:30.094657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:30.094657+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.094657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:05.891743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'13","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:47.397509+0000","last_change":"2024-09-19T12:03:47.397509+0000","last_active":"2024-09-19T12:03:47.397509+0000","last_peered":"2024-09-19T12:03:47.397509+0000","last_clean":"2024-09-19T12:03:47.397509+0000","last_became_active":"2024-09-19T11:35:41.677991+0000","last_became_peered":"2024-09-19T11:35:41.677991+0000","last_unstale":"2024-09-19T12:03:47.397509+0000","last_undegraded":"2024-09-19T12:03:47.397509+0000","last_fullsized":"2024-09-19T12:03:47.397509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-09-19T12:03:47.397329+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-09-19T12:03:47.397329+0000","last_clean_scrub_stamp":"2024-09-19T12:03:47.397329+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:12.386458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":90,"num_write":33,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.232001+0000","last_change":"2024-09-19T12:03:17.231795+0000","last_active":"2024-09-19T12:03:17.232001+0000","last_peered":"2024-09-19T12:03:17.232001+0000","last_clean":"2024-09-19T12:03:17.232001+0000","last_became_active":"2024-09-19T11:36:06.674947+0000","last_became_peered":"2024-09-19T11:36:06.674947+0000","last_unstale":"2024-09-19T12:03:17.232001+0000","last_undegraded":"2024-09-19T12:03:17.232001+0000","last_fullsized":"2024-09-19T12:03:17.232001+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:17.231570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:17.231570+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.231570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:32.772458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"264'32","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:11.318659+0000","last_change":"2024-09-19T12:03:11.318659+0000","last_active":"2024-09-19T12:03:11.318659+0000","last_peered":"2024-09-19T12:03:11.318659+0000","last_clean":"2024-09-19T12:03:11.318659+0000","last_became_active":"2024-09-19T11:35:31.589077+0000","last_became_peered":"2024-09-19T11:35:31.589077+0000","last_unstale":"2024-09-19T12:03:11.318659+0000","last_undegraded":"2024-09-19T12:03:11.318659+0000","last_fullsized":"2024-09-19T12:03:11.318659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-19T12:03:11.318438+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-19T12:03:11.318438+0000","last_clean_scrub_stamp":"2024-09-19T12:03:11.318438+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:43.791532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":45,"num_read_kb":7227,"num_write":97,"num_write_kb":7207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.108696+0000","last_change":"2024-09-19T12:03:25.108563+0000","last_active":"2024-09-19T12:03:25.108696+0000","last_peered":"2024-09-19T12:03:25.108696+0000","last_clean":"2024-09-19T12:03:25.108696+0000","last_became_active":"2024-09-19T11:35:35.629798+0000","last_became_peered":"2024-09-19T11:35:35.629798+0000","last_unstale":"2024-09-19T12:03:25.108696+0000","last_undegraded":"2024-09-19T12:03:25.108696+0000","last_fullsized":"2024-09-19T12:03:25.108696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:25.108374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:25.108374+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.108374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:13:16.547584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'73","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.307714+0000","last_change":"2024-09-19T12:03:36.307578+0000","last_active":"2024-09-19T12:03:36.307714+0000","last_peered":"2024-09-19T12:03:36.307714+0000","last_clean":"2024-09-19T12:03:36.307714+0000","last_became_active":"2024-09-19T11:35:37.640008+0000","last_became_peered":"2024-09-19T11:35:37.640008+0000","last_unstale":"2024-09-19T12:03:36.307714+0000","last_undegraded":"2024-09-19T12:03:36.307714+0000","last_fullsized":"2024-09-19T12:03:36.307714+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'73","last_scrub_stamp":"2024-09-19T12:03:36.307378+0000","last_deep_scrub":"264'73","last_deep_scrub_stamp":"2024-09-19T12:03:36.307378+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.307378+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:11.616881+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":172,"num_write":74,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:37.391743+0000","last_change":"2024-09-19T12:03:37.391576+0000","last_active":"2024-09-19T12:03:37.391743+0000","last_peered":"2024-09-19T12:03:37.391743+0000","last_clean":"2024-09-19T12:03:37.391743+0000","last_became_active":"2024-09-19T11:35:39.675913+0000","last_became_peered":"2024-09-19T11:35:39.675913+0000","last_unstale":"2024-09-19T12:03:37.391743+0000","last_undegraded":"2024-09-19T12:03:37.391743+0000","last_fullsized":"2024-09-19T12:03:37.391743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:37.391395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:37.391395+0000","last_clean_scrub_stamp":"2024-09-19T12:03:37.391395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:26.854978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'73","reported_seq":589,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.113812+0000","last_change":"2024-09-19T12:03:21.113812+0000","last_active":"2024-09-19T12:03:21.113812+0000","last_peered":"2024-09-19T12:03:21.113812+0000","last_clean":"2024-09-19T12:03:21.113812+0000","last_became_active":"2024-09-19T11:35:33.624358+0000","last_became_peered":"2024-09-19T11:35:33.624358+0000","last_unstale":"2024-09-19T12:03:21.113812+0000","last_undegraded":"2024-09-19T12:03:21.113812+0000","last_fullsized":"2024-09-19T12:03:21.113812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'73","last_scrub_stamp":"2024-09-19T12:03:21.113588+0000","last_deep_scrub":"264'73","last_deep_scrub_stamp":"2024-09-19T12:03:21.113588+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.113588+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:37.273797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":316,"num_read_kb":286,"num_write":104,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2877,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'41","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.876573+0000","last_change":"2024-09-19T12:03:15.876573+0000","last_active":"2024-09-19T12:03:15.876573+0000","last_peered":"2024-09-19T12:03:15.876573+0000","last_clean":"2024-09-19T12:03:15.876573+0000","last_became_active":"2024-09-19T11:35:31.574673+0000","last_became_peered":"2024-09-19T11:35:31.574673+0000","last_unstale":"2024-09-19T12:03:15.876573+0000","last_undegraded":"2024-09-19T12:03:15.876573+0000","last_fullsized":"2024-09-19T12:03:15.876573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-19T12:03:15.876312+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-19T12:03:15.876312+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.876312+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:09.652364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":49,"num_write":124,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.389854+0000","last_change":"2024-09-19T12:03:29.389707+0000","last_active":"2024-09-19T12:03:29.389854+0000","last_peered":"2024-09-19T12:03:29.389854+0000","last_clean":"2024-09-19T12:03:29.389854+0000","last_became_active":"2024-09-19T11:35:35.617643+0000","last_became_peered":"2024-09-19T11:35:35.617643+0000","last_unstale":"2024-09-19T12:03:29.389854+0000","last_undegraded":"2024-09-19T12:03:29.389854+0000","last_fullsized":"2024-09-19T12:03:29.389854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:29.389529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:29.389529+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.389529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:07.829457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'106","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:28.654722+0000","last_change":"2024-09-19T12:03:28.654722+0000","last_active":"2024-09-19T12:03:28.654722+0000","last_peered":"2024-09-19T12:03:28.654722+0000","last_clean":"2024-09-19T12:03:28.654722+0000","last_became_active":"2024-09-19T11:35:37.640147+0000","last_became_peered":"2024-09-19T11:35:37.640147+0000","last_unstale":"2024-09-19T12:03:28.654722+0000","last_undegraded":"2024-09-19T12:03:28.654722+0000","last_fullsized":"2024-09-19T12:03:28.654722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'106","last_scrub_stamp":"2024-09-19T12:03:28.654523+0000","last_deep_scrub":"264'106","last_deep_scrub_stamp":"2024-09-19T12:03:28.654523+0000","last_clean_scrub_stamp":"2024-09-19T12:03:28.654523+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:50.635509+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9836,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":276,"num_write":110,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:41.415146+0000","last_change":"2024-09-19T12:03:41.415146+0000","last_active":"2024-09-19T12:03:41.415146+0000","last_peered":"2024-09-19T12:03:41.415146+0000","last_clean":"2024-09-19T12:03:41.415146+0000","last_became_active":"2024-09-19T11:35:39.651426+0000","last_became_peered":"2024-09-19T11:35:39.651426+0000","last_unstale":"2024-09-19T12:03:41.415146+0000","last_undegraded":"2024-09-19T12:03:41.415146+0000","last_fullsized":"2024-09-19T12:03:41.415146+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:41.414967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:41.414967+0000","last_clean_scrub_stamp":"2024-09-19T12:03:41.414967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:11.850992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'75","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:53.100993+0000","last_change":"2024-09-19T12:03:53.100993+0000","last_active":"2024-09-19T12:03:53.100993+0000","last_peered":"2024-09-19T12:03:53.100993+0000","last_clean":"2024-09-19T12:03:53.100993+0000","last_became_active":"2024-09-19T11:35:41.674006+0000","last_became_peered":"2024-09-19T11:35:41.674006+0000","last_unstale":"2024-09-19T12:03:53.100993+0000","last_undegraded":"2024-09-19T12:03:53.100993+0000","last_fullsized":"2024-09-19T12:03:53.100993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'75","last_scrub_stamp":"2024-09-19T12:03:53.100814+0000","last_deep_scrub":"264'75","last_deep_scrub_stamp":"2024-09-19T12:03:53.100814+0000","last_clean_scrub_stamp":"2024-09-19T12:03:53.100814+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:06.138167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'110","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.333687+0000","last_change":"2024-09-19T12:03:23.333458+0000","last_active":"2024-09-19T12:03:23.333687+0000","last_peered":"2024-09-19T12:03:23.333687+0000","last_clean":"2024-09-19T12:03:23.333687+0000","last_became_active":"2024-09-19T11:35:33.611732+0000","last_became_peered":"2024-09-19T11:35:33.611732+0000","last_unstale":"2024-09-19T12:03:23.333687+0000","last_undegraded":"2024-09-19T12:03:23.333687+0000","last_fullsized":"2024-09-19T12:03:23.333687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-19T12:03:23.333232+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-19T12:03:23.333232+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.333232+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.621387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":312,"num_write":153,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'50","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.674076+0000","last_change":"2024-09-19T12:03:13.674076+0000","last_active":"2024-09-19T12:03:13.674076+0000","last_peered":"2024-09-19T12:03:13.674076+0000","last_clean":"2024-09-19T12:03:13.674076+0000","last_became_active":"2024-09-19T11:35:31.585423+0000","last_became_peered":"2024-09-19T11:35:31.585423+0000","last_unstale":"2024-09-19T12:03:13.674076+0000","last_undegraded":"2024-09-19T12:03:13.674076+0000","last_fullsized":"2024-09-19T12:03:13.674076+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-19T12:03:13.673866+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-19T12:03:13.673866+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.673866+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:32.590993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":1132,"num_write":175,"num_write_kb":1063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.119551+0000","last_change":"2024-09-19T12:03:27.119551+0000","last_active":"2024-09-19T12:03:27.119551+0000","last_peered":"2024-09-19T12:03:27.119551+0000","last_clean":"2024-09-19T12:03:27.119551+0000","last_became_active":"2024-09-19T11:35:35.632384+0000","last_became_peered":"2024-09-19T11:35:35.632384+0000","last_unstale":"2024-09-19T12:03:27.119551+0000","last_undegraded":"2024-09-19T12:03:27.119551+0000","last_fullsized":"2024-09-19T12:03:27.119551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:27.119375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:27.119375+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.119375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:03.270132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'84","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.293483+0000","last_change":"2024-09-19T12:03:38.293483+0000","last_active":"2024-09-19T12:03:38.293483+0000","last_peered":"2024-09-19T12:03:38.293483+0000","last_clean":"2024-09-19T12:03:38.293483+0000","last_became_active":"2024-09-19T11:35:37.641603+0000","last_became_peered":"2024-09-19T11:35:37.641603+0000","last_unstale":"2024-09-19T12:03:38.293483+0000","last_undegraded":"2024-09-19T12:03:38.293483+0000","last_fullsized":"2024-09-19T12:03:38.293483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-19T12:03:38.293270+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-19T12:03:38.293270+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.293270+0000","objects_scrubbed":8,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:03.705413+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":118,"num_read_kb":160,"num_write":100,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.559018+0000","last_change":"2024-09-19T12:03:36.559018+0000","last_active":"2024-09-19T12:03:36.559018+0000","last_peered":"2024-09-19T12:03:36.559018+0000","last_clean":"2024-09-19T12:03:36.559018+0000","last_became_active":"2024-09-19T11:35:39.683564+0000","last_became_peered":"2024-09-19T11:35:39.683564+0000","last_unstale":"2024-09-19T12:03:36.559018+0000","last_undegraded":"2024-09-19T12:03:36.559018+0000","last_fullsized":"2024-09-19T12:03:36.559018+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:36.558812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:36.558812+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.558812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:45.887514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'29","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.126533+0000","last_change":"2024-09-19T12:03:35.126263+0000","last_active":"2024-09-19T12:03:35.126533+0000","last_peered":"2024-09-19T12:03:35.126533+0000","last_clean":"2024-09-19T12:03:35.126533+0000","last_became_active":"2024-09-19T11:35:41.665262+0000","last_became_peered":"2024-09-19T11:35:41.665262+0000","last_unstale":"2024-09-19T12:03:35.126533+0000","last_undegraded":"2024-09-19T12:03:35.126533+0000","last_fullsized":"2024-09-19T12:03:35.126533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-19T12:03:35.125984+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-19T12:03:35.125984+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.125984+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:40.520346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1551,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":132,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'2","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.939755+0000","last_change":"2024-09-19T12:03:25.939755+0000","last_active":"2024-09-19T12:03:25.939755+0000","last_peered":"2024-09-19T12:03:25.939755+0000","last_clean":"2024-09-19T12:03:25.939755+0000","last_became_active":"2024-09-19T11:35:33.613712+0000","last_became_peered":"2024-09-19T11:35:33.613712+0000","last_unstale":"2024-09-19T12:03:25.939755+0000","last_undegraded":"2024-09-19T12:03:25.939755+0000","last_fullsized":"2024-09-19T12:03:25.939755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:25.939569+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:25.939569+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.939569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:32:24.600578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'48","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.168534+0000","last_change":"2024-09-19T12:03:14.168534+0000","last_active":"2024-09-19T12:03:14.168534+0000","last_peered":"2024-09-19T12:03:14.168534+0000","last_clean":"2024-09-19T12:03:14.168534+0000","last_became_active":"2024-09-19T11:35:31.579680+0000","last_became_peered":"2024-09-19T11:35:31.579680+0000","last_unstale":"2024-09-19T12:03:14.168534+0000","last_undegraded":"2024-09-19T12:03:14.168534+0000","last_fullsized":"2024-09-19T12:03:14.168534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'48","last_scrub_stamp":"2024-09-19T12:03:14.168295+0000","last_deep_scrub":"264'48","last_deep_scrub_stamp":"2024-09-19T12:03:14.168295+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.168295+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:40.012360+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":1771,"num_write":190,"num_write_kb":1706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.221078+0000","last_change":"2024-09-19T12:03:35.221078+0000","last_active":"2024-09-19T12:03:35.221078+0000","last_peered":"2024-09-19T12:03:35.221078+0000","last_clean":"2024-09-19T12:03:35.221078+0000","last_became_active":"2024-09-19T11:35:35.625446+0000","last_became_peered":"2024-09-19T11:35:35.625446+0000","last_unstale":"2024-09-19T12:03:35.221078+0000","last_undegraded":"2024-09-19T12:03:35.221078+0000","last_fullsized":"2024-09-19T12:03:35.221078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:35.220895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:35.220895+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.220895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:14.166973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'77","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:40.108262+0000","last_change":"2024-09-19T12:03:40.108262+0000","last_active":"2024-09-19T12:03:40.108262+0000","last_peered":"2024-09-19T12:03:40.108262+0000","last_clean":"2024-09-19T12:03:40.108262+0000","last_became_active":"2024-09-19T11:35:37.616602+0000","last_became_peered":"2024-09-19T11:35:37.616602+0000","last_unstale":"2024-09-19T12:03:40.108262+0000","last_undegraded":"2024-09-19T12:03:40.108262+0000","last_fullsized":"2024-09-19T12:03:40.108262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'77","last_scrub_stamp":"2024-09-19T12:03:40.108057+0000","last_deep_scrub":"264'77","last_deep_scrub_stamp":"2024-09-19T12:03:40.108057+0000","last_clean_scrub_stamp":"2024-09-19T12:03:40.108057+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:33.493365+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4880,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":165,"num_write":74,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:30.616618+0000","last_change":"2024-09-19T12:03:30.616479+0000","last_active":"2024-09-19T12:03:30.616618+0000","last_peered":"2024-09-19T12:03:30.616618+0000","last_clean":"2024-09-19T12:03:30.616618+0000","last_became_active":"2024-09-19T11:35:39.686225+0000","last_became_peered":"2024-09-19T11:35:39.686225+0000","last_unstale":"2024-09-19T12:03:30.616618+0000","last_undegraded":"2024-09-19T12:03:30.616618+0000","last_fullsized":"2024-09-19T12:03:30.616618+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:30.616299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:30.616299+0000","last_clean_scrub_stamp":"2024-09-19T12:03:30.616299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:21.834894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'4","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:45.368632+0000","last_change":"2024-09-19T12:03:45.368632+0000","last_active":"2024-09-19T12:03:45.368632+0000","last_peered":"2024-09-19T12:03:45.368632+0000","last_clean":"2024-09-19T12:03:45.368632+0000","last_became_active":"2024-09-19T11:35:41.682440+0000","last_became_peered":"2024-09-19T11:35:41.682440+0000","last_unstale":"2024-09-19T12:03:45.368632+0000","last_undegraded":"2024-09-19T12:03:45.368632+0000","last_fullsized":"2024-09-19T12:03:45.368632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-19T12:03:45.368367+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-19T12:03:45.368367+0000","last_clean_scrub_stamp":"2024-09-19T12:03:45.368367+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:31.866847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'93","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.239877+0000","last_change":"2024-09-19T12:03:18.239877+0000","last_active":"2024-09-19T12:03:18.239877+0000","last_peered":"2024-09-19T12:03:18.239877+0000","last_clean":"2024-09-19T12:03:18.239877+0000","last_became_active":"2024-09-19T11:35:33.605161+0000","last_became_peered":"2024-09-19T11:35:33.605161+0000","last_unstale":"2024-09-19T12:03:18.239877+0000","last_undegraded":"2024-09-19T12:03:18.239877+0000","last_fullsized":"2024-09-19T12:03:18.239877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'93","last_scrub_stamp":"2024-09-19T12:03:18.239701+0000","last_deep_scrub":"264'93","last_deep_scrub_stamp":"2024-09-19T12:03:18.239701+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.239701+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:08:10.377092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":359,"num_read_kb":288,"num_write":158,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'32","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:12.315615+0000","last_change":"2024-09-19T12:03:12.315615+0000","last_active":"2024-09-19T12:03:12.315615+0000","last_peered":"2024-09-19T12:03:12.315615+0000","last_clean":"2024-09-19T12:03:12.315615+0000","last_became_active":"2024-09-19T11:35:31.602466+0000","last_became_peered":"2024-09-19T11:35:31.602466+0000","last_unstale":"2024-09-19T12:03:12.315615+0000","last_undegraded":"2024-09-19T12:03:12.315615+0000","last_fullsized":"2024-09-19T12:03:12.315615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-19T12:03:12.315539+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-19T12:03:12.315539+0000","last_clean_scrub_stamp":"2024-09-19T12:03:12.315539+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:05:37.501317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":124,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.595939+0000","last_change":"2024-09-19T12:03:25.595939+0000","last_active":"2024-09-19T12:03:25.595939+0000","last_peered":"2024-09-19T12:03:25.595939+0000","last_clean":"2024-09-19T12:03:25.595939+0000","last_became_active":"2024-09-19T11:35:35.631573+0000","last_became_peered":"2024-09-19T11:35:35.631573+0000","last_unstale":"2024-09-19T12:03:25.595939+0000","last_undegraded":"2024-09-19T12:03:25.595939+0000","last_fullsized":"2024-09-19T12:03:25.595939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:25.595749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:25.595749+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.595749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:33.449047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'46","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:42.298469+0000","last_change":"2024-09-19T12:03:42.298469+0000","last_active":"2024-09-19T12:03:42.298469+0000","last_peered":"2024-09-19T12:03:42.298469+0000","last_clean":"2024-09-19T12:03:42.298469+0000","last_became_active":"2024-09-19T11:35:37.632562+0000","last_became_peered":"2024-09-19T11:35:37.632562+0000","last_unstale":"2024-09-19T12:03:42.298469+0000","last_undegraded":"2024-09-19T12:03:42.298469+0000","last_fullsized":"2024-09-19T12:03:42.298469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'46","last_scrub_stamp":"2024-09-19T12:03:42.298265+0000","last_deep_scrub":"264'46","last_deep_scrub_stamp":"2024-09-19T12:03:42.298265+0000","last_clean_scrub_stamp":"2024-09-19T12:03:42.298265+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:07.451508+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":55,"num_read_kb":48,"num_write":46,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'617","reported_seq":1548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.092168+0000","last_change":"2024-09-19T12:03:31.092168+0000","last_active":"2024-09-19T12:03:31.092168+0000","last_peered":"2024-09-19T12:03:31.092168+0000","last_clean":"2024-09-19T12:03:31.092168+0000","last_became_active":"2024-09-19T11:35:39.659602+0000","last_became_peered":"2024-09-19T11:35:39.659602+0000","last_unstale":"2024-09-19T12:03:31.092168+0000","last_undegraded":"2024-09-19T12:03:31.092168+0000","last_fullsized":"2024-09-19T12:03:31.092168+0000","mapping_epoch":34,"log_start":"264'600","ondisk_log_start":"264'600","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'617","last_scrub_stamp":"2024-09-19T12:03:31.091985+0000","last_deep_scrub":"264'617","last_deep_scrub_stamp":"2024-09-19T12:03:31.091985+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.091985+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:24.959348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'7","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.369871+0000","last_change":"2024-09-19T12:03:43.369871+0000","last_active":"2024-09-19T12:03:43.369871+0000","last_peered":"2024-09-19T12:03:43.369871+0000","last_clean":"2024-09-19T12:03:43.369871+0000","last_became_active":"2024-09-19T11:35:41.681567+0000","last_became_peered":"2024-09-19T11:35:41.681567+0000","last_unstale":"2024-09-19T12:03:43.369871+0000","last_undegraded":"2024-09-19T12:03:43.369871+0000","last_fullsized":"2024-09-19T12:03:43.369871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-19T12:03:43.369705+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-19T12:03:43.369705+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.369705+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:27.875990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'69","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.248021+0000","last_change":"2024-09-19T12:03:24.248021+0000","last_active":"2024-09-19T12:03:24.248021+0000","last_peered":"2024-09-19T12:03:24.248021+0000","last_clean":"2024-09-19T12:03:24.248021+0000","last_became_active":"2024-09-19T11:35:33.617414+0000","last_became_peered":"2024-09-19T11:35:33.617414+0000","last_unstale":"2024-09-19T12:03:24.248021+0000","last_undegraded":"2024-09-19T12:03:24.248021+0000","last_fullsized":"2024-09-19T12:03:24.248021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'69","last_scrub_stamp":"2024-09-19T12:03:24.247784+0000","last_deep_scrub":"264'69","last_deep_scrub_stamp":"2024-09-19T12:03:24.247784+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.247784+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:57.608796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":257,"num_read_kb":201,"num_write":115,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'34","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.581458+0000","last_change":"2024-09-19T12:03:16.581458+0000","last_active":"2024-09-19T12:03:16.581458+0000","last_peered":"2024-09-19T12:03:16.581458+0000","last_clean":"2024-09-19T12:03:16.581458+0000","last_became_active":"2024-09-19T11:35:31.613260+0000","last_became_peered":"2024-09-19T11:35:31.613260+0000","last_unstale":"2024-09-19T12:03:16.581458+0000","last_undegraded":"2024-09-19T12:03:16.581458+0000","last_fullsized":"2024-09-19T12:03:16.581458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-19T12:03:16.581208+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-19T12:03:16.581208+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.581208+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:46.072831+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":9290,"num_write":82,"num_write_kb":7234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:32.263960+0000","last_change":"2024-09-19T12:03:32.263960+0000","last_active":"2024-09-19T12:03:32.263960+0000","last_peered":"2024-09-19T12:03:32.263960+0000","last_clean":"2024-09-19T12:03:32.263960+0000","last_became_active":"2024-09-19T11:35:35.617489+0000","last_became_peered":"2024-09-19T11:35:35.617489+0000","last_unstale":"2024-09-19T12:03:32.263960+0000","last_undegraded":"2024-09-19T12:03:32.263960+0000","last_fullsized":"2024-09-19T12:03:32.263960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:32.263756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:32.263756+0000","last_clean_scrub_stamp":"2024-09-19T12:03:32.263756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:15.095540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'98","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:39.351862+0000","last_change":"2024-09-19T12:03:39.351862+0000","last_active":"2024-09-19T12:03:39.351862+0000","last_peered":"2024-09-19T12:03:39.351862+0000","last_clean":"2024-09-19T12:03:39.351862+0000","last_became_active":"2024-09-19T11:35:37.624101+0000","last_became_peered":"2024-09-19T11:35:37.624101+0000","last_unstale":"2024-09-19T12:03:39.351862+0000","last_undegraded":"2024-09-19T12:03:39.351862+0000","last_fullsized":"2024-09-19T12:03:39.351862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'98","last_scrub_stamp":"2024-09-19T12:03:39.351636+0000","last_deep_scrub":"264'98","last_deep_scrub_stamp":"2024-09-19T12:03:39.351636+0000","last_clean_scrub_stamp":"2024-09-19T12:03:39.351636+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:10.145768+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4425,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":123,"num_read_kb":188,"num_write":92,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:41.413613+0000","last_change":"2024-09-19T12:03:41.413613+0000","last_active":"2024-09-19T12:03:41.413613+0000","last_peered":"2024-09-19T12:03:41.413613+0000","last_clean":"2024-09-19T12:03:41.413613+0000","last_became_active":"2024-09-19T11:35:39.671474+0000","last_became_peered":"2024-09-19T11:35:39.671474+0000","last_unstale":"2024-09-19T12:03:41.413613+0000","last_undegraded":"2024-09-19T12:03:41.413613+0000","last_fullsized":"2024-09-19T12:03:41.413613+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:41.413408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:41.413408+0000","last_clean_scrub_stamp":"2024-09-19T12:03:41.413408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:35.195876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'18","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:45.386001+0000","last_change":"2024-09-19T12:03:45.386001+0000","last_active":"2024-09-19T12:03:45.386001+0000","last_peered":"2024-09-19T12:03:45.386001+0000","last_clean":"2024-09-19T12:03:45.386001+0000","last_became_active":"2024-09-19T11:35:41.693900+0000","last_became_peered":"2024-09-19T11:35:41.693900+0000","last_unstale":"2024-09-19T12:03:45.386001+0000","last_undegraded":"2024-09-19T12:03:45.386001+0000","last_fullsized":"2024-09-19T12:03:45.386001+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-19T12:03:45.385807+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-19T12:03:45.385807+0000","last_clean_scrub_stamp":"2024-09-19T12:03:45.385807+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:21:53.491987+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":443,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":69,"num_write":47,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'84","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.222123+0000","last_change":"2024-09-19T12:03:23.222123+0000","last_active":"2024-09-19T12:03:23.222123+0000","last_peered":"2024-09-19T12:03:23.222123+0000","last_clean":"2024-09-19T12:03:23.222123+0000","last_became_active":"2024-09-19T11:35:33.605259+0000","last_became_peered":"2024-09-19T11:35:33.605259+0000","last_unstale":"2024-09-19T12:03:23.222123+0000","last_undegraded":"2024-09-19T12:03:23.222123+0000","last_fullsized":"2024-09-19T12:03:23.222123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-19T12:03:23.221939+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-19T12:03:23.221939+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.221939+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:03.856307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":291,"num_write":128,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'46","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.566095+0000","last_change":"2024-09-19T12:03:17.566095+0000","last_active":"2024-09-19T12:03:17.566095+0000","last_peered":"2024-09-19T12:03:17.566095+0000","last_clean":"2024-09-19T12:03:17.566095+0000","last_became_active":"2024-09-19T11:35:31.622688+0000","last_became_peered":"2024-09-19T11:35:31.622688+0000","last_unstale":"2024-09-19T12:03:17.566095+0000","last_undegraded":"2024-09-19T12:03:17.566095+0000","last_fullsized":"2024-09-19T12:03:17.566095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'46","last_scrub_stamp":"2024-09-19T12:03:17.565856+0000","last_deep_scrub":"264'46","last_deep_scrub_stamp":"2024-09-19T12:03:17.565856+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.565856+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:16.319910+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":10950,"num_write":217,"num_write_kb":6774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:35.452711+0000","last_change":"2024-09-19T12:03:35.452711+0000","last_active":"2024-09-19T12:03:35.452711+0000","last_peered":"2024-09-19T12:03:35.452711+0000","last_clean":"2024-09-19T12:03:35.452711+0000","last_became_active":"2024-09-19T11:35:35.621518+0000","last_became_peered":"2024-09-19T11:35:35.621518+0000","last_unstale":"2024-09-19T12:03:35.452711+0000","last_undegraded":"2024-09-19T12:03:35.452711+0000","last_fullsized":"2024-09-19T12:03:35.452711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:35.452526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:35.452526+0000","last_clean_scrub_stamp":"2024-09-19T12:03:35.452526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:37:15.891912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'96","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:36.425162+0000","last_change":"2024-09-19T12:03:36.425162+0000","last_active":"2024-09-19T12:03:36.425162+0000","last_peered":"2024-09-19T12:03:36.425162+0000","last_clean":"2024-09-19T12:03:36.425162+0000","last_became_active":"2024-09-19T11:35:37.639833+0000","last_became_peered":"2024-09-19T11:35:37.639833+0000","last_unstale":"2024-09-19T12:03:36.425162+0000","last_undegraded":"2024-09-19T12:03:36.425162+0000","last_fullsized":"2024-09-19T12:03:36.425162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'96","last_scrub_stamp":"2024-09-19T12:03:36.424910+0000","last_deep_scrub":"264'96","last_deep_scrub_stamp":"2024-09-19T12:03:36.424910+0000","last_clean_scrub_stamp":"2024-09-19T12:03:36.424910+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:12.676734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5142,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":105,"num_read_kb":164,"num_write":86,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.121385+0000","last_change":"2024-09-19T12:03:29.121385+0000","last_active":"2024-09-19T12:03:29.121385+0000","last_peered":"2024-09-19T12:03:29.121385+0000","last_clean":"2024-09-19T12:03:29.121385+0000","last_became_active":"2024-09-19T11:35:39.659011+0000","last_became_peered":"2024-09-19T11:35:39.659011+0000","last_unstale":"2024-09-19T12:03:29.121385+0000","last_undegraded":"2024-09-19T12:03:29.121385+0000","last_fullsized":"2024-09-19T12:03:29.121385+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:29.121214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:29.121214+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.121214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:43.379624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'16","reported_seq":531,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:52.128179+0000","last_change":"2024-09-19T12:03:52.128179+0000","last_active":"2024-09-19T12:03:52.128179+0000","last_peered":"2024-09-19T12:03:52.128179+0000","last_clean":"2024-09-19T12:03:52.128179+0000","last_became_active":"2024-09-19T11:35:41.674818+0000","last_became_peered":"2024-09-19T11:35:41.674818+0000","last_unstale":"2024-09-19T12:03:52.128179+0000","last_undegraded":"2024-09-19T12:03:52.128179+0000","last_fullsized":"2024-09-19T12:03:52.128179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-09-19T12:03:52.127996+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-09-19T12:03:52.127996+0000","last_clean_scrub_stamp":"2024-09-19T12:03:52.127996+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:29.938736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":90,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'44","reported_seq":556,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.881067+0000","last_change":"2024-09-19T12:03:23.881067+0000","last_active":"2024-09-19T12:03:23.881067+0000","last_peered":"2024-09-19T12:03:23.881067+0000","last_clean":"2024-09-19T12:03:23.881067+0000","last_became_active":"2024-09-19T11:35:33.603610+0000","last_became_peered":"2024-09-19T11:35:33.603610+0000","last_unstale":"2024-09-19T12:03:23.881067+0000","last_undegraded":"2024-09-19T12:03:23.881067+0000","last_fullsized":"2024-09-19T12:03:23.881067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-19T12:03:23.880876+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-19T12:03:23.880876+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.880876+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:55.046789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":138,"num_write":82,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'50","reported_seq":573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.839834+0000","last_change":"2024-09-19T12:03:14.839686+0000","last_active":"2024-09-19T12:03:14.839834+0000","last_peered":"2024-09-19T12:03:14.839834+0000","last_clean":"2024-09-19T12:03:14.839834+0000","last_became_active":"2024-09-19T11:35:31.620504+0000","last_became_peered":"2024-09-19T11:35:31.620504+0000","last_unstale":"2024-09-19T12:03:14.839834+0000","last_undegraded":"2024-09-19T12:03:14.839834+0000","last_fullsized":"2024-09-19T12:03:14.839834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'50","last_scrub_stamp":"2024-09-19T12:03:14.839475+0000","last_deep_scrub":"264'50","last_deep_scrub_stamp":"2024-09-19T12:03:14.839475+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.839475+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:52.284729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":1683,"num_write":177,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:34.196586+0000","last_change":"2024-09-19T12:03:34.196586+0000","last_active":"2024-09-19T12:03:34.196586+0000","last_peered":"2024-09-19T12:03:34.196586+0000","last_clean":"2024-09-19T12:03:34.196586+0000","last_became_active":"2024-09-19T11:35:35.623348+0000","last_became_peered":"2024-09-19T11:35:35.623348+0000","last_unstale":"2024-09-19T12:03:34.196586+0000","last_undegraded":"2024-09-19T12:03:34.196586+0000","last_fullsized":"2024-09-19T12:03:34.196586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:34.196399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:34.196399+0000","last_clean_scrub_stamp":"2024-09-19T12:03:34.196399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:55:02.848981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'45","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:41.131616+0000","last_change":"2024-09-19T12:03:41.131616+0000","last_active":"2024-09-19T12:03:41.131616+0000","last_peered":"2024-09-19T12:03:41.131616+0000","last_clean":"2024-09-19T12:03:41.131616+0000","last_became_active":"2024-09-19T11:35:37.643249+0000","last_became_peered":"2024-09-19T11:35:37.643249+0000","last_unstale":"2024-09-19T12:03:41.131616+0000","last_undegraded":"2024-09-19T12:03:41.131616+0000","last_fullsized":"2024-09-19T12:03:41.131616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-19T12:03:41.131431+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-19T12:03:41.131431+0000","last_clean_scrub_stamp":"2024-09-19T12:03:41.131431+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:06.620351+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":104,"num_write":42,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:43.249989+0000","last_change":"2024-09-19T12:03:43.249989+0000","last_active":"2024-09-19T12:03:43.249989+0000","last_peered":"2024-09-19T12:03:43.249989+0000","last_clean":"2024-09-19T12:03:43.249989+0000","last_became_active":"2024-09-19T11:35:39.675285+0000","last_became_peered":"2024-09-19T11:35:39.675285+0000","last_unstale":"2024-09-19T12:03:43.249989+0000","last_undegraded":"2024-09-19T12:03:43.249989+0000","last_fullsized":"2024-09-19T12:03:43.249989+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:43.249782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:43.249782+0000","last_clean_scrub_stamp":"2024-09-19T12:03:43.249782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:12.747657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'24","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:44.364890+0000","last_change":"2024-09-19T12:03:44.364890+0000","last_active":"2024-09-19T12:03:44.364890+0000","last_peered":"2024-09-19T12:03:44.364890+0000","last_clean":"2024-09-19T12:03:44.364890+0000","last_became_active":"2024-09-19T11:35:41.694201+0000","last_became_peered":"2024-09-19T11:35:41.694201+0000","last_unstale":"2024-09-19T12:03:44.364890+0000","last_undegraded":"2024-09-19T12:03:44.364890+0000","last_fullsized":"2024-09-19T12:03:44.364890+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-19T12:03:44.364708+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-19T12:03:44.364708+0000","last_clean_scrub_stamp":"2024-09-19T12:03:44.364708+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:45.047687+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":56,"num_write":68,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'84","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.212198+0000","last_change":"2024-09-19T12:03:22.212198+0000","last_active":"2024-09-19T12:03:22.212198+0000","last_peered":"2024-09-19T12:03:22.212198+0000","last_clean":"2024-09-19T12:03:22.212198+0000","last_became_active":"2024-09-19T11:35:33.628283+0000","last_became_peered":"2024-09-19T11:35:33.628283+0000","last_unstale":"2024-09-19T12:03:22.212198+0000","last_undegraded":"2024-09-19T12:03:22.212198+0000","last_fullsized":"2024-09-19T12:03:22.212198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'84","last_scrub_stamp":"2024-09-19T12:03:22.211993+0000","last_deep_scrub":"264'84","last_deep_scrub_stamp":"2024-09-19T12:03:22.211993+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.211993+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:56:25.321214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":329,"num_read_kb":270,"num_write":117,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'31","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.370653+0000","last_change":"2024-09-19T12:03:13.370653+0000","last_active":"2024-09-19T12:03:13.370653+0000","last_peered":"2024-09-19T12:03:13.370653+0000","last_clean":"2024-09-19T12:03:13.370653+0000","last_became_active":"2024-09-19T11:36:06.649652+0000","last_became_peered":"2024-09-19T11:36:06.649652+0000","last_unstale":"2024-09-19T12:03:13.370653+0000","last_undegraded":"2024-09-19T12:03:13.370653+0000","last_fullsized":"2024-09-19T12:03:13.370653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-19T12:03:13.370381+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-19T12:03:13.370381+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.370381+0000","objects_scrubbed":9,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:51.332104+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079957,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":43,"num_read_kb":1095,"num_write":138,"num_write_kb":1067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,7],"acting":[0,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.578419+0000","last_change":"2024-09-19T12:03:31.578419+0000","last_active":"2024-09-19T12:03:31.578419+0000","last_peered":"2024-09-19T12:03:31.578419+0000","last_clean":"2024-09-19T12:03:31.578419+0000","last_became_active":"2024-09-19T11:35:35.612450+0000","last_became_peered":"2024-09-19T11:35:35.612450+0000","last_unstale":"2024-09-19T12:03:31.578419+0000","last_undegraded":"2024-09-19T12:03:31.578419+0000","last_fullsized":"2024-09-19T12:03:31.578419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-19T12:03:31.578193+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-19T12:03:31.578193+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.578193+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:28:05.874385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'94","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:38.280041+0000","last_change":"2024-09-19T12:03:38.280041+0000","last_active":"2024-09-19T12:03:38.280041+0000","last_peered":"2024-09-19T12:03:38.280041+0000","last_clean":"2024-09-19T12:03:38.280041+0000","last_became_active":"2024-09-19T11:35:37.638771+0000","last_became_peered":"2024-09-19T11:35:37.638771+0000","last_unstale":"2024-09-19T12:03:38.280041+0000","last_undegraded":"2024-09-19T12:03:38.280041+0000","last_fullsized":"2024-09-19T12:03:38.280041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'94","last_scrub_stamp":"2024-09-19T12:03:38.279801+0000","last_deep_scrub":"264'94","last_deep_scrub_stamp":"2024-09-19T12:03:38.279801+0000","last_clean_scrub_stamp":"2024-09-19T12:03:38.279801+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:42.145735+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4489,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":185,"num_write":92,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:39.463893+0000","last_change":"2024-09-19T12:03:39.463893+0000","last_active":"2024-09-19T12:03:39.463893+0000","last_peered":"2024-09-19T12:03:39.463893+0000","last_clean":"2024-09-19T12:03:39.463893+0000","last_became_active":"2024-09-19T11:35:39.662405+0000","last_became_peered":"2024-09-19T11:35:39.662405+0000","last_unstale":"2024-09-19T12:03:39.463893+0000","last_undegraded":"2024-09-19T12:03:39.463893+0000","last_fullsized":"2024-09-19T12:03:39.463893+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:39.463727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:39.463727+0000","last_clean_scrub_stamp":"2024-09-19T12:03:39.463727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:01.077359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'5","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:45.226127+0000","last_change":"2024-09-19T12:03:45.226127+0000","last_active":"2024-09-19T12:03:45.226127+0000","last_peered":"2024-09-19T12:03:45.226127+0000","last_clean":"2024-09-19T12:03:45.226127+0000","last_became_active":"2024-09-19T11:35:41.687549+0000","last_became_peered":"2024-09-19T11:35:41.687549+0000","last_unstale":"2024-09-19T12:03:45.226127+0000","last_undegraded":"2024-09-19T12:03:45.226127+0000","last_fullsized":"2024-09-19T12:03:45.226127+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-19T12:03:45.225935+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-19T12:03:45.225935+0000","last_clean_scrub_stamp":"2024-09-19T12:03:45.225935+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:06.084398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'79","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:23.562924+0000","last_change":"2024-09-19T12:03:23.562775+0000","last_active":"2024-09-19T12:03:23.562924+0000","last_peered":"2024-09-19T12:03:23.562924+0000","last_clean":"2024-09-19T12:03:23.562924+0000","last_became_active":"2024-09-19T11:35:33.629186+0000","last_became_peered":"2024-09-19T11:35:33.629186+0000","last_unstale":"2024-09-19T12:03:23.562924+0000","last_undegraded":"2024-09-19T12:03:23.562924+0000","last_fullsized":"2024-09-19T12:03:23.562924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'79","last_scrub_stamp":"2024-09-19T12:03:23.562590+0000","last_deep_scrub":"264'79","last_deep_scrub_stamp":"2024-09-19T12:03:23.562590+0000","last_clean_scrub_stamp":"2024-09-19T12:03:23.562590+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:34.865041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":235,"num_write":161,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'77","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.040384+0000","last_change":"2024-09-19T12:03:16.040384+0000","last_active":"2024-09-19T12:03:16.040384+0000","last_peered":"2024-09-19T12:03:16.040384+0000","last_clean":"2024-09-19T12:03:16.040384+0000","last_became_active":"2024-09-19T11:35:31.611719+0000","last_became_peered":"2024-09-19T11:35:31.611719+0000","last_unstale":"2024-09-19T12:03:16.040384+0000","last_undegraded":"2024-09-19T12:03:16.040384+0000","last_fullsized":"2024-09-19T12:03:16.040384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'77","last_scrub_stamp":"2024-09-19T12:03:16.040181+0000","last_deep_scrub":"264'77","last_deep_scrub_stamp":"2024-09-19T12:03:16.040181+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.040181+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:20.926088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":5196,"num_write":200,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'356","reported_seq":1062,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.626287+0000","last_change":"2024-09-19T12:03:20.626129+0000","last_active":"2024-09-19T12:03:20.626287+0000","last_peered":"2024-09-19T12:03:20.626287+0000","last_clean":"2024-09-19T12:03:20.626287+0000","last_became_active":"2024-09-19T11:35:33.603938+0000","last_became_peered":"2024-09-19T11:35:33.603938+0000","last_unstale":"2024-09-19T12:03:20.626287+0000","last_undegraded":"2024-09-19T12:03:20.626287+0000","last_fullsized":"2024-09-19T12:03:20.626287+0000","mapping_epoch":28,"log_start":"253'300","ondisk_log_start":"253'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-19T12:03:20.625945+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-19T12:03:20.625945+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.625945+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:23.605332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1936,"num_read_kb":1745,"num_write":575,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25754,"num_omap_keys":101,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'39","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.131069+0000","last_change":"2024-09-19T12:03:13.131069+0000","last_active":"2024-09-19T12:03:13.131069+0000","last_peered":"2024-09-19T12:03:13.131069+0000","last_clean":"2024-09-19T12:03:13.131069+0000","last_became_active":"2024-09-19T11:35:31.602046+0000","last_became_peered":"2024-09-19T11:35:31.602046+0000","last_unstale":"2024-09-19T12:03:13.131069+0000","last_undegraded":"2024-09-19T12:03:13.131069+0000","last_fullsized":"2024-09-19T12:03:13.131069+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-09-19T12:03:13.130878+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-09-19T12:03:13.130878+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.130878+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:22.035681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":1671,"num_write":116,"num_write_kb":1627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'4","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.541740+0000","last_change":"2024-09-19T12:03:26.541496+0000","last_active":"2024-09-19T12:03:26.541740+0000","last_peered":"2024-09-19T12:03:26.541740+0000","last_clean":"2024-09-19T12:03:26.541740+0000","last_became_active":"2024-09-19T11:35:33.616104+0000","last_became_peered":"2024-09-19T11:35:33.616104+0000","last_unstale":"2024-09-19T12:03:26.541740+0000","last_undegraded":"2024-09-19T12:03:26.541740+0000","last_fullsized":"2024-09-19T12:03:26.541740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-19T12:03:26.541258+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-19T12:03:26.541258+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.541258+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:34.987591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'37","reported_seq":552,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.554014+0000","last_change":"2024-09-19T12:03:15.554014+0000","last_active":"2024-09-19T12:03:15.554014+0000","last_peered":"2024-09-19T12:03:15.554014+0000","last_clean":"2024-09-19T12:03:15.554014+0000","last_became_active":"2024-09-19T11:35:31.613195+0000","last_became_peered":"2024-09-19T11:35:31.613195+0000","last_unstale":"2024-09-19T12:03:15.554014+0000","last_undegraded":"2024-09-19T12:03:15.554014+0000","last_fullsized":"2024-09-19T12:03:15.554014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:15.553759+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:15.553759+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.553759+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:58.104806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":62,"num_read_kb":44,"num_write":136,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'20","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.567353+0000","last_change":"2024-09-19T12:03:22.567098+0000","last_active":"2024-09-19T12:03:22.567353+0000","last_peered":"2024-09-19T12:03:22.567353+0000","last_clean":"2024-09-19T12:03:22.567353+0000","last_became_active":"2024-09-19T11:35:33.619302+0000","last_became_peered":"2024-09-19T11:35:33.619302+0000","last_unstale":"2024-09-19T12:03:22.567353+0000","last_undegraded":"2024-09-19T12:03:22.567353+0000","last_fullsized":"2024-09-19T12:03:22.567353+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'20","last_scrub_stamp":"2024-09-19T12:03:22.566882+0000","last_deep_scrub":"264'20","last_deep_scrub_stamp":"2024-09-19T12:03:22.566882+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.566882+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:29.013184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'66","reported_seq":606,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.360205+0000","last_change":"2024-09-19T12:03:17.360205+0000","last_active":"2024-09-19T12:03:17.360205+0000","last_peered":"2024-09-19T12:03:17.360205+0000","last_clean":"2024-09-19T12:03:17.360205+0000","last_became_active":"2024-09-19T11:35:31.590651+0000","last_became_peered":"2024-09-19T11:35:31.590651+0000","last_unstale":"2024-09-19T12:03:17.360205+0000","last_undegraded":"2024-09-19T12:03:17.360205+0000","last_fullsized":"2024-09-19T12:03:17.360205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'66","last_scrub_stamp":"2024-09-19T12:03:17.359961+0000","last_deep_scrub":"264'66","last_deep_scrub_stamp":"2024-09-19T12:03:17.359961+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.359961+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:33.016521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":163,"num_read_kb":1977,"num_write":243,"num_write_kb":1874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.984193+0000","last_change":"2024-09-19T12:03:27.984193+0000","last_active":"2024-09-19T12:03:27.984193+0000","last_peered":"2024-09-19T12:03:27.984193+0000","last_clean":"2024-09-19T12:03:27.984193+0000","last_became_active":"2024-09-19T11:35:33.619372+0000","last_became_peered":"2024-09-19T11:35:33.619372+0000","last_unstale":"2024-09-19T12:03:27.984193+0000","last_undegraded":"2024-09-19T12:03:27.984193+0000","last_fullsized":"2024-09-19T12:03:27.984193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:27.983993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:27.983993+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.983993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:39.204138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'17","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.875181+0000","last_change":"2024-09-19T12:03:21.875042+0000","last_active":"2024-09-19T12:03:21.875181+0000","last_peered":"2024-09-19T12:03:21.875181+0000","last_clean":"2024-09-19T12:03:21.875181+0000","last_became_active":"2024-09-19T11:35:31.584316+0000","last_became_peered":"2024-09-19T11:35:31.584316+0000","last_unstale":"2024-09-19T12:03:21.875181+0000","last_undegraded":"2024-09-19T12:03:21.875181+0000","last_fullsized":"2024-09-19T12:03:21.875181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-19T12:03:21.874788+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-19T12:03:21.874788+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.874788+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:13:03.876466+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079915,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":1065,"num_write":66,"num_write_kb":1060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.233496+0000","last_change":"2024-09-19T12:03:25.233496+0000","last_active":"2024-09-19T12:03:25.233496+0000","last_peered":"2024-09-19T12:03:25.233496+0000","last_clean":"2024-09-19T12:03:25.233496+0000","last_became_active":"2024-09-19T11:35:33.626872+0000","last_became_peered":"2024-09-19T11:35:33.626872+0000","last_unstale":"2024-09-19T12:03:25.233496+0000","last_undegraded":"2024-09-19T12:03:25.233496+0000","last_fullsized":"2024-09-19T12:03:25.233496+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:25.233308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:25.233308+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.233308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:10:23.945915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'31","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:15.620767+0000","last_change":"2024-09-19T12:03:15.620612+0000","last_active":"2024-09-19T12:03:15.620767+0000","last_peered":"2024-09-19T12:03:15.620767+0000","last_clean":"2024-09-19T12:03:15.620767+0000","last_became_active":"2024-09-19T11:35:31.591724+0000","last_became_peered":"2024-09-19T11:35:31.591724+0000","last_unstale":"2024-09-19T12:03:15.620767+0000","last_undegraded":"2024-09-19T12:03:15.620767+0000","last_fullsized":"2024-09-19T12:03:15.620767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-19T12:03:15.620320+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-19T12:03:15.620320+0000","last_clean_scrub_stamp":"2024-09-19T12:03:15.620320+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:00.450806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079955,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":62,"num_read_kb":1149,"num_write":140,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'52","reported_seq":568,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:29.005096+0000","last_change":"2024-09-19T12:03:29.005096+0000","last_active":"2024-09-19T12:03:29.005096+0000","last_peered":"2024-09-19T12:03:29.005096+0000","last_clean":"2024-09-19T12:03:29.005096+0000","last_became_active":"2024-09-19T11:35:33.614316+0000","last_became_peered":"2024-09-19T11:35:33.614316+0000","last_unstale":"2024-09-19T12:03:29.005096+0000","last_undegraded":"2024-09-19T12:03:29.005096+0000","last_fullsized":"2024-09-19T12:03:29.005096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-19T12:03:29.004884+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-19T12:03:29.004884+0000","last_clean_scrub_stamp":"2024-09-19T12:03:29.004884+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:13.358873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":175,"num_write":74,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'46","reported_seq":566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:13.008428+0000","last_change":"2024-09-19T12:03:13.008163+0000","last_active":"2024-09-19T12:03:13.008428+0000","last_peered":"2024-09-19T12:03:13.008428+0000","last_clean":"2024-09-19T12:03:13.008428+0000","last_became_active":"2024-09-19T11:35:31.612367+0000","last_became_peered":"2024-09-19T11:35:31.612367+0000","last_unstale":"2024-09-19T12:03:13.008428+0000","last_undegraded":"2024-09-19T12:03:13.008428+0000","last_fullsized":"2024-09-19T12:03:13.008428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'46","last_scrub_stamp":"2024-09-19T12:03:13.007880+0000","last_deep_scrub":"264'46","last_deep_scrub_stamp":"2024-09-19T12:03:13.007880+0000","last_clean_scrub_stamp":"2024-09-19T12:03:13.007880+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:16.799470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":319,"num_write":186,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"262'50","reported_seq":549,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:22.137052+0000","last_change":"2024-09-19T12:03:22.137052+0000","last_active":"2024-09-19T12:03:22.137052+0000","last_peered":"2024-09-19T12:03:22.137052+0000","last_clean":"2024-09-19T12:03:22.137052+0000","last_became_active":"2024-09-19T11:35:33.625249+0000","last_became_peered":"2024-09-19T11:35:33.625249+0000","last_unstale":"2024-09-19T12:03:22.137052+0000","last_undegraded":"2024-09-19T12:03:22.137052+0000","last_fullsized":"2024-09-19T12:03:22.137052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'50","last_scrub_stamp":"2024-09-19T12:03:22.136758+0000","last_deep_scrub":"262'50","last_deep_scrub_stamp":"2024-09-19T12:03:22.136758+0000","last_clean_scrub_stamp":"2024-09-19T12:03:22.136758+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:25.098457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":159,"num_write":74,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'52","reported_seq":577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.868423+0000","last_change":"2024-09-19T12:03:16.868272+0000","last_active":"2024-09-19T12:03:16.868423+0000","last_peered":"2024-09-19T12:03:16.868423+0000","last_clean":"2024-09-19T12:03:16.868423+0000","last_became_active":"2024-09-19T11:35:31.588705+0000","last_became_peered":"2024-09-19T11:35:31.588705+0000","last_unstale":"2024-09-19T12:03:16.868423+0000","last_undegraded":"2024-09-19T12:03:16.868423+0000","last_fullsized":"2024-09-19T12:03:16.868423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'52","last_scrub_stamp":"2024-09-19T12:03:16.868041+0000","last_deep_scrub":"264'52","last_deep_scrub_stamp":"2024-09-19T12:03:16.868041+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.868041+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:40.261460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":83,"num_read_kb":4157,"num_write":184,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'73","reported_seq":579,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.347834+0000","last_change":"2024-09-19T12:03:25.347586+0000","last_active":"2024-09-19T12:03:25.347834+0000","last_peered":"2024-09-19T12:03:25.347834+0000","last_clean":"2024-09-19T12:03:25.347834+0000","last_became_active":"2024-09-19T11:35:33.625874+0000","last_became_peered":"2024-09-19T11:35:33.625874+0000","last_unstale":"2024-09-19T12:03:25.347834+0000","last_undegraded":"2024-09-19T12:03:25.347834+0000","last_fullsized":"2024-09-19T12:03:25.347834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'73","last_scrub_stamp":"2024-09-19T12:03:25.347361+0000","last_deep_scrub":"264'73","last_deep_scrub_stamp":"2024-09-19T12:03:25.347361+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.347361+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:09.483565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":214,"num_write":124,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'30","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:18.538735+0000","last_change":"2024-09-19T12:03:18.538592+0000","last_active":"2024-09-19T12:03:18.538735+0000","last_peered":"2024-09-19T12:03:18.538735+0000","last_clean":"2024-09-19T12:03:18.538735+0000","last_became_active":"2024-09-19T11:35:31.593067+0000","last_became_peered":"2024-09-19T11:35:31.593067+0000","last_unstale":"2024-09-19T12:03:18.538735+0000","last_undegraded":"2024-09-19T12:03:18.538735+0000","last_fullsized":"2024-09-19T12:03:18.538735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-19T12:03:18.538359+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-19T12:03:18.538359+0000","last_clean_scrub_stamp":"2024-09-19T12:03:18.538359+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:10.521160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079937,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":48,"num_read_kb":1085,"num_write":114,"num_write_kb":1065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.194013+0000","last_change":"2024-09-19T12:03:27.193871+0000","last_active":"2024-09-19T12:03:27.194013+0000","last_peered":"2024-09-19T12:03:27.194013+0000","last_clean":"2024-09-19T12:03:27.194013+0000","last_became_active":"2024-09-19T11:35:33.612924+0000","last_became_peered":"2024-09-19T11:35:33.612924+0000","last_unstale":"2024-09-19T12:03:27.194013+0000","last_undegraded":"2024-09-19T12:03:27.194013+0000","last_fullsized":"2024-09-19T12:03:27.194013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:27.193693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:27.193693+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.193693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:06.323463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'63","reported_seq":584,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:17.823681+0000","last_change":"2024-09-19T12:03:17.823681+0000","last_active":"2024-09-19T12:03:17.823681+0000","last_peered":"2024-09-19T12:03:17.823681+0000","last_clean":"2024-09-19T12:03:17.823681+0000","last_became_active":"2024-09-19T11:35:31.581058+0000","last_became_peered":"2024-09-19T11:35:31.581058+0000","last_unstale":"2024-09-19T12:03:17.823681+0000","last_undegraded":"2024-09-19T12:03:17.823681+0000","last_fullsized":"2024-09-19T12:03:17.823681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'63","last_scrub_stamp":"2024-09-19T12:03:17.823463+0000","last_deep_scrub":"264'63","last_deep_scrub_stamp":"2024-09-19T12:03:17.823463+0000","last_clean_scrub_stamp":"2024-09-19T12:03:17.823463+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:53.718849+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":310,"num_write":200,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'63","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.277810+0000","last_change":"2024-09-19T12:03:21.277810+0000","last_active":"2024-09-19T12:03:21.277810+0000","last_peered":"2024-09-19T12:03:21.277810+0000","last_clean":"2024-09-19T12:03:21.277810+0000","last_became_active":"2024-09-19T11:35:33.628335+0000","last_became_peered":"2024-09-19T11:35:33.628335+0000","last_unstale":"2024-09-19T12:03:21.277810+0000","last_undegraded":"2024-09-19T12:03:21.277810+0000","last_fullsized":"2024-09-19T12:03:21.277810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'63","last_scrub_stamp":"2024-09-19T12:03:21.277541+0000","last_deep_scrub":"264'63","last_deep_scrub_stamp":"2024-09-19T12:03:21.277541+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.277541+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:40:38.808707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":184,"num_write":116,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'40","reported_seq":560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:19.501988+0000","last_change":"2024-09-19T12:03:19.501988+0000","last_active":"2024-09-19T12:03:19.501988+0000","last_peered":"2024-09-19T12:03:19.501988+0000","last_clean":"2024-09-19T12:03:19.501988+0000","last_became_active":"2024-09-19T11:35:31.623733+0000","last_became_peered":"2024-09-19T11:35:31.623733+0000","last_unstale":"2024-09-19T12:03:19.501988+0000","last_undegraded":"2024-09-19T12:03:19.501988+0000","last_fullsized":"2024-09-19T12:03:19.501988+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-19T12:03:19.501752+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-19T12:03:19.501752+0000","last_clean_scrub_stamp":"2024-09-19T12:03:19.501752+0000","objects_scrubbed":9,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:34.279646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159904,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":74,"num_read_kb":2163,"num_write":163,"num_write_kb":2120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'86","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.191248+0000","last_change":"2024-09-19T12:03:26.191248+0000","last_active":"2024-09-19T12:03:26.191248+0000","last_peered":"2024-09-19T12:03:26.191248+0000","last_clean":"2024-09-19T12:03:26.191248+0000","last_became_active":"2024-09-19T11:35:33.628184+0000","last_became_peered":"2024-09-19T11:35:33.628184+0000","last_unstale":"2024-09-19T12:03:26.191248+0000","last_undegraded":"2024-09-19T12:03:26.191248+0000","last_fullsized":"2024-09-19T12:03:26.191248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'86","last_scrub_stamp":"2024-09-19T12:03:26.191061+0000","last_deep_scrub":"264'86","last_deep_scrub_stamp":"2024-09-19T12:03:26.191061+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.191061+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:52.403398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":344,"num_read_kb":269,"num_write":142,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'57","reported_seq":579,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:16.379290+0000","last_change":"2024-09-19T12:03:16.379290+0000","last_active":"2024-09-19T12:03:16.379290+0000","last_peered":"2024-09-19T12:03:16.379290+0000","last_clean":"2024-09-19T12:03:16.379290+0000","last_became_active":"2024-09-19T11:35:31.612601+0000","last_became_peered":"2024-09-19T11:35:31.612601+0000","last_unstale":"2024-09-19T12:03:16.379290+0000","last_undegraded":"2024-09-19T12:03:16.379290+0000","last_fullsized":"2024-09-19T12:03:16.379290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'57","last_scrub_stamp":"2024-09-19T12:03:16.379072+0000","last_deep_scrub":"264'57","last_deep_scrub_stamp":"2024-09-19T12:03:16.379072+0000","last_clean_scrub_stamp":"2024-09-19T12:03:16.379072+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:19.650443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":6286,"num_write":172,"num_write_kb":11381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'7","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:26.404056+0000","last_change":"2024-09-19T12:03:26.404056+0000","last_active":"2024-09-19T12:03:26.404056+0000","last_peered":"2024-09-19T12:03:26.404056+0000","last_clean":"2024-09-19T12:03:26.404056+0000","last_became_active":"2024-09-19T11:35:33.624149+0000","last_became_peered":"2024-09-19T11:35:33.624149+0000","last_unstale":"2024-09-19T12:03:26.404056+0000","last_undegraded":"2024-09-19T12:03:26.404056+0000","last_fullsized":"2024-09-19T12:03:26.404056+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-19T12:03:26.403849+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-19T12:03:26.403849+0000","last_clean_scrub_stamp":"2024-09-19T12:03:26.403849+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:14.799208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'34","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.999808+0000","last_change":"2024-09-19T12:03:14.999808+0000","last_active":"2024-09-19T12:03:14.999808+0000","last_peered":"2024-09-19T12:03:14.999808+0000","last_clean":"2024-09-19T12:03:14.999808+0000","last_became_active":"2024-09-19T11:35:31.609885+0000","last_became_peered":"2024-09-19T11:35:31.609885+0000","last_unstale":"2024-09-19T12:03:14.999808+0000","last_undegraded":"2024-09-19T12:03:14.999808+0000","last_fullsized":"2024-09-19T12:03:14.999808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-19T12:03:14.999554+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-19T12:03:14.999554+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.999554+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:58.998133+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":83,"num_write":119,"num_write_kb":10337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'127","reported_seq":659,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.363258+0000","last_change":"2024-09-19T12:03:24.363258+0000","last_active":"2024-09-19T12:03:24.363258+0000","last_peered":"2024-09-19T12:03:24.363258+0000","last_clean":"2024-09-19T12:03:24.363258+0000","last_became_active":"2024-09-19T11:35:33.620326+0000","last_became_peered":"2024-09-19T11:35:33.620326+0000","last_unstale":"2024-09-19T12:03:24.363258+0000","last_undegraded":"2024-09-19T12:03:24.363258+0000","last_fullsized":"2024-09-19T12:03:24.363258+0000","mapping_epoch":28,"log_start":"264'100","ondisk_log_start":"264'100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-19T12:03:24.363078+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-19T12:03:24.363078+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.363078+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:58.950026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":393,"num_write":181,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'43","reported_seq":565,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:25.445831+0000","last_change":"2024-09-19T12:03:25.445831+0000","last_active":"2024-09-19T12:03:25.445831+0000","last_peered":"2024-09-19T12:03:25.445831+0000","last_clean":"2024-09-19T12:03:25.445831+0000","last_became_active":"2024-09-19T11:35:31.620566+0000","last_became_peered":"2024-09-19T11:35:31.620566+0000","last_unstale":"2024-09-19T12:03:25.445831+0000","last_undegraded":"2024-09-19T12:03:25.445831+0000","last_fullsized":"2024-09-19T12:03:25.445831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'43","last_scrub_stamp":"2024-09-19T12:03:25.445605+0000","last_deep_scrub":"264'43","last_deep_scrub_stamp":"2024-09-19T12:03:25.445605+0000","last_clean_scrub_stamp":"2024-09-19T12:03:25.445605+0000","objects_scrubbed":8,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:05.496684+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":90,"num_read_kb":69,"num_write":200,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'47","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:33.142570+0000","last_change":"2024-09-19T12:03:33.142570+0000","last_active":"2024-09-19T12:03:33.142570+0000","last_peered":"2024-09-19T12:03:33.142570+0000","last_clean":"2024-09-19T12:03:33.142570+0000","last_became_active":"2024-09-19T11:35:33.618247+0000","last_became_peered":"2024-09-19T11:35:33.618247+0000","last_unstale":"2024-09-19T12:03:33.142570+0000","last_undegraded":"2024-09-19T12:03:33.142570+0000","last_fullsized":"2024-09-19T12:03:33.142570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'47","last_scrub_stamp":"2024-09-19T12:03:33.142416+0000","last_deep_scrub":"264'47","last_deep_scrub_stamp":"2024-09-19T12:03:33.142416+0000","last_clean_scrub_stamp":"2024-09-19T12:03:33.142416+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:37.202857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":141,"num_write":67,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'24","reported_seq":539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.148827+0000","last_change":"2024-09-19T12:03:14.148668+0000","last_active":"2024-09-19T12:03:14.148827+0000","last_peered":"2024-09-19T12:03:14.148827+0000","last_clean":"2024-09-19T12:03:14.148827+0000","last_became_active":"2024-09-19T11:35:31.602248+0000","last_became_peered":"2024-09-19T11:35:31.602248+0000","last_unstale":"2024-09-19T12:03:14.148827+0000","last_undegraded":"2024-09-19T12:03:14.148827+0000","last_fullsized":"2024-09-19T12:03:14.148827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-19T12:03:14.148443+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-19T12:03:14.148443+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.148443+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:02:22.593414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":5134,"num_write":78,"num_write_kb":5127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'37","reported_seq":560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:24.417440+0000","last_change":"2024-09-19T12:03:24.417258+0000","last_active":"2024-09-19T12:03:24.417440+0000","last_peered":"2024-09-19T12:03:24.417440+0000","last_clean":"2024-09-19T12:03:24.417440+0000","last_became_active":"2024-09-19T11:35:33.624412+0000","last_became_peered":"2024-09-19T11:35:33.624412+0000","last_unstale":"2024-09-19T12:03:24.417440+0000","last_undegraded":"2024-09-19T12:03:24.417440+0000","last_fullsized":"2024-09-19T12:03:24.417440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-19T12:03:24.417066+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-19T12:03:24.417066+0000","last_clean_scrub_stamp":"2024-09-19T12:03:24.417066+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:45.238270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":98,"num_write":42,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'30","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:20.465953+0000","last_change":"2024-09-19T12:03:20.465783+0000","last_active":"2024-09-19T12:03:20.465953+0000","last_peered":"2024-09-19T12:03:20.465953+0000","last_clean":"2024-09-19T12:03:20.465953+0000","last_became_active":"2024-09-19T11:35:31.607037+0000","last_became_peered":"2024-09-19T11:35:31.607037+0000","last_unstale":"2024-09-19T12:03:20.465953+0000","last_undegraded":"2024-09-19T12:03:20.465953+0000","last_fullsized":"2024-09-19T12:03:20.465953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-19T12:03:20.465565+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-19T12:03:20.465565+0000","last_clean_scrub_stamp":"2024-09-19T12:03:20.465565+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:53.230652+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":51,"num_read_kb":53,"num_write":115,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'42","reported_seq":562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:21.451199+0000","last_change":"2024-09-19T12:03:21.451050+0000","last_active":"2024-09-19T12:03:21.451199+0000","last_peered":"2024-09-19T12:03:21.451199+0000","last_clean":"2024-09-19T12:03:21.451199+0000","last_became_active":"2024-09-19T11:35:31.607805+0000","last_became_peered":"2024-09-19T11:35:31.607805+0000","last_unstale":"2024-09-19T12:03:21.451199+0000","last_undegraded":"2024-09-19T12:03:21.451199+0000","last_fullsized":"2024-09-19T12:03:21.451199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-09-19T12:03:21.450834+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-09-19T12:03:21.450834+0000","last_clean_scrub_stamp":"2024-09-19T12:03:21.450834+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:38.340283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":66,"num_write":147,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:27.379034+0000","last_change":"2024-09-19T12:03:27.379034+0000","last_active":"2024-09-19T12:03:27.379034+0000","last_peered":"2024-09-19T12:03:27.379034+0000","last_clean":"2024-09-19T12:03:27.379034+0000","last_became_active":"2024-09-19T11:35:33.630100+0000","last_became_peered":"2024-09-19T11:35:33.630100+0000","last_unstale":"2024-09-19T12:03:27.379034+0000","last_undegraded":"2024-09-19T12:03:27.379034+0000","last_fullsized":"2024-09-19T12:03:27.379034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T12:03:27.378846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T12:03:27.378846+0000","last_clean_scrub_stamp":"2024-09-19T12:03:27.378846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:57.992134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'27","reported_seq":538,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:14.640146+0000","last_change":"2024-09-19T12:03:14.640003+0000","last_active":"2024-09-19T12:03:14.640146+0000","last_peered":"2024-09-19T12:03:14.640146+0000","last_clean":"2024-09-19T12:03:14.640146+0000","last_became_active":"2024-09-19T11:35:31.588328+0000","last_became_peered":"2024-09-19T11:35:31.588328+0000","last_unstale":"2024-09-19T12:03:14.640146+0000","last_undegraded":"2024-09-19T12:03:14.640146+0000","last_fullsized":"2024-09-19T12:03:14.640146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-19T12:03:14.639761+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-19T12:03:14.639761+0000","last_clean_scrub_stamp":"2024-09-19T12:03:14.639761+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:57.221214+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":33,"num_write":109,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'233","reported_seq":738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-19T12:03:31.418629+0000","last_change":"2024-09-19T12:03:31.418629+0000","last_active":"2024-09-19T12:03:31.418629+0000","last_peered":"2024-09-19T12:03:31.418629+0000","last_clean":"2024-09-19T12:03:31.418629+0000","last_became_active":"2024-09-19T11:35:33.612152+0000","last_became_peered":"2024-09-19T11:35:33.612152+0000","last_unstale":"2024-09-19T12:03:31.418629+0000","last_undegraded":"2024-09-19T12:03:31.418629+0000","last_fullsized":"2024-09-19T12:03:31.418629+0000","mapping_epoch":28,"log_start":"264'200","ondisk_log_start":"264'200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'233","last_scrub_stamp":"2024-09-19T12:03:31.418441+0000","last_deep_scrub":"264'233","last_deep_scrub_stamp":"2024-09-19T12:03:31.418441+0000","last_clean_scrub_stamp":"2024-09-19T12:03:31.418441+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:47.091951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":962,"num_read_kb":742,"num_write":392,"num_write_kb":213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1228,"num_read_kb":871,"num_write":344,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":8631,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2810,"num_read_kb":2559,"num_write":1797,"num_write_kb":496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1721,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":17262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":732,"ondisk_log_size":732,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":155085,"num_objects":184,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":184,"num_whiteouts":0,"num_read":4671,"num_read_kb":6549,"num_write":3033,"num_write_kb":1354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":49824,"num_omap_keys":122,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2258,"ondisk_log_size":2258,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2082,"num_read_kb":2479,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":14003,"num_read_kb":11442,"num_write":5494,"num_write_kb":2900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35261,"num_omap_keys":142,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2408,"ondisk_log_size":2408,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":28939990,"num_objects":275,"num_object_clones":0,"num_object_copies":1100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":275,"num_whiteouts":0,"num_read":5003,"num_read_kb":236980,"num_write":9889,"num_write_kb":271206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40419328,"data_stored":40419328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2792,"ondisk_log_size":2792,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":114698,"num_write":81,"num_write_kb":65538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":11534336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":120842,"num_write":81,"num_write_kb":65538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542496,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202096,"kb_used_data":8480,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94169744,"statfs":{"total":96636764160,"available":96429817856,"internally_reserved":0,"allocated":8683520,"data_stored":6718512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":198244810},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542495,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":204524,"kb_used_data":10908,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94167316,"statfs":{"total":96636764160,"available":96427331584,"internally_reserved":0,"allocated":11169792,"data_stored":9233803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":198244806},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542496,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58480,"kb_used_data":9248,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313360,"statfs":{"total":96636764160,"available":96576880640,"internally_reserved":0,"allocated":9469952,"data_stored":7492221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542498,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67420,"kb_used_data":9868,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94304420,"statfs":{"total":96636764160,"available":96567726080,"internally_reserved":0,"allocated":10104832,"data_stored":8206396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542496,"num_pgs":122,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":204228,"kb_used_data":10612,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94167612,"statfs":{"total":96636764160,"available":96427634688,"internally_reserved":0,"allocated":10866688,"data_stored":8917533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542496,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56652,"kb_used_data":7420,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94315188,"statfs":{"total":96636764160,"available":96578752512,"internally_reserved":0,"allocated":7598080,"data_stored":5684279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542495,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105560,"kb_used_data":7816,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94266280,"statfs":{"total":96636764160,"available":96528670720,"internally_reserved":0,"allocated":8003584,"data_stored":6065036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542497,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216504,"kb_used_data":9064,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94155336,"statfs":{"total":96636764160,"available":96415064064,"internally_reserved":0,"allocated":9281536,"data_stored":7337278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212400581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4489216,"data_stored":4489216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3809280,"data_stored":3809280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3428352,"data_stored":3428352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6660096,"data_stored":6660096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5951488,"data_stored":5951488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5234688,"data_stored":5234688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6975488,"data_stored":6975488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3870720,"data_stored":3870720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T12:04:14.016 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-19T12:04:14.378 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-19T12:04:14.379 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-19T12:04:14.379 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-19T12:04:14.379 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T12:04:14.469 INFO:tasks.ceph.osd.0:Stopped 2024-09-19T12:04:14.469 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-19T12:04:14.469 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T12:04:14.534 INFO:tasks.ceph.osd.1:Stopped 2024-09-19T12:04:14.535 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-19T12:04:14.535 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T12:04:14.618 INFO:tasks.ceph.osd.2:Stopped 2024-09-19T12:04:14.619 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-19T12:04:14.619 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T12:04:18.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-19T12:04:20.721 INFO:tasks.ceph.osd.3:Stopped 2024-09-19T12:04:20.722 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-19T12:04:20.722 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T12:04:20.804 INFO:tasks.ceph.osd.4:Stopped 2024-09-19T12:04:20.804 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-19T12:04:20.804 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T12:04:20.896 INFO:tasks.ceph.osd.5:Stopped 2024-09-19T12:04:20.897 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-19T12:04:20.897 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T12:04:23.795 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-19T12:04:23.795 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-19T12:04:27.001 INFO:tasks.ceph.osd.6:Stopped 2024-09-19T12:04:27.002 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-19T12:04:27.002 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T12:04:27.084 INFO:tasks.ceph.osd.7:Stopped 2024-09-19T12:04:27.085 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-19T12:04:27.085 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-19T12:04:27.085 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T12:04:27.116 INFO:tasks.ceph.mgr.y:Stopped 2024-09-19T12:04:27.117 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-19T12:04:27.117 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T12:04:27.149 INFO:tasks.ceph.mgr.x:Stopped 2024-09-19T12:04:27.149 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-19T12:04:27.150 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-19T12:04:27.150 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T12:04:27.177 INFO:tasks.ceph.mon.a:Stopped 2024-09-19T12:04:27.177 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-19T12:04:27.178 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T12:04:27.240 INFO:tasks.ceph.mon.c:Stopped 2024-09-19T12:04:27.241 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-19T12:04:27.241 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T12:04:27.260 INFO:tasks.ceph.mon.b:Stopped 2024-09-19T12:04:27.260 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-19T12:04:27.260 DEBUG:teuthology.orchestra.run.smithi120:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-19T12:04:27.299 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T12:04:27.299 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-19T12:04:27.926 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T12:04:27.926 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-19T12:04:28.138 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T12:04:28.139 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-19T12:04:28.302 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T12:04:28.303 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-19T12:04:28.460 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-19T12:04:28.460 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-19T12:04:28.689 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-19T12:04:28.689 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-19T12:04:28.796 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-19T12:04:28.868 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-19T12:04:28.869 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-19T12:04:29.046 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-19T12:04:29.046 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-19T12:04:29.224 INFO:tasks.ceph:Archiving mon data... 2024-09-19T12:04:29.225 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912444/data/mon.a.tgz 2024-09-19T12:04:29.225 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-19T12:04:29.231 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.zVAzq30ioY 2024-09-19T12:04:29.232 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.zVAzq30ioY 2024-09-19T12:04:29.393 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.zVAzq30ioY 2024-09-19T12:04:29.453 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.zVAzq30ioY is 442KB 2024-09-19T12:04:29.516 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.zVAzq30ioY 2024-09-19T12:04:29.521 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912444/data/mon.c.tgz 2024-09-19T12:04:29.521 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-19T12:04:29.569 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.opaOMwTN6e 2024-09-19T12:04:29.570 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.opaOMwTN6e 2024-09-19T12:04:29.743 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.opaOMwTN6e 2024-09-19T12:04:29.809 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.opaOMwTN6e is 456KB 2024-09-19T12:04:29.871 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.opaOMwTN6e 2024-09-19T12:04:29.876 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912444/data/mon.b.tgz 2024-09-19T12:04:29.876 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-09-19T12:04:29.882 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.DzOKaDaPyc 2024-09-19T12:04:29.883 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.DzOKaDaPyc 2024-09-19T12:04:30.051 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.DzOKaDaPyc 2024-09-19T12:04:30.113 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.DzOKaDaPyc is 456KB 2024-09-19T12:04:30.173 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.DzOKaDaPyc 2024-09-19T12:04:30.178 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-19T12:04:30.179 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T12:04:30.181 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T12:04:30.241 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T12:04:30.284 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T12:04:30.284 INFO:tasks.ceph:Archiving crash dumps... 2024-09-19T12:04:30.286 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/crash to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912444/remote/smithi120/crash 2024-09-19T12:04:30.286 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T12:04:30.299 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912444/remote/smithi151/crash 2024-09-19T12:04:30.300 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T12:04:30.339 INFO:tasks.ceph:Compressing logs... 2024-09-19T12:04:30.339 DEBUG:teuthology.orchestra.run.smithi120:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T12:04:30.346 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T12:04:30.365 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154135.log 2024-09-19T12:04:30.369 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68904.log 2024-09-19T12:04:30.369 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.154135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32037.log 2024-09-19T12:04:30.369 INFO:teuthology.orchestra.run.smithi120.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.154135.log.gz 2024-09-19T12:04:30.369 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.68904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149393.log 2024-09-19T12:04:30.369 INFO:teuthology.orchestra.run.smithi120.stderr: 25.9% -- replaced with /var/log/ceph/ceph-client.admin.68904.log.gz 2024-09-19T12:04:30.370 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42864.log 2024-09-19T12:04:30.370 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32037.log.gz 2024-09-19T12:04:30.370 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.149393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61192.log 2024-09-19T12:04:30.370 INFO:teuthology.orchestra.run.smithi120.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.149393.log.gz 2024-09-19T12:04:30.370 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.42864.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-19T12:04:30.370 INFO:teuthology.orchestra.run.smithi120.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.42864.log.gz 2024-09-19T12:04:30.370 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32712.log 2024-09-19T12:04:30.370 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51814.log 2024-09-19T12:04:30.370 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32712.log.gz 2024-09-19T12:04:30.371 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86850.log 2024-09-19T12:04:30.374 INFO:teuthology.orchestra.run.smithi120.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.61192.log.gz 2024-09-19T12:04:30.374 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111633.log 2024-09-19T12:04:30.374 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51814.log: /var/log/ceph/ceph-client.admin.86850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31959.log 2024-09-19T12:04:30.374 INFO:teuthology.orchestra.run.smithi120.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.51814.log.gz 2024-09-19T12:04:30.375 INFO:teuthology.orchestra.run.smithi120.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.86850.log.gz 2024-09-19T12:04:30.375 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.111633.log: 82.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.111633.log.gz 2024-09-19T12:04:30.375 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.100420.log 2024-09-19T12:04:30.375 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.31959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84490.log 2024-09-19T12:04:30.375 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31959.log.gz 2024-09-19T12:04:30.376 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.100420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55501.log 2024-09-19T12:04:30.376 INFO:teuthology.orchestra.run.smithi120.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.100420.log.gz 2024-09-19T12:04:30.376 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.84490.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57966.log 2024-09-19T12:04:30.376 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55501.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.84490.log.gz 2024-09-19T12:04:30.376 INFO:teuthology.orchestra.run.smithi120.stderr: 59.1% -- replaced with /var/log/ceph/ceph-client.admin.55501.log.gz 2024-09-19T12:04:30.377 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53609.log 2024-09-19T12:04:30.377 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.57966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91570.log 2024-09-19T12:04:30.377 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.53609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53609.log.gz 2024-09-19T12:04:30.377 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-19T12:04:30.377 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32290.log 2024-09-19T12:04:30.377 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.91570.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.57966.log.gz 2024-09-19T12:04:30.377 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50584.log 2024-09-19T12:04:30.377 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32290.log.gz 2024-09-19T12:04:30.377 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157750.log 2024-09-19T12:04:30.393 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51224.log 2024-09-19T12:04:30.393 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.50584.log: /var/log/ceph/ceph-client.admin.157750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157750.log.gz 2024-09-19T12:04:30.394 INFO:teuthology.orchestra.run.smithi120.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.91570.log.gz 2024-09-19T12:04:30.394 INFO:teuthology.orchestra.run.smithi120.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.50584.log.gz 2024-09-19T12:04:30.394 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56730.log 2024-09-19T12:04:30.394 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157775.log 2024-09-19T12:04:30.394 INFO:teuthology.orchestra.run.smithi120.stderr: 80.8%/var/log/ceph/ceph-client.admin.56730.log: -- replaced with /var/log/ceph/ceph-client.admin.51224.log.gz 2024-09-19T12:04:30.394 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54224.log 2024-09-19T12:04:30.394 INFO:teuthology.orchestra.run.smithi120.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.56730.log.gz 2024-09-19T12:04:30.394 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.157775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71507.log 2024-09-19T12:04:30.395 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54224.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.157775.log.gz 2024-09-19T12:04:30.395 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32971.log 2024-09-19T12:04:30.395 INFO:teuthology.orchestra.run.smithi120.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.54224.log.gz 2024-09-19T12:04:30.395 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.71507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32090.log 2024-09-19T12:04:30.395 INFO:teuthology.orchestra.run.smithi120.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.71507.log.gz 2024-09-19T12:04:30.395 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32971.log.gz 2024-09-19T12:04:30.395 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69546.log 2024-09-19T12:04:30.395 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125793.log 2024-09-19T12:04:30.396 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32090.log.gz 2024-09-19T12:04:30.396 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.69546.log: 84.7% -- replaced with /var/log/ceph/ceph-client.0.69546.log.gz 2024-09-19T12:04:30.396 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35453.log 2024-09-19T12:04:30.396 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67132.log 2024-09-19T12:04:30.396 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.125793.log: /var/log/ceph/ceph-client.0.35453.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.125793.log.gz 2024-09-19T12:04:30.397 INFO:teuthology.orchestra.run.smithi120.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.0.35453.log.gz 2024-09-19T12:04:30.397 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32947.log 2024-09-19T12:04:30.397 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92750.log 2024-09-19T12:04:30.397 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.67132.log: /var/log/ceph/ceph-client.admin.32947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32947.log.gz 2024-09-19T12:04:30.397 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33071.log 2024-09-19T12:04:30.397 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-19T12:04:30.397 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.92750.log: /var/log/ceph/ceph-client.admin.33071.log: 81.6% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.92750.log.gz -- replaced with /var/log/ceph/ceph-client.admin.33071.log.gz 2024-09-19T12:04:30.397 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-19T12:04:30.398 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32502.log 2024-09-19T12:04:30.398 INFO:teuthology.orchestra.run.smithi120.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67132.log.gz 2024-09-19T12:04:30.398 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21905.log 2024-09-19T12:04:30.398 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32502.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.32502.log.gz -- 2024-09-19T12:04:30.398 INFO:teuthology.orchestra.run.smithi120.stderr: /var/log/ceph/ceph-client.admin.160835.log 2024-09-19T12:04:30.398 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32288.log/var/log/ceph/ceph.tmp-client.admin.21905.log: 2024-09-19T12:04:30.398 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21905.log.gz 2024-09-19T12:04:30.399 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160835.log.gz 2024-09-19T12:04:30.399 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32717.log 2024-09-19T12:04:30.399 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32272.log 2024-09-19T12:04:30.399 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32288.log.gz 2024-09-19T12:04:30.399 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32717.log.gz 2024-09-19T12:04:30.399 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101602.log 2024-09-19T12:04:30.399 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152955.log 2024-09-19T12:04:30.399 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32272.log.gz 2024-09-19T12:04:30.400 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.101602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98060.log 2024-09-19T12:04:30.400 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101602.log.gz 2024-09-19T12:04:30.400 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.152955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144673.log 2024-09-19T12:04:30.400 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.98060.log: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.152955.log.gz 2024-09-19T12:04:30.400 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37211.log 2024-09-19T12:04:30.400 INFO:teuthology.orchestra.run.smithi120.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.98060.log.gz 2024-09-19T12:04:30.400 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32507.log 2024-09-19T12:04:30.400 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.144673.log: gzip -5/var/log/ceph/ceph-client.0.37211.log: --verbose -- /var/log/ceph/ceph-client.admin.26943.log 2024-09-19T12:04:30.400 INFO:teuthology.orchestra.run.smithi120.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.144673.log.gz 2024-09-19T12:04:30.401 INFO:teuthology.orchestra.run.smithi120.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.37211.log.gz 2024-09-19T12:04:30.401 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32507.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.32507.log.gz -- 2024-09-19T12:04:30.401 INFO:teuthology.orchestra.run.smithi120.stderr: /var/log/ceph/ceph-client.admin.134643.log 2024-09-19T12:04:30.401 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.26943.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.32716.log -- replaced with /var/log/ceph/ceph-client.admin.26943.log.gz 2024-09-19T12:04:30.401 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-19T12:04:30.401 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141723.log 2024-09-19T12:04:30.401 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.134643.log: /var/log/ceph/ceph-client.admin.32716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32716.log.gz 2024-09-19T12:04:30.402 INFO:teuthology.orchestra.run.smithi120.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.134643.log.gz 2024-09-19T12:04:30.402 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34866.log 2024-09-19T12:04:30.402 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32083.log 2024-09-19T12:04:30.402 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.141723.log: /var/log/ceph/ceph-client.0.34866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94520.log 2024-09-19T12:04:30.402 INFO:teuthology.orchestra.run.smithi120.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.0.34866.log.gz 2024-09-19T12:04:30.402 INFO:teuthology.orchestra.run.smithi120.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.141723.log.gz 2024-09-19T12:04:30.402 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32498.log 2024-09-19T12:04:30.402 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32083.log.gz 2024-09-19T12:04:30.403 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.94520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32501.log 2024-09-19T12:04:30.403 INFO:teuthology.orchestra.run.smithi120.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.94520.log.gz 2024-09-19T12:04:30.403 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45249.log 2024-09-19T12:04:30.403 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32498.log.gz 2024-09-19T12:04:30.403 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32501.log.gz 2024-09-19T12:04:30.403 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32082.log 2024-09-19T12:04:30.403 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26697.log 2024-09-19T12:04:30.403 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45249.log.gz 2024-09-19T12:04:30.404 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32082.log.gz 2024-09-19T12:04:30.404 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158956.log 2024-09-19T12:04:30.404 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45864.log 2024-09-19T12:04:30.404 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.26697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26697.log.gz 2024-09-19T12:04:30.404 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.158956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58611.log 2024-09-19T12:04:30.404 INFO:teuthology.orchestra.run.smithi120.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.158956.log.gz 2024-09-19T12:04:30.404 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160733.log 2024-09-19T12:04:30.404 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.58611.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.45864.log.gz 2024-09-19T12:04:30.404 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41044.log 2024-09-19T12:04:30.427 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26731.log 2024-09-19T12:04:30.427 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26683.log 2024-09-19T12:04:30.427 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.26731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26803.log 2024-09-19T12:04:30.427 INFO:teuthology.orchestra.run.smithi151.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26731.log.gz 2024-09-19T12:04:30.427 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.26683.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-19T12:04:30.427 INFO:teuthology.orchestra.run.smithi151.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26683.log.gz 2024-09-19T12:04:30.428 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.26803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26827.log 2024-09-19T12:04:30.428 INFO:teuthology.orchestra.run.smithi151.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26803.log.gz 2024-09-19T12:04:30.428 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-19T12:04:30.428 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.26827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26827.log.gz 2024-09-19T12:04:30.428 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26707.log 2024-09-19T12:04:30.428 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26755.log 2024-09-19T12:04:30.429 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.26707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26707.log.gz 2024-09-19T12:04:30.429 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-19T12:04:30.429 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.26755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26851.log 2024-09-19T12:04:30.429 INFO:teuthology.orchestra.run.smithi151.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26755.log.gz 2024-09-19T12:04:30.429 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26779.log 2024-09-19T12:04:30.429 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.26851.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-19T12:04:30.429 INFO:teuthology.orchestra.run.smithi151.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26851.log.gz 2024-09-19T12:04:30.429 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.26779.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T12:04:30.430 INFO:teuthology.orchestra.run.smithi151.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26779.log.gz 2024-09-19T12:04:30.430 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T12:04:30.430 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-19T12:04:30.430 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-19T12:04:30.430 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T12:04:30.430 INFO:teuthology.orchestra.run.smithi151.stderr: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T12:04:30.451 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32995.log 2024-09-19T12:04:30.451 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160733.log: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-19T12:04:30.451 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160733.log.gz 2024-09-19T12:04:30.452 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.41044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67722.log 2024-09-19T12:04:30.452 INFO:teuthology.orchestra.run.smithi120.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.41044.log.gz 2024-09-19T12:04:30.452 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119893.log 2024-09-19T12:04:30.452 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32995.log.gz 2024-09-19T12:04:30.452 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.67722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41634.log 2024-09-19T12:04:30.452 INFO:teuthology.orchestra.run.smithi120.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.67722.log.gz 2024-09-19T12:04:30.452 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.119893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64417.log 2024-09-19T12:04:30.453 INFO:teuthology.orchestra.run.smithi120.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.119893.log.gz 2024-09-19T12:04:30.453 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.41634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128743.log 2024-09-19T12:04:30.453 INFO:teuthology.orchestra.run.smithi120.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.41634.log.gz 2024-09-19T12:04:30.453 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.64417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56002.log 2024-09-19T12:04:30.453 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.128743.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-19T12:04:30.453 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.128743.log.gz 2024-09-19T12:04:30.453 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.56002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145853.log 2024-09-19T12:04:30.453 INFO:teuthology.orchestra.run.smithi120.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.56002.log.gz 2024-09-19T12:04:30.453 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89800.log 2024-09-19T12:04:30.454 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.145853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160603.log 2024-09-19T12:04:30.454 INFO:teuthology.orchestra.run.smithi120.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.145853.log.gz/var/log/ceph/ceph-client.admin.89800.log: 2024-09-19T12:04:30.454 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137593.log 2024-09-19T12:04:30.454 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89800.log.gz 2024-09-19T12:04:30.454 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160603.log: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.58611.log.gz 2024-09-19T12:04:30.454 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160603.log.gz 2024-09-19T12:04:30.454 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126973.log 2024-09-19T12:04:30.454 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.137593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31889.log 2024-09-19T12:04:30.454 INFO:teuthology.orchestra.run.smithi120.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.137593.log.gz 2024-09-19T12:04:30.455 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96880.log 2024-09-19T12:04:30.455 INFO:teuthology.orchestra.run.smithi120.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.64417.log.gz 2024-09-19T12:04:30.455 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.31889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160421.log 2024-09-19T12:04:30.455 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31889.log.gz 2024-09-19T12:04:30.455 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144083.log 2024-09-19T12:04:30.455 INFO:teuthology.orchestra.run.smithi120.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.96880.log.gz 2024-09-19T12:04:30.455 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143493.log 2024-09-19T12:04:30.455 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160421.log.gz 2024-09-19T12:04:30.455 INFO:teuthology.orchestra.run.smithi120.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.126973.log.gz 2024-09-19T12:04:30.456 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.144083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39749.log 2024-09-19T12:04:30.456 INFO:teuthology.orchestra.run.smithi120.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.144083.log.gz 2024-09-19T12:04:30.456 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.143493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160473.log 2024-09-19T12:04:30.456 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.39749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82130.log 2024-09-19T12:04:30.456 INFO:teuthology.orchestra.run.smithi120.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.39749.log.gz 2024-09-19T12:04:30.456 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36043.log 2024-09-19T12:04:30.456 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160473.log.gz 2024-09-19T12:04:30.456 INFO:teuthology.orchestra.run.smithi120.stderr: 86.4%/var/log/ceph/ceph-client.admin.82130.log: -- replaced with /var/log/ceph/ceph-client.admin.143493.log.gz 2024-09-19T12:04:30.456 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147623.log 2024-09-19T12:04:30.457 INFO:teuthology.orchestra.run.smithi120.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.82130.log.gz 2024-09-19T12:04:30.457 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.36043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151753.log 2024-09-19T12:04:30.457 INFO:teuthology.orchestra.run.smithi120.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.36043.log.gz 2024-09-19T12:04:30.457 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.147623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32479.log 2024-09-19T12:04:30.457 INFO:teuthology.orchestra.run.smithi120.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.147623.log.gz 2024-09-19T12:04:30.457 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.151753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111043.log 2024-09-19T12:04:30.457 INFO:teuthology.orchestra.run.smithi120.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.151753.log.gz 2024-09-19T12:04:30.457 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-19T12:04:30.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32479.log.gz 2024-09-19T12:04:30.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.111043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83310.log 2024-09-19T12:04:30.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mon.a.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111043.log.gz 2024-09-19T12:04:30.458 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139363.log 2024-09-19T12:04:30.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.83310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156545.log 2024-09-19T12:04:30.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.139363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103962.log 2024-09-19T12:04:30.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.156545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160239.log 2024-09-19T12:04:30.459 INFO:teuthology.orchestra.run.smithi120.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.156545.log.gz 2024-09-19T12:04:30.459 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.103962.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.83310.log.gz 2024-09-19T12:04:30.459 INFO:teuthology.orchestra.run.smithi120.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.103962.log.gz 2024-09-19T12:04:30.459 INFO:teuthology.orchestra.run.smithi120.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.139363.log.gz 2024-09-19T12:04:30.459 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90390.log 2024-09-19T12:04:30.459 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126383.log 2024-09-19T12:04:30.459 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160239.log.gz 2024-09-19T12:04:30.459 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.90390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45274.log 2024-09-19T12:04:30.459 INFO:teuthology.orchestra.run.smithi120.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.90390.log.gz 2024-09-19T12:04:30.459 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78590.log 2024-09-19T12:04:30.460 INFO:teuthology.orchestra.run.smithi120.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.126383.log.gz 2024-09-19T12:04:30.460 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72097.log 2024-09-19T12:04:30.460 INFO:teuthology.orchestra.run.smithi120.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.45274.log.gz 2024-09-19T12:04:30.460 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.78590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105732.log 2024-09-19T12:04:30.460 INFO:teuthology.orchestra.run.smithi120.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.78590.log.gz 2024-09-19T12:04:30.460 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.72097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134053.log 2024-09-19T12:04:30.460 INFO:teuthology.orchestra.run.smithi120.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.72097.log.gz 2024-09-19T12:04:30.460 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.105732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32299.log 2024-09-19T12:04:30.461 INFO:teuthology.orchestra.run.smithi120.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.105732.log.gz 2024-09-19T12:04:30.461 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.134053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137003.log 2024-09-19T12:04:30.461 INFO:teuthology.orchestra.run.smithi120.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.134053.log.gz 2024-09-19T12:04:30.461 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40454.log 2024-09-19T12:04:30.461 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32299.log.gz 2024-09-19T12:04:30.461 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.137003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160785.log 2024-09-19T12:04:30.461 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.137003.log.gz 2024-09-19T12:04:30.461 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.40454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46454.log 2024-09-19T12:04:30.462 INFO:teuthology.orchestra.run.smithi120.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.40454.log.gz 2024-09-19T12:04:30.462 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.160785.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66540.log 2024-09-19T12:04:30.462 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160785.log.gz 2024-09-19T12:04:30.462 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.46454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109273.log 2024-09-19T12:04:30.462 INFO:teuthology.orchestra.run.smithi120.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.46454.log.gz 2024-09-19T12:04:30.462 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.66540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155905.log 2024-09-19T12:04:30.462 INFO:teuthology.orchestra.run.smithi120.stderr: 84.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112223.log 2024-09-19T12:04:30.463 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.109273.log: -- replaced with /var/log/ceph/ceph-client.admin.66540.log.gz 2024-09-19T12:04:30.463 INFO:teuthology.orchestra.run.smithi120.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.109273.log.gz 2024-09-19T12:04:30.463 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.155905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85080.log 2024-09-19T12:04:30.463 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155905.log.gz 2024-09-19T12:04:30.463 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160525.log 2024-09-19T12:04:30.463 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.112223.log: /var/log/ceph/ceph-client.admin.85080.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.112223.log.gz 2024-09-19T12:04:30.463 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97470.log 2024-09-19T12:04:30.463 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160525.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88620.log 2024-09-19T12:04:30.463 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.85080.log.gz 2024-09-19T12:04:30.464 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.160525.log.gz 2024-09-19T12:04:30.464 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.97470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75050.log 2024-09-19T12:04:30.464 INFO:teuthology.orchestra.run.smithi120.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.97470.log.gz 2024-09-19T12:04:30.464 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.88620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152933.log 2024-09-19T12:04:30.465 INFO:teuthology.orchestra.run.smithi120.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.88620.log.gz 2024-09-19T12:04:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32011.log 2024-09-19T12:04:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.75050.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.75050.log.gz 2024-09-19T12:04:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.152933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112813.log 2024-09-19T12:04:30.465 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152933.log.gz 2024-09-19T12:04:30.465 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108683.log 2024-09-19T12:04:30.465 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32011.log.gz 2024-09-19T12:04:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.112813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160447.log 2024-09-19T12:04:30.466 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112813.log.gz 2024-09-19T12:04:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.108683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56694.log 2024-09-19T12:04:30.466 INFO:teuthology.orchestra.run.smithi120.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.108683.log.gz 2024-09-19T12:04:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138773.log 2024-09-19T12:04:30.466 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160447.log.gz 2024-09-19T12:04:30.466 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.56694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32895.log 2024-09-19T12:04:30.466 INFO:teuthology.orchestra.run.smithi120.stderr: 22.0% -- replaced with /var/log/ceph/ceph-client.admin.56694.log.gz 2024-09-19T12:04:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.138773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93930.log 2024-09-19T12:04:30.467 INFO:teuthology.orchestra.run.smithi120.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.138773.log.gz 2024-09-19T12:04:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160681.log 2024-09-19T12:04:30.467 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32895.log.gz 2024-09-19T12:04:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.93930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78000.log 2024-09-19T12:04:30.467 INFO:teuthology.orchestra.run.smithi120.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.93930.log.gz 2024-09-19T12:04:30.467 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160681.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.160681.log.gz 2024-09-19T12:04:30.467 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-19T12:04:30.468 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.78000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139953.log 2024-09-19T12:04:30.468 INFO:teuthology.orchestra.run.smithi120.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.78000.log.gz 2024-09-19T12:04:30.468 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99240.log 2024-09-19T12:04:30.468 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.139953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160265.log 2024-09-19T12:04:30.468 INFO:teuthology.orchestra.run.smithi120.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.139953.log.gz 2024-09-19T12:04:30.468 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.99240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26847.log 2024-09-19T12:04:30.468 INFO:teuthology.orchestra.run.smithi120.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.99240.log.gz 2024-09-19T12:04:30.469 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43454.log 2024-09-19T12:04:30.469 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160265.log: /var/log/ceph/ceph-client.admin.26847.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61837.log 2024-09-19T12:04:30.469 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.160265.log.gz 2024-09-19T12:04:30.469 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26847.log.gz 2024-09-19T12:04:30.469 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43454.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.43454.log.gz 2024-09-19T12:04:30.470 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42224.log 2024-09-19T12:04:30.470 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.61837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59901.log 2024-09-19T12:04:30.470 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.42224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95700.log 2024-09-19T12:04:30.470 INFO:teuthology.orchestra.run.smithi120.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.42224.log.gz 2024-09-19T12:04:30.470 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132873.log 2024-09-19T12:04:30.471 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.95700.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.95700.log.gz 2024-09-19T12:04:30.471 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149983.log 2024-09-19T12:04:30.471 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.132873.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.132873.log.gz 2024-09-19T12:04:30.472 INFO:teuthology.orchestra.run.smithi120.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.59901.log.gz 2024-09-19T12:04:30.472 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115173.log 2024-09-19T12:04:30.472 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.149983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51174.log 2024-09-19T12:04:30.473 INFO:teuthology.orchestra.run.smithi120.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.149983.log.gz 2024-09-19T12:04:30.473 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.115173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74460.log 2024-09-19T12:04:30.473 INFO:teuthology.orchestra.run.smithi120.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.115173.log.gz/var/log/ceph/ceph-client.admin.51174.log: 2024-09-19T12:04:30.473 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51174.log.gz 2024-09-19T12:04:30.474 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89210.log 2024-09-19T12:04:30.474 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.74460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68956.log 2024-09-19T12:04:30.474 INFO:teuthology.orchestra.run.smithi120.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.74460.log.gz 2024-09-19T12:04:30.474 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.89210.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.89210.log.gz 2024-09-19T12:04:30.475 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70184.log 2024-09-19T12:04:30.475 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68313.log 2024-09-19T12:04:30.475 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.68956.log: /var/log/ceph/ceph-client.admin.70184.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.68956.log.gz 2024-09-19T12:04:30.475 INFO:teuthology.orchestra.run.smithi120.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.70184.log.gz 2024-09-19T12:04:30.476 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110453.log 2024-09-19T12:04:30.476 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.68313.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.68313.log.gz 2024-09-19T12:04:30.476 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147033.log 2024-09-19T12:04:30.476 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32091.log 2024-09-19T12:04:30.477 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.110453.log: /var/log/ceph/ceph-client.admin.147033.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.110453.log.gz 2024-09-19T12:04:30.477 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52404.log 2024-09-19T12:04:30.477 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32091.log.gz 2024-09-19T12:04:30.477 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160317.log 2024-09-19T12:04:30.478 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.52404.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.147033.log.gz 81.2% -- replaced with /var/log/ceph/ceph-client.admin.52404.log.gz 2024-09-19T12:04:30.478 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-19T12:04:30.478 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75640.log 2024-09-19T12:04:30.478 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63772.log 2024-09-19T12:04:30.479 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160317.log.gz 2024-09-19T12:04:30.479 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.75640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79180.log 2024-09-19T12:04:30.479 INFO:teuthology.orchestra.run.smithi120.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.75640.log.gz 2024-09-19T12:04:30.480 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.63772.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63772.log.gz 2024-09-19T12:04:30.480 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-19T12:04:30.480 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160759.log 2024-09-19T12:04:30.480 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.79180.log: /var/log/ceph/ops-log-ceph-client.admin.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.79180.log.gz 2024-09-19T12:04:30.481 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125203.log 2024-09-19T12:04:30.481 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160759.log.gz 2024-09-19T12:04:30.481 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32694.log 2024-09-19T12:04:30.481 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.125203.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125203.log.gz 2024-09-19T12:04:30.482 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-19T12:04:30.482 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32694.log.gz 2024-09-19T12:04:30.482 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53584.log 2024-09-19T12:04:30.483 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.1.log: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-19T12:04:30.483 INFO:teuthology.orchestra.run.smithi120.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.61837.log.gz 2024-09-19T12:04:30.515 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88030.log 2024-09-19T12:04:30.516 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.53584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48814.log 2024-09-19T12:04:30.516 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53584.log.gz 2024-09-19T12:04:30.516 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76820.log 2024-09-19T12:04:30.516 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.88030.log: /var/log/ceph/ceph-client.admin.48814.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88030.log.gz 2024-09-19T12:04:30.516 INFO:teuthology.orchestra.run.smithi120.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.48814.log.gz 2024-09-19T12:04:30.516 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79770.log 2024-09-19T12:04:30.516 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45224.log 2024-09-19T12:04:30.517 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.76820.log: /var/log/ceph/ceph-client.admin.79770.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.76820.log.gz 2024-09-19T12:04:30.517 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.79770.log.gz 2024-09-19T12:04:30.517 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32687.log 2024-09-19T12:04:30.517 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70221.log 2024-09-19T12:04:30.517 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45224.log: /var/log/ceph/ceph-client.admin.32687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45224.log.gz 2024-09-19T12:04:30.517 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32687.log.gz 2024-09-19T12:04:30.517 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72687.log 2024-09-19T12:04:30.517 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108093.log 2024-09-19T12:04:30.518 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.70221.log: /var/log/ceph/ceph-client.admin.72687.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.72687.log.gz 2024-09-19T12:04:30.518 INFO:teuthology.orchestra.run.smithi120.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.70221.log.gz 2024-09-19T12:04:30.518 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93340.log 2024-09-19T12:04:30.518 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32503.log 2024-09-19T12:04:30.518 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.108093.log: /var/log/ceph/ceph-client.admin.93340.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.108093.log.gz 2024-09-19T12:04:30.518 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93340.log.gz 2024-09-19T12:04:30.518 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142903.log 2024-09-19T12:04:30.518 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76230.log 2024-09-19T12:04:30.518 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32503.log.gz 2024-09-19T12:04:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.142903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155930.log 2024-09-19T12:04:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.76230.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.142903.log.gz 2024-09-19T12:04:30.519 INFO:teuthology.orchestra.run.smithi120.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.76230.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131693.log 2024-09-19T12:04:30.519 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-19T12:04:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.155930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32499.log 2024-09-19T12:04:30.519 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0%/var/log/ceph/ceph-client.admin.131693.log: -- replaced with /var/log/ceph/ceph-client.admin.155930.log.gz 2024-09-19T12:04:30.519 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.131693.log.gz 2024-09-19T12:04:30.519 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138183.log 2024-09-19T12:04:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32499.log.gz 2024-09-19T12:04:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33692.log 2024-09-19T12:04:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42839.log 2024-09-19T12:04:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.138183.log: /var/log/ceph/ceph-client.0.33692.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.138183.log.gz 2024-09-19T12:04:30.520 INFO:teuthology.orchestra.run.smithi120.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.33692.log.gz 2024-09-19T12:04:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49404.log 2024-09-19T12:04:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116943.log 2024-09-19T12:04:30.520 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.42839.log: /var/log/ceph/ceph-client.admin.49404.log: 29.6% 80.6% -- replaced with /var/log/ceph/ceph-client.admin.42839.log.gz 2024-09-19T12:04:30.521 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49404.log.gz 2024-09-19T12:04:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99830.log 2024-09-19T12:04:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54814.log 2024-09-19T12:04:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.116943.log: /var/log/ceph/ceph-client.admin.99830.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.116943.log.gz 2024-09-19T12:04:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140543.log 2024-09-19T12:04:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.54814.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.54814.log.gz 2024-09-19T12:04:30.521 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70811.log 2024-09-19T12:04:30.521 INFO:teuthology.orchestra.run.smithi120.stderr: 86.4%/var/log/ceph/ceph-client.admin.140543.log: -- replaced with /var/log/ceph/ceph-client.admin.99830.log.gz 2024-09-19T12:04:30.522 INFO:teuthology.orchestra.run.smithi120.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.140543.log.gz 2024-09-19T12:04:30.522 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101010.log 2024-09-19T12:04:30.522 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154725.log 2024-09-19T12:04:30.523 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.70811.log: /var/log/ceph/ceph-client.admin.101010.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.70811.log.gz 2024-09-19T12:04:30.523 INFO:teuthology.orchestra.run.smithi120.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.101010.log.gz 2024-09-19T12:04:30.523 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33094.log 2024-09-19T12:04:30.523 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.154725.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.154725.log.gz 2024-09-19T12:04:30.523 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136413.log 2024-09-19T12:04:30.523 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160629.log 2024-09-19T12:04:30.523 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.33094.log: /var/log/ceph/ceph-client.admin.136413.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.136413.log.gz 2024-09-19T12:04:30.523 INFO:teuthology.orchestra.run.smithi120.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.0.33094.log.gz 2024-09-19T12:04:30.524 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129333.log 2024-09-19T12:04:30.524 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86260.log 2024-09-19T12:04:30.524 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160629.log.gz 2024-09-19T12:04:30.524 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.129333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90980.log 2024-09-19T12:04:30.524 INFO:teuthology.orchestra.run.smithi120.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.129333.log.gz 2024-09-19T12:04:30.524 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.86260.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.86260.log.gz 2024-09-19T12:04:30.524 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119303.log 2024-09-19T12:04:30.525 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T12:04:30.525 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.90980.log: /var/log/ceph/ceph-client.admin.119303.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.90980.log.gz 2024-09-19T12:04:30.525 INFO:teuthology.orchestra.run.smithi120.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.119303.log.gz 2024-09-19T12:04:30.525 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124613.log 2024-09-19T12:04:30.525 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.159620.log 2024-09-19T12:04:30.525 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.124613.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.124613.log.gz 2024-09-19T12:04:30.525 INFO:teuthology.orchestra.run.smithi120.stderr: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T12:04:30.525 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107502.log 2024-09-19T12:04:30.526 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113993.log 2024-09-19T12:04:30.526 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.159620.log: /var/log/ceph/ceph-client.admin.107502.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.107502.log.gz 2024-09-19T12:04:30.526 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.0.159620.log.gz 2024-09-19T12:04:30.526 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105142.log 2024-09-19T12:04:30.526 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124023.log 2024-09-19T12:04:30.526 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.113993.log: 82.0%/var/log/ceph/ceph-client.admin.105142.log: -- replaced with /var/log/ceph/ceph-client.admin.113993.log.gz 2024-09-19T12:04:30.526 INFO:teuthology.orchestra.run.smithi120.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.105142.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122253.log 2024-09-19T12:04:30.526 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-19T12:04:30.527 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.124023.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.124023.log.gz 2024-09-19T12:04:30.527 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48224.log 2024-09-19T12:04:30.527 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103372.log 2024-09-19T12:04:30.527 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.122253.log: /var/log/ceph/ceph-client.admin.48224.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122253.log.gz 2024-09-19T12:04:30.527 INFO:teuthology.orchestra.run.smithi120.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.48224.log.gz 2024-09-19T12:04:30.527 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32714.log 2024-09-19T12:04:30.527 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.103372.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.103372.log.gz 2024-09-19T12:04:30.528 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127563.log 2024-09-19T12:04:30.528 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122843.log 2024-09-19T12:04:30.528 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32714.log: /var/log/ceph/ceph-client.admin.127563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32714.log.gz 2024-09-19T12:04:30.528 INFO:teuthology.orchestra.run.smithi120.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.127563.log.gz 2024-09-19T12:04:30.528 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104552.log 2024-09-19T12:04:30.528 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.122843.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.122843.log.gz 2024-09-19T12:04:30.528 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73277.log 2024-09-19T12:04:30.528 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81540.log 2024-09-19T12:04:30.529 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.104552.log: /var/log/ceph/ceph-client.admin.73277.log: 81.0% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104552.log.gz 2024-09-19T12:04:30.529 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73277.log.gz 2024-09-19T12:04:30.529 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118713.log 2024-09-19T12:04:30.529 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82720.log 2024-09-19T12:04:30.529 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.81540.log: /var/log/ceph/ceph-client.admin.118713.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.81540.log.gz 2024-09-19T12:04:30.529 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53634.log 2024-09-19T12:04:30.529 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.118713.log.gz 2024-09-19T12:04:30.529 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.82720.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.82720.log.gz 2024-09-19T12:04:30.530 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160811.log 2024-09-19T12:04:30.530 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113403.log 2024-09-19T12:04:30.530 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.53634.log: /var/log/ceph/ceph-client.admin.160811.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.53634.log.gz 2024-09-19T12:04:30.530 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160811.log.gz 2024-09-19T12:04:30.530 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-19T12:04:30.530 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95110.log 2024-09-19T12:04:30.531 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.113403.log: /var/log/ceph/ceph-mon.c.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.113403.log.gz 2024-09-19T12:04:30.531 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44634.log 2024-09-19T12:04:30.531 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.95110.log: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.95110.log.gz 2024-09-19T12:04:30.531 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150573.log 2024-09-19T12:04:30.532 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44634.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.44634.log.gz 2024-09-19T12:04:30.532 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131103.log 2024-09-19T12:04:30.532 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.150573.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.150573.log.gz 2024-09-19T12:04:30.532 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32921.log 2024-09-19T12:04:30.532 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.131103.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.131103.log.gz 2024-09-19T12:04:30.533 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31939.log 2024-09-19T12:04:30.533 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32921.log.gz 2024-09-19T12:04:30.533 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32291.log 2024-09-19T12:04:30.533 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.31939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31939.log.gz 2024-09-19T12:04:30.533 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96290.log 2024-09-19T12:04:30.533 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32291.log.gz 2024-09-19T12:04:30.534 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152343.log 2024-09-19T12:04:30.534 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.96290.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96290.log.gz 2024-09-19T12:04:30.534 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160707.log 2024-09-19T12:04:30.539 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.152343.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.152343.log.gz 2024-09-19T12:04:30.539 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32085.log 2024-09-19T12:04:30.539 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160707.log.gz 2024-09-19T12:04:30.539 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31629.log 2024-09-19T12:04:30.539 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32085.log.gz 2024-09-19T12:04:30.540 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92160.log 2024-09-19T12:04:30.540 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.31629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31629.log.gz 2024-09-19T12:04:30.540 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32292.log 2024-09-19T12:04:30.540 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.92160.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.92160.log.gz 2024-09-19T12:04:30.540 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32710.log 2024-09-19T12:04:30.540 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32292.log.gz 2024-09-19T12:04:30.540 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65068.log 2024-09-19T12:04:30.540 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32710.log.gz 2024-09-19T12:04:30.541 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160343.log 2024-09-19T12:04:30.541 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.65068.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.65068.log.gz 2024-09-19T12:04:30.541 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56069.log 2024-09-19T12:04:30.541 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160343.log.gz 2024-09-19T12:04:30.541 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157725.log 2024-09-19T12:04:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.56069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32084.log 2024-09-19T12:04:30.542 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.157725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157725.log.gz 2024-09-19T12:04:30.543 INFO:teuthology.orchestra.run.smithi120.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56069.log.gz 2024-09-19T12:04:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-19T12:04:30.544 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32084.log.gz 2024-09-19T12:04:30.545 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132283.log 2024-09-19T12:04:30.555 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 94.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106322.log 2024-09-19T12:04:30.556 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.132283.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.132283.log.gz 2024-09-19T12:04:30.556 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-19T12:04:30.557 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T12:04:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.106322.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.106322.log.gz 2024-09-19T12:04:30.559 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155955.log 2024-09-19T12:04:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.audit.log: 94.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T12:04:30.563 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32497.log 2024-09-19T12:04:30.565 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.155955.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.155955.log.gz 2024-09-19T12:04:30.565 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135233.log 2024-09-19T12:04:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32497.log.gz 2024-09-19T12:04:30.566 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73867.log 2024-09-19T12:04:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.135233.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.135233.log.gz 2024-09-19T12:04:30.568 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116353.log 2024-09-19T12:04:30.569 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.73867.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73867.log.gz 2024-09-19T12:04:30.570 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60546.log 2024-09-19T12:04:30.570 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.116353.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.116353.log.gz 2024-09-19T12:04:30.571 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56121.log 2024-09-19T12:04:30.573 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.60546.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.60546.log.gz 2024-09-19T12:04:30.574 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117533.log 2024-09-19T12:04:30.574 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.56121.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.56121.log.gz 2024-09-19T12:04:30.575 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62482.log 2024-09-19T12:04:30.576 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.117533.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.117533.log.gz 2024-09-19T12:04:30.576 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160499.log 2024-09-19T12:04:30.579 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.62482.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.62482.log.gz 2024-09-19T12:04:30.580 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57319.log 2024-09-19T12:04:30.580 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160499.log.gz 2024-09-19T12:04:30.580 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49994.log 2024-09-19T12:04:30.593 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.57319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153545.log 2024-09-19T12:04:30.593 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49994.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.49994.log.gz 2024-09-19T12:04:30.597 INFO:teuthology.orchestra.run.smithi120.stderr: 93.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36627.log 2024-09-19T12:04:30.598 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.153545.log: -- replaced with /var/log/ceph/ceph-client.admin.57319.log.gz 2024-09-19T12:04:30.599 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.153545.log.gz 2024-09-19T12:04:30.599 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77410.log 2024-09-19T12:04:30.600 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.36627.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.36627.log.gz 2024-09-19T12:04:30.600 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51199.log 2024-09-19T12:04:30.601 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.77410.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.77410.log.gz 2024-09-19T12:04:30.601 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32295.log 2024-09-19T12:04:30.602 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.51199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51199.log.gz 2024-09-19T12:04:30.603 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142313.log 2024-09-19T12:04:30.603 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32295.log.gz 2024-09-19T12:04:30.604 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65951.log 2024-09-19T12:04:30.604 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.142313.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.142313.log.gz 2024-09-19T12:04:30.605 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59256.log 2024-09-19T12:04:30.606 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.65951.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.65951.log.gz 2024-09-19T12:04:30.606 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44044.log 2024-09-19T12:04:30.612 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.59256.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.59256.log.gz 2024-09-19T12:04:30.612 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130513.log 2024-09-19T12:04:30.613 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44044.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.44044.log.gz 2024-09-19T12:04:30.613 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32695.log 2024-09-19T12:04:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.130513.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.130513.log.gz 2024-09-19T12:04:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160577.log 2024-09-19T12:04:30.615 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32695.log.gz 2024-09-19T12:04:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106912.log 2024-09-19T12:04:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160577.log.gz 2024-09-19T12:04:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47044.log 2024-09-19T12:04:30.618 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.106912.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.106912.log.gz 2024-09-19T12:04:30.618 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102192.log 2024-09-19T12:04:30.619 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47044.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.47044.log.gz 2024-09-19T12:04:30.619 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85670.log 2024-09-19T12:04:30.620 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.102192.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.102192.log.gz 2024-09-19T12:04:30.620 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80360.log 2024-09-19T12:04:30.621 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.85670.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.85670.log.gz 2024-09-19T12:04:30.622 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98650.log 2024-09-19T12:04:30.623 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.80360.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.80360.log.gz 2024-09-19T12:04:30.623 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56096.log 2024-09-19T12:04:30.624 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.98650.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.98650.log.gz 2024-09-19T12:04:30.624 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63127.log 2024-09-19T12:04:30.625 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.56096.log: 57.3% -- replaced with /var/log/ceph/ceph-client.admin.56096.log.gz 2024-09-19T12:04:30.625 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33045.log 2024-09-19T12:04:30.627 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.63127.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63127.log.gz 2024-09-19T12:04:30.628 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129923.log 2024-09-19T12:04:30.628 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.33045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33045.log.gz 2024-09-19T12:04:30.629 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55736.log 2024-09-19T12:04:30.630 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.129923.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.129923.log.gz 2024-09-19T12:04:30.630 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158366.log 2024-09-19T12:04:30.631 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55736.log: 57.7% -- replaced with /var/log/ceph/ceph-client.admin.55736.log.gz 2024-09-19T12:04:30.631 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121663.log 2024-09-19T12:04:30.632 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.158366.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.158366.log.gz 2024-09-19T12:04:30.632 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160655.log 2024-09-19T12:04:30.633 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.121663.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.121663.log.gz 2024-09-19T12:04:30.634 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157135.log 2024-09-19T12:04:30.634 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160655.log.gz 2024-09-19T12:04:30.635 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148803.log 2024-09-19T12:04:30.635 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.157135.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.157135.log.gz 2024-09-19T12:04:30.636 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47634.log 2024-09-19T12:04:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.148803.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.148803.log.gz 2024-09-19T12:04:30.637 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160369.log 2024-09-19T12:04:30.638 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47634.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.47634.log.gz 2024-09-19T12:04:30.638 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37795.log 2024-09-19T12:04:30.639 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160369.log.gz 2024-09-19T12:04:30.640 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115763.log 2024-09-19T12:04:30.640 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.37795.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37795.log.gz 2024-09-19T12:04:30.641 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34276.log 2024-09-19T12:04:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.115763.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115763.log.gz 2024-09-19T12:04:30.642 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160291.log 2024-09-19T12:04:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.34276.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.34276.log.gz 2024-09-19T12:04:30.643 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102782.log 2024-09-19T12:04:30.644 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160291.log.gz 2024-09-19T12:04:30.644 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114583.log 2024-09-19T12:04:30.645 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.102782.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.102782.log.gz 2024-09-19T12:04:30.645 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-19T12:04:30.646 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121073.log 2024-09-19T12:04:30.647 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.114583.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.114583.log.gz 2024-09-19T12:04:30.648 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151163.log 2024-09-19T12:04:30.648 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.121073.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.121073.log.gz 2024-09-19T12:04:30.649 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128153.log 2024-09-19T12:04:30.650 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.151163.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.151163.log.gz 2024-09-19T12:04:30.650 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31914.log 2024-09-19T12:04:30.651 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.128153.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.128153.log.gz 2024-09-19T12:04:30.651 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120483.log 2024-09-19T12:04:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.31914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31914.log.gz 2024-09-19T12:04:30.652 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118123.log 2024-09-19T12:04:30.654 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.120483.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.120483.log.gz 2024-09-19T12:04:30.655 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160551.log 2024-09-19T12:04:30.655 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.118123.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.118123.log.gz 2024-09-19T12:04:30.656 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32279.log 2024-09-19T12:04:30.656 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160551.log.gz 2024-09-19T12:04:30.657 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80950.log 2024-09-19T12:04:30.657 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32279.log.gz 2024-09-19T12:04:30.658 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146443.log 2024-09-19T12:04:30.659 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.80950.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.80950.log.gz 2024-09-19T12:04:30.659 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133463.log 2024-09-19T12:04:30.660 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.146443.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.146443.log.gz 2024-09-19T12:04:30.660 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135823.log 2024-09-19T12:04:30.661 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.133463.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.133463.log.gz 2024-09-19T12:04:30.662 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109863.log 2024-09-19T12:04:30.662 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.135823.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.135823.log.gz 2024-09-19T12:04:30.663 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160213.log 2024-09-19T12:04:30.663 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.109863.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.109863.log.gz 2024-09-19T12:04:30.664 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148213.log 2024-09-19T12:04:30.665 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160213.log.gz 2024-09-19T12:04:30.665 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155315.log 2024-09-19T12:04:30.666 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.148213.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.148213.log.gz 2024-09-19T12:04:30.666 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32088.log 2024-09-19T12:04:30.667 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.155315.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.155315.log.gz 2024-09-19T12:04:30.667 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31985.log 2024-09-19T12:04:30.668 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32088.log.gz 2024-09-19T12:04:30.668 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42814.log 2024-09-19T12:04:30.669 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.31985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31985.log.gz 2024-09-19T12:04:30.669 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160395.log 2024-09-19T12:04:30.670 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.42814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42814.log.gz 2024-09-19T12:04:30.670 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123433.log 2024-09-19T12:04:30.671 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160395.log.gz 2024-09-19T12:04:30.671 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39147.log 2024-09-19T12:04:30.672 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.123433.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.123433.log.gz 2024-09-19T12:04:30.673 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87440.log 2024-09-19T12:04:30.673 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.39147.log: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.39147.log.gz 2024-09-19T12:04:30.674 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56667.log 2024-09-19T12:04:30.675 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.87440.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.87440.log.gz 2024-09-19T12:04:30.675 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52994.log 2024-09-19T12:04:30.676 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.56667.log: 20.8% -- replaced with /var/log/ceph/ceph-client.admin.56667.log.gz 2024-09-19T12:04:30.676 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141133.log 2024-09-19T12:04:30.677 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.52994.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.52994.log.gz 2024-09-19T12:04:30.677 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55815.log 2024-09-19T12:04:30.678 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.141133.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.141133.log.gz 2024-09-19T12:04:30.678 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33021.log 2024-09-19T12:04:30.679 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.55815.log: 52.7% -- replaced with /var/log/ceph/ceph-client.admin.55815.log.gz 2024-09-19T12:04:30.679 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56044.log 2024-09-19T12:04:30.680 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.33021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33021.log.gz 2024-09-19T12:04:30.681 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83900.log 2024-09-19T12:04:30.681 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.56044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56044.log.gz 2024-09-19T12:04:30.682 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32089.log 2024-09-19T12:04:30.682 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.83900.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.83900.log.gz 2024-09-19T12:04:30.683 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145263.log 2024-09-19T12:04:30.684 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.32089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32089.log.gz 2024-09-19T12:04:30.686 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.145263.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.145263.log.gz 2024-09-19T12:04:30.721 INFO:teuthology.orchestra.run.smithi120.stderr: 93.0% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-19T12:04:31.017 INFO:teuthology.orchestra.run.smithi120.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-19T12:04:31.173 INFO:teuthology.orchestra.run.smithi151.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-19T12:04:31.757 INFO:teuthology.orchestra.run.smithi120.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-19T12:04:33.624 INFO:teuthology.orchestra.run.smithi120.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-19T12:04:33.793 INFO:teuthology.orchestra.run.smithi151.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-19T12:04:34.566 INFO:teuthology.orchestra.run.smithi151.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-19T12:04:34.971 INFO:teuthology.orchestra.run.smithi120.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-19T12:04:35.483 INFO:teuthology.orchestra.run.smithi151.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-19T12:04:37.044 INFO:teuthology.orchestra.run.smithi120.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-19T12:04:40.376 INFO:teuthology.orchestra.run.smithi151.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-19T12:04:40.377 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-19T12:04:40.377 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m9.991s 2024-09-19T12:04:40.377 INFO:teuthology.orchestra.run.smithi151.stderr:user 0m22.763s 2024-09-19T12:04:40.377 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m0.821s 2024-09-19T12:04:44.222 INFO:teuthology.orchestra.run.smithi120.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-19T12:04:44.224 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-19T12:04:44.224 INFO:teuthology.orchestra.run.smithi120.stderr:real 0m13.875s 2024-09-19T12:04:44.224 INFO:teuthology.orchestra.run.smithi120.stderr:user 0m29.828s 2024-09-19T12:04:44.224 INFO:teuthology.orchestra.run.smithi120.stderr:sys 0m1.109s 2024-09-19T12:04:44.225 INFO:tasks.ceph:Archiving logs... 2024-09-19T12:04:44.225 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912444/remote/smithi120/log 2024-09-19T12:04:44.226 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T12:04:47.856 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912444/remote/smithi151/log 2024-09-19T12:04:47.857 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T12:04:50.586 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T12:04:50.598 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T12:04:50.599 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T12:04:50.601 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T12:04:50.693 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T12:04:50.704 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T12:04:50.704 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T12:04:50.707 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T12:04:50.718 INFO:teuthology.orchestra.run.smithi120.stdout: remote refid st t when poll reach delay offset jitter 2024-09-19T12:04:50.718 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================== 2024-09-19T12:04:50.718 INFO:teuthology.orchestra.run.smithi120.stdout:*hv01.front.sepi 67.205.162.81 3 u 62 64 377 0.079 -8.318 1.394 2024-09-19T12:04:50.718 INFO:teuthology.orchestra.run.smithi120.stdout:+hv02.front.sepi 63.231.80.2 3 u 54 64 377 0.088 -7.066 0.945 2024-09-19T12:04:50.719 INFO:teuthology.orchestra.run.smithi120.stdout:+hv03.front.sepi 74.6.168.72 3 u - 64 377 0.085 -6.827 1.197 2024-09-19T12:04:50.719 INFO:teuthology.orchestra.run.smithi120.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-19T12:04:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-09-19T12:04:50.721 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-09-19T12:04:50.721 INFO:teuthology.orchestra.run.smithi151.stdout:*hv01.front.sepi 67.205.162.81 3 u 126 128 377 0.102 -1.582 0.144 2024-09-19T12:04:50.721 INFO:teuthology.orchestra.run.smithi151.stdout:+hv02.front.sepi 63.231.80.2 3 u - 128 377 0.081 -2.171 0.108 2024-09-19T12:04:50.721 INFO:teuthology.orchestra.run.smithi151.stdout:+hv03.front.sepi 74.6.168.72 3 u 130 128 377 0.099 -0.520 0.198 2024-09-19T12:04:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-19T12:04:50.722 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T12:04:50.733 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T12:04:50.734 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T12:04:50.743 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T12:04:50.752 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T12:04:50.761 INFO:teuthology.task.internal:Duration was 2419.818441 seconds 2024-09-19T12:04:50.761 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T12:04:50.779 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T12:04:50.780 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T12:04:50.783 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T12:04:50.821 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T12:04:50.822 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T12:04:50.822 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T12:04:50.874 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2024-09-19T12:04:50.874 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T12:04:50.885 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T12:04:50.886 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T12:04:50.923 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T12:04:50.953 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T12:04:50.953 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T12:04:50.991 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T12:04:51.051 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T12:04:51.066 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T12:04:51.067 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T12:04:51.079 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T12:04:51.091 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T12:04:51.105 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T12:04:51.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T12:04:51.129 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-09-19T12:04:51.143 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2024-09-19T12:04:51.162 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T12:04:51.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T12:04:51.192 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T12:04:51.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T12:04:51.206 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T12:04:51.220 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T12:04:51.221 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912444/remote/smithi120 2024-09-19T12:04:51.221 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T12:04:51.254 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912444/remote/smithi151 2024-09-19T12:04:51.254 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T12:04:51.276 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T12:04:51.276 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T12:04:51.295 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T12:04:51.320 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T12:04:51.332 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T12:04:51.332 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T12:04:51.342 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T12:04:51.343 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T12:04:51.345 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T12:04:51.349 INFO:teuthology.orchestra.run.smithi120.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 12:04 /home/ubuntu/cephtest 2024-09-19T12:04:51.368 INFO:teuthology.orchestra.run.smithi151.stdout: 658634 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 12:04 /home/ubuntu/cephtest 2024-09-19T12:04:51.370 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T12:04:51.382 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T12:04:51.414 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 2419.818440914154 failure_reason: No module named 'tasks.s3tests_java' flavor: default owner: scheduled_yuvalif@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=5a1cd85ca0874691bb403346754af2ce status: fail success: false 2024-09-19T12:04:51.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T12:04:51.503 INFO:teuthology.run:FAIL